CN102375580A - Operation method of multi-point control - Google Patents

Abstract

An operation method of a multipoint control for controlling a cursor in a display device through an input device having a multipoint input function, the operation method comprising: acquiring an operation range of an input device and a display range of a display device; drawing a cursor and setting a corresponding mapping block in a display device; acquiring a cursor movement vector by the input device, moving the position of a cursor on the display device according to the cursor movement vector, and resetting the position of the mapping block; when at least one object is selected from the mapping block and the multi-point input function is started, the user can perform multi-point operation on the object through the input device.

Description

Operation method of multi-point control

technical field

The invention relates to a control method for multi-point operation, in particular to an operation method for multi-point control between different devices.

Background technique

With the advancement of technology, various input peripherals have also emerged. Especially with the development of touch screens, users can select different target objects (which may be windows, pictures or built-in functions of application programs) by touching the screen with their fingers. Especially the seventh-generation window operating system (Windows 7, hereinafter referred to as Windows 7) released by Microsoft Corporation has built-in touch screen related functions in Windows 7.

The user can slide the finger on the touch screen 100 to zoom or move the target object 110 on the screen. Please refer to FIG. 1 , which is a schematic diagram of multi-touch in the prior art. The multi-touch function of Windows 7 uses the movement of multiple fingers as the operation on the target object 110 . Microsoft defines these various methods performed by using the multi-touch function as gesture operations. Windows 7 currently supports the following gestures: Zoom, move with one or two fingers, rotate, tap with two fingers, and hold and tap. For example, when a user uses two fingers to touch any graphic file on the screen, Windows 7 will immediately activate the multi-touch function. When the relative distance between the two fingers increases, the image file will be enlarged; otherwise, the image will be reduced.

However, since the cost of a touch display device is proportional to its size, a large-size touch display device may be several times more expensive than a display device of the same size. Moreover, a large-sized touch display device is not necessary for users. Due to the large size of the touch display device, it is bound to cause a burden on the operation of the user. Therefore, some manufacturers propose to use small touch devices (or touch display devices) to operate large-sized touch display devices. Although the small touch display device can provide easy operation for the user. But the operation of the small touch display device is to project the coordinates of the large size into the small touch device in the way of pixel mapping. Such an approach will result in the loss of excessive cursor displacement. Since the operating range of the small touch device is small, when projected onto a large-sized display device, the displacement of the movement will inevitably be enlarged in a certain proportion. Therefore, when the user operates the cursor through the small touch device, although the user only moves a short distance, the cursor on the large touch display device may move a large distance. Therefore, this imaging mode causes inconvenience to the user in operation.

Contents of the invention

In view of the above problems, the main purpose of the present invention is to provide a multi-point control operation method for controlling a cursor in a display device through an input device having a multi-point input function.

To achieve the above purpose, the multi-point control operation method disclosed in the present invention includes the following steps: when the input device is electrically connected to the display device, the mapping program is loaded to obtain the operating range of the input device and the display range of the display device; Draw the cursor in the display device, and set the image block in the display device according to the cursor and the operating range; obtain the cursor movement vector from the input device, and use the cursor movement vector to move the position of the cursor on the display device, and re- Set the position of the image block; select the object from the image block, and wait for the multi-point input function to be activated; when the input device activates the multi-point input function, the input device will generate the relative position according to the first control point and the second control point The amount of displacement used to change the operational properties of the object.

The present invention proposes a small-sized input device to activate a multi-touch function on a large-sized display device. The user can move the cursor on the display device through the input device. When the input device continuously receives the cursor movement signal, the mapping program converts the cursor movement vector of the input device into a cursor movement vector of the display device according to the block correspondence table. In addition, the user can use the multi-touch function of the input device to perform corresponding operations on the objects in the screen of the display device. Regarding the features and implementation of the present invention, the preferred embodiments are described in detail below in conjunction with the drawings.

Description of drawings

FIG. 1 is a schematic diagram of multi-touch in the prior art;

FIG. 2A is a schematic diagram of the architecture of the present invention;

2B is a schematic diagram of a display unit with a computer device of the present invention;

Fig. 3 is a schematic diagram of the operation flow of the present invention;

FIG. 4A is a schematic diagram of a mapping block of the present invention;

4B is a schematic diagram of the relative position of the cursor and the image block of the present invention;

FIG. 4C is a schematic diagram of drawing an image block when moving the cursor according to the present invention;

FIG. 5A is a schematic diagram of the operation flow of cursor interruption processing in the present invention;

Figure 5B is a schematic diagram of the operation of the present invention;

FIG. 5C is another schematic diagram of the operation of the present invention;

FIG. 6A is a schematic diagram of the placement angle of the scaling object of the present invention;

FIG. 6B is a schematic diagram of the placement angle of the scaling object in the present invention;

FIG. 6C is a schematic diagram of the placement angle of the rotating object of the present invention;

FIG. 6D is a schematic diagram of the arrangement angle of the rotating object of the present invention.

7A is a schematic diagram of the present invention before moving multiple objects in the mapping block;

7B is a schematic diagram of the present invention after moving multiple objects in the mapping block;

7C is a schematic diagram of the present invention before the rotation of multiple objects in the mapping block;

FIG. 7D is a schematic diagram of a plurality of objects in the mapping block after rotation according to the present invention;

FIG. 8A is a schematic diagram of the image of the input device before the image block moves according to the present invention;

FIG. 8B is a schematic diagram of an image of the input device after the image block is moved according to the present invention.

[Description of main component symbols]

touch screen 100

target audience 110

Computer device 210

Imager 211

display device 220

Display range 221

input device 230

Operating range 231

Cursor 240

map block 310

Object 610

Detailed ways

Please refer to "FIG. 2A" and "FIG. 2B", which are schematic diagrams of different implementations of the present invention. The present invention can be applied to a display device with computing processing (such as "FIG. 2A"), and can also be applied to a stand-alone computer device. In order to clarify the connection and operation relationship of each component, an independent computer device is used as an illustration below. The present invention includes: a computer device 210 , a display device 220 and an input device 230 . The computer device 210 may be, but not limited to, a personal computer, a server, a notebook computer (notebook) or an integrated personal computer (All-in-one PC). The mapping program 211 is stored in the computer device 210 . The display device 220 is electrically connected to the computer device 210 for rendering an image output by the computer device 210 .

Generally speaking, the display device 220 may have more than one pixel display range 221 . For example: display range 221 of 800*600 pixels, 1024*768 pixels or 1920*1200 pixels. Therefore, when the computer device 210 executes the operating system, the current display range 221 of the display device 220 can be obtained through the operating system.

The input device 230 in the present invention is an electronic device with multi-point input function. The input device 230 can be a digital personal assistant (personal digital assistant, PDA), digital pad, mouse, trackball, mobile phone or tablet computer (tablet). When the input device 230 is connected to the computer device 210 , the computer device 210 starts to run the mapping program 211 to obtain the operating range 231 of the input device 230 and the display range 221 of the display device 220 . Wherein, the connection mode between the input device 230 and the computer device 210 can be connected by means of Universal Serial Bus (Universal Serial Bus, USB) or Bluetooth wireless transmission.

The computer device 210 executes the mapping program 211 according to the acquired operating range 231 of the input device 230 and the display range 221 of the display device 220 . Please refer to FIG. 3 , which is a schematic diagram of the operation flow of the present invention. Operation of the present invention comprises the following steps:

Step S310: when the input device is electrically connected to the computer device, load the image program to obtain the operating range of the input device and the display range of the display device;

Step S320: setting the cursor on the initial coordinates, and setting the image block in the display device according to the cursor and the operating range;

Step S330: Obtain a cursor movement vector from the input device, and use the cursor movement vector to move the position of the cursor on the display device, and reset the position of the image block; and

Step S340: When the user selects an object from the image block and activates the multi-point input function, the input device is used to change the operation attribute of the object according to the relative displacement generated by the first control point and the second control point.

First, run the imaging program 211 on the computer device 210 , and then connect the input device 230 and the display device 220 to the computer device 210 respectively. After the input device 230 is connected and the display device 220 is connected to the computer device 210 , the mapping program 211 starts to initialize the initial position of the input device 230 relative to the cursor 240 . The display range 221 of the display device 220 is not necessarily equal to the operation range 231 of the input device 230 .

Therefore, it is necessary to synchronize the cursor 240 on the display device 220 with the input device 230 so that the input device 230 can correctly correspond to the cursor 240 of the display device 220 . Generally speaking, the computer device 210 can obtain the display range 221 of the display device 220 after it starts up and enters the operating system. Therefore, the mapping program 211 can obtain the current display range 221 from the operating system first, so as to perform initial processing when the input device 230 is connected to the computer device 210 . Of course, the imaging program 211 may also perform the process of acquiring the display range 221 when the input device 230 is installed.

During the initial processing of the cursor 240 , the cursor 240 can be set at the center or four corners of the display device 220 , so that the input device 230 can accurately correspond to a specific area of the display device 220 . And in order to clearly illustrate the position of the cursor 240, the position of the cursor 240 is defined as the initial coordinate.

After completing the initialization of the cursor 240, the mapping program 211 sets a mapping block 310 from the display device 220 according to the position of the cursor 240. Please refer to FIG. 4A , which is a schematic diagram of the mapping block 310 of the present invention. The image block 310 is not physically drawn on the display device 220, so it is represented by a dotted box in "FIG. 4A". In addition to depending on the size of the operating range 231 , the range of the mapping block 310 can also provide different mapping relationships to the input device 230 according to the display range 221 . In order to realize various mapping relationships, the mapping program 211 generates a block correspondence table (not shown) according to the operating range 231 and the display range 221 . In the block correspondence table, it is recorded that the image block 310 corresponds to the operable range of the display device 220 , and the X-axis and Y-axis of the recorded image block 310 correspond to the ratio of the X-axis and Y-axis of the display device 220 .

For example: when the mapping relationship between the X-axis and the Y-axis of the mapping block 310 corresponding to the display device 220 is 1:1, it means that the mapping block 310 corresponds to a pixel position of the display device 220; if the mapping block 310 When the mapping relationship of the X-axis corresponding to the display device 220 is 1:1 and the mapping relationship of the Y-axis corresponding to the display device 220 is 1:2, it means that the mapping block 310 corresponds to one pixel of the display device 220 on the X-axis. Pixel position, but the movement on the Y axis is one pixel corresponding to two pixels. Similarly, the present invention can be applied to different mapping relationships, so they are not listed one by one.

After determining the corresponding mapping relationship from the block correspondence table, the computer device 210 sets the mapping block 310 including the cursor 240 on the display device 220 . The present invention does not limit the position of the cursor 240 relative to the image block 310 . However, for the convenience of description, the following description is based on the center point of the mapping block 310 as the position of the cursor 240. Please refer to FIG. 4B , which is the relative position of the cursor 240 and the mapping block 310 of the present invention. schematic diagram.

Please match "Figure 4A" and "Figure 4C" at the same time. Wherein, "FIG. 4C" is a schematic diagram of drawing the image block 310 when the cursor 240 is moved. First, after the initial completion of the cursor 240 and the image block 310 (as shown in FIG. 4A ), the cursor 240 will be placed in the center of the display area 221 . When the user operates the cursor 240 through the input device 230, the computer device 210 will obtain the cursor movement vector from the input device 230, and use the cursor movement vector to move the position of the cursor 240 on the display device 220, and reset the image The location of block 310 . Because the movement of the input device 230 is calculated in dot per pixel (DPI for short), the movement of the input device 230 relative to the cursor 240 of the display device 220 also needs to be adjusted as follows. The computer device 210 calculates the moving distance of the cursor 240 on the display device 220 from the cursor movement vector obtained by the input device 230 according to the block correspondence table.

Assume that the display range 221 of the display device 220 has a screen resolution of 1024*768, the operating range 231 of the input device 230 has a size of 70*50 pixels, and the mapping relationship between the X axis and the Y axis is 1:10 for illustration. After the mapping program 211 completes the initial movement of the cursor 240, it is assumed that the mapping program 211 will display the cursor 240 on the coordinate (512, 384) of the display device 220, and use this coordinate as the initial coordinate. The mapping program 211 sets a mapping block 310 with a size of 70*50 pixels on the display device 220 with the initial coordinates as the axis (as shown in FIG. 4C ).

When the user moves the cursor 240 through the input device 230, the input device 230 generates a set of cursor movement vectors. If the touchpad is used as the input device 230 as an example, when the user presses the finger on the touchpad, the computer device 210 regards the pressed position as a reference coordinate. As the finger moves on the touchpad, the computer device 210 will continuously acquire the signal output by the input device 230 , and generate a corresponding cursor movement vector according to the reference coordinates and the coordinates of the current position of the finger. If the user moves 10 pixels from left to right along the X axis from the reference coordinates, and 20 pixels from bottom to top along the Y axis. The computer device 210 will finally obtain a set of (10, 20) cursor movement vectors. According to the cursor movement vector, the computer device 210 moves the cursor 240 in the display device 220 by 1 pixel from left to right along the X axis (10/10=1), and moves the cursor 240 by 2 pixels from bottom to top along the Y axis (20/10). Finally, the cursor 240 will move to the coordinate position (513, 386) on the display device 220 .

Since the operation range 231 of the input device 230 is smaller than the display range 221 of the display device 220 , the user has moved the finger to the edge of the operation range 231 . In order to provide continuous movement of the cursor 240 and the image block 310, the present invention further proposes the following interrupt processing of the cursor 240, and please also refer to "FIG. 5A", "FIG. 5B" and "FIG. 5C":

Step S510: when the input device interrupts and receives the cursor movement vector, the computer device records the position of the cursor at the time of the interruption; and

Step S520: receiving a new cursor movement vector, the computer device moves the cursor on the display device according to the new cursor movement vector, and resets the position of the image block, taking the position of the cursor when it was interrupted last time as a starting point.

When the user's finger moves to the edge of the input device 230 (as shown in FIG. 5B ), the user cannot continue to move the cursor, so the user must move the finger away. At the same time, the computer device 210 will record the current position of the cursor 240 . The user can place the finger anywhere in the operating range 231 of the input device 230 and continue to operate the cursor 240 (as shown in FIG. 5C , where the dotted finger represents the position before moving). The computer device 210 receives the new cursor movement vector, and takes the position of the cursor 240 when it was interrupted last time as the starting point. The computer device 210 moves the cursor 240 on the display device 220 according to the new cursor movement vector, and resets the position of the image block 310 . Therefore, the mapping block 310 will also be moved to a new position, so as to synchronize the corresponding relationship between the input device 230 and the mapping block 310 .

Then, the user can select the object 610 to be controlled from the mapping block 310 and activate the multi-point input function. Wherein, the user can move to any object 610 in the mapping block 310 with a finger, and click (click) the object 610 to complete the action of selecting the object 610 . When the user presses the first finger on the input device 230 , it defines the first control point here. When the user presses the second finger on the input device 230, the second finger is defined as the second control point. When the computer device 210 receives the first control point and the second control point at the same time, the computer device 210 regards it as the multi-point input function being activated.

When the computer device 210 receives the multi-point input function to be activated, the computer device 210 will receive the relative displacement of multiple fingers (the first control point and the second control point received by the input device 230) according to the input device 230 amount to change the operational properties of the object 610. The operation attribute includes the coordinate position of the object 610, the display range 221 or the rotation angle. For example, the user can change the image size of the object 610 through the moving distance between two fingers (that is, the distance between the first control point and the second control point received by the input device 230). Please refer to " Figure 6A" and "Figure 6B". The user can also rotate the placement angle of the object 610 by changing the relative position between the two fingers (that is, the first control point and the second control point). Please refer to FIG. 6C and FIG. 6D .

In addition to the above-mentioned process of controlling a single object 610 in the map block 310 , the present invention can also be applied to the process of having more than two objects 610 in the map block 310 . Please refer to "FIG. 7A" and "FIG. 7B", which are schematic diagrams of the movement states of multiple objects in the mapping block, respectively. When multiple objects 610 exist in the mapping block 310 at the same time, the user first selects any object 610 from the mapping block 310 (eg, clicks on the object 610 with a finger as a selection trigger signal). Then, the user presses another point with another finger to activate the multi-point input function. When the user activates the multi-point input function, the computer device 210 will determine the rotation or movement of the object 610 according to the displacement change between the first control point and the second control point. Please refer to "FIG. 7C" and "FIG. 7D", which are schematic diagrams of rotation states of multiple objects in the mapping block, respectively. In addition, if the user's other finger is pressing on another object 610 , the computer device 210 will modify the positions of the two objects 610 according to the displacement between the two fingers.

The above-mentioned implementation is illustrated by the input device 230 without the image display function, and the present invention can also be applied to the input device 230 with the image display function. Please refer to "FIG. 8A" and "FIG. 8B", which are schematic diagrams of images of the input device before and after the movement of the image block, respectively. If it is applied to an input device 230 with an image display function (such as a tablet computer or a touch-sensitive mobile phone), after the computer device 210 has set the image block 310, the computer device 210 will immediately map the image in the block 310 sent to the input device 230. When the cursor 240 and the image block 310 are moved, the computer device 210 will also transmit the image in the image block 310 to the input device 230 at the same time, so as to provide the user with viewing.

The present invention proposes a small-sized input device 230 to activate the multi-touch function on the large-sized display device 220 . The user can move the cursor 240 on the display device 220 through the input device 230 . When the input device 230 continuously receives the movement signal of the cursor 240 , the computer device 210 converts the cursor movement vector of the input device 230 into a cursor movement vector of the display device 220 according to the block correspondence table. In addition, the user can use the multi-touch function of the input device 230 to perform corresponding operations on the object 610 in the screen of the display device 220 .

Although the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention. Those skilled in the art can make various corresponding modifications according to the present invention without departing from the spirit and essence of the present invention. Changes and deformations, but these corresponding changes and deformations should fall within the scope of protection of the appended claims of the present invention.

Claims (8)

1. A multi-point control operation method, which is used to control a cursor in a display device through an input device with a multi-point input function, it is characterized in that the operation method comprises the following steps: obtaining an operating range of the input device and a display range of the display device; setting the cursor on an initial coordinate, and setting an image block in the display device according to the cursor and the operating range; Obtaining a cursor movement vector from the input device, and using the cursor movement vector to move the position of the cursor on the display device, and resetting the position of the image block; When the input device receives a first control point and a second control point, the multi-point input function is activated, wherein the input device regards the current position of the cursor as the first control point and the second control point is another press signal at a location other than the first control point; and When at least one object is selected from the image block and the multi-point input function is activated, the input device is used to change the object's position according to a relative displacement generated by the first control point and the second control point. An operational attribute. 2. The operation method of multi-point control as claimed in claim 1, characterized in that, the step of setting the mapping block further comprises: generating a block correspondence table according to the operating range and the display range; obtaining the range of the image block from the block correspondence table; and The image block including the cursor is set on the display device. 3. The operation method of multi-point control as claimed in claim 1, wherein the step of obtaining the cursor movement vector comprises: A block correspondence table generated according to the operating range and the display range; and According to the block correspondence table, the moving distance of the cursor on the display device is calculated from the cursor movement vector acquired by the input device. 4. The operation method of multi-point control as claimed in claim 3, wherein the step of obtaining the cursor movement vector further comprises: When the input device interrupts receiving the cursor movement vector, record the position of the cursor at the time of interruption; and The new cursor movement vector is received, and the cursor is moved on the display device according to the new cursor movement vector, and the position of the image block is reset by taking the position of the cursor when it was interrupted last time as a starting point. 5. The operation method of multi-point control according to claim 1, wherein the operation attribute of the object is a coordinate position, a display range or a rotation angle. 6. The operation method of multi-point control as claimed in claim 1, wherein if the input device has a display function, when the image block is set in the display device, the image area of the display device The image in the block is passed and drawn on the input device. 7. The operation method of multi-point control as claimed in claim 6, wherein when the cursor movement vector is output, in addition to resetting the location of the mapping block in the display device, the The image in the image block is drawn on the input device. 8. The operation method of multi-point control according to claim 1, further comprising a computer device electrically connected to the display device and the input device.

Images