KR101060175B1 - Touch screen control method, recording medium and cloud computing control method using the same - Google Patents

Abstract

A touch screen control method, a recording medium for the same, and a cloud computing control method using the same are provided.
According to an aspect of the present invention, there is provided a method of controlling a touch screen, the method including: detecting simultaneous touch points at two or more multiple points on the touch screen; Selecting an object according to a first dragging starting from two touch points among the detected multiple touch points; Displaying a plurality of command menus on the touch screen after the first dragging ends; Selecting one of the plurality of command menus; Storing the selected command and the selected object; And performing the stored command for the stored object according to the second dragging in a direction opposite to the first dragging. The touch screen control method according to the present invention includes a touch and two touch points at two points. Depending on the relative dragging (movement) direction of the touch point, various tasks can be performed intuitively and quickly.

Description

Touch screen control method, recording medium and cloud computing control method using the same {method for controlling touch screen, recording medium for the same, and method for controlling cloud computing}

The present invention relates to a touch screen control method, a recording medium for the same, and a cloud computing control method using the same. More specifically, a touch screen capable of performing various tasks intuitively and quickly according to a touch of two points and a relative dragging direction thereof. A control method, a recording medium therefor, and a cloud computing control method using the same.

Recently, in order to facilitate user input, mobile devices such as user terminals having a touch interface are increasing. In particular, most mobile devices such as portable media terminals or user terminals equipped with a touch interface are designed to operate by sensing a user's touch on the display screen.

Such touch-based mobile devices perform virtually the same or similar functions as computers with recent increase in computing power.

However, since the mobile device has a relatively small touch screen unlike a computer and does not have a separate interface device such as a mouse, it is very difficult to perform control commands such as copying and pasting at the same level as a computer. . Furthermore, even in the case of a computer having a touch screen, a computer control method based on a user gesture of the touch screen itself is urgently needed rather than a computer control through a mouse.

Accordingly, an object of the present invention is to provide a new touch screen control method based on a user's gesture gesture and a computer readable recording medium therefor.

Another problem to be solved by the present invention is to provide an effective cloud computing control method based on the user's gesture gesture.

The present invention to solve the above problems, the step of detecting the simultaneous touch point at two or more multiple points on the touch screen; Selecting an object according to a first dragging starting from two touch points among the detected multiple touch points; Displaying a plurality of command menus on the touch screen after the first dragging ends; Selecting one of the plurality of command menus; Storing the selected command and the selected object; And performing the stored command on the stored object according to the second dragging in a direction opposite to the first dragging.

In one embodiment of the present invention, the first dragging is a pinch gesture, and the second dragging is a reverse pinch gesture. In addition, the second dragging may be performed on a touch screen different from the touch screen on which the first dragging is performed.

In one embodiment of the present invention, the first dragging end is performed when the two touch points do not move for a predetermined time or more. In the object selection, an object through which the first dragging trajectory passes is selected.

In order to solve the above another problem, the present invention provides a recording medium on which program instructions for performing the above-described touch screen control method are recorded.

According to another aspect of the present invention, there is provided a method for detecting simultaneous touch points at two or more multiple points on a touch screen; Selecting an object according to a first dragging starting from two touch points among the detected multiple touch points; Detecting a third dragging pattern performed after the first dragging ends; Storing the dragging pattern and the object selected by the first dragging; Detecting a second dragging direction opposite to the first dragging and a fourth dragging pattern performed after the second dragging ends; And performing a predetermined command on the selected object when the third dragging pattern and the fourth dragging pattern coincide with each other.

In one embodiment of the present invention, the first dragging is a pinch gesture, and the second dragging is a reverse pinch gesture. In addition, the second dragging may be performed on a touch screen different from the touch screen on which the first dragging is performed, and the first dragging and the second dragging are terminated when the two touch points do not move for a predetermined time or more. The object selection may include selecting an object that passes the first dragging trajectory, and when a third dragging pattern and a fourth dragging pattern do not match, a predetermined command may not be performed on the selected object. In addition, the third dragging and the fourth dragging may be single touch dragging.

In accordance with another aspect of the present invention, there is provided a recording medium having recorded thereon program instructions for performing the above-described touch screen control method. The present invention also provides a cloud computing control method using the above-described touch screen control method. do.

The touch screen control method according to the present invention can perform various tasks intuitively and quickly according to the touch at two points and the relative dragging (movement) direction of the two touch points. In addition, in a cloud computing-based multi-terminal or touch environment, a user may use the interaction method according to the present invention, and the user may recall the stored contents with one touch at any time. Furthermore, even if the same dragging gesture, the user can select only a desired command among a plurality of command menus, and in a cloud computing environment, a plurality of users directly create their own patterns and perform another command for executing the command. By assigning and tagging motion gestures, more effective cloud computing control is possible.

1 is a block diagram of a touch screen control device according to an embodiment of the present invention.
2 to 5 are diagrams illustrating an example of using a copy / paste command for specific lines of document content according to an embodiment of the present invention.
6 and 7 are diagrams illustrating applications of performing a copy and paste command of a file displayed on a touch screen.
8 to 10 are views illustrating a touch screen control method according to another embodiment of the present invention.
11 is a flowchart illustrating a touch screen control method according to the above-described embodiment.
12 is a flowchart illustrating a touch screen control method according to an embodiment of the present invention.
13 to 16 illustrate a method of copying a predetermined document content line by the above-described method.

In order to fully understand the present invention, the operational advantages of the present invention, and the objects achieved by the practice of the present invention, reference should be made to the accompanying drawings which illustrate preferred embodiments of the present invention and the contents described in the accompanying drawings.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In addition, in order to clearly describe the present invention, parts irrelevant to the description are omitted, and the same reference numerals in the drawings indicate the same members.

Throughout the specification, when an element is referred to as " including " an element, it does not exclude other elements unless specifically stated to the contrary. The terms "part", "unit", "module", "block", and the like described in the specification mean units for processing at least one function or operation, And a combination of software.

The apparatus and method for controlling a touch screen according to the present invention can simply perform the selection of an object and a predetermined command for the selected object according to the dragging direction and the trajectory of two touch points generated from two fingers.

In an embodiment of the present invention, the predetermined command is a copy and paste command. According to the embodiment, the user first performs a pinch gesture, that is, a pinch gesture and a pinch gesture on an object to be copied. The object is selected in accordance with the direction and trajectory of the dragging (first dragging) occurring from. In this case, the user may select an object such as a file or a content through a very intuitive gesture as if the content or the file displayed on the screen is picked up by hand. As used herein, the object may be not only a simple image but also any form that is displayed and selected by a user such as a document file, content, and the like.

An object such as a file or document content selected by the first dragging is stored in the memory unit, and a predetermined command (for example, copy-pasting) is performed on the object by a second dragging gesture on the same or different touch screen. This is explained in more detail below.

1 is a block diagram of a touch screen control device according to an embodiment of the present invention.

Referring to FIG. 1, the touch screen controller 100 according to the present invention includes a touch screen 110, and includes a touch detector configured to detect simultaneous touches at two or more multiple points on the touch screen. 120). That is, the touch detector 120 detects user touches at multiple points, in particular, two points, and detects a continuous movement (dragging) pattern of the touch points generated by the pinch gesture and the like, and the direction thereof. .

In the present invention, an object displayed on the screen is selected according to dragging (eg, pinch gesture or first dragging) of a specific pattern detected by the touch detector 120, and the selected object is stored in the memory 130. The memory unit 130 may be a memory of an electronic device itself including a touch screen control device according to the present invention, or may be a network memory.

The touch screen control apparatus according to the present invention includes a controller 140 that performs a predetermined command on the selected and stored object when another dragging (second dragging) of a pattern distinguished from the first dragging is performed. . In an embodiment of the present invention, the direction of the second dragging is performed in a direction opposite to the first dragging. For example, the first dragging pinches two fingers toward a predetermined point. pinch), the second dragging may be an unpinch, an inverse gesture of a pinch gesture, which opens two fingers from a predetermined point, and vice versa.

Hereinafter, the present invention will be described in more detail with reference to the drawings and application examples.

2 to 4 are diagrams illustrating an application example of performing a copy and paste command of document contents according to an embodiment of the present invention.

Referring to FIG. 2, a user first touches two points 210 and 220 including a document line A to be copied among desired documents, and then performs a pinch gesture passing through the document lines (see FIG. 3). . In this case, the two touch points by the pinch gesture are not physically merged at the same point, but even when the touch point approaches a predetermined level due to the thickness of the finger, the touch point recognizes it as a continuous pinch gesture. Thus, the document lines therein are selected by the pinch gesture and stored in memory. For example, when two fingers are dragged to face each other by a predetermined length or more, it is determined as a pinch gesture for selecting and copying a document line, and the document lines between the two points 210 and 220 are all caused by the pinch gesture. Is selected.

Furthermore, in order to distinguish the pinch gesture for copying and the like from the same gesture for performing another command, the present invention may be performed only when there is a predetermined event (for example, when a touch longer than a predetermined time is maintained). Document selection and saving are performed according to the pinch gesture. According to the present invention, when the zoom command of the screen is performed by the pinch-back pinch gesture, and the copy / paste command is the pinch-back pinch gesture, the touch time before the pinch gesture may be divided. When the zoom command is to be performed, the pinch-back pinch gesture is performed immediately after the touch. On the contrary, when the copy command is performed, the pinch-back pinch gesture is performed after maintaining the touch for a predetermined time.

Referring to FIG. 4, the selected and stored document lines are pasted to the same or another touch screen, wherein the user moves a finger away from a certain point of the screen to which the user wants to paste (this corresponds to an inverse gesture of the pinching gesture). , Referred to as an inverse pinch gesture). That is, the first dragging pinch gesture and the second dragging pinch gesture are inverse gestures of the reverse pinch gesture, which are distinguished from each other in the dragging direction. The touch screen to which the selected and stored document lines are pasted may be a screen of the same electronic device or a screen of another separate electronic device.

6 and 7 are diagrams illustrating applications of performing a copy and paste command of a file displayed on a touch screen. Referring to FIG. 6, a plurality of files are displayed on a touch screen, and a pinch gesture passing through a file to be copied among the displayed plurality of files is performed. As a result, the file of the region where the first dragging of the pinch gesture passes is selected and stored in the memory unit. Referring to FIG. 7, after collecting two fingers at a predetermined point of a touch screen to be copied, the separation is performed by the second dragging gesture. In this case, the controller divides the second dragging and the first dragging according to the moving direction of the touch point, and the paste command of the selected file is performed according to the second dragging in which the touch point moves in a direction opposite to the first dragging. Accordingly, the touch screen control method according to the present invention comprises the steps of detecting a simultaneous touch point at two or more multiple points on the touch screen; Selecting an object according to a first dragging starting from the detected two touch points; And performing a predetermined command on the stored object according to a second dragging in a direction opposite to the first dragging. In the present invention, the screen on which the first dragging and the second dragging are performed may be a touch screen of the same or different electronic device. That is, a first dragging is performed on the first computer to select and copy a desired specific file or document line, and a second dragging is performed on another second computer to attach the selected specific file or document line. In this case, an object such as the selected file is distinguished and stored according to an individual in a network memory, and a corresponding object is called and pasted according to a specific gesture of the individual.

In the present invention, the first dragging is a pinch gesture, and the second dragging is a reverse pinch gesture, which is an inverse gesture of the pinch gesture. In this case, the pinch gesture and the reverse pinch gesture are divergent from a specific point or convergence to a specific point, and the present invention performs a command such as copying / pasting around the specific point, and thus, at a desired point with a simple operation. You can perform various commands. In the present invention, the object selection is to select an object belonging to the area where the first dragging passes. In contrast, if the first dragging gesture (pinch gesture) is performed by two fingers by a predetermined length, all contents, files, and the like in the moving vector direction of the first dragging gesture of the two fingers may be selected by the first dragging. have.

Another embodiment of the present invention allows a user to select one of a plurality of command menus instead of performing a predetermined command with a continuous first dragging (pinch gesture) and a second dragging (reverse pinch gesture). do.

8 to 10 are views illustrating a touch screen control method according to another embodiment of the present invention.

Referring to FIG. 8, an object such as a file, a picture, a document content or a file is selected according to the pinch gesture on the touch screen. In this case, the object selection is based on whether the touch trajectory of the dragging part or the whole passes as described above.

Referring to FIG. 9, a plurality of command menus 910 are displayed on the touch screen at a time when it is determined that the pinch gesture is substantially finished (for example, when the touch point is not moved for a predetermined time or more while the touch state is maintained). Is displayed. Thereafter, the user selects one of a plurality of displayed command menus, thereby storing the object selected by the first dragging gesture and the selected command signal (type). In an embodiment of the present invention, the plurality of command menus may be shaped like a dial, and the user may select any one of the plurality of command menus by rotating the dial. For example, when copying is desired, copying may be selected by moving a direction line connecting two finger touch points collected after the first dragging gesture to a point corresponding to the copying. However, the scope of the present invention is not limited to the range shown in FIG. 9, and any configuration that a user can select by displaying a plurality of command menus after performing the first dragging belongs to the scope of the present invention. In one embodiment of the present invention the storage by the first dragging gesture (pinch gesture) is stored in the electronic device itself with a touch screen or stored in an external server or the like, the first touch screen of another electronic device connected to the server 2 The instruction by dragging may be performed, as described above.

Referring to FIG. 10, in another touch screen, a user performs a reverse pinching gesture, which is a second dragging gesture. In this case, the electronic device including the touch screen is connected to a server in which a file selected by the first dragging and a command signal are stored in advance, and the storage command for the stored file is performed by the inverse pinch gesture which is the second dragging gesture. do. In FIG. 10, the selected command, the copy, is performed by the second dragging gesture.

11 is a flowchart illustrating a touch screen control method according to the above-described embodiment.

Referring to FIG. 11, the method for controlling a touch screen according to the present invention includes detecting simultaneous touch points at two or more multiple points on the touch screen (S210); Selecting an object according to a first dragging starting from the detected two touch points (S220); Displaying a plurality of command menus on the touch screen after the end of the first dragging, and selecting one of them (S230); Storing the selected command and the selected object (S240); And performing the stored command on the stored object according to the second dragging in the opposite direction to the first dragging (S250).

The inventors also note that when a large number of users use the above-described touch screen control method of the present invention on the same touch screen, the same pattern of pinch-back pinch gestures can be performed by multiple users, in which case an unwanted file Note that commands such as copying and pasting can be performed. In particular, in order to solve the problem that a file selected by a user A as a pinch gesture and a file selected by a user B as a pinch gesture in a clouding computer environment cannot be stored at the same time on the same clouding computer, the present invention provides a pinch gesture ( After the first dragging), a method of allocating a user's identification pattern with a predetermined gesture is provided.

12 is a flowchart illustrating a touch screen control method according to an embodiment of the present invention.

Referring to FIG. 12, the touch screen control method according to the present invention includes detecting a simultaneous touch point at two or more multiple points on the touch screen (S310); Selecting an object according to the first dragging starting from the detected two touch points (S320); Detecting a third dragging pattern performed after the first dragging ends (S330); Storing an object selected by the first dragging and the third dragging pattern (S340); Detecting a second dragging pattern performed after the second dragging and the second dragging in the opposite direction to the first dragging (S350); And performing a predetermined command on the selected object when the third dragging pattern and the fourth dragging pattern coincide with each other (S360).

13 to 16 illustrate a method of copying a predetermined document content line by the above-described method.

Referring to FIG. 13, a user first selects a predetermined document content line as a first dragging gesture, a pinch gesture. After the first dragging gesture, the user releases one of the two touch points and performs dragging (third dragging) in the desired pattern with the other (see FIG. 14). At this time, the pattern related to the direction, position, etc. of the third dragging is stored, and the third dragging pattern is allocated to the object selected by the first dragging, and stored in an internal or external memory.

Referring to FIG. 15, the same user performs a second dragging gesture with respect to the same or another touch screen. In the present invention, the second dragging gesture is a multi-touch dragging performed in a direction opposite to the first dragging gesture. In an embodiment of the present invention, the second dragging gesture is a reverse pinching gesture, which is the same as described above.

Referring to FIG. 16, after performing the second dragging gesture, the user releases one touch and performs dragging (fourth dragging) of a predetermined pattern while maintaining the other touch. 14 and 16, the third and fourth dragging patterns are the same. That is, if the patterns of the third and fourth dragging are the same, a predetermined command for the object selected by the pinch gesture, which is the first dragging gesture, is performed by the inverse pinch gesture, which is the second dragging gesture.

The present invention provides an electronic device including the touch screen control device described above. Herein, the electronic device includes any and all devices having a screen that can be input by a user as described above and having an operation processing function. For example, mobile devices, laptops, netbooks, computers and the like are examples of such electronic devices. In addition, the present invention provides a cloud computing control method based on the touch screen control method described above. That is, the user stores his or her own dragging pattern, file, command, etc. in the server connected to the client through one client, and executes the storage command for the storage file in another client connected to the server. At this time, whether or not the command is performed is determined according to whether the unique pattern (the third dragging and the fourth dragging) matches. This is as described above, and thus will be omitted.

As described above, although the present invention has been described by way of limited embodiments and drawings, the present invention is not limited to the above-described embodiments, which can be modified by those skilled in the art to which the present invention pertains. Modifications are possible. Accordingly, the spirit of the invention should be understood only by the claims set forth below, and all equivalent or equivalent modifications will fall within the scope of the invention.

In addition, the apparatus according to the present invention can be embodied as computer readable codes on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, hard disk, flash drive, and the like, which are also implemented in the form of a carrier wave (for example, transmission over the Internet). It also includes. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

Claims (15)

As a touch screen control method, the method
Detecting simultaneous touch points at two or more multiple points on the touch screen; Selecting an object according to a first dragging starting from two touch points among the detected multiple touch points;
Displaying a plurality of command menus on the touch screen after the first dragging ends;
Selecting one of the plurality of command menus;
Storing the selected command and the selected object; And
And performing the stored command on the stored object according to the second dragging in a direction opposite to the first dragging. The method of claim 1,
And wherein the first dragging is a pinch gesture and the second dragging is a reverse pinch gesture. Claim 3 was abandoned when the setup registration fee was paid. The method of claim 1,
And the second dragging is performed on a touch screen different from the touch screen on which the first dragging is performed. Claim 4 was abandoned when the registration fee was paid. The method of claim 1,
The first dragging end is performed when the two touch points do not move for a predetermined time or more. The method of claim 1,
And an object passing through the first dragging trajectory is selected in the object selection. A recording medium on which program instructions for performing the touch screen control method according to any one of claims 1 to 5 are recorded. As a touch screen control method, the method
Detecting simultaneous touch points at two or more multiple points on the touch screen;
Selecting an object according to a first dragging starting from two touch points among the detected multiple touch points;
Detecting a third dragging pattern performed after the first dragging ends;
Storing the dragging pattern and the object selected by the first dragging; Detecting a second dragging direction opposite to the first dragging and a fourth dragging pattern performed after the second dragging ends; And
And performing a predetermined command on the selected object when the third dragging pattern and the fourth dragging pattern coincide with each other. The method of claim 7, wherein
And wherein the first dragging is a pinch gesture and the second dragging is a reverse pinch gesture. Claim 9 was abandoned upon payment of a set-up fee. The method of claim 7, wherein
And the second dragging is performed on a touch screen different from the touch screen on which the first dragging is performed. Claim 10 was abandoned upon payment of a setup registration fee. The method of claim 7, wherein
The first dragging and the second dragging end are performed when the two touch points do not move for a predetermined time or more. The method of claim 7, wherein
And an object passing through the first dragging trajectory is selected in the object selection. The method of claim 7, wherein
And if the third dragging pattern and the fourth dragging pattern do not match, a predetermined command for the selected object is not performed. The method of claim 12,
And the third dragging and the fourth dragging are single touch dragging. A recording medium on which program instructions for performing the touch screen control method according to any one of claims 7 to 13 are recorded. Claim 15 was abandoned upon payment of a registration fee. The cloud computing control method by the touch screen control method according to any one of claims 7 to 13.

Images