CN106648102A - Method and system of controlling terminal equipment through non-touch gesture - Google Patents
Method and system of controlling terminal equipment through non-touch gesture Download PDFInfo
- Publication number
- CN106648102A CN106648102A CN201611219132.9A CN201611219132A CN106648102A CN 106648102 A CN106648102 A CN 106648102A CN 201611219132 A CN201611219132 A CN 201611219132A CN 106648102 A CN106648102 A CN 106648102A
- Authority
- CN
- China
- Prior art keywords
- terminal device
- control
- touch
- predetermined
- gesture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to a method of controlling terminal equipment through a non-touch gesture. The method is characterized by comprising the steps: recognizing the non-touch gesture of a user made on the back surface of the terminal equipment; judging whether the non-touch gesture is matched with a predetermined gesture or not; and if so, pre-operating a predetermined operable object of the terminal equipment in a current display interface. The invention further provides a system of controlling the terminal equipment through the non-touch gesture. The method and system provided by the invention can solve the problem that the user selects a display content of the terminal equipment inconveniently, and the convenience of user operation is improved.
Description
Technical field
The present invention relates to electronic technology field, and in particular to it is a kind of by non-touch-control gesture come the method for control terminal equipment
And system.
Background technology
With the display screen of the terminal devices such as the development of electronic technology, mobile phone it is increasing.It is this kind of in user's one-handed performance
During terminal device, due to terminal device display screen it is larger so that user is needing to operate the display content in display screen
Shi Wufa is directly chosen to the content for wanting selection, causes the inconvenience of user operation.
The content of the invention
In view of the foregoing, it is necessary to propose it is a kind of by non-touch-control gesture come the method and system of control terminal equipment,
It can solve the problems, such as that user is inconvenient to choose the display content of terminal device, improve the convenience of user operation.
The first aspect of the application provide it is a kind of by non-touch-control gesture come the method for control terminal equipment, methods described bag
Include：
The non-touch-control gesture that identifying user is made at the back side of the terminal device；
Judge whether the non-touch-control gesture matches with default gesture；
If the non-touch-control gesture matches with default gesture, to the current display interface of the terminal device in it is pre-
Fixed operable object carries out scheduled operation.
In alternatively possible implementation, the non-touch-control hand that the identifying user is made at the back side of the terminal device
Gesture includes：
Recognized by the back mounted ultrasonic sensor or camera or infrared sensor of the terminal device described
Non-touch-control gesture.
In alternatively possible implementation, the operable object includes operation button or control, described to described
Predetermined operable object in the current display interface of terminal device carries out scheduled operation to be included：
Choose the operation button or the control in the current display interface of the terminal device；
Methods described also includes：
Detection acts on the user operation of the terminal device；
When the user operation meets predetermined condition, control the operation button or control performs corresponding function.
It is predetermined operable in the current display interface to the terminal device in alternatively possible implementation
Object carries out scheduled operation to be included：
Choose the predetermined operable object in the current display interface of the terminal device；Or
The predetermined operable object controlled in the current display interface of the terminal device performs corresponding function；Or
Highlight the predetermined operable object in the current display interface of the terminal device；Or
The default viewing area that the predetermined operable object is moved to the terminal device is shown.
It is predetermined operable in the current display interface to the terminal device in alternatively possible implementation
Object carries out scheduled operation to be included：
Show and make a reservation for the preview interface after operable object is triggered；Or
Show that difference makes a reservation for the preview interface after operable objects are triggered in turn；
Methods described also includes：
Detection acts on the user operation of the terminal device；
When the user operation meets predetermined condition, into the preview interface.
It is described to make a reservation for operable object including predetermined word, predetermined pictures, pre- accordatura in alternatively possible implementation
Video, predetermined control, scheduled operation button, input frame or dummy keyboard.
The second aspect of the application provide it is a kind of by non-touch-control gesture come the system of control terminal equipment, the system bag
Include：
Recognition unit, for the non-touch-control gesture that identifying user is made at the back side of the terminal device；
Judging unit, for judging whether the non-touch-control gesture matches with default gesture；
Operating unit, if matching for the non-touch-control gesture and default gesture, to the current of the terminal device
Predetermined operable object in display interface carries out scheduled operation.
In alternatively possible implementation, the operating unit specifically for：
Choose the operation button or control in the current display interface of the terminal device；
The system also includes：
Control unit, for the user operation that detection acts on the terminal device, meets predetermined in the user operation
During condition, control the operation button or control performs corresponding function.
In alternatively possible implementation, the operating unit specifically for：
Choose the predetermined operable object in the current display interface of the terminal device；Or
The predetermined operable object controlled in the current display interface of the terminal device performs corresponding function；Or
Highlight the predetermined operable object in the current display interface of the terminal device；Or
The default viewing area that the predetermined operable object is moved to the terminal device is shown.
In alternatively possible implementation, the operating unit specifically for：
Show and make a reservation for the preview interface after operable object is triggered；Or
Show that difference makes a reservation for the preview interface after operable objects are triggered in turn；
The system also includes：
Into unit, for the user operation that detection acts on the terminal device, meet predetermined in the user operation
During condition, into the preview interface.
The non-touch-control gesture that identifying user of the present invention is made at the back side of the terminal device；Judge the non-touch-control gesture
Whether match with default gesture；If the non-touch-control gesture matches with default gesture, to the current of the terminal device
Predetermined operable object in display interface carries out scheduled operation.The present invention also provides one kind and controls end by non-touch-control gesture
The system of end equipment.The present invention can solve the problems, such as that user is inconvenient to choose the display content of terminal device, improve user behaviour
The convenience of work.
Description of the drawings
Fig. 1 be the embodiment of the present invention one provide by non-touch-control gesture come the flow chart of the method for control terminal equipment.
Fig. 2 be the embodiment of the present invention two provide by non-touch-control gesture come the structure chart of the system of control terminal equipment.
Fig. 3 be embodiment three provide realization by non-touch-control gesture come the terminal device of the method for control terminal equipment
Structure chart.
Main element symbol description
Terminal device 1
By non-touch-control gesture come the system 10 of control terminal equipment
Storage device 20
Processing equipment 30
Display screen 40
Recognition unit 201
Judging unit 202
Operating unit 203
Following specific embodiment will further illustrate the present invention with reference to the accompanying drawing.
Specific embodiment
It is below in conjunction with the accompanying drawings and concrete real in order to be more clearly understood that the objects, features and advantages of the present invention
Apply example to describe the present invention.It should be noted that in the case where not conflicting, embodiments herein and embodiment
In feature can be mutually combined.
Many details are elaborated in the following description in order to fully understand the present invention, and described embodiment is only
Only it is a part of embodiment of the invention, rather than the embodiment of whole.Based on the embodiment in the present invention, ordinary skill
The every other embodiment that personnel are obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
Unless otherwise defined, all of technology used herein and scientific terminology and the technical field for belonging to the present invention
The implication that technical staff is generally understood that is identical.The term for being used in the description of the invention herein is intended merely to description tool
The purpose of the embodiment of body, it is not intended that of the invention in limiting.
Preferably, it is of the invention to be applied at one or more end come the method for control terminal equipment by non-touch-control gesture
In end equipment.The terminal device be it is a kind of can according to the instruction being previously set or store, carry out automatically numerical computations and/or
The equipment of information processing, its hardware includes but is not limited to microprocessor, special IC (Application Specific
Integrated Circuit, ASIC), programmable gate array (Field-Programmable Gate Array, FPGA), number
Word processing device (Digital Signal Processor, DSP), embedded device etc..
The terminal device may be, but not limited to, any one can pass through keyboard, mouse, remote control, touch with user
The mode such as plate or voice-operated device carries out the electronic product of man-machine interaction, for example, personal computer, panel computer, smart mobile phone, individual
Personal digital assistant (Personal Digital Assistant, PDA), game machine, IPTV (Internet
Protocol Television, IPTV), intelligent wearable equipment etc..
Embodiment one
Fig. 1 is for the offer of the embodiment of the present invention one by non-touch-control gesture come the flow chart of the method for control terminal equipment.
As shown in figure 1, the method specifically includes following steps：
101：The non-touch-control gesture that identifying user is made at the back side of terminal device.
The non-touch-control gesture can be recognized by the back mounted ultrasonic sensor of the terminal device.It is described super
Sonic sensor can include ultrasonic speaker and ultrasonic microphone.The ultrasonic speaker sends ultrasonic wave (for example
The ultrasonic wave of 20-22KHz), when user makes gesture at the back side of the terminal device, ultrasonic wave echo is produced, it is described super
Sound wave microphone receives the ultrasonic wave echo.Ultrasonic wave echo to receiving is analyzed, and obtains the non-touch-control gesture.Example
Such as, the ultrasonic wave echo to receiving carries out ultrasonic frequency feature extraction and analysis, when obtaining the moving direction of gesture and being formed
Between sequence, recycle HMM the time series is identified, obtain the non-touch-control gesture.The ultrasound
Ripple microphone can include multiple (such as 5), to obtain preferable accuracy of identification.
In another embodiment, the non-touch-control hand can be recognized by the back mounted camera of the terminal device
Gesture.The camera gathers the image at the back side of the terminal device, when user makes gesture at the back side of the terminal device
When, the image of user gesture is obtained, the image of the user gesture is identified, obtain the non-touch-control gesture.For example, profit
The image of the user gesture is split with image segmentation algorithm, then carries out the feature extraction and matching of gesture, to recognize
Go out the non-touch-control gesture.
In another embodiment, the non-touch can be recognized by the back mounted infrared ray sensor of the terminal device
Control gesture.The infrared ray sensor can include RF transmitter (such as infrared light emitting diode) and infrared receiver
Device (such as phototriode).The RF transmitter launches infrared ray, when user makes at the back side of the terminal device
During gesture, the infrared ray of transmitting is reflected back, and the infrared receiver receives the infrared ray for reflecting, according to what is received
The infrared ray for reflecting can recognize the non-touch-control gesture.
It is appreciated that except the several ways, can also by other means recognize the non-touch-control gesture.For example,
Electric field can be produced at the back side of the terminal device, detect the change of the electric field, institute is recognized according to the change of the electric field
State non-touch-control gesture.
102：Judge whether the non-touch-control gesture matches with default gesture.
The default gesture can include that finger is moved to preset direction, for example, be moved to the left, move right, moving upwards
Move, move down, move forward, be moved rearwards by.The default gesture can include that finger moves preset times to preset direction,
For example be moved to the left once, be moved to the left twice, to be moved to the left three inferior.
The default gesture can also include drawing preset pattern with finger, for example, draw triangle, circle, square, judge
Whether whether matches with the default gesture non-touch-control gesture that judge of the non-touch-control gesture is preset pattern described in picture.
If the non-touch-control gesture is mismatched with default gesture, return to step 101.
103：If the non-touch-control gesture matches with default gesture, in the current display interface to the terminal device
Predetermined operable object carry out scheduled operation.
It is described to make a reservation for operable object and include predetermined word, predetermined pictures, predetermined audio frequency and video, predetermined control, predetermined
The polytypes such as operation button, input frame or dummy keyboard.For example, it can be music-playing interface to make a reservation for operable object
Collection, pause button, it can also be picture, word in webpage etc. to make a reservation for operable object, and making a reservation for operable object can be with
It is input frame, dummy keyboard etc..Any object that can be operated shown in display interface be able to can be grasped for predetermined
Make object.
The predetermined operable object can include one or more.
Different predetermined operable objects can be corresponded to when the non-touch-control gesture is different.For example, if the non-touch-control
Gesture then corresponds to the fast backward button of music-playing interface to be moved to the left once；If the non-touch-control gesture is to be moved to the left two
It is secondary, then correspond to upper one bent button of music-playing interface；If the non-touch-control gesture is to move right once, corresponding music is broadcast
Put the fast forward button at interface；If the non-touch-control gesture moves right twice to be moved to the left, music-playing interface is corresponded to
Next bent button.
When the non-touch-control gesture is picture preset pattern, can search from the current display interface of the terminal device
The operable object similar to the shape of the preset pattern, using the operable object for finding as non-touch-control gesture correspondence
Predetermined operable object.For example, if the non-touch-control gesture is picture triangle, the time-out of corresponding music-playing interface is pressed
Button, upper one first button, next button.
The scheduled operation can be predefined operation, for example, predetermined operable object is moved into predeterminated position
To facilitate user to choose.The scheduled operation can also be according to the operation that predetermined handling function is carried out is performed, predetermined
The predetermined operable object be able to can be carried out with reference to the current behaviour in service definition of the terminal device in handling function
Operation.
For different operable objects can correspond to different scheduled operations.If it is music for example to make a reservation for operable object
The collection button of broadcast interface, scheduled operation can be the collection button for clicking on music-playing interface, and music-playing interface is broadcast
The information such as the song put are added into collection.
Or, if it is dummy keyboard to make a reservation for operable object, scheduled operation can be to amplify the dummy keyboard to show, with
User is set conveniently input operation to be carried out on keyboard.
Or, if to make a reservation for operable object be the picture in webpage, scheduled operation can be picture to be adjusted to pre-
If size is facilitating user to check other contents, or only shows that picture identification does not show whole pictures according to current network conditions
Content is saving flow.
Optionally, in embodiments of the present invention, to the current display interface of the terminal device in it is predetermined operable right
As the specific implementation for carrying out scheduled operation has various, the implementation of three kinds presented below relatively optimization：
If the 1, the predetermined operable object is operation button or control, the currently displaying of the terminal device is chosen
The operation button or control in interface.
The operation button is the button that user can be operated, and for example radio button, multiselect button, drop-down menu are pressed
Button etc..The control refers to that user can interact with the object with input or peration data, such as chart control, grid control
Deng.
If the predetermined operable object is operation button or control, the operation button or control can be carried out
Choose operation.Can all choose or the operation button or control are chosen in part.
Further, after the operation button or control in the current display interface for choosing the terminal device,
The user operation for acting on the terminal device can be detected, when the user operation meets predetermined condition, the behaviour is controlled
Make button or control performs corresponding function.
The user operation for acting on the terminal device can be that user is enterprising in the display screen of the terminal device
Row touch control operation, or user presses the predetermined physical button of the terminal device, or be that user sets to the terminal
It is standby to perform other operations.
The predetermined condition can set as needed, and the non-touch-control gesture operation that for example user performs is default gesture,
Or the touch control operation on the display screen of the terminal device confirms to act on terminal device when operating for preset touch
User operation meets predetermined condition.
Either control execution corresponding function refers to that the operation button or control perform corresponding side to the operation button
Method.When program is realized, an object can have the attribute and method of oneself, and the method is exactly the corresponding function of the object.One
Individual object can include one or more methods, and operable object can perform difference according to the different user operation for receiving
Method.
For example, if the pictures in have selected the current display interface of the terminal device, then receive user's point
The operation of picture is hit, at this point it is possible to picture is carried out to be amplified display on display interface.
2nd, the predetermined operable object in the current display interface of the terminal device is chosen；Or the control terminal sets
Predetermined operable object in standby current display interface performs corresponding function；Or highlight the currently displaying of terminal device
Predetermined operable object in interface；Or move the predetermined operable object in the current display interface of the terminal device
Default viewing area to terminal device is shown.
It can only select to carry out scheduled operation to the predetermined operable object in the current display interface of the terminal device
Described in terminal device current display interface in predetermined operable object.For example, the current aobvious of the terminal device is chosen
Show the text message in interface.
It can also be straight to carry out scheduled operation to the predetermined operable object in the current display interface of the terminal device
The predetermined operable object connect in the current display interface for controlling the terminal device performs corresponding function.For example, control described
Picture in the current display interface of terminal device amplifies.
Scheduled operation is carried out to the predetermined operable object in the current display interface of the terminal device and can also be prominent
The predetermined operable object gone out in the current display interface for showing the terminal device.For example, by the text in current display interface
This information is amplified and shows, is highlighted, increasing underscore and show, or while is amplified and is highlighted.
Predetermined operable object in the current display interface of the terminal device is carried out scheduled operation can also be by
Predetermined operable object in the current display interface of the terminal device is moved to the default viewing area of terminal device and carries out
Show.The default viewing area can be region set in advance, it is also possible to by detecting terminal described in user's current handheld
What the situation of equipment was determined.For example, detect that user grips the posture of terminal device, then predetermined operable object is moved to
The position that user's finger can be chosen, to facilitate user to choose.
3rd, show and make a reservation for the preview interface after operable object is triggered；Or show that difference makes a reservation for operable objects in turn
Preview interface after being triggered.
The preview interface is the display interface after operable object is triggered.For example, preview interface can be that user touches
Send out the display interface after collection button.
The preview interface can be shown in the arbitrary region in the current display interface of the terminal device.It is specific aobvious
Show that region can preset, it is also possible to automatically select according to the current display interface of the terminal device.For example, at the end
The blank viewing area of the current display interface of end equipment shows the preview interface.
If described make a reservation for operable object including one, can directly show in the current display interface of the terminal device
Show that this makes a reservation for the preview interface after operable object is triggered.If it is described make a reservation for operable object include it is multiple, can be described
Show simultaneously in the current display interface of terminal device and multiple make a reservation for the preview interface after operable objects are triggered, it is also possible to
Show that difference makes a reservation for the preview interface after operable objects are triggered in the current display interface of the terminal device in turn.In wheel
When stream shows, can be automatically switched according to Preset Time, each makes a reservation for the preview interface after operable object is triggered and stops institute
State Preset Time.Preview interface can also be carried out by modes such as physical button, touch control operation or non-touch-control gesture operations
Switching.
Further, after the preview interface is shown, the user operation for acting on the terminal device can be detected,
When the user operation meets predetermined condition, into the preview interface.
The user operation for acting on the terminal device can be that user is enterprising in the display screen of the terminal device
Row touch control operation, or user presses the predetermined physical button of the terminal device, or be that user sets to the terminal
It is standby to perform other operations.
Embodiment one by non-touch-control gesture come the method identifying user of control terminal equipment in the terminal device
The non-touch-control gesture that the back side is made；Judge whether the non-touch-control gesture matches with default gesture；If the non-touch-control gesture
Match with default gesture, then to the current display interface of the terminal device in predetermined operable object carry out predetermined behaviour
Make.Embodiment one is realized when user matches in the non-touch-control gesture that the back side of terminal device is made with default gesture, right
Predetermined operable object in the current display interface of the terminal device carries out scheduled operation, manually selects without the need for user, solution
The user that determined is inconvenient to choose the problem of the display content of terminal device, improves the convenience of user operation.
Embodiment two
Fig. 2 is for the offer of the embodiment of the present invention two by non-touch-control gesture come the structure chart of the system of control terminal equipment.
As shown in Fig. 2 described can be included by non-touch-control gesture come the system 10 of control terminal equipment：Recognition unit 201, judgement are single
Unit 202, operating unit 203.
Recognition unit 201, for the non-touch-control gesture that identifying user is made at the back side of terminal device.
The non-touch-control gesture can be recognized by the back mounted ultrasonic sensor of the terminal device.It is described super
Sonic sensor can include ultrasonic speaker and ultrasonic microphone.The ultrasonic speaker sends ultrasonic wave (for example
The ultrasonic wave of 20-22KHz), when user makes gesture at the back side of the terminal device, ultrasonic wave echo is produced, it is described super
Sound wave microphone receives the ultrasonic wave echo.Ultrasonic wave echo to receiving is analyzed, and obtains the non-touch-control gesture.Example
Such as, the ultrasonic wave echo to receiving carries out ultrasonic frequency feature extraction and analysis, when obtaining the moving direction of gesture and being formed
Between sequence, recycle HMM the time series is identified, obtain the non-touch-control gesture.The ultrasound
Ripple microphone can include multiple (such as 5), to obtain preferable accuracy of identification.
In another embodiment, the non-touch-control hand can be recognized by the back mounted camera of the terminal device
Gesture.The camera gathers the image at the back side of the terminal device, when user makes gesture at the back side of the terminal device
When, the image of user gesture is obtained, the image of the user gesture is identified, obtain the non-touch-control gesture.For example, profit
The image of the user gesture is split with image segmentation algorithm, then carries out the feature extraction and matching of gesture, to recognize
Go out the non-touch-control gesture.
In another embodiment, the non-touch can be recognized by the back mounted infrared ray sensor of the terminal device
Control gesture.The infrared ray sensor can include RF transmitter (such as infrared light emitting diode) and infrared receiver
Device (such as phototriode).The RF transmitter launches infrared ray, when user makes at the back side of the terminal device
During gesture, the infrared ray of transmitting is reflected back, and the infrared receiver receives the infrared ray for reflecting, according to what is received
The infrared ray for reflecting can recognize the non-touch-control gesture.
It is appreciated that except the several ways, can also by other means recognize the non-touch-control gesture.For example,
Electric field can be produced at the back side of the terminal device, detect the change of the electric field, institute is recognized according to the change of the electric field
State non-touch-control gesture.
Judging unit 202, for judging whether the non-touch-control gesture matches with default gesture.
The default gesture can include that finger is moved to preset direction, for example, be moved to the left, move right, moving upwards
Move, move down, move forward, be moved rearwards by.The default gesture can include that finger moves preset times to preset direction,
For example be moved to the left once, be moved to the left twice, to be moved to the left three inferior.
The default gesture can also include drawing preset pattern with finger, for example, draw triangle, circle, square, judge
Whether whether matches with the default gesture non-touch-control gesture that judge of the non-touch-control gesture is preset pattern described in picture.
Operating unit 203, if matching for the non-touch-control gesture and default gesture, works as to the terminal device
Predetermined operable object in front display interface carries out scheduled operation.
It is described to make a reservation for operable object and include predetermined word, predetermined pictures, predetermined audio frequency and video, predetermined control, predetermined
The polytypes such as operation button, input frame or dummy keyboard.For example, it can be music-playing interface to make a reservation for operable object
Collection, pause button, it can also be picture, word in webpage etc. to make a reservation for operable object, and making a reservation for operable object can be with
It is input frame, dummy keyboard etc..Any object that can be operated shown in display interface be able to can be grasped for predetermined
Make object.
The predetermined operable object can include one or more.
Different predetermined operable objects can be corresponded to when the non-touch-control gesture is different.For example, if the non-touch-control
Gesture then corresponds to the fast backward button of music-playing interface to be moved to the left once；If the non-touch-control gesture is to be moved to the left two
It is secondary, then correspond to upper one bent button of music-playing interface；If the non-touch-control gesture is to move right once, corresponding music is broadcast
Put the fast forward button at interface；If the non-touch-control gesture moves right twice to be moved to the left, music-playing interface is corresponded to
Next bent button.
When the non-touch-control gesture is picture preset pattern, can search from the current display interface of the terminal device
The operable object similar to the shape of the preset pattern, using the operable object for finding as non-touch-control gesture correspondence
Predetermined operable object.For example, if the non-touch-control gesture is picture triangle, the time-out of corresponding music-playing interface is pressed
Button, upper one first button, next button.
The scheduled operation can be predefined operation, for example, predetermined operable object is moved into predeterminated position
To facilitate user to choose.The scheduled operation can also be according to the operation that predetermined handling function is carried out is performed, predetermined
The predetermined operable object be able to can be carried out with reference to the current behaviour in service definition of the terminal device in handling function
Operation.
For different operable objects can correspond to different scheduled operations.If it is music for example to make a reservation for operable object
The collection button of broadcast interface, scheduled operation can be the collection button for clicking on music-playing interface, and music-playing interface is broadcast
The information such as the song put are added into collection.
Or, if it is dummy keyboard to make a reservation for operable object, scheduled operation can be to amplify the dummy keyboard to show, with
User is set conveniently input operation to be carried out on keyboard.
Or, if to make a reservation for operable object be the picture in webpage, scheduled operation can be picture to be adjusted to pre-
If size is facilitating user to check other contents, or only shows that picture identification does not show whole pictures according to current network conditions
Content is saving flow.
Optionally, in embodiments of the present invention, to the current display interface of the terminal device in it is predetermined operable right
As the specific implementation for carrying out scheduled operation has various, the implementation of three kinds presented below relatively optimization：
If the 1, the predetermined operable object is operation button or control, the currently displaying of the terminal device is chosen
The operation button or control in interface.
The operation button is the button that user can be operated, and for example radio button, multiselect button, drop-down menu are pressed
Button etc..The control refers to that user can interact with the object with input or peration data, such as chart control, grid control
Deng.
If the predetermined operable object is operation button or control, the operation button or control can be carried out
Choose operation.Can all choose or the operation button or control are chosen in part.
Further, after the operation button or control in the current display interface for choosing the terminal device,
The user operation for acting on the terminal device can be detected, when the user operation meets predetermined condition, the behaviour is controlled
Make button or control performs corresponding function.
The user operation for acting on the terminal device can be that user is enterprising in the display screen of the terminal device
Row touch control operation, or user presses the predetermined physical button of the terminal device, or be that user sets to the terminal
It is standby to perform other operations.
The predetermined condition can set as needed, and the non-touch-control gesture operation that for example user performs is default gesture,
Or the touch control operation on the display screen of the terminal device confirms to act on terminal device when operating for preset touch
User operation meets predetermined condition.
Either control execution corresponding function refers to that the operation button or control perform corresponding side to the operation button
Method.When program is realized, an object can have the attribute and method of oneself, and the method is exactly the corresponding function of the object.One
Individual object can include one or more methods, and operable object can perform difference according to the different user operation for receiving
Method.
For example, if the pictures in have selected the current display interface of the terminal device, then receive user's point
The operation of picture is hit, at this point it is possible to picture is carried out to be amplified display on display interface.
2nd, the predetermined operable object in the current display interface of the terminal device is chosen；Or the control terminal sets
Predetermined operable object in standby current display interface performs corresponding function；Or highlight the currently displaying of terminal device
Predetermined operable object in interface；Or move the predetermined operable object in the current display interface of the terminal device
Default viewing area to terminal device is shown.
It can only select to carry out scheduled operation to the predetermined operable object in the current display interface of the terminal device
Described in terminal device current display interface in predetermined operable object.For example, the current aobvious of the terminal device is chosen
Show the text message in interface.
It can also be straight to carry out scheduled operation to the predetermined operable object in the current display interface of the terminal device
The predetermined operable object connect in the current display interface for controlling the terminal device performs corresponding function.For example, control described
Picture in the current display interface of terminal device amplifies.
Scheduled operation is carried out to the predetermined operable object in the current display interface of the terminal device and can also be prominent
The predetermined operable object gone out in the current display interface for showing the terminal device.For example, by the text in current display interface
This information is amplified and shows, is highlighted, increasing underscore and show, or while is amplified and is highlighted.
Predetermined operable object in the current display interface of the terminal device is carried out scheduled operation can also be by
Predetermined operable object in the current display interface of the terminal device is moved to the default viewing area of terminal device and carries out
Show.The default viewing area can be region set in advance, it is also possible to by detecting terminal described in user's current handheld
What the situation of equipment was determined.For example, detect that user grips the posture of terminal device, then predetermined operable object is moved to
The position that user's finger can be chosen, to facilitate user to choose.
3rd, show and make a reservation for the preview interface after operable object is triggered；Or show that difference makes a reservation for operable objects in turn
Preview interface after being triggered.
The preview interface is the display interface after operable object is triggered.For example, preview interface can be that user touches
Send out the display interface after collection button.
The preview interface can be shown in the arbitrary region in the current display interface of the terminal device.It is specific aobvious
Show that region can preset, it is also possible to automatically select according to the current display interface of the terminal device.For example, at the end
The blank viewing area of the current display interface of end equipment shows the preview interface.
If described make a reservation for operable object including one, can directly show in the current display interface of the terminal device
Show that this makes a reservation for the preview interface after operable object is triggered.If it is described make a reservation for operable object include it is multiple, can be described
Show simultaneously in the current display interface of terminal device and multiple make a reservation for the preview interface after operable objects are triggered, it is also possible to
Show that difference makes a reservation for the preview interface after operable objects are triggered in the current display interface of the terminal device in turn.In wheel
When stream shows, can be automatically switched according to Preset Time, each makes a reservation for the preview interface after operable object is triggered and stops institute
State Preset Time.Preview interface can also be carried out by modes such as physical button, touch control operation or non-touch-control gesture operations
Switching.
Further, after the preview interface is shown, the user operation for acting on the terminal device can be detected,
When the user operation meets predetermined condition, into the preview interface.
The user operation for acting on the terminal device can be that user is enterprising in the display screen of the terminal device
Row touch control operation, or user presses the predetermined physical button of the terminal device, or be that user sets to the terminal
It is standby to perform other operations.
Embodiment two by non-touch-control gesture come the system identification user of control terminal equipment in the terminal device
The non-touch-control gesture that the back side is made；Judge whether the non-touch-control gesture matches with default gesture；If the non-touch-control gesture
Match with default gesture, then to the current display interface of the terminal device in predetermined operable object carry out predetermined behaviour
Make.Embodiment two is realized when user matches in the non-touch-control gesture that the back side of terminal device is made with default gesture, right
Predetermined operable object in the current display interface of the terminal device carries out scheduled operation, manually selects without the need for user, solution
The user that determined is inconvenient to choose the problem of the display content of terminal device, improves the convenience of user operation.
Embodiment three
Fig. 3 is to realize the present invention by non-touch-control gesture come the structural representation of the terminal device of the method for control terminal equipment
Figure.The terminal device 1 includes the system 10 by non-touch-control gesture come control terminal equipment.The terminal device 1 also includes
Storage device 20, processing equipment 30 and display screen 40.
Preferably, it is of the invention by non-touch-control gesture come the method for control terminal equipment by the terminal device 1
By non-touch-control gesture come the system 10 of control terminal equipment realizing.
The terminal device 1 be it is a kind of can according to the instruction being previously set or store, carry out automatically numerical computations and/or
The equipment of information processing, its hardware includes but is not limited to microprocessor, special IC (Application Specific
Integrated Circuit, ASIC), programmable gate array (Field-Programmable Gate Array, FPGA), number
Word processing device (Digital Signal Processor, DSP), embedded device etc..
The terminal device 1 may be, but not limited to, any one can pass through keyboard, mouse, remote control, touch with user
The mode such as plate or voice-operated device carries out the electronic product of man-machine interaction, for example, personal computer, panel computer, smart mobile phone, individual
Personal digital assistant (Personal Digital Assistant, PDA), game machine, IPTV (Internet
Protocol Television, IPTV), intelligent wearable equipment etc..
Network residing for the terminal device 1 includes, but are not limited to internet, wide area network, Metropolitan Area Network (MAN), LAN, virtual
Dedicated network (Virtual Private Network, VPN) etc..
The storage device 20 be used to storing it is described by non-touch-control gesture come in the system 10 of control terminal equipment each
The program code of program segment.The storage device 20 can include：USB flash disk, portable hard drive, read-only storage (Read-Only
Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disc or CD etc. are various can deposit
The medium of storage program code.
The processing equipment 30 can include one or more microprocessor, digital processing unit.The processing equipment 30
By non-touch-control gesture come the program code of each program segment of the system 10 of control terminal equipment described in performing, identifying user exists
The non-touch-control gesture that the back side of the terminal device 1 is made, judges whether the non-touch-control gesture matches with default gesture, if
The non-touch-control gesture matches with default gesture, then to the current display interface of the terminal device 1 in it is predetermined operable
Object carries out scheduled operation.It is achieved thereby that the non-touch-control gesture made at the back side of terminal device 1 as user and default gesture
When matching, scheduled operation is carried out to the predetermined operable object in the current display interface of the terminal device 1, without the need for user
Manually select, solve the problems, such as that user is inconvenient to choose the display content of terminal device 1, improve the convenience of user operation.
The display screen 40 is used to show the information of the terminal device 1, such as described to be controlled by non-touch-control gesture
The corresponding word of terminal device.
In several embodiments provided by the present invention, it should be understood that disclosed terminal device and method, Ke Yitong
Cross other modes to realize.For example, terminal device embodiment described above is only schematic, for example, the unit
Division, only a kind of division of logic function can have other dividing mode when actually realizing.
In addition, each functional unit in each embodiment of the invention can be integrated in same treatment unit, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in same unit.The integrated list
Unit both can be realized in the form of hardware, it would however also be possible to employ hardware adds the form of software function module to realize.
It is obvious to a person skilled in the art that the invention is not restricted to the details of the one exemplary embodiment, Er Qie
In the case of spirit or essential attributes without departing substantially from the present invention, the present invention can be in other specific forms realized.Therefore, no matter
From the point of view of which point, embodiment all should be regarded as exemplary, and be nonrestrictive, the scope of the present invention is by appended power
Profit is required rather than the explanation is limited, it is intended that all in the implication and scope of the equivalency of claim by falling
Change is included in the present invention.Any reference in claim should not be considered as and limit involved claim.This
Outward, it is clear that " including ", a word was not excluded for other units or step, and odd number is not excluded for plural number.State in terminal device claim
Multiple units or terminal device can also be realized by same unit or terminal device by software or hardware.The first, the
Second-class word is used for representing title, and is not offered as any specific order.
Finally it should be noted that above example is only to illustrate technical scheme and unrestricted, although reference
Preferred embodiment has been described in detail to the present invention, it will be understood by those within the art that, can be to the present invention's
Technical scheme is modified or equivalent, without deviating from the spirit and scope of technical solution of the present invention.
Claims (10)
1. it is a kind of by non-touch-control gesture come the method for control terminal equipment, it is characterised in that methods described includes：
The non-touch-control gesture that identifying user is made at the back side of the terminal device；
Judge whether the non-touch-control gesture matches with default gesture；
If the non-touch-control gesture matches with default gesture, to the current display interface of the terminal device in it is predetermined can
Operation object carries out scheduled operation.
2. the method for claim 1, it is characterised in that the identifying user is made at the back side of the terminal device
Non-touch-control gesture includes：
The non-touch is recognized by the back mounted ultrasonic sensor or camera or infrared sensor of the terminal device
Control gesture.
3. the method for claim 1, it is characterised in that the operable object includes operation button or control, institute
Stating the predetermined operable object in the current display interface to the terminal device and carrying out scheduled operation includes：
Choose the operation button or the control in the current display interface of the terminal device；
Methods described also includes：
Detection acts on the user operation of the terminal device；
When the user operation meets predetermined condition, control the operation button or control performs corresponding function.
4. the method for claim 1, it is characterised in that pre- in the current display interface to the terminal device
Fixed operable object carries out scheduled operation to be included：
Choose the predetermined operable object in the current display interface of the terminal device；Or
The predetermined operable object controlled in the current display interface of the terminal device performs corresponding function；Or
Highlight the predetermined operable object in the current display interface of the terminal device；Or
The default viewing area that the predetermined operable object is moved to the terminal device is shown.
5. the method for claim 1, it is characterised in that pre- in the current display interface to the terminal device
Fixed operable object carries out scheduled operation to be included：
Show and make a reservation for the preview interface after operable object is triggered；Or
Show that difference makes a reservation for the preview interface after operable objects are triggered in turn；
Methods described also includes：
Detection acts on the user operation of the terminal device；
When the user operation meets predetermined condition, into the preview interface.
6. the method as described in any one of claim 1-5, it is characterised in that described to make a reservation for operable object and include predetermined text
Word, predetermined pictures, predetermined audio frequency and video, predetermined control, scheduled operation button, input frame or dummy keyboard.
7. it is a kind of by non-touch-control gesture come the system of control terminal equipment, it is characterised in that the system includes：
Recognition unit, for the non-touch-control gesture that identifying user is made at the back side of the terminal device；
Judging unit, for judging whether the non-touch-control gesture matches with default gesture；
Operating unit, if matching for the non-touch-control gesture and default gesture, to the currently displaying of the terminal device
Predetermined operable object in interface carries out scheduled operation.
8. system as claimed in claim 7, it is characterised in that the operating unit specifically for：
Choose the operation button or control in the current display interface of the terminal device；
The system also includes：
Control unit, for the user operation that detection acts on the terminal device, in the user operation predetermined condition is met
When, control the operation button or control performs corresponding function.
9. system as claimed in claim 7, it is characterised in that the operating unit specifically for：
Choose the predetermined operable object in the current display interface of the terminal device；Or
The predetermined operable object controlled in the current display interface of the terminal device performs corresponding function；Or
Highlight the predetermined operable object in the current display interface of the terminal device；Or
The default viewing area that the predetermined operable object is moved to the terminal device is shown.
10. system as claimed in claim 7, it is characterised in that the operating unit specifically for：
Show and make a reservation for the preview interface after operable object is triggered；Or
Show that difference makes a reservation for the preview interface after operable objects are triggered in turn；
The system also includes：
Into unit, for the user operation that detection acts on the terminal device, in the user operation predetermined condition is met
When, into the preview interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611219132.9A CN106648102A (en) | 2016-12-26 | 2016-12-26 | Method and system of controlling terminal equipment through non-touch gesture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611219132.9A CN106648102A (en) | 2016-12-26 | 2016-12-26 | Method and system of controlling terminal equipment through non-touch gesture |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106648102A true CN106648102A (en) | 2017-05-10 |
Family
ID=58827403
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611219132.9A Pending CN106648102A (en) | 2016-12-26 | 2016-12-26 | Method and system of controlling terminal equipment through non-touch gesture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106648102A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107422853A (en) * | 2017-06-29 | 2017-12-01 | 努比亚技术有限公司 | A kind of gesture identification method, mobile terminal and computer-readable recording medium |
| CN108491067A (en) * | 2018-02-07 | 2018-09-04 | 深圳还是威健康科技有限公司 | Intelligent fan control method, intelligent fan and computer readable storage medium |
| CN110050249A (en) * | 2017-08-31 | 2019-07-23 | 华为技术有限公司 | A kind of input method and intelligent terminal |
| CN110058681A (en) * | 2019-03-08 | 2019-07-26 | 佛山市云米电器科技有限公司 | A kind of interface alternation method and system of the movable type with screen equipment |
| CN111428222A (en) * | 2020-03-19 | 2020-07-17 | 闻泰通讯股份有限公司 | Gesture control method and device of mobile terminal, mobile terminal and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202383598U (en) * | 2011-09-29 | 2012-08-15 | 上海华勤通讯技术有限公司 | Mobile terminal |
| US20120281129A1 (en) * | 2011-05-06 | 2012-11-08 | Nokia Corporation | Camera control |
| CN103324274A (en) * | 2012-03-22 | 2013-09-25 | 联想(北京)有限公司 | Method and device for man-machine interaction |
| CN104583906A (en) * | 2012-08-21 | 2015-04-29 | 三星电子株式会社 | Input method and apparatus of portable device |
| CN104636064A (en) * | 2015-01-23 | 2015-05-20 | 小米科技有限责任公司 | Gesture generating method and device |
| CN105009035A (en) * | 2013-03-15 | 2015-10-28 | 高通股份有限公司 | Enhancing touch inputs with gestures |
-
2016
- 2016-12-26 CN CN201611219132.9A patent/CN106648102A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120281129A1 (en) * | 2011-05-06 | 2012-11-08 | Nokia Corporation | Camera control |
| CN202383598U (en) * | 2011-09-29 | 2012-08-15 | 上海华勤通讯技术有限公司 | Mobile terminal |
| CN103324274A (en) * | 2012-03-22 | 2013-09-25 | 联想(北京)有限公司 | Method and device for man-machine interaction |
| CN104583906A (en) * | 2012-08-21 | 2015-04-29 | 三星电子株式会社 | Input method and apparatus of portable device |
| CN105009035A (en) * | 2013-03-15 | 2015-10-28 | 高通股份有限公司 | Enhancing touch inputs with gestures |
| CN104636064A (en) * | 2015-01-23 | 2015-05-20 | 小米科技有限责任公司 | Gesture generating method and device |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107422853A (en) * | 2017-06-29 | 2017-12-01 | 努比亚技术有限公司 | A kind of gesture identification method, mobile terminal and computer-readable recording medium |
| CN110050249A (en) * | 2017-08-31 | 2019-07-23 | 华为技术有限公司 | A kind of input method and intelligent terminal |
| CN110050249B (en) * | 2017-08-31 | 2020-08-25 | 华为技术有限公司 | Input method and intelligent terminal equipment |
| US11429191B2 (en) | 2017-08-31 | 2022-08-30 | Huawei Technologies Co., Ltd. | Input method and smart terminal device |
| CN108491067A (en) * | 2018-02-07 | 2018-09-04 | 深圳还是威健康科技有限公司 | Intelligent fan control method, intelligent fan and computer readable storage medium |
| CN108491067B (en) * | 2018-02-07 | 2021-12-10 | 深圳市元征科技股份有限公司 | Intelligent fan control method, intelligent fan and computer readable storage medium |
| CN110058681A (en) * | 2019-03-08 | 2019-07-26 | 佛山市云米电器科技有限公司 | A kind of interface alternation method and system of the movable type with screen equipment |
| CN111428222A (en) * | 2020-03-19 | 2020-07-17 | 闻泰通讯股份有限公司 | Gesture control method and device of mobile terminal, mobile terminal and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11513608B2 (en) | Apparatus, method and recording medium for controlling user interface using input image | |
| CN106648102A (en) | Method and system of controlling terminal equipment through non-touch gesture | |
| US8890818B2 (en) | Apparatus and method for proximity based input | |
| US8842919B2 (en) | Gesture based interface system and method | |
| CN110798397B (en) | File sending method and device and electronic equipment | |
| EP2899719B1 (en) | Display apparatus for performing voice control and voice controlling method thereof | |
| US10101874B2 (en) | Apparatus and method for controlling user interface to select object within image and image input device | |
| US20140053079A1 (en) | Apparatus and method for proximity based input | |
| EP2624107A2 (en) | Method of operating multi-touch panel and terminal supporting the same | |
| KR20140019630A (en) | Method and system for tagging and searching additional information about image, apparatus and computer readable recording medium thereof | |
| CN108605165A (en) | The method and electronic equipment of video thumbnails are generated in the electronic device | |
| CN102939574A (en) | Character selection | |
| CN109358784A (en) | A kind of arrangement figure calibration method, terminal device and storage medium | |
| CN105744054A (en) | Mobile terminal control method and mobile terminal | |
| CN104714637A (en) | Polygonal gesture detection and interaction method, device and computer program product | |
| CN113050863A (en) | Page switching method and device, storage medium and electronic equipment | |
| WO2014146516A1 (en) | Interactive device and method for left and right hands | |
| CN107924280A (en) | System and method for the control of double articulations digitorum manus touch-screens | |
| WO2017143575A1 (en) | Method for retrieving content of image, portable electronic device, and graphical user interface | |
| CN106775415A (en) | Application program launching method and system | |
| CN106782553A (en) | Pronunciation inputting method and terminal device | |
| US20240119943A1 (en) | Apparatus for implementing speaker diarization model, method of speaker diarization, and portable terminal including the apparatus | |
| CN109753154B (en) | Gesture control method and device for screen equipment | |
| CN106775355A (en) | By gas come the method and system of control terminal equipment | |
| CN109740520B (en) | Fingerprint identification method and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |