CN106802717A - Space gesture remote control thereof and electronic equipment - Google Patents
Space gesture remote control thereof and electronic equipment Download PDFInfo
- Publication number
- CN106802717A CN106802717A CN201710048134.4A CN201710048134A CN106802717A CN 106802717 A CN106802717 A CN 106802717A CN 201710048134 A CN201710048134 A CN 201710048134A CN 106802717 A CN106802717 A CN 106802717A
- Authority
- CN
- China
- Prior art keywords
- special characteristic
- module
- instruction
- area
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a kind of space gesture remote control thereof and electronic equipment, the method is comprised the following steps：Three-dimensional manipulation space is set up, three-dimensional manipulation space includes three-dimensional system of coordinate and the fictitious line interface put centered on three-dimensional system of coordinate origin, and fictitious line interface is divided into multiple instruction region；Gather the successive frame depth image of user；According to the palm area of depth image identifying user；The motion of the special characteristic of palm area is tracked according to successive frame depth image；Information is passed through come triggering command when passing through instruction area according to special characteristic；Execute instruction.The electronic equipment includes that module, acquisition module, the first identification module, tracking module, trigger module and performing module are set up in manipulation space.The present invention only need in space brandish hand before television set and manipulated with to television set, not limit the form of palm, remote control of the people to television set is more facilitated, comfortable, also, the present invention also has precision higher and faster response speed.
Description
Technical field
The present invention relates to technical field of hand gesture recognition, more particularly to a kind of space gesture remote control thereof and electronic equipment.
Background technology
Depth camera can obtain the depth image of object, thus, to the target area in depth image, can directly obtain
Its spatial positional information is taken, the functions such as 3D object reconstructions, the manipulation of gesture identification gesture further can be realized according to depth image.
Conventional television is remotely controlled by infrared technique using remote control to television set, and the remote control is the dress of an entity
Put, be provided with multiple buttons to carry out different controls to television set, with TV remote controller operational and controlled key button increasingly
Simplify, TV remote controller only retains the button that some are manipulated substantially, such as switching on and shutting down, it is determined that, exit, channel plus-minus and volume
Plus-minus etc..
Existing remote control needs to install battery, when remote controller battery electricity is used up, it is necessary to which changing battery could be real
Existing remote control, if remote control is lost, cannot be remotely controlled to television set, if remote control position is distant, must also
Remote control must be fetched to use, thus, remote control of the people using remote control to television set is still present inconvenience.
The content of the invention
The present invention provides a kind of space gesture remote control thereof and electronic equipment, can solve the problem that the use that prior art is present is distant
Control device is remotely controlled to television set has inconvenience.
In order to solve the above technical problems, one aspect of the present invention is：A kind of space gesture remote control side is provided
Method, the method is comprised the following steps：Set up three-dimensional manipulation space, wherein, the three-dimensional manipulation space include three-dimensional system of coordinate and
The fictitious line interface put centered on the three-dimensional system of coordinate origin, the fictitious line interface is divided into multiple instruction region；
Gather the successive frame depth image of user；According to the palm area of the depth image identifying user；According to the successive frame depth
The motion of the special characteristic of palm area described in degree image trace；Wearing when passing through the instruction area according to the special characteristic
More information carrys out triggering command；Perform the instruction.
Wherein, after the step of foundation three-dimensional manipulation space, also include：Obtain each point on the fictitious line interface
First position information in the three-dimensional system of coordinate；The step of motion of the special characteristic of the tracking palm area, wraps
Include：The special characteristic is recognized from the palm area；Special characteristic described in the successive frame depth image is obtained in institute
State the multiple second place information in three-dimensional system of coordinate.
Wherein, it is described when passing through the instruction area according to the special characteristic the step of passing through information come triggering command
In, it is described to pass through the instruction area that information is passed through including the special characteristic；It is described according to the special characteristic is passed through
The step of information of passing through during instruction area carrys out triggering command be：According to multiple second place information and the first position
The relation of information determines the instruction area that the special characteristic is passed through, so that triggering command.
Wherein, it is described when passing through the instruction area according to the special characteristic the step of passing through information come triggering command
In, the information of passing through passes through the instruction area including the instruction area that the special characteristic is passed through with the special characteristic
Through direction during domain；It is described to pass through information come the step of triggering command when passing through the instruction area according to the special characteristic
Suddenly it is：According to the institute that multiple second place information are passed through with the relation of the first position information come the true special characteristic
Instruction area and the special characteristic through the direction of the instruction area are stated, so that triggering command.
Wherein, the special characteristic is the point on the edge of center of gravity, barycenter or the palm area of the palm area.
In order to solve the above technical problems, another technical solution used in the present invention is：There is provided a kind space gesture distant
The electronic equipment of control, the electronic equipment include manipulation space set up module, acquisition module, the first identification module, tracking module, touch
Hair module and performing module；Module is set up for setting up three-dimensional manipulation space in manipulation space, wherein, the three-dimensional manipulation space bag
Three-dimensional system of coordinate and the fictitious line interface put centered on the three-dimensional system of coordinate origin are included, the fictitious line interface is divided into
Multiple instruction region；Acquisition module is set up module and is connected with the manipulation space, the successive frame depth image for gathering user；
First identification module is connected with the acquisition module, for the palm area according to the depth image identifying user；Tracking mould
Block is connected with first identification module, the special characteristic for tracking the palm area according to the successive frame depth image
Motion；Trigger module is connected with the tracking module, wearing during for passing through the instruction area according to the special characteristic
More information carrys out triggering command；Performing module is connected with the trigger module, for performing the instruction.
Wherein, the electronic equipment is further included：First acquisition module, sets up module and is connected with the manipulation space,
For obtaining each first position information in the three-dimensional system of coordinate on the fictitious line interface；The tracking module enters
One step includes the second identification module and the second acquisition module, and second identification module is connected with first identification module, uses
In the special characteristic is recognized from the palm area, second acquisition module is connected with second identification module, uses
Multiple second place information of the special characteristic in the three-dimensional system of coordinate described in the acquisition successive frame depth image.
Wherein, it is described to pass through the instruction area that information is passed through including the special characteristic；The trigger module with it is described
Second acquisition module is connected, for according to the relation of multiple second place information and the first position information to determine
The instruction area that special characteristic is passed through is stated, so that triggering command.
Wherein, the information of passing through is passed through including the instruction area that the special characteristic is passed through with the special characteristic
The through direction during instruction area；The trigger module is connected with second acquisition module, for according to multiple
Second place information carrys out the instruction area and institute that really the special characteristic is passed through with the relation of the first position information
Special characteristic through the direction of the instruction area is stated, so that triggering command.
Wherein, the special characteristic is the point on the edge of center of gravity, barycenter or the palm area of the palm area.
The beneficial effects of the invention are as follows：The situation of prior art is different from, the present invention has been divided multiple by one
The three-dimensional manipulation that the fictitious line interface of instruction area is formed spatially carries out gesture remote control, and by gathering user's successive frame depth
Image obtains the action of the special characteristic of user's palm area, and passing through when passing through instruction area according to the special characteristic
Information carrys out triggering command, to realize that space gesture is remotely controlled to television set, with response speed faster.Also, the present invention
It is controlled without entity apparatus such as remote controls, people only need to brandish hand in space before television set and carry out spy
Fixed gesture motion is manipulated to television set, it is to avoid need to change the trouble of battery or finding remote controller etc., so that
Remote control of the people to television set more facilitates, also, the present invention also has precision higher.In addition, the present invention only need to
The special characteristic of track palm area, and hand form (open or close) need not be particularly limited to, it is possible to achieve manipulate naturally,
Make user during manipulating, from frequently completing specific gesture motion, triggering command by only needing hand to move integrally is manipulated
It is more naturally comfortable.
Brief description of the drawings
Technical scheme in order to illustrate more clearly the embodiments of the present invention, below will be to that will make needed for embodiment description
Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for
For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings
Accompanying drawing.
Fig. 1 is a kind of schematic flow sheet of space gesture remote control thereof provided in an embodiment of the present invention；
Fig. 2 is the schematic diagram in the three-dimensional manipulation space of foundation in first embodiment of the invention；
Fig. 3 is a kind of schematic flow sheet of space gesture remote control thereof that second embodiment of the invention is provided；
Fig. 4 is the motion schematic diagram of the special characteristic of palm area in second embodiment of the invention；
Fig. 5 is a kind of schematic flow sheet of space gesture remote control thereof that third embodiment of the invention is provided；
Fig. 6 is the motion schematic diagram of the special characteristic of palm area in third embodiment of the invention；
Fig. 7 is the structural representation of the electronic equipment of the space gesture remote control that first embodiment of the invention is provided；
Fig. 8 is the structural representation of the electronic equipment of the space gesture remote control that second embodiment of the invention is provided；
Fig. 9 is a kind of structural representation of the entity apparatus of the electronic equipment of gesture remote control provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is all other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
Fig. 1 is referred to, Fig. 1 is a kind of schematic flow sheet of space gesture remote control thereof provided in an embodiment of the present invention.
The space gesture remote control thereof that the present embodiment is provided is comprised the following steps：
S11, the three-dimensional manipulation space of foundation, wherein, three-dimensional manipulation space is former including three-dimensional system of coordinate and with three-dimensional system of coordinate
The fictitious line interface put centered on point, fictitious line interface is divided into multiple instruction region.
As shown in Fig. 2 Fig. 2 is the schematic diagram in the three-dimensional manipulation space of foundation in first embodiment of the invention.Specifically, three
The foundation in dimension manipulation space can be set up after the instruction for setting up three-dimensional manipulation space is obtained, to prevent follow-up hand
The gesture motion that user is not intended to gesture remote control is misidentified in gesture remote control process, to be more precisely carried out gesture identification.
Wherein, the instruction can be a specific gesture motion.For example, palm is from opening up into the gesture motion clenched fist.
For example, the depth image of user's successive frame is first gathered, wherein, depth image can be entered by depth camera
Row collection, spatial positional information of the object in space can be obtained by depth image.Wherein, the depth image of successive frame refers to
Within a specific time period, a series of continuous depth images.
After the instruction for setting up three-dimensional manipulation space is obtained, specified point sets up three-dimensional seat as origin with depth image
Mark system.The three-dimensional system of coordinate has an axles of xyz tri-, user towards need the direction of device to be controlled (such as television set) for y-axis just
Plane where direction, x-axis and y-axis parallel to ground, z-axis vertically with the plane where x-axis and y-axis.The side of right towards in Fig. 2
To the positive direction for x-axis, the direction towards the top in Fig. 2 is the positive direction of z-axis.
Wherein, specified point can be the hand central point of user, it is to be understood that in some other embodiment, also
Can be the peak of palm area, or palm area most left or most right point etc..
Then, fictitious line interface then centered on specified point is set up, and obtains the point on fictitious line interface in three-dimensional coordinate
The positional information fastened.
The fictitious line interface of the present embodiment be a sphere, the sphere with specified point as the centre of sphere, with R as radius.
The three-dimensional manipulation space of the present embodiment is spherical in shape, it is possible to understand that ground, and in some other embodiment, three-dimensional manipulation is empty
Between can be cube, such as square or cuboid etc., now, fictitious line interface is then the face of cube, for example square or
Six faces of person's cuboid.
Finally, by fictitious line boundary division multiple instruction region.Specifically, the present invention divides multiple instruction area on sphere
The instruction area that domain, such as the present embodiment divide has the instruction area that the instruction area A that x-axis positive direction passes through, x-axis negative direction are passed through
Domain B, the instruction area C that z-axis positive direction is passed through, the instruction area D that z-axis negative direction is passed through, the instruction area that y-axis positive direction is passed through
The instruction area F that E and y-axis negative direction are passed through.Instruction area A, instruction area B, instruction area C, instruction area D, instruction area E
Whole fictitious line interface is constituted with instruction area F.
The three-dimensional manipulation space of the present embodiment is the space that the sphere with multiple instruction region is surrounded, three-dimensional manipulation
Space is a Virtual space.
S12, the successive frame depth image of collection user.
Specifically, depth image can be acquired by depth camera, further, can also be gathered by RGBD cameras
The RGBD images of user's successive frame.
S13, the palm area according to depth image identifying user.
Wherein, in step S13, palm area can be identified according to the feature of palm, for example, the feature of finger, hand
The palm is located at feature of upper outlimb etc..
S14, according to successive frame depth image track palm area special characteristic motion.
Specifically, special characteristic can be the point on the edge of center of gravity, barycenter or the palm area of palm area.This reality
Apply example to be illustrated by taking the center of gravity of palm area as an example, the motion of the center of gravity of palm is tracked according to successive frame depth image.
S15, information is passed through come triggering command when instruction area is passed through according to special characteristic.
Specifically, can define different information of passing through and trigger the different instruction of correspondence when three dimensions is set up,
Thus, when gesture remote control, then pass through information to determine which is triggered when passing through instruction area according to special characteristic
Individual instruction.
S16, execute instruction.
Difference and prior art, the present invention is by being divided what the fictitious line interface in multiple instruction region was formed at one
Three-dimensional manipulation spatially carries out gesture remote control, and obtains the spy of user's palm area by gathering user's successive frame depth image
Determine the action of feature, and information is passed through come triggering command when passing through instruction area according to the special characteristic, to realize space
Gesture is remotely controlled to television set, with response speed faster.Also, the present invention comes without entity apparatus such as remote controls
It is controlled, people only need to brandish hand in space before television set and carry out specific gesture motion television set is grasped
Control, it is to avoid need to change the trouble of battery or finding remote controller etc., so that remote control of the people to television set more facilitates,
Also, the present invention also has precision higher.In addition, the present invention only needs to track the dynamic motion of special characteristic of palm area,
And hand form (open or close) need not be particularly limited to, it is possible to achieve manipulate naturally, make user during manipulating, palm
Can be from frequently completing specific gesture motion, triggering command by only needing hand to move integrally, manipulation is more naturally comfortable.
Fig. 3 is referred to, Fig. 3 is that a kind of flow of space gesture remote control thereof that second embodiment of the invention is provided is illustrated
Figure.
S21, the three-dimensional manipulation space of foundation, wherein, three-dimensional manipulation space is former including three-dimensional system of coordinate and with three-dimensional system of coordinate
The fictitious line interface put centered on point, fictitious line interface is divided into multiple instruction region.
Specifically, the mode for setting up three-dimensional manipulation space can be identical with the mode in first embodiment, no longer goes to live in the household of one's in-laws on getting married again
State.
Each first position information in three-dimensional system of coordinate on S22, acquisition fictitious line interface.
Wherein, first position information is coordinate value, for example, the coordinate value of point g is (x, y, z), as shown in Figure 2.
S23, the successive frame depth image of collection user.
S24, the palm area according to depth image identifying user.
S25, from palm area recognize palm area center of gravity.
Specifically, the center of gravity of palm area can be calculated and obtained according to palm area.
Multiple second place information of the special characteristic in three-dimensional system of coordinate in S26, acquisition successive frame depth image.
Specifically, because the center of gravity of palm area is in motion, thus in successive frame depth image, second place information with
Motion and change, second place information is the point on the movement locus of the center of gravity of palm area in three-dimensional system of coordinate
Coordinate value, therefore, in successive frame depth image, second place information has the multiple of consecutive variations.
As shown in figure 4, Fig. 4 is the motion schematic diagram of the special characteristic of palm area in second embodiment of the invention.In Fig. 4
The movement locus of the center of gravity of palm area is straight line from left to right.For convenience of explanation, the present embodiment have chosen palm area
Center of gravity movement locus on 4 points be that specifically, the center of gravity of palm area sequentially passes through point g1 (x1, y1, z1), point g2
(x2, y2, z2), point g (x, y, z) and point g3 (x3, y3, z3).
S27, the instruction area that special characteristic is passed through is determined according to the relation of second place information and first position information,
So as to triggering command.
For example, when three-dimensional manipulation space is set up, the finger of instruction area A triggerings is passed through at the center for defining palm area
It is Aa to make, and instruction Aa correspondence channels increase；The center of gravity for defining palm area passes through instruction area B triggering command Bb, instructs Bb pairs
Channel is answered to reduce；The center of gravity for defining palm area passes through instruction area C triggering command Cc, and instruction Cc correspondence volumes increase；Definition
The center of gravity of palm area passes through instruction area D triggering command Dd, and instruction Dd correspondence volumes weaken；The center of gravity for defining palm area is worn
More instruction area E triggering commands Ee, Ee is to should determine that for instruction；The center of gravity for defining palm area passes through instruction area F triggering commands
Ff, instruction Ff correspondences are exited.
In the present embodiment, the second place information of point g1, point g2, point g and point g3 is point g1, the three of point g2, point g and point g3
Dimensional coordinate values (x1, y1, z1), (x2, y2, z2), (x, y, z) and (x3, y3, z3), by 4 D coordinates values of point with it is virtual
The coordinate value of each point compares in boundary face, it can be deduced that, the coordinate value and finger of point g (x, y, z) of the center of gravity process of palm area
Make the coordinate value of a point on the A of region identical, thus may determine that the center of gravity of palm area has passed through instruction area A, thus
Triggering command Aa.
S28, execute instruction.
In step S28, because instruction Aa correspondence channels increase, therefore correspondingly, the increased instruction of channel is performed.
Fig. 5 is referred to, Fig. 5 is that a kind of flow of space gesture remote control thereof that third embodiment of the invention is provided is illustrated
Figure.
S31, the three-dimensional manipulation space of foundation, wherein, three-dimensional manipulation space is former including three-dimensional system of coordinate and with three-dimensional system of coordinate
The fictitious line interface put centered on point, fictitious line interface is divided into multiple instruction region.
Specifically, the mode for setting up three-dimensional manipulation space can be identical with the mode in first embodiment, no longer goes to live in the household of one's in-laws on getting married again
State.
Each first position information in three-dimensional system of coordinate on S32, acquisition fictitious line interface.
S33, the successive frame depth image of collection user.
S34, the palm area according to depth image identifying user.
S35, the point from palm area on the edge of identification palm area.
Wherein, the point on the edge of palm area is arbitrary point on the edge of palm area.Can be from depth image
Feature recognition according to palm area goes out the profile of palm area, so that it is determined that the edge of palm area.
S36, persistently multiple second place information of the acquisition special characteristic in three-dimensional system of coordinate.
Specifically, because palm area is in motion, thus in successive frame depth image, have many on the edge of palm area
It is individual, also, with the motion of palm area, the second place information of same point can also change, second place information
It is coordinate value of the point on multiple movement locus of the multiple points on palm area edge in three-dimensional system of coordinate, therefore, it is same
The edge of individual palm area has multiple second place information by multiple points in a depth image, and the side of palm area
In successive frame depth image, second place information has the multiple of consecutive variations to same point on edge.
S37, the instruction area passed through come true special characteristic according to the relation of multiple second place information and first position information
Domain and special characteristic pass through the direction of instruction area, so that triggering command.
For example, at the three-dimensional manipulation space of foundation, the point defined on the edge of palm area manipulates interior volume from three-dimensional
It is Aa to pass through instruction area A and reach the three-dimensional instruction for manipulating space external trigger, and instruction Aa correspondence channels increase；Define palm area
Edge on point pass through instruction area B from three-dimensional manipulation interior volume and reach three-dimensional manipulation space external trigger instruction Bb, instruction
Bb correspondence channels are reduced；The point defined on the edge of palm area passes through instruction area C arrival three from three-dimensional manipulation interior volume
Dimension manipulation space external trigger instruction Cc, instruction Cc correspondence volumes increase；The point defined on the edge of palm area is manipulated from three-dimensional
Interior volume is passed through instruction area D and reaches three-dimensional manipulation space external trigger instruction Dd, and instruction Dd correspondence volumes weaken；Define palm
Point in edges of regions passes through instruction area E and reaches three-dimensional manipulation space external trigger instruction Ee from three-dimensional manipulation interior volume, refers to
Ee is made to should determine that；The point defined on the edge of palm area passes through instruction area F arrival three-dimensionals from three-dimensional manipulation interior volume
Manipulation outside triggering command Ff, instruction Ff correspondences are exited.
Additionally, the point also defined on the edge of palm area reaches three from outside three-dimensional manipulation space through instruction area A
Dimension manipulation space internal trigger instruction Aa ', instructs Aa ' to increase with corresponding brightness, or, define the point on the edge of palm area
Three-dimensional manipulation space internal trigger instruction Bb ' is reached through instruction area B from outside three-dimensional manipulation space, instruction Bb ' can be correspondingly bright
Degree reduction etc..
For example, as shown in fig. 6, the motion that Fig. 6 is the special characteristic of palm area in third embodiment of the invention is shown
It is intended to.In the present embodiment, the second place information of point h1, point h and point h2 is the D coordinates value of point h1, point h and point h2
(x4, y4, z4), (x5, y5, z5) and (x6, y6, z6), by the seat of each point in 3 D coordinates values of point and fictitious line interface
Scale value compares, it can be deduced that, point h1 (x4, y4, z4) that a point on the edge of palm area is first passed through is empty in three-dimensional manipulation
Between it is internal, point h (x5, y5, z5) on the three-dimensional fictitious line interface for manipulating space, and on instruction area A, the side of palm area
After the point on edge by point h3 (x6, y6, z6) three-dimensional manipulation space outside, hence, it can be determined that the side of the palm area
Point on edge passes through the outside that instruction area A reaches three-dimensional manipulation space from the inside in three-dimensional manipulation space, therefore, triggering command
Aa。
S38, execute instruction.
In step S38, because instruction Aa correspondence channels increase, therefore correspondingly, the increased instruction of channel is performed.
As shown in fig. 7, Fig. 7 is the structural representation of the electronic equipment of the space gesture remote control that first embodiment of the invention is provided
Figure.
Specifically, electronic equipment of the invention includes that module 10, acquisition module 11, the first identification module are set up in manipulation space
12nd, tracking module 13, trigger module 14 and performing module 15.
Specifically, module 10 is set up for setting up three-dimensional manipulation space in manipulation space, wherein, three-dimensional manipulation space includes three
Dimension coordinate system and the fictitious line interface put centered on three-dimensional system of coordinate origin, fictitious line interface is divided into multiple instruction area
Domain.
Acquisition module 11 is set up module 10 and is connected with manipulation space, the successive frame depth image for gathering user.
First identification module 12 is connected with acquisition module 11, for the palm area according to depth image identifying user.
Tracking module 13 is connected with the first identification module 12, the spy for tracking palm area according to successive frame depth image
Determine the motion of feature.
Trigger module 14 is connected with tracking module 13, during for passing through instruction area according to special characteristic pass through information come
Triggering command.
Performing module 15 is connected with trigger module 14, for execute instruction.
As shown in figure 8, Fig. 8 is the structural representation of the electronic equipment of the space gesture remote control that second embodiment of the invention is provided
Figure.
Specifically, electronic equipment of the invention includes that module 20, acquisition module 21, the first identification module are set up in manipulation space
22nd, tracking module 23, trigger module 24, the acquisition module 26 of performing module 25 and first.
Specifically, module 20 is set up for setting up three-dimensional manipulation space in manipulation space, wherein, three-dimensional manipulation space includes three
Dimension coordinate system and the fictitious line interface put centered on three-dimensional system of coordinate origin, fictitious line interface is divided into multiple instruction area
Domain.
First acquisition module 26 is set up module 20 and is connected with manipulation space, for obtaining on fictitious line interface each o'clock three
First position information in dimension coordinate system.
Acquisition module 21 is set up module 20 and is connected with manipulation space, the successive frame depth image for gathering user.
First identification module 22 is connected with acquisition module 21, for the palm area according to depth image identifying user.
Tracking module 23 further includes the second identification module 230 and the second acquisition module 231, the second identification module 230
It is connected with the first identification module 22, for recognizing special characteristic from palm area, wherein, it is palm area that special characteristic can be
Point on the edge of the center of gravity, barycenter or palm area in domain.Second acquisition module 231 is connected with the second identification module 230, uses
Multiple second place information of the special characteristic in three-dimensional system of coordinate in successive frame depth image is obtained.
Specifically, in one embodiment, the instruction area that information is passed through including special characteristic is passed through.Trigger module 24
It is connected with the second acquisition module 231, for specific to determine with the relation of first position information according to multiple second place information
The instruction area that feature is passed through, so that triggering command.
In another embodiment, pass through information and pass through finger with special characteristic including the instruction area that special characteristic is passed through
Make through direction during region.Trigger module 24 is connected with the second acquisition module 231, for according to multiple second place information with
Instruction area and special characteristic that the next true special characteristic of the relation of first position information is passed through pass through the direction of instruction area, from
And triggering command.
Performing module 25 is connected with trigger module 24, for execute instruction.
Fig. 9 is referred to, Fig. 9 is a kind of knot of the entity apparatus of the electronic equipment of gesture remote control provided in an embodiment of the present invention
Structure schematic diagram.The device of present embodiment can perform the step in the above method, and related content is referred in the above method
Describe in detail, will not be repeated here.
The intelligent electronic device includes the memory 32 that processor 31 is coupled with processor 31.
Memory 32 is used for storage program area and the program for setting.
Processor 31 is used to set up three-dimensional manipulation space, wherein, the three-dimensional manipulation space include three-dimensional system of coordinate and with
The fictitious line interface put centered on the three-dimensional system of coordinate origin, the fictitious line interface is divided into multiple instruction region；Adopt
Collect the successive frame depth image of user；According to the palm area of the depth image identifying user；According to the successive frame depth
The motion of the special characteristic of palm area described in image trace；Passing through when passing through the instruction area according to the special characteristic
Information carrys out triggering command；Perform the instruction.
Processor 31 is additionally operable to obtain each first position in the three-dimensional system of coordinate on the fictitious line interface
Information；The special characteristic is recognized from the palm area；Special characteristic described in the successive frame depth image is obtained to exist
Multiple second place information in the three-dimensional system of coordinate.
Processor 31 is additionally operable to be determined with the relation of the first position information according to multiple second place information
The instruction area that the special characteristic is passed through, so that triggering command.
Processor 31 is additionally operable to the relation according to multiple second place information and the first position information come true institute
The instruction area and the special characteristic that special characteristic passes through are stated through the direction of the instruction area, so as to trigger refer to
Order.
In several implementation methods provided by the present invention, it should be understood that disclosed apparatus and method, can pass through
Other modes are realized.For example, equipment implementation method described above is only schematical, for example, module or unit
Divide, only a kind of division of logic function there can be other dividing mode when actually realizing, for example multiple units or component
Can combine or be desirably integrated into another system, or some features can be ignored, or do not perform.It is another, it is shown or
The coupling each other for discussing or direct-coupling or communication connection can be the indirect couplings of device or unit by some interfaces
Close or communicate to connect, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, be shown as unit
Part can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple networks
On unit.Some or all of unit therein can be according to the actual needs selected to realize the mesh of present embodiment scheme
's.
In addition, during each functional unit in each implementation method of the invention can be integrated in a processing unit, also may be used
Being that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.It is above-mentioned integrated
Unit can both be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If integrated unit, can to realize in the form of SFU software functional unit and as independent production marketing or when using
To store in a computer read/write memory medium.Based on such understanding, technical scheme substantially or
Saying all or part of the part or technical scheme contributed to prior art can be embodied in the form of software product
Out, computer software product storage is in a storage medium, including some instructions are used to so that a computer equipment
(can be personal computer, server, or network equipment etc.) or processor (processor) perform each implementation of the present invention
The all or part of step of methods.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM,
Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. it is various
Can be with the medium of store program codes.
In sum, space gesture remote control of the invention has response speed, precision higher faster, can make people
Remote control to television set more facilitates.
Embodiments of the present invention are the foregoing is only, the scope of the claims of the invention is not thereby limited, it is every using this
Equivalent structure or equivalent flow conversion that description of the invention and accompanying drawing content are made, or directly or indirectly it is used in other correlations
Technical field, is included within the scope of the present invention.
Claims (10)
1. a kind of space gesture remote control thereof, it is characterised in that comprise the following steps：
Three-dimensional manipulation space is set up, wherein, the three-dimensional manipulation space includes three-dimensional system of coordinate and with three-dimensional system of coordinate original
The fictitious line interface put centered on point, the fictitious line interface is divided into multiple instruction region；
Gather the successive frame depth image of user；
According to the palm area of the depth image identifying user；
The motion of the special characteristic of the palm area is tracked according to the successive frame depth image；
Information is passed through come triggering command when passing through the instruction area according to the special characteristic；
Perform the instruction.
2. space gesture remote control thereof according to claim 1, it is characterised in that the step in the three-dimensional manipulation space of the foundation
After rapid, also include：
Obtain each first position information in the three-dimensional system of coordinate on the fictitious line interface；
The step of motion of the special characteristic of the tracking palm area, includes：
The special characteristic is recognized from the palm area；
Obtain multiple second place information of the special characteristic described in the successive frame depth image in the three-dimensional system of coordinate.
3. space gesture remote control thereof according to claim 2, it is characterised in that described to be passed through according to the special characteristic
In the step of information of the passing through during instruction area carrys out triggering command, the information of passing through is passed through including the special characteristic
Instruction area；
It is described to be the step of passing through information come triggering command when passing through the instruction area according to the special characteristic：According to many
The individual second place information determines the instruction area that the special characteristic is passed through with the relation of the first position information
Domain, so that triggering command.
4. space gesture remote control thereof according to claim 2, it is characterised in that described to be passed through according to the special characteristic
In the step of information of the passing through during instruction area carrys out triggering command, the information of passing through is passed through including the special characteristic
Instruction area passing through with the special characteristic through direction during instruction area；
It is described to be the step of passing through information come triggering command when passing through the instruction area according to the special characteristic：According to many
The individual second place information carrys out the instruction area that really special characteristic is passed through with the relation of the first position information
And the special characteristic is through the direction of the instruction area, so that triggering command.
5. space gesture remote control thereof according to claim 1, it is characterised in that the special characteristic is the palm area
Point on the edge of the center of gravity, barycenter or palm area in domain.
6. a kind of electronic equipment of space gesture remote control, it is characterised in that including：
Module is set up in manipulation space, for setting up three-dimensional manipulation space, wherein, the three-dimensional manipulation space includes three-dimensional system of coordinate
With the fictitious line interface put centered on the three-dimensional system of coordinate origin, the fictitious line interface is divided into multiple instruction area
Domain；
Acquisition module, sets up module and is connected with the manipulation space, the successive frame depth image for gathering user；
First identification module, is connected with the acquisition module, for the palm area according to the depth image identifying user；
Tracking module, is connected with first identification module, for tracking the palm area according to the successive frame depth image
The motion of the special characteristic in domain；
Trigger module, is connected with the tracking module, passing through during for passing through the instruction area according to the special characteristic
Information carrys out triggering command；
Performing module, is connected with the trigger module, for performing the instruction.
7. electronic equipment according to claim 6, it is characterised in that the electronic equipment is further included：First obtains
Module, sets up module and is connected with the manipulation space, for obtaining on the fictitious line interface each point in the three-dimensional coordinate
First position information in system；
The tracking module further includes the second identification module and the second acquisition module, second identification module and described
One identification module is connected, for recognizing the special characteristic from the palm area, second acquisition module and described the
Two identification modules are connected, many in the three-dimensional system of coordinate for obtaining special characteristic described in the successive frame depth image
Individual second place information.
8. electronic equipment according to claim 7, it is characterised in that the information of passing through is worn including the special characteristic
Instruction area more；
The trigger module is connected with second acquisition module, for according to multiple second place information and described first
The relation of positional information determines the instruction area that the special characteristic is passed through, so that triggering command.
9. electronic equipment according to claim 7, it is characterised in that the information of passing through is worn including the special characteristic
Instruction area more is passing through with the special characteristic through direction during instruction area；
The trigger module is connected with second acquisition module, for according to multiple second place information and described first
The relation of positional information carrys out the instruction area that really special characteristic is passed through and the special characteristic passes through the instruction
The direction in region, so that triggering command.
10. electronic equipment according to claim 6, it is characterised in that the special characteristic is the weight of the palm area
Point on the edge of the heart, barycenter or palm area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710048134.4A CN106802717A (en) | 2017-01-20 | 2017-01-20 | Space gesture remote control thereof and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710048134.4A CN106802717A (en) | 2017-01-20 | 2017-01-20 | Space gesture remote control thereof and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106802717A true CN106802717A (en) | 2017-06-06 |
Family
ID=58987149
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710048134.4A Pending CN106802717A (en) | 2017-01-20 | 2017-01-20 | Space gesture remote control thereof and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106802717A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241643A (en) * | 2017-08-03 | 2017-10-10 | 沈阳建筑大学 | A kind of multimedia volume adjusting method and system |
| CN109871123A (en) * | 2019-01-21 | 2019-06-11 | 广东精标科技股份有限公司 | A teaching method based on gesture or eye control |
| CN111898489A (en) * | 2020-07-15 | 2020-11-06 | 北京百度网讯科技有限公司 | Method, device, electronic device and storage medium for labeling palm pose |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102449577A (en) * | 2009-06-01 | 2012-05-09 | 微软公司 | Virtual desktop coordinate transformation |
| CN102860031A (en) * | 2010-04-09 | 2013-01-02 | 索尼公司 | Apparatus And Method For Identifying A Still Image Contained In Moving Image Contents |
| CN102982557A (en) * | 2012-11-06 | 2013-03-20 | 桂林电子科技大学 | Method for processing space hand signal gesture command based on depth camera |
| CN104199547A (en) * | 2014-08-29 | 2014-12-10 | 福州瑞芯微电子有限公司 | Man-machine interactive type virtual touch device, system and method |
| CN104898879A (en) * | 2009-05-26 | 2015-09-09 | 美国智能科技有限公司 | Method and apparatus for data input |
| CN105590098A (en) * | 2015-12-22 | 2016-05-18 | 北京百度网讯科技有限公司 | Image identification method and device |
| CN105630134A (en) * | 2014-10-27 | 2016-06-01 | 乐视致新电子科技（天津）有限公司 | Operation event identification method and apparatus |
| US20170003877A1 (en) * | 2015-07-01 | 2017-01-05 | Le Holdings (Beijing) Co., Ltd. | Method and device for motion-sensing key positioning |
-
2017
- 2017-01-20 CN CN201710048134.4A patent/CN106802717A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104898879A (en) * | 2009-05-26 | 2015-09-09 | 美国智能科技有限公司 | Method and apparatus for data input |
| CN102449577A (en) * | 2009-06-01 | 2012-05-09 | 微软公司 | Virtual desktop coordinate transformation |
| CN102860031A (en) * | 2010-04-09 | 2013-01-02 | 索尼公司 | Apparatus And Method For Identifying A Still Image Contained In Moving Image Contents |
| CN102982557A (en) * | 2012-11-06 | 2013-03-20 | 桂林电子科技大学 | Method for processing space hand signal gesture command based on depth camera |
| CN104199547A (en) * | 2014-08-29 | 2014-12-10 | 福州瑞芯微电子有限公司 | Man-machine interactive type virtual touch device, system and method |
| CN105630134A (en) * | 2014-10-27 | 2016-06-01 | 乐视致新电子科技（天津）有限公司 | Operation event identification method and apparatus |
| US20170003877A1 (en) * | 2015-07-01 | 2017-01-05 | Le Holdings (Beijing) Co., Ltd. | Method and device for motion-sensing key positioning |
| CN105590098A (en) * | 2015-12-22 | 2016-05-18 | 北京百度网讯科技有限公司 | Image identification method and device |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241643A (en) * | 2017-08-03 | 2017-10-10 | 沈阳建筑大学 | A kind of multimedia volume adjusting method and system |
| CN109871123A (en) * | 2019-01-21 | 2019-06-11 | 广东精标科技股份有限公司 | A teaching method based on gesture or eye control |
| CN111898489A (en) * | 2020-07-15 | 2020-11-06 | 北京百度网讯科技有限公司 | Method, device, electronic device and storage medium for labeling palm pose |
| CN111898489B (en) * | 2020-07-15 | 2023-08-08 | 北京百度网讯科技有限公司 | Method and device for marking palm pose, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107168537B (en) | Cooperative augmented reality wearable operation guidance method and system | |
| US10719993B1 (en) | Augmented reality system and method with space and object recognition | |
| KR102051309B1 (en) | Intelligent technology based augmented reality system | |
| CN104407694B (en) | The man-machine interaction method and device of a kind of combination face and gesture control | |
| CN105027030B (en) | Wireless wrist-based computing and control device and method for three-dimensional imaging, mapping, networking and interfacing | |
| WO2022216784A1 (en) | Bimanual interactions between mapped hand regions for controlling virtual and graphical elements | |
| US9933851B2 (en) | Systems and methods for interacting with virtual objects using sensory feedback | |
| US10726631B1 (en) | Augmented reality system and method with frame region recording and reproduction technology based on object tracking | |
| WO2022225761A1 (en) | Hand gestures for animating and controlling virtual and graphical elements | |
| US10665036B1 (en) | Augmented reality system and method with dynamic representation technique of augmented images | |
| CN111694428B (en) | Gesture and trajectory remote control robot system based on Kinect | |
| CN109003301A (en) | A kind of estimation method of human posture and rehabilitation training system based on OpenPose and Kinect | |
| CN106020478A (en) | Intelligent terminal manipulation method, intelligent terminal manipulation apparatus and intelligent terminal | |
| CN107357428A (en) | Man-machine interaction method and device based on gesture identification, system | |
| CN107168530A (en) | Object processing method and device in virtual scene | |
| CN109976338A (en) | A kind of multi-modal quadruped robot man-machine interactive system and method | |
| WO2020186826A1 (en) | Game control method based on intelligent wristband, intelligent wristband and storage medium | |
| CN114581535B (en) | Method, device, storage medium and equipment for marking key points of user bones in image | |
| CN109839827B (en) | Gesture recognition intelligent household control system based on full-space position information | |
| CN110013671A (en) | Movement executes method and apparatus, storage medium and electronic device | |
| CN106468917B (en) | A remote presentation interaction method and system for touching live real-time video images | |
| CN109800676A (en) | Gesture identification method and system based on depth information | |
| WO2022119697A1 (en) | Head-related transfer function | |
| KR20200025960A (en) | Intelligent technology based augmented reality system | |
| CN106886285A (en) | A kind of historical relic interactive system and operating method based on virtual reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170606 |
|
| RJ01 | Rejection of invention patent application after publication |