CN106708255A - Interaction control method and system for virtual interface - Google Patents
Interaction control method and system for virtual interface Download PDFInfo
- Publication number
- CN106708255A CN106708255A CN201610932112.XA CN201610932112A CN106708255A CN 106708255 A CN106708255 A CN 106708255A CN 201610932112 A CN201610932112 A CN 201610932112A CN 106708255 A CN106708255 A CN 106708255A
- Authority
- CN
- China
- Prior art keywords
- virtual interface
- gesture
- operational order
- function
- wearing device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an interaction control method for a virtual interface, and is applied to electronic equipment. The method comprises the following steps that: establishing communication connection with an intelligent wearing device; determining a feedback operation function item set on a setting interface; obtaining a current user interface; sending the current user interface and the set feedback operation function item to the intelligent wearing device; and after the intelligent wearing device displays the current user interface on the virtual interface by projection equipment and an operation instruction on the virtual interface is determined on the basis of the set feedback operation function item, receiving the operation instruction sent from the intelligent wearing device, and executing a corresponding operation according to the operation instruction. The invention also provides an interaction control system for the virtual interface. When the user uses the electronic equipment, the user is not limited to factors including the size of a display screen and the like and is also not limited to whether the user holds the electronic equipment at present. Even if the display screen of the user can not be used, the user still can use the electronic equipment, and user experience is improved.
Description
Technical field
The present invention relates to technical field of virtual reality, more particularly to a kind of virtual interface interaction control method and system.
Background technology
At present, virtual reality technology is a kind of computer simulation system that can be created with the experiencing virtual world, can be utilized
Computer generates a kind of simulated environment of Multi-source Information Fusion.Although prior art has had projection virtual keyboard, to projection
The operation of dummy keyboard point is singlehanded to take electronic equipment and both hands to take electronic equipment.When one hand take electronic equipment when, dummy keyboard into
Nine grids show, when both hands take electronic equipment, dummy keyboard helps keyboard ＆ display, and when user does not take electronic equipment,
Dummy keyboard cannot be shown.In addition, being in the prior art projection virtual keyboard, it is impossible to by the currently used interface of electronic equipment
Virtual interface is projected into, makes user be able to be operated on virtual interface.
The content of the invention
In view of the foregoing, it is necessary to provide a kind of virtual interface interaction control method and system, can use user
During electronic equipment, whether size, the electronic equipment of the display screen of electronic equipment are no longer limited in factors such as hands.Even if in addition,
The display screen of user can not be used, and user remains to use electronic equipment, improve the experience of user.
A kind of virtual interface interaction control method, is applied in electronic equipment, and methods described includes：
Set up the communication connection with intelligent object wearing device；
It is determined that setting feedback operation function items set on interface；
Obtain present user interface；
The present user interface and set feedback operation function items are sent to the intelligent object wearing device；
When be shown to the present user interface on virtual interface using projector equipment by the intelligent object wearing device, and base
After set feedback operation function items determine the operational order on the virtual interface, the intelligent object wearing device hair is received
The operational order for sending；And
Corresponding operation is performed according to the operational order.
According to the preferred embodiment of the present invention, the feedback operation function items include catching gesture function or sensing function
, the seizure gesture function is used to determine the operational order according to the movement locus of gesture that the sensing function to be used
Operated in using the intelligent sensor device sensing touching communicated with the intelligent object wearing device, and according to the touching for being sensed
Operation determines the operational order.
A kind of virtual interface interaction control method, is applied in intelligent object wearing device, and methods described includes：
Receive the present user interface that the electronic equipment communicated with the intelligent object wearing device sends and set
Feedback operation function items；
The present user interface is shown on virtual interface；
The operational order on the virtual interface is determined based on set feedback operation function items；And
The operational order is sent to the electronic equipment.
According to the preferred embodiment of the present invention, the feedback operation function items include catching gesture function or sensing function
, the seizure gesture function is used to determine the operational order according to the movement locus of gesture that the sensing function to be used
Operated in using the intelligent sensor device sensing touching communicated with the intelligent object wearing device, and according to the touching for being sensed
Operation determines the operational order.
According to the preferred embodiment of the present invention, when the set feedback operation function items are seizure gesture functions,
It is described to determine that the operational order on the virtual interface includes based on set feedback operation function items：
Gesture information is obtained using the picture pick-up device of the intelligent object wearing device；
According to the gesture information for getting and the RM for pre-setting, the behaviour on the virtual interface is determined
Instruct.
It is described when the set feedback operation function items are sensing functions according to the preferred embodiment of the present invention
Determine that the operational order on the virtual interface includes based on set feedback operation function items：
Obtain touching operation of the intelligent sensor device on the virtual interface；
According to the touching operation for being sensed and the touching operation for pre-setting, determine that the operation on the virtual interface refers to
Order.
A kind of virtual interface intersection control routine, runs in electronic equipment, and the system includes：
Module is set up, for setting up the communication connection with intelligent object wearing device；
Information module is determined, for determining setting feedback operation function items set on interface；
Acquisition module, for obtaining present user interface；
Information module is sent, for the present user interface and set feedback operation function items to be sent to described
Intelligent object wearing device；
The determination information module is additionally operable to utilize projector equipment by active user circle when the intelligent object wearing device
Face is shown on virtual interface, and the operational order on the virtual interface is determined based on set feedback operation function items
Afterwards, the operational order that the intelligent object wearing device sends is received.
According to the preferred embodiment of the present invention, the feedback operation function items include catching gesture function or sensing function
, the seizure gesture function is used to determine the operational order according to the movement locus of gesture that the sensing function to be used
Operated in using the intelligent sensor device sensing touching communicated with the intelligent object wearing device, and according to the touching for being sensed
Operation determines the operational order；And
Performing module, for performing corresponding operation according to the operational order.
A kind of virtual interface intersection control routine, runs in intelligent object wearing device, and the system includes：
Receiver module, for receiving the active user that the electronic equipment communicated with the intelligent object wearing device sends
Interface and set feedback operation function items；
Display module, for the present user interface to be shown into virtual interface；
Determining module, for determining the operational order on the virtual interface based on set feedback operation function items；
And
Instruction module is sent, for the operational order to be sent to the electronic equipment.
According to the preferred embodiment of the present invention, the feedback operation function items include catching gesture function or sensing function
, the seizure gesture function is used to determine the operational order according to the movement locus of gesture that the sensing function to be used
Operated in using the intelligent sensor device sensing touching communicated with the intelligent object wearing device, and according to the touching for being sensed
Operation determines the operational order.
According to the preferred embodiment of the present invention, when the set feedback operation function items are seizure gesture functions,
The determining module is used to determine that the operational order on the virtual interface includes based on set feedback operation function items：
Gesture information is obtained using the picture pick-up device of the intelligent object wearing device；
According to the gesture information for getting and the RM for pre-setting, the behaviour on the virtual interface is determined
Instruct.
It is described when the set feedback operation function items are sensing functions according to the preferred embodiment of the present invention
Determining module is used to determine that the operational order on the virtual interface includes based on set feedback operation function items：
Obtain touching operation of the intelligent sensor device on the virtual interface；
According to the touching operation for being sensed and the touching operation for pre-setting, determine that the operation on the virtual interface refers to
Order.
As can be seen from the above technical solutions, the present invention passes through intelligent object wearing device by the active user of electronic equipment
Interface is projected on virtual interface, by catching the movement locus of gesture and according to the movement locus for pre-setting determining the void
Intend the operational order on interface, or touching sensed by intelligent sensor device to operate and true according to the movement locus for pre-setting
Operational order on the fixed virtual interface, the operational order is sent to the electronic equipment.The present invention can set electronics
The interface display of standby middle user can make user when using electronic equipment on virtual interface, be no longer limited to electronic equipment
Whether size, the electronic equipment of display screen are in factors such as hands.Even if the display screen of other user can not be used, user remains to use
Electronic equipment, improves the experience of user.
Brief description of the drawings
Fig. 1 is the applied environment figure that the present invention realizes virtual interface interaction control method.
Fig. 2 is the flow chart of the first preferred embodiment of virtual interface interaction control method of the present invention.
Fig. 3 is the flow chart of the second preferred embodiment of virtual interface interaction control method of the present invention.
Fig. 4 is the structural representation of the electronic equipment of the preferred embodiment that the present invention realizes virtual interface interaction control method
Figure.
Fig. 5 is that the structure of the intelligent object wearing device of the preferred embodiment that the present invention realizes virtual interface interaction control method is shown
It is intended to.
Fig. 6 is the functional block diagram of the embodiment of virtual interface intersection control routine of the present invention.
Fig. 7 is the functional block diagram of another embodiment of virtual interface intersection control routine of the present invention.
Main element symbol description
Specific embodiment
In order that the object, technical solutions and advantages of the present invention are clearer, below in conjunction with the accompanying drawings with specific embodiment pair
The present invention is described in detail.
As shown in figure 1, Fig. 1 is the applied environment figure that the present invention realizes virtual interface interaction control method.The application ring
Border figure includes electronic equipment 1 and intelligent object wearing device 2.The intelligent object wearing device 2 is communicated with the electronic equipment 1.
Preferably, virtual interface interaction control method of the invention can apply in the multiple intelligent object wearing devices 2 and
In multiple electronic equipments 1.The electronic equipment 1 and the intelligent object wearing device 2 be one kind can according to being previously set or
The instruction of storage, the equipment that numerical computations and/or information processing are carried out automatically, its hardware include but is not limited to microprocessor, specially
With integrated circuit (Application Specific Integrated Circuit, ASIC), programmable gate array (Field-
Programmable Gate Array, FPGA), it is digital processing unit (Digital Signal Processor, DSP), embedded
Equipment etc..
Network residing for the electronic equipment 1 and the intelligent object wearing device 2 include but is not limited to internet, wide area network,
Metropolitan Area Network (MAN), LAN, VPN (Virtual Private Network, VPN) etc..The electronic equipment 1 also includes
But it is not limited to single network server, the server group of multiple webserver compositions or based on cloud computing (Cloud
Computing the cloud being made up of a large amount of main frames or the webserver), wherein, cloud computing is one kind of Distributed Calculation, by one
One super virtual computer of the computer collection composition of group's loose couplings.
The electronic equipment 1 also includes but is not limited to any one can pass through keyboard, mouse, remote control, touch with user
The mode such as plate or voice-operated device carries out the electronic product of man-machine interaction, for example, personal computer, panel computer, smart mobile phone, individual
Personal digital assistant (Personal Digital Assistant, PDA), game machine, IPTV (Internet
Protocol Television, IPTV), intellectual Wearable etc..
The intelligent object wearing device 2 can be intelligent glasses, Intelligent bracelet etc..In the embodiment of the present invention, the intelligence
Object wearing device 2 can be worn at least one position of user, for example, head, wrist, arm, leg etc..The carrier is behaved
Body, user can dress, attach or the hand-held intelligent object wearing device 2 is to detect operation of the user on virtual interface.It is described
Intelligent object wearing device 2 obtains operation of the user on virtual interface, and corresponding instruction will be operated to be sent to electronic equipment 1.
As shown in Fig. 2 being the flow chart of virtual interface interaction control method first of the present invention preferred embodiment.According to difference
Demand, the order of step can change in the flow chart, and some steps can be omitted.
S10, the electronic equipment 1 sets up the communication connection with the intelligent object wearing device 2.
In one embodiment of the invention, the electronic equipment 1 includes the first communication apparatus.The intelligent object wearing device
2 include the second communication apparatus.The electronic equipment 1 passes through the second of first communication apparatus and the intelligent object wearing device 2
Communication apparatus is set up with the intelligent object wearing device 2 and is communicated to connect.First communication apparatus and the second communication apparatus can be
Wireless communication module, wire communication module, including bluetooth module, Wi-Fi module, WiMax (World Interoperability
For Microwave Access, i.e. World Interoperability for Microwave Access, WiMax) module, GSM (Global System for Mobile
Communication, global system for mobile communications) module etc..
S11, electronic equipment 1 determines setting feedback operation function items set on interface.
In one embodiment of the invention, the setting interface includes feedback operation function items, the feedback operation work(
Energy item includes catching gesture function.The seizure gesture function is used to determine that the operation refers to according to the movement locus of gesture
Order.
In one embodiment of the invention, the intelligent object wearing device 2 is also communicated with intelligent sensor device, the intelligence
Energy sensor device includes image unit, such as described intelligent sensor device can be smart pen etc..The intelligent sensor device
The target item that user chooses is obtained by image unit.Therefore, further, the feedback operation function items also include sensing work(
Can item.The sensing function touches operation for being sensed using the intelligent sensor device, and according to the touching for being sensed
Operation determines the operational order.
When the electronic equipment 1 is provided with the feedback operation function items to catch gesture function, the follow-up intelligence
Energy object wearing device 2 is based on catching the operational order that gesture function is determined on virtual interface.When the electronic equipment 1 is provided with institute
When stating feedback operation function items for sensing function, the follow-up intelligent object wearing device 2 is based on sensing function and determines virtual boundary
Operational order on face, detailed process will be in subsequent detailed.
The setting interface also includes opening the option of intelligent object wearing device 2 and closing the intelligent object wearing device 2 selecting
.
S12, electronic equipment 1 obtains present user interface.
In one embodiment of the invention, electronic equipment 1 obtains present user interface and specifically includes：Electronic equipment 1 is obtained
Take the information of each display items on present user interface, such as icon, setting option, picture.The information of the display items includes
Title of display items etc..Electronic equipment 1 simultaneously obtains the band of position of each display items on the present user interface.
S13, electronic equipment 1 sends to the intelligence present user interface and set feedback operation function items
Object wearing device 2.
S14, when be shown to the present user interface on the virtual interface by the intelligent object wearing device 2, and is based on
After set feedback operation function items determine the operational order on the virtual interface, the electronic equipment 1 receives the intelligence
The operational order that energy object wearing device 2 sends.
In one embodiment of the invention, the intelligent object wearing device 2 includes projector equipment (such as micro projector).
The acquired present user interface is projected to the virtual interface by the intelligent object wearing device 2 using the projector equipment
On.The virtual interface may be located on books, on wall etc. on other material objects.
In one embodiment of the invention, the intelligent object wearing device 2 further includes picture pick-up device, and the shooting sets
It is ready for use on the gesture information for obtaining user on the virtual interface.
It is described to be grasped based on set feedback when the set feedback operation function items are seizure gesture functions
Determine that the operational order on the virtual interface includes as function items：
(1) gesture information is obtained using the picture pick-up device.
In one embodiment of the invention, the gesture information includes the impact point of gesture and the movement locus of gesture.
For example, for the impact point of gesture, when user touches on the virtual interface position where certain display items with hand, then hand
The impact point of gesture be the display items where position.For example, for the movement locus of gesture, when user is slided to the right with finger
When dynamic, then the movement locus of gesture is to slide to the right.
(2) according to the gesture information for getting and the RM for pre-setting, determine on the virtual interface
Operational order.
When the RM for pre-setting is that when recognizing the movement locus of gesture, the gesture information is the fortune of gesture
Dynamic rail mark；The movement locus of acquisition is matched with the movement locus for pre-saving, by the fortune for pre-saving that the match is successful
Operational order corresponding to dynamic rail mark is used as the operational order determined.When the RM for pre-setting is identification gesture
Coordinate information when, the gesture information for gesture impact point；The display to be operated is determined according to the impact point
, and the operational order to the display items is determined according to the corresponding movement locus of the impact point.For example, being set in advance in
A circle is drawn and has represented the opening display items with display items described in frame in display items periphery.User has first been touched with finger and chatted
Its software icon, an and circle has been drawn in chat software icon periphery, in the chat software icon frame, according to setting in advance
The information put, then it represents that open the chat software.
It is described based on set feedback operation work(when the set feedback operation function items are sensing functions
Energy item determines that the operational order on the virtual interface includes：
(1) touching operation of the intelligent sensor device on the virtual interface is obtained.
In one embodiment of the invention, the touching operation includes clicking operation and slide.The intelligence sense
Measurement equipment includes multiple inductors, and the inductor includes pressure inductor, gyroscope, gravity sensor etc..The intelligence
Touching operation of the sensor device using the multiple inductor sensing user on the virtual interface.
(2) according to the touching operation for being sensed and the touching operation for pre-setting, the behaviour on the virtual interface is determined
Instruct.
In one embodiment of the invention, when the touching operation for being sensed is for clicking operation, further with institute
The image unit for stating intelligent sensor device obtains target item.
In one embodiment of the invention, using the image unit obtain picture, and using Feature Extraction Technology from
The picture extracts target item, such as icon, setting options.
The sensed touching operation is matched with the touching operation for pre-setting, it is pre- according to what the match is successful
The operational order that the operational order and the target item touched corresponding to operation for first setting are determined on the virtual interface.Example
Such as, the target item that clicking operation is touched by opening.
When the touching operation for being sensed is for slide, by the sensed touching operation with pre-set
Touching operation is matched, and the operational order according to corresponding to the touching operation for pre-setting that the match is successful determines described virtual
Operational order on interface.For example, such as pre-set upward sliding be by the user interface upward sliding on the virtual interface,
Then when the touching for detecting upward sliding is operated, then the operational order on the virtual interface is to slide up user interface
It is dynamic.
S15, electronic equipment 1 performs corresponding operation according to the operational order.
As shown in figure 3, being the flow chart of virtual interface interaction control method second of the present invention preferred embodiment.According to difference
Demand, the order of step can change in the flow chart, and some steps can be omitted.
S20, the intelligent object wearing device 2 receives the present user interface that electronic equipment 1 sends and set anti-
Feedback operating function.
In one embodiment of the invention, the setting interface includes feedback operation function items, the feedback operation work(
Energy item includes catching gesture function.The seizure gesture function is used to determine that the operation refers to according to the movement locus of gesture
Order.
In one embodiment of the invention, the intelligent object wearing device 2 is also communicated with intelligent sensor device, the intelligence
Energy sensor device includes image unit, such as described intelligent sensor device can be smart pen etc..The intelligent sensor device
The target item that user chooses is obtained by image unit.Therefore, further, the feedback operation function items also include sensing work(
Can item.The sensing function touches operation for being sensed using the intelligent sensor device, and according to the touching for being sensed
Operation determines the operational order.
When the electronic equipment 1 is provided with the feedback operation function items to catch gesture function, the follow-up intelligence
Energy object wearing device 2 is based on catching the operational order that gesture function is determined on virtual interface.When the electronic equipment 1 is provided with institute
When stating feedback operation function items for sensing function, the follow-up intelligent object wearing device 2 is based on sensing function and determines virtual boundary
Operational order on face, detailed process will be in subsequent detailed.
Be shown to the present user interface on virtual interface by S21, the intelligent object wearing device 2.
In one embodiment of the invention, the intelligent object wearing device 2 includes projector equipment (such as micro projector).
The acquired present user interface is projected to the virtual interface by the intelligent object wearing device 2 using the projector equipment
On.The virtual interface may be located on books, on wall etc. on other material objects.
S22, the intelligent object wearing device 2 is based on the behaviour that set feedback operation function items are determined on the virtual interface
Instruct.
In one embodiment of the invention, the intelligent object wearing device 2 further includes picture pick-up device, and the shooting sets
It is ready for use on the gesture information for obtaining user on the virtual interface.
It is described to be grasped based on set feedback when the set feedback operation function items are seizure gesture functions
Determine that the operational order on the virtual interface includes as function items：
(1) gesture information is obtained using the picture pick-up device.
In one embodiment of the invention, the gesture information includes the impact point of gesture and the movement locus of gesture.
For example for the impact point of gesture, when user touches on the virtual interface position where certain display items with hand, then hand
The impact point of gesture be the display items where position.For example, for the movement locus of gesture, when user is slided to the right with finger
When dynamic, then the movement locus of gesture is to slide to the right.
(2) according to the gesture information for getting and the RM for pre-setting, determine on the virtual interface
Operational order.
When the RM for pre-setting is that when recognizing the movement locus of gesture, the gesture information is the fortune of gesture
Dynamic rail mark；The movement locus of acquisition is matched with the movement locus for pre-saving, by the fortune for pre-saving that the match is successful
Operational order corresponding to dynamic rail mark is used as the operational order determined.When the RM for pre-setting is identification gesture
Coordinate information when, the gesture information for gesture impact point；The display to be operated is determined according to the impact point
, and the operational order to the display items is determined according to the corresponding movement locus of the impact point.For example, being set in advance in
A circle is drawn and has represented the opening display items with display items described in frame in display items periphery.User has touched chat with finger
Software icon, an and circle has been drawn in chat software icon periphery, in the chat software icon frame, according to pre-setting
Information, then it represents that open the chat software.
It is described based on set feedback operation work(when the set feedback operation function items are sensing functions
Energy item determines that the operational order on the virtual interface includes：
(1) touching operation of the intelligent sensor device on the virtual interface is obtained.
In one embodiment of the invention, the touching operation includes clicking operation and slide.The intelligence sense
Measurement equipment includes multiple inductors, and the inductor includes pressure inductor, gyroscope, gravity sensor etc..The intelligence
Touching operation of the sensor device using the multiple inductor sensing user on the virtual interface.
(2) according to the touching operation for being sensed and the touching operation for pre-setting, the behaviour on the virtual interface is determined
Instruct.
In one embodiment of the invention, when the touching operation for being sensed is for clicking operation, further with institute
The image unit for stating intelligent sensor device obtains target item.
In one embodiment of the invention, using the image unit obtain picture, and using Feature Extraction Technology from
The picture extracts target item, such as icon, setting options.
The sensed touching operation is matched with the touching operation for pre-setting, it is pre- according to what the match is successful
The operational order that the operational order and the target item touched corresponding to operation for first setting are determined on the virtual interface.Example
Such as, the target item that clicking operation is touched by opening.
When the touching operation for being sensed is for slide, by the sensed touching operation with pre-set
Touching operation is matched, and the operational order according to corresponding to the touching operation for pre-setting that the match is successful determines described virtual
Operational order on interface.For example, such as pre-set upward sliding be by the user interface upward sliding on the virtual interface,
Then when the touching for detecting upward sliding is operated, then the operational order on the virtual interface is to slide up user interface
It is dynamic.
S23, the intelligent object wearing device 2 sends to the electronic equipment 1 operational order
The present invention is projected on virtual interface the present user interface of electronic equipment by intelligent object wearing device, is led to
Cross the movement locus of seizure gesture and the operational order on the virtual interface is determined according to the movement locus for pre-setting, or
Touching operation is sensed by intelligent sensor device and the operation on the virtual interface is determined according to the movement locus for pre-setting
Instruction, the operational order is sent to the electronic equipment.The present invention can be by the interface display of user in electronic equipment in void
Intend on interface, can make user when using electronic equipment, being no longer limited to the size of the display screen of electronic equipment, electronic equipment is
It is no in factors such as hands.Even if the display screen of other user can not be used, user remains to use electronic equipment, improves the body of user
Test.
As shown in figure 4, Fig. 4 is the electronic equipment of the preferred embodiment that the present invention realizes virtual interface interaction control method
Structural representation.The electronic equipment 1 includes the first storage device 12, the first processing equipment 13 and the first communication apparatus 14.
The electronic equipment 1 also includes but is not limited to any one can pass through keyboard, mouse, remote control, touch with user
The mode such as plate or voice-operated device carries out the electronic product of man-machine interaction, for example, personal computer, panel computer, smart mobile phone, individual
Personal digital assistant (Personal Digital Assistant, PDA), game machine, IPTV (Internet
Protocol Television, IPTV), intellectual Wearable etc..Network residing for the electronic equipment 1 is included but not
It is limited to internet, wide area network, Metropolitan Area Network (MAN), LAN, VPN (Virtual Private Network, VPN) etc..
First storage device 12 is used to store the program and various data of a kind of virtual interface interaction control method, and
High speed is realized in the running of the electronic equipment 1, the access of program or data is automatically completed.First storage device
12 can be the External memory equipment and/or internal storage device of electronic equipment 1.Further, first storage device 12
Can there is no the circuit with store function of physical form in integrated circuit, such as RAM (Random-Access Memory,
Direct access storage device), FIFO (First In First Out) etc..Or, first storage device 12 can also be
Storage device with physical form, such as memory bar, TF cards (Trans-flash Card).
First processing equipment 13, also known as central processing unit (CPU, Central Processing Unit), is one piece
Ultra-large integrated circuit, is the arithmetic core (Core) and control core (Control Unit) of electronic equipment 1.Described
One processing equipment 13 can perform the operating system of the electronic equipment 1 and types of applications program, the program code of installation etc., example
Such as virtual interface intersection control routine 11.
First communication apparatus 14 can be wireless communication module, wire communication module, including bluetooth module, Wi-Fi
Module, (World Interoperability for Microwave Access, i.e. Worldwide Interoperability for Microwave access interoperability to WiMax
Property) module, GSM (Global System for Mobile Communication, global system for mobile communications) module etc..
As shown in figure 5, the present invention realizes the intelligent object wearing device of the preferred embodiment of virtual interface interaction control method
Structural representation.The intelligent object wearing device 2 includes projector equipment 20, picture pick-up device 21, the second communication apparatus 22, second processing
The storage device 24 of equipment 23 and second.Further, the intelligent object wearing device 2 also includes other elements etc..
The intelligent object wearing device 2 receives the present user interface of the transmission of the electronic equipment 1 and set anti-
Feedback operating function；The present user interface is shown on virtual interface；It is true based on set feedback operation function items
Operational order on the fixed virtual interface；And send to the electronic equipment 1 operational order.
The projector equipment 20 is used to that the virtual interface will to be projected on acquired active user circle.It is described virtual
Interface may be located on books, on wall etc. on other material objects.The projector equipment can be micro projector) etc..
The picture pick-up device 21 is used to obtain gesture information, and the gesture information includes the impact point of gesture and the fortune of gesture
Dynamic rail mark.For example for the impact point of gesture, when user touches the position on the virtual interface where certain display items with hand
When, then the position where the impact point of gesture is the display items.For example, for the movement locus of gesture, when user's hand
When pointing to right slip, then the movement locus of gesture is to slide to the right.
Second communication apparatus 22 can be wireless communication module, wire communication module, including bluetooth module,
Wi-Fi module, (World Interoperability for Microwave Access, i.e. Worldwide Interoperability for Microwave access mutual WiMax
Operability) module, GSM (Global System for Mobile Communication, global system for mobile communications) module
Etc..
The second processing equipment 23, also known as central processing unit (CPU, Central Processing Unit), is one piece
Ultra-large integrated circuit, is the arithmetic core (Core) and control core (Control of the intelligent object wearing device 2
Unit).The second processing equipment 23 can perform the operating system of the intelligent object wearing device 2 and the types of applications journey of installation
Sequence, program code etc., such as virtual interface intersection control routine 21.
Second storage device 24 is used to store the program and various data of a kind of virtual interface interaction control method, and
High speed is realized in the running of intelligent object wearing device 2, the access of program or data is automatically completed.Second storage
Equipment 24 can be the External memory equipment and/or internal storage device of the intelligent object wearing device 2.Further, described
Two storage devices 24 can not have the circuit with store function of physical form, such as RAM (Random- in integrated circuit
Access Memory, direct access storage device), FIFO (First In First Out) etc..Or, second storage
Equipment 24 can also be the storage device with physical form, such as memory bar, TF cards (Trans-flash Card).
As shown in fig. 6, the functional block diagram of the embodiment of virtual interface intersection control routine of the present invention.The virtual interface
Intersection control routine 11 includes setting up module 100, determines information module 101, acquisition module 102, sends information module 103 and hold
Row module 104.Module alleged by the present invention refers to that one kind can be performed by the first processing equipment 13 and can complete to fix
The series of computation machine program segment of function, its storage is in the first storage device 12.In the present embodiment, on the work(of each module
To can be described in detail in follow-up embodiment.
Set up module 100 and set up communication connection with the intelligent object wearing device 2.
In one embodiment of the invention, the module 100 of setting up is by first communication apparatus 14 and the intelligence
Second communication apparatus 22 and the intelligent object wearing device 2 of energy object wearing device 2 are set up and are communicated to connect.
Determine that information module 101 determines setting feedback operation function items set on interface.At one of the invention
In embodiment, the setting interface includes feedback operation function items, and the feedback operation function items include catching gesture function.
The seizure gesture function according to the movement locus of gesture for determining the operational order.
In one embodiment of the invention, the intelligent object wearing device 2 is also communicated with intelligent sensor device, the intelligence
Energy sensor device includes image unit, such as described intelligent sensor device can be smart pen etc..The intelligent sensor device
The target item that user chooses is obtained by image unit.Therefore, further, the feedback operation function items also include sensing work(
Can item.The sensing function touches operation for being sensed using the intelligent sensor device, and according to the touching for being sensed
Operation determines the operational order.
When the electronic equipment 1 is provided with the feedback operation function items to catch gesture function, the follow-up intelligence
Energy object wearing device 2 is based on catching the operational order that gesture function is determined on virtual interface.When the electronic equipment 1 is provided with institute
When stating feedback operation function items for sensing function, the follow-up intelligent object wearing device 2 is based on sensing function and determines virtual boundary
Operational order on face, detailed process will be in subsequent detailed.
The setting interface also includes opening the option of intelligent object wearing device 2 and closing the intelligent object wearing device 2 selecting
.
Acquisition module 102 obtains present user interface.
In one embodiment of the invention, the acquisition module 102 obtains present user interface and specifically includes：It is described to obtain
Modulus block 102 obtains the information of each display items on present user interface, such as icon, setting option, picture.The display items
Title of information including display items etc..The acquisition module 102 simultaneously obtains each display items in the present user interface
On the band of position.
Information module 103 is sent to send to the intelligence present user interface and set feedback operation function items
Can object wearing device 2.
When be shown to the present user interface on virtual interface by the intelligent object wearing device 2, and based on set
After feedback operation function items determine the operational order on the virtual interface, the determination information module 101 receives the intelligence
The operational order that object wearing device 2 sends.
In one embodiment of the invention, the intelligent object wearing device 2 includes projector equipment 20 (such as micro projector)
Deng.The acquired present user interface is projected to the void by the intelligent object wearing device 2 using the projector equipment 20
Intend on interface.The virtual interface may be located on books, on wall etc. on other material objects.
In one embodiment of the invention, the intelligent object wearing device 2 further includes picture pick-up device 21, the shooting
Equipment 21 is used to obtain gesture information of the user on the virtual interface.
It is described to be grasped based on set feedback when the set feedback operation function items are seizure gesture functions
Determine that the operational order on the virtual interface includes as function items：
(1) gesture information is obtained using the picture pick-up device 21.
In one embodiment of the invention, the gesture information includes the impact point of gesture and the movement locus of gesture.
For example, for the impact point of gesture, when user touches on the virtual interface position where certain display items with hand, then hand
The impact point of gesture be the display items where position.For example, for the movement locus of gesture, when user is slided to the right with finger
When dynamic, then the movement locus of gesture is to slide to the right.
(2) according to the gesture information for getting and the RM for pre-setting, determine on the virtual interface
Operational order.
When the RM for pre-setting is that when recognizing the movement locus of gesture, the gesture information is the fortune of gesture
Dynamic rail mark；The movement locus of acquisition is matched with the movement locus for pre-saving, by the fortune for pre-saving that the match is successful
Operational order corresponding to dynamic rail mark is used as the operational order determined.When the RM for pre-setting is identification gesture
Coordinate information when, the gesture information for gesture impact point；The display to be operated is determined according to the impact point
, and the operational order to the display items is determined according to the corresponding movement locus of the impact point.For example, being set in advance in
A circle is drawn and has represented the opening display items with display items described in frame in display items periphery.User has first been touched with finger and chatted
Its software icon, an and circle has been drawn in chat software icon periphery, in the chat software icon frame, according to setting in advance
The information put, then it represents that open the chat software.
It is described based on set feedback operation work(when the set feedback operation function items are sensing functions
Energy item determines that the operational order on the virtual interface includes：
(1) touching operation of the intelligent sensor device on the virtual interface is obtained.
In one embodiment of the invention, the touching operation includes clicking operation and slide.The intelligence sense
Measurement equipment includes multiple inductors, and the inductor includes pressure inductor, gyroscope, gravity sensor etc..The intelligence
Touching operation of the sensor device using the multiple inductor sensing user on the virtual interface.
(2) according to the touching operation for being sensed and the touching operation for pre-setting, the behaviour on the virtual interface is determined
Instruct.
In one embodiment of the invention, when the touching operation for being sensed is for clicking operation, further with institute
The image unit for stating intelligent sensor device obtains target item.
In one embodiment of the invention, using the image unit obtain picture, and using Feature Extraction Technology from
The picture extracts target item, such as icon, setting options.
The sensed touching operation is matched with the touching operation for pre-setting, it is pre- according to what the match is successful
The operational order that the operational order and the target item touched corresponding to operation for first setting are determined on the virtual interface.Example
Such as, the target item that clicking operation is touched by opening.
When the touching operation for being sensed is for slide, by the sensed touching operation with pre-set
Touching operation is matched, and the operational order according to corresponding to the touching operation for pre-setting that the match is successful determines described virtual
Operational order on interface.For example, such as pre-set upward sliding be by the user interface upward sliding on the virtual interface,
Then when the touching for detecting upward sliding is operated, then the operational order on the virtual interface is to slide up user interface
It is dynamic.
Performing module 104 performs corresponding operation according to the operational order.
As shown in fig. 7, the functional block diagram of another embodiment of virtual interface intersection control routine of the present invention.It is described virtual
Interface alternation control system 21 includes receiver module 200, display module 201, determining module 202 and sends instruction module 203.This
The alleged module of invention refers to that a kind of can be performed by second processing equipment 23 and can complete a series of of fixing function
Computer program code segments, its storage is in the second storage device 24.In the present embodiment, the function on each module is by follow-up
Described in detail in embodiment.
Receiver module 200 receives the present user interface and the set feedback operation function that electronic equipment 1 sends
.
In one embodiment of the invention, the setting interface includes feedback operation function items, the feedback operation work(
Energy item includes catching gesture function.The seizure gesture function is used to determine that the operation refers to according to the movement locus of gesture
Order.
In one embodiment of the invention, the intelligent object wearing device 2 is also communicated with intelligent sensor device, the intelligence
Energy sensor device includes image unit, such as described intelligent sensor device can be smart pen etc..The intelligent sensor device
The target item that user chooses is obtained by image unit.Therefore, further, the feedback operation function items also include sensing work(
Can item.The sensing function touches operation for being sensed using the intelligent sensor device, and according to the touching for being sensed
Operation determines the operational order.
When the electronic equipment 1 is provided with the feedback operation function items to catch gesture function, the follow-up intelligence
Energy object wearing device 2 is based on catching the operational order that gesture function is determined on virtual interface.When the electronic equipment 1 is provided with institute
When stating feedback operation function items for sensing function, the follow-up intelligent object wearing device 2 is based on sensing function and determines virtual boundary
Operational order on face, detailed process will be in subsequent detailed.
Be shown to the present user interface on virtual interface by display module 201.
In one embodiment of the invention, the intelligent object wearing device 2 includes projector equipment 20 (such as micro projector)
Deng.The acquired present user interface is projected to the void by the intelligent object wearing device 2 using the projector equipment 20
Intend on interface.The virtual interface may be located on books, on wall etc. on other material objects.
Determining module 202 is based on the operational order that set feedback operation function items are determined on the virtual interface.
In one embodiment of the invention, the intelligent object wearing device 2 further includes picture pick-up device 21, the shooting
Equipment 21 is used to obtain gesture information of the user on the virtual interface.
When the set feedback operation function items are that the determining module 202 is based on institute when catching gesture function
The feedback operation function items of setting determine that the operational order on the virtual interface includes：
(1) gesture information is obtained using the picture pick-up device.
In one embodiment of the invention, the gesture information includes the impact point of gesture and the movement locus of gesture.
For example for the impact point of gesture, when user touches on the virtual interface position where certain display items with hand, then hand
The impact point of gesture be the display items where position.For example, for the movement locus of gesture, when user is slided to the right with finger
When dynamic, then the movement locus of gesture is to slide to the right.
(2) according to the gesture information for getting and the RM for pre-setting, determine on the virtual interface
Operational order.
When the RM for pre-setting is that when recognizing the movement locus of gesture, the gesture information is the fortune of gesture
Dynamic rail mark；The movement locus of acquisition is matched with the movement locus for pre-saving, by the fortune for pre-saving that the match is successful
Operational order corresponding to dynamic rail mark is used as the operational order determined.When the RM for pre-setting is identification gesture
Coordinate information when, the gesture information for gesture impact point；The display to be operated is determined according to the impact point
, and the operational order to the display items is determined according to the corresponding movement locus of the impact point.For example, being set in advance in
A circle is drawn and has represented the opening display items with display items described in frame in display items periphery.User has touched chat with finger
Software icon, an and circle has been drawn in chat software icon periphery, in the chat software icon frame, according to pre-setting
Information, then it represents that open the chat software.
When the set feedback operation function items are sensing functions, the determining module 202 is based on set
Feedback operation function items determine that the operational order on the virtual interface includes：
(1) touching operation of the intelligent sensor device on the virtual interface is obtained.
In one embodiment of the invention, the touching operation includes clicking operation and slide.The intelligence sense
Measurement equipment includes multiple inductors, and the inductor includes pressure inductor, gyroscope, gravity sensor etc.).The intelligence
Touching operation of the sensor device using the multiple inductor sensing user on the virtual interface.
(2) according to the touching operation for being sensed and the touching operation for pre-setting, the behaviour on the virtual interface is determined
Instruct.
In one embodiment of the invention, when the touching operation for being sensed is for clicking operation, further with institute
The image unit for stating intelligent sensor device obtains target item.
In one embodiment of the invention, using the image unit obtain picture, and using Feature Extraction Technology from
The picture extracts target item, such as icon, setting options.
The sensed touching operation is matched with the touching operation for pre-setting, it is pre- according to what the match is successful
The operational order that the operational order and the target item touched corresponding to operation for first setting are determined on the virtual interface.Example
Such as, the target item that clicking operation is touched by opening.
When the touching operation for being sensed is for slide, by the sensed touching operation with pre-set
Touching operation is matched, and the operational order according to corresponding to the touching operation for pre-setting that the match is successful determines described virtual
Operational order on interface.For example, such as pre-set upward sliding be by the user interface upward sliding on the virtual interface,
Then when the touching for detecting upward sliding is operated, then the operational order on the virtual interface is to slide up user interface
It is dynamic.
Instruction module 203 is sent to send to the electronic equipment 1 operational order.
The present invention is projected on virtual interface the present user interface of electronic equipment by intelligent object wearing device, is led to
Cross the movement locus of seizure gesture and the operational order on the virtual interface is determined according to the movement locus for pre-setting, or
Touching operation is sensed by intelligent sensor device and the operation on the virtual interface is determined according to the movement locus for pre-setting
Instruction, the operational order is sent to the electronic equipment.The present invention can be by the interface display of user in electronic equipment in void
Intend on interface, can make user when using electronic equipment, being no longer limited to the size of the display screen of electronic equipment, electronic equipment is
It is no in factors such as hands.Even if the display screen of other user can not be used, user remains to use electronic equipment, improves the body of user
Test.
The above-mentioned integrated unit realized in the form of software function module, can store and be deposited in an embodied on computer readable
In storage media.Above-mentioned software function module storage is in a storage medium, including some instructions are used to so that a computer
Equipment (can be personal computer, server, or network equipment etc.) or processor (processor) perform the present invention each
The part steps of embodiment methods described.
With reference to Fig. 2, the first storage device 12 storage multiple instruction in the electronic equipment 1 is a kind of virtual to realize
Interface alternation control method, first processing equipment 13 can perform the multiple instruction so as to realize：Set up and dressed with intelligence
The communication connection of device；It is determined that setting feedback operation function items set on interface；Obtain present user interface；Will be described
Present user interface and set feedback operation function items are sent to the intelligent object wearing device；When the intelligent object wearing device
The present user interface is shown on virtual interface using projector equipment, and it is true based on set feedback operation function items
After operational order on the fixed virtual interface, the operational order that the intelligent object wearing device sends is received；And according to institute
State operational order and perform corresponding operation.
According to the preferred embodiment of the present invention, the feedback operation function items include catching gesture function or sensing function
, the seizure gesture function is used to determine the operational order according to the movement locus of gesture that the sensing function to be used
Operated in using the intelligent sensor device sensing touching communicated with the intelligent object wearing device, and according to the touching for being sensed
Operation determines the operational order.
With reference to Fig. 3, in one embodiment of the invention, second storage device in the intelligent object wearing device 2
To realize a kind of virtual interface interaction control method, the second processing equipment 23 can perform the multiple 24 storage multiple instructions
Instruction is so as to realize：Receive the present user interface and institute that the electronic equipment communicated with the intelligent object wearing device sends
The feedback operation function items of setting；The present user interface is shown on virtual interface；Based on set feedback operation
Function items determine the operational order on the virtual interface；And send to the electronic equipment operational order.
According to the preferred embodiment of the present invention, the feedback operation function items include catching gesture function or sensing function
, the seizure gesture function is used to determine the operational order according to the movement locus of gesture that the sensing function to be used
Operated in using the intelligent sensor device sensing touching communicated with the intelligent object wearing device, and according to the touching for being sensed
Operation determines the operational order.
According to the preferred embodiment of the present invention, the second processing equipment 23 can also carry out with give an order including：
Gesture information is obtained using the picture pick-up device of the intelligent object wearing device；
According to the gesture information for getting and the RM for pre-setting, the behaviour on the virtual interface is determined
Instruct.
According to the preferred embodiment of the present invention, the second processing equipment 23 can also carry out with give an order including：
Obtain touching operation of the intelligent sensor device on the virtual interface；
According to the touching operation for being sensed and the touching operation for pre-setting, determine that the operation on the virtual interface refers to
Order.
Specifically, first processing equipment 13 and second processing equipment 23 can join to the concrete methods of realizing of above-mentioned instruction
The description of correlation step in Fig. 2 and Fig. 3 correspondence embodiments is examined, be will not be described here.In several embodiments provided by the present invention,
It should be appreciated that disclosed system, apparatus and method, can realize by another way.For example, dress described above
It is only schematical to put embodiment, for example, the division of the module, only a kind of division of logic function, when actually realizing
There can be other dividing mode.
The module that is illustrated as separating component can be or may not be it is physically separate, it is aobvious as module
The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of module therein can be according to the actual needs selected to realize the mesh of this embodiment scheme
's.
In addition, during each functional module in each embodiment of the invention can be integrated in a processing unit, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.Above-mentioned integrated list
Unit can both be realized in the form of hardware, it would however also be possible to employ hardware adds the form of software function module to realize.
It is obvious to a person skilled in the art that the invention is not restricted to the details of above-mentioned one exemplary embodiment, Er Qie
In the case of without departing substantially from spirit or essential attributes of the invention, the present invention can be in other specific forms realized.Therefore, no matter
From the point of view of which point, embodiment all should be regarded as exemplary, and be nonrestrictive, the scope of the present invention is by appended power
Profit requires to be limited rather than described above, it is intended that all in the implication and scope of the equivalency of claim by falling
Change is included in the present invention.The right that any attached associated diagram mark in claim should not be considered as involved by limitation will
Ask.Furthermore, it is to be understood that " including " word is not excluded for other units or step, odd number is not excluded for plural number.Stated in system claims
Multiple units or device can also be realized by software or hardware by a unit or device.The first, the second grade word
For representing title, and it is not offered as any specific order.
Finally it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention and it is unrestricted, although reference
Preferred embodiment has been described in detail to the present invention, it will be understood by those within the art that, can be to of the invention
Technical scheme is modified or equivalent, without deviating from the spirit and scope of technical solution of the present invention.
Claims (12)
1. a kind of virtual interface interaction control method, is applied in electronic equipment, it is characterised in that methods described includes：
Set up the communication connection with intelligent object wearing device；
It is determined that setting feedback operation function items set on interface；
Obtain present user interface；
The present user interface and set feedback operation function items are sent to the intelligent object wearing device；
When be shown to the present user interface on virtual interface using projector equipment by the intelligent object wearing device, and based on institute
After the feedback operation function items of setting determine the operational order on the virtual interface, receive what the intelligent object wearing device sent
The operational order；And
Corresponding operation is performed according to the operational order.
2. virtual interface interaction control method as claimed in claim 1, it is characterised in that the feedback operation function items include
Gesture function or sensing function are caught, the seizure gesture function according to the movement locus of gesture for determining the behaviour
Instruct, the sensing function is for using the intelligent sensor device sensing touching behaviour communicated with the intelligent object wearing device
Make, and the operational order is determined according to the touching operation for being sensed.
3. a kind of virtual interface interaction control method, is applied in intelligent object wearing device, it is characterised in that methods described includes：
Receive the present user interface that the electronic equipment communicated with the intelligent object wearing device sends and set anti-
Feedback operating function；
The present user interface is shown on virtual interface；
The operational order on the virtual interface is determined based on set feedback operation function items；And
The operational order is sent to the electronic equipment.
4. virtual interface interaction control method as claimed in claim 3, it is characterised in that the feedback operation function items include
Gesture function or sensing function are caught, the seizure gesture function according to the movement locus of gesture for determining the behaviour
Instruct, the sensing function is for using the intelligent sensor device sensing touching behaviour communicated with the intelligent object wearing device
Make, and the operational order is determined according to the touching operation for being sensed.
5. virtual interface interaction control method as claimed in claim 4, it is characterised in that when the set feedback operation
Function items are the behaviour determined based on set feedback operation function items on virtual interface when catching gesture function
Include as instruction：
Gesture information is obtained using the picture pick-up device of the intelligent object wearing device；
According to the gesture information for getting and the RM for pre-setting, determine that the operation on the virtual interface refers to
Order.
6. virtual interface interaction control method as claimed in claim 4, it is characterised in that when the set feedback operation
It is described to determine that the operation on the virtual interface refers to based on set feedback operation function items when function items are sensing functions
Order includes：
Obtain touching operation of the intelligent sensor device on the virtual interface；
According to the touching operation for being sensed and the touching operation for pre-setting, the operational order on the virtual interface is determined.
7. a kind of virtual interface intersection control routine, in running on electronic equipment, it is characterised in that the system includes：
Module is set up, for setting up the communication connection with intelligent object wearing device；
Information module is determined, for determining setting feedback operation function items set on interface；
Acquisition module, for obtaining present user interface；
Information module is sent, for the present user interface and set feedback operation function items to be sent to the intelligence
Object wearing device；
The determination information module is additionally operable to show the present user interface using projector equipment when the intelligent object wearing device
Show on virtual interface, and after determining the operational order on the virtual interface based on set feedback operation function items, connect
Receive the operational order that the intelligent object wearing device sends；And
Performing module, for performing corresponding operation according to the operational order.
8. virtual interface intersection control routine as claimed in claim 7, it is characterised in that the feedback operation function items include
Gesture function or sensing function are caught, the seizure gesture function according to the movement locus of gesture for determining the behaviour
Instruct, the sensing function is for using the intelligent sensor device sensing touching behaviour communicated with the intelligent object wearing device
Make, and the operational order is determined according to the touching operation for being sensed.
9. a kind of virtual interface intersection control routine, in running on intelligent object wearing device, it is characterised in that the system includes：
Receiver module, for receiving the present user interface that the electronic equipment communicated with the intelligent object wearing device sends
And set feedback operation function items；
Display module, for the present user interface to be shown into virtual interface；
Determining module, for determining the operational order on the virtual interface based on set feedback operation function items；And
Instruction module is sent, for the operational order to be sent to the electronic equipment.
10. virtual interface intersection control routine as claimed in claim 9, it is characterised in that the feedback operation function items bag
Seizure gesture function or sensing function are included, the seizure gesture function is used for according to the movement locus of gesture determines
Operational order, the sensing function using the intelligent sensor device communicated with the intelligent object wearing device for sensing touching
Operation, and the operational order is determined according to the touching operation for being sensed.
11. virtual interface intersection control routines as claimed in claim 10, it is characterised in that as the set feedback behaviour
It is that when catching gesture function, the feedback operation function items that the determining module is used for based on set by determine described as function items
Operational order on virtual interface includes：
Gesture information is obtained using the picture pick-up device of the intelligent object wearing device；
According to the gesture information for getting and the RM for pre-setting, determine that the operation on the virtual interface refers to
Order.
12. virtual interface intersection control routines as claimed in claim 10, it is characterised in that as the set feedback behaviour
When being sensing function as function items, the determining module is used to determining based on set feedback operation function items described virtual
Operational order on interface includes：
Obtain touching operation of the intelligent sensor device on the virtual interface；
According to the touching operation for being sensed and the touching operation for pre-setting, the operational order on the virtual interface is determined.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610932112.XA CN106708255A (en) | 2016-10-31 | 2016-10-31 | Interaction control method and system for virtual interface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610932112.XA CN106708255A (en) | 2016-10-31 | 2016-10-31 | Interaction control method and system for virtual interface |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106708255A true CN106708255A (en) | 2017-05-24 |
Family
ID=58940353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610932112.XA Pending CN106708255A (en) | 2016-10-31 | 2016-10-31 | Interaction control method and system for virtual interface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106708255A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108170506A (en) * | 2017-11-27 | 2018-06-15 | 北京硬壳科技有限公司 | Control method, device and the control system of app |
| CN108268185A (en) * | 2017-11-27 | 2018-07-10 | 北京硬壳科技有限公司 | Control method, control device and control system |
| CN108769206A (en) * | 2018-05-30 | 2018-11-06 | 努比亚技术有限公司 | Method of data synchronization, terminal and storage medium |
| CN109561333A (en) * | 2017-09-27 | 2019-04-02 | 腾讯科技（深圳）有限公司 | Video broadcasting method, device, storage medium and computer equipment |
| CN110362228A (en) * | 2018-10-26 | 2019-10-22 | 珠海中电数码科技有限公司 | A kind of unlimited writing on the blackboard method and its system based on liquid crystal blackboard |
| CN114783432A (en) * | 2022-03-22 | 2022-07-22 | 歌尔科技有限公司 | Playing control method of intelligent glasses, intelligent glasses and storage medium |
| CN114779924A (en) * | 2022-03-22 | 2022-07-22 | 歌尔科技有限公司 | Head-mounted display device, method for controlling household device and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120229509A1 (en) * | 2011-03-07 | 2012-09-13 | Liu Guangsong | System and method for user interaction |
| CN202600639U (en) * | 2012-04-06 | 2012-12-12 | 深圳市三诺电子有限公司 | Laser pointer for remotely controlling projection picture of projector |
| CN103076900A (en) * | 2012-12-27 | 2013-05-01 | 苏州佳世达光电有限公司 | Projection pen and projection interactive system employing same |
| CN104090702A (en) * | 2014-07-04 | 2014-10-08 | 续拓 | Intelligent and virtual blackboard system based on image processing |
| CN104808800A (en) * | 2015-05-21 | 2015-07-29 | 上海斐讯数据通信技术有限公司 | Smart glasses device, mobile terminal and operation method of mobile terminal |
| CN104866103A (en) * | 2015-06-01 | 2015-08-26 | 联想(北京)有限公司 | Relative position determining method, wearable electronic equipment and terminal equipment |
| CN105739672A (en) * | 2014-12-09 | 2016-07-06 | 深圳富泰宏精密工业有限公司 | Projection input system and method |
| CN105824399A (en) * | 2015-01-06 | 2016-08-03 | 中兴通讯股份有限公司 | Control method, system and apparatus for projection equipment |
-
2016
- 2016-10-31 CN CN201610932112.XA patent/CN106708255A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120229509A1 (en) * | 2011-03-07 | 2012-09-13 | Liu Guangsong | System and method for user interaction |
| CN202600639U (en) * | 2012-04-06 | 2012-12-12 | 深圳市三诺电子有限公司 | Laser pointer for remotely controlling projection picture of projector |
| CN103076900A (en) * | 2012-12-27 | 2013-05-01 | 苏州佳世达光电有限公司 | Projection pen and projection interactive system employing same |
| CN104090702A (en) * | 2014-07-04 | 2014-10-08 | 续拓 | Intelligent and virtual blackboard system based on image processing |
| CN105739672A (en) * | 2014-12-09 | 2016-07-06 | 深圳富泰宏精密工业有限公司 | Projection input system and method |
| CN105824399A (en) * | 2015-01-06 | 2016-08-03 | 中兴通讯股份有限公司 | Control method, system and apparatus for projection equipment |
| CN104808800A (en) * | 2015-05-21 | 2015-07-29 | 上海斐讯数据通信技术有限公司 | Smart glasses device, mobile terminal and operation method of mobile terminal |
| CN104866103A (en) * | 2015-06-01 | 2015-08-26 | 联想(北京)有限公司 | Relative position determining method, wearable electronic equipment and terminal equipment |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109561333A (en) * | 2017-09-27 | 2019-04-02 | 腾讯科技（深圳）有限公司 | Video broadcasting method, device, storage medium and computer equipment |
| CN109561333B (en) * | 2017-09-27 | 2021-09-07 | 腾讯科技（深圳）有限公司 | Video playing method and device, storage medium and computer equipment |
| CN108170506A (en) * | 2017-11-27 | 2018-06-15 | 北京硬壳科技有限公司 | Control method, device and the control system of app |
| CN108268185A (en) * | 2017-11-27 | 2018-07-10 | 北京硬壳科技有限公司 | Control method, control device and control system |
| CN108268185B (en) * | 2017-11-27 | 2021-05-28 | 北京硬壳科技有限公司 | Control method, control device and control system |
| CN108769206A (en) * | 2018-05-30 | 2018-11-06 | 努比亚技术有限公司 | Method of data synchronization, terminal and storage medium |
| CN108769206B (en) * | 2018-05-30 | 2021-06-01 | 努比亚技术有限公司 | Data synchronization method, terminal and storage medium |
| CN110362228A (en) * | 2018-10-26 | 2019-10-22 | 珠海中电数码科技有限公司 | A kind of unlimited writing on the blackboard method and its system based on liquid crystal blackboard |
| CN114783432A (en) * | 2022-03-22 | 2022-07-22 | 歌尔科技有限公司 | Playing control method of intelligent glasses, intelligent glasses and storage medium |
| CN114779924A (en) * | 2022-03-22 | 2022-07-22 | 歌尔科技有限公司 | Head-mounted display device, method for controlling household device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106708255A (en) | Interaction control method and system for virtual interface | |
| EP2812770B1 (en) | Image processing device, and computer program product | |
| US10055064B2 (en) | Controlling multiple devices with a wearable input device | |
| Seo et al. | Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences | |
| EP3921806A1 (en) | Body pose estimation | |
| CN109074217A (en) | Application for multi-touch input detection | |
| EP2977881A1 (en) | Method and apparatus of touch control for multi-point touch terminal | |
| WO2020047307A1 (en) | Virtual item simulation using detected surfaces | |
| CN107291317B (en) | The selection method and device of target in a kind of virtual scene | |
| US20170091977A1 (en) | Method and system for a virtual reality animation tool | |
| CN103620526A (en) | Gesture-controlled technique to expand interaction radius in computer vision applications | |
| CN104007819A (en) | Gesture recognition method and device and Leap Motion system | |
| CN103902056B (en) | Dummy keyboard input method, equipment and system | |
| CN104951064B (en) | Efficient free space finger identification | |
| CN106029187A (en) | Advanced game mechanics on hover-sensitive devices | |
| CN109598198A (en) | The method, apparatus of gesture moving direction, medium, program and equipment for identification | |
| RU2667720C1 (en) | Method of imitation modeling and controlling virtual sphere in mobile device | |
| CN117011929A (en) | Head posture estimation method, device, equipment and storage medium | |
| CN116152289A (en) | A tracking method, related device, equipment and storage medium of a target object | |
| US20250013309A1 (en) | Virtual object display method and apparatus, electronic device and readable medium | |
| CN106598422A (en) | Directivity-based control and hybrid control methods, control system and electronic equipment | |
| CN106547339A (en) | The control method and device of computer equipment | |
| CN107885318A (en) | A kind of virtual environment exchange method, device, system and computer-readable medium | |
| CN108803862B (en) | Account relation establishing method and device used in virtual reality scene | |
| CN114637394A (en) | Interactive operation system and method for bare hand and simulated touch screen interface in VR environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170524 |