CN109597489A - A kind of method and system of the eye movement tracking interaction of near-eye display device - Google Patents
A kind of method and system of the eye movement tracking interaction of near-eye display device Download PDFInfo
- Publication number
- CN109597489A CN109597489A CN201811612264.7A CN201811612264A CN109597489A CN 109597489 A CN109597489 A CN 109597489A CN 201811612264 A CN201811612264 A CN 201811612264A CN 109597489 A CN109597489 A CN 109597489A
- Authority
- CN
- China
- Prior art keywords
- eye
- display device
- eye display
- eye movement
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention belongs to near-eye display device applied technical fields, disclose a kind of method and system of the eye movement tracking interaction of near-eye display device, Eye-controlling focus is carried out using the eye movement tracking mould group in near-eye display device, is mapped to near-eye display device optical imagery button screen coordinate position after carrying out calculation processing to the eye movement information of acquisition；Button screen is imaged to click, executes the interactive function program after interaction success.Operation of the present invention interactive experience sense is more preferable: selecting in contrast to the blink of existing eye movement interaction, the present invention greatly reduces attention of the user during interactive controlling carried out by eyeball, the cognitive load on subjective consciousness is reduced simultaneously, the muscle of simple eye blink will not be controlled uncoordinated and bring is uncomfortable；In contrast to gesture identification interactive controlling, advantage of the invention is that concealment height is convenient without losing operation, suitable for the application scenarios required to privacy.
Description
Technical field
The invention belongs to near-eye display device application technology and display interaction technique field more particularly to a kind of nearly eye are aobvious
Show the method and system of the eye movement tracking interaction of equipment.
Background technique
Currently, the prior art commonly used in the trade is such that
In near-eye display device application process, eye movement tracking is one of interactive mode important in its use process.When
It is irreplaceable excellent that right eye movement tracking interactive mode has that mobile selection is fast, privacy is strong, consumes one's strength less, is convenient and efficient etc.
Gesture.When by fixation object certain time length, binocular blink, monocular blink, eye movement direction, (eyeball is looked up, past left and right is seen
Deng) etc. the virtual image that is presented in a series of eyes behavior and near-eye display device or display interact when (hand over
Mutually include selection confirmation, click, page turning sliding, attribute pop-up etc., including but not limited to above-mentioned interbehavior) need people in subjectivity
Huge cognition is paid in consciousness level and energy goes to coordinate interaction of the eyes to near-eye display device interface.Above interaction side
Formula do not seem using mouse when clicking right and left key, the subjective consciousness of people do not need it is excessive participate in operation,
And current eye movement interbehavior, such as eyes blink " click determine " need people to pay certain subjective energy of people, and shadow
Ring sight.
In conclusion problem of the existing technology is:
In the prior art, the operating interactive experience perception of near-eye display device is poor.Cannot high-frequency click the behaviour of behavior
Make；
When by fixation object certain time length, binocular blink, monocular blink, (eyeball looks up, two-sided in eye movement direction
Seen toward center) etc. the virtual image that is presented in a series of eyes behavior and near-eye display device (interact when interacting
Including selection confirmation, click, page turning sliding, attribute pop-up) need people to pay huge cognition and essence in subjective consciousness level
Power goes to coordinate interaction of the eyes to near-eye display device interface.Comparing pure eye movement interaction, (fixation object certain time length, binocular blink
Eye, monocular blink) the bad above interactive mode of experience do not seem using mouse when clicking right and left key, the master of people
The consciousness of sight does not need the excessive operation that participates in, and current eye movement interbehavior, such as eyes blink " click and determine "
People is needed to pay the subjective energy of people.
Solve the meaning of above-mentioned technical problem:
The present invention keeps the operating interactive experience sense of near-eye display device more preferable:
In contrast to the blink selection of traditional eye movement interaction, the upper cognition that the present invention greatly reduces user's subjective consciousness is negative
Lotus, will not be one black at the moment during selection, and when operation will not control uncoordinated and bring because of the muscle of simple eye blink
It is uncomfortable.
Interactive efficiency is higher: the present invention solves the problems, such as that low efficiency is clicked in confirmation in existing eye movement interactive process, according to
Interaction schemes of the present invention, clicking affirming conduct is completed by external hardware device, has continued the operation that people use mouse
Habit, improves human-computer interaction efficiency.
There is privacy:
It is suitable in contrast to gesture identification interactive mode advantage of the invention is that concealment height is convenient without losing operation
To privacy by desired application scenarios.
Scheme system structure is simple: near-eye display device+hardware adaptor, is communicatively coupled by wireless (bluetooth), firmly
Part peripheral hardware, which receives, will click on instruction after the click behavior of people and is transferred to near-eye display device, at this moment friendship of the people to institute's watching area
It is clicked at mutual interface.
Whole exchange method power consumption is lower, interactive experience is more preferable: comparing the interaction schemes of gesture identification, this programme power consumption
It is low, so that the Product Experience of near-eye display device entirety is more preferable
The present invention means a great, and compensates for the defect of pure eye movement interaction.
Summary of the invention
In view of the problems of the existing technology, the present invention provides a kind of sides of the eye movement of near-eye display device tracking interaction
Method and system.
The invention is realized in this way a kind of method of the eye movement tracking interaction of near-eye display device includes:
The optical imagery button screen coordinate position of near-eye display device receives click behavior Bluetooth signal；
Eye movement tracking is carried out using near-eye display device, is mapped to optics after carrying out calculation processing to the eye movement information of acquisition
Button screen coordinate position is imaged；Optical imagery button screen click is carried out again, executes interactive program.
Further, the method for the eye movement tracking interaction of the near-eye display device specifically includes:
Step 1: the computer system of near-eye display device is shown in nearly eye by eye movement tracing module acquisition human eye ball and is set
The mapping point of sight intersection point on standby optical imagery screen；The eye movement tracing module integrated in near-eye display device obtains human eye
Ball image identifies eye image and calculates eye movement vector, obtains the eye movement coordinates of motion；
During wherein eye movement vector obtains, using pupil-corneal reflection spot method or MEMS eyeball tracking technology, by people
The motor behavior digitlization of eye, is converted into the electronic signal of computer system calculating, and calculate by algorithm and obtain people's blinkpunkt
Mapping relations on the optical imagery screen of near-eye display device；According to mapping relations, near-eye display device optics at
Visual feedback as human eye fixation point is presented on display；
Step 2: obtaining the operational order of hardware external equipment: setting radio magnetic wave communication module in near-eye display device,
Near-eye display device receives the click from hardware external equipment by radio magnetic wave communication module and confirms wireless signal instruction,
Instruction is transferred to near-eye display device by hardware external equipment in the form of radio magnetic wave signal；
Step 3: it completes to click the button in the operation interface on near-eye display device optical imagery screen, executes friendship
Mutual program.
Further, it after the hardware external equipment obtains click behavior signal, is carried out at signal by integrated processor
Reason, by the bluetooth module of treated signal is sent in a manner of Bluetooth matching near-eye display device.
Electromagnetic wave signal includes Bluetooth signal, wifi signal, infrared signal；
The shape of mapping point is arbitrarily replaced.
The visual feedback of human eye fixation point can be presented on the optical imagery display of near-eye display device (shaped like in computer screen
Mouse on curtain)；Hardware external equipment has click function, and the mobile click with hardware external equipment of the cursor of eye movement forms class
Like the interactive function of mouse.
Another object of the present invention is to provide a kind of methods of eye movement tracking interaction for implementing the near-eye display device
Near-eye display device eye movement track interactive system, the near-eye display device eye movement tracking interactive system include:
Near-eye display device and hardware external equipment；
Near-eye display device is used to interact the selection at interface by eye movement tracing equipment；
Hardware external equipment, and near-eye display device bluetooth connection, for confirming click behavior.
Further, the hardware external equipment is intended to be worn in user hand, with the wrist of user, palm, finger, hand body
Any shape of engineering science is identical.
Further, near-eye display device is intelligent glasses, and intelligent glasses include:
Obtain the hardware adaptor key of click behavior signal；
Click behavior signal is received, the processor of signal processing is carried out；
By the Bluetooth transmission module of treated signal is sent in a manner of Bluetooth matching bluetooth module.Bluetooth is optimal, but
It is not limited to Bluetooth transmission, including other wireless radio transmission forms.
Further, the near-eye display device includes:
Carry out the eye movement tracing module of eyeball tracking；
The optical imagery screen that the information of near-eye display device operation interface or Application Program Interface is presented；
The calculation processing module of calculation processing is carried out to the eye movement tracked information of acquisition；
For receiving the bluetooth module of the Bluetooth signal of hardware external equipment transmission；
It is integrated on bluetooth module, what is be used for sends and receivees the signal receiver of Bluetooth signal.
After hardware external equipment obtains click behavior signal, signal processing is carried out by integrated processor, after processing
Signal the bluetooth module of near-eye display device is sent in a manner of Bluetooth matching.
Further, the optical imagery screen shows equipment for being integrated in head；
Hardware external equipment is that intelligent TV set, projector, the LED with display imaging function show large-size screen monitors, plate.
Another object of the present invention is to provide a kind of methods of eye movement tracking interaction for realizing the near-eye display device
Computer program.
Another object of the present invention is to provide a kind of methods of eye movement tracking interaction for realizing the near-eye display device
Information data processing terminal.
Another object of the present invention is to provide a kind of computer readable storage mediums, including instruction, when it is in computer
When upper operation, so that the method that computer executes the eye movement tracking interaction of the near-eye display device.
In conclusion advantages of the present invention and good effect are as follows:
The operating interactive experience sense of near-eye display device of the present invention is more preferable: it is selected in contrast to the blink of existing eye movement interaction,
The present invention greatly reduces attention of the user during interactive controlling carried out by eyeball, while reducing subjective consciousness
On cognitive load, the muscle of simple eye blink will not be controlled it is uncoordinated and bring is uncomfortable, will not eye during selection
It is previous black, it will not be controlled because of the muscle of simple eye blink when operation uncoordinated and bring is uncomfortable.
Interactive efficiency is higher: the present invention solves the problems, such as that low efficiency is clicked in confirmation in existing eye movement interactive process, according to
Interaction schemes of the present invention, clicking affirming conduct is completed by external hardware device, has continued the operation that people use mouse
Habit, improves human-computer interaction efficiency.
Privacy: in contrast to gesture identification interaction, advantage of the invention is that concealment is high rather than operation is convenient, is applicable in
In the application scenarios required to privacy.
Scheme system structure is simple: near-eye display device+hardware adaptor, is communicatively coupled by wireless (bluetooth), firmly
Part peripheral hardware, which receives, will click on instruction after the click behavior of people and is transferred to near-eye display device, at this moment friendship of the people to institute's watching area
It is clicked at mutual interface.
Have from interaction technique angle in the prior art: the main interactive operation scheme of near-eye display device has: eye movement tracking,
Gesture identification, operation handle.
Inspiration of the present invention and interactive frame derive from computer mouse and handset touch panel curtain；
Have in the prior art and from the beginning show equipment interaction: the current AR/VR head with eye movement tracking function both at home and abroad is aobvious, and (AR is close
Eye display equipment and VR glasses)；
The present invention is substantially that will click on the movement of confirmation independently to go out, and has peripheral hardware hardware to undertake, and is to track to interact in eye movement
Technical innovation, under dimension with the present invention without similar scheme.
The present invention, which applies, shows large-size screen monitors, plate etc. in display interaction field, such as intelligent TV set, projector, LED.
The mapping of eye movement coordinate is shown in equipment (near-eye display device optical display means) to the end, other any shapes can also be will be mapped to
On the screen of formula, eye movement tracking and external equipment are simultaneously using realizing better interactive experience.
Detailed description of the invention
Fig. 1 is the eye movement tracking exchange method flow chart of near-eye display device provided in an embodiment of the present invention.
Fig. 2 is the eye movement tracking interactive system schematic diagram of near-eye display device provided in an embodiment of the present invention.
In figure: 1, intelligent glasses；2, hardware external equipment；3, hardware adaptor key；4, processor；5, Bluetooth transmission mould
Block；6, eye movement tracing module；7, optical imagery screen；8, calculation processing module；9, bluetooth module；10, signal receiver.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to embodiments, to the present invention
It is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not used to
Limit the present invention.
In the prior art, the operating interactive experience perception of near-eye display device is poor, cannot reduce the subjective consciousness of user
On cognition meet, it is uncoordinated to the control of the muscle of simple eye blink and bring is uncomfortable.Protect upper operability poor in concealment；
In order to solve the above technical problems, being described in detail below with reference to concrete scheme to application principle of the invention.
The eye movement of near-eye display device provided in an embodiment of the present invention tracks exchange method
The optical imagery button screen coordinate position of near-eye display device receives click behavior Bluetooth signal；
Eye movement tracking is carried out using near-eye display device, is mapped to optics after carrying out calculation processing to the eye movement information of acquisition
Button screen coordinate position is imaged；Optical imagery button screen click is carried out again, and the interactive function journey is executed after interaction success
Sequence.
In embodiments of the present invention, the method for the eye movement tracking interaction of the near-eye display device, as shown in Figure 1, specifically
Include:
S101: the computer system of near-eye display device obtains human eye ball in near-eye display device by eye movement tracing module
Optical imagery screen on sight intersection point mapping point；The eye movement tracing module integrated in near-eye display device obtains human eye ball
Image identifies eye image and calculates eye movement vector, obtains the eye movement coordinates of motion.
During wherein eye movement vector obtains, using pupil-corneal reflection spot method or MEMS eyeball tracking technology, by people
The motor behavior digitlization of eye, is converted into the electronic signal of computer system calculating, and calculate by algorithm and obtain people's blinkpunkt
Mapping relations on the optical imagery screen of near-eye display device；According to mapping relations, near-eye display device optics at
Visual feedback as human eye fixation point is presented on display.
S102: it obtains the operational order of hardware external equipment: setting radio magnetic wave communication module in near-eye display device, closely
Eye display equipment receives the click from hardware external equipment by radio magnetic wave communication module and confirms wireless signal instruction, refers to
Order is transferred to near-eye display device by hardware external equipment in the form of radio magnetic wave signal.
S103: it completes to click the button in the operation interface on near-eye display device optical imagery screen, executes interaction
Program.
In embodiments of the present invention, it after hardware external equipment obtains click behavior signal, is carried out by integrated processor
Signal processing, by the bluetooth module of treated signal is sent in a manner of Bluetooth matching near-eye display device.
Electromagnetic wave signal includes Bluetooth signal, wifi signal, infrared signal；The shape of mapping point is arbitrarily replaced.Nearly eye
The computer system for showing equipment is the operating system of near-eye display device, such as window, Android.
As shown in Fig. 2, the eye movement tracking interactive system that the embodiment of the present invention provides near-eye display device includes:
Near-eye display device and hardware external equipment 2；
Near-eye display device is used to interact the selection at interface by eye movement tracing equipment；
Hardware external equipment, and near-eye display device bluetooth connection, for confirming click behavior.
In embodiments of the present invention, hardware external equipment is intended to be worn in user hand, the palm, finger, hand with user
Any shape of body engineering science is identical.
As the preferred embodiment of the present invention, hardware external equipment 2 includes:
Obtain the hardware adaptor key 3 of click behavior signal；
Click behavior signal is received, the processor 4 of signal processing is carried out；
By the Bluetooth transmission module 5 of treated signal is sent in a manner of Bluetooth matching bluetooth module.
As the preferred embodiment of the present invention, near-eye display device is intelligent glasses 1: intelligent glasses 1 include:
Carry out the eye movement tracing module 6 of eye movement tracking；
The optical imagery screen 7 that the information of near-eye display device operation interface or Application Program Interface is presented；
The calculation processing module 8 of calculation processing is carried out to the eye movement tracked information of acquisition；
For receiving the bluetooth module 9 of the Bluetooth signal of hardware external equipment transmission；
It is integrated on bluetooth module, the signal receiver 10 for sending and receiving Bluetooth signal being used for.
After hardware external equipment obtains click behavior signal, signal processing is carried out by integrated processor, after processing
Signal the bluetooth module of near-eye display device is sent in a manner of Bluetooth matching.
In embodiments of the present invention, the present invention is not solely restricted to intelligent glasses interaction field, further includes that other displays are set
For such as intelligent TV set, projector, LED show large-size screen monitors, plate.The present invention is to show the mapping of eye movement coordinate in equipment to the end
(near-eye display device optical display means), deeper one layer is that can also will be mapped on other any type of screens, this hair
Bright is eye movement tracking and external equipment while using realizing better interactive experience.The present invention, which is also suitable, has display to other
The display of imaging function.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real
It is existing.When using entirely or partly realizing in the form of a computer program product, the computer program product include one or
Multiple computer instructions.When loading on computers or executing the computer program instructions, entirely or partly generate according to
Process described in the embodiment of the present invention or function.The computer can be general purpose computer, special purpose computer, computer network
Network or other programmable devices.The computer instruction may be stored in a computer readable storage medium, or from one
Computer readable storage medium is transmitted to another computer readable storage medium, for example, the computer instruction can be from one
A web-site, computer, server or data center pass through wired (such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)
Or wireless (such as infrared, wireless, microwave etc.) mode is carried out to another web-site, computer, server or data center
Transmission).The computer-readable storage medium can be any usable medium or include one that computer can access
The data storage devices such as a or multiple usable mediums integrated server, data center.The usable medium can be magnetic Jie
Matter, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard disk Solid
State Disk (SSD)) etc..
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Made any modifications, equivalent replacements, and improvements etc., should all be included in the protection scope of the present invention within mind and principle.
Claims (11)
1. a kind of method of the eye movement tracking interaction of near-eye display device, which is characterized in that the eye movement of the near-eye display device
Tracking interactive method includes:
Have eye movement tracing module using near-eye display device and carry out eyeball tracking, calculation processing is carried out to the eye movement information of acquisition
After be mapped to head-mounted display optical imagery button screen coordinate position；
The optical imagery button screen coordinate position of near-eye display device receives click commands of the peripheral hardware hardware by Bluetooth transmission；
Optical imagery button screen clicking operation is carried out again, executes interactive program.
2. the method for the eye movement tracking interaction of near-eye display device as described in claim 1, which is characterized in that nearly eye, which is shown, to be set
The method of standby eye movement tracking interaction specifically includes:
Step 1: the computer system of near-eye display device obtains human eye ball in near-eye display device by eye movement tracing module
The mapping point of sight intersection point on optical imagery screen；The eye movement tracing module integrated in near-eye display device obtains human eye ball figure
Picture identifies eye image and calculates eye movement vector, obtains the eye movement coordinates of motion；
During wherein eye movement vector obtains, using pupil-corneal reflection spot method or MEMS eyeball tracking technology, by human eye
Motor behavior digitlization is converted into the electronic signal of computer system calculating, and is calculated by algorithm and obtain people's blinkpunkt close
Mapping relations on the optical imagery screen of eye display equipment；It is aobvious in the optical imagery of near-eye display device according to mapping relations
Show the visual feedback that human eye fixation point is presented on device；
Step 2: it obtains the operational order of hardware external equipment: setting radio magnetic wave communication module, nearly eye in near-eye display device
Show that equipment receives the click from hardware external equipment by radio magnetic wave communication module and confirms wireless signal instruction, instruction
Near-eye display device is transferred to by hardware external equipment in the form of radio magnetic wave signal；
Step 3: completing to click the button in the operation interface on near-eye display device optical imagery screen, executes interaction journey
Sequence.
3. the method for the eye movement tracking interaction of near-eye display device as claimed in claim 2, which is characterized in that set outside hardware
It is standby obtain click behavior signal after, signal processing is carried out by integrated processor, will treated signal with Bluetooth matching side
Formula is sent to the bluetooth module of near-eye display device；
Electromagnetic wave signal includes Bluetooth signal, wifi signal, infrared signal；
The shape of mapping point is arbitrarily replaced.
4. a kind of eye of the near-eye display device of the method for the eye movement tracking interaction for implementing near-eye display device described in claim 1
Dynamic tracking interactive system, which is characterized in that the eye movement of near-eye display device tracks interactive system and includes:
Near-eye display device and hardware external equipment；
Near-eye display device is used to interact the selection at interface by eye movement tracing equipment；
Hardware external equipment, and near-eye display device bluetooth connection, for confirming click behavior.
5. the eye movement of near-eye display device as claimed in claim 4 tracks interactive system, which is characterized in that
The hardware external equipment is intended to be worn in user hand, the life with the wrist, palm, finger, hand body engineering science of user
Reason state matches.
6. the eye movement of near-eye display device as claimed in claim 4 tracks interactive system, which is characterized in that
Near-eye display device is intelligent glasses, and intelligent glasses include:
Carry out the eye movement tracing module of eyeball tracking；
The optical imagery screen that the information of operation interface or Application Program Interface is presented；
The calculation processing module of calculation processing is carried out to the eye movement tracked information of acquisition；
For receiving the bluetooth module of the Bluetooth signal of hardware external equipment transmission；
It is integrated on bluetooth module, what is be used for sends and receivees the signal receiver of Bluetooth signal.
7. the eye movement of near-eye display device as claimed in claim 4 tracks interactive system, which is characterized in that hardware external equipment
Include:
Obtain the hardware adaptor key of click behavior signal；
Click behavior signal is received, the processor of signal processing is carried out；
By treated, signal is in a manner of Bluetooth matching or other wireless radio transmission forms are sent to the Bluetooth transmission of bluetooth module
Module.
8. the eye movement of near-eye display device as claimed in claim 6 tracks interactive system, which is characterized in that the optical imagery
Screen shows equipment for being integrated in head；
Hardware external equipment is that intelligent TV set, projector, the LED with display imaging function show large-size screen monitors, plate.
9. a kind of calculating of the method for the eye movement tracking interaction for realizing near-eye display device described in claims 1 to 3 any one
Machine program.
10. a kind of information of the method for the eye movement tracking interaction for realizing near-eye display device described in claims 1 to 3 any one
Data processing terminal.
11. a kind of computer readable storage medium, including instruction, when run on a computer, so that computer executes such as
The method of the eye movement tracking interaction of near-eye display device described in claim 1-3 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811612264.7A CN109597489A (en) | 2018-12-27 | 2018-12-27 | A kind of method and system of the eye movement tracking interaction of near-eye display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811612264.7A CN109597489A (en) | 2018-12-27 | 2018-12-27 | A kind of method and system of the eye movement tracking interaction of near-eye display device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109597489A true CN109597489A (en) | 2019-04-09 |
Family
ID=65963726
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811612264.7A Pending CN109597489A (en) | 2018-12-27 | 2018-12-27 | A kind of method and system of the eye movement tracking interaction of near-eye display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109597489A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110187855A (en) * | 2019-05-28 | 2019-08-30 | 武汉市天蝎科技有限公司 | The intelligent adjusting method for avoiding hologram block vision of near-eye display device |
| CN110554777A (en) * | 2019-09-24 | 2019-12-10 | 大连理工大学 | Eyeball gaze angle measuring method based on electromagnetic wave tracking |
| CN111061372A (en) * | 2019-12-18 | 2020-04-24 | Oppo广东移动通信有限公司 | Equipment control method and related equipment |
| CN111949131A (en) * | 2020-08-17 | 2020-11-17 | 陈涛 | Eye movement interaction method, system and equipment based on eye movement tracking technology |
| CN112034977A (en) * | 2019-06-04 | 2020-12-04 | 陈涛 | Method for MR intelligent glasses content interaction, information input and recommendation technology application |
| CN113325956A (en) * | 2021-06-29 | 2021-08-31 | 华南理工大学 | Eye movement control system based on neural network and implementation method |
| CN113655622A (en) * | 2021-09-18 | 2021-11-16 | 物芯智能科技有限公司 | Use at AR and VR refraction screen eye movement automatic focusing system |
| CN114779969A (en) * | 2022-06-20 | 2022-07-22 | 艾视雅健康科技(苏州)有限公司 | Device for displaying object position on second display screen near to eye and combination thereof |
| CN114816053A (en) * | 2022-04-11 | 2022-07-29 | 青岛虚拟现实研究院有限公司 | Eye tracking interaction method and device, electronic equipment and readable storage medium |
| WO2023134637A1 (en) * | 2022-01-13 | 2023-07-20 | 北京七鑫易维信息技术有限公司 | Vehicle-mounted eye movement interaction system and method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344816A (en) * | 2008-08-15 | 2009-01-14 | 华南理工大学 | Human-computer interaction method and device based on gaze tracking and gesture recognition |
| CN104866105A (en) * | 2015-06-03 | 2015-08-26 | 深圳市智帽科技开发有限公司 | Eye movement and head movement interactive method for head display equipment |
| CN106125931A (en) * | 2016-06-30 | 2016-11-16 | 刘兴丹 | A kind of method and device of eyeball tracking operation |
| CN106814854A (en) * | 2016-12-29 | 2017-06-09 | 杭州联络互动信息科技股份有限公司 | A kind of method and device for preventing maloperation |
-
2018
- 2018-12-27 CN CN201811612264.7A patent/CN109597489A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344816A (en) * | 2008-08-15 | 2009-01-14 | 华南理工大学 | Human-computer interaction method and device based on gaze tracking and gesture recognition |
| CN104866105A (en) * | 2015-06-03 | 2015-08-26 | 深圳市智帽科技开发有限公司 | Eye movement and head movement interactive method for head display equipment |
| CN106125931A (en) * | 2016-06-30 | 2016-11-16 | 刘兴丹 | A kind of method and device of eyeball tracking operation |
| CN106814854A (en) * | 2016-12-29 | 2017-06-09 | 杭州联络互动信息科技股份有限公司 | A kind of method and device for preventing maloperation |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110187855A (en) * | 2019-05-28 | 2019-08-30 | 武汉市天蝎科技有限公司 | The intelligent adjusting method for avoiding hologram block vision of near-eye display device |
| CN112034977A (en) * | 2019-06-04 | 2020-12-04 | 陈涛 | Method for MR intelligent glasses content interaction, information input and recommendation technology application |
| CN112034977B (en) * | 2019-06-04 | 2022-07-19 | 陈涛 | Method for MR intelligent glasses content interaction, information input and recommendation technology application |
| CN110554777A (en) * | 2019-09-24 | 2019-12-10 | 大连理工大学 | Eyeball gaze angle measuring method based on electromagnetic wave tracking |
| CN111061372A (en) * | 2019-12-18 | 2020-04-24 | Oppo广东移动通信有限公司 | Equipment control method and related equipment |
| CN111949131A (en) * | 2020-08-17 | 2020-11-17 | 陈涛 | Eye movement interaction method, system and equipment based on eye movement tracking technology |
| CN111949131B (en) * | 2020-08-17 | 2023-04-25 | 陈涛 | Eye movement interaction method, system and equipment based on eye movement tracking technology |
| CN113325956A (en) * | 2021-06-29 | 2021-08-31 | 华南理工大学 | Eye movement control system based on neural network and implementation method |
| CN113655622A (en) * | 2021-09-18 | 2021-11-16 | 物芯智能科技有限公司 | Use at AR and VR refraction screen eye movement automatic focusing system |
| WO2023134637A1 (en) * | 2022-01-13 | 2023-07-20 | 北京七鑫易维信息技术有限公司 | Vehicle-mounted eye movement interaction system and method |
| CN114816053A (en) * | 2022-04-11 | 2022-07-29 | 青岛虚拟现实研究院有限公司 | Eye tracking interaction method and device, electronic equipment and readable storage medium |
| CN114779969A (en) * | 2022-06-20 | 2022-07-22 | 艾视雅健康科技(苏州)有限公司 | Device for displaying object position on second display screen near to eye and combination thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109597489A (en) | A kind of method and system of the eye movement tracking interaction of near-eye display device | |
| CN110456907A (en) | Virtual screen control method, device, terminal equipment and storage medium | |
| CN103336575A (en) | Man-machine interaction intelligent glasses system and interaction method | |
| CN102915044B (en) | A kind of robot head eye coordinate motion control method based on bionic principle | |
| CN110689479B (en) | Face makeup method, device, equipment and medium | |
| Karim et al. | Telepointer technology in telemedicine: a review | |
| CN106843498A (en) | Dynamic interface exchange method and device based on virtual reality | |
| CN201638151U (en) | Device for realizing virtual display and virtual interactive operation | |
| CN106846496A (en) | DICOM images based on mixed reality technology check system and operating method | |
| CN111586459A (en) | Method and device for controlling video playing, electronic equipment and storage medium | |
| CN107390874A (en) | A kind of intelligent terminal control method and control device based on human eye | |
| CN105677018A (en) | Screen capture method and apparatus, and electronic device | |
| US9392223B2 (en) | Method for controlling visual light source, terminal, and video conference system | |
| Tian et al. | Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR | |
| Jalaliniya et al. | EyeDroid: an open source mobile gaze tracker on Android for eyewear computers | |
| CN106127171A (en) | A display method, device and terminal for augmented reality content | |
| CN109426342B (en) | Document reading method and device based on augmented reality | |
| KR20120128369A (en) | Matching system, matching method, wearable input device and command signal providing method for incorporating real world into virtual reality for handicapped and elderly | |
| Wang et al. | EXG wearable human-machine interface for natural multimodal interaction in VR environment | |
| CN104699230B (en) | A kind of determination method and apparatus for inputting information | |
| CN113641238A (en) | A control method, device, terminal device, controlled device and storage medium | |
| CN103902202B (en) | A kind of information processing method and electronic equipment | |
| CN105718036A (en) | Information interaction methods and systems of wearable device | |
| CN110221688A (en) | The control method and device of wearable device, mouse | |
| Lin et al. | Study on directional eye movements in non‐frontal face images for eye‐controlled interaction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201127 Address after: Room 007 (U), 1F college students' innovation and entrepreneurship practice base, Liufang campus, Wuhan Engineering University, 430205 Donghu New Technology Development Zone, Wuhan City, Hubei Province Applicant after: Magic scorpion technology (Wuhan) Co.,Ltd. Address before: 430205 Room 003, Innovation and Entrepreneurship Practice Base for College Students in Liufang Campus of Wuhan Engineering University, Wuhan City, Hubei Province Applicant before: WUHAN SCORPIONS TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190409 |
|
| RJ01 | Rejection of invention patent application after publication |