CN114690886B - Light spot determination method, device, equipment and storage medium - Google Patents
Light spot determination method, device, equipment and storage mediumInfo
- Publication number
- CN114690886B CN114690886B CN202011615423.6A CN202011615423A CN114690886B CN 114690886 B CN114690886 B CN 114690886B CN 202011615423 A CN202011615423 A CN 202011615423A CN 114690886 B CN114690886 B CN 114690886B
- Authority
- CN
- China
- Prior art keywords
- light source
- information
- characteristic data
- pupil
- pupil information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Eye Examination Apparatus (AREA)
Abstract
本发明实施例公开了一种光斑确定方法、装置、设备及存储介质。包括：根据各光源分别缓存的历史特征数据确定各光源的数据变化曲线及锚定偏差；所述特征数据包括瞳孔信息及光斑信息；获取当前时刻点亮光源对应的第一瞳孔信息和第一光斑信息；根据所述点亮光源的锚定偏差对所述第一瞳孔信息进行修正，获得目标瞳孔信息；对于未点亮光源，根据当前时刻的时间戳及所述数据变化曲线确定各未点亮光源的目标光斑信息。本发明实施例提供的光斑确定方法，根据点亮光源的锚定偏差对第一瞳孔信息进行修正，根据当前时刻的时间戳及数据变化曲线确定各未点亮光源的目标光斑信息，可以实现闪烁型眼动仪中未点亮光源的光斑的确定，从而提高眼动追踪的准确性。
The embodiment of the present invention discloses a light spot determination method, device, equipment and storage medium. It includes: determining the data change curve and anchor deviation of each light source based on the historical characteristic data cached by each light source; the characteristic data includes pupil information and light spot information; obtaining the first pupil information and first light spot information corresponding to the light source that is lit at the current moment; correcting the first pupil information according to the anchor deviation of the lit light source to obtain the target pupil information; for the unlit light source, determining the target light spot information of each unlit light source according to the timestamp of the current moment and the data change curve. The light spot determination method provided by the embodiment of the present invention corrects the first pupil information according to the anchor deviation of the lit light source, and determines the target light spot information of each unlit light source according to the timestamp of the current moment and the data change curve. It can realize the determination of the light spot of the unlit light source in the flicker-type eye tracker, thereby improving the accuracy of eye tracking.
Description
Technical Field
The embodiment of the invention relates to the technical field of eye movement tracking, in particular to a light spot determining method, a light spot determining device, light spot determining equipment and a storage medium.
Background
Currently, eye tracker is divided into two general categories, one category is non-blinking eye tracker and the other category is blinking eye tracker. For a non-blinking eye tracker, each time the camera captures an image, all deployed infrared light sources are lit, i.e., all infrared light sources are visible at the spots formed by the pupillary cornea. For the scintillation type eye tracker, the deployed infrared light sources are alternately lightened, namely, only a certain infrared light source can be seen at a facula formed by pupillary cornea when the camera acquires images each time. In the gaze point estimation process, if gaze point position information cannot be obtained only by means of one piece of light spot information, it is particularly important for the scintillation type eye tracker to determine the light spot information of the infrared light source which is not lightened currently.
Disclosure of Invention
The embodiment of the invention provides a light spot determining method, a light spot determining device, light spot determining equipment and a storage medium, which are used for determining light spots of a current unlit light source in a flicker type eye tracker, so that the accuracy of eye tracking is improved.
In a first aspect, an embodiment of the present invention provides a light spot determining method, which is used in a scintillation type eye tracker, the scintillation type eye tracker including at least 2 light sources, the at least 2 light sources being alternately lighted to illuminate an eye, including:
Determining a data change curve and an anchoring deviation of each light source according to historical characteristic data cached by each light source respectively, wherein the characteristic data comprises pupil information and light spot information;
acquiring first pupil information and first light spot information corresponding to a lighting light source at the current moment;
Correcting the first pupil information according to the anchoring deviation of the lighting light source to obtain target pupil information;
And for the unlit light sources, determining the target light spot information of each unlit light source according to the time stamp of the current moment and the data change curve.
Further, the historical characteristic data includes real characteristic data and predicted characteristic data, and the determining a data change curve of each light source according to the historical characteristic data cached by each light source respectively includes:
extracting a first set number of real characteristic data nearest to the current moment for each light source;
And performing straight line or curve fitting on the set number of real characteristic data to obtain a data transformation curve of the light source, wherein the transformation curve is used for representing the corresponding relation between the time stamp and the characteristic data.
Further, determining target spot information of each unlit light source according to the timestamp of the current moment and the data change curve, including:
And searching spot information corresponding to the timestamp of the current moment in the data change curve, and determining the spot information as target spot information of the unlit light source.
Further, the real characteristic data comprises real pupil information, and the determining the anchoring deviation of each light source according to the historical characteristic data cached by each light source respectively comprises the following steps:
calculating, for each light source, average pupil information of a second set number of real pupil information;
setting one of the light sources as a standard light source, calculating the deviation between the average pupil information of each light source and the average pupil information of the standard light source, and determining the anchoring deviation of each light source by using the deviation.
Further, correcting the first pupil information according to the anchoring deviation of the lighting light source to obtain target pupil information, including:
if the lighting light source is a standard light source, determining the first pupil information as target pupil information;
And if the lighting light source is a non-standard light source, accumulating the first pupil information and the anchoring deviation of the non-standard light source to obtain target pupil information.
Further, before determining the data change curve and the anchoring deviation of each light source according to the historical characteristic data cached by each light source respectively, the method further comprises:
caching the characteristic data acquired when each light source is lightened;
and performing exception screening on the cached characteristic data, and deleting the exception data.
Further, the method for performing anomaly screening on the cached characteristic data comprises the following steps:
determining as abnormal data characteristic data having a difference between pupil information and pupil information of adjacent characteristic data exceeding a set threshold value, or
And fitting the eyeball motion trail according to the pupil information of the cached characteristic data, and determining the characteristic data which deviates from the motion trail as abnormal data. .
In a second aspect, an embodiment of the present invention further provides a flare determining apparatus, the apparatus being disposed in a scintillation type eye tracker including at least 2 light sources alternately lighted to illuminate eyes, including:
The data change curve and anchoring deviation determining module is used for determining the data change curve and the anchoring deviation of each light source according to the historical characteristic data respectively cached by each light source, wherein the characteristic data comprises pupil information and light spot information;
The first characteristic data acquisition module is used for acquiring first pupil information and first light spot information corresponding to the lighting light source at the current moment;
The target pupil information acquisition module is used for correcting the first pupil information according to the anchoring deviation of the lighting light source to obtain target pupil information;
And the target light spot information determining module is used for determining the target light spot information of each unlit light source according to the time stamp of the current moment and the data change curve for the unlit light source.
In a third aspect, the embodiment of the invention also provides a computer device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the light spot determining method according to the embodiment of the invention.
In a fourth aspect, embodiments of the present invention further provide a computer readable storage medium having stored thereon a computer program which, when executed by a processing device, implements a spot determination method according to embodiments of the present invention.
The embodiment of the invention discloses a light spot determining method, a light spot determining device, light spot determining equipment and a storage medium. The method is used for a scintillation type eye tracker, the scintillation type eye tracker comprises at least 2 light sources, at least 2 light sources are lighted alternately to illuminate eyes, the method comprises the steps of determining a data change curve and an anchoring deviation of each light source according to historical characteristic data cached by each light source respectively, obtaining first pupil information and first light spot information corresponding to the lighted light source at the current moment, correcting the first pupil information according to the anchoring deviation of the lighted light source to obtain target pupil information, and determining target light spot information of each non-lighted light source according to a time stamp and the data change curve at the current moment for the non-lighted light source. According to the spot determination method provided by the embodiment of the invention, the first pupil information is corrected according to the anchoring deviation of the lighted light source, and the target spot information of each unlit light source is determined according to the time stamp and the data change curve at the current moment, so that the determination of the spot of the unlit light source in the flicker type eye tracker can be realized, and the accuracy of eye tracking is improved.
Drawings
FIG. 1 is a flow chart of a spot determination method in accordance with a first embodiment of the present invention;
FIG. 2 is an image of an eye acquired when a light source is on in accordance with a first embodiment of the present invention;
FIG. 3 is an image of an eye acquired when a light source is illuminated in accordance with a first embodiment of the present invention;
FIG. 4 is an image of an eye acquired when a light source is illuminated in accordance with a first embodiment of the present invention;
Fig. 5 is a schematic structural diagram of a spot determining apparatus in a second embodiment of the present invention;
Fig. 6 is a schematic structural diagram of a computer device in a third embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Example 1
Fig. 1 is a flowchart of a spot determining method according to an embodiment of the present invention, where the method may be performed by a spot determining device, and the method may be applied to determining spot information of a currently unlit light source in a scintillation type eye tracker. The method is used in a scintillation type eye tracker that includes at least 2 light sources that are alternately illuminated to illuminate the eye.
The scintillation type eye tracker comprises a multi-dark pupil scintillation type eye tracker and a bright and dark pupil scintillation type eye tracker. For the multi-dark pupil flicker type eye tracker, when a camera takes a picture each time, a specific light source is visible on a light source formed by a pupil cornea, and the light sources are alternately changed, and all the light sources are non-coaxial (coaxial with the camera), so that the generated image is a dark pupil image. For a bright and dark pupil flicker type eye tracker, each time a camera takes a picture, a specific light source is visible at a light source formed by the pupil cornea, and alternately, and one light source is an on-axis (on-axis with the camera) light source, so that the generated image is a bright and dark pupil image. For the scintillation type eye movement instrument, only one light source is lightened when the camera adopts the image every time, namely pupil information and spot information corresponding to the lightened light source can be directly obtained according to the currently acquired image. In the eye tracking, it is necessary to perform eye tracking based on at least two pieces of spot information, and therefore, it is necessary to determine spot information of other unlit light sources.
As shown in fig. 1, the method for determining a light spot in this embodiment specifically includes the following steps:
Step 110, determining a data change curve and an anchoring deviation of each light source according to the historical characteristic data respectively cached by each light source.
The characteristic data comprises pupil information and light spot information. The pupil information may be position information of the pupil center, and the spot information may be position information of the spot center. The data change curve is used for representing the corresponding relation between the time stamp and the characteristic data. The historical characteristic data can be acquired by acquiring images of the light sources when illuminating the eye. The method for extracting pupil information and facula information through the eye image can be any existing method, and will not be described here again.
The historical feature data may include real feature data and predicted feature data, wherein the real feature data may be understood as feature data directly acquired from an image formed by illuminating an eye with a light source, and the predicted feature data may be understood as data deduced from the real feature data. In this embodiment, the data change curve includes a pupil change curve and a spot change curve, and the anchoring deviation is an anchoring deviation of pupil information. The present embodiment determines a data change curve and an anchor deviation of each light source based on the real characteristic data.
Specifically, the method for determining the data change curve of each light source according to the historical characteristic data cached by each light source respectively can be that for each light source, a first set number of real characteristic data closest to the current moment are extracted, and straight lines or curve fitting is carried out on the set number of real characteristic data to obtain the data change curve of the light source.
In this embodiment, the straight line or curve fitting of the set number of real feature data may be understood as fitting of the pupil uniform motion or variable motion. If the pupil moves at a uniform speed, a straight line is fitted, and if the pupil moves at a variable speed, a curve is fitted.
Wherein the first set number may be any value between 3-6 frames. In the embodiment, the real pupil information of 3-6 frames closest to the current moment is extracted to perform straight line or curve fitting to obtain a pupil change curve, and the real light spot information of 3-6 frames closest to the current moment is extracted to perform straight line or curve fitting to obtain a light spot change curve. The human eyes comprise left eyes and right eyes, the characteristic data of the left eyes and the right eyes are required to be fitted respectively to obtain a pupil change curve of the left eyes and a pupil change curve of the right eyes, and a light spot change curve of the left eyes and a light spot change curve of the right eyes.
Specifically, the method for determining the anchoring deviation of each light source according to the historical characteristic data cached by each light source respectively can be that for each light source, average pupil information of real pupil information of set quantity is calculated, one light source is set as a standard light source, the deviation between the average pupil information of each light source and the average pupil information of the standard light source is calculated, and the anchoring deviation of each light source is determined according to the deviation.
Wherein the human eye comprises a left eye and a right eye, and thus, the anchoring deviation comprises a left eye anchoring deviation and a right eye anchoring deviation. The standard light source may be an arbitrarily selected one.
Step 120, obtaining first pupil information and first light spot information corresponding to the lighting light source at the current moment.
Specifically, the light source is lightened at the current moment to irradiate the eye, the camera collects an image of the eye irradiated by the light source, analysis processing is carried out on the collected image of the eye, and first pupil information and first light spot information corresponding to the light source are obtained. The first pupil information may be center position information of the pupil, and the first spot information may be center position information of the spot.
And 130, correcting the first pupil information according to the anchoring deviation of the lighting light source to obtain target pupil information.
Specifically, the anchoring deviation and the first pupil information are accumulated to obtain target pupil information.
In this embodiment, the first pupil information is corrected according to the anchoring deviation of the lighting light source, and the target pupil information is obtained by determining the first pupil information as the target pupil information if the lighting light source is a standard light source, and accumulating the first pupil information with the anchoring deviation of the non-standard light source if the lighting light source is a non-standard light source.
Wherein when the lighting light source is a standard light source, the anchoring deviation is 0, and therefore, the first pupil information can be directly determined as the target pupil information.
And 140, for the unlit light sources, determining target light spot information of each unlit light source according to the time stamp and the data change curve of the current moment.
In this embodiment, the corresponding relationship between the standard timestamp of the light spot change curve and the light spot information in the data change curve. Therefore, the method for determining the target spot information of each unlit light source according to the time stamp of the current time and the data change curve can be that the spot information corresponding to the time stamp of the current time is searched in the data change curve and is determined as the target spot information of the unlit light source.
Specifically, for each unlit light source, a light spot change curve corresponding to each unlit light source is obtained, light spot information corresponding to a time stamp at the current moment is searched in the light spot change curve, and the light spot information of each unlit light source is determined. For the illumination of the light source, the first spot information may be directly determined as target spot information.
Optionally, before determining the data change curve and the anchoring deviation of each light source according to the historical characteristic data cached by each light source respectively, the method further comprises the steps of caching the characteristic data obtained when each light source is lightened, carrying out abnormal screening on the cached characteristic data, and deleting the abnormal data.
The feature data acquired when each light source is lit can be understood as true feature data. Specifically, the method for carrying out abnormal screening on the cached characteristic data can be that characteristic data, of which the difference value between pupil information and pupil information of adjacent characteristic data exceeds a set threshold value, is determined to be abnormal data, or that the eyeball motion trail is fitted according to the pupil information of the cached characteristic data, and the characteristic data of the offset motion trail is determined to be abnormal data.
In this embodiment, the feature data may be further subjected to anomaly screening according to the spot information. The characteristic data that the difference value of the spot information and the spot information of the adjacent characteristic data exceeds a set threshold value is determined to be abnormal data, or the characteristic data of the offset motion track is determined to be abnormal data according to the cached characteristic data spot information fitting eyeball motion track. For the eye tracking device in this embodiment, the relative position between the pupil and the light spot should satisfy a certain preset condition, and if the deviation from the preset condition is too large, it can be confirmed that the data itself is abnormal. In addition, the motion of human eyes generally accords with objective rules, so that the abnormal data can be screened out according to the motion mechanism of human eyes.
Optionally, after deleting the abnormal data, the prediction feature data associated with the abnormal data also needs to be deleted.
According to the technical scheme, a data change curve and an anchoring deviation of each light source are determined according to historical characteristic data cached by each light source respectively, first pupil information and first light spot information corresponding to the light source which is lightened at the current moment are obtained, the first pupil information is corrected according to the anchoring deviation of the light source which is lightened to obtain target pupil information, and for the light source which is not lightened, the target light spot information of each light source which is not lightened is determined according to a time stamp and the data change curve at the current moment. According to the spot determination method provided by the embodiment of the invention, the first pupil information is corrected according to the anchoring deviation of the lighted light source, and the target spot information of each unlit light source is determined according to the time stamp and the data change curve at the current moment, so that the determination of the spot of the unlit light source in the flicker type eye tracker can be realized, and the accuracy of eye tracking is improved.
The spot determination method of the present embodiment is explained in detail below with a specific example:
Taking the left eye data of a group of real bright and dark pupils as an example, assuming that the eye tracker is provided with three light sources, three buffer buffers are required to be set, as shown in tables 1-3:
TABLE 1
TABLE 2
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 2 | ||||||
| 2 |
TABLE 3 Table 3
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 3 | ||||||
| 3 |
With the light sources alternately turned on, feature data of each light source can be collected, fig. 2 is an eye image when the lamp 3 is turned on in this embodiment, and table 4 is feature data corresponding to the lamp 3:
TABLE 4 Table 4
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 3 | 734.074 | 758.917 | 745.027 | 766.997 | 0.9607 | 1 |
| 3 |
Next, the light 2 is turned on, fig. 3 is an eye image when the light 2 is turned on, and table 5 is feature data corresponding to the light 2:
TABLE 5
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 2 | 735.239 | 758.829 | 729.846 | 767.168 | 0.9444 | 2 |
| 2 |
Next, the light 1 is turned on, fig. 4 is an eye image when the light 1 is turned on, and table 6 is feature data corresponding to the light 1:
TABLE 6
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 1 | 736.331 | 759.742 | 737.657 | 766.884 | 0.9375 | 3 |
| 1 |
The three lamps are alternately lighted in the flicker sequence 3- >2- >1- >3- >2- > 1.
Table 7 is two frames of characteristic data buffered by lamp 3:
TABLE 7
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 3 | 734.074 | 758.917 | 745.027 | 766.997 | 0.9607 | 1 |
| 3 | 734.329 | 758.497 | 745.225 | 766.509 | 0.9574 | 4 |
Table 8 is two frames of characteristic data buffered by lamp 2:
TABLE 8
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 2 | 735.239 | 758.829 | 729.846 | 767.168 | 0.9444 | 2 |
| 2 | 735.214 | 758.769 | 729.655 | 766.643 | 0.9595 | 5 |
The lamp 2 is set as a standard light source. The mean value of the pupil position of the lamp 2 is (735.227,758.799), and the mean value of the pupil position of the lamp 3 is (734.202,758.707). Pupil deviation delta_p23= (-1.025, -0.092) is calculated.
By combining the relation of the frame ordinal numbers, the time consumption of the lamp 3 data 1 to the lamp 3 data 2 is about 3 frame periods, the time consumption of the lamp 3 data 2 to the current moment is about 1 frame period, and the lamp 3 data table 9 at the current moment can be obtained through uniform inference:
TABLE 9
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 3 | 734.074 | 758.917 | 745.027 | 766.997 | 0.9607 | 1 |
| 3 | 734.329 | 758.497 | 745.225 | 766.509 | 0.9574 | 4 |
| 3 | 734.414 | 758.357 | 745.291 | 766.346 | 0.9591 | 5 |
The fused characteristic data output at the time of frame number 5 is pupil information (735.214,758.769), spot information including lamp 1 (temporary defect), lamp 2 (729.655,766.643), and lamp 3 (745.291,766.346), in which the spot information of lamp 3 is the result of data estimation, by combining the pupil anchoring deviation and the estimated data.
At the next moment, the lamp 1 is lighted when the wheel is equal to 1, and two frames of characteristic data of the lamp 1 are obtained:
Table 10
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 1 | 736.331 | 759.742 | 737.657 | 766.884 | 0.9375 | 3 |
| 1 | 736.002 | 759.708 | 737.223 | 766.788 | 0.9639 | 6 |
The anchoring deviation of the lamp 1 data and the lamp 2 data is calculated, wherein the average value of the pupil positions of the lamp 1 is (736.167,759.725), and the average value of the pupil positions of the lamp 2 is (735.227,758.799). It can be seen that there is a significant deviation in both lamp 1 and lamp 2 in the x y direction. Pupil deviation delta_p21= (0.94,0.926) is calculated.
At this time, characteristic data of the lamps 2 and 3 can be estimated at a constant speed, wherein table 11 is cache data corresponding to the lamp 3, and table 12 is cache data corresponding to the lamp 2:
TABLE 11
Table 12
| Lamp signal | Pupil x | Pupil y | Glint x | Glint y | Confidence level | Frame number |
| 2 | 735.239 | 758.829 | 729.846 | 767.168 | 0.9444 | 2 |
| 2 | 735.214 | 758.769 | 729.655 | 766.643 | 0.9595 | 5 |
| 2 | 735.206 | 758.749 | 729.591 | 766.468 | 0.9520 | 6 |
The target pupil information is calculated (735.062,758.782) from the real pupil information (736.002,759.708) and delta_p21 (0.94,0.926) of the current lamp 1.
To sum up, the final feature data at the time of frame number 6 is:
Pupil information (735.062,758.782), flare information, lamp 1 (737.223,766.788), lamp 2 (729.591,766.468), lamp 3 (745.357,766.183).
The pupil information is the target pupil information obtained by calculating the pupil information and the pupil deviation of the lamp 1. The spot data of both lamp 2 and lamp 3 are inferred.
Example two
Fig. 5 is a schematic structural diagram of a light spot determining apparatus according to a second embodiment of the present invention. The device is arranged in a scintillation type eye-tracker which comprises at least 2 light sources, and the at least 2 light sources are alternately lightened to irradiate eyes. As shown, the apparatus includes:
The data change curve and anchoring deviation determining module 210 is configured to determine a data change curve and an anchoring deviation of each light source according to historical characteristic data respectively cached by each light source, where the characteristic data includes pupil information and light spot information;
a first feature data obtaining module 220, configured to obtain first pupil information and first spot information corresponding to the lighting light source at the current moment;
the target pupil information obtaining module 230 is configured to correct the first pupil information according to the anchoring deviation of the lighting light source to obtain target pupil information;
The target spot information determining module 240 is configured to determine, for the unlit light sources, target spot information of each unlit light source according to the timestamp of the current time and the data change curve.
Optionally, the historical feature data includes real feature data and predicted feature data, and the data change curve and anchor bias determination module 210 is further configured to:
extracting a first set number of real characteristic data nearest to the current moment for each light source;
And performing straight line or curve fitting on the set number of real characteristic data to obtain a data transformation curve of the light source, wherein the transformation curve is used for representing the corresponding relation between the time stamp and the characteristic data.
Optionally, the target spot information determining module 240 is further configured to:
And searching spot information corresponding to the timestamp of the current moment in the data change curve, and determining the spot information as target spot information of the unlit light source.
Optionally, the real characteristic data includes real pupil information, and the data change curve and anchor deviation determining module 210 is further configured to:
calculating, for each light source, average pupil information of a second set number of real pupil information;
setting one of the light sources as a standard light source, calculating the deviation between the average pupil information of each light source and the average pupil information of the standard light source, and determining the anchoring deviation of each light source by using the deviation.
Optionally, the target pupil information obtaining module 230 is further configured to:
if the lighting light source is a standard light source, determining the first pupil information as target pupil information;
And if the lighting light source is a non-standard light source, accumulating the first pupil information and the anchoring deviation of the non-standard light source to obtain target pupil information.
Optionally, the device further comprises a characteristic data caching module for:
caching the characteristic data acquired when each light source is lightened;
and performing exception screening on the cached characteristic data, and deleting the exception data.
Optionally, the feature data caching module is further configured to:
determining as abnormal data characteristic data having a difference between pupil information and pupil information of adjacent characteristic data exceeding a set threshold value, or
And fitting the eyeball motion trail according to the pupil information of the cached characteristic data, and determining the characteristic data which deviates from the motion trail as abnormal data.
The device can execute the method provided by all the embodiments of the invention, and has the corresponding functional modules and beneficial effects of executing the method. Technical details not described in detail in this embodiment can be found in the methods provided in all the foregoing embodiments of the invention.
Example III
Fig. 6 is a schematic structural diagram of a computer device according to a third embodiment of the present invention. FIG. 6 illustrates a block diagram of a computer device 312 suitable for use in implementing embodiments of the present invention. The computer device 312 shown in fig. 6 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention. Device 312 is a computing device of typical spot determination functionality.
As shown in FIG. 6, the computer device 312 is in the form of a general purpose computing device. Components of computer device 312 may include, but are not limited to, one or more processors 316, a storage device 328, and a bus 318 connecting the different system components (including storage device 328 and processor 316).
Bus 318 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include industry standard architecture (Industry Standard Architecture, ISA) bus, micro channel architecture (Micro Channel Architecture, MCA) bus, enhanced ISA bus, video electronics standards association (Video Electronics Standards Association, VESA) local bus, and peripheral component interconnect (PERIPHERAL COMPONENT INTERCONNECT, PCI) bus.
Computer device 312 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer device 312 and includes both volatile and nonvolatile media, removable and non-removable media.
Storage 328 may include computer system-readable media in the form of volatile memory, such as random access memory (Random Access Memory, RAM) 330 and/or cache memory 332. The computer device 312 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 334 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 6, commonly referred to as a "hard disk drive"). Although not shown in fig. 6, a disk drive for reading from and writing to a removable nonvolatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from and writing to a removable nonvolatile optical disk (e.g., a Compact Disc-Read Only Memory (CD-ROM), digital versatile Disc (Digital Video Disc-Read Only Memory, DVD-ROM), or other optical media) may be provided. In such cases, each drive may be coupled to bus 318 through one or more data medium interfaces. Storage 328 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
Programs 336 having a set (at least one) of program modules 326 may be stored, for example, in storage 328, such program modules 326 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 326 generally perform the functions and/or methods in the described embodiments of the invention.
The computer device 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, camera, display 324, etc.), one or more devices that enable a user to interact with the computer device 312, and/or any devices (e.g., network card, modem, etc.) that enable the computer device 312 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 322. Moreover, the computer device 312 may also communicate with one or more networks such as a local area network (Local Area Network, LAN), a wide area network Wide Area Network, a WAN, and/or a public network such as the internet via the network adapter 320. As shown, network adapter 320 communicates with other modules of computer device 312 via bus 318. It should be appreciated that although not shown, other hardware and/or software modules may be utilized in connection with computer device 312, including, but not limited to, microcode, device drivers, redundant processing units, external disk drive arrays, disk array (Redundant Arrays of INDEPENDENT DISKS, RAID) systems, tape drives, and data backup storage systems, among others.
Processor 316 executes programs stored in storage 328 to perform various functional applications and data processing, such as implementing the spot determination methods provided by the above-described embodiments of the present invention.
Example IV
The embodiment of the invention provides a computer readable storage medium, and a computer program is stored on the computer readable storage medium, and when the program is executed by a processing device, the method for determining the light spot in the embodiment of the invention is realized. The computer readable medium of the present invention described above may be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of a computer-readable storage medium may include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to electrical wiring, fiber optic cable, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be included in the electronic device or may exist alone without being incorporated into the electronic device.
The computer readable medium carries one or more programs, when the one or more programs are executed by the electronic equipment, the electronic equipment determines a data change curve and an anchoring deviation of each light source according to historical characteristic data cached by each light source respectively, wherein the characteristic data comprises pupil information and light spot information, acquires first pupil information and first light spot information corresponding to the light source which is lightened at the current moment, corrects the first pupil information according to the anchoring deviation of the light source which is lightened to acquire target pupil information, and determines target light spot information of each light source which is not lightened according to a timestamp of the current moment and the data change curve.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic that may be used include Field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems-on-a-chip (SOCs), complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (9)
1. A method for spot determination, the method being used in a scintillation-type eye-tracker comprising at least 2 light sources that are alternately illuminated to illuminate an eye, the method comprising:
Determining a data change curve and an anchoring deviation of each light source according to historical characteristic data cached by each light source respectively, wherein the characteristic data comprises pupil information and light spot information;
acquiring first pupil information and first light spot information corresponding to a lighting light source at the current moment;
Correcting the first pupil information according to the anchoring deviation of the lighting light source to obtain target pupil information;
For the unlit light sources, determining target light spot information of each unlit light source according to the time stamp of the current moment and the data change curve;
the historical characteristic data comprises real characteristic data and predicted characteristic data, and the real characteristic data comprises real pupil information;
determining an anchoring deviation of each light source according to the historical characteristic data respectively cached by each light source, including:
calculating, for each light source, average pupil information of a second set number of real pupil information;
setting one light source as a standard light source, calculating the deviation between the average pupil information of each light source and the average pupil information of the standard light source, and determining the deviation as the anchoring deviation of each light source.
2. The method of claim 1, wherein determining the data change curve for each light source based on the historical characteristic data cached for each light source separately comprises:
extracting a first set number of real characteristic data nearest to the current moment for each light source;
And performing straight line or curve fitting on the first set number of real characteristic data to obtain a data transformation curve of the light source, wherein the transformation curve is used for representing the corresponding relation between the time stamp and the characteristic data.
3. The method of claim 2, wherein determining target spot information for each unlit light source based on the timestamp of the current time and the data profile comprises:
And searching spot information corresponding to the timestamp of the current moment in the data change curve, and determining the spot information as target spot information of the unlit light source.
4. The method of claim 1, wherein correcting the first pupil information based on the anchoring deviation of the illumination source to obtain target pupil information comprises:
if the lighting light source is a standard light source, determining the first pupil information as target pupil information;
And if the lighting light source is a non-standard light source, accumulating the first pupil information and the anchoring deviation of the non-standard light source to obtain target pupil information.
5. The method of claim 1, further comprising, prior to determining the data profile and the anchor bias for each light source based on the historical characteristic data cached for each light source separately:
caching the characteristic data acquired when each light source is lightened;
and performing exception screening on the cached characteristic data, and deleting the exception data.
6. The method of claim 5, wherein the abnormality screening of the cached characteristic data comprises:
determining as abnormal data characteristic data having a difference between pupil information and pupil information of adjacent characteristic data exceeding a set threshold value, or
And fitting the eyeball motion trail according to the pupil information of the cached characteristic data, and determining the characteristic data which deviates from the motion trail as abnormal data.
7. The device is arranged in a scintillation type eye movement instrument, the scintillation type eye movement instrument comprises at least 2 light sources, the at least 2 light sources are lighted alternately to irradiate eyes, and the device comprises:
The data change curve and anchoring deviation determining module is used for determining the data change curve and the anchoring deviation of each light source according to the historical characteristic data respectively cached by each light source, wherein the characteristic data comprises pupil information and light spot information;
The first characteristic data acquisition module is used for acquiring first pupil information and first light spot information corresponding to the lighting light source at the current moment;
The target pupil information acquisition module is used for correcting the first pupil information according to the anchoring deviation of the lighting light source to obtain target pupil information;
The target light spot information determining module is used for determining target light spot information of each unlit light source according to the time stamp of the current moment and the data change curve for the unlit light source;
the historical characteristic data comprises real characteristic data and predicted characteristic data, and the real characteristic data comprises real pupil information;
the data change curve and the anchoring deviation determining module are specifically configured to:
calculating, for each light source, average pupil information of a second set number of real pupil information;
setting one light source as a standard light source, calculating the deviation between the average pupil information of each light source and the average pupil information of the standard light source, and determining the deviation as the anchoring deviation of each light source.
8. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the spot determination method according to any one of claims 1-6 when executing the program.
9. A computer readable storage medium having stored thereon a computer program, characterized in that the program, when executed by processing means, implements a spot determination method according to any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011615423.6A CN114690886B (en) | 2020-12-30 | 2020-12-30 | Light spot determination method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011615423.6A CN114690886B (en) | 2020-12-30 | 2020-12-30 | Light spot determination method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114690886A CN114690886A (en) | 2022-07-01 |
| CN114690886B true CN114690886B (en) | 2025-08-29 |
Family
ID=82131899
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011615423.6A Active CN114690886B (en) | 2020-12-30 | 2020-12-30 | Light spot determination method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114690886B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101872237A (en) * | 2009-04-23 | 2010-10-27 | 由田新技股份有限公司 | Pupil Tracking Method and System and Correction Method and Module for Pupil Tracking |
| CN106371566A (en) * | 2015-07-24 | 2017-02-01 | 由田新技股份有限公司 | Correction module, method and computer readable recording medium for eye tracking |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6322216B1 (en) * | 1999-10-07 | 2001-11-27 | Visx, Inc | Two camera off-axis eye tracker for laser eye surgery |
| TW201533609A (en) * | 2014-02-20 | 2015-09-01 | Utechzone Co Ltd | Method for pupil localization based on a corresponding position of auxiliary light, system and computer product thereof |
| WO2016075532A1 (en) * | 2014-11-14 | 2016-05-19 | The Eye Tribe Aps | Dynamic eye tracking calibration |
| CN107358217B (en) * | 2017-07-21 | 2020-01-07 | 北京七鑫易维信息技术有限公司 | Sight estimation method and device |
| CN108498064B (en) * | 2018-03-19 | 2021-06-18 | 中国人民解放军空军特色医学中心 | Digital bright spot flicker detection system |
| CN112099615B (en) * | 2019-06-17 | 2024-02-09 | 北京七鑫易维科技有限公司 | Gaze information determination method, gaze information determination device, eyeball tracking device, and storage medium |
| CN110427101A (en) * | 2019-07-08 | 2019-11-08 | 北京七鑫易维信息技术有限公司 | Calibration method, device, equipment and the storage medium of eyeball tracking |
| CN110908511B (en) * | 2019-11-08 | 2022-03-15 | Oppo广东移动通信有限公司 | Method for triggering recalibration and related device |
| CN211207351U (en) * | 2019-12-24 | 2020-08-07 | 厦门金龙联合汽车工业有限公司 | A vehicle eye tracking device |
| CN111700586B (en) * | 2020-07-01 | 2023-09-29 | 业成科技（成都）有限公司 | Eye tracking device and electronic device using the same |
-
2020
- 2020-12-30 CN CN202011615423.6A patent/CN114690886B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101872237A (en) * | 2009-04-23 | 2010-10-27 | 由田新技股份有限公司 | Pupil Tracking Method and System and Correction Method and Module for Pupil Tracking |
| CN106371566A (en) * | 2015-07-24 | 2017-02-01 | 由田新技股份有限公司 | Correction module, method and computer readable recording medium for eye tracking |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114690886A (en) | 2022-07-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114067173B (en) | Object detection method for small sample low-quality images based on multi-resolution ensemble self-training | |
| US20200175673A1 (en) | Method and device for detecting defect of meal box, server, and storage medium | |
| CN113724190B (en) | Image processing method and device based on medical image processing model | |
| WO2022006784A1 (en) | Human skeleton detection method, apparatus, and system, and device, and storage medium | |
| CN106019265A (en) | Multi-target positioning method and system | |
| CN112261477A (en) | Video processing method and device, training method and storage medium | |
| US10336256B1 (en) | Reduction of LED headlight flickering in electronic mirror applications | |
| CN113534945A (en) | Method, device and equipment for determining eyeball tracking calibration coefficient and storage medium | |
| CN114690886B (en) | Light spot determination method, device, equipment and storage medium | |
| CN111385659B (en) | Video recommendation method, device, equipment and storage medium | |
| CN104182958A (en) | Target detection method and device | |
| Yang et al. | Multi-scale feature fusion for pavement crack detection based on Transformer | |
| Watson | Quantification of surgical technique using an inertial measurement unit | |
| CN104253994A (en) | Night monitored video real-time enhancement method based on sparse code fusion | |
| CN106558089B (en) | Image depth method for drafting and device | |
| US11881048B2 (en) | Monitoring device, learning apparatus, method and storage medium | |
| US20240161715A1 (en) | A system and a method for adjusting a level of luminance of a display | |
| CN114187438A (en) | An image detection method and system | |
| Khalid et al. | VISTA: vision improvement via split and reconstruct deep neural network for fundus image quality assessment | |
| CN118379245A (en) | Model training method, PCB defect detection method, product and knowledge box | |
| CN114168651B (en) | System for counting xerophthalmia patient distribution group by utilizing cloud computing | |
| Hu et al. | A lightweight framework for robust object detection in adverse weather based on dual-teacher feature alignment | |
| CN114516270A (en) | Vehicle control method, device, electronic equipment and computer readable medium | |
| US11375209B2 (en) | Method and apparatus for processing video frame | |
| CN103747224B (en) | Based on the control method of the ambient light adaptive rate of change of audio & video equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |