CN110812145B - Visual function adjusting method and device and virtual reality head-mounted display equipment - Google Patents
Visual function adjusting method and device and virtual reality head-mounted display equipment Download PDFInfo
- Publication number
- CN110812145B CN110812145B CN201911139300.7A CN201911139300A CN110812145B CN 110812145 B CN110812145 B CN 110812145B CN 201911139300 A CN201911139300 A CN 201911139300A CN 110812145 B CN110812145 B CN 110812145B
- Authority
- CN
- China
- Prior art keywords
- eyes
- preset
- imaging
- eye
- local
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000004382 visual function Effects 0.000 title claims abstract description 50
- 238000000034 method Methods 0.000 title claims abstract description 31
- 210000001508 eye Anatomy 0.000 claims abstract description 175
- 210000001525 retina Anatomy 0.000 claims abstract description 84
- 238000003384 imaging method Methods 0.000 claims abstract description 83
- 230000006378 damage Effects 0.000 claims abstract description 57
- 208000027418 Wounds and injury Diseases 0.000 claims abstract description 21
- 208000014674 injury Diseases 0.000 claims abstract description 21
- 230000007246 mechanism Effects 0.000 claims description 56
- 230000000007 visual effect Effects 0.000 claims description 42
- 230000002207 retinal effect Effects 0.000 claims description 8
- 208000010412 Glaucoma Diseases 0.000 claims description 7
- 238000003780 insertion Methods 0.000 claims description 6
- 230000037431 insertion Effects 0.000 claims description 6
- 208000002780 macular degeneration Diseases 0.000 claims description 6
- 206010057430 Retinal injury Diseases 0.000 claims description 2
- 230000004438 eyesight Effects 0.000 description 10
- 239000011521 glass Substances 0.000 description 9
- 210000004556 brain Anatomy 0.000 description 8
- 230000008447 perception Effects 0.000 description 8
- 230000000638 stimulation Effects 0.000 description 8
- 210000003710 cerebral cortex Anatomy 0.000 description 7
- 230000003902 lesion Effects 0.000 description 6
- 210000005036 nerve Anatomy 0.000 description 5
- 230000002093 peripheral effect Effects 0.000 description 5
- 208000035719 Maculopathy Diseases 0.000 description 4
- 230000001276 controlling effect Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000001537 neural effect Effects 0.000 description 4
- 210000000857 visual cortex Anatomy 0.000 description 4
- 208000007014 Retinitis pigmentosa Diseases 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 210000003205 muscle Anatomy 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 206010025421 Macule Diseases 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 201000010099 disease Diseases 0.000 description 2
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 2
- 239000003814 drug Substances 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 210000002569 neuron Anatomy 0.000 description 2
- 210000000977 primary visual cortex Anatomy 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- 206010012689 Diabetic retinopathy Diseases 0.000 description 1
- 241000282412 Homo Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000004308 accommodation Effects 0.000 description 1
- 230000004480 accommodation of the lens Effects 0.000 description 1
- 230000001154 acute effect Effects 0.000 description 1
- 206010064930 age-related macular degeneration Diseases 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 210000004027 cell Anatomy 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000012528 membrane Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004256 retinal image Effects 0.000 description 1
- 210000001116 retinal neuron Anatomy 0.000 description 1
- 230000004936 stimulating effect Effects 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 210000000225 synapse Anatomy 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 210000003813 thumb Anatomy 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H5/00—Exercisers for the eyes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
Landscapes
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Pain & Pain Management (AREA)
- Optics & Photonics (AREA)
- Ophthalmology & Optometry (AREA)
- Epidemiology (AREA)
- General Physics & Mathematics (AREA)
- Physical Education & Sports Medicine (AREA)
- Rehabilitation Therapy (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The embodiment of the invention provides a visual function adjusting method and device and virtual reality head-mounted display equipment, wherein the method comprises the following steps: respectively imaging two eyes of a user to respectively display corresponding preset images in corresponding local areas of the two eyes, and enabling the corresponding preset images to have a preset time interval alpha between the time of respectively imaging the two eyes; wherein the local area corresponds to a local injury of one retina of one of the eyes, and the preset map is imaged in the corresponding one of the local injuries of the retina at a time earlier than the preset map is imaged in the other eye by a time interval alpha.
Description
Technical Field
The invention relates to the technical field of electronics, in particular to a visual function adjusting method and device and virtual reality head-mounted display equipment.
Background
Vision is certainly of paramount importance, and the retina is the vital part of imaging. Each visual cortex binocular cell receives input from the retina of the left and right eye. The visual images formed by the retinal membranes are encoded by neurons of different visual centers and neural images are formed in the visual cortex. The latter is heavily relied upon by human visual perception. The optic cortex nerve loop has strong plasticity, and the proper visual stimulation on the retina can ensure that the nerve loop of the corresponding cortex area gradually restores the visual function. The retina is divided into the fovea (foveal) and peripheral regions; the fovea is the most visually acute area of the retina (color discrimination, resolution). In humans, for example, a yellow area at about 3.5mm of the temporal side of the optic disc is called the macula, and the depression in the center of the macula is the fovea. It is currently found that many ophthalmic diseases such as glaucoma, AMD, RP (retinitis pigmentosa) and DM (diabetic retinopathy) cause local lesions of the retina and local damage to the retina due to various reasons, so that the visual field area of the cerebral cortex corresponding to the local damage to the retina in the visual field range cannot form a normal neural image.
Throughout this application, the area of localized damage to the retina is defined as: damage to at least a portion of the retina, rather than the entire retina; by "at least a portion" is meant that one or more regions of the retina have been locally damaged.
Because the local damage lesion of the retina can cause that the corresponding cerebral cortex part in the visual field range can not form a normal nerve image, the prior art does not have a method and a device for adjusting the visual function aiming at the problems.
Disclosure of Invention
In view of the foregoing problems, an embodiment of the present invention provides a visual function adjustment method and apparatus, and a virtual reality head-mounted display device, which can improve and recover abnormal visual function of a corresponding area of a cerebral cortex generated when a retina is locally damaged. Thereby achieving the purpose of stimulating retina to regulate brain nerve loop and adjust visual function.
In one aspect, an embodiment of the present invention provides a method for adjusting a visual function, including:
respectively imaging two eyes of a user to respectively display corresponding preset images in corresponding local areas of the two eyes, and enabling the corresponding preset images to have a preset time interval alpha between the time of respectively imaging the two eyes;
wherein the local area corresponds to a local injury of one retina of one of the eyes, and the preset map is imaged in the corresponding one of the local injuries of the retina at a time earlier than the preset map is imaged in the other eye by a time interval alpha.
In some embodiments, the method further comprises: respectively imaging two eyes by using preset video streams, wherein corresponding frames of the video streams of the two eyes comprise the same preset images corresponding to the corresponding local area positions; and the corresponding frames of the video streams of the two eyes have a preset time interval alpha, so that the time of imaging the corresponding frame of the video streams of the two eyes at the local damage of the retina is earlier than the time of imaging the corresponding frame of the video streams of the other eye by the time interval alpha.
In some embodiments, the method comprises:
determining the working frequency f of the preset device for playing the preset image, and determining the time interval alpha according to the working frequency;
α＝n×1/f；
wherein n is more than or equal to 0.
In some embodiments, the method comprises:
the frames of each video stream have inserted frames, and the corresponding inserted frames of the video streams of the two eyes have the same time interval alpha.
In some embodiments, the interpolated frame is a blank image frame; or
The insertion frame is a frame of a specific graph, and the specific graph is different from the preset graph.
In some embodiments, the method further comprises:
and outputting a prompt when the preset image is played, receiving feedback of a user aiming at the prompt, and judging the concentration degree of the user according to the feedback.
In some embodiments, the method comprises:
wherein the prompt is a figure with identifiability or the prompt is a sound with identifiability.
In some embodiments, the local region is determined by:
setting P points in a non-central area of the visual field of one eye, and setting a display brightness interval of each point;
displaying a center mark aiming at a center area of a visual field of one eye of a user, and enabling the user to watch the center mark; then continuously adjusting the brightness at any one point in the P points to determine the brightness value of the user at the visible and invisible critical points;
and determining the brightness difference of the two corresponding eyes at the same corresponding point, and determining a local area corresponding to the local damage of the retina according to the brightness difference of the corresponding points of the two eyes.
In a second aspect, a visual function adjusting apparatus is provided, including: a first imaging mechanism for imaging for a left eye, a second imaging mechanism for imaging for a right eye, a control mechanism for controlling the first imaging mechanism and the second imaging mechanism;
the control mechanism is connected with the first imaging mechanism and the second imaging mechanism to image on two side eyes of a user respectively so as to display corresponding preset images on corresponding local areas of the two side eyes respectively, and the corresponding preset images have preset time intervals alpha between the time of imaging the two side eyes respectively;
wherein the local area corresponds to a local injury of one retina of one of the eyes, and the preset map is imaged in the corresponding one of the local injuries of the retina at a time earlier than the preset map is imaged in the other eye by a time interval alpha.
In a third aspect, a virtual reality head-mounted display device is provided, including: a left-eye imaging mechanism for imaging for a left eye, a right-eye imaging mechanism for imaging for a right eye, and a control mechanism for controlling the left-eye imaging mechanism and the right-eye imaging mechanism;
the control mechanism is connected with the left eye imaging mechanism and the right eye imaging mechanism to image on two side eyes of a user respectively so as to display corresponding preset images in corresponding local areas of the two side eyes respectively, and the corresponding preset images have preset time intervals alpha between the time of imaging of the two side eyes respectively;
wherein the local area corresponds to a local injury of one retina of one of the eyes, and the preset map is imaged in the corresponding one of the local injuries of the retina at a time earlier than the preset map is imaged in the other eye by a time interval alpha.
The technical scheme of the invention has the following beneficial effects: according to the technical scheme, the visual function adjusting method and device and the virtual reality head-mounted display equipment are provided, the visual function of local lesions of one eye can be adjusted in a local imaging mode, and the non-invasive visual function can be adjusted in a visual stimulation mode to gradually improve or recover the visual function.
As previously mentioned, the protocols in the examples of the present invention do not treat damage to the retina itself. Each point on the retina binocular region has a corresponding representative region on the visual cortex; and is substituted forThe surface area becomes gradually larger as the eccentricity becomes smaller. The representative area of the fovea is maximized (0-0.5 degree fovea area corresponds to 142mm of primary visual cortex)2Area of! ) (ii) a Each point on the fovea is now a large representative area of the visual cortex. However, the utilization rate of this area is not very high under normal conditions, so the embodiment of the invention can adjust the visual function. In the embodiment of the invention, the optic cortex nerve loop corresponding to the damaged area of the retina can be regulated and controlled, so that synapses of neurons of the loop are reshaped, a small amount of input provided by residual retinal neurons can be efficiently utilized, and finally, the visual function reconstruction is realized to a certain extent.
Drawings
Fig. 1 is a schematic diagram of binocular parallax;
FIG. 2 is a schematic illustration of a binocular fixation;
FIG. 3 is a schematic diagram showing a predetermined area of the retina in accordance with the determination of the local damage of the retina;
FIG. 4 is a flowchart illustrating a visual function adjustment method according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a visual function adjusting apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a virtual reality head-mounted display device in an embodiment of the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
The retina is locally diseased for a variety of reasons, resulting in the inability to image a location within the field of view that corresponds to a local injury to the retina. In the prior art, the problem of visual function damage caused by the local damage of the retina is that the local damage of the retina is eliminated by means of medicine and surgical treatment, and is treated or eliminated in such a way. The inventors have discovered in their research that non-invasive adjustments to visual function can be made by way of visual stimuli to gradually improve or restore visual function.
The principle of the invention is explained first: the binocular stereopsis of a person is formed by: the eyes watch on an object at the same time, the sight lines of the eyes intersect at a Point called a Fixation Point (collimation Point), and the light points reflected from the Fixation Point back to the retinas of the left eye and the right eye are called Corresponding points (collimation points). Because the distance between two pupils of a person exists (the average value is 50-75mm), the Relative positions (Relative positions) of the left eye and the right eye are different for the same scene, so that the two eyes see external objects with different visual angles, and Binocular Disparity (Binocular Disparity) is generated, namely, the left eye and the right eye see images with different visual angles. The visual information from the two eyes is transferred into the primary visual cortex through the lateral geniculate nucleus, and then is processed and integrated by each level of visual centers to enable people to obtain a neural image with three-dimensional depth perception. Specifically, once the eyes focus on the fixation point, not only the point is seen clearly, but also the distance, depth, projection and depression, contrast, chromatic aberration, contour, and the like between the point and the surrounding objects can be distinguished, and the perceived visual image is a stereoscopic visual image, and the binocular stereoscopic function of the human is called stereoscopic vision (stereovision) for short.
Stereoscopic vision gives a person a sense of depth in the perception of the surrounding visual world. Specifically, both eyes have a Perception capability (Depth Perception) of the Depth of the captured ambient image, and this capability is based on the fact that both left and right eyes can extract Depth information (Depth Cue) in the scene. The human eye can have these abilities, and mainly depends on the following 4 basic functions of the two eyes:
1. binocular parallax (Binocular Disparity)
Binocular parallax describes a visual angle difference which appears at a horizontal position where an image of an object falls on retinas of two eyes when the left eye and the right eye watch the same object due to a distance between the two eyes, and is called binocular parallax for short. The brain extracts depth information in 2-dimensional retinal images using binocular parallax in stereoscopic vision.
As shown in fig. 1, where 1 denotes a monocular vision field and 2 denotes a visual axis, if both eyes focus on (Horopter) fixation points a and B on the monocular vision field, the visual axis angles of the images projected on the left and right retinas are equally large, L and R, respectively, that is, the images on the retinas of both eyes overlap, there is no parallax. However, when the two-eye focal points are focused on the fixation point A on the binocular single vision interface and the other is focused on the fixation point C outside the binocular single vision interface, the included angles of the visual axes of the images projected on the left and right retinas are not the same, and are L 'and R', respectively. At this time, the images on the left and right retinas are different from each other in position and cannot be superimposed, resulting in parallax.
As shown in fig. 2, when one binocular fixation Point is on the monocular vision field (a) and the other fixation Point is at the Near Point (Near Point), cross-Disparity (cross Disparity) is formed. Creating a stereoscopic perception of an object being close to the viewer. Conversely, when one binocular fixation Point is on the monocular vision (C) and the other fixation Point is at the Far Point (Far Point), non-cross parallax (unoccluded Disparity) is formed. Creating a stereoscopic perception of an object leaving the observer.
2. Adaptation adjustment (adaptation)
Accommodation of both eyes mainly refers to Active Focusing action (Active Focusing) of the eyes. The method is mainly suitable for close-range focusing. The focal length of the eye is finely adjusted by changing the intraocular Lens (Lens) curvature. When the lens is fixed on an object, the change of the curvature of the lens in the eye leads the two eyes to focus and see different objects and different parts of the same scene clearly. The accommodation of the lens is achieved by the contraction and relaxation of its attached -like muscle.
3. Binocular Convergence (Convergence)
Depth perception is determined by the direction of binocular fixation. Your eyes form an angle when you look at an object. The angle is larger as the object is closer to you and smaller as the object is further away from you. The lines of sight of the two eyes tend to be parallel as the object is further away from you.
4. Mobile parallax (Motion Disparity)
Parallel parallax produces a sense of depth through relative motion between the observer and the observed object. Close one eye you can only see the outside world through one eye. When you are looking at an object with one eye, the arm of the display is extended with the thumb to block a portion of the scene in your field of view, but when you turn your head you can see that portion of the scene that is blocked. Specifically, when you obtain depth perception information using parallel parallax, the brain determines the relative distance between you and two objects by calculation.
In short, in the process of merging the images of both eyes, the same convergence Mechanism (Converging Mechanism) of the two eyes in the observed scene is relied on first, i.e. the fixation points of the two eyes are at the same point. This mechanism allows the left and right human eyes (with a fixed distance between the left and right pupils) and the fixation point on the scene to geometrically form a definite triangle. The distance of the observed scene from the human eyes can be judged through the triangle. In order to realize the mechanism, the muscles of the eyes of the human need to pull the eyeballs to rotate, the movement of the muscles is fed back to the brain of the human again, and the parallax images obtained by the two eyes are fused in the brain of the human.
Both glaucoma and maculopathy produce localized damage to the retina, with maculopathy producing localized damage to the retina at the fovea and glaucoma producing localized damage to the retina at the peripheral region of the fovea. Thus, in the early stage of the disease, a patient with maculopathy cannot image a local central area in the visual range, and glaucoma cannot image a local peripheral area in the peripheral area other than the central area in the visual range. Of course, these are only examples, and there are many possible causes of local damage to the retina, such as glaucoma and maculopathy, and there may be various causes of retinitis pigmentosa, and the embodiments of the present invention are not limited thereto.
Aiming at the characteristic, the embodiment of the invention provides a visual function adjusting method and device and virtual reality head-mounted display equipment, which are used for performing visual stimulation on a retina of visual imaging by adopting a physical means based on the visual imaging principle so as to adjust the visual function of a cortex layer, so that the influence of local damage of the retina on the visual imaging is gradually improved or even eliminated. The visual function adjusting method and device and the virtual reality head-mounted display device provided by the embodiment of the invention stimulate the retina in a local stimulation mode.
Specifically, the visual function adjusting method shown in fig. 4 includes:
imaging the two eyes of a user respectively to display corresponding preset images in corresponding local areas of the two side eyes respectively, and enabling the corresponding preset images to have a preset time interval alpha between the time of imaging the two side eyes respectively;
wherein the local area corresponds to a local injury of one retina of one of the eyes, and the preset image is imaged in the corresponding one of the local injuries of the retina at a time earlier than the preset image is imaged in the other eye by a time interval alpha.
The corresponding preset images are identical images when the adjustment of the visual function is performed through the plane image, that is, the two eyes display the same preset images at the interval time interval α. When the visual function is adjusted through the stereo image, the corresponding preset images are two images containing parallax. This is because in the imaging mechanism of the human cerebral cortex, if the parallax problem is considered, the images displayed when imaging the two eyes need to include a certain parallax to realize the stereoscopic imaging. This principle can be referred to the existing production principle for movies in virtual reality head-mounted display devices; that is, in order to allow a user to form a stereoscopic image through the virtual reality head-mounted display apparatus, it is necessary to perform certain processing on images displayed on both eyes so that the user can generate a stereoscopic image when viewing the images; namely, the two eyes respectively display corresponding preset images containing parallax.
For example, an image of an existing virtual reality head-mounted display device simultaneously and respectively displays corresponding preset images for two eyes. In the embodiment of the invention, the corresponding preset images are required to be respectively displayed on the two eyes at the interval time interval alpha.
Specifically, when one eye generates a local damage of the retina, corresponding preset images are displayed on both eyes at the position corresponding to the local damage of the retina; and the corresponding preset map is imaged on the retina of both eyes with a priori timing.
Wherein, the sequential imaging means that the retina position of the area corresponding to the local damage of the retina on one eye with the local damage of the retina is imaged first, and the retina position corresponding to the local damage of the retina of the other eye and the area of the first eye is imaged later (the position of the other eye corresponding to the local damage of the retina of the first eye has no lesion or has a smaller degree of lesion); and the display between the two has an interval alpha.
This stimulates the retina of the visual image such that the preset image is imaged first in the eye with the retinal local lesion and then subsequently in the other eye. Due to the visual imaging mechanism of human eyes, the human brain does not feel uncomfortable because the human brain feels that the human brain displays successively only by setting the time interval alpha well, and simultaneously, the mode can well stimulate the cerebral cortex through the retina by adopting a local stimulation mode. After a period of stimulation, the retina of the visual imaging can correspondingly repair the cortical areas which can not normally form neural images in the visual field range of the cerebral cortex corresponding to the local damaged area of the retina, thereby gradually improving the visual function and even restoring the visual function.
Throughout the description of embodiments of the present invention, the respective local regions of both eyes refer to the same positions of both eyes. For example, if a partial area of one eye has a retinal partial injury, when the method of the embodiment of the invention is used for visual function adjustment, the same preset image is displayed on the same partial areas of two eyes, which correspond to the retinal partial injury of one eye.
In a further embodiment of the present invention, based on the scheme proposed in the foregoing method for adjusting the visual function by using a video stream, one or more consecutive frames of a predetermined map are added to a predetermined position in the video stream: such as blank frames or frames having a predetermined identification pattern. The addition of frames with a predetermined map may provide a buffer for retinal imaging or may be used as an interpolation to increase the number of frames in the video stream.
In all embodiments of the present invention, since the normal video stream is typically 24 frames or 25 frames per second or other predetermined number of frames, if a virtual reality head-mounted display device (e.g., 3D glasses) is applied to play video, the current mainstream 3D glasses are 90-120 frames per second. Interpolation between the frames of the video stream at this time can change the video stream of 24 or 25 frames per year to a video stream of 90-120 frames per second.
In any embodiment of the present invention, the time interval α is 8.33 milliseconds. The arrangement is that the method can be realized by using 3D glasses, and the 3D glasses have natural advantages that the visual field range of each pair of glasses of a person can be limited in a specific area, so that peripheral light can be prevented from influencing the visual function adjusting process; meanwhile, the working principle of the 3D glasses is that the two eyes are respectively displayed, so that visual stimulation can be well and independently applied to the left eye channel and the right eye channel to realize any scheme of the embodiment of the invention. For example, with existing 3D glasses with a frequency of 120Hz, the minimum time interval shown is 1/120 seconds, i.e. 8.33 milliseconds. Of course, the time interval α can be adjusted according to the operating frequency of the device. Of course, it is not limited that the time interval α is perfectly corresponding to the operating frequency of the device, and a slight difference may also implement the solution of the embodiment of the present invention.
Of course, other configurations of the device may be used to image the eyes separately; the above-described embodiments using virtual reality head mounted display devices (e.g., 3D glasses) are merely illustrative.
Of course, the aforementioned time interval α of 8.33 ms is only an example and is not a limitation to the scope of the present invention. The 3D glasses with 120Hz operation frequency are only an example and are not intended to limit the scope of the present invention. It will be understood by those skilled in the art that the apparatus for implementing the embodiment of the present invention may be any apparatus capable of displaying preset drawings, and the embodiment of the present invention is not limited thereto.
In any embodiment of the invention, the method further comprises the following steps:
and prompting when the corresponding preset graph or the corresponding preset graph sequence is played, and determining whether corresponding feedback of a user for the prompt is received.
This mechanism may be referred to as a focus detection mechanism to determine that the user's attention is focused on viewing the preset map. This is to prevent the user from being distracted during long-term use. Once the user is not focused, the preset image played cannot generate the preset visual function adjusting effect.
The prompt can be an icon with a direction prompt displayed in a preset graph, and receives feedback made by a user for the icon with the direction prompt so as to determine that the user makes correct feedback.
For example: regularly displaying a convex figure, wherein the protrusions of the figure can be oriented in different directions; the user makes a predetermined action (e.g., scribe a predetermined direction on the touch pad, press a corresponding key on a keyboard having four directional keys, … …) according to the orientation of the protrusion in the figure. In one embodiment, the protrusions of the "embossed" pattern may be oriented to the left or right and may be changed in sequence; meanwhile, the user can correspondingly press the left button or the right button of the mouse.
The prompt may also be a warning tone that is played periodically so that the user can give feedback when he hears the warning tone.
For example: the prompt tone is played regularly, so that the user can press the preset key after hearing the prompt tone.
In the above scheme, it can be determined whether the user is still focusing on watching the preset picture being played according to the prompt, so as to prevent the user from concentrating on the ineffective playing caused by the inattention. Of course, whether the aforementioned manner of using the prompt tone, the prompt icon or other manners is only to determine whether the user is focused on viewing the preset map being played; these are only examples and are not intended to limit the scope of the present invention.
Since the eye distances of different patients differ, it is necessary to specifically determine the correspondence between the position of the local damage of the retina and the position of the displayed preset map for each user. In any embodiment of the present invention, the correspondence between the position of the local damage of the retina and the position where the preset map is displayed can be obtained by various methods, and the following example is given as an example in the embodiment of the present invention:
in this example, the following steps are performed for each eye:
setting P points in a non-central area of the visual field of one eye, wherein the display brightness interval of each point is not lightened to the maximum brightness value;
displaying a center mark aiming at a center area of a visual field of one eye of a user, and enabling the user to watch the center mark; then, any one of the P points is lighted by taking the initial brightness (such as the central value of a display brightness interval) as the display brightness so as to determine whether the user sees that the point is lighted; if so, reducing the display brightness by a first preset step length; if not, increasing the display brightness by a second preset step length; when the same point can be seen under the current display brightness and cannot be seen after the display brightness is adjusted, the current first preset step length or the second preset step length is reduced, and the detection is carried out again;
the contrast difference of the point can be determined by continuously and repeatedly adjusting the display brightness; and the exit condition may be that the test reaches a predetermined number of times or the adjustment step size becomes the minimum adjustment step size.
Wherein the minimum adjustment step size may be predetermined, or determined depending on adjustable parameters of the device, or any other feasible manner.
After the above steps are performed on the P points of each eye, the respective contrast difference of the P points corresponding to the two eyes can be determined, and one point with the largest contrast difference among the P points is used as a point for visual function adjustment.
For example, the center identification and P points shown in fig. 3 may be used, P76; and the display brightness interval of each point is not lighted to the maximum brightness value, 0 is used for marking the non-lighting, 1 is used for marking the maximum brightness value, and the brightness values in all the embodiments of the application are relative values based on the display brightness interval. The following steps are performed for each eye:
step 1, only the central fixation point is displayed, and a user watches the red cross of the central fixation point;
step 2, one of 76 white points randomly appears for 500 milliseconds, the baseline brightness value in the first appearance is 50 percent of the highest brightness value, namely 0.5, the patient reports that the light spot is detected by clicking any key of the mouse, and if the key is not pressed within 500 milliseconds, the light spot is not detected; the brightness is decreased by one step for the next occurrence of a detected spot and increased by one step for the next occurrence of an undetected spot. The initial step size for each spot is 0.1, when the same spot becomes undetected from detection, the step size of this spot is halved; when the test on each light spot exceeds 15 times or the step length is changed into 1, ending the test, wherein the contrast value of each light spot is the contrast threshold value of the changed point;
and 3, after the contrast threshold detection of the respective 76 visual field points of the left eye and the right eye is finished, selecting a point with the maximum contrast threshold difference value at the same position of the left eye and the right eye, and recording the coordinates of the point as a visual stimulation point.
In the above manner, the correspondence between the position of the retinal damage of the user and the position at which the preset map is displayed can be determined to determine the position at which the preset map is displayed.
Of course, the above-described method of determining a localized damage to the retina is merely exemplary, and is a relatively accurate and repeatable implementation. It will be appreciated by those skilled in the art that other means of determining may also be employed. For example: displaying the local images at different positions in the visual field range of a single eye of the user, and judging whether the user sees the local images, thereby determining the position of the local damage of the retina; i.e. exhaustive. For another example: the location of the localized damage to the retina can be determined from the retinal map. There are many ways to determine the local damage of the retina in current clinical medicine, and thus the local area of the preset map can be correspondingly determined and displayed; the location of the local area displaying the preset map can be determined in many ways.
As shown in fig. 5, an embodiment of the present invention further provides a visual function adjusting apparatus, including: a first imaging mechanism for imaging for a left eye, a second imaging mechanism for imaging for a right eye, a control mechanism for controlling the first imaging mechanism and the second imaging mechanism;
the control mechanism is connected with the first imaging mechanism and the second imaging mechanism to image on two side eyes of a user respectively so as to display corresponding preset images on corresponding local areas of the two side eyes respectively, and the corresponding preset images have preset time intervals alpha between the time of imaging the two side eyes respectively;
wherein the local area corresponds to a local injury of one retina of one of the eyes, and the preset map is imaged in the corresponding one of the local injuries of the retina at a time earlier than the preset map is imaged in the other eye by a time interval alpha.
As shown in fig. 6, an embodiment of the present invention further provides a virtual reality head-mounted display device, including: a left-eye imaging mechanism for imaging for a left eye, a right-eye imaging mechanism for imaging for a right eye, and a control mechanism for controlling the left-eye imaging mechanism and the right-eye imaging mechanism;
the control mechanism is connected with the left eye imaging mechanism and the right eye imaging mechanism to image on two side eyes of a user respectively so as to display corresponding preset images in corresponding local areas of the two side eyes respectively, and the corresponding preset images have preset time intervals alpha between the time of imaging of the two side eyes respectively;
wherein the local area corresponds to a local injury of one retina of one of the eyes, and the preset map is imaged in the corresponding one of the local injuries of the retina at a time earlier than the preset map is imaged in the other eye by a time interval alpha.
Those skilled in the art can understand that the visual function adjusting device shown in fig. 5 and the virtual reality head-mounted display device shown in fig. 6 in the embodiment of the present invention may be used in the visual function adjusting method in any one of the foregoing embodiments, and therefore the principle, function, and execution steps of the visual function adjusting device and the virtual reality head-mounted display device in the embodiment of the present invention all correspond to the visual function adjusting method in any one of the foregoing embodiments, and are not described in detail herein.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (18)
1. A visual function adjusting device is characterized in that the visual function adjusting device is applied to a retina part to generate a retina part damage; the method comprises the following steps: a first imaging mechanism for imaging for a left eye, a second imaging mechanism for imaging for a right eye, a control mechanism for controlling the first imaging mechanism and the second imaging mechanism;
the control mechanism is connected with the first imaging mechanism and the second imaging mechanism to image on two side eyes of a user respectively so as to display corresponding preset images on corresponding local areas of the two side eyes respectively, and the corresponding preset images have preset time intervals alpha between the time of imaging the two side eyes respectively;
wherein the local area corresponds to a local injury of one retina of one of the eyes, and the preset map is imaged in the corresponding one of the local injuries of the retina at a time earlier than the preset map is imaged in the other eye by a time interval alpha.
2. A visual function adjusting apparatus according to claim 1, wherein said imaging is performed on both eyes of the user to display the corresponding preset images on the corresponding partial areas of both eyes, respectively, comprising:
respectively imaging the two eyes by using the video streams, wherein corresponding frames of the video streams of the two eyes comprise the same preset graph corresponding to the corresponding local area position; and the corresponding frames of the video streams of the two eyes have a preset time interval alpha, so that the time of imaging the corresponding frame of the video streams of the two eyes at the local damage of the retina is earlier than the time of imaging the corresponding frame of the video streams of the other eye by the time interval alpha.
3. A visual function adjustment device according to claim 1, wherein said time interval α is determined by:
determining the working frequency f of equipment for playing a preset image, and determining a time interval alpha according to the working frequency;
α＝n×1/f；
wherein n is more than or equal to 1.
4. A visual function adjustment device according to claim 2, wherein each video stream has an insertion frame therein, and the video streams of the two eyes have the same time interval α therebetween.
5. A visual function adjustment device according to claim 4, wherein said insertion frame is a blank image frame; or the insertion frame is a frame of a specific graph, and the specific graph is different from the preset graph.
6. A visual function adjustment device according to claim 1, characterized in that said device is further adapted to perform the following operations:
and outputting a prompt when the preset image is played, receiving feedback of a user aiming at the prompt, and judging the concentration degree of the user according to the feedback.
7. A visual function adjustment device according to claim 6, wherein said prompt is a figure with recognizability or said prompt is a sound with recognizability.
8. A visual function adjustment device according to any one of claims 1-7, wherein said local area is determined by:
setting P points in a non-central area of the visual field of one eye, and setting a display brightness interval of each point;
displaying a center mark aiming at a center area of a visual field of one eye of a user, and enabling the user to watch the center mark; then continuously adjusting the brightness at any one point in the P points to determine the brightness value of the user at the visible and invisible critical points;
and determining the brightness difference of the two corresponding eyes at the same corresponding point, and determining a local area corresponding to the local damage of the retina according to the brightness difference of the corresponding points of the two eyes.
9. A visual function adjustment device according to any one of claims 1-7, wherein said locally produced retinal damage comprises but is not limited to: glaucoma or macular degeneration.
10. A virtual reality head-mounted display device is characterized in that the virtual reality head-mounted display device is applied to a retina to locally generate retina local damage; the method comprises the following steps: a left-eye imaging mechanism for imaging for a left eye, a right-eye imaging mechanism for imaging for a right eye, and a control mechanism for controlling the left-eye imaging mechanism and the right-eye imaging mechanism;
the control mechanism is connected with the left eye imaging mechanism and the right eye imaging mechanism to image on two side eyes of a user respectively so as to display corresponding preset images in corresponding local areas of the two side eyes respectively, and the corresponding preset images have preset time intervals alpha between the time of imaging of the two side eyes respectively;
wherein the local area corresponds to a local injury of one retina of one of the eyes, and the preset map is imaged in the corresponding one of the local injuries of the retina at a time earlier than the preset map is imaged in the other eye by a time interval alpha.
11. The virtual reality head-mounted display device of claim 10, wherein the imaging is performed on both eyes of the user to display corresponding preset maps on corresponding local regions of both eyes, respectively, and comprises: respectively imaging the two eyes by using the video streams, wherein corresponding frames of the video streams of the two eyes comprise the same preset graph corresponding to the corresponding local area position; and the corresponding frames of the video streams of the two eyes have a preset time interval alpha, so that the time of imaging the corresponding frame of the video streams of the two eyes at the local damage of the retina is earlier than the time of imaging the corresponding frame of the video streams of the other eye by the time interval alpha.
12. The virtual reality head-mounted display device of claim 10, wherein the time interval α is determined by:
determining the working frequency f of equipment for playing a preset image, and determining a time interval alpha according to the working frequency;
α＝n×1/f；
wherein n is more than or equal to 1.
13. The virtual reality head-mounted display apparatus of claim 11, wherein each video stream has an interpolated frame in the frames, and the video streams of the two eyes have the same time interval a between the corresponding interpolated frames.
14. The virtual reality head mounted display device of claim 13, wherein the insertion frame is a blank image frame; or the insertion frame is a frame of a specific graph, and the specific graph is different from the preset graph.
15. The virtual reality head mounted display device of claim 10, wherein the virtual reality head mounted display device is further configured to:
and outputting a prompt when the preset image is played, receiving feedback of a user aiming at the prompt, and judging the concentration degree of the user according to the feedback.
16. The virtual reality head-mounted display device of claim 15, wherein the prompt is a recognizable figure or the prompt is a recognizable sound.
17. The virtual reality head mounted display device of any one of claims 10-16, wherein the local region is determined by:
setting P points in a non-central area of the visual field of one eye, and setting a display brightness interval of each point;
displaying a center mark aiming at a center area of a visual field of one eye of a user, and enabling the user to watch the center mark; then continuously adjusting the brightness at any one point in the P points to determine the brightness value of the user at the visible and invisible critical points;
and determining the brightness difference of the two corresponding eyes at the same corresponding point, and determining a local area corresponding to the local damage of the retina according to the brightness difference of the corresponding points of the two eyes.
18. The virtual reality head-mounted display device of any one of claims 10-16, wherein the retinal local generation retinal local damage includes, but is not limited to: glaucoma or macular degeneration.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911139300.7A CN110812145B (en) | 2019-11-20 | 2019-11-20 | Visual function adjusting method and device and virtual reality head-mounted display equipment |
| EP20891162.8A EP4062888A4 (en) | 2019-11-20 | 2020-11-02 | METHOD AND DEVICE FOR ADJUSTING VISUAL FUNCTIONS |
| PCT/CN2020/125906 WO2021098498A1 (en) | 2019-11-20 | 2020-11-02 | Visual function adjustment method and apparatus |
| US17/749,069 US20220276495A1 (en) | 2019-11-20 | 2022-05-19 | Visual function adjustment method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911139300.7A CN110812145B (en) | 2019-11-20 | 2019-11-20 | Visual function adjusting method and device and virtual reality head-mounted display equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110812145A CN110812145A (en) | 2020-02-21 |
| CN110812145B true CN110812145B (en) | 2022-02-22 |
Family
ID=69557154
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911139300.7A Active CN110812145B (en) | 2019-11-20 | 2019-11-20 | Visual function adjusting method and device and virtual reality head-mounted display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110812145B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021098498A1 (en) * | 2019-11-20 | 2021-05-27 | 精准视光(北京)医疗技术有限公司 | Visual function adjustment method and apparatus |
| KR102549616B1 (en) * | 2021-09-03 | 2023-06-29 | 재단법인 아산사회복지재단 | Apparatus and method for providing eye movement and visual perception training based on virtual reality |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1210454A (en) * | 1996-12-02 | 1999-03-10 | 新达泰克工程技术服务股份有限公司 | Process and system for determining topography of eye reaction signals |
| CN1617698A (en) * | 2002-02-08 | 2005-05-18 | 诺瓦维森公司 | Improved process and device for training human vision |
| CN203539645U (en) * | 2013-05-09 | 2014-04-16 | 北京大学 | System for treating visual dysfunction by adopting ocular dominance regulation |
| JP2017042301A (en) * | 2015-08-25 | 2017-03-02 | 株式会社クリュートメディカルシステムズ | Eye examination device |
| CN109069294A (en) * | 2016-05-06 | 2018-12-21 | 奥哈伊视网膜技术有限责任公司 | The system and method for neuroprotection therapy for glaucoma |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2000012042A1 (en) * | 1998-08-27 | 2000-03-09 | Novavision Ag | Process and device for the training of human vision |
| GB0513603D0 (en) * | 2005-06-30 | 2005-08-10 | Univ Aberdeen | Vision exercising apparatus |
| WO2014010664A1 (en) * | 2012-07-13 | 2014-01-16 | 興和株式会社 | Diopsimeter |
| CN103239347B (en) * | 2013-05-09 | 2015-05-13 | 北京大学 | System for treating visual dysfunction by adopting ocular dominance regulation |
| CN106037626B (en) * | 2016-07-12 | 2017-11-03 | 吴越 | A kind of wear-type perimetry instrument |
| CN109744994B (en) * | 2019-03-12 | 2024-05-31 | 西安奇点融合信息科技有限公司 | Visual field inspection device based on multi-screen display |
| CN110464298B (en) * | 2019-07-25 | 2021-11-02 | 深圳大学 | An EEG signal processing device and method |
-
2019
- 2019-11-20 CN CN201911139300.7A patent/CN110812145B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1210454A (en) * | 1996-12-02 | 1999-03-10 | 新达泰克工程技术服务股份有限公司 | Process and system for determining topography of eye reaction signals |
| CN1617698A (en) * | 2002-02-08 | 2005-05-18 | 诺瓦维森公司 | Improved process and device for training human vision |
| CN203539645U (en) * | 2013-05-09 | 2014-04-16 | 北京大学 | System for treating visual dysfunction by adopting ocular dominance regulation |
| JP2017042301A (en) * | 2015-08-25 | 2017-03-02 | 株式会社クリュートメディカルシステムズ | Eye examination device |
| CN109069294A (en) * | 2016-05-06 | 2018-12-21 | 奥哈伊视网膜技术有限责任公司 | The system and method for neuroprotection therapy for glaucoma |
Non-Patent Citations (2)
| Title |
|---|
| Morphological, biochemical, and histopathological postmortem ocular indices following subchronic exposure to cadmium and/or lead in a rabbit model;Abd-Elhakim;《ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH》;20180331;第25卷(第7期);6619-6632 * |
| 局部应用医用生物蛋白胶释放NGF治疗大鼠视神经不完全损伤;林宁;《中国临床神经外科杂志》;20101031;第15卷(第10期);603-606 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110812145A (en) | 2020-02-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12016629B2 (en) | Screening apparatus and method | |
| Stidwill et al. | Normal binocular vision: Theory, investigation and practical aspects | |
| US20170296421A1 (en) | Head-mounted apparatus and methods for treatment and enhancement of visual function | |
| US8668334B2 (en) | Vision measurement and training system and method of operation thereof | |
| JPWO2018055618A5 (en) | ||
| Yang et al. | Effects of vergence and accommodative responses on viewer's comfort in viewing 3D stimuli | |
| JP2020509790A5 (en) | ||
| US9952434B2 (en) | Device for assisting visually impaired patients | |
| US8531507B2 (en) | Enhancement of visual perception IV | |
| Hoffman et al. | Focus information is used to interpret binocular images | |
| CN112807200B (en) | Strabismus training equipment | |
| CN110812145B (en) | Visual function adjusting method and device and virtual reality head-mounted display equipment | |
| CN110850596B (en) | Two-side eye vision function adjusting device and virtual reality head-mounted display equipment | |
| CN110882139B (en) | Visual function adjusting method and device by using graph sequence | |
| US20220276495A1 (en) | Visual function adjustment method and apparatus | |
| CN110812146B (en) | Multi-region visual function adjusting method and device and virtual reality head-mounted display equipment | |
| TW202305452A (en) | System and method for enhancing visual acuity | |
| CN114028181A (en) | Visual training method and system combining accommodation training and convergence training | |
| CN105739090B (en) | A kind of calculation method of the stereoscopic viewing depth of field | |
| CN115645238A (en) | Multidimensional visual field stimulation system and method based on light field and light splitting scene | |
| RU2283071C2 (en) | Method for restoring binocular vision | |
| CN114052642A (en) | Naked eye 3D spine endomicroscopy system | |
| CN114051388A (en) | Method for inducing controlled changes in accommodation in a subject's eye | |
| Diamond et al. | –Sensory Status in Strabismus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A method and device for adjusting visual function, virtual reality head mounted display device Granted publication date: 20220222 Pledgee: Bank of Hangzhou Limited by Share Ltd. Beijing Zhongguancun branch Pledgor: Precision optical (Beijing) Medical Technology Co.,Ltd. Registration number: Y2024110000287 |