JP2022136342A - Artificial eye device built into the eyeball - Google Patents

Abstract

The present invention provides an artificial eye device that enables a visually impaired person to acquire color vision. A built-in eyeball component (100) includes a micro LED curved screen embedded between the lens of the eye and the retina, a microfocus lens and a hollow eyeball body, and the eyeball lens is placed at the center of the hollow eyeball body. A hollow channel is provided for passing light rays to reach the retina, the micro LED curved screen and the micro focus lens are spaced in the hollow channel of the hollow eyeball body, and the micro LED curved screen is located in the crystalline lens of the eye. and the micro-focus lens is provided on the side close to the retina, the micro-LED curved screen and the micro-focus lens can be controllably rotated, folded and unfolded, respectively, and the micro-LED curved surface The screen and microfocus lens are each changed according to their position relative to the hollow channel. [Selection drawing] Fig. 1

Description

The present invention belongs to the technical field of artificial vision, and specifically relates to an artificial eye device built into an eyeball.

According to World Health Organization data, there are 39 million visually impaired people worldwide. The visual impairments of these visually impaired people are partly congenital and partly acquired. Visual impairment and even vision loss have a serious impact on the quality of life of patients, and currently many artificial vision devices have been developed, which can be mainly classified into two types. One type is visual replacement devices, which convey visual information to the patient in other ways, such as tactile or auditory sensations, and other types, such as retinal prostheses, that attempt to restore visual function. Technology.

The primary method of operation of current vision restoration technology is by directly stimulating the optic nerve via an electrode array or photovoltaic array device implanted in the retina, bypassing the process of converting light into electrical signals through the retina. , the ability of the wearer to generate vision. However, the sensing and integration of color vision is primarily completed by the response of cone and rod cells to light in the retina, and thus conventional electrode array implants are unable to make patients perceive the contours of objects. It can, but has the problem of not being able to make the patient perceive the color of the object, which greatly reduces the intuitive experience of the external world for visually impaired patients.

In order to make up for the lack of traditional color vision restoration technology in the field of artificial vision, the present invention provides an artificial eye device built into the eyeball, abbreviated as an "eye-in-eye" device, which collects and processes external visual information. Later, by projecting onto selected areas of normal retinal function, the visually impaired can acquire color vision.

In order to achieve the above object, the present invention has taken the following technical solutions.
Including an internal eyeball component, the internal eyeball component includes a micro LED curved screen embedded between the eye lens and the retina, a micro-focus lens and a hollow eyeball body, the hollow eyeball body being between the eye lens and the retina embedded and in its central position, a hollow channel is provided so that the light rays passing through the lens of the eye can reach the retina, and the micro LED curved screen and the micro focus lens are placed in the hollow channel of the hollow eyeball body A micro LED curved screen is provided at a side of the eye proximate to the lens, a micro-focus lens is provided on a side proximate to the retina of the eye, and the micro LED curved screen and the micro-focus lens are respectively controlled Possible rotation, folding and unfolding can be performed, the micro LED curved screen and the micro focus lens can be changed according to their positions relative to the hollow channel, and the working state of the built-in eyeball component can be divided into the following two types:
First, by rotating and folding both the micro LED display and the rear microlens to create an optical path from the natural pupil to the retina, the external image is directly refracted by the natural lens and focused on the retina. forming and stimulating the optic nerve to generate nerve signals and transmitting them to the visual center of the brain to be seen by the patient;
The second is to develop a micro LED curved screen and a micro focus lens embedded in the eye to block the optical path from the natural pupil to the retina, and then process the external image with the information processing module before sending it to the micro LED curved screen. From the micro LED curved screen, through a microfocus lens provided on the side close to the retina behind the micro LED curved screen, the image is formed by refracting to a selected area on the retina, stimulating the optic nerve to generate nerve signals, and cerebral is to be seen by the patient, hereinafter referred to as the "artificial vision screen state". Both are artificial eye devices built into the eyeball, which are located in the natural retina.

Furthermore, it further includes an image generation module, an image processing module and an external control module connected in sequence, the image processing module transmitting the image to the micro LED curved screen, and the built-in eyeball component has two working modes under the artificial vision screen state. have
The first is that the image acquisition device in the image generation module collects the image, stores it in real time, transmits it to the image processing module, processes it in the image processing module, and then transmits it to the micro LED curved screen in real time for display. Then, the image on the micro LED curved screen is refracted to a selected area on the retina through a micro focus lens provided on the side close to the retina behind the micro LED curved screen to form an image, stimulating the optic nerve. to generate a neural signal and transmit it to the visual center of the brain to be seen by the patient, hereinafter referred to as "artificial visual screen real-time communication mode"
The second is to send the image information stored in the network or the image generation module to the micro LED curved screen after being processed by the image processing module, and then installed on the rear side of the micro LED curved screen, close to the retina. Through a microfocus lens, it refracts and forms an image on a selected area of the retina, stimulates the optic nerve to generate a neural signal, and transmits it to the visual center of the cerebrum to be seen by the patient. This mode of operation is called "artificial vision screen covert communication mode",
The external control module can control the built-in ocular components to be in different operating states or modes, the first is to control switching between the "natural state" and the "artificial vision screen state"; The eye is to control the switching between "artificial vision screen real-time communication mode" and "artificial vision screen covert communication mode"; is to activate the screen covert communication mode at the same time.

Further, the image generation module includes an image acquisition unit, an image storage unit, an image extraction unit and an image retrieval unit, controlled by an external control module to enable different units corresponding to different operation modes, and an artificial vision Enable the image acquisition unit and image storage unit in screen real-time communication mode, and enable the image extraction unit and image retrieval unit in artificial vision screen covert communication mode.

Further, the image processing module is for processing the received image, and includes a brightness adjustment unit, a contrast adjustment unit, a saturation adjustment unit, a pixel adjustment unit, a panorama selection unit, a partial image controlled by an external control module. It includes a selection unit, a partial enlargement unit, a telephoto effect unit, a foreground effect unit and a motion imaging compensation unit.

In addition, the external control module can also set the expansion and rotation angle of the micro LED curved screen, pixels, brightness, contrast, color and saturation, etc., and set the expansion and rotation angle of the micro focus lens. By controlling the direction of its focus refraction, the setting of imaging parameters in different modes of operation of the built-in ocular component can be controlled.

Further, the image acquisition device in the image generation module may be a built-in micro image acquisition device or an external image acquisition device.

In addition, the image storage unit in the image generation module implements storage by an internal storage chip, or stores in the cloud by wireless transmission.

In addition, the image extracting unit in the image generating module extracts from the built-in storage chip or extracts from the cloud.

Further, the image search unit in the image generation module realizes search by connecting to a network and opening a search engine, and the network connection is used by one or more of wireless network, local area network, 4G and 5G. be done.

Furthermore, the micro LED curved screen and the micro focus lens provided on the side close to the retina behind the micro LED curved screen can both be rotated, folded and unfolded, and by deflecting both at different angles, the micro The image on the LED curved screen can be focused and imaged on different areas of the retina, so that the built-in ocular component can avoid the lesion area when the image on the micro LED curved screen is out of the lesion area, and the normal function of the retina. Visually impaired patients with or without partial retinal damage such as macular disease, cataracts, amblyopia, myopia, astigmatism, night blindness, military personnel and covert communications Other retinal functions are adapted to the needs of different users, such as normal people, who need to perform special tasks, or need to complete special tasks.

Further, the control method for the operating mode of the built-in ocular component of the external control module is manual control or voice control.

In addition, the image processing module may use a built-in image processing chip or a cloud processing system.

Moreover, the brightness, pixel, color and saturation of the Micro LED curved screen are all adjustable.

In addition, it further includes a built-in optical information enhancement device to enable special functions not provided by the natural eye, such as infrared imaging, ultraviolet imaging, and starlight low-light imaging.

It further includes a power source implanted inside the eyeball provided by a micro wireless rechargeable battery.

Further, information transmission between the image generation module and the image processing module, information communication between the image processing module and the micro LED curved screen, and external control module and the image generation module, the image processing module, the micro LED curved screen and the micro focus Communication with the lens uses wired and/or wireless methods, and the types of wireless signal transmission include Bluetooth, WIFI, Zigbee, and mobile communication.

Beneficial Effect Compared with the conventional artificial vision technology, (1) the “artificial vision screen state” in the artificial eye device built into the eye according to the present invention combines the micro LED curved screen and the micro focus lens to make the image natural. Regarding the new imaging method of forming images on the retina, it can also form color vision, which can bring patients a more intuitive and richer experience of the external world, and is called "artificial vision screen real-time communication mode". Combined with the "artificial visual screen secret communication mode", the user can obtain much more information than the real-time environment image, that is, in addition to the real-time environment image, Able to "see" a multitude of sights, images and textual information to complete special tasks.
(2) By deflecting the microfocus lens provided on the side close to the retina behind the micro LED curved screen according to the present invention at different angles, the artificial eye device can reproduce the image on the micro LED curved screen with the retina. Patients with visual impairments with or without partially damaged retina such as macular disease, cataracts, amblyopia, myopia, astigmatism, night blindness, and military personnel and secretives, capable of imaging in selected areas Other retinal functions are adapted to the needs of different users, such as normal people who need to communicate or need to complete special tasks.
(3) The eyeball built-in artificial eye device according to the present invention can be used in fields such as visual recovery, entertainment, navigation, data inquiry, medical care, and confidential communication.

FIG. 1 is a structural schematic diagram of an artificial eye device built into an eye according to one embodiment of the present invention. FIG. 2 is a three-dimensional structural schematic diagram of an internal ocular component in one embodiment of the present invention. FIG. 3 is a schematic cross-sectional view of the built-in ocular component in one embodiment of the present invention when operating in a natural state. FIG. 4 is a schematic cross-sectional view of the built-in ocular component in one embodiment of the present invention when operating in an artificial vision screen. FIG. 5 is a principle diagram when the built-in eyeball component is in a natural state in one embodiment of the present invention. FIG. 6 is a principle diagram of the built-in eyeball component in the artificial vision screen state in one embodiment of the present invention.

The invention will now be described with reference to specific examples. Those skilled in the art can appreciate that these examples are merely illustrative of the invention and that they do not limit the scope of the invention in any way.

Referring to FIG. 1, the artificial eye device embedded in the eye according to a specific embodiment of the present invention includes an embedded eye component 100, an image generation module 200, an image processing module 300 and an external control module 400. The image generation module 200 and stored in real time and transmitted to the image processing module 300, processed by the image processing module 300 and then transmitted in real time to the embedded eyeball component 100, or stored in the network or image generation module 200. After the image information is processed by the image processing module 300, it is sent to the micro LED curved screen of the built-in eyeball component 100, and the external control module 400 can control the built-in eyeball component 100 to be in different working states or modes, and at the same time generate images. Module 200 and image processing module 300 are also controlled by external control module 400 .

2-4, the built-in eyeball components include a micro LED curved screen 1, a microfocus lens 2 and a hollow eyeball body 3, which is an ellipsoid with a cylindrical hollow channel 4 at its center. , the micro LED curved screen 1 and the micro focus lens 2 are respectively installed on the upper and lower two side walls of the hollow channel 4 of the hollow eyeball body 3 , and the micro LED curved screen 1 and the micro focus lens 2 are both installed in the hollow channel 4 Can be rotated, folded and unfolded within.

Referring to FIG. 5, when the eyeball built-in artificial eye device in the specific embodiment of the present invention operates in the “natural state”, the micro LED curved screen 1 and the microfocus lens 2 inside the hollow eyeball body 3 will be is also folded and positioned close to the sidewalls in the hollow channel 4 so as to allow the light path from the natural lens 5 to the retina 6 to exit, so that the external image 8 is focused by the natural lens 5 before entering the hollow eyeball body. It can pass through the hollow channel 4 of 3 to form an image directly onto the retina 6 and be transmitted via the optic nerve 7 to the cerebrum to form vision.

Referring to FIG. 6, when the artificial eye device built into the eyeball in the specific embodiment of the present invention operates in the “artificial vision screen state”, the micro LED curved screen 1 and the microfocus lens 2 inside the hollow eyeball body 3 are deployed to block the optical path from the natural lens 5 to the retina 6, thereby replacing the image formation path in the natural eye of the external world image 8, and transmitting the image transmitted from the image generation module and the image processing module to the micro LED It can be transmitted to the curved screen 1, focused through the microfocus lens 2, then imaged on the retina 6, and finally transmitted through the optic nerve 7 to the brain to form vision.

In this embodiment, the image processing module transfers the image to the micro LED curved screen, and the built-in eyeball component has two working modes in the state of the artificial vision screen;
The first is that the image acquisition device in the image generation module collects the image, stores it in real time, transmits it to the image processing module, processes it in the image processing module, and then transmits it to the micro LED curved screen in real time for display. Then, the image on the micro LED curved screen is refracted to a selected area on the retina through a micro focus lens provided on the side close to the retina behind the micro LED curved screen to form an image, stimulating the optic nerve. to generate a neural signal and transmit it to the visual center of the brain to be seen by the patient, hereinafter referred to as "artificial visual screen real-time communication mode"
The second is to send the image information stored in the network or the image generation module to the micro LED curved screen after being processed by the image processing module, and then installed on the rear side of the micro LED curved screen, close to the retina. Through a microfocus lens, it refracts and forms an image on a selected area of the retina, stimulates the optic nerve to generate a neural signal, and transmits it to the visual center of the cerebrum to be seen by the patient. This mode of operation is called "artificial vision screen covert communication mode",
The external control module can control the built-in ocular components to be in different operating states or modes, the first is to control switching between the "natural state" and the "artificial vision screen state"; The eye is to control the switching between "artificial vision screen real-time communication mode" and "artificial vision screen covert communication mode"; It is to activate "screen secret communication mode" at the same time,
Information transmission between the image generation module and the image processing module, information communication between the image processing module and the micro LED curved screen, and external control module and the image generation module, the image processing module, the micro LED curved screen and the micro focus lens. using wired and/or wireless methods, the type of wireless signal transmission includes Bluetooth, WIFI, Zigbee, mobile communication;
In addition, the micro LED curved screen and the micro focus lens provided on the side close to the retina behind the micro LED curved screen can both be rotated, folded and unfolded, and by deflecting both at different angles, the micro LED The image on the curved screen can be focused and imaged on different areas of the retina, so that the built-in ocular component allows the image on the micro LED curved screen to avoid the lesion area and restore the normal function of the retina. The ability to image areas can be achieved, and patients with visual impairments with or without partially damaged retina, such as macular disease, cataracts, amblyopia, myopia, astigmatism, night blindness, as well as military personnel and covert communications. Other retinal functions are applied to the needs of different users, such as normal people, who need or need to complete special tasks.

In this embodiment, the image acquisition device in the image generation module is a built-in micro image acquisition device or an external image acquisition device. The image generation module includes an image acquisition unit, an image storage unit, an image extraction unit and an image retrieval unit, controlled by an external control module to enable different units corresponding to different operation modes, and an artificial vision screen real-time communication. mode, and enable the image extraction unit and image retrieval unit in artificial vision screen covert communication mode. Specifically, the image storage unit in the image generation module implements storage by a built-in memory chip or stores in the cloud by wireless transmission, and the image extraction unit in the image generation module extracts from the built-in memory chip. or extract from the cloud, the image search unit in the image generation module can connect to the network and open the search engine to realize the search, and the network connection can be wireless network, local area network, 4G and 5G. Or multiple types are used.

In this embodiment, the image processing module is for processing the received image, and includes a brightness adjustment unit, a contrast adjustment unit, a saturation adjustment unit, a pixel adjustment unit, a panorama selection unit, controlled by the external control module. It includes a partial image selection unit, a partial enlargement unit, a telephoto effect unit, a foreground effect unit and a motion image formation compensation unit. At the same time, the image processing module uses an embedded image processing chip or a cloud processing system.

In this embodiment, the control method for the operating mode of the built-in ocular component of the external control module is manual control or voice control. The external control module can also set the expansion and rotation angle of the micro LED curved screen, pixels, brightness, contrast, color and saturation, etc., and set the expansion and rotation angle of the micro-focus lens for micro-focus. By controlling the direction of focus refraction of the lens, it is possible to control the setting of imaging parameters in different working modes of the built-in eyeball component, and the brightness, pixel, color and saturation of the micro LED curved screen can all be adjusted. It is possible.

In this embodiment, a built-in optical information enhancement device is further included to realize special functions that the natural eye does not have, such as infrared imaging, ultraviolet imaging, and starlight low-light imaging.

In this embodiment, it further includes a power source implanted inside the eye, provided by a micro wireless rechargeable battery.

The above are merely preferred embodiments of the present invention, and are not intended to limit the present invention, and several improvements and modifications can be made by those skilled in the art without departing from the principles of the present invention. It should be pointed out that improvements and modifications should also be regarded as the protection scope of the present invention.

1 - micro LED curved screen, 2 - micro focus lens, 3 - hollow eyeball body, 4 - hollow channel, 5 - lens, 6 - retina, 7 - optic nerve, 8 - external image

Claims (10)

Including an internal eyeball component, the internal eyeball component includes a micro LED curved screen embedded between the eye lens and the retina, a micro-focus lens and a hollow eyeball body, the hollow eyeball body being between the eye lens and the retina embedded and at the center position of the hollow eyeball body, a hollow channel is provided so that light rays passing through the lens of the eye can reach the retina, and a micro LED curved screen and a microfocus lens are installed in the hollow eyeball Spaced in the hollow channel of the main body, a micro LED curved screen is provided on the side of the eye proximate to the crystalline lens, and a micro-focus lens is provided on the side proximate to the retina of the eye, comprising a micro-LED curved screen and a micro-focus. The lens can be controlled to rotate, fold and unfold respectively, the micro LED curved screen and the micro focus lens can be changed according to the position relative to the hollow channel, and the working state of the built-in eyeball component can be divided into the following two types: is possible and
First, by rotating and folding both the micro LED display and the rear microlens to create an optical path from the natural pupil to the retina, the external image is directly refracted by the natural lens and focused on the retina. forming and stimulating the optic nerve to generate nerve signals and transmitting them to the visual center of the brain to be seen by the patient;
The second is to develop a micro LED curved screen and a micro focus lens embedded in the eye to block the optical path from the natural pupil to the retina, and then process the external image with the information processing module before sending it to the micro LED curved screen. From the micro LED curved screen, through a microfocus lens provided on the side close to the retina behind the micro LED curved screen, the image is formed by refracting to a selected area on the retina, stimulating the optic nerve to generate nerve signals, and cerebral is to be seen by the patient, hereinafter referred to as the "artificial vision screen state". and are both in the natural retina. It further includes an image generation module, an image processing module and an external control module connected in sequence, the image processing module transmitting the image to the micro LED curved screen, and the built-in eyeball component has two working modes in the state of the artificial vision screen. ,
The first is that the image acquisition device in the image generation module collects the image, stores it in real time, transmits it to the image processing module, processes it in the image processing module, and then transmits it to the micro LED curved screen in real time for display. Then, the image on the micro LED curved screen is refracted to a selected area on the retina through a micro focus lens provided on the side close to the retina behind the micro LED curved screen to form an image, stimulating the optic nerve. to generate a neural signal and transmit it to the visual center of the brain to be seen by the patient, hereinafter referred to as "artificial visual screen real-time communication mode"
The second is to send the image information stored in the network or the image generation module to the micro LED curved screen after being processed by the image processing module, and then installed on the rear side of the micro LED curved screen, close to the retina. Through a microfocus lens, it refracts and forms an image on a selected area of the retina, stimulates the optic nerve to generate a neural signal, and transmits it to the visual center of the cerebrum to be seen by the patient. This mode of operation is called "artificial vision screen covert communication mode",
the external control module is controllable to put the built-in ocular components into different operating states or modes, the first being to control switching between "natural state" and "artificial vision screen state"; The second is to control switching between "artificial vision screen real-time communication mode" and "artificial vision screen covert communication mode", and the third is to control switching between "artificial vision screen real-time communication mode" and "artificial vision screen real-time communication mode" and ""Artificial visual screen covert communication mode" is operated at the same time, and the control method for the operating mode of the built-in eyeball component of the external control module is manual control or voice control;
Information transmission between the image generation module and the image processing module, information communication between the image processing module and the micro LED curved screen, and external control module with the image generation module, the image processing module, the micro LED curved screen and the micro focus lens. The in-eye prosthesis of claim 1, characterized in that the communication between the eye device. The image acquisition device in the image generation module is an internal micro image acquisition device or an external image acquisition device, and the image generation module comprises an image acquisition unit, an image storage unit, an image extraction unit and an image retrieval unit. including, controlling by an external control module to enable different units corresponding to different working modes, enabling the image acquisition unit and the image storage unit in the artificial vision screen real-time communication mode, and the image in the artificial vision screen covert communication mode. 3. The intraocular artificial eye device according to claim 2, wherein the extraction unit and the image retrieval unit are enabled. The image processing module is for processing the received image, and is controlled by an external control module: a brightness adjustment unit, a contrast adjustment unit, a saturation adjustment unit, a pixel adjustment unit, a panorama selection unit, a partial image selection unit. , a partial enlargement unit, a telephoto effect unit, a foreground effect unit and a motion image formation compensation unit, wherein the image processing module uses a built-in image processing chip or a cloud processing system. An artificial eye device built into the eyeball of The external control module can also set the expansion and rotation angles of the micro LED curved screen, pixels, brightness, contrast, color and saturation, etc.; 3. The in-eye prosthesis of claim 2, characterized in that by controlling the direction of focus refraction of the focus lens, it is possible to control the setting of imaging parameters in different operating modes of the in-built ocular component. eye device. the image storage unit in the image generation module implements storage by a built-in storage chip or stores in the cloud by wireless transmission;
The image extraction unit extracts from the built-in storage chip or extracts from the cloud,
The image search unit realizes search by connecting to a network and opening a search engine, and the network connection uses one or more of wireless network, local area network, 4G and 5G. The artificial eye device built in the eye according to claim 3. The micro LED curved screen and the micro focus lens provided on the side close to the retina behind the micro LED curved screen are both rotatable, foldable and unfoldable, and by deflecting both at different angles, the micro LED The image on the curved screen can be focused and imaged on different areas of the retina, so that the built-in ocular component allows the image on the micro LED curved screen to avoid the lesion area and improve the function of the retina. Patients with vision impairments with or without partial retinal damage such as macular disease, cataracts, amblyopia, myopia, astigmatism, night blindness, etc., who are capable of imaging in normal areas, and military personnel and other retinal functions are adapted to the needs of different users, such as normal people, who need covert communication or need to complete special tasks. An artificial eye device built into the eyeball of The in-eye artificial eye device according to claim 1, characterized in that the brightness, pixel, color and saturation of the micro LED curved screen are all adjustable. 11. The method of claim 1, further comprising a built-in optical information enhancement device to achieve special functions not provided by the natural eye, such as infrared imaging, ultraviolet imaging, starlight low-light imaging, and the like. An artificial eye device built into the eyeball of 3. The intraocular prosthetic device of claim 1, further comprising a power source implanted inside the eye provided by a micro wireless rechargeable battery.

Images