CN110349271B - Lens color adjustment method, device, storage medium and augmented reality equipment - Google Patents

Abstract

The embodiment of the application discloses a lens color adjusting method, a device, a storage medium and augmented reality equipment, which are applied to the augmented reality equipment and comprise the following steps: determining a scene of a current augmented reality image; determining a lens color that matches a scene of the augmented reality image; and adjusting the lens in the lens augmented reality device according to the lens color. By adopting the technical scheme, the embodiment of the application determines the color of the lens in the augmented reality equipment by determining the scene of the augmented reality image seen by human eyes, adjusts the color of the lens, enables the color of the lens to be matched with the scene of the augmented reality image, improves the reality of the augmented reality image, and improves the immersion of the target object to the augmented reality image.

Description

Lens color adjustment method, device, storage medium and augmented reality device

Technical field

The embodiments of the present application relate to the technical field of augmented reality equipment, and in particular to a lens color adjustment method, replacement, storage medium and augmented reality equipment.

Background technique

With the continuous development of augmented reality technology, head-mounted augmented reality devices such as augmented reality devices are widely accepted and used by users.

The augmented reality device includes a virtual image display and a light-transmitting lens. The virtual image display generates a virtual image. The light of the virtual image and the ambient light passing through the lens enter the human eye at the same time, so that the user wearing the augmented reality device can not only see real things. , you can also see virtual images, forming augmented reality images in human eyes.

The lenses of current augmented reality devices are generally fixed-color transparent or semi-transparent lenses. Generally, the light reflected by objects in the external environment enters the human eye through the lens and is not affected by other factors, such as changes in the virtual image. The light of real objects does not change, and the augmented reality image formed in the human eye cannot be adaptively adjusted.

Contents of the invention

Embodiments of the present application provide a lens color adjustment method, device, storage medium, and augmented reality equipment to improve the intelligence of the augmented reality equipment and improve the variability of the augmented reality image.

In the first aspect, embodiments of the present application provide a lens color adjustment method applied to augmented reality devices, including:

Determine the scene of the current augmented reality image;

determining a lens color that matches the scene of the augmented reality image;

Adjust the lens in the lens augmented reality device according to the lens color.

In a second aspect, embodiments of the present application provide a lens color adjustment device, including:

Scene determination module, used to determine the scene of the current augmented reality image;

a lens color determination module configured to determine a lens color that matches the scene of the augmented reality image;

A lens adjustment module, used to adjust the lens in the lens augmented reality device according to the lens color.

In a third aspect, embodiments of the present application provide a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the lens color adjustment method as described in the embodiments of the present application is implemented.

In the fourth aspect, embodiments of the present application provide an augmented reality device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the following is implemented: The lens color adjustment method described in the application embodiment.

The technical solution provided in the embodiment of the present application determines the scene of the augmented reality image seen by the human eye, determines the color of the lens in the augmented reality device, and adjusts the color of the lens so that the color of the lens matches the scene of the augmented reality image, thereby improving The authenticity of the augmented reality image, and the target subject's immersion in the augmented reality image.

Description of the drawings

Figure 1A is a schematic structural diagram of augmented reality glasses provided by an embodiment of the present application;

Figure 1B is a schematic cross-sectional structural diagram of the side frame and internal components of the augmented reality glasses provided by an embodiment of the present application;

Figure 2 is a schematic flow chart of a lens color adjustment method provided by an embodiment of the present application;

Figure 3 is a schematic flow chart of another lens color adjustment method provided by an embodiment of the present application;

Figure 4 is a schematic flow chart of another lens color adjustment method provided by an embodiment of the present application;

Figure 5 is a schematic structural diagram of a lens color adjustment device provided by an embodiment of the present application;

Figure 6 is a schematic structural diagram of an augmented reality device provided by an embodiment of the present application;

Figure 7 is a schematic structural diagram of another augmented reality device provided by an embodiment of the present application.

Detailed ways

The technical solution of the present application will be further described below with reference to the accompanying drawings and through specific implementation methods. It can be understood that the specific embodiments described here are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for convenience of description, only some but not all structures related to the present application are shown in the drawings.

Before discussing example embodiments in more detail, it should be mentioned that some example embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts depict steps as a sequential process, many of the steps may be performed in parallel, concurrently, or simultaneously. Additionally, the order of steps can be rearranged. The process may be terminated when its operation is completed, but may also have additional steps not included in the figures. The processing may correspond to a method, function, procedure, subroutine, subroutine, or the like.

The augmented reality devices provided by this application include but are not limited to augmented reality glasses, mobile phones with augmented reality functions, tablet computers and other electronic devices. Taking a head-mounted augmented reality device (augmented reality glasses) as an example, see FIG. 1A for example. FIG. 1A is a schematic structural diagram of an augmented reality glasses 101 provided by an embodiment of the present application. The augmented reality glasses 101 include a frame. 104. Left-eye lens and right-eye lens, left-eye diffraction integrator 102, right-eye diffraction integrator 103, processing unit 105, reality information collector 107, and operating component 106 respectively provided on the left-eye lens and right-eye lens, wherein , the left eye diffraction integrator 102 and the right eye diffraction integrator 103 are both composed of ultraviolet light fixed/thermosetting resin layers with surface relief diffraction gratings for reflecting virtual images into the human eye. The augmented reality glasses 101 also include a microdisplay, which may be disposed on the temples for outputting virtual images, and may be electrically connected to the processing unit 105 . The reality information collector 107 and the operating component 106 are electrically connected to the processing unit 105 respectively. The operating component 106 can be used to receive the user's input operation on the augmented reality glasses 101 and send the input operation to the processing unit 105. The operating component 106 can It consists of one or more keys. The processing unit 105 is used to accept operating instructions transmitted by the operating component 106, and is also used to control the real information collector 107 to obtain real information. The processing unit 105 can also be wirelessly connected to other devices 108 through wireless transmission, etc. The other devices 108 can be But it is not limited to mobile devices such as mobile phones and tablets, and can also be computers, servers and other devices.

For example, see FIG. 1B , which is a schematic cross-sectional structural diagram of the side frame and internal components of the augmented reality glasses provided by an embodiment of the present application. In Figure 1B, the dotted line represents the virtual light signal emitted by the microdisplay 109, and the solid line passing through the lens represents the real light signal. The virtual light signal and the real light signal are simultaneously absorbed into the target pupil, forming an augmented reality image in the target pupil. Among them, after the real light signal is the light information carrying the real object information, the virtual light signal is the light signal carrying the virtual image information obtained by converting the electrical signal. The target pupil can be the pupil of the user who wears or uses the augmented reality device.

Figure 2 is a schematic flowchart of a lens color adjustment method provided by an embodiment of the present application. The method can be executed by a lens color adjustment device, where the device can be implemented by software and/or hardware, and can generally be integrated in an augmented reality device. As shown in Figure 2, the method includes:

Step 201: Determine the scene of the current augmented reality image.

Step 202: Determine a lens color that matches the scene of the augmented reality image.

Step 203: Adjust the lens in the lens augmented reality device according to the lens color.

Among them, the augmented reality image is an image formed by a real image and a virtual image, and includes real objects within the line of sight of the target object, as well as virtual objects carried in the virtual image that enters the pupil of the target object. In this embodiment, determining the scene of the augmented reality image formed in the human eye can be determined based on the real objects within the sight range of the target object and the objects in the virtual image. Specifically, it can be by extracting the objects in the virtual image, and Obtain real objects within the line of sight of the target object, and determine the scene of the augmented reality image based on the relative positional relationship between the objects in the virtual image and the real objects, and/or the objects in the virtual image and the real objects. For example, the scenes of the augmented reality images may include but are not limited to romantic scenes, warm scenes, sad scenes, bright scenes, dim scenes, etc. The scenes of the augmented reality images may be preset, and may also be added or deleted according to user needs. and modifications.

Based on the above embodiments, determining the lens color that matches the scene of the augmented reality image includes: determining the lens color according to the mapping relationship between the scene and the color and the scene of the augmented reality image. The augmented reality device stores a mapping relationship between scenes and colors. After determining the scene of the augmented reality image, the lens color corresponding to the scene of the augmented reality image is determined in the mapping relationship between the scene and color. The mapping relationship between scenes and colors can be a one-to-one mapping relationship, or multiple scenes can correspond to one lens color.

In this embodiment, the lens configured in the augmented reality device is an electrochromic lens. The lens is electrically connected to the power supply module of the augmented reality device, and the color of the lens can be adjusted according to the voltage provided by the power supply module. Optionally, the lens includes a glass substrate, a transparent conductive layer, an electrochromic layer, an ion conductor layer, an ion storage layer, a transparent conductive layer, and a glass substrate in sequence, wherein the transparent conductive layer may be electrically connected to the power supply module. When a voltage is applied between the two transparent conductive layers, the electrochromic layer undergoes an oxidation-reduction reaction under the action of the voltage, and the color changes; the ion conductor layer is composed of special conductive materials, such as lithium perchlorate, perchloric acid Solution or solid electrolyte material such as sodium; the ion storage layer plays the role of storing corresponding counter ions when the redox reaction of the electrochromic material occurs, maintaining the charge balance of the entire system. The ion storage layer can also be a kind of layer similar to the previous layer Electrochromic materials are electrochromic materials with opposite color-changing properties, which can play a role of color superposition or complementation. For example, the material of the electrochromic layer is an anodized color-changing material, and the ion storage layer can use a cathodic reduction color-changing material.

Among them, the lens configured in the augmented reality device can adjust the color of the lens according to the applied voltage, that is, when different voltages are applied to the lens, the color of the lens will be different. Optionally, adjusting the lens in the lens augmented reality device according to the lens color includes: determining a voltage to be applied to the lens according to the lens color, and applying the determined voltage to the lens. For example, if the augmented reality image includes the sun, trees, and flowers, it can be determined that the scene of the augmented reality image is a bright scene, and the lens color can be transparent or warm; if the augmented reality image includes people waving goodbye, it can be determined that the augmented reality image contains people waving goodbye. The scene of the real image is a farewell scene, and the lens color can be gray; when the augmented reality image includes a smiling man and woman, it can be determined that the scene of the augmented reality image is a romantic scene, and the lens color can be pink; when the augmented reality image includes playing For parents and children, the scene of the augmented reality image can be determined to be a warm scene, and the lens color can be light pink.

In this embodiment, by adjusting the color of the lens so that the color of the lens matches the augmented reality image, the problem of conflict between the real light and the scene of the augmented reality image is avoided, thereby improving the user's immersion in the augmented reality image. For example, when the virtual image includes raindrops and the sun is shining brightly in the real environment, an augmented reality image will be formed that includes both bright sunshine and raindrops. The augmented reality image contradicts conventional theory. According to the objects (raindrops) in the augmented reality image, it is determined that the scene of the augmented reality image is a raining scene. The lens color of the augmented reality device can be determined to be grayscale or light blue. The real-life light projected into the human eye is processed based on the lens. The light of the augmented reality image formed in the human eye is gray or light blue, which is consistent with the rain scene.

The lens color adjustment method provided in the embodiment of the present application determines the color of the lens in the augmented reality device by determining the scene of the augmented reality image seen by the human eye, and adjusts the color of the lens so that the color of the lens matches the scene of the augmented reality image. , improve the authenticity of augmented reality images, and the target object’s immersion in augmented reality images.

Based on the above embodiments, lens color adjustment also includes: collecting ambient light intensity, and adjusting the light transmittance of the lens in the augmented reality device according to the ambient light intensity. When the ambient light intensity is high, it is easy to irritate the human eyes and cause damage to the human eyes. The ambient light intensity is collected through photosensitive elements configured in the augmented reality device, where the reality information collector 107 may include photosensitive elements. When the ambient light intensity is greater than the preset value, the transmittance of the lens is reduced. The transmittance of the lens is negatively related to the ambient light intensity. That is, the greater the ambient light intensity, the smaller the transmittance of the lens to ensure that the transmittance is The light intensity of the human eye is within the acceptable range of the human eye, which reduces the damage of strong light to the human eye, allowing users to view augmented reality images under strong light.

Figure 3 is a schematic flow chart of another lens color adjustment method provided by an embodiment of the present application. Referring to Figure 3, the method of this embodiment includes the following steps:

Step 301: Collect real images and determine the current virtual image.

Step 302: Fusion of the real image and the current virtual image to obtain an augmented reality image, and identify the scene of the augmented reality image.

Step 303: Determine a lens color that matches the scene of the augmented reality image.

Step 304: Adjust the lens in the lens augmented reality device according to the lens color.

In this embodiment, real images are collected through a camera provided in the augmented reality device. For example, the real information collector 107 may include a camera. Optionally, collecting real-life images may include pupil tracking of the target object, determining the pupil direction of the target object, adjusting the shooting angle of the camera according to the pupil direction of the target object, and controlling the adjusted shooting angle of the camera. Take photos and generate realistic images. Optionally, tracking the pupil and determining the pupil direction includes: obtaining an eye image of the target object; performing edge detection on the eye image to determine the eye position and pupil position; and based on the pupil position and the eye The relative relationship between the head positions determines the pupil direction of the target object. Optionally, a tracking camera is provided on the temples of the augmented reality glasses to collect eye images of the target object wearing the augmented reality glasses. Perform edge detection on the collected eye images, match the edge detection results with the preset standard eye images and standard pupil images, determine the eye contour and pupil contour, and determine the sitting position of the eye contour as the eye position and pupil The contour position is determined as the pupil position. Optionally, verify the determined eye position and pupil position, where the verification conditions may include the relative position of the eye and the pupil, and the pupil is located inside the human eye; the verification conditions may also include the size and size of the eye and pupil. quantity. The pupil direction is determined based on the relative relationship between the pupil position and the eye position. Furthermore, the pupil direction can be determined based on the relative relationship between the pupil center position and the eye center position. When the pupil center position coincides with the eye center position, the pupil direction is determined as Horizontally forward; when there is a distance between the pupil center position and the eye center position, determine the pupil direction and there is a deflection angle. For example, when the pupil center position is to the left of the eye center position, determine the pupil direction to the left. When the pupil center position is at When the center of the eye is below, make sure the pupil is directed downward. Determine the direction and distance of the pupil center position relative to the eye center position to determine the pupil direction.

The shooting angle of the camera is determined according to the direction and distance of the pupil center position relative to the eye center position in the pupil direction. The adjustment direction of the camera is determined according to the direction of the pupil center position relative to the eye center position. The adjustment direction is consistent with the pupil center position. The direction relative to the center of the eye is consistent, and the adjustment value of the camera is determined based on the distance between the center of the pupil and the center of the eye. The adjustment value of the camera may be determined based on a preset mapping relationship between the adjustment value of the camera and the distance.

In this embodiment, the current virtual image may be extracted from the microdisplay. In order to distinguish the real image and the virtual image, after obtaining the real image and the virtual image, an image type identifier is set for the collected real image and virtual image, where, The image type includes real images and virtual images. The image type identifier can be numbers, characters, etc. For example, the type identifier of the real image can be 1, and the virtual image can be 0. In order to determine matching real images and virtual images, after acquiring the real images and virtual images, add a timestamp to the collected real images and virtual images.

In some embodiments, fusing the real image and the currently displayed virtual image to generate an augmented reality image includes: determining matching real images and virtual images according to the image type identifier and timestamp; The matching real images and virtual images are fused to generate augmented reality images. Exemplarily, real images and virtual images are distinguished according to image type identifiers, real images and virtual images with the same time stamp are determined as matching real images and virtual images, and the matching real images and virtual images are aligned. , to ensure that the fused real image and virtual image conform to the user's viewing angle and avoid errors caused by fusion. The aligned real images and virtual images are fused to obtain an augmented reality image. For example, the real image may be user A, the virtual image may be a hat, and the fused augmented reality image may be user A wearing the hat. Optionally, when the augmented reality device is equipped with two cameras (for example, the two cameras can be respectively set at the center of the frame above the lens), two real images are obtained, and a real image with depth information is obtained based on the two real images. And the real image with depth information and the corresponding virtual image are fused to obtain an augmented reality image with depth information, which improves the three-dimensional sense of the augmented reality image.

Optionally, after generating the augmented reality image, verify the augmented reality image to determine the fusion status of the augmented reality image. If the fusion error is stored, adjust the relative positions of the real image and the virtual image, and re-align the adjusted real image. fused with virtual images. For example, if in the fused augmented reality image, the hat is far away from user A's head or the hat partially blocks user A (for example, it covers user A's face), it is determined that there is a fusion error in the augmented reality image. The adjustment value of the real image and the virtual image is determined according to the error of the augmented reality image. The adjustment value includes a horizontal movement distance and a vertical movement distance. The real image or the virtual image is adjusted according to the adjustment value to generate a new augmented reality image.

It should be noted that step 302 may be performed by the processing unit 105 of the augmented reality device, or may be performed by the augmented reality device communicating with other devices 108 through wireless transmission or other means, controlling other devices 108 to perform, and receiving enhancement feedback from other devices 108 Realistic image scenes to reduce the computational load of the augmented reality device, where the other devices 108 may be, for example, mobile terminals such as mobile phones, tablets, or computers. The processing unit 105 of the augmented reality device adjusts the lens color according to the scene of the fed-back augmented reality image.

The lens color adjustment method provided in the embodiment of the present application obtains an augmented reality image by fusing the collected real images and virtual images, and adjusts the lens color of the augmented reality device according to the scene of the augmented reality image, so that the lens color is consistent with the augmented reality image. Match the scene, improve the authenticity of the augmented reality image, and the target object's immersion in the augmented reality image.

Figure 4 is a schematic flow chart of another lens color adjustment method provided by an embodiment of the present application. This embodiment is an alternative to the above embodiment. Correspondingly, as shown in Figure 4, the method of this embodiment includes the following steps :

Step 401: Collect real images and determine the current virtual image.

Step 402: Determine the first scene of the real image and the second scene of the current virtual image respectively.

Step 403: Determine the scene of the augmented reality image according to the first scene and the second scene.

Step 404: Determine a lens color that matches the scene of the augmented reality image.

Step 405: Adjust the lens in the lens augmented reality device according to the lens color.

In this embodiment, after determining the real image and the current virtual image, scene recognition is performed on the real image and the current virtual image respectively, the first scene of the real image and the second scene of the current virtual image are determined, and the augmented reality image is further determined. scene, which simplifies the fusion process of augmented reality images and reduces the calculation amount of augmented reality devices. The method may include inputting the real image and the current virtual image into a pre-trained scene recognition model respectively, and obtaining the scene of the real image and the current virtual image according to the output result of the scene recognition model. The scene recognition module is a machine learning model with scene recognition function, for example, it can be a neural network model, etc.

Optionally, determining the scene of the augmented reality image according to the first scene and the second scene includes: determining the scene of the augmented reality image according to the priorities of the first scene and the second scene. . Among them, the augmented reality device may be set with scene priorities. For example, the priorities of romantic scenes, warm scenes, and rain scenes decrease in order. The scene priorities may be set according to user needs, which are not limited in this embodiment. The scene with higher priority among the first scene and the second scene is determined as the scene of the augmented reality image. For example, if the first scene is a romantic scene and the second scene is a raining scene, the first scene will be given priority. If the priority of the first scene is higher than that of the second scene, the scene of the augmented reality image is determined to be a romantic scene.

Optionally, determining the scene of the augmented reality image according to the first scene and the second scene includes: determining the augmented reality image corresponding to the combination of the first scene and the second scene according to a preset scene combination table. scene. Among them, the scene combination table includes the mapping relationship between any two scenes and the target scene, and the target scene is the scene of the augmented reality image. After the first scene and the second scene are determined, the target scene corresponding to the combination of the first scene and the second scene can be determined based on the scene combination table, that is, the scene of the augmented reality image. It should be noted that when the first scene and the second scene are the same, the first scene or the second scene is determined as the scene of the augmented reality image.

The lens color adjustment method provided in this embodiment determines the scene of the augmented reality image based on the first scene of the real image and the second image of the virtual image, thereby simplifying the fusion process of the augmented reality image and reducing the calculation amount of the augmented reality device. Adjust the lens color of the augmented reality device according to the scene of the augmented reality image so that the lens color matches the scene of the augmented reality image, thereby improving the authenticity of the augmented reality image and the target object's immersion in the augmented reality image.

Figure 5 is a structural block diagram of a lens color adjustment device provided by an embodiment of the present application. The device can be implemented by software and/or hardware, and is generally integrated in an augmented reality device. It can be adjusted by executing the lens color adjustment method of the augmented reality device. The lens color of the augmented reality device is adjusted. As shown in FIG. 5 , the device includes: a scene determination module 501 , a lens color determination module 502 and a lens adjustment module 503 .

Scene determination module 501, used to determine the scene of the current augmented reality image;

Lens color determination module 502, configured to determine a lens color that matches the scene of the augmented reality image;

The lens adjustment module 503 is used to adjust the lens in the lens augmented reality device according to the lens color.

The lens color adjustment device provided in the embodiment of the present application determines the color of the lens in the augmented reality device by determining the scene of the augmented reality image seen by the human eye, and adjusts the color of the lens so that the color of the lens matches the scene of the augmented reality image. , improve the authenticity of augmented reality images, and the target object’s immersion in augmented reality images.

Based on the above embodiments, the lens is an electrochromic lens.

Based on the above embodiments, the lens adjustment module 503 is used for:

determining a voltage to be applied to the lens based on the lens color;

A determined voltage is applied to the lens.

Based on the above embodiments, the scene determination module 501 includes:

The first image determination unit is used to collect real images and determine the current virtual image;

An augmented reality image determination unit, configured to fuse the real image and the current virtual image to obtain an augmented reality image;

The first scene identification unit is used to identify the scene of the augmented reality image.

Based on the above embodiments, the scene determination module 501 includes:

The second image determination module is used to collect real images and determine the current virtual image;

a second scene recognition unit, configured to respectively determine the first scene of the real image and the second scene of the current virtual image;

A scene determination unit, configured to determine the scene of the augmented reality image according to the first scene and the second scene.

Based on the above embodiments, the scene determination unit is used to:

The scene of the augmented reality image is determined according to the priorities of the first scene and the second scene.

Based on the above embodiments, the scene determination unit is used to:

According to the preset scene combination table, the scene of the augmented reality image corresponding to the combination of the first scene and the second scene is determined.

Based on the above embodiments, the lens color determination module 502 is used to:

The lens color is determined according to the mapping relationship between the scene and the color and the scene of the augmented reality image.

On the basis of the above embodiments, it also includes:

Light intensity collection module, used to collect ambient light intensity;

A light transmittance adjustment module, configured to adjust the light transmittance of the lens in the augmented reality device according to the ambient light intensity.

Embodiments of the present application also provide a storage medium containing computer-executable instructions, which when executed by a computer processor are used to perform a lens color adjustment method. The method includes:

Determine the scene of the current augmented reality image;

determining a lens color that matches the scene of the augmented reality image;

Adjust the lens in the lens augmented reality device according to the lens color.

Storage media – Any memory device or storage device of any type. The term "storage media" is intended to include: installation media, such as CD-ROM, floppy disks, or tape devices; computer system memory or random access memory, such as DRAM, DDRRAM, SRAM, EDORAM, Rambus RAM, etc.; non- Volatile memory, such as flash memory, magnetic media (such as hard disk or optical storage); registers or other similar types of memory elements, etc. Storage media may also include other types of memory or combinations thereof. Additionally, the storage medium may be located in the first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network, such as the Internet. The second computer system may provide program instructions to the first computer for execution. The term "storage media" may include two or more storage media that may reside in different locations (eg, in different computer systems connected by a network). Storage media may store program instructions (eg, embodied as a computer program) executable by one or more processors.

Of course, the embodiments of the present application provide a storage medium containing computer-executable instructions. The computer-executable instructions are not limited to the lens color adjustment operations described above, and can also perform the lens color adjustment provided by any embodiment of the application. Related operations in the method.

The embodiment of the present application provides an augmented reality device, in which the lens color adjustment device provided by the embodiment of the present application can be integrated. Figure 6 is a schematic structural diagram of an augmented reality device provided by an embodiment of the present application. The augmented reality device 600 may include: a memory 601, a processor 602, and a computer program stored on the memory 601 and executable on the processor 602. When the processor 602 executes the computer program, it implements the methods described in the embodiments of the present application. Lens color adjustment method.

The augmented reality device provided by the embodiment of the present application determines the scene of the augmented reality image seen by human eyes, determines the color of the lens in the augmented reality device, and adjusts the color of the lens so that the color of the lens matches the scene of the augmented reality image, thereby improving The authenticity of the augmented reality image, and the target subject's immersion in the augmented reality image.

Figure 7 is a schematic structural diagram of another augmented reality device provided by an embodiment of the present application. The augmented reality device may include: a casing (not shown in the figure), a memory 701, a central processing unit (CPU) 702 (also called a processor, hereinafter referred to as the CPU), a circuit board (not shown in the figure) ) and power circuit (not shown in the figure). The circuit board is placed inside the space enclosed by the housing; the CPU 702 and the memory 701 are provided on the circuit board; the power circuit is used to provide various circuits or devices of the augmented reality device Power supply; the memory 701 is used to store executable program code; the CPU 702 reads the executable program code stored in the memory 701 to run the computer program corresponding to the executable program code to implement the following steps :

Determine the scene of the current augmented reality image;

determining a lens color that matches the scene of the augmented reality image;

Adjust the lens in the lens augmented reality device according to the lens color.

The augmented reality device also includes: peripheral interface 703, RF (Radio Frequency, radio frequency) circuit 705, audio circuit 706, speaker 711, power management chip 708, input/output (I/O) subsystem 709, other input/ Control device 710, touch screen 712, other input/control devices 710, and external ports 704, these components communicate through one or more communication buses or signal lines 707.

It should be understood that the illustrated augmented reality device 700 is only one example of an augmented reality device, and that the augmented reality device 700 may have more or fewer components than shown in the figures, and two or more may be combined. components, or may have different component configurations. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The following is a detailed description of the augmented reality device provided in this embodiment for adjusting the lens color. The augmented reality device takes a mobile phone as an example.

Memory 701. The memory 701 can be accessed by the CPU 702, the peripheral interface 703, etc. The memory 701 can include high-speed random access memory, and can also include non-volatile memory, such as one or more disk storage devices, flash memory devices. , or other volatile solid-state storage devices.

Peripheral interface 703, which can connect the input and output peripherals of the device to the CPU 702 and the memory 701.

I/O subsystem 709, which can connect input and output peripherals on the device, such as touch screen 712 and other input/control devices 710, to peripheral interface 703. I/O subsystem 709 may include a display controller 7091 and one or more input controllers 7092 for controlling other input/control devices 710 . One or more input controllers 7092 receive electrical signals from or send electrical signals to other input/control devices 710 , which may include physical buttons (press buttons, rocker buttons, etc. ), dials, slide switches, joysticks, click wheels. It is worth noting that the input controller 7092 can be connected to any of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.

Touch screen 712. The touch screen 712 is the input interface and output interface between the user's augmented reality device and the user, and displays visual output to the user. The visual output may include graphics, text, icons, videos, etc.

Display controller 7091 in I/O subsystem 709 receives electrical signals from or sends electrical signals to touch screen 712 . The touch screen 712 detects contact on the touch screen, and the display controller 7091 converts the detected contact into an interaction with a user interface object displayed on the touch screen 712, that is, human-computer interaction is realized. The user interface object displayed on the touch screen 712 can be a running The icon of the game, the icon of connecting to the corresponding network, etc. It is worth noting that the device may also include an optical mouse, which is a touch-sensitive surface that does not display visual output, or is an extension of the touch-sensitive surface formed by the touch screen.

The RF circuit 705 is mainly used to establish communication between the mobile phone and the wireless network (i.e., the network side), and realize data reception and transmission between the mobile phone and the wireless network. For example, send and receive text messages, emails, etc. Specifically, the RF circuit 705 receives and sends RF signals, which are also called electromagnetic signals. The RF circuit 705 converts electrical signals into electromagnetic signals or electromagnetic signals into electrical signals, and communicates with communication networks and other devices through the electromagnetic signals. communicate. RF circuitry 705 may include known circuitry for performing these functions, including, but not limited to, antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODECs ( COder-DECoder, codec) chipset, Subscriber Identity Module (Subscriber Identity Module, SIM), etc.

The audio circuit 706 is mainly used to receive audio data from the peripheral interface 703, convert the audio data into electrical signals, and send the electrical signals to the speaker 711.

The speaker 711 is used to restore the voice signal received by the mobile phone from the wireless network through the RF circuit 705 into a sound and play the sound to the user.

The power management chip 708 is used to provide power supply and power management for the hardware connected to the CPU 702, I/O subsystem and peripheral interfaces.

The lens color adjustment device, storage medium and augmented reality device provided in the above embodiments can execute the lens color adjustment method provided in any embodiment of the present application, and have corresponding functional modules and beneficial effects for executing the method. For technical details that are not described in detail in the above embodiments, please refer to the lens color adjustment method provided in any embodiment of this application.

Note that the above are only the preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and may also include more other equivalent embodiments without departing from the concept of the present application, and the present application The scope is determined by the scope of the appended claims.

Claims (10)

1. A lens color adjustment method for use in an augmented reality device, comprising:

determining a scene of a current augmented reality image;

determining a lens color that matches a scene of the augmented reality image;

adjusting a lens in a lens augmented reality device according to the lens color;

the determining a lens color that matches a scene of the augmented reality image includes:

determining a lens color according to the mapping relation between the scene and the color and the scene of the augmented reality image;

the augmented reality image is an image formed by a reality image and a virtual image together, and comprises a real object in a sight range of a target object, a virtual object carried in the virtual image entering the pupil of the target object, and/or a scene of the augmented reality image is determined based on the relative position relationship between the object in the virtual image and the real object.

2. The method of claim 1, wherein the lens is an electrochromic lens.

3. The method of claim 2, wherein adjusting the lens in the lens augmented reality device according to the lens color comprises:

determining a voltage applied to the lens based on the lens color;

the determined voltage is applied to the lens.

4. The method of claim 1, wherein determining the scene of the current augmented reality image comprises:

acquiring a real image and determining a current virtual image;

fusing the reality image and the current virtual image to obtain an augmented reality image;

a scene of the augmented reality image is identified.

5. The method of claim 1, wherein determining the scene of the current augmented reality image comprises:

acquiring a real image and determining a current virtual image;

respectively determining a first scene of a real image and a second scene of the current virtual image;

and determining the scene of the augmented reality image according to the first scene and the second scene.

6. The method of claim 5, wherein determining the scene of the augmented reality image from the first scene and the second scene comprises:

determining a scene of the augmented reality image according to the priorities of the first scene and the second scene; or,

and determining the scene of the augmented reality image corresponding to the combination of the first scene and the second scene according to a preset scene combination table.

7. The method according to claim 1, wherein the method further comprises:

collecting the intensity of ambient light;

and adjusting the light transmittance of a lens in the augmented reality device according to the ambient light intensity.

8. A lens color adjustment device, comprising:

the scene determining module is used for determining the scene of the current augmented reality image;

a lens color determination module for determining a lens color that matches a scene of the augmented reality image;

a lens adjustment module for adjusting a lens in a lens augmented reality device according to the lens color;

the lens color determination module is used for:

determining a lens color according to the mapping relation between the scene and the color and the scene of the augmented reality image;

the augmented reality image is an image formed by a reality image and a virtual image together, and comprises a real object in a sight range of a target object, a virtual object carried in the virtual image entering the pupil of the target object, and/or a scene of the augmented reality image is determined based on the relative position relationship between the object in the virtual image and the real object.

9. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the lens color adjustment method according to any one of claims 1-7.

10. An augmented reality device comprising a memory, a processor and a computer program stored on the memory and executable by the processor, the processor implementing the lens colour adjustment method according to any one of claims 1 to 7 when executing the computer program.