CN117315164B - Optical waveguide holographic display method, device, equipment and storage medium - Google Patents

Abstract

The invention relates to the technical field of image processing, and discloses an optical waveguide holographic display method, an optical waveguide holographic display device, optical waveguide holographic display equipment and a storage medium, which are used for improving the optical waveguide holographic display accuracy. Comprising the following steps: acquiring preset three-dimensional image data, and performing coding processing on the three-dimensional image data to obtain diffraction fringe distribution data corresponding to the three-dimensional image data; position transmission is carried out on diffraction fringe distribution data through a preset optical waveguide device, so that corresponding optical waveguide projection data are obtained; constructing image stereo information of the optical waveguide projection data to obtain the image stereo information of the optical waveguide projection data; and carrying out holographic image construction on the optical waveguide projection data based on the image stereo information to obtain a corresponding target holographic image, and transmitting the corresponding target holographic image to a preset image display terminal.

Description

Optical waveguide holographic display method, device, equipment and storage medium

Technical field

The present invention relates to the technical field of image processing, and in particular to an optical waveguide holographic display method, device, equipment and storage medium.

Background technique

With the continuous advancement of technology and people's growing demand for more realistic and immersive visual experiences, holographic imaging technology is becoming increasingly important in fields such as virtual reality, medical imaging, distance education, and entertainment. The above technology covers a series of steps, including the acquisition and encoding of three-dimensional image data, the processing of diffraction fringe distribution data, optical waveguide transmission, image stereoscopic information construction, and the generation and transmission of holographic images. The acquisition of 3D image data can involve the use of laser scanning, cameras, depth sensors, and other devices to capture 3D information in the real world. Encoding and processing this data helps reduce data size and transmission and storage costs. The use of optical waveguide technology can help effectively transmit diffraction fringe distribution data, thereby achieving high-quality holographic image display. These technologies provide a more realistic experience in virtual reality applications, help visualize anatomical structures in the medical field, and provide more vivid communication methods in education and remote conferencing.

Although the above technologies have made significant progress in providing immersive experience and high-quality image display, there are still some shortcomings: processing three-dimensional image data, depth information, and holographic image construction requires a large amount of computing resources and algorithm support. This has high requirements on hardware and software, limiting the wide application of the technology. High-resolution holographic images require large amounts of data transmission and storage space. High-bandwidth communication is required for transmission and large-capacity storage devices are required for storage, which increases costs. Some applications require real-time image generation and transmission, which places higher demands on the performance of the technology. Latency can degrade user experience, especially in virtual reality and augmented reality applications.

Contents of the invention

The invention provides an optical waveguide holographic display method, device, equipment and storage medium, which are used to improve the accuracy of optical waveguide holographic display.

A first aspect of the present invention provides an optical waveguide holographic display method. The optical waveguide holographic display method includes:

Obtain preset three-dimensional image data, and perform encoding processing on the three-dimensional image data to obtain diffraction fringe distribution data corresponding to the three-dimensional image data;

Positionally transmit the diffraction fringe distribution data through a preset optical waveguide device to obtain corresponding optical waveguide projection data;

Construct image stereoscopic information on the optical waveguide projection data to obtain image stereoscopic information of the optical waveguide projection data;

Based on the image stereoscopic information, a holographic image is constructed on the optical waveguide projection data to obtain a corresponding target holographic image and transmit it to a preset image display terminal.

In conjunction with the first aspect, in a first implementation manner of the first aspect of the present invention, preset three-dimensional image data is obtained, and the three-dimensional image data is encoded to obtain a diffraction fringe distribution corresponding to the three-dimensional image data. Data, including:

Obtain the three-dimensional image data, perform viewpoint extraction on the three-dimensional image data, and obtain multiple viewpoint information of the three-dimensional image data;

Based on the plurality of viewpoint information, perform coordinate system correction on the three-dimensional image data to obtain corrected three-dimensional image data;

Perform data alignment processing on the corrected three-dimensional image data to obtain aligned three-dimensional image data;

The aligned three-dimensional image data is encoded to obtain the diffraction fringe distribution data.

With reference to the first implementation of the first aspect, in the second implementation of the first aspect of the present invention, the encoding process on the aligned three-dimensional image data to obtain the diffraction fringe distribution data includes:

Extract depth information from the aligned three-dimensional image data to obtain a depth information set;

Perform phase data analysis on the depth information set to obtain a corresponding phase data set;

Perform object target detection on the aligned three-dimensional image data to obtain at least one target object;

Perform brightness analysis on at least one target object to obtain brightness data;

Based on the brightness data, perform amplitude data analysis on at least one of the target objects to obtain a corresponding amplitude data set;

Perform data merging on the phase data set and the amplitude data set to obtain corresponding merged data;

Perform data conversion on the merged data to obtain the diffraction fringe distribution data.

In conjunction with the first aspect, in a third embodiment of the first aspect of the present invention, the position transmission of the diffraction fringe distribution data through a preset optical waveguide device is performed to obtain corresponding optical waveguide projection data, including:

Perform transmission path analysis on the diffraction fringe distribution data through the optical waveguide device to obtain an initial transmission path;

Perform path data correction on the initial transmission path to obtain the target transmission path;

Based on the target transmission path and the diffraction fringe distribution data, transmit a preset optical signal to the optical waveguide device for position transmission;

The optical signal data after position transmission is collected through a preset optical sensor, and the optical signal data is analyzed to obtain the optical waveguide projection data.

In conjunction with the first aspect, in a fourth embodiment of the first aspect of the present invention, the construction of image stereoscopic information on the optical waveguide projection data to obtain the image stereoscopic information of the optical waveguide projection data includes:

Perform image depth calculation on the optical waveguide projection data to obtain pixel depth data corresponding to the optical waveguide projection data;

Perform pixel pair matching on the optical waveguide projection data using the pixel depth data to obtain multiple target pixel pairs;

Perform disparity value calculation on each target pixel pair to obtain multiple disparity values;

Generate a disparity map on the optical waveguide projection data using a plurality of the disparity values to obtain a corresponding target disparity map set;

The target disparity atlas is depth back-projected through a preset stereo vision algorithm to obtain the image stereo information of the optical waveguide projection data.

In conjunction with the first aspect, in a fifth embodiment of the first aspect of the present invention, the target disparity atlas is depth back-projected through a preset stereo vision algorithm to obtain image stereo information of the optical waveguide projection data ,include:

Use the stereoscopic vision algorithm to perform depth value conversion on each target disparity map in the target disparity map set to obtain the depth value of each target disparity map;

Based on the depth value of each target disparity map, perform binarization processing on each target disparity map to obtain multiple depth binarized maps;

Perform pixel coordinate conversion on each depth binarized image to obtain multiple converted binarized images;

Perform three-dimensional coordinate calculations on a plurality of the converted binarized maps to obtain a three-dimensional coordinate set;

Depth back-projection is performed on the target disparity atlas based on the three-dimensional coordinate set to obtain image stereoscopic information of the optical waveguide projection data.

In conjunction with the first aspect, in a sixth embodiment of the first aspect of the present invention, the optical waveguide projection data is constructed with a holographic image based on the image stereoscopic information, and a corresponding target holographic image is obtained and transmitted to a preset Image display terminal, including:

Perform reflected light field analysis on the three-dimensional information of the image to obtain the corresponding target reflected light field;

Based on the target reflected light field, perform left-eye image segmentation on the optical waveguide projection data to obtain a corresponding left-eye image set and a right-eye image set;

Perform holographic image construction on the left eye image set and the right eye image set to obtain the target holographic image;

Perform data encoding on the target holographic image to obtain encoded image data;

Perform transmission channel matching on the encoded image data to obtain multiple data transmission channels;

Based on the plurality of data transmission channels, a holographic image is constructed on the encoded image data to obtain the target holographic image and transmit it to the image display terminal.

A second aspect of the present invention provides an optical waveguide holographic display device. The optical waveguide holographic display device includes:

An acquisition module is used to acquire preset three-dimensional image data, encode the three-dimensional image data, and obtain diffraction fringe distribution data corresponding to the three-dimensional image data;

A transmission module, used to positionally transmit the diffraction fringe distribution data through a preset optical waveguide device to obtain corresponding optical waveguide projection data;

The first building module is used to construct image stereoscopic information on the optical waveguide projection data to obtain the image stereoscopic information of the optical waveguide projection data;

The second building module is used to construct a holographic image on the optical waveguide projection data based on the image stereoscopic information, obtain the corresponding target holographic image and transmit it to a preset image display terminal.

A third aspect of the present invention provides an optical waveguide holographic display device, including: a memory and at least one processor, with instructions stored in the memory; and the at least one processor calls the instructions in the memory, so that The optical waveguide holographic display device performs the above-mentioned optical waveguide holographic display method.

A fourth aspect of the present invention provides a computer-readable storage medium. Instructions are stored in the computer-readable storage medium. When run on a computer, the computer is caused to execute the above optical waveguide holographic display method.

In the technical solution provided by the present invention, preset three-dimensional image data is obtained, and the three-dimensional image data is encoded to obtain diffraction fringe distribution data corresponding to the three-dimensional image data; the diffraction fringe distribution data is positioned through a preset optical waveguide device. Transmit and obtain the corresponding optical waveguide projection data; construct the image stereoscopic information of the optical waveguide projection data to obtain the image stereoscopic information of the optical waveguide projection data; construct the holographic image of the optical waveguide projection data based on the image stereoscopic information to obtain the corresponding target hologram images and transmit them to the preset image display terminal. In this application solution, high-quality holographic image display can be achieved by acquiring three-dimensional image data and diffraction fringe distribution data, and then combining optical waveguide technology for position transmission. Such displays can present high resolution, depth and three-dimensional effects, providing viewers with a more immersive visual experience. Encoding 3D image data helps compress and optimize the data, thereby reducing transmission and storage overhead. This increases efficiency and reduces resource costs.

Description of drawings

Figure 1 is a schematic diagram of an embodiment of an optical waveguide holographic display method in an embodiment of the present invention;

Figure 2 is a flow chart for encoding aligned three-dimensional image data in an embodiment of the present invention;

Figure 3 is a flow chart of position transmission of diffraction fringe distribution data through a preset optical waveguide device in an embodiment of the present invention;

Figure 4 is a flow chart for constructing image stereoscopic information on optical waveguide projection data in an embodiment of the present invention;

Figure 5 is a schematic diagram of an embodiment of an optical waveguide holographic display device in an embodiment of the present invention;

Figure 6 is a schematic diagram of an embodiment of an optical waveguide holographic display device in an embodiment of the present invention.

Detailed ways

Embodiments of the present invention provide an optical waveguide holographic display method, device, equipment and storage medium for improving the accuracy of optical waveguide holographic display.

The terms "first", "second", "third", "fourth", etc. (if present) in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects without necessarily using Used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments described herein can be practiced in sequences other than those illustrated or described herein. In addition, the terms "comprising" or "having" and any variations thereof are intended to cover non-exclusive inclusions, e.g., processes, methods, systems, products, or devices that comprise a series of steps or units and are not necessarily limited to those expressly listed. steps or units, but may include other steps or units not expressly listed or inherent to such processes, methods, products or apparatuses.

For ease of understanding, the specific process of the embodiment of the present invention is described below. Please refer to Figure 1. One embodiment of the optical waveguide holographic display method in the embodiment of the present invention includes:

S101. Obtain preset three-dimensional image data, encode the three-dimensional image data, and obtain diffraction fringe distribution data corresponding to the three-dimensional image data;

It can be understood that the execution subject of the present invention can be an optical waveguide holographic display device, or a terminal or a server, and the details are not limited here. The embodiment of the present invention is explained by taking the server as the execution subject as an example.

Specifically, three-dimensional image data is obtained. This data can come from different sources such as 3D scans, computer-generated models or other 3D imaging techniques. This data contains three-dimensional information about the object, but often requires further processing for use in holographic displays. Perform viewpoint extraction. Extract multiple viewpoint information from three-dimensional image data. Viewpoints can be understood as different angles and positions from which objects are observed. By extracting multiple viewpoint information from three-dimensional data, the server simulates the effect of observing objects from different angles. Based on multiple viewpoint information, coordinate system correction is performed. This is to ensure consistency and accuracy across viewpoints. The process of coordinate system correction involves aligning data from different viewpoints so that they can be correctly superimposed in the holographic image, creating a complete three-dimensional effect. This can be achieved through mathematical transformations and coordinate system adjustments. Perform data alignment processing. Once the viewpoint information is corrected, this information needs to be aligned to obtain a consistent three-dimensional representation. This involves handling the overlap and fusion of data between different viewpoints to ensure there are no inconsistent or discordant elements in the final holographic image. Carry out encoding processing. The aligned three-dimensional image data is encoded to generate diffraction fringe distribution data. This is a core part of a holographic display, where three-dimensional information is encoded to create diffraction patterns that will be used in an optical waveguide device to form the final holographic image.

Among them, the server extracts depth information from the aligned three-dimensional image data. Obtain information related to the depth of each pixel to obtain a depth information set. Depth information is key to three-dimensional scenes because it determines the distance relationships between different objects and elements. Perform phase data analysis. By analyzing the depth information, the server calculates the phase information of each pixel, which will be used in the subsequent encoding process. Phase data is a key component of optical waveguide holographic displays. It determines the optical path difference of the image, thereby affecting the interference and diffraction effects of light. At the same time, object detection is performed. In a three-dimensional image, there are multiple target objects, such as people, buildings or other objects. The task of object detection is to determine the target objects present in the image and extract relevant information. This can be achieved through computer vision technology and deep learning algorithms. Next is brightness analysis. Luminance analysis of detected target objects is performed to determine their brightness or brightness distribution in the image. This helps identify bright and dark parts of the target object, information that will be used in subsequent amplitude data analysis. Based on the brightness data, amplitude data analysis is performed. Calculate the amplitude information of target objects, that is, their light and dark changes. The amplitude data reflects the reflection or transmission properties of the object surface, which is crucial for optical waveguide holographic displays. Perform data merging. Phase data and amplitude data are merged together to generate corresponding merged data. This combined data contains phase and amplitude information about the object, providing the necessary data for the creation of the final holographic image. Perform data conversion. Perform the necessary mathematical and computational operations on the merged data to generate diffraction fringe distribution data. This data will be used to generate holographic images, which will be projected into the viewer's eyes through optical waveguide technology to present a realistic three-dimensional effect.

S102. Positionally transmit the diffraction fringe distribution data through the preset optical waveguide device to obtain the corresponding optical waveguide projection data;

Specifically, the transmission path analysis of the diffraction fringe distribution data is performed through the optical waveguide device. This is to determine how to transmit diffraction fringe distribution data to an optical waveguide device. Transmission path analysis takes into account the geometry, material, and light transmission characteristics of the optical waveguide device to ensure that data is transmitted optimally. Perform path data correction on the initial transmission path. The initial transmission path needs to be fine-tuned based on the actual conditions and needs of the optical waveguide device. This includes adjusting transmission angle, incidence position, or other parameters to ensure data can effectively enter the optical waveguide device. Based on the target transmission path and diffraction fringe distribution data, the preset optical signal is transmitted to the optical waveguide device for position transmission. This is a critical step in getting data into optical waveguide devices. Optical signals are generated by lasers or other light sources and directed along targeted transmission paths for interaction with optical waveguide devices. Subsequently, the optical signal data after position transmission is collected through a preset optical sensor. This sensor can be a camera, light detector, or other optical device that captures the behavior and changes of data within the optical waveguide device. The optical signal data is analyzed to obtain optical waveguide projection data. This analysis process involves interpreting light signals reflected, refracted or transmitted back from the optical waveguide device to restore the final holographic image or projection data. For example, assume that a three-dimensional rotating cube is displayed on an optical waveguide holographic display device. The server performs transmission path analysis to determine how to transmit the diffraction fringe distribution data to the optical waveguide device, taking into account the shape and characteristics of the optical waveguide device. The server adjusts the initial transmission path to ensure that the data enters the optical waveguide device in the best possible way. The server generates a preset optical signal, such as a laser beam, and directs it to the optical waveguide device according to the target transmission path. This optical signal interacts with the diffraction fringe distribution data, producing interference and refraction effects. Using pre-installed optical sensors, the server captures the changes in optical signals that occur within the optical waveguide device. This includes the interference patterns and refraction effects of light after passing through the optical waveguide device. By analyzing the light signal data, the server restores the light waveguide projection data, which will be used to generate the final holographic image, and the audience can view the rotating three-dimensional cube on the light waveguide device. This process ensures the accurate transmission and final presentation of data.

S103. Construct image stereoscopic information on the optical waveguide projection data to obtain the image stereoscopic information of the optical waveguide projection data;

Specifically, image depth calculation is performed on the optical waveguide projection data. Calculate the depth or distance information of each pixel in the scene. Depth data is used to determine the distance relationship between different pixels, which helps create a three-dimensional feel to the image. Pixel pair matching via pixel depth data. The purpose is to find corresponding pixel pairs in different viewpoints, that is, the positions of the same pixels in different viewpoints. Pixel pair matching is to establish a connection between different viewpoints to achieve a three-dimensional effect. Subsequently, the disparity value is calculated for each target pixel pair. Parallax refers to the difference in pixel positions between different viewpoints. The disparity value is calculated to determine the disparity between different pairs of pixels, that is, their offset between different viewpoints. Generate a disparity map through multiple disparity values. This is the process of visualizing disparity information, which typically produces an image called a "disparity map" where each pixel represents the disparity value between different viewpoints. Disparity maps are an important tool in stereovision for simulating the perception of depth. Depth backprojection of the target disparity atlas via a preset stereo vision algorithm. Depth backprojection is the process of converting disparity information back to three-dimensional depth information, that is, mapping the disparity value of a pixel back to depth or distance. In this way, the server obtains the image stereoscopic information of the optical waveguide projection data, enabling the server to present realistic three-dimensional effects. For example, assuming that a three-dimensional image of a person needs to be displayed, the server first obtains the optical waveguide projection data. The server calculates the depth of each pixel to understand how far away different parts of the character are. Pixel pair matching is performed to find pairs of pixels that correspond in different viewpoints, for example, the same pixels in the left and right eye viewpoints. Calculate the disparity between each pair of pixels, i.e. the offset between them. Through multiple disparity values, a disparity map is generated, which shows the depth information of different pixels. Depth back-projection is performed through a stereoscopic vision algorithm to convert parallax information into three-dimensional depth information, thereby creating image stereoscopic information of the character, allowing the audience to see a stereoscopic image with a sense of depth. This process provides a realistic three-dimensional effect to the holographic display.

Among them, the depth value of each target disparity map in the target disparity map set is converted through a stereoscopic vision algorithm. The purpose is to convert disparity information into actual depth values. The pixels in each target disparity map represent the disparity between different viewpoints, and the algorithm converts these disparity values into depth values, that is, the distance from the pixel to the object surface. Each target disparity map is binarized based on its depth value. Based on the threshold of the depth value, pixels are classified as foreground or background, forming a depth binarized map. This step helps determine the contours and boundaries of objects in the image. Perform pixel coordinate conversion on each depth binarized image. This is the process of mapping binary information onto pixel coordinates to determine the pixel positions of the foreground and background. This helps map depth information onto the image for subsequent calculations. Perform three-dimensional coordinate calculations on multiple transformed binarized images. Through the stereo vision algorithm, the pixel positions of the foreground and background are converted into the three-dimensional coordinates of the object. This step maps each pixel to a coordinate in three-dimensional space, thus forming a three-dimensional coordinate set. Based on the obtained three-dimensional coordinate set, the target disparity atlas is depth back-projected. The process of depth back-projection is to back-project the three-dimensional coordinate information back to the original optical waveguide projection data to restore the three-dimensional information of the image. This step enables viewers to see images with a sense of depth on the optical waveguide holographic display device.

S104. Construct a holographic image based on the image stereoscopic information on the optical waveguide projection data, obtain the corresponding target holographic image and transmit it to the preset image display terminal.

Specifically, reflected light field analysis is performed. This is to understand the behavior of light waveguide projection data when reflected at the observer's eye for further processing. Reflected light field analysis helps determine how light waveguide projection data interacts with the observer's eye. Based on the target reflected light field, the left and right eye image segmentation is performed on the optical waveguide projection data. The optical waveguide projection data is divided into two parts, namely the left eye image and the right eye image. This is to create a view suitable for stereoscopic vision, so that the left and right eyes see different images, creating a sense of depth. Holographic image construction is performed on the left eye image set and the right eye image set. The collection of images for the left and right eyes will be merged into a single holographic image. The process involves creating diffraction patterns on light waveguide devices that correspond to left and right eye images so that viewers can see a realistic three-dimensional effect. Subsequently, the target holographic image is data encoded. Encoding is to convert the holographic image into a data format suitable for transmission so that it can be used in subsequent transmission stages. Perform transmission channel matching on encoded image data. Choose an appropriate transmission channel to ensure that the target holographic image can be transmitted to the image display terminal for viewing by the audience. Transmission channels may include cables, network connections, or other transmission methods. Based on multiple data transmission channels, the holographic image is constructed from the encoded image data. The scattered data is transmitted to the image display terminal, and the target holographic image is constructed again, so that the audience can watch the realistic three-dimensional holographic image on the image display terminal.

In the embodiment of the present invention, preset three-dimensional image data is obtained, and the three-dimensional image data is encoded to obtain diffraction fringe distribution data corresponding to the three-dimensional image data; the diffraction fringe distribution data is positionally transmitted through the preset optical waveguide device, Obtain the corresponding optical waveguide projection data; construct the image stereoscopic information of the optical waveguide projection data to obtain the image stereoscopic information of the optical waveguide projection data; construct the holographic image of the optical waveguide projection data based on the image stereoscopic information to obtain the corresponding target holographic image and Transmit to the preset image display terminal. In this application solution, high-quality holographic image display can be achieved by acquiring three-dimensional image data and diffraction fringe distribution data, and then combining optical waveguide technology for position transmission. Such displays can present high resolution, depth and three-dimensional effects, providing viewers with a more immersive visual experience. Encoding 3D image data helps compress and optimize the data, thereby reducing transmission and storage overhead. This increases efficiency and reduces resource costs.

In a specific embodiment, the process of executing step S101 may specifically include the following steps:

(1) Obtain three-dimensional image data, perform viewpoint extraction on the three-dimensional image data, and obtain multiple viewpoint information of the three-dimensional image data;

(2) Based on multiple viewpoint information, perform coordinate system correction on the three-dimensional image data to obtain corrected three-dimensional image data;

(3) Perform data alignment processing on the corrected three-dimensional image data to obtain aligned three-dimensional image data;

(4) Encode the aligned three-dimensional image data to obtain diffraction fringe distribution data.

Specifically, the server obtains three-dimensional image data. This involves using a 3D scanner, stereo camera, depth sensor or other 3D imaging technology to capture 3D information of the target scene. This process generates raw 3D image data, which contains depth and shape information of the scene. Perform viewpoint extraction. Multiple viewpoint information is extracted from the original three-dimensional image data, each viewpoint corresponding to a different viewing angle or position. This viewpoint information will be used for subsequent processing to obtain scene information from multiple perspectives. Based on multiple viewpoint information, coordinate system correction is performed on the three-dimensional image data. Because each viewpoint has a different coordinate system, calibration is a critical step to ensure that they are aligned in the same coordinate system. This ensures that information from different viewpoints can be correctly merged in subsequent processing. Subsequently, the corrected three-dimensional image data is subjected to data alignment processing. The purpose is to align data from different viewpoints to ensure that they are consistent at the same spatial location. Data alignment can involve transformations such as translation, rotation, and scaling to achieve consistency between viewpoints. The aligned three-dimensional image data is encoded to generate diffraction fringe distribution data. Encoding can employ various techniques, such as optical encoding or digital encoding, to convert the three-dimensional information into a diffraction fringe distribution, which is the input data required for subsequent optical waveguide holographic display.

In a specific embodiment, as shown in Figure 2, the process of performing the encoding processing step on the aligned three-dimensional image data may specifically include the following steps:

S201. Extract depth information from the aligned three-dimensional image data to obtain a depth information set;

S202. Perform phase data analysis on the depth information set to obtain the corresponding phase data set;

S203. Perform object target detection on the aligned three-dimensional image data to obtain at least one target object;

S204. Perform brightness analysis on at least one target object to obtain brightness data;

S205. Based on the brightness data, perform amplitude data analysis on at least one target object to obtain a corresponding amplitude data set;

S206. Merge the phase data set and the amplitude data set to obtain corresponding merged data;

S207. Perform data conversion on the merged data to obtain diffraction fringe distribution data.

Specifically, depth information is extracted from the aligned three-dimensional image data. The purpose is to extract the depth information of objects from the image, that is, the distance between different objects or parts of objects. Depth information can be obtained by calculating disparity or other depth perception techniques. This will generate a collection of depth information containing depth values at different points. Phase data analysis is performed on a collection of depth information. There is a correlation between phase data and depth information, usually obtained by converting depth information into phase information of light waves. The phase data set contains the phase information of each point and can be used for subsequent processing. At the same time, object detection is performed on the aligned three-dimensional image data. This step aims to identify different objects or parts of objects in the image in order to analyze their depth and shape information. Object target detection can use computer vision techniques such as object segmentation and contour detection. Subsequently, a brightness analysis is performed on at least one target object. Luminance data represents the brightness or light intensity of an object, which is recorded by an optical waveguide device. Luminance data helps understand an object's surface properties, including reflection and transmission. Based on the brightness data, amplitude data analysis is performed on at least one target object. Amplitude data reflects the amplitude changes of light waves, which plays a key role in the construction of holographic images. Amplitude data sets contain amplitude information at different points to describe the fluctuations of light waves. Perform data merging on phase data sets and amplitude data sets. Depth, phase and amplitude information are combined to build a complete model of the object. Data merging helps integrate information from all aspects to ultimately build a holographic image. Data transformation was performed on the merged data to obtain diffraction fringe distribution data. Diffraction fringe distribution data are used to create holographic images, which include phase and amplitude information of light waves, as well as depth information. The conversion of this data combines all the information to meet the requirements of optical waveguide holographic display, thereby presenting a realistic three-dimensional holographic image on the optical waveguide device.

In a specific embodiment, as shown in Figure 3, the process of executing step S102 may specifically include the following steps:

S301. Perform transmission path analysis on the diffraction fringe distribution data through the optical waveguide device to obtain the initial transmission path;

S302. Perform path data correction on the initial transmission path to obtain the target transmission path;

S303. Based on the target transmission path and diffraction fringe distribution data, transmit the preset optical signal to the optical waveguide device for position transmission;

S304. Collect the optical signal data after position transmission through the preset optical sensor, analyze the optical signal data, and obtain the optical waveguide projection data.

Specifically, transmission path analysis is performed to determine the initial transmission path on the optical waveguide device so that the diffraction fringe distribution data can be transmitted to an appropriate location. Transmission path analysis takes into account the characteristics of the optical waveguide, diffraction patterns, and target location to ensure that data can be transmitted correctly. Perform path data correction on the initial transmission path. The correction process involves computer simulations or actual adjustments to the optical waveguide device to ensure that the path through which the data travels accurately matches the target location. Path data modifications may involve fine-tuning the angle, position or shape of the optical waveguide element. Based on the target transmission path and diffraction fringe distribution data, the preset optical signal is transmitted to the optical waveguide device for position transmission. The optical signal is injected into the optical waveguide device so that the light follows a modified transmission path to transmit diffraction fringe distribution data. The properties and wavelength of the optical signal can be selected based on application requirements. The optical signal data after position transmission is collected through a preset optical sensor. These sensors are located on optical waveguide devices and are used to detect transmitted light wave information. Sensors can detect the amplitude, phase, and other characteristics of light signals. The optical signal data is analyzed to obtain optical waveguide projection data. This step involves processing the data acquired from the optical sensor to restore the original diffraction fringe distribution data, which will be used to construct the holographic image. Analysis includes techniques such as digital signal processing, waveform recovery, and diffraction calculations. For example, suppose you need to render a holographic image of a rotating three-dimensional sphere. Through transmission path analysis, the server determines how the diffraction fringe distribution data should be transmitted to the location of the sphere. Through path data correction, the server fine-tunes the angle and position of the optical waveguide device to ensure that data can be transmitted to the correct location on the sphere. The server sends preset light signals for location transmission. These optical signals are injected into the optical waveguide device and then follow a modified transmission path to the location of the sphere. The optical sensor is located on the device and collects the transmitted optical signal data, including amplitude and phase information. By analyzing the light signal data, the server is able to restore the diffraction fringe distribution data, which will be used to construct the holographic image. Through mathematics and computing technology, the server can reconstruct the holographic image of the three-dimensional sphere, allowing the audience to see the rotating sphere on the optical waveguide holographic display device, presenting a realistic holographic image effect. The entire process ensures the transmission and final presentation of data to achieve the desired holographic display.

In a specific embodiment, as shown in Figure 4, the process of executing step S103 may specifically include the following steps:

S401. Perform image depth calculation on the optical waveguide projection data to obtain pixel depth data corresponding to the optical waveguide projection data;

S402. Perform pixel pair matching on the optical waveguide projection data through pixel depth data to obtain multiple target pixel pairs;

S403. Calculate the disparity value for each target pixel pair to obtain multiple disparity values;

S404. Generate a disparity map on the optical waveguide projection data through multiple disparity values to obtain the corresponding target disparity atlas;

S405. Perform depth back-projection on the target disparity atlas through a preset stereo vision algorithm to obtain image stereo information of the optical waveguide projection data.

Specifically, image depth calculation is performed on the optical waveguide projection data. The goal is to determine the depth information for each pixel in the optical waveguide projection data. Depth can be calculated based on the position of the pixel on the optical waveguide device and other parameters. Image depth calculation can be performed using camera parameters and calibration techniques, etc. Pixel pair matching is performed on optical waveguide projection data via pixel depth data. For each pixel in the light guide projection data, find its corresponding pixel in the depth information to ensure that they match in depth. Pixel pair matching can be achieved by pixel coordinates or other specific identifiers. Subsequently, the disparity value is calculated for each target pixel pair. The disparity value refers to the difference in position of the same pixel under two different viewpoints. Depth information can be learned by calculating the disparity value of each pixel pair. Parallax values are often used to represent the depth of an object, depending on the principles of stereoscopic vision. Disparity map generation is performed on optical waveguide projection data using multiple disparity values. A disparity map is a representation of depth information that shows the disparity values of different pixels. The disparity map is an important tool for constructing stereoscopic information because it provides depth information at different locations in the image. Depth backprojection of the target disparity atlas via a preset stereo vision algorithm. This step involves converting the disparity map into a depth map to restore the stereoscopic information of the image. Stereo vision algorithms can use a variety of techniques, including disparity-depth correlation, triangulation, and stereo vision, to recover depth information from disparity information.

In a specific embodiment, the process of executing step S405 may specifically include the following steps:

(1) Use a stereo vision algorithm to convert the depth value of each target disparity map in the target disparity map set to obtain the depth value of each target disparity map;

(2) Based on the depth value of each target disparity map, perform binarization processing on each target disparity map to obtain multiple depth binarized maps;

(3) Perform pixel coordinate conversion on each depth binarized image to obtain multiple converted binarized images;

(4) Calculate three-dimensional coordinates on multiple converted binary images to obtain a three-dimensional coordinate set;

(5) Perform depth back-projection on the target disparity atlas based on the three-dimensional coordinate set to obtain the image stereo information of the optical waveguide projection data.

Specifically, the depth value of each target disparity map in the target disparity map set is converted through a stereoscopic vision algorithm. The pixel values of each target disparity map will be converted into actual depth values. This is achieved by using known disparity-depth correlations or other depth perception algorithms. The depth value represents the distance of each pixel from the viewer. Each target disparity map is binarized based on its depth value. The depth value will be converted to binary form to generate a depth binarized map. This step helps represent the depth information in a more manageable way for subsequent calculations. Subsequently, pixel coordinate transformation is performed on each depth binarized map. Convert pixel depth information into three-dimensional coordinates to determine the location of the object. Pixel coordinate transformation can be implemented using known camera parameters and depth information. Perform three-dimensional coordinate calculations on multiple transformed binarized images. Three-dimensional coordinates will be calculated based on pixel coordinates and depth information. This will produce a set of three-dimensional coordinates representing the location of points on the object's surface. Depth backprojection of the target disparity atlas based on a set of three-dimensional coordinates. Depth backprojection is the process of reprojecting three-dimensional information onto the image plane to obtain the three-dimensional information of the image. The three-dimensional coordinate set is combined with the target disparity atlas to restore the stereoscopic information of the image.

In a specific embodiment, the process of executing step S104 may specifically include the following steps:

(1) Analyze the reflected light field on the three-dimensional image information to obtain the corresponding target reflected light field;

(2) Based on the target reflected light field, perform left-eye image segmentation on the optical waveguide projection data to obtain the corresponding left-eye image set and right-eye image set;

(3) Construct holographic images on the left eye image set and right eye image set to obtain the target holographic image;

(4) Encode the target holographic image to obtain the encoded image data;

(5) Match the transmission channels of the encoded image data to obtain multiple data transmission channels;

(6) Based on multiple data transmission channels, construct a holographic image on the encoded image data to obtain the target holographic image and transmit it to the image display terminal.

Specifically, the reflected light field analysis is performed on the three-dimensional information of the image. The goal is to analyze the reflected light field on an optical waveguide device to understand how light reflects and propagates on the device. Reflected light field analysis takes into account the characteristics of the optical waveguide, the surface shape, and the properties of the light source to determine the path and properties of the reflected light. Based on the target reflected light field, the left and right eye image segmentation is performed on the optical waveguide projection data. The information in the reflected light field is divided into left-eye and right-eye views for subsequent holographic image construction. Left and right eye image segmentation can be done based on the viewer's viewpoint and eye position. Holographic image construction is performed on the left eye image set and the right eye image set. The views of the left and right eyes are combined into a single holographic image to create a stereoscopic effect. Holographic image construction takes into account factors such as parallax, viewing angle, and light propagation. Subsequently, the target holographic image is data encoded. Encoding is used to reduce the amount of data so that it can be transmitted and stored more efficiently. Coding can include techniques such as compression, data segmentation, and error correction coding. Perform transmission channel matching on encoded image data. Select an appropriate data transmission channel to ensure that the encoded image data can be effectively transmitted to the image display terminal. Transmission channel matching can be determined based on network conditions, transmission media and bandwidth. Based on multiple data transmission channels, the holographic image is constructed from the encoded image data. This step reassembles the scattered encoded data to restore the target holographic image. Multiple data transmission channels help improve the speed and stability of data transmission.

The optical waveguide holographic display method in the embodiment of the present invention is described above. The optical waveguide holographic display device in the embodiment of the present invention is described below. Please refer to Figure 5. An embodiment of the optical waveguide holographic display device in the embodiment of the present invention includes:

The acquisition module 501 is used to acquire preset three-dimensional image data, encode the three-dimensional image data, and obtain diffraction fringe distribution data corresponding to the three-dimensional image data;

The transmission module 502 is used to positionally transmit the diffraction fringe distribution data through a preset optical waveguide device to obtain the corresponding optical waveguide projection data;

The first construction module 503 is used to construct image stereoscopic information on the optical waveguide projection data to obtain the image stereoscopic information of the optical waveguide projection data;

The second construction module 504 is used to construct a holographic image on the optical waveguide projection data based on the image stereoscopic information, obtain the corresponding target holographic image and transmit it to a preset image display terminal.

Through the collaborative cooperation of the above components, the preset three-dimensional image data is obtained, and the three-dimensional image data is encoded and processed to obtain the diffraction fringe distribution data corresponding to the three-dimensional image data; the diffraction fringe distribution data is processed through the preset optical waveguide device. position transmission to obtain the corresponding optical waveguide projection data; construct the image stereoscopic information of the optical waveguide projection data to obtain the image stereoscopic information of the optical waveguide projection data; construct the holographic image of the optical waveguide projection data based on the image stereoscopic information to obtain the corresponding target The holographic image is transmitted to the preset image display terminal. In this application solution, high-quality holographic image display can be achieved by acquiring three-dimensional image data and diffraction fringe distribution data, and then combining optical waveguide technology for position transmission. Such displays can present high resolution, depth and three-dimensional effects, providing viewers with a more immersive visual experience. Encoding 3D image data helps compress and optimize the data, thereby reducing transmission and storage overhead. This increases efficiency and reduces resource costs.

Figure 5 above describes the optical waveguide holographic display device in the embodiment of the present invention in detail from the perspective of modular functional entities. The following describes the optical waveguide holographic display device in the embodiment of the present invention in detail from the perspective of hardware processing.

FIG. 6 is a schematic structural diagram of an optical waveguide holographic display device provided by an embodiment of the present invention. The optical waveguide holographic display device 600 may vary greatly due to different configurations or performance, and may include one or more processors (central processing units). , CPU) 610 (eg, one or more processors) and memory 620, one or more storage media 630 (eg, one or more mass storage devices) that stores applications 633 or data 632. Among them, the memory 620 and the storage medium 630 may be short-term storage or persistent storage. The program stored in the storage medium 630 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the optical waveguide holographic display device 600 . Furthermore, the processor 610 may be configured to communicate with the storage medium 630 and execute a series of instruction operations in the storage medium 630 on the optical waveguide holographic display device 600 .

The optical waveguide holographic display device 600 may also include one or more power supplies 640, one or more wired or wireless network interfaces 650, one or more input and output interfaces 660, and/or one or more operating systems 631, such as WindowsServe , MacOSX, Unix, Linux, FreeBSD and more. Those skilled in the art can understand that the structure of the optical waveguide holographic display device shown in Figure 6 does not constitute a limitation on the optical waveguide holographic display device. It may include more or fewer components than shown in the figure, or combine certain components, or Different component arrangements.

The present invention also provides an optical waveguide holographic display device. The optical waveguide holographic display device includes a memory and a processor. Computer readable instructions are stored in the memory. When the computer readable instructions are executed by the processor, the processor executes the above steps. The steps of the optical waveguide holographic display method in the embodiment.

The present invention also provides a computer-readable storage medium. The computer-readable storage medium can be a non-volatile computer-readable storage medium. The computer-readable storage medium can also be a volatile computer-readable storage medium. Instructions are stored in the computer-readable storage medium, and when the instructions are run on the computer, they cause the computer to execute the steps of the optical waveguide holographic display method.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

The integrated unit, if implemented in the form of a software functional unit and sold or passed as an independent product, may be stored in a computer-readable storage medium. Based on the understanding, the technical solution of the present invention is essentially or contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, It includes several instructions to cause a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code.

As mentioned above, the above embodiments are only used to illustrate the technical solution of the present invention, but not to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the foregoing. The technical solutions described in each embodiment may be modified, or some of the technical features may be equivalently replaced; however, these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of each embodiment of the present invention.

Claims (6)

1. An optical waveguide holographic display method, characterized in that the optical waveguide holographic display method includes: Obtain preset three-dimensional image data, and perform encoding processing on the three-dimensional image data to obtain diffraction fringe distribution data corresponding to the three-dimensional image data; specifically including: obtaining the three-dimensional image data, and performing viewpoint analysis on the three-dimensional image data. Extract and obtain multiple viewpoint information of the three-dimensional image data; perform coordinate system correction on the three-dimensional image data based on the plurality of viewpoint information to obtain corrected three-dimensional image data; perform data alignment processing on the corrected three-dimensional image data , obtain aligned three-dimensional image data; perform encoding processing on the aligned three-dimensional image data to obtain the diffraction fringe distribution data; wherein obtaining the diffraction fringe distribution data includes: extracting depth information from the aligned three-dimensional image data, Obtain a depth information set; perform phase data analysis on the depth information set to obtain a corresponding phase data set; perform object target detection on the aligned three-dimensional image data to obtain at least one target object; perform brightness analysis on at least one target object, Obtain brightness data; perform amplitude data analysis on at least one of the target objects based on the brightness data to obtain a corresponding amplitude data set; perform data merging on the phase data set and the amplitude data set to obtain the corresponding merged data ; Perform data conversion on the merged data to obtain the diffraction fringe distribution data; Positionally transmit the diffraction fringe distribution data through a preset optical waveguide device to obtain corresponding optical waveguide projection data; Constructing image stereoscopic information on the optical waveguide projection data to obtain image stereoscopic information of the optical waveguide projection data; specifically including: performing image depth calculation on the optical waveguide projection data to obtain pixels corresponding to the optical waveguide projection data Depth data; performing pixel pair matching on the optical waveguide projection data through the pixel depth data to obtain multiple target pixel pairs; performing disparity value calculation on each of the target pixel pairs to obtain multiple disparity values; by Use multiple parallax values to generate a parallax map on the optical waveguide projection data to obtain a corresponding target parallax atlas; perform depth back-projection on the target parallax atlas through a preset stereoscopic vision algorithm to obtain the optical waveguide projection data. Image stereoscopic information of the waveguide projection data; wherein, obtaining the image stereoscopic information of the optical waveguide projection data includes: performing depth value conversion on each target disparity map in the target disparity map set through the stereoscopic vision algorithm to obtain each The depth value of the target disparity map; based on the depth value of each target disparity map, perform binarization processing on each target disparity map to obtain multiple depth binarized maps; perform binary processing on each depth Perform pixel coordinate conversion on the transformed image to obtain a plurality of converted binary images; perform three-dimensional coordinate calculation on the multiple converted binary images to obtain a three-dimensional coordinate set; perform a calculation on the target disparity atlas based on the three-dimensional coordinate set Depth back-projection to obtain image stereoscopic information of the optical waveguide projection data; Based on the image stereoscopic information, a holographic image is constructed on the optical waveguide projection data to obtain a corresponding target holographic image and transmit it to a preset image display terminal. 2. The optical waveguide holographic display method according to claim 1, characterized in that the position transmission of the diffraction fringe distribution data through a preset optical waveguide device is performed to obtain corresponding optical waveguide projection data, including: Perform transmission path analysis on the diffraction fringe distribution data through the optical waveguide device to obtain an initial transmission path; Perform path data correction on the initial transmission path to obtain the target transmission path; Based on the target transmission path and the diffraction fringe distribution data, transmit a preset optical signal to the optical waveguide device for position transmission; The optical signal data after position transmission is collected through a preset optical sensor, and the optical signal data is analyzed to obtain the optical waveguide projection data. 3. The optical waveguide holographic display method according to claim 1, characterized in that the holographic image construction is performed on the optical waveguide projection data based on the image stereoscopic information to obtain the corresponding target holographic image and transmit it to a preset Image display terminals, including: Perform reflected light field analysis on the three-dimensional information of the image to obtain the corresponding target reflected light field; Based on the target reflected light field, perform left-eye image segmentation on the optical waveguide projection data to obtain a corresponding left-eye image set and a right-eye image set; Perform holographic image construction on the left eye image set and the right eye image set to obtain the target holographic image; Perform data encoding on the target holographic image to obtain encoded image data; Perform transmission channel matching on the encoded image data to obtain multiple data transmission channels; Based on the plurality of data transmission channels, a holographic image is constructed on the encoded image data to obtain the target holographic image and transmit it to the image display terminal. 4. An optical waveguide holographic display device, characterized in that the optical waveguide holographic display device includes: An acquisition module is used to acquire preset three-dimensional image data, and perform encoding processing on the three-dimensional image data to obtain diffraction fringe distribution data corresponding to the three-dimensional image data; specifically including: acquiring the three-dimensional image data, and encoding the three-dimensional image data. Perform viewpoint extraction on the three-dimensional image data to obtain multiple viewpoint information of the three-dimensional image data; perform coordinate system correction on the three-dimensional image data based on the plurality of viewpoint information to obtain corrected three-dimensional image data; correct the three-dimensional image data Perform data alignment processing on the data to obtain aligned three-dimensional image data; perform encoding processing on the aligned three-dimensional image data to obtain the diffraction fringe distribution data; wherein obtaining the diffraction fringe distribution data includes: encoding the aligned three-dimensional image data Perform depth information extraction to obtain a depth information set; perform phase data analysis on the depth information set to obtain a corresponding phase data set; perform object target detection on the aligned three-dimensional image data to obtain at least one target object; detect at least one target Perform brightness analysis on the object to obtain brightness data; perform amplitude data analysis on at least one of the target objects based on the brightness data to obtain a corresponding amplitude data set; perform data merging on the phase data set and the amplitude data set, Obtain corresponding merged data; perform data conversion on the merged data to obtain the diffraction fringe distribution data; A transmission module, used to positionally transmit the diffraction fringe distribution data through a preset optical waveguide device to obtain corresponding optical waveguide projection data; The first building module is used to construct image stereoscopic information on the optical waveguide projection data to obtain the image stereoscopic information of the optical waveguide projection data; specifically includes: performing image depth calculation on the optical waveguide projection data to obtain the Pixel depth data corresponding to the optical waveguide projection data; perform pixel pair matching on the optical waveguide projection data through the pixel depth data to obtain multiple target pixel pairs; perform disparity value calculation on each of the target pixel pairs to obtain Multiple parallax values; generate a parallax map on the optical waveguide projection data through multiple parallax values to obtain a corresponding target parallax atlas; perform depth processing on the target parallax atlas through a preset stereo vision algorithm Back-projection is used to obtain the image stereoscopic information of the optical waveguide projection data; wherein, obtaining the image stereoscopic information of the optical waveguide projection data includes: using the stereoscopic vision algorithm to perform an operation on each target disparity map in the target disparity map set. Depth value conversion to obtain the depth value of each target disparity map; based on the depth value of each target disparity map, perform binarization processing on each target disparity map to obtain multiple depth binarized maps ; Perform pixel coordinate conversion on each depth binarized map to obtain multiple converted binarized maps; perform three-dimensional coordinate calculation on multiple converted binarized maps to obtain a three-dimensional coordinate set; based on the three-dimensional coordinate set The target disparity atlas is subjected to depth back-projection to obtain image stereoscopic information of the optical waveguide projection data; The second building module is used to construct a holographic image on the optical waveguide projection data based on the image stereoscopic information, obtain the corresponding target holographic image and transmit it to a preset image display terminal. 5. An optical waveguide holographic display device, characterized in that the optical waveguide holographic display device includes: a memory and at least one processor, and instructions are stored in the memory; The at least one processor calls the instructions in the memory to cause the optical waveguide holographic display device to execute the optical waveguide holographic display method according to any one of claims 1-3. 6. A computer-readable storage medium having instructions stored on the computer-readable storage medium, characterized in that when the instructions are executed by a processor, the optical waveguide according to any one of claims 1-3 is implemented. Holographic display method.