CN106878698A - Method and system for mobile naked-eye three-dimensional virtual reality based on optical path acquisition - Google Patents

Abstract

The present invention relates to a method and system for moving naked-eye three-dimensional virtual reality based on optical path acquisition proposed by the embodiment of the present invention. Wherein, the method may include: collecting an image; obtaining a two-viewpoint synthetic map index map according to the collected image; obtaining a two-viewpoint map according to the position information of acceleration and the rotation information of angular velocity; based on the image-based two-viewpoint synthetic map index map, for The composite image is rendered by rendering the two-viewpoint image, and a three-dimensional virtual reality display image is obtained. Preferably, the step of obtaining the two-viewpoint map may specifically include: determining the influence weight of sub-pixel brightness on the image, and then using the least squares method with a bounding box to determine the composite map index map of the two viewpoints; according to the position information of the acceleration and the angular velocity Rotate the information, adjust the orientation of the acquired image, and obtain a two-viewpoint map. The embodiment of the present invention solves the technical problem of how to realize high-quality naked-eye three-dimensional virtual reality display by adopting the above technical solution.

Description

Method and system for mobile naked-eye three-dimensional virtual reality based on optical path collection

technical field

The invention relates to a three-dimensional display method, in particular to a method and system for moving naked-eye three-dimensional virtual reality based on optical path acquisition.

Background technique

At present, virtual reality has set off a wave in the world, and three-dimensional virtual reality is a relatively new development direction. Virtual reality technology is a comprehensive achievement that integrates tracking system, haptic system, image generation and display system and visual display equipment, but there are still many problems to be solved on the road to practical commercialization. Virtual reality mostly integrates related technologies through wearable device helmets, but the size of the headband cannot be adjusted, the helmet is too heavy, and the device has poor ventilation and heat dissipation when worn for a long time. These factors will reduce the comfort experience of the viewer; The actual equipment needs to be connected with the computer for signal transmission, which is often connected with a very long cable as a communication guarantee. When the viewer is moving, the attention is always on the display device and the cable under the feet is ignored, and there is a danger of tripping; relatively speaking, the price of virtual reality devices with medium-to-high performance is generally high. As an entertainment tool, its display resources are very limited at present, but the price is beyond the affordability of the general public. Compared with traditional virtual reality, 3D virtual reality is closer to the actual perception of human beings, and can intuitively bring depth effects to viewers. Among many three-dimensional display technologies at home and abroad, holographic technology is a recording and restoration technology that records and restores real object images through optical phenomena of interference and diffraction. However, current holographic imaging devices use lasers for image acquisition and display, and equipment costs extremely expensive. Integrated imaging 3D display technology has problems in many aspects such as image viewpoint crosstalk and the number of viewpoints. Naked-eye stereoscopic 3D display has considerable commercial prospects. Most of the stereoscopic 3D display devices that have gone out of the laboratory stage are complex in structure, heavy and require a variety of materials and equipment and self-designed control devices, which are not suitable for applications in mobile applications. Strong virtual reality technology.

Due to its portability and popularity, mobile terminals have inherent advantages in 3D virtual reality technology. The microlens array naked-eye 3D display technology is based on a microlens array covered on a 2D flat screen, which is relatively simple to implement, and the quality of its 3D image reconstruction is sufficient for many consumer electronics devices. Existing rendering methods for display technologies, such as Philips' modular arithmetic or ray backprojection methods, require precise calibration calibrations that rely on device measurements to produce high-quality 3D displays.

In view of this, the present invention is proposed.

Contents of the invention

In order to solve the above-mentioned problems in the prior art, that is, to solve the technical problem of how to realize high-quality naked-eye three-dimensional virtual reality display, a method for moving naked-eye three-dimensional virtual reality based on optical path acquisition is proposed. In addition, a mobile naked-eye three-dimensional virtual reality system based on optical path collection is also provided.

In order to achieve the above object, according to one aspect of the present invention, the following technical solutions are provided:

A method for moving naked-eye three-dimensional virtual reality based on optical path collection, the method comprising:

capture images;

Obtain a two-view composite map index map according to the collected images;

According to the position information of the acceleration and the rotation information of the angular velocity, a two-viewpoint map is obtained;

Based on the image-based two-viewpoint synthetic image index image, the composite image is rendered for the two-viewpoint image to obtain a three-dimensional virtual reality display image.

Further, the obtaining the two-view composite map index map based on the collected image specifically includes:

Determine the sub-pixel brightness influence weight on the image;

Based on the influence weight of sub-pixel brightness on the image, the index map of the composite image of two viewpoints is determined by using the method of least squares with bounding boxes.

Further, determining the sub-pixel brightness influence weight on the image may specifically include:

Determine the sub-pixel brightness influence weight on the image according to the following formula:

Among them, Image _c(t) (i, j, k) represents the sub-pixel on the image collected at the t-th viewpoint, t=0, 1, i=1～H, j=1～W; H represents The height of the image; W represents the width of the image; r represents the radius of the security window; m and n represent the window coordinates with the center of the security window as the origin; q=1~3; Image _m (i+m,j+n,q) represents sub-pixels on the image; Indicates the normalized brightness influence weight of adjacent pixels (i, j, k) when the sub-pixel (i+m, j+n, q) on the image is lit to the maximum brightness.

Further, based on the influence weight of the sub-pixel brightness on the image, the least squares method with bounding boxes is used to determine the composite image index map of the two viewpoints, which may specifically include:

Based on the influence weight of the sub-pixel brightness on the image, using the least squares method with bounding boxes, the composite image index map of the two viewpoints is determined according to the following formula:

in, Indicates the difference in the weights of sub-pixel brightness influences corresponding to two viewpoints; I represents the composite image index map of two viewpoints, and is limited to the bounding box B _I ={I∈Z ^1×H :L≤I≤U}, L=0 ×I _1×H and U=255×I _1×H , I _1×H represents a full 1-column vector of H dimension; Indicates the difference between images collected from two viewpoints; H indicates the height of the image.

Further, before determining the sub-pixel brightness influence weight step on the image, it may also include:

Anti-distortion and region-of-interest extraction operations are performed on the image.

Further, according to the position information of the acceleration and the rotation information of the angular velocity, a two-viewpoint map is obtained, which may specifically include:

According to the position information of the acceleration and the rotation information of the angular velocity, the orientation of the acquired image is adjusted to obtain a two-viewpoint image.

Based on the image-based two-viewpoint synthetic image index map, the two-viewpoint image is rendered to a composite image to obtain a three-dimensional virtual reality display image, specifically including:

The composite image is rendered according to the following formula to obtain a 3D virtual reality display image:

Syn＝I ₀ ×view ₀ +I ₁ ×view ₁

Among them, Syn represents the 3D virtual reality display image; I ₀ represents the synthetic map index map of the 0th viewpoint; I ₁ represents the synthetic map index map of the 1st viewpoint; view ₀ represents the 0th viewpoint map; view ₁ represents the 1st viewpoint map.

In order to achieve the above object, according to another aspect of the present invention, the following technical solutions are provided:

A mobile naked-eye three-dimensional virtual reality system based on optical path acquisition, the system may include:

an image acquisition unit, configured to acquire images and send the images to the controller;

The mobile terminal includes a screen, and a microlens array film is arranged on the screen, which is used to send the position information of the acceleration and the rotation information of the angular velocity to the controller, and display a three-dimensional virtual reality display image through the screen;

The controller is connected to the image acquisition unit and the mobile terminal respectively; it is used to process the image to obtain the index map of the two-viewpoint composite map, and obtain the two-viewpoint map according to the position information of the acceleration and the rotation information of the angular velocity, and based on the image The two-viewpoint synthetic image index image is used to render a composite image for the two-viewpoint image to obtain a three-dimensional virtual reality display image, and to send the three-dimensional virtual reality display image to a mobile terminal.

Further, the mobile terminal can also include

Accelerometer, used to obtain the location information of the acceleration;

Gyroscope, used to obtain rotation information of angular velocity.

Further, the image acquisition unit is a monocular camera, a monocular camera, a binocular camera or a binocular camera.

Further, the mobile terminal is a mobile phone or a personal digital assistant.

Further, the controller is a computer, a notebook computer, a server or an industrial computer.

Embodiments of the present invention propose a method and system for mobile naked-eye three-dimensional virtual reality based on optical path acquisition. Wherein, the method may include: collecting an image; obtaining a two-viewpoint synthetic map index map based on the collected image, and obtaining a two-viewpoint map according to the position information of the acceleration and the rotation information of the angular velocity; based on the image-based two-viewpoint synthetic map index map, The composite image is rendered by rendering the two-viewpoint image, and a three-dimensional virtual reality display image is obtained. The embodiment of the present invention combines the three-dimensional display technology with the virtual reality technology, and can present a high-quality three-dimensional display effect under the condition that the parameters of the microlens array and the screen of the mobile terminal are unknown. Compared with traditional virtual reality equipment, it reduces the weight of the helmet and the sense of restraint due to poor comfort. At the same time, it increases the three-dimensional display effect of the equipment itself instead of just using binoculars to receive pictures of different scenes on the left and right to achieve a three-dimensional effect.

Description of drawings

FIG. 1 is a schematic structural diagram of a mobile naked-eye three-dimensional virtual reality system based on optical path acquisition according to an embodiment of the present invention;

FIG. 2 is a schematic structural diagram of a mobile naked-eye three-dimensional virtual reality system based on optical path acquisition according to another embodiment of the present invention;

Fig. 3 is a schematic diagram of a naked-eye three-dimensional virtual reality display effect of a mobile phone held by a user at three different observation points according to an embodiment of the present invention;

Fig. 4 is a schematic flowchart of a method for moving naked-eye three-dimensional virtual reality based on optical path acquisition according to an embodiment of the present invention.

detailed description

Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention, and are not intended to limit the protection scope of the present invention.

The following uses an exemplary embodiment to illustrate the application platform of the embodiment of the present invention. Among them, two image acquisition units with a reference line of 60 mm can be used to simulate the eyes of a person, and they are placed at a distance of about 300 mm from the screen of the mobile terminal. A sealed experimental box is used to provide a closed environment isolated from external light for the optical path acquisition of the image acquisition unit, and a fan is installed behind the image acquisition unit for heat dissipation. Preferably, in order to maximize the use of pixels on the captured image, the image acquisition unit may be equipped with a telephoto lens. The test atlas is generated on the computer, and is sequentially transmitted to the mobile terminal for display through the construction of the local area network.

The above-mentioned image acquisition unit includes but is not limited to a monocular camera, a binocular camera, a monocular camera, a binocular camera, and an industrial camera. Wherein, if a monocular camera or a monocular camera is selected, in practical applications, two monocular cameras or monocular cameras are used.

An embodiment of the present invention provides a mobile naked-eye three-dimensional virtual reality system based on optical path acquisition. As shown in FIG. 1 , the system 10 includes: an image acquisition unit 12 , a mobile terminal 14 and a controller 16 . Wherein, the image acquisition unit 12 is used to acquire images and send the images to the controller. The mobile terminal 14 includes a screen, on which a microlens array film is arranged, for sending the position information of the acceleration and the rotation information of the angular velocity to the controller, and displaying a three-dimensional virtual reality display image through the screen. The controller 16 is communicated with the image acquisition unit and the mobile terminal respectively; it is used to process the image to obtain a two-viewpoint synthetic map index map, and obtain a two-viewpoint map according to the position information of the acceleration and the rotation information of the angular velocity, and based on the image The two-viewpoint synthetic image index image is used to render the composite image for the two-viewpoint image to obtain a three-dimensional virtual reality display image, and to send the three-dimensional virtual reality display image to a mobile terminal.

The mobile terminal includes, but is not limited to, a mobile phone and a personal digital assistant. In this preferred embodiment, the mobile three-dimensional display technology is combined with the virtual reality technology, and a mobile terminal can be used to realize a mobile naked-eye three-dimensional virtual reality display.

The above-mentioned image acquisition unit, as an optical path acquisition device, includes but is not limited to a monocular camera, a monocular camera, a binocular camera and a binocular camera. The image acquisition unit can perform pre-calibration and calibration with the mobile terminal, and then perform three-dimensional virtual reality display.

The aforementioned controllers include but are not limited to computers, notebook computers, industrial computers, and servers. The server can also be a server cluster.

A microlens array film is covered on the screen of the mobile terminal, and the microlens array film is composed of tens of thousands of convex lenses. In this way, when viewed in different directions, the sub-pixels located at different places under the convex lens are magnified into the viewer's eyes.

In this embodiment, the ways in which the controller communicates with the image acquisition unit and the mobile terminal respectively include but are not limited to WIFI network, Bluetooth, ZigBee, 2G, 3G, 4G, and 5G.

By adopting the above-mentioned technical solution, the embodiment of the present invention can realize mobile three-dimensional virtual reality display with high reproducibility, controllable cost and high resolution under the condition that the parameters of the microlens array and the liquid crystal screen of the mobile terminal are unknown.

In an optional embodiment, the mobile terminal may include a gyroscope and an accelerometer. Among them, the accelerometer is used to obtain the position information of the acceleration. Gyroscopes are used to obtain rotation information of angular velocity.

The working process of the mobile naked-eye three-dimensional virtual reality system based on light path acquisition will be described in detail below in combination with FIG. 2 and FIG. 3 in the form of a preferred embodiment. In this preferred embodiment, a mobile phone, a camera, and a control computer are respectively used as a mobile terminal, an image acquisition unit, and a controller to describe in detail. Among them, two monocular industrial cameras are used. The mobile phone screen is covered with a microlens array film. The control computer realizes wireless communication with the mobile phone and the industrial camera through the router.

This preferred embodiment carries out the following distance settings: measure the binocular distance of watching the user, the distance between the screen and the eyes when holding the mobile phone 3, two cameras 6 horizontal placement distances are set to the user 7 binocular distances, and the mobile phone screen and the camera 6 is consistent with the distance at which the user 7 holds the mobile phone 3 .

In the light path acquisition experiment box 4, the industrial camera 6 is calibrated and calibrated through the light 5 through the mobile phone 3. Wherein, the calibration method includes but not limited to an active vision camera calibration method and a camera self-calibration method.

Connect the industrial camera 6 to the control computer 1 for image acquisition, and optimize the two initial synthetic image index images. The effect is that the display effect of the two index images in the mobile phone 3 is complementary in black, white and color.

The mobile phone 3 collects the viewer's displacement and rotation posture, and communicates with the control computer 1 through the WIFI network, and sends the viewer's displacement and rotation posture to the control computer 1 .

The control computer 1 performs signal communication with the mobile phone 3 and the industrial camera 6 respectively through the router 2, controls the mobile phone to light up a single pixel, and controls the camera 6 to collect images at the same time; also optimizes the images collected by the two industrial cameras 6 to generate two viewpoints and also receive the viewer's displacement and rotation attitude data sent by the mobile phone 3, and according to the viewer's displacement and rotation attitude data, the two-viewpoint figure to be displayed and the initial synthetic figure index figure interact to generate a virtual three-dimensional scene image ( 3D virtual reality image), and the virtual 3D scene image is fed back to the mobile phone 3 for naked-eye 3D display. At this time, the viewer can watch the three-dimensional effect of the virtual scene without any other external auxiliary equipment.

FIG. 3 exemplarily shows a schematic diagram of naked-eye three-dimensional virtual reality display effects of the mobile phone at three different viewing points when the user holds the mobile phone.

This preferred embodiment constructs a naked-eye three-dimensional virtual reality system based on optical path acquisition with strong reproducibility, controllable cost, high resolution, and mobility, which incorporates virtual reality technology as an automatic calibration and crosstalk reduction based on optical path acquisition. The mobile 3D display solution can present a high-quality, delicate 3D display effect when the parameters of the microlens array and the LCD screen of the mobile phone are unknown, and it can be customized according to the differences in personal mobile phones. Compared with the traditional The virtual reality device reduces the weight of the helmet and the sense of restraint caused by poor comfort, and at the same time increases the three-dimensional display effect of the device itself instead of just using binoculars to receive pictures of different scenes on the left and right to achieve a three-dimensional effect.

In addition, an embodiment of the present invention provides a method for moving naked-eye three-dimensional virtual reality based on optical path acquisition. The method can be applied to the above-mentioned mobile naked-eye three-dimensional virtual reality system based on optical path acquisition. As shown in Figure 4, the method may include:

S400: Collect images.

S410: Obtain a composite map index map of two viewpoints based on the collected images.

Specifically, this step may be implemented through steps S414 to S418.

S414: Determine the influence weight of sub-pixel brightness on the image.

In this step, the influence of surrounding subpixels is taken into account for the value of each subpixel on the composite image index map of two viewpoints, and the weight value of different subpixel influences is obtained through the collected images.

For example, when any sub-pixel Image _m (i, j, q) located in the Image _m (i, j) window is lit, it will affect the captured image, Image _c(t) (i, j ) for each sub-pixel in the pixel.

Specifically, this step may further include: determining the sub-pixel brightness influence weight on the image according to the following formula:

Among them, Image _c(t) (i, j, k) represents the sub-pixel on the image collected at the t-th viewpoint, t=0, 1, i=1～H, j=1～W; H represents The height of the image; W represents the width of the image; r represents the radius of the security window; m and n represent the window coordinates with the center of the security window as the origin; q=1~3; Image _m (i+m,j+n,q) represents sub-pixels on the image; Indicates the normalized brightness influence weight of adjacent pixels (i, j, k) when the sub-pixel (i+m, j+n, q) on the image is lit to the maximum brightness.

According to the sub-pixel brightness influence weight obtained in this step, a weight matrix can be indexed for subsequent processing.

S416: Based on the influence weight of sub-pixel brightness on the image, using the method of least squares with bounding boxes, determine the composite image index map of the two viewpoints.

Specifically, this step may further include: based on the influence weight of sub-pixel brightness on the image, using the least squares method with bounding boxes, according to the following formula to determine the composite map index map of the two viewpoints:

in, Indicates the difference in the weights of sub-pixel brightness influences corresponding to two viewpoints; I represents the composite image index map of two viewpoints, and is limited to the bounding box B _I ={I∈Z ^1×H :L≤I≤U}, L=0 ×I _1×H and U=255×I _1×H , I _1×H represents a full 1-column vector of H dimension; Indicates the difference between images collected from two viewpoints; H indicates the height of the image.

As an example, the composite map index map I ₀ of the 0th viewpoint is determined in the following manner:

Step 1: Confine I to the bounding box B _I ={I∈Z ^1×H :L≤I≤U}, where L=0×I _1×H and U=255×I _1×H , I _{1 ×H} represents an H-dimensional full 1-column vector.

Step 2: Perform least squares processing with bounding boxes according to the following formula:

in, Indicates the difference between images captured at 0 viewpoint and 1 viewpoint, Indicates the difference in the weight of sub-pixel brightness influences corresponding to two viewpoints, which is a full-rank sparse matrix of size (H×W×3, H×W)×3, H represents the height of the image, W represents the width of the image; I represents the Composite graph index graph.

In the same way, we can obtain the composite map index map of the first viewpoint.

In a preferred embodiment, before step S414, the embodiment of the present invention may further include:

S412: Perform anti-distortion and ROI extraction operations on the image.

For example, considering that the brightness of two pixels on the screen of the mobile terminal whose distance is N (where N is taken as an integer) pixels will not affect each other, the screen of the mobile terminal can be divided into several N×N sized security window. Therefore, it can be implemented by transmitting N×N×3 test images image _m to the mobile terminal. Wherein, the resolution of the test chart is H×W. Among them, H represents the height of the test pattern; W represents the width of the test pattern. In the specific implementation process, the image acquisition units located at the observation points of the two viewpoints are used to capture separately to obtain the captured image, and the captured image is subjected to anti-distortion and region-of-interest extraction operations to obtain an image _{c(0 )} image and image _c(1) image with resolution H×W. Wherein, the image acquisition unit includes but not limited to a monocular camera, a monocular camera, a binocular camera, a binocular camera, and an industrial camera.

S420: Obtain a two-viewpoint map according to the position information of the acceleration and the rotation information of the angular velocity.

Specifically, this step may be implemented in the following manner: according to the position information of the acceleration and the rotation information of the angular velocity, the orientation of the collected image is adjusted to obtain a two-viewpoint image.

Wherein, the location information of the acceleration can be obtained by collecting the accelerometer sensor of the mobile terminal. The rotation information of the angular velocity can be obtained through collection by the gyroscope sensor of the mobile terminal. Thus, the displacement and rotation posture of the viewer can be collected, so that the display of the mobile naked-eye three-dimensional virtual reality can be realized by using the displacement and rotation posture.

In practical applications, through the platform built by the mobile phone, the camera and the computer, the pose of the virtual camera can be adjusted on the computer side through step S420 to obtain a two-viewpoint map.

S430: Based on the image-based two-viewpoint synthetic image index image, render the composite image for the two-viewpoint image to obtain a three-dimensional virtual reality display image.

For example, the composite image is rendered according to the following formula to obtain a three-dimensional virtual reality display image:

Syn=I ₀ ×view ₀ +I ₁ ×view ₁ ;

Among them, Syn represents the 3D virtual reality display image; I ₀ represents the synthetic map index map of the 0th viewpoint; I ₁ represents the synthetic map index map of the 1st viewpoint; view ₀ represents the 0th viewpoint map; view ₁ represents the 1st viewpoint map.

In a preferred embodiment, this step S430 can also be implemented in the following manner: combining the two-viewpoint images with two predetermined composite image index images whose display effects are black and white and complement each other to obtain a 3D virtual reality display image.

In the above embodiment, although the various steps are described according to the above sequence, those skilled in the art can understand that in order to achieve the effect of this embodiment, different steps do not have to be executed in this order, and they can be performed at the same time ( Parallel) execution or execution in reversed order, these simple changes are all within the protection scope of the present invention.

It should be noted that, in the process of describing various embodiments of the present invention, for the sake of brevity, the same parts are omitted, and those skilled in the art should understand that, in the absence of conflict, the description of an embodiment It can also be applied to another embodiment.

It should also be noted that the language used in this specification is mainly for the purpose of readability and teaching, and is not intended to explain or limit the protection scope of the present invention.

The foregoing detailed description of example embodiments of the present invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms described. Obviously, many modifications and changes will be apparent to those skilled in the art. The embodiment was chosen and described in order to best explain the principles of the invention and its practical application, thereby enabling others skilled in the art to understand the invention for various embodiments and with various modifications as are suited to the particular use contemplated. Embodiments of the present invention may omit some of the above-mentioned technical features, and only solve some technical problems existing in the prior art. Moreover, the described technical features can be combined arbitrarily. The scope of protection of the present invention is defined by the appended claims and their equivalents. Others skilled in the art can make various modifications or replacements and combinations of the technical solutions described in the appended claims. The technical solutions after these changes or replacements All will fall within the protection scope of the present invention.

Claims (12)

1. A method for moving naked eye three-dimensional virtual reality based on optical path acquisition is characterized by comprising the following steps:

collecting an image;

acquiring a two-viewpoint composite map index map based on the acquired image;

obtaining two viewpoint images according to the position information of the acceleration and the rotation information of the angular velocity;

rendering a synthetic graph to the two-viewpoint graph based on the two-viewpoint synthetic graph index graph of the image to obtain a three-dimensional virtual reality display image.

2. The method for moving naked eye three-dimensional virtual reality based on optical path acquisition according to claim 1, wherein the obtaining of the two-viewpoint synthetic image index map based on the acquired image specifically comprises:

determining a sub-pixel luminance impact weight on the image;

and determining the composite map index map of the two viewpoints by using a least square method with bounding boxes based on the sub-pixel brightness influence weight on the image.

3. The method for moving naked eye three-dimensional virtual reality based on optical path acquisition according to claim 2, wherein the determining the sub-pixel brightness influence weight on the image specifically comprises:

determining the sub-pixel luminance impact weight on the image according to:

${\mathrm{Image}}_{c\left(t\right)}(i,j,k)=\underset{m=-r}{\overset{r}{\Σ}}\underset{n=-r}{\overset{r}{\Σ}}\underset{q=1}{\overset{3}{\Σ}}{w}_{i+m,j+n,q}^{\left(t\right)}(-m,-n,k){\mathrm{Image}}_m(i+m,j+n,q)$

wherein the Image is_c(t)(i, j, k) represents a sub-pixel on the image acquired at the t-th viewpoint, t being 0, 1, i being 1 to H, and j being 1 to W; the H represents the height of the image; the W represents a width of the image; the r represents a security window radius; the m and the n represent window coordinates with the center of the safety window as an origin; the q is 1-3; the Image_m(i + m, j + n, q) represents a sub-pixel on the image; the above-mentionedRepresenting the normalized luminance impact weight for the neighboring pixel (i, j, k) when the sub-pixel (i + m, j + n, q) on the image is lit to maximum luminance.

4. The method for moving naked eye three-dimensional virtual reality based on optical path acquisition according to claim 2, wherein the determining the composite map index map of the two viewpoints by using a least square method with bounding boxes based on the sub-pixel brightness influence weight on the image specifically comprises:

determining the composite map index map for the two viewpoints using a least squares with bounding boxes based on sub-pixel luminance impact weights on the image according to the following equation:

$\▿w\×I=\▿I_c;$

wherein, theRepresenting the difference of the brightness influence weights of the sub-pixels corresponding to the two viewpoints; the I represents the composite map index map of the two viewpoints and is limited to a bounding box B_I＝{I∈Z^1×HL is less than or equal to I and less than or equal to U, L is 0 × I_1×HAnd U255 × I_1×HSaid I is_1×HA full 1-column vector representing the H dimension; the above-mentionedRepresenting the difference of the two viewpoint collected images; the H represents the height of the image.

5. The method for moving naked eye three-dimensional virtual reality based on optical path acquisition according to claim 2, wherein before the step of determining the sub-pixel brightness influence weight on the image, the method further comprises:

and carrying out anti-distortion and interest region extraction operation processing on the image.

6. The method for moving naked eye three-dimensional virtual reality based on optical path acquisition according to claim 1, wherein the obtaining of the two-viewpoint images according to the position information of the acceleration and the rotation information of the angular velocity specifically comprises:

and adjusting the orientation of the acquired image according to the position information of the acceleration and the rotation information of the angular velocity to obtain the two-viewpoint image.

7. The method for moving naked eye three-dimensional virtual reality based on optical path acquisition according to claim 1, wherein rendering a composite map to obtain a three-dimensional virtual reality display image based on the two-viewpoint composite map index map of the image specifically comprises:

rendering a synthetic graph according to the following formula to obtain the three-dimensional virtual reality display image:

Syn＝I₀×view₀+I₁×view₁；

wherein the Syn represents the three-dimensional virtual reality display image; said I₀A composite map index map indicating the 0 th view; said I₁A composite map index map indicating the 1 st view; the view is₀Represents a 0 th viewpoint map; the view is₁The 1 st view is shown.

8. A system for moving naked eye three-dimensional virtual reality based on optical path acquisition is characterized by comprising:

the image acquisition unit is used for acquiring an image and sending the image to the controller;

the mobile terminal comprises a screen, wherein a micro-lens array film is arranged on the screen and used for sending position information of acceleration and rotation information of angular velocity to the controller and displaying a three-dimensional virtual reality display image through the screen;

the controller is in communication connection with the image acquisition unit and the mobile terminal respectively; the two-viewpoint synthetic graph index graph is obtained according to the position information of the acceleration and the rotation information of the angular velocity, a synthetic graph is rendered for the two-viewpoint synthetic graph based on the two-viewpoint synthetic graph index graph of the image, a three-dimensional virtual reality display image is obtained, and the three-dimensional virtual reality display image is sent to the mobile terminal.

9. The system for moving naked eye three-dimensional virtual reality based on optical path acquisition according to claim 8, wherein the mobile terminal comprises:

the accelerometer is used for acquiring position information of the acceleration;

and the gyroscope is used for acquiring the rotation information of the angular velocity.

10. The system for moving naked eye three-dimensional virtual reality based on optical path acquisition according to claim 8, wherein the image acquisition unit is a monocular camera, a monocular video camera, a binocular camera or a binocular video camera.

11. The system for mobile naked eye three-dimensional virtual reality based on optical path acquisition according to claim 8, wherein the mobile terminal is a mobile phone or a personal digital assistant.

12. The system for moving naked eye three-dimensional virtual reality based on light path acquisition according to claim 8, wherein the controller is a computer, a notebook computer, a server or an industrial personal computer.