CN106598250B - A VR display method, device and electronic equipment - Google Patents

Abstract

The present invention relates to the technical field of image processing, and specifically discloses a VR display method, device, and electronic equipment. The method includes: determining an image in a selected state in an original view, wherein the original view contains at least one image, The image is a two-dimensional image; horizontally shifting the image in the selected state in the original view to the right by a predetermined distance to obtain a first perspective view, and shifting the image in the selected state in the original view to the left by a predetermined distance Obtain a second perspective view; perform VR display according to the first perspective view and the second perspective view. Through the above method, the embodiment of the present invention can present the three-dimensional spatial layering of two-dimensional images to the user during VR display, without embedding 3D engine programming, reducing the amount of communication and calculation between applications, and saving the processing resources of smart terminals .

Description

A VR display method, device and electronic equipment

technical field

Embodiments of the present invention relate to the technical field of image processing, and in particular, to a VR (Virtual Reality, virtual reality) display method, device and electronic equipment.

Background technique

Virtual Reality, referred to as VR technology, uses computers or other intelligent computing devices to simulate a three-dimensional virtual world, providing users with simulations of vision, hearing, touch and other senses, making users feel as if they were there. Because VR technology can provide a very immersive experience, it is very suitable for various fields such as games, film and television, and interaction. With the development of VR technology and the explosive growth of VR hardware, there are more and more VR applications, people's attention to VR has increased significantly, and the demand for VR applications has also become higher and higher.

Currently, a user often needs to browse a two-dimensional image when experiencing a VR application, for example, browse a UI (User Interface, user interface) interactive interface image. When users use VR applications to browse two-dimensional images, they also hope to experience the three-dimensional spatial layering of two-dimensional images, so as to further enhance the sense of immersion. However, the two-dimensional image itself does not have a three-dimensional effect. In order to realize the three-dimensional presentation of the two-dimensional image in the VR application, in the prior art, a 3D (Three Dimensional, 3-dimensional) engine is mostly used, for example: in the VR application program of Android or ios Embed Unity 3D in it, and realize the presentation of the three-dimensional space layering of two-dimensional images through Unity 3D programming.

However, in the process of realizing the present invention, the inventors found that the related technologies have the following problems: Although the existing technical solutions can meet the needs of users to view the spatial layering of images through VR applications, the embedding of the 3D engine increases the gap between the programming software and the application program. The inter-communication process increases the complexity of the application program. At the same time, the amount of information processing on the terminal where the application program runs increases and the consumption increases.

Contents of the invention

Embodiments of the present invention provide a VR display method, device, and electronic equipment, which can reduce the complexity of VR application programs, effectively reduce consumption, and solve the problem of increasing application programs when embedding a 3D engine to realize the three-dimensional spatial layering of two-dimensional images. The complexity and the amount of information processing on the terminal where the application program is running become larger and the consumption increases.

In a first aspect, an embodiment of the present invention provides a VR display method, including:

determining the selected image in the original view, wherein the original view contains at least one image, and the image is a two-dimensional image;

horizontally shifting the selected image in the original view to the right by a predetermined distance to obtain a first perspective view, and horizontally shifting the selected image in the original view to the left by a predetermined distance to obtain a second perspective view;

VR display is performed according to the first perspective view and the second perspective view.

Wherein, optionally, the first perspective view is obtained by horizontally shifting the image in the selected state in the original view by a predetermined distance to the right, and shifting the image in the selected state in the original view horizontally by a predetermined distance to the left Obtaining a second-person view includes:

Shifting the image in the selected state in the original view to the right by a predetermined distance and performing scaling processing according to a preset zoom factor to obtain a first perspective view, and shifting the image in the selected state in the original view horizontally to the left Move a predetermined distance and perform zoom processing according to a preset zoom factor to obtain a second perspective view.

Specifically, the above zooming processing is zooming in processing.

Among them, optional:

The original view contains at least two images;

The image in the selected state in the original view is shifted horizontally by a predetermined distance to the right and zoomed according to a preset zoom factor to obtain a first perspective view, and the image in the selected state in the original view is moved to the left Horizontally offset a predetermined distance and perform zoom processing according to a preset zoom factor to obtain a second perspective view, including:

Shifting the image in the selected state in the original view to the right by a predetermined distance and zooming in according to a preset magnification, and reducing the images other than the image in the selected state in the original view according to a preset multiple times to perform zoom-out processing to obtain the first perspective view, shift the image in the selected state in the original view horizontally to the left by a predetermined distance and perform zoom-in processing according to the preset magnification, and select the image in the original view The images other than the image are reduced according to the preset reduction factor to obtain the second perspective view;

or,

Shifting the image in the selected state in the original view to the right by a predetermined distance and performing reduction processing according to a preset reduction factor, and zooming in on images other than the image in the selected state in the original view according to a preset Multiply to zoom in to obtain the first perspective view, shift the image in the selected state in the original view horizontally to the left by a predetermined distance and perform reduction processing according to the preset reduction factor, and make the image in the selected state in the original view The images other than the image are enlarged according to the preset magnification to obtain the second perspective view.

Among them, optional:

After the image in the selected state in the original view is determined, before acquiring the first perspective view and the second perspective view, the method further includes:

Enlarging the image in the selected state in the original view according to a preset magnification factor to obtain a third perspective view;

performing VR display according to the third perspective view;

The step of horizontally shifting the selected image in the original view by a predetermined distance to the right to obtain a first perspective view, and shifting the selected image in the original view horizontally by a predetermined distance to the left to obtain a second perspective view includes :

shifting the image in the selected state in the third perspective view horizontally by a predetermined distance to the right to obtain a first perspective view, and shifting the image in the selected state in the third perspective view horizontally by a predetermined distance to the left Obtain a second perspective view;

or,

After the image in the selected state in the original view is determined, before acquiring the first perspective view and the second perspective view, the method further includes:

performing reduction processing on images other than the selected image in the original view according to a preset reduction factor to obtain a fourth perspective view;

performing VR display according to the fourth perspective view;

The step of horizontally shifting the selected image in the original view by a predetermined distance to the right to obtain a first perspective view, and shifting the selected image in the original view horizontally by a predetermined distance to the left to obtain a second perspective view includes :

shifting the image in the selected state in the fourth perspective view horizontally by a predetermined distance to the right to obtain a first perspective view, and shifting the image in the selected state in the fourth perspective view horizontally by a predetermined distance to the left Get a second-person view.

Wherein, optionally, performing VR display according to the first perspective view and the second perspective view includes:

Sending the first perspective view and the second perspective view, so that the receiving end performs VR display according to the first perspective view and the second perspective view.

Wherein, optionally, the determining the selected image in the original view includes:

Receive the user's image selection instruction;

According to the image selection instruction, the selected image in the original view is determined.

In a second aspect, an embodiment of the present invention provides a VR display device, including:

An image selection unit, configured to determine the selected image in the original view, wherein the original view contains at least one image, and the image is a two-dimensional image;

A binocular view acquisition unit, configured to horizontally shift the image in the selected state in the original view by a predetermined distance to the right to obtain a first perspective view, and shift the image in the selected state in the original view horizontally by a predetermined distance to the left Obtain a second perspective view;

A display unit, configured to perform VR display according to the first perspective view and the second perspective view.

Wherein, optionally, the binocular view acquisition unit is specifically used for:

Shifting the image in the selected state in the original view to the right by a predetermined distance and performing scaling processing according to a preset zoom factor to obtain a first perspective view, and shifting the image in the selected state in the original view horizontally to the left Move a predetermined distance and perform zoom processing according to a preset zoom factor to obtain a second perspective view.

Among them, optional:

The original view contains at least two images;

The binocular view acquisition unit is specifically used for:

Shifting the image in the selected state in the original view to the right by a predetermined distance and zooming in according to a preset magnification, and reducing the images other than the image in the selected state in the original view according to a preset multiple times to perform zoom-out processing to obtain the first perspective view, shift the image in the selected state in the original view horizontally to the left by a predetermined distance and perform zoom-in processing according to the preset magnification, and select the image in the original view The images other than the image are reduced according to the preset reduction factor to obtain the second perspective view;

or,

Shifting the image in the selected state in the original view to the right by a predetermined distance and performing reduction processing according to a preset reduction factor, and zooming in on images other than the image in the selected state in the original view according to a preset Multiply to zoom in to obtain the first perspective view, shift the image in the selected state in the original view horizontally to the left by a predetermined distance and perform reduction processing according to the preset reduction factor, and make the image in the selected state in the original view The images other than the image are enlarged according to the preset magnification to obtain the second perspective view.

Among them, optional:

The device further includes a first scaling processing unit, configured to, after determining the image in the selected state in the original view, and before acquiring the first perspective view and the second perspective view, The selected image is enlarged according to the preset magnification factor to obtain a third perspective view;

The display unit is further configured to perform VR display according to the third perspective view;

The binocular view acquisition unit is specifically used for:

shifting the image in the selected state in the third perspective view horizontally by a predetermined distance to the right to obtain a first perspective view, and shifting the image in the selected state in the third perspective view horizontally by a predetermined distance to the left Obtain a second perspective view;

or,

The device further includes a second scaling processing unit, configured to, after determining the selected image in the original view and before acquiring the first perspective view and the second perspective view, The images other than the selected image are reduced according to the preset reduction factor to obtain the fourth perspective view;

The display unit is further configured to perform VR display according to the fourth perspective view;

The binocular view acquisition unit is specifically used for:

shifting the image in the selected state in the fourth perspective view horizontally by a predetermined distance to the right to obtain a first perspective view, and shifting the image in the selected state in the fourth perspective view horizontally by a predetermined distance to the left Get a second-person view.

Wherein, optionally, the display unit is specifically used for:

Sending the first perspective view and the second perspective view, so that the receiving end performs VR display according to the first perspective view and the second perspective view.

Wherein, optionally, the image selection unit is specifically used for:

Receive the user's image selection instruction;

According to the image selection instruction, the selected image in the original view is determined.

In a third aspect, an embodiment of the present invention provides an electronic device, including:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the aforementioned VR display method.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to cause a computer to execute the above-mentioned VR display method.

In the fifth aspect, an embodiment of the present invention further provides a computer program product, the computer program product includes a computer program stored on a computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a computer When executing, the computer is made to execute the above-mentioned VR display method.

The beneficial effect of the embodiments of the present invention is that, different from the situation of the prior art, the VR display method, device and electronic equipment provided by the embodiments of the present invention determine the image in the selected state in the original view, and convert the image in the original view to The image in the selected state is shifted horizontally by a predetermined distance to the right to obtain a first perspective view, and the image in the selected state in the original view is horizontally shifted by a predetermined distance to the left to obtain a second perspective view, and then according to the first perspective view Performing VR display with the second perspective view can realize the stereoscopic display effect of the two-dimensional image in the VR display. In this process, there is no need to embed 3D engine programming, which reduces the amount of communication and calculation between applications, and saves the cost of the application program running terminal. Process resources.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the following will briefly introduce the drawings that are used in the embodiments of the present invention. Apparently, the drawings described below are only some embodiments of the present invention, and those skilled in the art can obtain other drawings according to these drawings without creative efforts.

FIG. 1 is a schematic flowchart of a VR display method provided by Embodiment 1 of the present invention;

2(a)-(c) are schematic views of the VR display method provided by Embodiment 2 of the present invention;

FIG. 3 is a schematic flowchart of a VR display method provided by Embodiment 3 of the present invention;

FIG. 4 is a schematic structural diagram of a VR display device provided by Embodiment 4 of the present invention;

FIG. 5 is a schematic structural diagram of a VR display device provided by Embodiment 5 of the present invention;

FIG. 6 is a schematic structural diagram of an electronic device provided by Embodiment 6 of the present invention; and,

FIG. 7 is a schematic diagram of the principle of the two-point perspective method of stereoscopic imaging described in Embodiment 1 of the present invention.

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

It should be noted that, if there is no conflict, various features in the embodiments of the present invention may be combined with each other, and all of them are within the protection scope of the present invention. In addition, although the functional modules are divided in the schematic diagram of the device, and the logical order is shown in the flowchart, in some cases, the division of modules in the device or the sequence shown in the flowchart can be performed in different ways. or the steps described.

The reason why people can see the spatial position of objects, rather than a flat feeling like a photo, is that the images seen by the left and right eyes of people are not the same. After the subtle differences between them are recognized by the brain, they can produce distance depth, resulting in a three-dimensional effect.

Based on the above principles, the VR display method, device, and electronic equipment provided by the embodiments of the present invention can process the view composed of two-dimensional images, and form left and right eye views for VR display by moving the two-dimensional images in the view (the first perspective view and second perspective view), and then use the VR display device for VR display, users can feel the spatial distance contrast between the two-dimensional images, and then feel the three-dimensional effect of the two-dimensional images in the view, which can be widely used in Games, video, interaction, maps, reading education and other fields. For example, in some embodiments, the overall picture of the game can be split into two types of two-dimensional images of scenes and characters, and the above-mentioned two-dimensional images can be processed by using the method provided by the embodiment of the present invention, and the image of the picture can be obtained. The left-eye view image and the right-eye view image, and then presenting them in the VR display device can enable the user to watch the game screen with a three-dimensional sense of space; or, in some other embodiments, during human-computer interaction, use The method provided by the embodiment of the present invention processes the images in the two-dimensional display screen, which can make the image selected by the user "move forward" and form a three-dimensional sense of hierarchy with other unselected images. Furthermore, in still some embodiments, the steps in the VR display method provided by the embodiments of the present invention may also be repeated multiple times to obtain stereoscopic images with various layers.

The embodiments of the present invention will be further described below in conjunction with the accompanying drawings.

Embodiment one

Fig. 1 is a schematic flowchart of a VR display method provided by Embodiment 1 of the present invention, please refer to Fig. 1, the method includes:

110. Determine the selected image in the original view.

In this embodiment, the "original view" refers to the initial view, which includes at least one image, and the image is a two-dimensional image, and an image will be selected from this view. The VR of the embodiment of the present invention The display mode is a process from unselected to selected in order to present the two-dimensional image in the original view, so that the user perceives a three-dimensional layered effect.

For example, the "original view" may be shown in Figure 2(a), including three two-dimensional images A, B, and C. For example, the original view can be a human-computer interaction interface view, which contains several (that is, at least one) two-dimensional control images. The user can perform selection operations through peripheral input, head-pointing, etc., issue selection instructions, and select one of them. A two-dimensional control, in this step, the image selected by the user will be determined according to the user's selection operation, that is, the image in the selected state.

The "image in the selected state" refers to the image selected by the terminal system or the user in the original view. Correspondingly, the image not selected by the terminal system or the user, that is, the unselected image, is an image other than the image in the selected state. Image. Wherein, when the original view only includes a two-dimensional image, the two-dimensional image can be defaulted to be the image in the selected state; or, the image in the selected state can also be a part of the two-dimensional image, which can be selected by The way of drawing separates it from other parts. For example: the original view 1 is a group photo of multiple people. The original view 1 includes: background X and characters A, B, C and D. If the system needs to select character A, you can Mark character A as selected, and cut it out. In some embodiments, the original view may include N two-dimensional images, where N is a positive integer greater than 1, wherein the N two-dimensional images may be arranged according to a certain rule, or arranged in random order, or, the When the sizes of the N two-dimensional images are different, they may also be arranged in an overlapping manner. In this embodiment, the selected image may be one or n of N two-dimensional images, where n≤N. In this embodiment, only simple processing is performed on the two-dimensional image in the original view to present a three-dimensional spatial layering, which is simple and convenient, and reduces the amount of processing of the original image by the application running terminal.

In this embodiment, first determine the selected image in the original view, the selected image can be automatically selected by the system according to the preset rules, for example: if the system needs to select the character A in the original view 1: you can first pre-select Assuming the position coordinate information of characters A, B, C and D in the original view 1, input the position coordinate information of character A to mark character A as selected. Or, in some embodiments, after receiving the user's image selection instruction, the image in the selected state in the original view can be determined according to the image selection instruction, for example: the user sends an image selection instruction to the terminal through a Bluetooth handle or touch operation , according to the image selection instruction, the terminal selects one or more corresponding images as selected images. Wherein, the way of receiving the user's image selection instruction and determining the selected image in the original view according to the image selection instruction can provide a better human-computer interaction experience.

120. Shift the selected image in the original view horizontally by a predetermined distance to the right to obtain a first perspective view, and shift the selected image in the original view horizontally by a predetermined distance to the left to obtain a second perspective view.

In this embodiment, the "first perspective view" and the "second perspective view" are a pair of binocular views obtained by adjusting the original view, including: a left eye for presenting to the user's left eye view and the right-eye view for presenting to the user's right eye. During VR display, the left-eye view is usually displayed on the left screen of the VR display device, and the right-eye view is displayed on the right screen of the VR display device.

In the embodiment of the present invention, after the original view is adjusted, the left-eye view and the right-eye view are obtained, and by presenting the left-eye view and the right-eye view to the user's left eye and right eye respectively, the A stereoscopic image corresponding to this original view is formed in the brain.

Wherein, the "predetermined distance" refers to the preset distance to horizontally shift the image in the selected state to the right or to the left in the original view. The predetermined distance can be fixed in advance, or can be set according to Dynamic adjustment of the preset stereoscopic effect, for example, the greater the spatial distance difference between the selected image and the unselected image in the preset stereoscopic effect, the required offset of the selected image in this step The greater the distance, the preset stereoscopic effect can be set by the system, and can also be selected by the user. In some embodiments, the original view includes N regularly arranged two-dimensional images, where N is a positive integer greater than 1, so that images close to the human eye will not be blocked by images far away from the human eye in the obtained viewing effect. images, the predetermined distance may be further adjusted according to the positional relationship between the N two-dimensional images.

According to the two-point perspective method of stereoscopic imaging, the scene objects are projected onto the same screen through different perspectives of the left and right eyes. Objects that are far away are shifted to the right, while objects that are closer to the user in the view of the right eye are projected on the screen to the left than objects that are farther away from the user. The principle can be seen in Figure 7. Based on this, in the embodiment of the present invention, it is intended to enable the user to perceive that the selected image is closer to the user, that is, to approach the user. Therefore, the selected image in the original view can be moved to the right by a certain distance based on the original position to obtain the left-eye view, and the selected image in the original view can be moved to the left by a certain distance based on the original position to obtain Right-eye view, in this way, when performing VR display according to the left-eye view and right-eye view, the selected image has the feeling of spatially moving to the user, that is, the image in the selected state that the user visually feels when browsing the image Closer to yourself than the unselected image. Of course, it is understandable that if you want the selected image to be visually farther away from the user than the user, move in the opposite direction, that is, move the selected image in the original view to the right based on the original position At a certain distance, the right-eye view can be obtained, and the selected image in the original view can be moved to the right by a certain distance based on the original position to obtain the left-eye view.

That is to say, in this embodiment, the unselected image in the original view can be fixed, and the selected image in the original view can be shifted horizontally by a predetermined distance to the right to obtain the first perspective view, and the original The selected image in the view is shifted horizontally by a predetermined distance to the left to obtain the second perspective view: if you want the selected image to be closer to the user's eyes than the unselected image in the obtained viewing effect, then, Use the first viewing angle view as the left eye view, and use the second viewing angle view as the right eye view; conversely, if you want the selected image to be farther away from the user's eyes than the unselected image in the obtained viewing effect If it is further away, the view from the first perspective is taken as the view for the right eye, and the view from the second perspective is taken as the view for the left eye.

In addition, according to the visual principle of "near large, far small", if the image in the selected state is zoomed in, the user can visually feel that the image in the selected state is closer to him; The reduction processing can make the user visually feel that the image in the selected state is farther away from the user. Therefore, in order to better establish the spatial three-dimensional sense of hierarchy between two-dimensional images, in some embodiments, while performing offset processing on the image in the selected state, the image in the selected state is imaged according to a preset zoom factor. The image in the original view is zoomed, that is, the image in the selected state in the original view is shifted horizontally by a predetermined distance to the right and zoomed in accordance with the preset zoom factor to obtain the first perspective view; the image in the original view in the The image in the selected state is shifted horizontally by a predetermined distance to the left and zoomed according to a preset zoom factor to obtain a second perspective view. Wherein, the zoom factor includes a zoom factor and a zoom factor, which can be fixed and set in advance, or can be dynamically adjusted according to the preset stereoscopic effect: in the preset stereoscopic effect, the images in the selected state and the unselected images are spaced The larger the distance difference, the larger the value of the zoom factor. In addition, scaling and offsetting the image in the selected state are complementary and coordinated processes. The order of implementation can be zooming in first and then offsetting, or offsetting first and then zooming in, or offsetting at the same time. and magnification; while the offset direction and scaling mode are determined by the preset stereo effect. For example: if you want to show the visual effect that the selected image is closer to the user's eyes, you need to enlarge the selected image, and make the screen view (left eye view) corresponding to the left eye in the split screen in the The enlarged image in the selected state moves horizontally to the right by a predetermined distance based on the original position, and the enlarged image in the selected state in the screen view corresponding to the right eye (right eye view) moves horizontally to the left by a predetermined distance based on the original position distance, that is, the first perspective view obtained in this step is taken as the left-eye view, and the second perspective view is taken as the right-eye view. Thus, the user can visually feel that the selected image is closer to the user than the unselected image when browsing.

It should be emphasized that, in order to highlight the perception of movement in space, regardless of which of the above-mentioned zoom and offset processes comes first, the display can also correspond to the processing during VR display, that is, it will be displayed every time the processing is performed. For example, if the image in the selected state is zoomed in first to obtain the zoomed-in view, VR display is performed based on the view, and then the image in the selected state is shifted to obtain the first and second views. The two views are displayed in VR, so that the user has a sense of movement when watching the selected image.

Furthermore, when the original view includes at least two images, in order to highlight the stereoscopic effect, in some embodiments, the images other than the selected image may be compared with the selected image according to a preset zoom factor. The opposite scaling process, that is, to achieve the effect that one of the selected image and the unselected image moves closer to the user and the other moves away from the user, that is, the image in the selected state in the original view is horizontally shifted to the right by a predetermined distance and according to The preset magnification is enlarged, and the image other than the selected image in the original view is reduced according to the preset reduction to obtain the first perspective view, and the original view is selected The image is shifted horizontally by a predetermined distance to the left and zoomed in according to a preset magnification factor, and the images other than the selected image in the original view are reduced in accordance with a preset zoom factor to obtain a second viewing angle or, shifting the image in the selected state in the original view horizontally to the right by a predetermined distance and performing reduction processing according to a preset reduction factor, and reducing the images other than the image in the selected state in the original view according to performing magnification processing at a preset magnification factor to obtain a view from a first perspective; shifting the image in the selected state in the original view horizontally to the left by a predetermined distance and performing reduction processing according to a preset magnification factor; and converting the original view The images other than the selected image are enlarged according to the preset magnification to obtain the second perspective view.

130. Perform VR display according to the first perspective view and the second perspective view.

In this embodiment, firstly, the left and right eye view types of the first perspective view and the second perspective view are determined according to the expected VR display effect: if in the expected VR display effect, the selected image is far from the human eye If it is closer, it is determined that the first perspective view is a left-eye view and the second perspective view is a right-eye view; on the contrary, if the image in the selected state is farther away from the human eye in the expected VR display effect, then it is determined that The first perspective view is a right eye view and the second perspective view is a left eye view. Then, VR display is performed according to the first perspective view and the second perspective view marked with left and right eye view types, so as to present a VR display effect of the image.

In addition, in some embodiments, an external VR display device may be used for VR display according to the first perspective view and the second perspective view. Therefore, in this embodiment, this step includes: sending the first perspective view and the second perspective view, so that the receiving end performs VR display according to the first perspective view and the second perspective view. Wherein, the "receiving end" refers to the left-hand side that can process the binocular view (that is, the first perspective view and the second perspective view) and present the corresponding left-eye view and right-eye view to the user respectively. The terminal viewed by the right eye and the right eye, such as: VR glasses. The first perspective view and the second perspective view may be transmitted through a network, or through physical connections such as HDMI and SDI. Furthermore, in some other embodiments, after the left and right eye view types of the first perspective view and the second perspective view are determined, the left eye view and right eye view can be synthesized side by side from left to right A left and right view image, and then send the left and right view images to the receiving end. By merging the first perspective view and the second perspective view into a left and right view image according to predetermined rules and sending it to the receiving end, it is convenient for the receiving end to directly present the VR display effect of the original view.

From the above technical solutions, it can be seen that the beneficial effect of the embodiments of the present invention is that the first perspective view is obtained by determining the image in the selected state in the original view, and shifting the image in the selected state in the original view to the right by a predetermined distance The selected image in the original view is shifted horizontally by a predetermined distance to the left to obtain a second perspective view, and then VR display is performed according to the first perspective view and the second perspective view, which can realize the two-dimensional image In this process, there is no need to embed 3D engine programming, which reduces the amount of communication and calculation between applications, and saves the processing resources of the application program running terminal. In addition, by performing offset processing on the image in the selected state and scaling it according to a preset zoom factor, it is possible to better establish a spatial three-dimensional layering between two-dimensional images and enhance the VR display effect.

Embodiment two

In this embodiment, the VR display method provided in Embodiment 1 of the present invention is further described in detail by taking a user using a VR application to browse a two-dimensional image of a UI interface as an example. Wherein, in this embodiment, the effect achieved is to make the two-dimensional image selected by the user closer to human eyes in terms of visual experience.

2(a)-(c) are schematic diagrams of views during the VR display process in this embodiment. Referring to Fig. 2(a)-(c), in the VR display method of this embodiment, VR display is first performed according to the original view, that is, both the left-eye view and the right-eye view are original views. Please refer to FIG. 2( a ) for the original view. The original view 20 is a UI interface view browsed by the user. The original view 20 includes three two-dimensional images A, B and C. At this time, if the user selects the 2D image B, for example, through peripheral device input or head-sighting, etc., it can be confirmed that the 2D image B is the selected image in the original view according to the user's selection, and then According to the preset magnification factor, the two-dimensional image B in the original view is enlarged, and the view obtained after the enlargement processing (third perspective view 23) is shown in FIG. 2(b), and VR display is performed according to the third perspective view 23 , that is, both the left-eye view and the right-eye view are third perspective views 23; then, as shown in FIG. First perspective view 21, shift the enlarged two-dimensional image B horizontally by a predetermined distance to the left to obtain a second perspective view 22; finally perform VR display according to the first perspective view 21 and the second perspective view 22: present the first perspective view 21 For the user's left eye to view, present the second perspective view 22 to the user's right eye to view, and the user's brain can obtain the three-dimensional level of the two-dimensional image B that is closer to the human eye than the two-dimensional images A and C Effect.

In this embodiment, by simply processing the two-dimensional images in the original view, the spatial distance comparison between the two-dimensional images can be realized, and then the VR display effect of the two-dimensional view can be presented. In this process, there is no need to embed 3D Engine programming reduces the amount of communication and calculation between applications and saves the processing resources of the terminal where the application is running.

Of course, it is understandable that, based on the principle of near-large and far-small, if the two-dimensional image selected by the user is to be visually closer to the human eye, an alternative way is not to zoom in on the selected image, but to The unselected image is zoomed out, that is, the fourth perspective view is acquired, and then the selected image is processed in the same way as above based on the fourth perspective view, which will not be repeated here.

Embodiment three

Fig. 3 is a schematic flowchart of a VR display method provided by Embodiment 3 of the present invention, please refer to Fig. 3, the method includes:

310. Receive a first perspective view and a second perspective view.

In this embodiment, the "first perspective view" and "second perspective view" are binocular views of the original view, including a left-eye view and a right-eye view. The first perspective view is obtained by horizontally shifting the selected image in the original view by a predetermined distance to the right, and the second perspective view is obtained by horizontally shifting the selected image in the original view by a predetermined distance to the left. Wherein, the original view includes at least one image, and the image is a two-dimensional view; the selected image refers to an image selected by the terminal system or the user in the original view. According to the expected VR display effect, the types of the left and right eye views of the first perspective view and the second perspective view may be determined.

In this embodiment, the first perspective view and the second perspective view can be obtained through the VR display method provided in the first embodiment, and have the same technical features as the first perspective view and the second perspective view described in the first embodiment, It will not be described in detail here.

320. Perform VR display according to the first perspective view and the second perspective view.

In this embodiment, after confirming the left and right eye view types of the first perspective view and the second perspective view, VR display is performed according to the left eye view and the right eye view, thereby presenting the space of the image three-dimensional layer. For example: after confirming that the first perspective view is a left-eye view and the second perspective view is a right-eye view, the first perspective view is presented to the user's left eye, and the second perspective view is presented to the user's right eye Watching, so as to realize VR display, and present the spatial three-dimensional layering of the image in the user's brain.

From the above technical solutions, it can be seen that the beneficial effect of the embodiments of the present invention is that the first perspective view is obtained by determining the image in the selected state in the original view, and shifting the image in the selected state in the original view to the right by a predetermined distance The selected image in the original view is shifted horizontally by a predetermined distance to the left to obtain a second perspective view, and then the first perspective view and the second perspective view are presented on the VR display device, which can realize two-dimensional The spatial distance between the images is compared, and then the VR display effect of the two-dimensional view is presented. In this process, there is no need to embed 3D engine programming, which reduces the amount of communication and calculation between applications, and saves the processing resources of the application running terminal.

Embodiment Four

Fig. 4 is a schematic structural diagram of a VR display device provided by Embodiment 4 of the present invention, please refer to Fig. 4, the device 4 includes:

The image selection unit 41 is configured to determine the image in the selected state in the original view, wherein the original view contains at least one image, and the image is a two-dimensional image; wherein, in order to facilitate processing of the original view and reduce application The information processing capacity of the program running terminal. In some embodiments, the original view includes N two-dimensional images, and N is a positive integer greater than 1;

The binocular view acquisition unit 42 is configured to horizontally shift the image in the selected state in the original view to the right by a predetermined distance to obtain a first perspective view, and to shift the image in the selected state in the original view to the left by a predetermined distance. distance to obtain a second-person view; and,

The display unit 43 is configured to perform VR display according to the first perspective view and the second perspective view.

In this embodiment, the image in the selected state in the original view is first determined by the image selection unit 41, wherein at least one image is included in the original view, and the image is a two-dimensional image; then the binocular view acquisition unit is used 42. Shifting the image in the selected state in the original view horizontally by a predetermined distance to the right to obtain a first perspective view, and shifting the image in the selected state in the original view horizontally by a predetermined distance to the left to obtain a second perspective view; finally VR display is performed on the display unit 43 according to the first perspective view and the second perspective view.

Wherein, in some embodiments, in order to provide a better human-computer interaction experience, the image selection unit 41 is specifically configured to: receive a user's image selection instruction; and determine the selected image in the original view according to the image selection instruction.

Among them, in some embodiments, the binocular view acquisition unit 42 is specifically configured to: shift the image in the selected state in the original view to the right by a predetermined distance and perform scaling processing according to a preset zoom factor so as to obtain the first For a perspective view, the selected image in the original view is shifted horizontally by a predetermined distance to the left and zoomed according to a preset zoom factor to obtain a second perspective view. Further, when the original view includes at least two images, the above implementation steps include: shifting the selected image in the original view horizontally by a predetermined distance to the right and performing magnification processing according to a preset magnification factor, and shrinking images other than the selected image in the original view according to a preset reduction factor to obtain a first perspective view, shifting the selected image in the original view horizontally by a predetermined distance to the left and Enlargement processing is performed according to a preset magnification factor, and the image other than the selected image in the original view is reduced according to a preset reduction factor to obtain a second perspective view; or, the original view is obtained The image in the selected state is shifted horizontally by a predetermined distance to the right and reduced according to a preset reduction factor, and the images other than the image in the selected state in the original view are enlarged according to a preset zoom factor to obtain For the first perspective view, the image in the selected state in the original view is shifted horizontally by a predetermined distance to the left and reduced according to a preset reduction factor, and the images other than the image in the selected state in the original view are reduced Zoom in according to a preset magnification to obtain a view from a second perspective.

Wherein, in some embodiments, the display unit 43 is specifically configured to: send the first perspective view and the second perspective view, so that the receiving end Perform VR display.

Wherein, in some embodiments, the device further includes a first scaling processing unit, configured to obtain the first perspective view and the second perspective view after the image in the selected state in the original view is determined. , enlarging the image in the selected state in the original view according to a preset magnification factor to obtain a third perspective view;

The display unit 43 is also configured to perform VR display according to the third perspective view;

The binocular view acquisition unit 42 is specifically used for:

shifting the image in the selected state in the third perspective view horizontally by a predetermined distance to the right to obtain a first perspective view, and shifting the image in the selected state in the third perspective view horizontally by a predetermined distance to the left Get a second-person view.

Wherein, in some embodiments, the device further includes a second scaling processing unit, configured to acquire the first perspective view and the second perspective view after determining the selected image in the original view performing reduction processing on images other than the selected image in the original view according to a preset reduction factor to obtain a fourth perspective view;

The display unit 43 is also configured to perform VR display according to the fourth perspective view;

The binocular view acquisition unit 42 is specifically used for:

shifting the image in the selected state in the fourth perspective view horizontally by a predetermined distance to the right to obtain a first perspective view, and shifting the image in the selected state in the fourth perspective view horizontally by a predetermined distance to the left Get a second-person view.

It can be known from the above technical solution that the beneficial effect of the embodiment of the present invention is that the image in the selected state in the original view is determined by the image selection unit 41, and the image in the selected state in the original view is transferred to the binocular view acquisition unit 42. The first perspective view is obtained by horizontally shifting the predetermined distance to the right, and the second perspective view is obtained by shifting the image in the selected state in the original view to the left by a predetermined distance, and then in the display unit 43 according to the first perspective view and the The VR display of the second perspective view can realize the spatial distance comparison between two-dimensional images, and then present the three-dimensional layered effect of two-dimensional images. In this process, there is no need to embed 3D engine programming, which reduces the communication and communication between applications. The calculation amount saves the processing resources of the application running terminal.

Embodiment five

Fig. 5 is a schematic structural diagram of a VR display device provided by Embodiment 4 of the present invention, please refer to Fig. 5, the device 5 includes:

The binocular view receiving unit 51 is configured to receive a first perspective view and a second perspective view. Wherein, the first perspective view is obtained by horizontally shifting the selected image in the original view by a predetermined distance to the right, and the second perspective view is obtained by horizontally shifting the selected image in the original view by a predetermined distance to the left obtained, the original view includes at least one image, the image is a two-dimensional view; and,

The VR display unit 52 is configured to perform VR display according to the first perspective view and the second perspective view.

In this embodiment, the binocular view receiving unit 51 first receives the first perspective view and the second perspective view constituting the VR display image, wherein the first perspective view moves the selected image in the original view to the right Obtained by horizontally shifting a predetermined distance, the second perspective view is obtained by horizontally shifting the selected image in the original view by a predetermined distance to the left, the original view includes at least one image, and the image is a two-dimensional view; Then, VR display is performed in the VR display unit 52 according to the first perspective view and the second perspective view, so as to present the spatial three-dimensional layering effect of the image.

It can be seen from the above technical solution that the beneficial effect of the embodiment of the present invention is that: the binocular view receiving unit 51 receives the first perspective view and the second perspective view obtained by offset processing the image in the selected state in the original view, and Presenting the VR image composed of the first perspective view and the second perspective view on the VR display unit 52 can realize the spatial distance comparison between the two-dimensional images, and then present the three-dimensional layering effect of the two-dimensional image. There is no need to embed 3D engine programming in the process, reducing the amount of communication and calculation between applications, and saving the processing resources of smart terminals.

It should be noted that since the aforementioned VR display devices 4 and 5 are based on the same inventive concepts as the VR display methods in Embodiments 1 and 3 respectively, the corresponding contents of method embodiments 1 and 3 are also applicable to device embodiments 4 and 3. Five, no more details here.

Embodiment six

Fig. 6 is a schematic structural diagram of an electronic device provided by Embodiment 6 of the present invention, please refer to Fig. 6, the electronic device 600 includes:

One or more processors 610 and memory 620, one processor 610 is taken as an example in FIG. 6 .

The processor 610 and the memory 620 may be connected through a bus or in other ways, and connection through a bus is taken as an example in FIG. 6 .

The memory 620, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer-executable programs and modules, such as program instructions/programs corresponding to the VR display method in Embodiment 1 of the present invention. Modules (for example, image selection unit 41, binocular view generation unit 42 and display unit 43 shown in FIG. 4). The processor 610 executes various functional applications and data processing of the system by running non-transitory software programs, instructions and modules stored in the memory 620, that is, implements the VR display method in the first method embodiment above.

The memory 620 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the VR display device, and the like. In addition, the memory 620 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some embodiments, the memory 620 may optionally include a memory that is remotely located relative to the processor 610, and these remote memories may be connected to the VR display device through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The one or more modules are stored in the memory 620, and when executed by the one or more processors 610, the method steps 110 to 130 shown in FIG. 1 described in Embodiment 1 may be executed, The functions of units 41-43 in FIG. 4 are realized.

The electronic device 600 can execute the method provided in Embodiment 1 of the present invention, and has corresponding functional modules and beneficial effects for executing the method. For technical details not described in detail in this embodiment, refer to the method provided in Embodiment 1 of the present invention.

In the embodiment of the present invention, the electronic device 600 may exist in various forms, including but not limited to:

(1) Mobile communication equipment: This type of equipment is characterized by mobile communication functions, and its main goal is to provide voice and data communication. Such terminals include: smart phones (such as iPhone), multimedia phones, feature phones, and low-end phones.

(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, with computing and processing functions, and generally also has the characteristics of mobile Internet access. Such terminals include: PDA, MID and UMPC equipment, such as iPad.

(3) Portable entertainment equipment: This type of equipment can display and play multimedia content. Such devices include: audio and video players (such as iPod), handheld game consoles, e-books, as well as smart toys and portable car navigation devices.

(4) Server: A device that provides computing services. The composition of a server includes processors, hard disks, memory, and system buses. , Reliability, security, scalability, manageability and other aspects have high requirements.

(5) Other electronic devices with data interaction function.

Embodiment seven

An embodiment of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, such as a processor in FIG. 6 610, the above-mentioned one or more processors can execute the VR display method in the above-mentioned method embodiment 1, for example, execute the method steps 110 to 130 in FIG. 1 described above, and realize the units 41-43 in FIG. 4 function.

The above-mentioned products can execute the methods provided by the embodiments of the present invention, and have corresponding functional modules and beneficial effects for executing the methods. For technical details that are not exhaustively described in this embodiment, refer to the method provided in the embodiment of the present invention.

The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, and of course also by hardware. Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing related hardware through computer programs, and the programs can be stored in a computer-readable storage medium. During execution, it may include the processes of the embodiments of the above-mentioned methods. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; under the idea of the present invention, the technical features in the above embodiments or different embodiments can also be combined, The steps may be performed in any order, and there are many other variations of the different aspects of the invention as described above, which have not been presented in detail for the sake of brevity; although the invention has been described in detail with reference to the preceding examples, those of ordinary skill in the art The skilled person should understand that it is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the various implementations of the present invention. The scope of technical solutions.

Claims (12)

1. A VR display method, comprising:

determining an image in a selected state in an original view, wherein the original view comprises at least one image, the image is a two-dimensional image, and the image in the selected state is a part of the image;

carrying out cutout processing on the image in the selected state;

horizontally shifting an image in a selected state in the original view by a preset distance to the right to obtain a first view angle view, and horizontally shifting an image in a selected state in the original view by a preset distance to the left to obtain a second view angle view;

performing Virtual Reality (VR) display according to the first perspective view and the second perspective view;

the horizontally shifting the image in the selected state in the original view by a predetermined distance to the right to obtain a first perspective view, and horizontally shifting the image in the selected state in the original view by a predetermined distance to the left to obtain a second perspective view, includes:

horizontally shifting an image in a selected state in the original views by a preset distance to the right and carrying out scaling processing according to a preset scaling multiple, and carrying out scaling processing on images except the image in the selected state in the original views according to the preset scaling multiple so as to obtain a first view angle view, horizontally shifting the image in the selected state in the original views by the preset distance to the left and carrying out scaling processing according to the preset scaling multiple, and carrying out scaling processing on the images except the image in the selected state in the original views according to the preset scaling multiple so as to obtain a second view angle view;

and carrying out reverse scaling processing on the image in the selected state and the images except the image in the selected state according to a preset scaling multiple.

2. The method of claim 1,

the original view comprises at least two images;

the horizontally shifting the image in the selected state in the original view by a predetermined distance to the right and performing scaling processing according to a preset scaling factor to obtain a first view angle view, and horizontally shifting the image in the selected state in the original view by a predetermined distance to the left and performing scaling processing according to a preset scaling factor to obtain a second view angle view, includes:

horizontally shifting an image in a selected state in the original views by a preset distance to the right and carrying out amplification processing according to a preset amplification factor, reducing images except the image in the selected state in the original views by a preset reduction factor to obtain a first view angle view, horizontally shifting the image in the selected state in the original views by a preset distance to the left and carrying out amplification processing according to a preset amplification factor, and reducing the images except the image in the selected state in the original views by a preset reduction factor to obtain a second view angle view;

or,

horizontally shifting the image in the selected state in the original view by a preset distance to the right and carrying out reduction processing according to a preset reduction multiple, amplifying the image except the image in the selected state in the original view by a preset amplification multiple to obtain a first view angle view, horizontally shifting the image in the selected state in the original view by a preset distance to the left and carrying out reduction processing according to a preset reduction multiple, and amplifying the image except the image in the selected state in the original view by a preset amplification multiple to obtain a second view angle view.

3. The method of claim 1,

after the determining the image in the selected state in the original view, before acquiring the first perspective view and the second perspective view, the method further includes:

amplifying the image in the selected state in the original view according to a preset amplification factor to obtain a third view angle view;

performing VR display according to the third perspective view;

the horizontally shifting the image in the selected state in the original view by a predetermined distance to the right to obtain a first perspective view, and the horizontally shifting the image in the selected state in the original view by a predetermined distance to the left to obtain a second perspective view includes:

horizontally shifting the image in the selected state in the third perspective view to the right by a preset distance to obtain a first perspective view, and horizontally shifting the image in the selected state in the third perspective view to the left by a preset distance to obtain a second perspective view;

or,

after the determining the image in the selected state in the original view, before acquiring the first perspective view and the second perspective view, the method further includes:

reducing images except the image in the selected state in the original view according to a preset reduction multiple to obtain a fourth view angle view;

performing VR display according to the fourth view;

the horizontally shifting the image in the selected state in the original view by a predetermined distance to the right to obtain a first perspective view, and the horizontally shifting the image in the selected state in the original view by a predetermined distance to the left to obtain a second perspective view includes:

and horizontally shifting the image in the selected state in the fourth view angle view by a preset distance to the right to obtain a first view angle view, and horizontally shifting the image in the selected state in the fourth view angle view by a preset distance to the left to obtain a second view angle view.

4. The method of claim 1, wherein the VR displaying from the first perspective view and the second perspective view comprises:

and sending the first perspective view and the second perspective view so that a receiving end carries out VR display according to the first perspective view and the second perspective view.

5. The method according to any one of claims 1-4, wherein determining the image in the selected state in the original view comprises:

receiving an image selection instruction of a user;

and determining the image in the selected state in the original view according to the image selection instruction.

6. A VR display device comprising:

the image selecting unit is used for determining an image in a selected state in an original view, wherein the original view comprises at least one image, the image is a two-dimensional image, and the image in the selected state is a part of the image; carrying out cutout processing on the image in the selected state;

the binocular vision image acquisition unit is used for horizontally shifting the image in the selected state in the original view by a preset distance to the right to obtain a first view angle view and horizontally shifting the image in the selected state in the original view by a preset distance to the left to obtain a second view angle view; and the number of the first and second groups,

a display unit configured to perform VR display according to the first perspective view and the second perspective view;

the binocular vision acquiring unit is specifically used for:

horizontally shifting the image in the selected state in the original view by a preset distance to the right and carrying out scaling processing according to a preset scaling multiple so as to obtain a first view angle view, and horizontally shifting the image in the selected state in the original view by the preset distance to the left and carrying out scaling processing according to the preset scaling multiple so as to obtain a second view angle view;

and carrying out reverse scaling processing on the image in the selected state and the images except the image in the selected state according to a preset scaling multiple.

7. The apparatus of claim 6,

the original view comprises at least two images;

the binocular vision acquiring unit is specifically used for:

horizontally shifting an image in a selected state in the original views by a preset distance to the right and carrying out amplification processing according to a preset amplification factor, reducing images except the image in the selected state in the original views by a preset reduction factor to obtain a first view angle view, horizontally shifting the image in the selected state in the original views by a preset distance to the left and carrying out amplification processing according to a preset amplification factor, and reducing the images except the image in the selected state in the original views by a preset reduction factor to obtain a second view angle view;

or,

horizontally shifting the image in the selected state in the original view by a preset distance to the right and carrying out reduction processing according to a preset reduction multiple, amplifying the image except the image in the selected state in the original view by a preset amplification multiple to obtain a first view angle view, horizontally shifting the image in the selected state in the original view by a preset distance to the left and carrying out reduction processing according to a preset reduction multiple, and amplifying the image except the image in the selected state in the original view by a preset amplification multiple to obtain a second view angle view.

8. The apparatus of claim 6,

the device further comprises a first zooming processing unit, which is used for magnifying the image in the selected state in the original view according to a preset magnification factor to obtain a third view angle before the first view angle view and the second view angle view are obtained after the image in the selected state in the original view is determined;

the display unit is further used for performing VR display according to the third perspective view;

the binocular vision acquiring unit is specifically used for:

horizontally shifting the image in the selected state in the third perspective view to the right by a preset distance to obtain a first perspective view, and horizontally shifting the image in the selected state in the third perspective view to the left by a preset distance to obtain a second perspective view;

or,

the device further comprises a second zooming processing unit, which is used for zooming out images except for the image in the selected state in the original view according to a preset zooming-out multiple after the image in the selected state in the original view is determined and before the first view angle view and the second view angle view are acquired, so as to acquire a fourth view angle view;

the display unit is further used for performing VR display according to the fourth perspective view;

the binocular vision acquiring unit is specifically used for:

and horizontally shifting the image in the selected state in the fourth view angle view by a preset distance to the right to obtain a first view angle view, and horizontally shifting the image in the selected state in the fourth view angle view by a preset distance to the left to obtain a second view angle view.

9. The apparatus according to claim 6, wherein the display unit is specifically configured to:

and sending the first perspective view and the second perspective view so that a receiving end carries out VR display according to the first perspective view and the second perspective view.

10. The apparatus according to any one of claims 6 to 9, wherein the image selection unit is specifically configured to:

receiving an image selection instruction of a user;

and determining the image in the selected state in the original view according to the image selection instruction.

11. An electronic device, comprising:

at least one processor; and the number of the first and second groups,

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.

12. A computer-readable storage medium having stored thereon computer-executable instructions for causing a computer to perform the method of any one of claims 1-5.