CN105933726A - Virtual reality terminal and video resolution adaptation method and device thereof - Google Patents

Abstract

The embodiment of the invention provides a video resolution adaptation method and device for a virtual reality terminal. The method comprises the steps: obtaining the size of an effective display screen of a display of the virtual reality terminal, and obtaining the target resolution of video play; carrying out the zooming of the play size of a to-be-played video according to the target resolution of video play and the size of the effective display screen of the display of the virtual reality terminal, so as to enable the target resolution of video play to adapt to the size of the effective display screen. According to the embodiment of the invention, the method can achieve adaptive representation on terminal equipment screens in various sizes according to the user's requirements for the video resolution, and enables a user to obtain a comfortable and smooth watch effect.

Description

Adaptation method and device for virtual reality terminal and its video resolution

technical field

The embodiments of the present invention belong to the field of image processing, and in particular relate to a virtual reality terminal and a video resolution adaptation method and device thereof.

Background technique

Virtual reality technology (Virtual Reality, VR) is a virtual world that uses computers to simulate a three-dimensional space, allowing users to generate interactive and immersive experiences through vision and hearing. Virtual reality technology is a computer graphics, It is a comprehensive technology that intersects the fields of human-computer interaction and sensor technology. With the rapid development of computer hardware and network environment, virtual reality technology has developed rapidly and many mature virtual reality systems have emerged, which have a wide range of applications in virtual simulation, geographic information systems, user social interaction, game entertainment, etc. .

The visual system is the most important perception channel of VR. At the same time, the perceptibility of the virtual scene is also the prerequisite for the user to interact with the human-computer in the virtual environment. Therefore, the scene display method and its equipment are the basic components of the human-computer interaction in the VR system. Currently commonly used scene display methods are helmet-mounted, desktop, projection, handheld and autostereoscopic display methods, etc., and each display method includes various types of screen sizes.

In order to present an immersive experience to users on a virtual reality terminal, video content needs to be presented in high resolution, which makes the video file size large, usually exceeding 1GB. If it is downloaded and presented, it will be loaded too slowly on the terminal device, and requires expensive and complicated This is the first factor that affects the experience, so it is considered to transmit the media to the end user through the network.

The video is compressed and encoded and stored on the server side. There are various compression formats and resolution differences, such as standard definition, high definition, ultra-high definition, etc. In order to present video streaming media to users comfortably and smoothly, it is necessary to play videos on various screen sizes and multiple resolutions. Therefore, there is an urgent need for a method and device for adapting video resolution in a virtual reality terminal.

Contents of the invention

In view of this, the embodiments of the present invention provide a virtual reality terminal and a method and device for adapting the video resolution thereof, so that users can play virtual reality videos comfortably and smoothly online.

An embodiment of the present invention provides a method for adapting video resolution in a virtual reality terminal, which includes:

Obtain the effective display screen size of the display in the virtual reality terminal and obtain the target resolution of video playback;

According to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal, the playback size of the video to be played is scaled so that the target resolution of the video playback adapts to the effective display screen size.

Preferably, in an embodiment of the present invention, the effective display screen size of the display in the virtual reality terminal is represented by the length and width pixel values of the effective display screen of the display in the virtual reality terminal.

Preferably, in an embodiment of the present invention, obtaining the target resolution of video playback includes: selecting a video resolution from multiple alternative video resolutions as the target resolution according to transmission speed and available bandwidth.

Preferably, in an embodiment of the present invention, obtaining the target resolution of video playback includes: capturing the user's operation event, and selecting a fixed video resolution from various video resolutions as the target resolution according to the captured operation event Rate.

Preferably, in an embodiment of the present invention, according to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal, the playback size of the video to be played is scaled so that the target resolution of the video playback is Rates adapted to the effective display screen size include:

According to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal, calculate the scaling ratio of the playback size of the video and the unit of the playback size of the zoomed video in the length direction relative to the effective display screen size Side padding or padding on one side in the width direction;

Scale the playback size of the video to be played according to the calculated scaling ratio, and perform double-sided padding in the length direction or width direction on the area on the effective display screen where no video content is played on the effective display screen according to the calculated unilateral padding amount padding on both sides.

An embodiment of the present invention provides an adaptation device for video resolution in a virtual reality terminal, which includes:

The acquisition module is used to obtain the effective display screen size of the display in the virtual reality terminal and obtain the target resolution of the video playback;

A video scaling module, configured to scale the playback size of the video to be played according to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal so that the target resolution of the video playback adapts to the effective display screen size.

Preferably, in an embodiment of the present invention, the effective display screen size of the display in the virtual reality terminal is represented by the length and width pixel values of the effective display screen of the display in the virtual reality terminal.

Preferably, in an embodiment of the present invention, the obtaining module is further configured to adaptively select a video resolution from multiple alternative video resolutions as the target resolution according to the transmission speed and available bandwidth.

Preferably, in an embodiment of the present invention, the acquisition module is further configured to capture user operation events, and select a fixed video resolution from multiple video resolutions as the target resolution according to the captured operation events.

Preferably, in an embodiment of the present invention, the video scaling module is further used to calculate the playback size scaling ratio and The playback size of the zoomed video is relative to the effective display screen size in the length direction of the unilateral padding or in the width direction of the unilateral padding; and scaling the playback size of the video to be played according to the calculated scaling ratio , and perform double-side padding in the length direction or double-side padding in the width direction for the area on the effective display screen where no video content is played, according to the calculated one-side padding amount.

An embodiment of the present invention provides a virtual reality terminal, which includes a display and a processor. The processor is used to obtain the effective display screen size of the display in the virtual reality terminal and obtain the target resolution of video playback, and to distinguish rate and the effective display screen size of the display in the virtual reality terminal, the playback size of the video to be played is scaled so that the target resolution of the video playback adapts to the effective display screen size.

In the embodiment of the present invention, by obtaining the effective display screen size of the display in the virtual reality terminal and obtaining the target resolution of the video playback; and according to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal, the The video to be played is scaled so that the target resolution of the video is adapted to the effective display screen size, so that it can be adaptively presented on the screen of a virtual reality terminal device of various sizes according to the user's requirements for video resolution, so that the user can obtain comfort , Smooth viewing effect.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments described in the present invention, and those skilled in the art can also obtain other drawings based on these drawings.

FIG. 1 is a schematic flowchart of an adaptation method for video resolution in a virtual reality terminal according to an embodiment of the present invention;

Fig. 2 is a schematic flow diagram of selecting one-side filling in Embodiment 2 of the present invention;

FIG. 3 is a schematic flowchart of adaptively selecting a video resolution as a target resolution from multiple alternative video resolutions according to Embodiment 3 of the present invention;

FIG. 4 is a schematic flow diagram of video adjustment in Embodiment 4 of the present invention;

5 is a schematic structural diagram of an adaptive device for video multi-resolution in a virtual reality terminal according to Embodiment 5 of the present invention;

FIG. 6 is a schematic structural diagram of a virtual reality terminal according to Embodiment 6 of the present invention.

detailed description

By obtaining the effective display screen size of the display in the virtual reality terminal and obtaining the target resolution of the video playback; and scaling the video to be played according to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal Adapt the target resolution of the video playback to the effective display screen size, so that it can be adaptively presented on the screens of virtual reality terminal devices of various sizes according to the user's requirements for video resolution, so that the user can obtain a comfortable and smooth viewing effect. Of course , implementing any technical solution of the embodiments of the present invention does not necessarily need to achieve all the above advantages at the same time.

In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, but not all of them. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present invention shall fall within the protection scope of the present invention.

The specific implementation of the present invention will be further described below in conjunction with the accompanying drawings of the present invention.

The present invention provides a method and device for adapting video resolution in virtual reality terminals, which are usually applied in virtual reality video-on-demand networks. If the resolution of the video matches the size of the effective display screen, it will be played directly; if it does not match, the video will be played directly. Then execute the technical solutions of the following embodiments.

Referring to FIG. 1 , it is a schematic flowchart of a method for adapting video resolution in a virtual reality terminal according to an embodiment of the present invention; it may include:

Step S1: Obtain the effective display screen size of the display in the virtual reality terminal and obtain the target resolution of video playback.

Specifically, common resolutions vary according to the ratio (aspect ratio) displayed on the monitor, as detailed below:

Table I

In addition, the resolution is also related to the video definition. The definition includes SD, UHD, HD, broadcast TV and cinema movies. The corresponding resolutions are shown in Table 2:

Table II

Step S2, according to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal, zoom the playback size of the video to be played so that the target resolution of the video playback adapts to the effective display screen size.

In this embodiment, if the target resolution of the video does not match the size of the effective display screen, for example, the target resolution of the video is 1280x720, but the size of the effective display screen is smaller or larger, so that the image exceeds the size of the effective display screen when the video is played. size, or on the contrary only occupies a small area on the effective display screen size, resulting in uncoordinated display, then step S2 can refer to Figure 2, a schematic flow chart of selecting length filling or width filling for Embodiment 2 of the present invention; as shown in Figure 2 shown, which includes:

Step S201: According to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal, calculate the scaling ratio of the playback size of the video and the length of the playback size of the scaled video relative to the effective display screen size One-sided padding in the direction or one-sided padding in the width direction;

Step S202: Scale the playback size of the video to be played according to the calculated scaling ratio, and perform double-sided padding in the length direction on the area on the effective display screen where no video content is played according to the calculated one-sided padding amount or double-sided padding in the width direction.

Referring to FIG. 3 , it is a schematic flow diagram of adaptively selecting a resolution as the target resolution from multiple alternative video resolutions in Embodiment 3 of the present invention; in this embodiment, when obtaining the target resolution of video playback, according to the transmission speed and the available bandwidth, adaptively select a video resolution from multiple alternative video resolutions as the target resolution.

Specifically, for a video file that can correspond to multiple resolutions a/b/c, calculate the specific code rate that can be adopted according to the transmission speed and available bandwidth, and select one from multiple alternative video resolutions according to the specific code rate value Video target resolution to increase or decrease the amount of data transfer. For example, if the network bandwidth is sufficient, the bit rate value is large, and high-resolution video files are used to provide more realistic virtual reality videos; if the network bandwidth decreases, the bit rate value is small, and low-resolution video files are used to reduce data delay. , to reduce the discomfort such as dizziness caused by virtual reality video delay.

Alternatively, the target resolution can also be determined according to the user's selection, that is, the user's operation event is captured when the target resolution of the video playback is obtained in step S1, and a fixed resolution is selected from multiple video resolutions according to the captured operation event. Video resolution as target resolution. For example, there are multiple video target resolution options on the display interface for the user to choose, and details will not be repeated here.

In this implementation, when the effective display screen size of the display in the virtual reality terminal is obtained in step S1, the length and width pixel values of the effective display screen of the display in the virtual reality terminal are used to represent the effective display screen size.

Set the display screen length pixel value to X, the display screen width pixel value to Y, set the video length pixel value to Xv, the video width pixel value to Yv, the video resolution to Xv*Yv, and the zoom ratio to scale , the target resolution is Scale*Xv*Yv; the one-side filling amount in the length direction is set to offsetX, and the one-side filling amount in the width direction is offsetY, then step S2 may include steps S401-S407 in Figure 4, see Figure 4, It is a schematic flow diagram of video adjustment in Embodiment 4 of the present invention; as shown in FIG. 4 , it includes:

Step S401: Calculate Sw=X·Yv/Xv,

Step S402: judging the size relationship between Sw and Y;

If Sw is less than Y, then perform step S403; if Sw is greater than Y, then perform step S404; if Sw is equal to Y, then think that the resolution of the video matches the effective display screen size, and there is no need to zoom and fill;

Step S403: Perform double-sided padding in the width direction on the area on the effective display screen where no video content is played, and this adjustment process ends;

When filling in step S403, first calculate scaling scale=Y/Yv, then calculate the unilateral filling amount offsetY=(Y-Yv scale)/2 in the width direction according to the scaling scale calculated, there is no video on the effective display screen The width direction of the area where the content is played is filled with a black border whose width is equal to offsetY=(Y-Yv scale)/2;

Step S404: Perform double-sided padding in the length direction on the area on the effective display screen where no video content is played, and this adjustment process ends.

Step S404 can first calculate the scaling ratio scale=X/Xv when filling, and calculate the one-sided filling amount offsetX=(X-Xv·scale)/2 in the length direction according to the calculated scaling ratio, so that there is no The length direction of the area where the video content is played is filled with black borders whose length is equal to offsetX=(X−Xv·scale)/2.

Referring to FIG. 5 , it is a schematic structural diagram of an adaptive device for multi-resolution video in a virtual reality terminal according to Embodiment 5 of the present invention, which includes: an acquisition module 501 and a video scaling module 502 coupled to each other, wherein:

Obtaining module 501, for obtaining the effective display screen size of the display in the virtual reality terminal and obtaining the target resolution of video playback;

The video scaling module 502 is configured to scale the playback size of the video to be played according to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal so that the target resolution of the video playback adapts to the effective display screen size. Displays the screen size.

In this embodiment, or in any other embodiment, the effective display screen size of the display in the virtual reality terminal is represented by the length and width pixel values of the effective display screen of the display in the virtual reality terminal.

In this embodiment, or in any other embodiment, the acquisition module 501 is further configured to adaptively select a video resolution from multiple alternative video resolutions as the target resolution according to the transmission speed and available bandwidth.

In this embodiment, or in any other embodiment, the acquisition module 501 is further configured to capture user operation events, and select a fixed video resolution from multiple video resolutions as the target resolution according to the captured operation events. Rate.

In this embodiment, or in any other embodiment, the video scaling module is further configured to calculate the playback size scaling ratio of the video according to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal and the playback size of the zoomed video relative to the effective display screen size in the length direction of the unilateral padding or in the width direction of the unilateral padding; and according to the calculated zoom ratio, the playback size of the video to be played is Scaling, and performing double-side padding in the length direction or double-side padding in the width direction for the area on the effective display screen where no video content is played, according to the calculated one-side padding amount.

In this embodiment, for a detailed explanation of further or specific functions of the acquisition module 501 and the video scaling module 502, please refer to the above-mentioned FIGS. 1-4 , and details will not be repeated here.

Referring to FIG. 6, it is a schematic structural diagram of a virtual reality terminal according to Embodiment 6 of the present invention; as shown in FIG. The target resolution for playback, and according to the target resolution for video playback and the effective display screen size of the display in the virtual reality terminal, the playback size of the video to be played is scaled so that the target resolution for video playback adapts to the effective display screen size. Displays the screen size.

Preferably, in any embodiment of the present invention, the effective display screen size of the display in the virtual reality terminal is characterized by the length and width pixel values of the effective display screen of the display in the virtual reality terminal.

Preferably, in any embodiment of the present invention, the processor 602 is further configured to adaptively select a video resolution from multiple alternative video resolutions as the target resolution according to the transmission speed and available bandwidth.

Preferably, in any embodiment of the present invention, the processor 602 is further configured to capture user operation events, and select a fixed video resolution from multiple video resolutions as the target resolution according to the captured operation events. Rate.

Preferably, in any embodiment of the present invention, the processor 602 is further configured to calculate the playback size scaling ratio of the video according to the target resolution of the video playback and the effective display screen size of the display in the virtual reality terminal and the playback size of the zoomed video relative to the effective display screen size in the length direction of the unilateral padding or in the width direction of the unilateral padding; and according to the calculated zoom ratio, the playback size of the video to be played is Scaling, and performing double-side padding in the length direction or double-side padding in the width direction for the area on the effective display screen where no video content is played, according to the calculated one-side padding amount.

In this embodiment, for detailed explanations about further or specific functions of the processor 602, please refer to the above-mentioned FIG. 1-FIG.

In the above embodiments of the present invention, the virtual reality terminal may be a virtual reality helmet or virtual reality glasses, and the virtual reality terminal may include one display or two displays.

Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, devices (devices), or computer program products. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices) and computer program products according to embodiments of the invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow diagram procedure or procedures and/or block diagram procedures or blocks.

While preferred embodiments of the invention have been described, additional changes and modifications to these embodiments can be made by those skilled in the art once the basic inventive concept is appreciated. Therefore, it is intended that the appended claims be construed to cover the preferred embodiment as well as all changes and modifications which fall within the scope of the invention. Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and equivalent technologies thereof, the present invention also intends to include these modifications and variations.

Claims (11)

1. the adaptive method of video resolution in a virtual reality terminal, it is characterised in that including:

Obtain effective display screen size of display in virtual reality terminal and obtain the mesh of video playback Mark resolution；

Effective display of display in target resolution according to described video playback and virtual reality terminal Screen size, zooms in and out so that the target resolution of video playback to the broadcasting size of video to be play Adapt to described effective display screen size.

Method the most according to claim 1, it is characterised in that show in described virtual reality terminal Effective display screen size of device uses the length and width of effective display screen of display in virtual reality terminal Pixel value characterizes.

Method the most according to claim 1, it is characterised in that the target obtaining video playback is differentiated Rate includes: according to transmission speed and available bandwidth, choose a video and divide from alternative various video is differentiated Resolution is as target resolution.

Method the most according to claim 1, it is characterised in that the target obtaining video playback is differentiated Rate includes: the Action Events of capture user, according to the Action Events captured, from various video resolution Middle selection one fixed video resolution is as target resolution.

5. according to the arbitrary described method of claim 1-4, it is characterised in that according to described video playback Target resolution and virtual reality terminal in effective display screen size of display, to be play The broadcasting size of video zooms in and out so that the target resolution of video playback adapts to described effective display screen Size includes:

Effective display of display in target resolution according to described video playback and virtual reality terminal Screen size, the broadcasting size calculating the video after video being play size scaling ratio and scaling is relative In described effective display screen size at the unilateral loading of length direction or in the unilateral filling of width Amount；

According to calculated scaling, the broadcasting size of video to be play is zoomed in and out, Yi Jigen According to calculated unilateral loading, the region that described effective display screen is play without video content is entered The bilateral in line length direction is filled or the bilateral of width is filled.

6. the adaptive device of video resolution in a virtual reality terminal, it is characterised in that including:

Acquisition module, it is thus achieved that in virtual reality terminal, effective display screen size and the acquisition of display regard The target resolution that frequency is play；

Video scaling module, for the target resolution according to described video playback and virtual reality terminal Effective display screen size of middle display, zooms in and out so that regarding the broadcasting size of video to be play The target resolution that frequency is play adapts to described effective display screen size.

Device the most according to claim 6, it is characterised in that show in described virtual reality terminal Effective display screen size of device uses the length and width of effective display screen of display in virtual reality terminal Pixel value characterizes.

Device the most according to claim 6, it is characterised in that described acquisition module is further used for According to transmission speed and available bandwidth, from alternative various video is differentiated, self adaptation chooses a video resolution Rate is as target resolution.

Device the most according to claim 6, it is characterised in that described acquisition module is further used for The Action Events of capture user, according to the Action Events captured, selects one from various video resolution Fixed video resolution is as target resolution.

10. according to the arbitrary described device of claim 6-9, it is characterised in that described video scaling mould Block is further used for display in the target resolution according to described video playback and virtual reality terminal Effectively display screen size, calculates the broadcasting of the video after video is play size scaling ratio and scaling Size relative to described effective display screen size at the unilateral loading of length direction or at width Unilateral loading；And according to calculated scaling, the broadcasting size of video to be play is carried out Scaling, and according to calculated unilateral loading, on described effective display screen without video content The region play carries out the bilateral of length direction and fills or the bilateral filling of width.

11. 1 kinds of virtual reality terminals, it is characterised in that include display, processor, processor is used In obtaining effective display screen size of display in virtual reality terminal and obtaining the target of video playback Resolution, and according to display in the target resolution of described video playback and virtual reality terminal Effectively display screen size, zooms in and out so that the mesh of video playback to the broadcasting size of video to be play Effective display screen size described in mark resolution adaptation.