CN111741343B - Video processing method and device and electronic equipment - Google Patents

Abstract

The embodiment of the present invention relates to the technical field of image processing, and discloses a video processing method and device, and electronic equipment. The video processing method includes: processing the received program media data to obtain compressed video data, and sending the compressed video data to a graphics processing chip, so that the compressed video data can be decoded by the graphics processing chip to obtain panoramic video data; The video data is processed, and the processed panoramic video data is sent to the graphics processing chip. In the present invention, the graphics processing chip can be used to decode the compressed video data, which makes full use of the hardware decoding capability, reduces the hardware configuration requirements, and facilitates popularization on low-configuration hardware; moreover, it does not depend on the Android native framework, which simplifies the playback The program playback process improves the playback and control speed.

Description

Video processing method and device, electronic equipment

technical field

Embodiments of the present invention relate to the technical field of image processing, and in particular, to a video processing method and device, and electronic equipment.

Background technique

In recent years, virtual reality technology (Virtual Reality, referred to as VR) is very hot, and a wide variety of VR products have been produced, such as VR glasses, VR helmets and so on. For different VR products, the VR algorithm may be slightly different, but the technical principle of its implementation is basically the same, all based on the Android native framework.

The inventors have found that there are at least the following problems in the prior art: current VR products have high requirements for hardware configuration, and cannot be popularized on low-configuration hardware; moreover, relying too much on the Android native framework and decoder, the process is complicated and time-consuming. The real-time performance is low.

Contents of the invention

The purpose of the embodiments of the present invention is to provide a video processing method and device, and electronic equipment, which can use a graphics processing chip to decode video compressed data, make full use of hardware decoding capabilities, reduce hardware configuration requirements, and facilitate low-configuration hardware It is suitable for large displays and low-configuration electronic devices, and can realize the playback of high-bit rate (such as 4K, 10bit) VR film sources on low-configuration electronic devices; moreover, it does not depend on the Android native framework, which simplifies Play program playback process, improve the playback and control speed.

In order to solve the above technical problems, the embodiment of the present invention provides a video processing method, including: processing the received program media data to obtain video compression data, and sending the video compression data to a graphics processing chip for graphics processing The chip decodes video compression data to obtain panoramic video data; processes the panoramic video data based on the VR model, and sends the processed panoramic video data to the graphics processing chip.

Embodiments of the present invention also provide a video processing device, including a playback device and a VR toolkit connected to each other; the playback device is used to process the received program media data, obtain video compression data, and send the video compression data to The graphics processing chip is used for the graphics processing chip to decode the compressed video data to obtain the panoramic video data; the VR toolkit is used to process the panoramic video data based on the VR model, and send the processed panoramic video data to the graphics processing chip.

An embodiment of the present invention also provides an electronic device, including the above-mentioned video processing device.

Compared with the prior art, the embodiments of the present invention process the program media data when receiving the program media data to obtain video compression data, and send the video compression data to the graphics processing chip, and the graphics processing chip can The video compression data is decoded to obtain the panoramic video data, and then the panoramic video data is processed based on the VR model, the panoramic video data is rendered to the VR model, and the VR model rendered with the panoramic video data is sent to the graphics processing chip for The graphics processing chip renders the image from the user's perspective to the display screen for display to the user; in the present invention, the graphics processing chip is used to decode the compressed video data, which makes full use of the hardware decoding capability, reduces the hardware configuration requirements, and is convenient for low-configuration Hardware promotion, suitable for large displays and low-configuration electronic devices, capable of playing high-bit rate (such as 4K, 10bit) VR source on low-configuration electronic devices; and, does not depend on the Android native framework, simplifying Streamlined the playback process of the program, and improved the playback and control speed.

In addition, when the viewing angle change parameter is received, the VR model is updated based on the viewing angle changing parameter. In this embodiment, when the viewing angle change parameter input by the user is received, the VR model can be adjusted accordingly, that is, the panoramic video data input to the image processor can be correspondingly adjusted based on the viewing angle adjusted by the user, so that the electronic device can display the adjustment through the display. Video image after viewing angle.

In addition, processing the received program media data to obtain video compression data includes: processing the received program media data to obtain video compression data and program video information.

In addition, before processing the panoramic video data based on the VR model, it also includes: creating a VR model according to the program video information. This implementation manner provides a specific implementation manner of creating a VR model.

In addition, before processing the panoramic video data based on the VR model, it also includes: establishing a binding relationship with a graphics processing chip; and obtaining panoramic video data from the graphics processing chip based on the binding relationship. In this embodiment, panoramic video data is obtained by establishing a binding relationship with the graphics processing chip.

Description of drawings

One or more embodiments are exemplified by the pictures in the corresponding drawings, and these exemplifications do not constitute a limitation to the embodiments. Elements with the same reference numerals in the drawings represent similar elements. Unless otherwise stated, the drawings in the drawings are not limited to scale.

Fig. 1 is according to the specific flow of the video processing method in the first embodiment of the present invention;

Fig. 2 is according to the specific flowchart of the video processing method in the second embodiment of the present invention;

3 is a specific structural diagram of a video processing device according to a third embodiment of the present invention;

FIG. 4 is a schematic diagram of a flow of panoramic video playback by an electronic device according to a third embodiment of the present invention;

Fig. 5 is a specific structural diagram of a playback device in a video processing device according to a fifth embodiment of the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, various implementation modes of the present invention will be described in detail below in conjunction with the accompanying drawings. However, those of ordinary skill in the art can understand that, in each implementation manner of the present invention, many technical details are provided for readers to better understand the present application. However, even without these technical details and various changes and modifications based on the following implementation modes, the technical solution claimed in this application can also be realized. The division of the following embodiments is for the convenience of description, and should not constitute any limitation to the specific implementation of the present invention, and the various embodiments can be combined and referred to each other on the premise of no contradiction.

The first embodiment of the present invention relates to a video processing method, which is applied to electronic devices, such as mobile phones, tablet computers, TV set-top boxes, televisions, etc., and the video processing method of the present invention can be used on the display of the electronic device or in conjunction with the Panoramic video is displayed on a monitor connected to the electronic device. Wherein, the electronic equipment includes a video processing device, and the video processing device includes a playback device and a VR toolkit (ie, VR SDK). The video processing device may be video playback software installed in the electronic device. In addition, the electronic device further includes a graphics processing chip, the graphics processing chip includes a decoder and a graphics processing unit (Graphics Processing Unit, GPU for short), and the playback device is connected to the decoder.

The specific flow of the video processing method in this embodiment is shown in FIG. 1 .

Step 101, process the received program media data to obtain compressed video data, and send the compressed video data to a graphics processing chip, so that the compressed video data can be decoded by the graphics processing chip to obtain panoramic video data.

Specifically, when the video playback software in the electronic device is opened by the user, it will display the program list on the display of the electronic device, and when receiving the program selected by the user from the program list, the playback device in the video playback software will send The play request of the program goes to the preset licensee, the licensee starts the play, creates an instance of the play program, and sends the video address of the program to the playback device; the play device accesses the server based on the video address of the program to obtain the program media data, and then The media data is analyzed to obtain program video information and video compression data. The video compression data is a video code stream, and then the video compression data is sent to the decoder in the graphics processing chip. The decoder can decode the video compression data to obtain Panoramic video data. Wherein, the program video information includes audio and video format, audio and video encoding format, resolution, memory size, and the like. Wherein, the playback device is directly connected to the decoder in the graphics processing chip without going through the codec interface MediaCodec in the Android native framework.

Step 102, process the panoramic video data based on the VR model, and send the processed panoramic video data to a graphics processing chip.

Specifically, the VR toolkit can create a VR model corresponding to the program based on the video information of the program and the Open Graphics Library (IPENGL library for short) configured in the electronic device. The VR model is, for example, a spherical model, a box model etc.

After decoding the panoramic video data, the decoder sends the panoramic video data to the graphics processor GPU, and the VR toolkit obtains the panoramic video data from the graphics processor GPU, and then calls the OPENGL library to process the panoramic video data based on the created VR model. Texture mapping, reprojection and other processing, that is, converting each frame of panoramic video data into RGB format and rendering it on the VR model.

Then, based on the current viewing angle parameters and the model matrix of the VR model, the view matrix of the user's viewing angle is generated, and the VR model rendered with the panoramic video data is sent to the graphics processing unit GPU, and the graphics processing unit GPU can convert the VR model according to the view matrix The panoramic video data under the user's perspective is rendered, and the image under the current user's perspective is output to the display of the electronic device.

In one example, after the playback device parses the program video information from the program media data, it can determine whether the program is a VR program type based on the program video information. If it is determined that the program is a VR program type, the VR toolkit and The graphics processor GPU is bound, and the binding relationship between the two is established, so that the VR toolkit can directly connect with the graphics processor GPU, and capture panoramic video data from the graphics processor GPU. Wherein, the graphics processing chip is generally provided with a chip SDK docked with the VR SDK. In addition, since the VR toolkit is directly connected to the graphics processor GPU, the panoramic video data can be sent to the graphics processor GPU without going through the surface view in the Android native frame.

Compared with the prior art, this embodiment, when receiving the program media data, processes the program media data to obtain video compression data, and sends the video compression data to the graphics processing chip, and the graphics processing chip can process the video The compressed data is decoded to obtain the panoramic video data, and then the panoramic video data is processed based on the VR model, the panoramic video data is rendered to the VR model, and the VR model rendered with the panoramic video data is sent to the graphics processing chip for graphics The processing chip renders the image from the user's perspective to the display screen for display to the user; in the present invention, the graphics processing chip is used to decode the video compressed data, which makes full use of the hardware decoding capability, reduces the hardware configuration requirements, and is convenient for low-configuration hardware It is suitable for large displays and low-configuration electronic devices, and can realize the playback of high-bit rate (such as 4K, 10bit) VR film sources on low-configuration electronic devices; moreover, it does not depend on the Android native framework, which simplifies Play program playback process, improve the playback and control speed.

The second embodiment of the present invention relates to a video processing method. Compared with the first embodiment, the main difference of this embodiment is that the panoramic video data input to the image processor can be correspondingly adjusted based on the angle of view adjusted by the user.

The specific flow of the training process of the video processing method in this embodiment is shown in FIG. 2 .

Step 201, process the received program media data to obtain compressed video data, and send the compressed video data to a graphics processing chip, so that the compressed video data can be decoded by the graphics processing chip to obtain panoramic video data. It is roughly the same as step 101 in the first embodiment, and will not be repeated here.

Step 202, when the angle change parameter is received, update the VR model based on the angle change parameter.

Step 203: Process the panoramic video data based on the VR model, and send the processed panoramic video data to the graphics processing chip.

Specifically, the user can adjust the steering and angle as required. Taking the electronic device as an example of a TV box, the user can adjust the steering and angle through the remote control. When the playback device of the electronic device receives the viewing angle change parameters including steering and angle, it sends the viewing angle changing parameters to the VR toolkit, and the VR toolkit adjusts the VR model based on the viewing angle changing parameters, and uses the updated VR model to The subsequent panoramic video data is processed so that the panoramic video data matches the adjusted viewing angle of the user, and an updated view matrix is generated, so that the graphics processor GPU can output the video image after the adjusted viewing angle based on the updated view matrix to the display.

Compared with the first embodiment, this embodiment can adjust the VR model accordingly when receiving the viewing angle change parameter input by the user, that is, it can adjust the panoramic video data input to the image processor based on the viewing angle adjusted by the user, so that The electronic device can display the video image after the viewing angle is adjusted through the display.

The third embodiment of the present invention relates to a video processing device, which is applied to electronic equipment, such as mobile phones, tablet computers, TV set-top boxes, televisions, etc., and can display panoramic videos on the display of the electronic equipment or a display connected to the electronic equipment. .

Please refer to FIG. 3 , the video processing device 1 includes a playback device 11 and a VR toolkit 12 (ie, VRSDK) connected to each other, and the video processing device may be a video playback software installed in an electronic device. In addition, the electronic device further includes a graphics processing chip 3 , the graphics processing chip 3 includes a decoder 31 and a graphics processor GPU32 (Graphics Processing Unit, GPU for short), and the playback device 11 is connected to the decoder 31 .

In this embodiment, the playback device 11 is used to process the received program media data to obtain compressed video data, and send the compressed video data to the graphics processing chip 3, so that the compressed video data can be decoded by the graphics processing chip 3 to obtain panoramic video data .

The VR toolkit 12 is used to process the panoramic video data based on the VR model, and send the processed panoramic video data to the graphics processing chip 3 .

Specifically, the playback device 11 can process the received program media data to obtain compressed video data, and send the compressed video data to the decoder 31 of the graphics processing chip 3, and the panoramic video data obtained by decoding the compressed video data by the decoder 31 , sending the panoramic video data to the graphics processing unit GPU32, and the VR toolkit 12 acquires the panoramic video data from the graphics processing unit GPU32.

The VR toolkit can create a VR model corresponding to the program according to the video information of the program and the Open Graphics Library (IPENGL for short) configured in the electronic device. The VR model is, for example, a sphere model, a box model, etc., and then based on The created VR model performs texture mapping, reprojection and other processing on the obtained panoramic video data, and sends the processed panoramic video data to the graphics processor GPU32.

In one example, the playback device 11 is used to establish a binding relationship between the VR toolkit and the graphics processing chip before processing the panoramic video data based on the VR model. The graphics processor 32 of 3 acquires the panoramic video data from the decoder 31.

The specific process of playing programs by the video processing apparatus 1 of this embodiment will be described below with reference to FIG. 4 .

When the video player software in the electronic device is opened by the user, it will display the program list on the display 5 of the electronic device. After receiving the program that the user selects to play from the program list, the playback device 31 in the video player software will send the program. The play request of the program is sent to the preset licensee party 4, the licensee party 4 starts playing, creates an instance of the program to be played, and sends the video address of the program to the playback device 11; the playback device 11 accesses the server from the video address of the program to obtain the program media data, and then The program media data is analyzed to obtain the program video information and video compression data, the video compression data is a video code stream, and then the video compression data is sent to the decoder 31 in the graphics processing chip 3, and the decoder 31 can compress the video The data is decoded to obtain panoramic video data. Wherein, the program video information includes audio and video format, audio and video encoding format, resolution, memory size, and the like. Wherein, the playback device is directly connected to the decoder in the graphics processing chip without going through the codec interface MediaCodec in the Android native framework.

The playback device 11 can also initialize the decoder 31 and the image processor 32 after receiving the video address of the program, and bind the VR toolkit 12 and the graphics processor GPU32 to establish a binding relationship between the two, and then the program The video information is sent to the VR toolkit 12, and the VR toolkit 12 can create a VR model corresponding to the program according to the program video information and the Open Graphics Library (IPENGL library for short) configured in the electronic device. The VR model is, for example, It is a sphere model, a box model, etc.

Decoder 31, after decoding the panoramic video data, sends the panoramic video data to the graphics processing unit GPU32, and the VR toolkit 12 directly interfaces with the graphics processing unit GPU32, so as to obtain the panoramic video data from the graphics processing unit GPU32, and then VR Toolkit 12 invokes the OPENGL library based on the created VR model to perform texture mapping, reprojection, and other processing on the acquired panoramic video data, that is, convert each frame of panoramic video data into RGB format, and render it on the VR model.

Then based on the current perspective parameters and the model matrix of the VR model and the view matrix of the user's perspective, the VR model that has rendered the panoramic video data is sent to the graphics processor GPU32, and the graphics processor GPU32 can convert the VR model according to the view matrix. The panoramic video data under the user's perspective is rendered, and the image under the current user's perspective is output to the display 5 of the electronic device.

In this embodiment, the decoding format of the hardware of the decoder 31 can also be extended to support decoding of more video formats and improve user experience.

Compared with the prior art, this embodiment, when receiving the program media data, processes the program media data to obtain video compression data, and sends the video compression data to the graphics processing chip, and the graphics processing chip can process the video The compressed data is decoded to obtain the panoramic video data, and then the panoramic video data is processed based on the VR model, the panoramic video data is rendered to the VR model, and the VR model rendered with the panoramic video data is sent to the graphics processing chip for graphics The processing chip renders the image from the user's perspective to the display screen for display to the user; in the present invention, the graphics processing chip is used to decode the video compressed data, which makes full use of the hardware decoding capability, reduces the hardware configuration requirements, and is convenient for low-configuration hardware It is suitable for large displays and low-configuration electronic devices, and can realize the playback of high-bit rate (such as 4K, 10bit) VR film sources on low-configuration electronic devices; moreover, it does not depend on the Android native framework, which simplifies Play program playback process, improve the playback and control speed.

The fourth embodiment of the present invention relates to a video processing method. Compared with the third embodiment, the main difference of this embodiment is that the panoramic video data input to the image processor can be correspondingly adjusted based on the angle of view adjusted by the user.

Please refer to FIG. 3 , the playback device 11 is also configured to send the viewing angle change parameters to the VR toolkit 12 when receiving the viewing angle changing parameters, and the VR toolkit 12 can update the VR model based on the viewing angle changing parameters.

Specifically, the user can adjust the steering and angle as required. Taking the electronic device as an example of a TV box, the user can adjust the steering and angle through a remote controller. When the playback device 11 of the electronic device receives the angle of view change parameters including steering and angle, it sends the angle of view change parameters to the VR toolkit 12, and the VR toolkit 12 adjusts the VR model based on the angle of view change parameters, and uses the updated The VR model processes the subsequent panoramic video data, so that the panoramic video data matches the adjusted viewing angle of the user, and generates an updated view matrix, so that the graphics processor GPU32 can adjust the viewing angle based on the updated view matrix. The video image is output on the display 5.

Compared with the first embodiment, this embodiment can adjust the VR model accordingly when receiving the viewing angle change parameter input by the user, that is, it can adjust the panoramic video data input to the image processor based on the viewing angle adjusted by the user, so that The electronic device can display the video image after the viewing angle is adjusted through the display.

The fifth embodiment of the present invention relates to a video processing device. Compared with the third embodiment, the main difference of this embodiment is that a specific structure of the playback device 11 is provided.

Please refer to FIG. 5 , the playback device 11 includes: a main control module 111 , a stream control module 112 , a decoding control module 113 and a data analysis module 114 .

The main control module 1 is used to obtain media data from the video address through the stream control module 12 in response to the received program video address. Specifically, the main control module 111 is a control module of the video processing device 1, capable of receiving external operation commands, and controlling the flow control module 112, the decoding control module 113, and the data analysis module 114 based on the operation commands. program video address, the program video address is sent to the flow control module 112, and the flow control module 112 establishes a session with the server based on the program video address, and obtains the media data of the program from the server, and stores it in the preset electronic device. In the buffer, it can support various types of streaming media protocols such as HLS, HTTP, and IGMP.

The decoding control module 113 is used to send the obtained media data to the data analysis module 114, that is, the decoding control module 113 can read the media data from the buffer and send it to the data analysis module 114; in addition, the access code control module 13 also The encoder 31 can be controlled, such as setting the decoder 31 and stopping playback, and relevant information of the decoder 31 is stored in it, such as buffer status, occupancy rate of the current playback, and the like.

Data parsing module 114 is used for processing the program media data that receives, obtains video compression data, and video compression data is sent to the decoder 31 of graphics processing chip, and it can also analyze program video information from media data, program video Information includes audio and video format, audio and video encoding format, resolution, memory size, etc.

In this embodiment, the data analysis module 114 has a unified interface adapted to different image processing chips 3, can start the decoder 31 in the image processing chip 3, set the audio and video format, write audio and video data, start/pause/stop playing , acquiring decoder information and other routine operations to adapt to the image processing chip 3 .

Compared with the first embodiment, this embodiment provides a specific structure of a playback device,

The sixth embodiment of the present invention relates to an electronic device, such as a mobile phone, a tablet computer, a TV set-top box, a TV set, etc., by applying the video processing method of the present invention, it can be displayed on the display of the electronic device or a display connected to the electronic device Show panoramic video.

In this embodiment, the electronic device includes the video processing apparatus in any one of the third to fifth implementation manners.

The electronic device in this embodiment may include at least one processor; and a memory communicatively connected to the at least one processor;

Wherein, the memory stores instructions executable by at least one processor, and the instructions are executed by at least one processor, so that at least one processor can execute the video processing method as in the first or second embodiment.

Wherein, the memory and the processor are connected by a bus, and the bus may include any number of interconnected buses and bridges, and the bus connects one or more processors and various circuits of the memory together. The bus may also connect together various other circuits such as peripherals, voltage regulators, and power management circuits, all of which are well known in the art and therefore will not be further described herein. The bus interface provides an interface between the bus and the transceivers. A transceiver may be a single element or multiple elements, such as multiple receivers and transmitters, providing means for communicating with various other devices over a transmission medium. The data processed by the processor is transmitted on the wireless medium through the antenna, and further, the antenna also receives the data and transmits the data to the processor.

The processor is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interface, voltage regulation, power management, and other control functions. Instead, memory can be used to store data that the processor uses when performing operations.

Compared with the prior art, this embodiment, when receiving the program media data, processes the program media data to obtain video compression data, and sends the video compression data to the graphics processing chip, and the graphics processing chip can process the video The compressed data is decoded to obtain the panoramic video data, and then the panoramic video data is processed based on the VR model, the panoramic video data is rendered to the VR model, and the VR model rendered with the panoramic video data is sent to the graphics processing chip for graphics The processing chip renders the image from the user's perspective to the display screen for display to the user; in the present invention, the graphics processing chip is used to decode the video compressed data, which makes full use of the hardware decoding capability, reduces the hardware configuration requirements, and is convenient for low-configuration hardware It is suitable for large displays and low-configuration electronic devices, and can realize the playback of high-bit rate (such as 4K, 10bit) VR film sources on low-configuration electronic devices; moreover, it does not depend on the Android native framework, which simplifies Play program playback process, improve the playback and control speed.

Those of ordinary skill in the art can understand that the above-mentioned embodiments are specific examples for realizing the present invention, and in practical applications, various changes can be made to it in form and details without departing from the spirit and spirit of the present invention. scope.

Claims (6)

1. A video processing method, characterized in that it is applied to electronic equipment, and the electronic equipment includes a graphics processing chip, a playback device and a VR toolkit, the graphics processing chip includes a decoder, and the playback device is connected to the decoder ; The methods include: Process the received program media data to obtain program video information and video compression data, and when judging that the program is a VR program type based on the program video information, bind the VR toolkit to the graphics processor and The compressed video data is sent to a graphics processing chip for the graphics processing chip to decode the compressed video data to obtain panoramic video data; Obtain the panoramic video data from the graphics processing chip, process the panoramic video data based on a VR model, and render the panoramic video data to the VR model; Based on the current perspective parameters and the model matrix of the VR model and the view matrix for generating the user's perspective, the VR model rendered with panoramic video data is sent to the graphics processing chip, so that the graphics processing chip will acquire the obtained view matrix according to the view matrix. The panoramic video data of the current angle of view on the VR model is rendered and the rendered video image is output to the display of the electronic device; wherein the VR model is pre-created according to the program video information and the open graphics configured in the electronic device; When the viewing angle change parameter for adjusting steering and angle is received, the VR model is updated based on the viewing angle change parameter, and the subsequent panoramic video data is processed using the updated VR model, and the panoramic video data matches the adjusted viewing angle , and generate an updated view matrix and send it to the graphics processing chip, so that the graphics processing chip outputs the video image with an adjusted viewing angle to the display based on the updated view matrix. 2. The video processing method according to claim 1, wherein, before the panoramic video data is processed based on the VR model, further comprising: Establish a binding relationship with the graphics processing chip; The panoramic video data is acquired from the graphics processing chip based on the binding relationship. 3. A video processing device, comprising: an interconnected playback device and a VR toolkit; The playback device is used to process the received program media data to obtain program video information and video compression data, and send the video compression data to a graphics processing chip for the graphics processing chip to decode the video compression data Obtain panoramic video data; The VR toolkit is used to obtain the panoramic video data from the graphics processing chip, process the panoramic video data based on a VR model, and render the panoramic video data to the VR model; based on the current Viewing angle parameters and the model matrix of the VR model and the view matrix generating the user's viewing angle, and sending the VR model rendered with panoramic video data to the graphics processing chip, so that the graphics processing chip converts the obtained VR model according to the view matrix Render the panoramic video data of the current angle of view and output the rendered video image to the display of the electronic device; wherein the VR model is pre-created according to the program video information and the open graphics configured in the electronic device; when receiving the adjustment When changing the angle of view parameters of steering and angle, update the VR model based on the angle of view change parameters, and use the updated VR model to process the subsequent panoramic video data, the panoramic video data matches the adjusted angle of view, and generate an updated The updated view matrix is sent to the graphics processing chip, so that the graphics processing chip outputs the video image with the adjusted viewing angle to the display based on the updated view matrix. 4. The video processing device according to claim 3, wherein the playback device is configured to process the received program media data to obtain video compression data and program video information. 5. The video processing device according to claim 4, wherein the playback device is used to establish the VR toolkit and the graphics processing device before processing the panoramic video data based on the VR model. Chip binding relationship; The VR toolkit is used to acquire the panoramic video data from the graphics processing chip based on the binding relationship. 6. An electronic device, comprising: the video processing device according to any one of claims 3 to 5.

Images