CN115695888A - Video processing method and device and storage medium - Google Patents

Abstract

The application relates to a video processing method, a video processing device and a storage medium, wherein the method comprises the following steps: creating a sub-process for a memory space applied by a server based on a main process, wherein the sub-process is used for video playing; creating canvas surface required by video playing on the sub-process, and drawing UI elements on the canvas; and acquiring video playing capacity, and displaying the UI elements drawn on the canvas of the sub-process in the main process based on the video playing capacity. By the method and the device, the problem that in the prior art, the homepage process and the player process exist in the same process, and the player loading consumes a large number of resources to influence the operation smoothness and the loading speed of the homepage is solved.

Description

Video processing method, device and storage medium

technical field

The present application relates to the computer field, and in particular to a video processing method, device and storage medium.

Background technique

In the prior art, the small window on the homepage plays video because the homepage and the player exist in the same process. Because the player loads and releases a large amount of performance and resources, the operation of the homepage is blocked in the same process, that is, the operation of the homepage is not smooth. And the home page operation and message distribution are stuck when the broadcast starts to load playback resources, and the home page user interface (UserInterface, UI) drawing or function loading is slow.

For the above-mentioned problems in related technologies, there is no effective solution at present.

Contents of the invention

This application provides a video processing method, device and storage medium to solve the problem that in the prior art, the home page process and the player process exist in the same process, and the operation fluency and loading speed of the home page are affected due to the player loading and consuming a lot of resources The problem.

In the first aspect, the present application provides a video processing method, including: creating a sub-process based on the memory space applied by the main process to the server, wherein the sub-process is used for video playback; creating a playback process on the sub-process The canvas surface required by the video, and draw UI elements on the canvas; obtain the video playback capability, and display the UI elements drawn on the canvas of the sub-process in the main process based on the video playback capability.

In a second aspect, the present application provides a video processing device, including: a creation module for creating a sub-process based on the memory space applied by the main process to the server, wherein the sub-process is used for video playback; the first processing A module, configured to create a canvas surface required for playing video on the subprocess, and draw UI elements on the canvas; a second processing module, configured to obtain video playback capabilities, and based on the video playback capabilities in the The UI elements drawn on the canvas of the sub-process are displayed in the main process.

In a third aspect, an electronic device is provided, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory complete mutual communication through the communication bus;

memory for storing computer programs;

The processor is configured to implement the method steps described in any one embodiment of the first aspect when executing the program stored in the memory.

In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the method steps described in any one embodiment of the first aspect are implemented.

Compared with the prior art, the above-mentioned technical solutions provided by the embodiments of the present application have the following advantages:

In the method provided by the embodiment of the present application, in the embodiment of the present application, the sub-process and the main process used to play the video are two separate processes, and a canvas is created on the separate sub-process, and UI elements are drawn on the canvas, After obtaining the video playback capability, the UI elements drawn on the canvas of the sub-process can be displayed in the main process. That is to say, the sub-process can play video independently without consuming or occupying the resources of the main process, which improves to a certain extent. The main process loads smoothly and the operation is silky smooth, thereby solving the problem in the prior art that the home page process and the player process exist in the same process, and the operation fluency and loading speed of the home page are affected due to the large amount of resources consumed by the player loading.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, In other words, other drawings can also be obtained from these drawings without paying creative labor.

FIG. 1 is a schematic flowchart of a video processing method provided in an embodiment of the present application;

FIG. 2 is a schematic structural diagram of a video processing device provided in an embodiment of the present application;

FIG. 3 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, but not all of them. Based on the embodiments in the present application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present application.

Fig. 1 is a schematic flow chart of a video processing method provided in the embodiment of the present application. As shown in Fig. 1, the steps of the method include:

Step 102, create a sub-process based on the memory space applied by the main process to the server, wherein the sub-process is used for video playback;

It should be noted that the application scenario of the main process and the sub-process in the embodiment of the present application can be a window (sub-process) on the home page (main process), and the window can be a pop-up window on the home page, or it can be in multiple windows on the home page One of them, taking the TV homepage as an example, currently there will be multiple windows on the TV homepage to display multiple contents, for example, some windows display the currently popular TV series, some windows display the current popular variety shows, and some windows Push advertisements, etc. That is to say, the main process in the embodiment of the present application is the TV homepage, and the sub-processes are windows for displaying TV dramas and variety shows. That is to say, the main process in the embodiment of the present application can separately apply for memory space for multiple sub-processes, that is, each sub-process can have a separate memory space. In addition, the main process and sub-processes in the embodiment of the present application are processes in the Android system.

Step 104, create a canvas surface required for playing video on the child process, and draw UI elements on the canvas;

It should be noted that Surface is an object pointing to video memory and used to be drawn on the screen. All the windows you can see have Surfaces that can be drawn on them. In Android, the system uses Surface Flinger service to set Surface according to The depth information is rendered to the final screen. A Surface generally has more than one (usually 2) buffer units (back buffer (back buffer) and front buffer (front buffer)), the system usually renders in the back buffer, and exchanges with the front buffer after completion, so that the display to the screen for smooth display.

The UI element is the View in the window. A window has only one View Hierarchy (view hierarchy), and these View Hierarchies provide all the performance in the window.

Step 106, acquire the video playback capability, and display the UI elements drawn on the canvas of the sub-process in the main process based on the video playback capability.

It should be noted that the video playback capability refers to the video decoding capability, and the video decoding capability is obtained from the local native layer of the system.

Through the above steps 102 to 106, in the embodiment of the present application, the sub-process and the main process used to play video are two separate processes, and a canvas is created on a separate sub-process, and UI elements are drawn on the canvas, through After obtaining the video playback capability, the UI elements drawn on the canvas of the sub-process can be displayed in the main process. That is to say, the sub-process can play video independently without consuming or occupying the resources of the main process, which improves the process to a certain extent. The smooth loading of the main process and the smooth operation solve the problem in the prior art that the home page process and the player process exist in the same process, and the operation fluency and loading speed of the home page are affected due to the large amount of resources consumed by the player loading.

In an optional implementation of the embodiment of the present application, the manner of obtaining the video playback capability involved in the above step 106 may further include: obtaining the video decoding capability from a local service, and drawing the decoding capability on the canvas.

It should be noted that the video decoding capability includes video decoding capability (VideoCodec, VCodec) and audio decoding capability (AudioCodec, ACodec), and the decoding capability is drawn on the canvas, so that the child process has the Function.

In an optional implementation of the embodiment of the present application, the method of displaying the UI elements drawn on the canvas of the sub-process in the main process based on the video playback capability involved in the above step 106 may further include:

Step 11, create an Android Interface Definition Language (Android Interface Definition Language, AIDL), and associate subprocesses and main processes based on AIDL, wherein the associated subprocesses and main processes can perform communication interaction and data interaction;

Step 12, display the UI elements drawn on the canvas of the sub-process in the main process based on AIDL.

It should be noted that, in order to enable other application programs to access the services provided by this application program, the Android system adopts a remote procedure call (Remote Procedure Call, RPC) method to implement. Like many other RPC-based solutions in this embodiment of the application, if the main process and sub-processes are applied to Android, then Android can use Interface Definition Language (Interface Definition Language, IDL) to expose the interface of the service, for example, you can use Android The four Android application components in: Activity, BroadcastReceiver, ContentProvider and Service can be accessed across processes. Further, for service, the main process and child process can be bound through bindservice.

Further, for the method of associating the sub-process and the main process based on AIDL involved in the above step 11, it may further be: create a player encapsulation interface and an operation interface for the sub-process based on AIDL.

Based on this encapsulation interface, it is possible to encapsulate the ability of the player after the child process draws it. The operation interface can be to realize the operation of the main process on the child process after the child process is associated with the main process. For example, if the player is played in the current child process To accelerate the video, the main process can control the sub-process to accelerate the playback of the video, or if you need to pause the video played in the current sub-process, you can control the sub-process to pause the video through the main process. That is to say, after associating the main process and the sub-process, the sub-process can be controlled through the main process.

In an optional implementation of the embodiment of the present application, the method of creating the canvas surface required to play the video involved in the above step 104 and drawing UI elements on the canvas may further include:

Step 21, draw the UI elements required by the child process, and create a player container View based on the UI elements;

Step 22, create a canvas associated with the player container View, and draw the player container View on the canvas.

Based on the above steps 21 and 22, during the video playback process, the sub-process can play two areas of the interface: the player container View and the content View. The player container is shared between list and detail pages. When the child process surface starts for the first time, create a surface that only contains the player container View. When playing the video, draw the content Vie into the player container to realize the list playback; when the child process is running, the player The container View animation moves to the top, creates and loads the content view of the details page; when the child process is not running, removes the content View of the details page from the surface, and moves the player container to the corresponding position in the list.

The following describes the application in conjunction with the specific implementation of the embodiment of the application. The specific implementation provides a cross-process video playback method. The steps of the method include:

Step 201, the client (main process) applies for memory space to create a player process (subprocess);

Among them, the memory village can be opened up through the processbuilder application to create a new process.

Step 202, draw Android standard UI, and create player container view;

Step 203, create a surface based on the player container view;

Step 204, drawing the playback capability of the video in the surface, to obtain the player in the player process;

Step 205, creating AIDL to provide communication services and data interaction services between the player process and the client process;

Step 206, displaying the UI drawn in the player process in the client process.

It can be seen from the above steps 201 to 206 that in this specific embodiment, since the client process and the player process are two separate processes, the separate process attached to the client process realizes player operation and rendering and drawing movie playback, Thus, the impact of player resource consumption on the client process is stripped away, so that player resource consumption will not be heavily occupied and blocked by the player. Therefore, the specific implementation of the present application makes the loading smoother and the operation more silky, and in this specific implementation, the player progress can be played separately from the home page application.

Corresponding to the above-mentioned Figure 1, the embodiment of the present application also provides a video processing device, as shown in Figure 2, the device includes:

Creating module 22, for creating sub-processes based on the memory space applied by the main process to the server, wherein the sub-processes are used for video playback;

The first processing module 24 is used to create a canvas surface required for playing video on the subprocess, and draw UI elements on the canvas;

The second processing module 26 is configured to obtain the video playback capability, and display the UI elements drawn on the canvas of the sub-process in the main process based on the video playback capability.

In the embodiment of this application, the sub-process and the main process used to play video are two separate processes, and a canvas is created on a separate sub-process, and UI elements are drawn on the canvas. After obtaining the video playback capability, the main process can be The UI elements drawn on the canvas of the sub-process are displayed in the process, that is to say, the sub-process can play video independently without consuming or occupying the resources of the main process, which improves the smooth loading and operation of the main process to a certain extent. Silky smooth, thereby solving the problem that the home page process and the player process exist in the same process in the prior art, and the operation fluency and loading speed of the home page are affected because the player loads and consumes a lot of resources

Optionally, the second processing module 26 in the embodiment of the present application may further include: a first processing unit, configured to acquire video decoding capabilities from local services, and draw the decoding capabilities on the canvas.

It should be noted that the video decoding capability includes video decoding capability (VideoCodec, VCodec) and audio decoding capability (AudioCodec, ACodec), and the decoding capability is drawn on the canvas, so that the child process has the Function.

Optionally, the second processing module 26 in the embodiment of the present application may further include: a second processing unit, configured to create the Android interface definition language AIDL, and associate the subprocess and the main process based on the AIDL, wherein the associated subprocess It can communicate and interact with the main process and interact with data; the display unit is used to display UI elements drawn on the canvas of the sub-process in the main process based on AIDL.

It should be noted that, in order to enable other application programs to access the services provided by this application program, the Android system adopts a remote procedure call (Remote Procedure Call, RPC) method to implement. In the embodiment of the present application, like many other RPC-based solutions, if the main process and sub-processes are applied to Android, then Android can use Interface Definition Language (Interface Definition Language, IDL) to expose the interface of the service, for example, you can use Android The four Android application components in: Activity, BroadcastReceiver, ContentProvider and Service can be accessed across processes. Further, for service, the main process and child process can be bound through bindservice.

Optionally, the second processing unit in the embodiment of the present application may further include: creating a player encapsulation interface and an operation interface for the sub-process based on AIDL.

Based on this encapsulation interface, it is possible to encapsulate the ability of the player after the child process draws it. The operation interface can be to realize the operation of the main process on the child process after the child process is associated with the main process. For example, if the player is played in the current child process To accelerate the video, the main process can control the sub-process to accelerate the playback of the video, or if you need to pause the video played in the current sub-process, you can control the sub-process to pause the video through the main process. That is to say, after associating the main process and the sub-process, the sub-process can be controlled through the main process.

Optionally, the first processing module in the embodiment of the present application includes: a third processing unit, configured to draw UI elements required by the sub-process, and create a player container View based on the UI elements; a fourth processing unit, configured to create The canvas associated with the player container View, and the player container View is drawn on the canvas.

It can be seen that during the video playback process, the child process can play two areas of the interface: the player container View and the content View. The player container is shared between list and detail pages. When the child process surface starts for the first time, create a surface that only contains the player container View. When playing the video, draw the content Vie into the player container to realize the list playback; when the child process is running, the player The container View animation moves to the top, creates and loads the content view of the details page; when the child process is not running, removes the content View of the details page from the surface, and moves the player container to the corresponding position in the list.

As shown in Figure 3, the embodiment of the present application provides an electronic device, including a processor 111, a communication interface 112, a memory 113, and a communication bus 114, wherein, the processor 111, the communication interface 112, and the memory 113 are completed through the communication bus 114 mutual communication,

Memory 113, used to store computer programs;

In one embodiment of the present application, the processor 111 is used to implement the video processing method provided by any one of the foregoing method embodiments when executing the program stored in the memory 113, and its functions are similar, here No longer.

The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the video processing method provided in any one of the foregoing method embodiments are implemented.

It should be noted that in this article, relative terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these No such actual relationship or order exists between entities or operations. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

The above descriptions are only specific embodiments of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Accordingly, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims (10)

1. A method for processing video, comprising:

creating a sub-process for a memory space applied by a server based on a main process, wherein the sub-process is used for video playing;

creating canvas surface required by video playing on the sub-process, and drawing UI elements on the canvas;

and acquiring video playing capacity, and displaying the UI elements drawn on the canvas of the sub-process in the main process based on the video playing capacity.

2. The method of claim 1, wherein the obtaining the video playing capability comprises:

and acquiring the decoding capability of the video from a local service, and drawing the decoding capability in the canvas.

3. The method of claim 1, wherein displaying the UI element drawn on the canvas of the child process in the host process based on the video playback capability comprises:

creating an android interface definition language AIDL, and associating the sub-process and the main process based on the AIDL, wherein the associated sub-process and the main process can perform communication interaction and data interaction;

and displaying the UI elements drawn on the canvas of the sub-process in the main process based on the AIDL.

4. The method of claim 3, wherein the associating the sub-process and the master-process based on the AIDL comprises:

and creating a player packaging interface and an operation interface for the sub-process based on the AIDL.

5. The method of claim 1, wherein creating a canvas surface required for playing a video and drawing a UI element on the canvas comprises:

drawing UI elements required by the sub-process, and creating a player container View based on the UI elements;

creating the canvas associated with the player container View, and drawing the player container View on the canvas.

6. An apparatus for processing video, comprising:

the system comprises a creation module, a storage module and a processing module, wherein the creation module is used for creating a subprocess to a memory space applied by a server based on a main process, and the subprocess is used for playing videos;

the first processing module is used for creating a canvas surface required by video playing on the subprocess and drawing a UI element on the canvas;

and the second processing module is used for acquiring the video playing capacity and displaying the UI elements drawn on the canvas of the sub-process in the main process based on the video playing capacity.

7. The apparatus of claim 6, wherein the second processing module comprises:

and the first processing unit is used for acquiring the decoding capability of the video from a local service and drawing the decoding capability in the canvas.

8. The apparatus of claim 6, wherein the second processing module comprises:

the second processing unit is used for creating an android interface definition language AIDL and associating the sub-process with the main process based on the AIDL, wherein the associated sub-process and the main process can perform communication interaction and data interaction;

and the display unit is used for displaying the UI elements drawn on the canvas of the sub-process in the main process based on the AIDL.

9. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any one of claims 1 to 5 when executing a program stored in the memory.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 5.

Images