WO2021008390A1

WO2021008390A1 - Image layer processing method and apparatus, electronic device, and computer-readable medium

Info

Publication number: WO2021008390A1
Application number: PCT/CN2020/100199
Authority: WO
Inventors: 胡杰
Original assignee: Oppo广东移动通信有限公司
Priority date: 2019-07-17
Filing date: 2020-07-03
Publication date: 2021-01-21
Also published as: CN110362186A; CN110362186B

Abstract

An image layer processing method and apparatus, an electronic device, and a computer-readable medium, relating to the technical field of video processing. The method comprises: obtaining image layers to be synthesized; obtaining the battery power of an electronic device; determining whether the battery power is below a preset threshold; and if yes, invoking a multimedia display processor to perform a synthesis operation on the image layers to be synthesized. Because power consumption of a multimedia display processor is lower, using a multimedia display processor to synthesize image layers to be synthesized can reduce electricity consumption, thereby making the battery more durable and the image synthesis mode more reasonable.

Description

Layer processing method, device, electronic equipment and computer readable medium

Cross references to related applications

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on July 17, 2019, with the application number CN201910647104.4 and titled "a layer processing method, device, electronic equipment and computer readable medium". The entire content is incorporated into this application by reference.

Technical field

This application relates to the field of video processing technology, and more specifically, to a layer processing method, device, electronic equipment, and computer readable medium.

Background technique

With the development of electronic technology and information technology, more and more devices can play video. In the process of video playback, the device needs to perform operations such as decoding, rendering, and compositing on the video, and then display it on the display. Among them, you can use a graphics processor (Graphics Processing Unit, GPU) or a multimedia display processor (Multimedia Display Processor). , MDP) to perform image synthesis operations. However, in the existing video playback technology, the image synthesis method is not reasonable enough.

Summary of the invention

This application proposes a layer processing method, device, electronic equipment and computer readable medium to improve the above-mentioned defects.

In the first aspect, an embodiment of the present application provides a layer processing method, which is applied to an electronic device, the electronic device includes a multimedia display processor, and the method includes: obtaining a layer to be synthesized; and obtaining information about the electronic device Battery power; determine whether the battery power is less than a preset threshold; if it is less than the preset threshold, call the multimedia display processor to perform a synthesis operation on the layer to be synthesized.

In the second aspect, the embodiments of the present application also provide a layer processing device, which is applied to an electronic device, the electronic device includes a multimedia display processor, and the layer processing device includes: an acquisition unit, a determination unit, a judgment unit, and Processing unit. The obtaining unit is used to obtain the layer to be synthesized. The determining unit is used to obtain the battery power of the electronic device. The judging unit is used to judge whether the battery power is less than a preset threshold. The processing unit is configured to call the multimedia display processor to perform a synthesis operation on the layer to be synthesized if it is less than a preset threshold.

In a third aspect, an embodiment of the present application also provides an electronic device, including: one or more processors; a memory; a multimedia display processor; one or more application programs, wherein the one or more application programs are stored In the memory and configured to be executed by the one or more processors, the one or more programs are configured to execute the above method.

In a fourth aspect, an embodiment of the present application also provides a computer-readable medium. The computer-readable storage medium stores program code, and the program code can be invoked by a processor to execute the foregoing method.

Compared with the prior art, the layer processing method, device, electronic equipment, and computer readable medium provided in this application must also obtain the battery power of the electronic device when acquiring the layer to be synthesized. If the battery power is less than the expected If the threshold is set, the multimedia display processor is called to perform the synthesis operation on the layer to be synthesized. Since the power consumption of the multimedia display processor is lower, the layer to be synthesized is synthesized by the multimedia display processor It can reduce power consumption, make the battery more durable, and make the image synthesis method more reasonable.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

Figure 1 shows a logical framework diagram of image processing provided by an embodiment of the present application;

FIG. 2 shows a method flowchart of a layer processing method provided by an embodiment of the present application;

FIG. 3 shows a schematic diagram of layers provided by an embodiment of the present application;

FIG. 4 shows a method flowchart of a layer processing method provided by another embodiment of the present application;

FIG. 5 shows a method flowchart of a layer processing method provided by still another embodiment of the present application

FIG. 6 shows a schematic diagram of the location of a charging device provided by an embodiment of the present application;

Fig. 7 shows a block diagram of a layer processing apparatus provided by an embodiment of the present application;

FIG. 8 shows a block diagram of a layer processing apparatus provided by another embodiment of the present application;

FIG. 9 shows a structural block diagram of an electronic device provided by an embodiment of the present application;

Fig. 10 shows a storage unit for storing or carrying program code for implementing the layer processing method according to the embodiment of the present application.

Detailed ways

In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

Please refer to FIG. 1, which shows a logical framework diagram of image processing provided by an embodiment of the present application.

The application (application) can create a window (window) through the window manager (Windows manager). The window manager creates a Surface for each window to draw various elements that need to be displayed on it. Each surface corresponds to a layer, namely You can draw a layer on each surface.

In the display interface (such as Activity), multiple layers can be included, such as navigation bar, status bar, program interface, etc. Each layer is drawn on the corresponding surface, that is, the corresponding layer is drawn on each surface. Specifically, it can be performed on the canvas provided by the surface through the hardware accelerated renderer (HWUI) and/or the Skia graphics library. Layer drawing.

The system then uses the layer transfer module (Surface Flinger) service to synthesize each surface, that is, synthesize each layer. Among them, the SurfaceFlinger service runs in the system process and is used to manage the frame buffer (FrameBuffer) of the system. SurfaceFlinger obtains all the layers, and can use the graphics processor (GPU, Graphics Processing Unit) to synthesize the layers and combine The result is saved to the frame buffer area.

In this embodiment of the application, the GPU can synthesize all or part of the layers. Among them, when the GPU synthesizes part of the layers in a display interface to be displayed, the hardware layer mixer (HWC, Hardware Composer) can synthesize the result of SurfaceFlinger synthesized by the GPU together with other layers. Specifically, such as As shown in Figure 1, HWC can call the Multimedia Display Processor (MDP, Multimedia Display Processor) to synthesize the layer obtained after the GPU synthesis in the frame buffer and other uncomposited layers, and finally form the BufferQueue A Buffer, and then under the action of the display driver, the image synthesized in the Buffer is used for display.

Therefore, the electronic device can synthesize layers through MDP, or combine layers through GPU, or combine layers through MDP and GPU.

At present, when the video is playing, if the power of the electronic device is too low, the power consumption of the electronic device when compositing the layers directly determines the power usage speed of the electronic device. The inventor found in the research that the power consumption is too fast The reason is that because the GPU is a general graphics processor, it can do 2D image processing, 3D image processing, special effects, etc. Therefore, GPU is generally used for image synthesis, and because the GPU power consumption is too high, it will cause the electronic device to consume too much power when playing video, especially when the power is too low, too fast power consumption will affect the normal operation of users Use electronic equipment.

Therefore, in order to solve the above-mentioned defects, please refer to FIG. 2. An embodiment of the present application provides a layer processing method, which is applied to electronic equipment. The method is used to solve the problem of setting the image composition reasonably when the battery power is too low. Strategies to reduce the power consumption speed. Specifically, the method includes: S201 to S204.

S201: Obtain a layer to be synthesized.

Wherein, the layers to be synthesized are the respective layers corresponding to the images that currently need to be displayed on the screen of the electronic device. As shown in FIG. 3, the interface displayed on the current screen is the interface of a client. The interface layer and content layer of the client are displayed in the interface. Among them, the interface layer is the layer used to display the operation interface of the client. Specifically, it can be a layer including each UI in the client, as shown in layer L1, L2 and L3. Normally, the interface layer is a static layer, and the content layer is a dynamic layer. That is, in the current interface of the client, the image in the content layer may change, but the image in the interface layer Generally does not change. For example, the current client is a map APP, and the map image is displayed in the area of the content layer of the client, and the data in the map image will change with the movement of the user's position, and the next frame of image displayed on the screen The content layer of is different from the content layer of the previous frame, but the interface layer in the next frame of image is the same as the interface layer of the previous frame.

Therefore, when the client determines the content to be displayed, it can determine the multiple layers corresponding to the displayed content, so as to render and synthesize each layer for display.

S202: Obtain the battery power of the electronic device.

Specifically, the electronic device can obtain the battery power usage state, which is used to indicate the battery power of the electronic device. Therefore, the battery power of the electronic device can be obtained by acquiring the battery power usage state.

Specifically, the battery power usage state may be a battery power percentage, for example, 50%. The battery power percentage is used to represent the battery power, for example, the 50% means that the battery power is 50% of the total power.

S203: Determine whether the battery power is less than a preset threshold.

Among them, the preset threshold is used to indicate that the battery power of the electronic device is in a certain battery power use state, where the battery power use state includes a full power state, a low power state, and a normal power state. In the fully charged state, the battery power The power is greater than the first threshold. When the power is insufficient, the power of the battery is lower than the second threshold. When the power is normal, the power of the battery is greater than or equal to the second threshold and less than or equal to the first threshold. The first threshold and the second threshold can be set according to actual use. For example, the first threshold is 80% and the second threshold is 20%. As an implementation manner, in the embodiment of the present application, the preset threshold is used to characterize that the battery power of the electronic device is in an insufficient state, and the preset threshold may be 20%.

As an implementation manner, the battery power is the remaining power of the battery, and when the remaining power of the battery is obtained, the remaining power of the battery is compared with a preset threshold, and if the remaining power of the battery is lower than the preset threshold , It is determined that the battery power usage state is an insufficient power state, and if the remaining power of the battery is greater than or equal to the preset threshold, it is determined that the battery power usage state is a full power state, that is, it is not an insufficient power state.

As another implementation manner, the battery power may be a preset status indicator, and when the current battery power of the battery is obtained, it is determined whether the battery power is less than a preset threshold. Specifically, the status is identified as a parameter value, for example, the fully-charged state, the low-charged state, and the normal-charged state are r1, r2, and r3, respectively, and the electronic device reads the parameter value, and if it reads r2, then It is determined that the battery power is less than the preset threshold, and if the read parameter value is r1 or r3, it is determined that the battery power is greater than or equal to the preset threshold.

S204: Invoke the multimedia display processor to perform a synthesis operation on the layer to be synthesized.

If it is less than the preset threshold, call the multimedia display processor to perform a synthesis operation on the layer to be synthesized. Among them, MDP is a dedicated display image processing unit that can do conventional 2-dimensional image processing. Its main advantage is low power consumption, but high cost. The more layers that an MDP can overlay at one time, the more FIFO (First Input First Output) pipelines are needed inside it. On Qualcomm's high-end platform, an MDP has 8 FIFO pipelines, and up to 8 layers can be synthesized and superimposed at one time. In Qualcomm's low-end and mid-range platforms, an MDP has only 4 FIFO pipelines, and up to 4 layers can be synthesized at a time.

GPU is a general-purpose graphics processor, which is much more powerful than MDP in graphics processing. In addition to 2D image processing, it can also do 3D image processing, special effects, etc., but the power consumption is relatively high, and it can be used at one time. Overlay multiple layers.

Since the power consumption of the MDP is less than the power consumption of the GPU, when the battery power is less than the preset threshold, the multimedia display processor is called to perform the synthesis operation on the layer to be synthesized, which can reduce the cost of layer synthesis. The incoming power consumption further improves the battery life, thereby providing users with a user experience when the power of the electronic device is too low.

Please refer to FIG. 4, which shows a layer processing method provided by an embodiment of the present application. The method is applied to electronic equipment. The method is used to solve the problem of setting a reasonable image synthesis strategy when the battery power is too low, thereby reducing The power consumption rate, specifically, the method includes: S401 to S405.

S401: Acquire a layer to be synthesized.

S402: Obtain the battery power of the electronic device.

S403: Determine whether the battery power is less than a preset threshold.

S404: Invoke the multimedia display processor to perform a synthesis operation on the layer to be synthesized.

S405: Invoke the graphics processor to perform a synthesis operation on the layer to be synthesized, or perform a hybrid synthesis operation.

Wherein, the hybrid synthesis operation is to simultaneously call the graphics processor and the multimedia display processor to perform the synthesis operation on the layer to be synthesized. Before the layer synthesis, the system may have set a preset synthesis strategy. Specifically, the operating system of the electronic device determines the current synthesis strategy according to the number of layers. For example, if the number of FIFO channels of MDP is certain, it can be determined to use MDP or GPU or the combination of MDP and GPU according to the current number of layers. Hybrid synthesis strategy. When it is determined that the battery power is too low, the synthesis strategy needs to be switched in time.

For the Android system, the 2D image that the user finally sees is actually superimposed by multiple layers, such as wallpaper layer, status bar layer, navigation bar layer, APP layer, floating ball layer, Video layers and so on. In different application scenarios, the number of these layers is different. Some applications display only 4 layers in the interface, so you can choose to use MDP for composition. However, the interface displayed by some applications has 7 layers or more, and it is impossible to complete the task by relying on only one MDP hardware to do the overlay synthesis. Therefore, when the MDP cannot complete the task, the GPU is used to jointly complete the synthesis task. This synthesis strategy is hybrid synthesis.

As an implementation, you can first determine the number of MDP FIFO pipelines. If the number of FIFIO pipelines is more than the number of layers corresponding to the image that needs to be displayed currently, you can choose to hand over all the layers to be synthesized to MDP For composition, if the number of FIFIO pipelines is less than the number of layers corresponding to the image that needs to be displayed currently, you can choose to use GPU for layer composition, or you can choose to use a hybrid of MDP and GPU for layer composition.

As another implementation manner, the synthesis strategy can be determined according to the size of the layer. Specifically, the GPU can be called to process a layer with a smaller size, and a layer with a larger size is synthesized by MDP, because if a larger layer is synthesized by the GPU, the power consumption will be higher.

As yet another implementation manner, the synthesis strategy may also be determined according to the content of the layer. If the content of the layer is dynamic content, that is, the content is easy to change, for example, video content layer, Camera preview layer, etc., you can choose to use MDP composition, and if the content of the layer is static, you can choose to use GPU composition For example, the status bar can be synthesized by GPU.

Among them, the static layer can be obtained by analyzing the interface layer of the client when the client is started, and the layer of the video content can be obtained through the video playback architecture. Specifically, the operating system is acquiring the data to be played When the time comes, the next job is to parse the audio and video data. General video files are composed of two parts: video stream and audio stream. Different video formats have different audio and video packaging formats. The process of synthesizing audio streams and video streams into files is called muxer, while the process of separating audio streams and video streams from media files is called demuxer. To play a video file, you need to separate the audio stream and the video stream from the file stream and decode them separately. The decoded video frame can be directly rendered, and the audio frame can be sent to the buffer of the audio output device for playback. Of course, video rendering Synchronization must be controlled with the timestamp of audio playback.

Specifically, video decoding can include hard decoding and soft decoding. Hardware decoding is to hand over part of the video data that was originally processed by the Central Processing Unit (CPU) to the graphics processor (Graphics Processing Unit, GPU). However, the parallel computing power of GPU is much higher than that of CPU, which can greatly reduce the load on the CPU. After the CPU occupancy rate is lower, you can run some other programs at the same time. Of course, for better For processors, such as i5 2320, or any quad-core processor from AMD, hardware solutions and software are selected according to requirements.

Whether it is hard or soft decoding, after decoding the video data, the decoded video data will be sent to the layer transfer module (SurfaceFlinger), and the decoded video data will be rendered and synthesized by SurfaceFlinger, and then displayed on the display . Among them, SurfaceFlinger is an independent Service, it receives all Window's Surface as input, and calculates the position of each Surface in the final composite image based on ZOrder, transparency, size, position and other parameters, and then submits it to HWComposer or OpenGL to generate the final Display Buffer, and then display to a specific display device.

As an implementation manner, after obtaining the layer to be synthesized, the battery power of the battery is first obtained, and if the battery power is less than a preset threshold, the multimedia display processor is called to execute the layer to be synthesized In the synthesis operation, if the battery power is greater than or equal to a preset threshold, the graphics processor is invoked or the graphics processor and the multimedia display processor are simultaneously invoked to perform the synthesis operation on the layer to be synthesized according to the above strategy.

In the embodiment of the present application, if the battery power is less than a preset threshold, it can be determined that the battery power usage state is an insufficient power state, and if the battery power is greater than or equal to the preset threshold, it can be determined that the battery power usage state is a full power state. As another implementation manner, when the layer to be synthesized is obtained, the multimedia display processor, the graphics processor, or the graphics processor and the multimedia display processing are called simultaneously according to the above strategy. The device performs the synthesis operation on the layer to be synthesized, and then obtains the battery power of the battery. If the battery power usage state is insufficient, the multimedia display processor is called to perform the synthesis operation on the layer to be synthesized If the battery power usage state is a fully charged state, that is, a non-deficient state, then the graphics processor is called according to the above strategy or the graphics processor and the multimedia display processor are called at the same time for the layer to be synthesized Perform synthesis operations.

In other words, the system can configure a corresponding synthesis strategy for a client in advance, for example, determine the interface to be displayed by the client, and the interface corresponds to a synthesis strategy, which is the default synthesis strategy of the interface, for example, the interface The default synthesis strategy is a mixed synthesis strategy of the graphics processor and the multimedia display processor. Specifically, the layer to be synthesized includes a first layer and a second layer, and the first layer is synthesized by the graphics processor. The layers to be mixed are stored in the frame buffer. Then, the multimedia display processor mixes and synthesizes the layer to be mixed and the second layer in the frame buffer to obtain the final image to be displayed. The image to be displayed is displayed.

Then, after acquiring the layer to be synthesized, the electronic device determines the synthesis strategy corresponding to the layer to be synthesized according to the preset corresponding relationship between the layer to be synthesized and the synthesis strategy, wherein the corresponding relationship may be the aforementioned The compositing strategy corresponding to the client of the client can also be a pre-set compositing strategy corresponding to the layer information of the image to be displayed, where the layer information includes the size of the layer and the corresponding content static or dynamic . Then, the battery power is obtained again. If the power usage state is not the low power state, the synthesis strategy preset by the layer to be synthesized is directly used for synthesis. If the power is insufficient, the multimedia display processor is called to perform the synthesis. The layer to be synthesized performs the synthesis operation.

In addition, if the power of the electronic device is insufficient, there is no need to call the multimedia display processor to perform the synthesis operation on the layer to be synthesized, so as to avoid the electronic device being charged immediately after switching to the multimedia display processor to synthesize the image. And switching back to the original synthesis strategy, resulting in frequent switching of threads calling GPU and MDP, resulting in system freezes and high power consumption. Specifically, please refer to FIG. 5, which shows a method provided by an embodiment of the present application A layer processing method, which is applied to electronic devices. This method is used to set a reasonable image synthesis strategy when the battery power is too low, thereby reducing the power consumption speed. Specifically, the method includes: S501 to S506.

S501: Obtain a layer to be synthesized.

S502: Obtain the battery power of the electronic device.

S503: Determine whether the battery power is less than a preset threshold.

S504: Acquire location information of the electronic device.

The location information of the electronic device can be obtained through a positioning module installed in the electronic device. Specifically, the location information is used to indicate the current location of the electronic device. For example, the location information may be latitude and longitude information of the electronic device.

S505: If the position information of the electronic device meets a preset condition, call the multimedia display processor to perform a synthesis operation on the layer to be synthesized.

The preset condition may be set according to user requirements, and is used to indicate that when the location information of the electronic device satisfies the preset condition, there is a high probability that the location of the electronic device cannot be charged. For example, when the location information of the electronic device meets the preset condition, there is no charging device within a certain range of the electronic device.

S506: Invoke the graphics processor or simultaneously invoke the graphics processor and the multimedia display processor to perform a synthesis operation on the layer to be synthesized.

As an implementation manner, it is determined whether the location information of the electronic device is outside the specified location range, wherein the historical charging location of the electronic device is within the specified location range; if it is outside the specified location range, the electronic device is determined The location information meets the preset conditions. Among them, the specified location range is set according to the charging position of the electronic device, that is, the charging record of the electronic device is obtained in advance, and the charging record includes the charging position information when the electronic device is in the charging state, so as to count all the charging within a certain period of time Location information, so that a specified location range can be determined. For example, the designated location range includes the vicinity of the user's residential address or the vicinity of the user's company.

If the current location information of the electronic device is within the specified range, it means that the user may be charged in the location range, and it is unnecessary to call the multimedia display processor to perform the synthesis operation on the layer to be synthesized. Waiting for the user to charge can avoid the frequent switching of threads calling the GPU and MDP of the electronic device, resulting in system stalls and excessive power consumption.

In addition, when the location information of the electronic device is within the specified range, it indicates that the user may charge the electronic device. However, if the user has not charged the electronic device and the electronic device continues to use the GPU for layer synthesis, it will cause The power consumption is too fast. Therefore, a first designated time period can be set. If the electronic device is not charged within the first designated time period, the multimedia display processor is used to perform a synthesis operation on the layer to be synthesized.

Specifically, if it is within a specified range, it is determined whether the electronic device is charged within the first specified time period; if it is not charged, the multimedia display processor is called to execute the layer to be synthesized Synthesis operation.

Wherein, the first designated time period may be a time period when it is determined that the location information of the electronic device is in the designated range as a starting point, and the time length is a designated length. For example, the time when it is determined that the location information of the electronic device is in the designated range is t1, and the designated time period is 1 minute, then the first designated time period is t1+1 minute.

In addition, if the electronic device is outside the designated location range, it is determined whether the charging device is included in the preset range of the location information of the electronic device; if the charging device is not included, the multimedia display processor is called to analyze the image to be synthesized. The layer performs composition operations.

Where a positioning module is provided in the charging device, the electronic device can obtain the charging device within a preset range of the location information of the electronic device through the server of the charging device, where the preset range may be the location information of the electronic device The center is within a specified distance range, for example, it can be within 500 meters. The electronic device sends a query instruction to the server of the charging device, and the query instruction is used to instruct the server to return the charging devices within the preset range of the location information of the electronic device. As an implementation manner, the acquired charging device corresponds to device location information, and the electronic device can display the device location information of the charging device on a map interface, as shown in FIG. 6, where the black circular dots are electronic The location of the device, the location shown by the other inverted triangles is the device location information of the charging device, and the charging device in the vicinity of the electronic device can be determined through the displayed location interface of the charging device.

If the electronic device is not located within the designated location range, but has a charging device within its preset range, then it is determined that the electronic device may use the charging device to charge, and the call to the multimedia display processor may not be executed temporarily. The layer to be synthesized performs the synthesis operation, or it is determined whether it is necessary to call the multimedia display processor to perform the synthesis operation on the layer to be synthesized according to other strategies, and if charging equipment is not included in the preset range, Then, the multimedia display processor can be called to perform a synthesis operation on the layer to be synthesized.

Specifically, if a charging device is included, it is determined whether the electronic device is charged within the second specified time period; if it is not charged, the multimedia display processor is called to perform a synthesis operation on the layer to be synthesized , Wherein the starting point of the second specified time period is the time point at which the preset range of the position information of the electronic device includes the determination result of the charging device, then the setting of the second specified time period is the same as the setting of the first specified time period Similarly, for details, please refer to the setting of the first designated time period mentioned above.

As another implementation manner, if the location information of the electronic device satisfies a preset condition, the specific implementation manner of calling the multimedia display processor to perform the synthesis operation on the layer to be synthesized may also be to determine the Whether a charging device is included in the preset range of the position information of the electronic device; if the charging device is not included, the multimedia display processor is called to perform a synthesis operation on the layer to be synthesized. In addition, if a charging device is included, it is determined whether the electronic device is charged within a specified time period; if it is not charged, the multimedia display processor is called to perform a synthesis operation on the layer to be synthesized. The determination of the charging device can refer to the foregoing embodiment.

It should be noted that whether the location information of the electronic device is within the specified location range and whether the electronic device’s location information includes a charging device can be freely combined to determine whether to call the multimedia display processor to The judgment basis for the layer to be synthesized to perform the synthesis operation.

Specifically, if the location information of the electronic device meets a preset condition, the specific implementation manner of invoking the multimedia display processor to perform a synthesis operation on the layer to be synthesized may be to determine the location information of the electronic device Whether it is located outside the designated location range, where the historical charging position of the electronic device is located within the designated location range; if it is located outside the designated location range, it is determined whether the electronic device includes a charging device within the preset range of the location information of the electronic device If the charging device is not included, call the multimedia display processor to perform the synthesis operation on the layer to be synthesized.

As another implementation manner, if the location information of the electronic device satisfies a preset condition, the specific implementation manner of calling the multimedia display processor to perform the synthesis operation on the layer to be synthesized may also be to determine the Whether a charging device is included in the preset range of the location information of the electronic device; if the charging device is not included, it is determined whether the location information of the electronic device is outside the specified location range, wherein the historical charging location of the electronic device is located in the specified location Within the position range; if it is outside the designated position range, call the multimedia display processor to perform a synthesis operation on the layer to be synthesized. Thus, when there is no charging device within the preset range of the location information of the electronic device, if the electronic device is located within the specified location range, for example, the charging device is a shared power bank, the location information of the electronic device is within the preset range There is no shared power bank, but if the user is in the company or at home, the user can use the charger to charge, and the charger may not have a built-in positioning module and cannot determine the location of the charger.

In addition, it is judged whether the electronic device is charged within the third specified time period. It can also be monitored when the battery is low. If it is detected that the battery of the electronic device is charged under the condition of low power, you can call the The graphics processor or simultaneously calls the graphics processor and the multimedia display processor to perform the synthesis operation on the layer to be synthesized, and if it has not been charged within the third specified time period, execute the subsequent acquisition The location information of the electronic device; if the location information of the electronic device meets a preset condition, the multimedia display processor is invoked to perform a synthesis operation on the layer to be synthesized. The specific implementation of the third designated time period may refer to the aforementioned first designated time period and the second designated time period. The time starting point of the third designated time period is the moment when the determination result that the battery power is less than the preset threshold is obtained.

Please refer to FIG. 7, which shows a structural block diagram of a layer processing device provided by an embodiment of the present application. The layer processing device may include: an acquiring unit 701, a determining unit 702, a determining unit 703, and a processing unit 704.

The obtaining unit 701 is used to obtain the layer to be synthesized.

The determining unit 702 is configured to obtain the battery power of the electronic device.

The determining unit 703 is configured to determine whether the battery power is less than a preset threshold.

The processing unit 704 is configured to call the multimedia display processor to perform a synthesis operation on the layer to be synthesized if it is less than a preset threshold.

Please refer to FIG. 8, which shows a structural block diagram of a layer processing apparatus provided by an embodiment of the present application. The layer processing apparatus may include: an acquisition unit 801, a determination unit 802, a judgment unit 803, a processing unit 804, and a composition Unit 805.

The obtaining unit 801 is used to obtain the layer to be synthesized.

The determining unit 802 is configured to obtain the battery power of the electronic device.

The determining unit 803 is configured to determine whether the battery power is less than a preset threshold.

The processing unit 804 is configured to call the multimedia display processor to perform a synthesis operation on the layer to be synthesized if it is less than a preset threshold.

Further, the processing unit 804 is configured to obtain the location information of the electronic device if it is less than a preset threshold; if the location information of the electronic device satisfies a preset condition, call the multimedia display processor to compare the to-be-combined The layer performs compositing operations.

Specifically, the processing unit 804 is further configured to determine whether the location information of the electronic device is outside the specified location range, wherein the historical charging position of the electronic device is within the specified location range; if it is outside the specified location range, then Call the multimedia display processor to perform the synthesis operation on the layer to be synthesized; if it is within a specified range, determine whether the electronic device is charged within the first specified time period; if it is not charged, call The multimedia display processor performs a synthesis operation on the layer to be synthesized.

The processing unit 804 is further configured to determine whether a charging device is included in the preset range of the location information of the electronic device if it is outside the designated location range; if the charging device is not included, call the multimedia display processor to perform The synthesized layer performs the synthesis operation; if the charging device is included, it is determined whether the electronic device is charged within the second specified time period; if it is not charged, the multimedia display processor is called to perform the synthesis operation on the The layer performs compositing operations.

The processing unit 804 is further configured to determine whether the electronic device is charged within the third specified time period if the battery power is less than the preset threshold, and if it is detected that the battery of the electronic device is charged under the condition of insufficient power, call the graphics processor Or call the graphics processor and the multimedia display processor at the same time to perform the synthesis operation on the layer to be synthesized, and if it has not been charged within the third specified time period, execute the subsequent acquisition of the electronic device Location information; if the location information of the electronic device meets a preset condition, call the multimedia display processor to perform a synthesis operation on the layer to be synthesized.

The compositing unit 805 is configured to, if the battery power is greater than or equal to a preset threshold, call the graphics processor to perform a compositing operation on the layer to be composited, or perform a mixed synthesis operation, the mixed synthesis operation is to simultaneously call all The graphics processor and the multimedia display processor perform a synthesis operation on the layer to be synthesized.

Those skilled in the art can clearly understand that, for the convenience and conciseness of the description, the specific working process of the device and module described above can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, the coupling between the modules may be electrical, mechanical or other forms of coupling.

In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules.

Please refer to FIG. 9, which shows a structural block diagram of an electronic device provided by an embodiment of the present application. The electronic device 100 may be an electronic device capable of running application programs, such as a smart phone, a tablet computer, or an e-book. The electronic device 100 in this application may include one or more of the following components: a processor 110, a memory 120, a screen 140, and one or more application programs, of which one or more application programs may be stored in the memory 120 and configured To be executed by one or more processors 110, one or more programs are configured to execute the methods described in the foregoing method embodiments.

The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes by running or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and calling data stored in the memory 120. Various functions and processing data of the electronic device 100. Optionally, the processor 110 may use at least one of digital signal processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). A kind of hardware form to realize. The processor 110 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is used for rendering and drawing of display content; the modem is used for processing wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented by a communication chip alone.

Specifically, the processor 110 may include one or a combination of a central processing unit (Central Processing Unit, CPU), a multimedia display processor 112, a graphics processing unit 111 (Graphics Processing Unit, GPU), a modem, and the like. Among them, the CPU mainly processes the operating system, user interface and client, etc.; GPU is used for rendering and drawing of display content; and the modem is used for processing wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented by a communication chip alone.

The memory 120 may include random access memory (RAM) or read-only memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, where the program storage area may store instructions for implementing the operating system and instructions for implementing at least one function (such as touch function, sound playback function, image playback function, etc.) , Instructions for implementing the following method embodiments, etc. The storage data area can also store data (such as phone book, audio and video data, chat record data) created by the electronic device 100 during use.

The screen 140 is used to display information input by the user, information provided to the user, and various graphical user interfaces of the electronic device. These graphical user interfaces can be composed of graphics, text, icons, numbers, videos, and any combination thereof. In one example, a touch screen may be provided on the display panel so as to form a whole with the display panel.

Please refer to FIG. 10, which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable medium 1000 stores program code, and the program code can be invoked by a processor to execute the method described in the foregoing method embodiment.

The computer-readable storage medium 1000 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 1000 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 1000 has storage space for the program code 1010 for executing any method steps in the above-mentioned methods. These program codes can be read out from or written into one or more computer program products. The program code 1010 may be compressed in an appropriate form, for example.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the application, not to limit them; although the application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the foregoing embodiments are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not drive the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

A layer processing method, characterized in that it is applied to an electronic device, the electronic device includes a multimedia display processor, and the method includes:

Get the layer to be synthesized;

Obtaining the battery power of the electronic device;

Judging whether the battery power is less than a preset threshold;

If it is less than the preset threshold, call the multimedia display processor to perform a synthesis operation on the layer to be synthesized.
The method according to claim 1, wherein the electronic device further comprises a graphics processor, and the method further comprises:

If it is greater than or equal to the preset threshold, call the graphics processor to perform a composite operation on the layer to be composited, or perform a hybrid composite operation, where the hybrid composite operation is to simultaneously call the graphics processor and the multimedia The display processor performs a synthesis operation on the layer to be synthesized.
The method according to claim 1 or 2, wherein if the value is less than a preset threshold, calling the multimedia display processor to perform a synthesis operation on the layer to be synthesized, comprising:

Judging whether the electronic device has not been charged within a third specified time period, wherein the time starting point of the third specified time period is the moment when the determination result that the battery power is less than a preset threshold is obtained;

If the electronic device is not charged within the third specified time period, acquiring location information of the electronic device;

If the position information of the electronic device satisfies a preset condition, the multimedia display processor is called to perform a synthesis operation on the layer to be synthesized.
The method according to claim 3, wherein the method further comprises:

If the electronic device is charged within the third specified period of time, the graphics processor is called to perform a synthesis operation on the layer to be synthesized, or a mixed synthesis operation is performed, and the mixed synthesis operation is to simultaneously call the graphics processing The multimedia display processor and the multimedia display processor perform a synthesis operation on the layer to be synthesized.
The method according to claim 1 or 2, wherein if the value is less than a preset threshold, calling the multimedia display processor to perform a synthesis operation on the layer to be synthesized, comprising:

If it is less than the preset threshold, obtain the location information of the electronic device;

If the position information of the electronic device satisfies a preset condition, the multimedia display processor is called to perform a synthesis operation on the layer to be synthesized.
The method according to any one of claims 3-5, wherein if the position information of the electronic device meets a preset condition, the multimedia display processor is called to perform synthesis on the layer to be synthesized Operations, including:

Determining whether the location information of the electronic device is outside a designated location range, wherein the historical charging location of the electronic device is located within the designated location range;

If it is outside the designated position range, the multimedia display processor is called to perform a synthesis operation on the layer to be synthesized.
The method according to claim 6, further comprising:

If it is within the specified range, it is determined whether the electronic device is charged within the first specified time period;

If it is not charged, call the multimedia display processor to perform a synthesis operation on the layer to be synthesized.
7. The method according to claim 6, wherein the calling the multimedia display processor to perform a synthesis operation on the layer to be synthesized if it is located outside the designated position range comprises:

If it is outside the designated location range, determining whether a charging device is included in the preset range of the location information of the electronic device;

If the charging device is not included, the multimedia display processor is called to perform the synthesis operation on the layer to be synthesized.
The method according to claim 8, further comprising:

If charging equipment is included, it is determined whether the electronic equipment is charged within the second specified time period;

If it is not charged, call the multimedia display processor to perform a synthesis operation on the layer to be synthesized.
The method according to claim 6, characterized in that, before determining whether the position information of the electronic device is outside a designated position range, the method further comprises:

Acquiring a charging record of the electronic device, the charging record including charging location information when the electronic device is in a charging state;

Counting multiple pieces of charging location information within a preset time period, and determining the designated location range according to the multiple pieces of charging location information.
The method according to claim 2, wherein if the value is greater than or equal to a preset threshold, calling the graphics processor to perform a synthesis operation on the layer to be synthesized, or perform a hybrid synthesis operation, comprising:

If it is greater than or equal to the preset threshold, determining the number of first-in first-out channels of the multimedia display processor;

When the number of the first-in first-out pipeline is less than the number of the layers to be synthesized, the hybrid synthesis operation is performed.
The method of claim 11, wherein the method further comprises:

When the number of the first-in first-out pipelines is greater than or equal to the number of the layers to be synthesized, the multimedia display processor is invoked to perform a synthesis operation on the layers to be synthesized.
The method according to claim 2, characterized in that, if the value is greater than or equal to a preset threshold, invoking the graphics processor to perform a synthesis operation on the layer to be synthesized, or perform a hybrid synthesis operation, comprises:

If it is greater than or equal to the preset threshold, obtain the size of the layer to be synthesized, and determine whether the size of the layer is less than the size threshold;

If the size of the layer is smaller than the size threshold, the graphics processor is called to perform a synthesis operation on the layer to be synthesized.
The method of claim 13, wherein the method further comprises:

If the size of the layer is greater than or equal to the size threshold, calling the multimedia display processor to perform a synthesis operation on the layer to be synthesized.
The method according to claim 2, wherein if the value is greater than or equal to a preset threshold, calling the graphics processor to perform a synthesis operation on the layer to be synthesized, or perform a hybrid synthesis operation, comprising:

If it is greater than or equal to the preset threshold, determining whether the layer to be synthesized is a static layer;

If the layer to be synthesized is a static layer, the graphics processor is called to perform a synthesis operation on the layer to be synthesized.
The method according to claim 15, wherein the method further comprises:

If the layer to be synthesized is not a static layer, determining whether the layer to be synthesized is a dynamic layer;

If the layer to be synthesized is a dynamic layer, call the multimedia display processor to perform a synthesis operation on the layer to be synthesized.
A layer processing device, characterized in that it is applied to an electronic device, the electronic device includes a multimedia display processor, and the layer processing device includes:

The obtaining unit is used to obtain the layer to be synthesized;

A determining unit for obtaining the battery power of the electronic device;

A judging unit for judging whether the battery power is less than a preset threshold;

The processing unit is configured to call the multimedia display processor to perform a synthesis operation on the layer to be synthesized if it is less than a preset threshold.
The apparatus according to claim 17, wherein the electronic device further comprises a graphics processor, and the apparatus further comprises:

The compositing unit is configured to call the graphics processor to perform a compositing operation on the layer to be composited if it is greater than or equal to a preset threshold, or perform a hybrid composition operation, where the hybrid composition operation is to simultaneously call the graphics processing The multimedia display processor and the multimedia display processor perform a synthesis operation on the layer to be synthesized.
An electronic device, characterized in that it comprises:

One or more processors;

Memory

Multimedia display processor;

One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute such as The method of any one of claims 1-16.
A computer readable medium, wherein the computer readable storage medium stores program code, and the program code can be called by a processor to execute the method according to any one of claims 1-16.