CN114723871A - Image data processing method, device, electronic device and storage medium - Google Patents

Abstract

The embodiment of the present application discloses a picture data processing method, device, electronic device, and storage medium; when applied to electronic equipment, the electronic device uses an extension program to execute a picture data processing process; the method includes: using a custom picture reading class, from a custom picture The picture material class obtains the file path of the picture to be played and the duration logic of the picture to be played; uses the custom picture reading class to obtain the picture data of the picture to be played according to the file path of the picture to be played, and transmits the picture data to the self-defined picture material class. Define the picture rendering class; use the custom picture rendering class to obtain the picture reading logic and the duration logic from the custom picture reading class; use the custom picture rendering class, according to the duration logic, picture reading logic, and from the file path The obtained picture data realizes the playback of the picture to be played. Therefore, the problems of high development cost and long development cycle existing in the re-development of the player can be improved through a lightweight extension program.

Description

Image data processing method, device, electronic device and storage medium

technical field

The present application relates to the field of computers, and in particular, to a picture data processing method, apparatus, electronic device, and storage medium.

Background technique

With the increasing demands of users for viewing and using videos and pictures, existing video players usually have relatively complete functions, such as playing pictures as videos, and freely editing and beautifying the pictures being played.

However, in the prior art, if a video player is to have both the function of playing video and the function of playing pictures, it is usually necessary to re-develop a player that can play both videos and pictures, and re-develop the above-mentioned player The development cost is high and the development cycle is long.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a picture data processing method, apparatus, electronic device, and storage medium, which can improve the problems of high development cost and long development cycle in the prior art of re-developed players.

An embodiment of the present application provides an image data processing method, which is applied to an electronic device. The electronic device uses an extension program to perform a picture data processing process, and the extension program includes a custom picture rendering class, a custom picture material class, and a custom picture A reading class, the method includes: using a custom picture reading class to obtain the file path of the picture to be played and the duration logic of the to-be-played picture from the custom picture material class; using the custom picture reading class, according to the Describe the file path of the picture to be played, obtain the picture data of the picture to be played, and transmit the picture data to a custom picture rendering class; use the custom picture rendering class to read the class from the custom picture Obtain the picture reading logic and the duration logic; use the custom picture rendering class to implement the to-be-played logic according to the duration logic, the picture reading logic, and the picture data obtained from the file path playback of pictures.

The embodiment of the present application also provides an image data processing device, including:

The first obtaining unit is used to use the custom picture reading class to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class; the second obtaining unit is used to use the custom picture The reading class, according to the file path of the picture to be played, obtains the picture data of the picture to be played, and transmits the picture data to a custom picture rendering class; the third obtaining unit is used for using the custom picture The picture rendering class obtains the picture reading logic and the duration logic from the custom picture reading class; the picture playing unit is used for using the custom picture rendering class to read the picture according to the duration logic and the picture The logic and the picture data obtained from the file path realize the playback of the picture to be played.

In some embodiments, the extension program further includes a custom single-frame timeline class; the picture playback unit is specifically used for:

Use the custom single-frame timeline class to obtain the playback logic of the picture data;

Using the custom picture rendering class, according to the duration logic, the picture reading logic, the picture data obtained from the file path, and the playing logic, the to-be-played picture is played.

In some embodiments, the apparatus further includes:

A first creation unit, in response to a first creation operation on the custom picture material class, configured to create the custom picture material class on the basis of the media material class; wherein the custom picture material class is used for Define the file path of the to-be-played picture and the duration logic of the to-be-played picture.

In some embodiments, the apparatus further includes:

A custom picture frame class creation unit is used to create a custom picture frame class based on the custom picture material class, wherein the custom picture frame class is used to create the custom picture reading class, and the custom picture frame class is used to create the custom picture frame class. The picture reading class is used to define the picture reading logic.

In some embodiments, the apparatus further includes:

The second creation unit, in response to the second creation operation on the custom picture reading class, is configured to create the custom picture reading class on the basis of the material sampling class based on the custom picture frame class.

In some embodiments, the apparatus further includes:

A custom single-frame timeline class creation unit, configured to create the custom single-frame timeline class based on the custom picture material class, where the custom single-frame timeline class is used to define the playback logic.

In some embodiments, the apparatus further includes:

A third creation unit, in response to a third creation operation on the custom picture rendering class, is configured to create the custom picture rendering class on the basis of the rendering class; wherein, the custom picture rendering class uses The drawing logic is used to define the drawing logic of the picture data, and the drawing logic is used to present the picture corresponding to the picture data on the display interface.

In some embodiments, the apparatus further includes:

The custom player class creation unit, in response to the fourth creation operation on the custom player class, creates the custom player class on the basis of the player class; wherein, the custom player class is used for adding Each of the extension programs is added to the corresponding basic program.

In some embodiments, the apparatus further includes:

A rendering calling unit, in response to the calling operation to the open graphics library, for using the open graphics library to call a custom rendering component;

a frame buffer object acquisition unit, used for acquiring the frame buffer object of the picture to be played;

a frame texture result acquisition unit, configured to process the frame buffer object based on the custom rendering component to obtain a frame texture result;

A binding unit, configured to bind the frame texture result with a target frame of a target video output by the electronic device, where the target video is a video generated by playing the to-be-played picture.

In some embodiments, the frame texture result acquisition unit further includes:

The first texture result sub-unit is used to render the first texture of the frame buffer object with the preset aspect ratio, rotation direction and curtain algorithm, and obtain the first texture result, and the first texture result is with the first texture result. A textured framebuffer object;

The second texture result subunit is used to render the first texture result according to the preset beauty algorithm and filter algorithm to obtain a second texture result, and the second texture result is a frame with the second texture effect buffer object;

The third texture result subunit is used to render the second texture result according to the preset sticker adding algorithm and text adding algorithm to obtain a third texture result, where the third texture result is a frame with a third texture effect buffer object;

The fourth texture result subunit is used to render the third texture result according to the preset transition algorithm to obtain a fourth texture result, where the fourth texture result is a frame buffer object with a fourth texture effect, so The fourth texture result is the frame texture result.

The embodiments of the present application further provide an electronic device, including a memory storing a plurality of instructions; the processor loads the instructions from the memory to execute steps in any image data processing method provided by the embodiments of the present application .

Embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium stores a plurality of instructions, and the instructions are adapted to be loaded by a processor to execute any image provided by the embodiments of the present application Steps in a data processing method.

In the present application, the extension program of the embodiment of the present application includes a plurality of custom classes, each custom class is realized by adding custom code to the source code of the base class, and the involved custom code is relatively simple, Lightweight. And because the basic program in the electronic device of the embodiment of the present application has high scalability, the electronic device can obtain comprehensive functions, better compatibility and stability on the basis of developing a lightweight extension program. The video player or software can be used to perform various picture playback and processing functions through the video player or software, thereby improving the problems of high development cost and long development cycle in the prior art of re-development of the player.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.

1a is a schematic diagram of a scene of a picture data processing method provided by an embodiment of the present application;

FIG. 1b is a schematic flowchart of a picture data processing method provided by an embodiment of the present application;

1c is a schematic diagram of playing a picture to be played provided by an embodiment of the present application;

1d is a schematic diagram of processing a frame buffer object provided by an embodiment of the present application;

2 is a schematic flowchart of a picture data processing method provided by another embodiment of the present application;

3 is a schematic structural diagram of a picture data processing apparatus provided by an embodiment of the present application;

FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

Embodiments of the present application provide a picture data processing method, apparatus, electronic device, and storage medium.

Wherein, the picture data processing apparatus may be integrated in an electronic device, and the electronic device may be a terminal, a server, or the like. The terminal may be a mobile phone, a tablet computer, an intelligent Bluetooth device, a notebook computer, or a personal computer (Personal Computer, PC) and other devices; the server may be a single server, or a server cluster composed of multiple servers.

In some embodiments, the image data processing apparatus may also be integrated into multiple electronic devices, for example, the image data processing apparatus may be integrated into multiple servers, and the image data processing method of the present application may be implemented by multiple servers.

In some embodiments, the server may also be implemented in the form of a terminal.

For example, referring to FIG. 1a, the above-mentioned electronic device can use an extension program to execute a picture data processing flow, and the extension program includes a custom picture rendering class, a custom picture material class, and a custom picture reading class. The above-mentioned electronic device can execute the following method : Use the custom picture reading class to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class; use the custom picture reading class to obtain the file path of the picture to be played according to the custom picture reading class , obtain the picture data of the picture to be played, and transmit the picture data to a custom picture rendering class; use the custom picture rendering class to obtain the picture reading logic and all parameters from the custom picture reading class The duration logic; using the custom picture rendering class, the playback of the to-be-played picture is implemented according to the duration logic, the picture reading logic, and the picture data obtained from the file path.

Each of them will be described in detail below. It should be noted that the serial numbers of the following embodiments are not intended to limit the preferred order of the embodiments.

The embodiments of the present disclosure firstly aim to provide a picture data processing method. The picture data processing flow is performed by adding an extension program in an electronic device, and the extension program includes a plurality of lightweight custom classes. Therefore, this solution can realize diversified picture playback functions on the basis of lightweight development.

In this embodiment of the present application, the electronic device may be a video player with some basic functions, for example, the basic functions may include video cropping and material splicing, etc., to meet the user's basic viewing and processing requirements for videos and pictures.

Since the electronic device realizes the picture data processing process after adding an extension program, the electronic device can have high scalability. For example, the electronic device can be a native video player that only supports video playback but not picture playback. , for example, exoplayer. Among them, exoplayer can realize the functions of video cropping, material splicing and video speed change. It can be understood that adding a custom extension program on the basis of the open source data in exoplayer is equivalent to customizing the extension in the native database of Android, so that the electronic device can be implemented in a lightweight development environment with high efficiency and low cost. Cost expansion to obtain electronic equipment with higher stability and compatibility. It should be noted that the electronic device may also be other highly scalable video players or similar software/hardware, and the type or specific model of the electronic device should not be construed as a limitation on the present application.

As shown in Figure 1b, the specific flow of the image data processing method may be as follows:

110. Use the custom picture reading class to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class.

Among them, the custom image material class (ImageMediaSource) can be a custom class extended on the basis of the media material class (MediaSource) of exoplayer, that is, the media material class of exoplayer can be used as an inheritable base class, which can be used in This base class extends a custom implementable class. The custom image reading class (ImageSampleStreamImpl) can be a custom class extended on the basis of the material sampling class (SampleStream).

The picture to be played refers to the target picture to play the picture in the form of a video, the file path of the picture to be played refers to the storage path of the picture to be played, and the duration logic of the picture to be played refers to defining a programming logic so that each Adjust the length of time that the playback picture is played.

Optionally, in a specific implementation manner, the custom picture material class may be used to define the file path of the picture to be played. It can be understood that because exoplayer does not have the function of playing pictures, it cannot read and decode picture data, and there is no logic to obtain the file path of picture data in the media material class of exoplayer. Therefore, the media material class can be extended through the custom picture material class, and the logic that can obtain the file path of the picture to be played can be defined, so that exoplayer can parse the custom picture material class at runtime and call the custom picture material class. to identify the file path of the picture to be played. Wherein, for a to-be-played picture with multiple file paths, that is, a to-be-played picture stored in multiple locations, all file paths of the to-be-played picture can be acquired, so as to achieve comprehensive file path acquisition.

Optionally, the custom picture material class can also be used to define the duration logic of the picture to be played. It can be understood that the biggest difference between pictures and videos is that pictures are static, while videos are dynamic. Therefore, it is necessary to extend the relevant logic for decoding and playing pictures based on the media material class. The media material class can be extended through the custom picture material class to define the duration logic of the picture to be played, so that exoplayer can parse the custom picture material class at runtime, call the custom picture material class, and perform each picture to be played. Adjust the length of time the picture is played. For example, the user can preset the playing time of each picture to be played through exoplayer, such as 1 second, 2 seconds, 10 seconds, etc. Among them, in the duration logic, the duration of the to-be-played picture to be played can be accurate to the millisecond level, so that after adding the duration logic, the specific duration of the to-be-played picture can be set as required.

For another example, the user can preset the number of frames occupied by each picture to be played in the video through exoplayer, such as 12 frames, 24 frames, and so on. Since the video data can calculate the number of frames played per second through the refresh rate of the display terminal, such as 12 frames per second, 24 frames per second, etc., the playing time of the picture to be played can be calculated based on the refresh rate of the display terminal. It should be noted that, the specific playback duration of the picture to be played should not be construed as a limitation on this application.

For details, please refer to FIG. 1c, which shows a playback interface for playing pictures. It can be seen that, at the first moment, the picture to be played is displayed in the playback interface for the first second. At the second moment, the same picture to be played is still displayed in the playback interface, so the playback duration of the picture to be played is at least 5 seconds. Optionally, in the playback interface of Figure 1c, in the video with a duration of 10 seconds, only one picture to be played can be played, or multiple pictures to be played can be played, and the specific number of pictures to be played should not be interpreted as is a limitation of this application.

Optionally, before step 110, the method further includes: in response to the first creation operation on the custom picture material class, creating the custom picture material class on the basis of the media material class.

The custom picture material class may be used to define the file path of the picture to be played and the duration logic of the picture to be played.

It can be understood that the media material class can be used as an inheritable base class, and the custom media material class can extend a custom implementable class on the base class. It should be noted that the above-mentioned extension of the custom class to the base class is realized by adding custom code to the source code of the base class. For example, a custom playback class can be extended in the playback class of exoplayer, so that exoplayer can implement other playback functions. For example, the following custom code can be added to the playback class of exoplayer, so that exoplayer can realize the gesture playback function, such as this custom code Can be:

ManualPlayer exoPlayerManager=new ManualPlayer(this, R.id.exo_play_context_id, newDataSource(this)).

It should be understood that, in this embodiment of the present application, the code related to the definition of the file path of the picture to be played and the logic related to the duration of the picture to be played can be added to the corresponding base class, for example, to the media material class of exoplayer, so as to realize Create a custom picture material class based on the media material class.

Optionally, after creating the custom picture material class on the basis of the media material class in response to the first creation operation on the custom picture material class, the method further includes:

Create a custom picture frame class based on the custom picture material class, wherein the custom picture frame class is used to create the custom picture reading class, and the custom picture reading class is used to define the picture read logic.

The custom picture frame class (ImageMediaPeriod) can be obtained by extending the media frame class (MediaPeriod) of exoplayer, that is, the code corresponding to the custom picture frame class is inherited from the media frame class.

Optionally, in a specific implementation, a custom picture frame class may be created based on a custom picture material class. It can be understood that in the program execution stage, exoplayer can create a pre-written custom picture frame class by parsing the custom picture material class and calling the custom picture material class. That is, the creation logic of the custom picture frame class can be pre-defined, which is realized by parsing the custom picture material class.

The custom picture frame class can be used to create a custom picture reading class. It should be understood that in the program execution phase, exoplayer can create a pre-written custom picture reading class by parsing the custom picture frame class. That is, the creation logic of the custom picture reading class can be pre-defined, which is realized by parsing the custom picture frame class.

Among them, the custom picture reading class can be used to define the picture reading logic. Since exoplayer does not have the function of reading picture data, even if exoplayer can obtain the file path of the picture by parsing the custom media material class, it cannot read the picture, that is, it cannot substantially obtain the picture to be played. It can be understood that the picture reading logic can define that the electronic device can read the corresponding picture from the file path of the picture, so as to realize the substantial acquisition of the picture. For example, the custom picture reading class can be parsed, and the custom picture reading class can be called, so that exoplayer can read the picture to be played from the file path of the picture to be played, and play the read picture to be played or Follow-up other processing.

Optionally, after creating a custom picture frame class based on the custom picture material class, the method further includes:

In response to the second creation operation on the custom picture reading class, the custom picture reading class is created on the basis of the material sampling class based on the custom picture frame class.

Since the custom picture reading class is a custom class extended on the basis of the material sampling class, the material sampling class can be used as the base class of the custom picture reading class, and the custom picture reading class can be the material sampling class. Subclass.

Optionally, the custom picture reading class may be created on the basis of a material sampling class based on a custom picture frame class. It can be understood that in the program execution stage, exoplayer can create a subclass of the material sampling class on the material sampling class by parsing the custom picture frame class, so as to write the custom picture reading class on the basis of the material sampling class. That is, the creation logic of the custom picture reading class can be pre-defined, which is realized by expanding the material sampling stream after parsing the custom picture frame class.

Optionally, after the custom picture material class is created on the basis of the media material class in response to the first creation operation on the custom picture material class, the method further includes:

Create a custom single-frame timeline class based on the custom picture material class, where the custom single-frame timeline class is used to define the playback logic.

Among them, the custom single-frame timeline class (SinglePeriodTimeline) extends from the timeline class (Timeline) of exoplayer. It can be understood that since the custom single-frame timeline class is created based on the custom picture material class, exoplayer can create a custom single frame by parsing the custom picture material class and calling the custom picture material class during the program execution stage. Timeline class. That is, the creation logic of the custom single-frame timeline class can be pre-defined, which is realized by parsing the custom picture material class.

Among them, the timeline class is also used to define the logic for storing video decoded frames, for example, multiple video decoded frames can be stored in a queue. Since the custom single-frame timeline class extends from the timeline class, the custom single-frame timeline class can extend the logic for storing decoded picture frames from the logic for storing decoded video frames, and is used to generate a frame that can store decoded picture frames. queue. The picture decoding frame may be that the picture data is used as a frame in the video playback, so that the video decodes the corresponding frame data.

The play logic in the embodiment of the present application refers to related logic used when playing pictures. Optionally, the playback logic may include defining a playback mode of the pictures to be played, for example, the pictures to be played may be played sequentially, in a loop, or in reverse order within a certain period of time.

Optionally, the playback logic may further include defining the start and end times of the picture to be played, for example, setting the picture to be played to start playing at the 3rd second and end the playback at the 5th second.

It should be noted that, compared with the duration logic of the picture to be played, it is different from the concept of duration. The focus of the playback logic is to highlight the logic between the picture to be played and the moment, and it is more focused on how to play the picture to be played at a certain moment. .

120. Use a custom picture reading class to acquire the picture data of the to-be-played picture according to the file path of the to-be-played picture, and transmit the picture data to the custom picture rendering class.

Among them, the custom image rendering class (ImageRenderer) can be extended from the rendering class (Renderer) of exoplayer, and the rendering class can be used to decode the video data and draw each frame of the video picture, that is, to convert each frame of the video picture The frame decoding is output to the display interface.

It can be understood that in the program execution stage, the electronic device can first obtain the file path of the picture to be played by parsing the custom picture material class and calling the custom picture material class. Then, by parsing the custom image reading class, call the custom image reading class to read the image data in the file path, and transfer the image data to the custom image rendering class.

130. Using the custom picture rendering class, obtain the picture reading logic and the duration logic from the custom picture reading class.

It can be understood that since the custom image rendering class can obtain image data through the transmission of the custom image reading class, the custom image reading class can be called by parsing the custom image reading class, so that the custom image rendering class can be obtained. Image reading logic and duration logic.

140. Use the custom picture rendering class to implement the playback of the to-be-played picture according to the duration logic, the picture reading logic, and the picture data obtained from the file path.

Optionally, in a specific implementation manner, the electronic device can call the custom picture material class and the custom picture reading class by parsing the custom picture material class and the custom picture reading class, and obtain the file path of the picture data. , duration logic and read logic. During execution, the electronic device can, based on the above logic, read the picture data of the picture to be played from the file path, adjust the duration of each picture to be played, and call the custom picture rendering class to draw the picture data, and play it under the duration The corresponding picture to be played.

The extension program also includes a custom single-frame timeline class. Optionally, step 140 may further include the following steps 141 and 142:

141. Obtain the playback logic of the picture data by using the custom single-frame timeline class.

142. Using the custom picture rendering class, according to the duration logic, the picture reading logic, the picture data obtained from the file path, and the playing logic, to implement the playback of the picture to be played.

Optionally, in a specific implementation manner, in order to realize the fluency and functional diversity of the electronic device playing pictures, the custom single-frame timeline class can be parsed, and the custom single-frame timeline class can be called to obtain the playback of the to-be-played picture. Logic, by combining the multiple logics mentioned in step 140 with the playback logic, the playback of the picture to be played is realized. For example, the start playback time, end playback time, playback mode, etc. of the picture to be played can be set through playback logic.

Optionally, before step 142, it can also include:

In response to the third creation operation on the custom picture rendering class, the custom picture rendering class is created on the basis of the rendering class. The custom picture rendering class is used to define the drawing logic of the picture data, and the drawing logic is used to present the picture corresponding to the picture data on the display interface.

It can be understood that, since the rendering class can be used to decode the video data, draw each frame of the video picture, that is, decode and output each frame of the video picture to the display interface. Accordingly, the custom picture rendering class can inherit the decoding ability of the rendering class, and use the picture data as the frame data of the decoding output, that is, decode the picture data into each frame of the video picture, so that the video picture can decode the picture to be played. The overall picture data is finally realized to draw the picture data to the display interface.

Optionally, the method of the embodiment of the present application further includes:

In response to the fourth creation operation on the custom player class, the custom player class can be created on the basis of the player class; wherein, the custom player class can be used to convert each of the extension programs. added to the corresponding basic program.

It can be understood that for the above multiple custom classes, it is necessary to add the custom class to the corresponding base class to implement the logic and methods contained therein. Taking the custom picture material class as an example, the code of the custom picture material class needs to be added to the list of media material class codes of exoplayer, and then the media material class can be extended to create a complete custom picture material class.

Since the extension program can include the above multiple custom classes, correspondingly, the base program can include the base classes corresponding to the above multiple custom classes. Therefore, a custom player class can be created on the basis of the player class, and the custom player class can be parsed to call the custom player class to add each custom class in the embodiments of the present application to the corresponding base class, and create out a complete custom class.

It can be seen from the above that the extension program of the embodiment of the present application includes a plurality of custom classes, and each custom class is realized by adding custom codes to the source code of the base class, and the involved custom codes are relatively simple and specific. Light weight. And because the basic program in the electronic device of the embodiment of the present application has high scalability, the electronic device can obtain comprehensive functions, better compatibility and stability on the basis of developing a lightweight extension program. The video player or software can be used to perform various picture playback and processing functions through the video player or software, thereby improving the problems of high development cost and long development cycle in the prior art of re-development of the player.

In order to realize that the electronic device can edit the playing picture in real time during the process of playing the picture, as shown in FIG. 1d , optionally, the method of the embodiment of the present application further includes:

In response to the calling operation to the open graphics library, using the open graphics library, the custom rendering component is called;

obtaining the frame buffer object of the picture to be played;

processing the frame buffer object based on the custom rendering component to obtain a frame texture result;

Binding the frame texture result with a target frame of a target video output by the electronic device, where the target video is a video generated by playing the to-be-played picture.

The Open Graphics Library (OpenGL) is a cross-language and cross-platform application programming interface (API) for rendering 2D and 3D vector graphics, which can be used to provide a set of unified graphics processing interfaces.

Optionally, in a specific implementation manner, the open graphics library can be called by parsing the drawing class setVideoSurface of the electronic device, and then the custom rendering component of the open graphics library can be called through the open graphics library, so that the electronic device can follow the custom rendering component of the open graphics library. The rendering component renders the image data. Among them, the custom rendering component can be the custom video frame rendering component GLSurfaceView.

The custom video frame rendering component can be used to render the video frame and provide a preview in the display interface. In the embodiment of the present application, since the video playback object is the picture to be played, the picture data of each frame can be rendered by using a custom video frame rendering component.

The framebuffer object (Framebuffer Object, FBO) is an image container, which is a collection of color buffers, depth buffers, and template buffers. Framebuffer objects can store textures, and textures can be rendered targets.

Optionally, in a specific implementation manner, the frame buffer object of the picture to be played can be obtained by creating, and after the frame buffer object is created, the frame buffer object can generate an RGBA image texture corresponding to the target video frame, RGBA Image textures can be bound to framebuffer objects.

Optionally, in a specific implementation manner, a frame buffer object may be processed based on a custom rendering component to obtain a frame texture result. It can be understood that because the frame buffer object is bound to the RGBA image texture, that is, the frame buffer object of the picture to be played stores the RGBA image texture, so that the RGBA image texture can be rendered by the custom rendering component, and the frame is obtained. Texture result.

Optionally, processing the frame buffer object further includes:

Render the first texture of the frame buffer object according to the preset aspect ratio, rotation direction and curtain algorithm, and obtain a first texture result, where the first texture result is the frame buffer object with the first texture;

According to the preset beauty algorithm and filter algorithm, the first texture result is rendered, and the second texture result is obtained, and the second texture result is a frame buffer object with the second texture effect;

According to the preset sticker adding algorithm and text adding algorithm, the second texture result is rendered to obtain a third texture result, and the third texture result is a frame buffer object with a third texture effect;

According to the preset transition algorithm, the third texture result is rendered to obtain a fourth texture result, where the fourth texture result is a frame buffer object with a fourth texture effect, and the fourth texture result is the frame Texture result.

Optionally, in a specific implementation manner, the MVP matrix of the video interface can be calculated by using a preset picture ratio and rotation direction. Among them, the MVP matrix is an inherent variable in the open graphics library. Through the MVP matrix transformation, the geometric data of the video interface can be converted into a two-dimensional coordinate system, so as to facilitate the subsequent processing of each point in the texture through the custom rendering component.

Then, the curtain can be drawn on the first texture by combining the two-bit coordinate system transformed by the MVP matrix through the curtain algorithm. Among them, the curtain algorithm can be used to draw a solid color curtain and a blurred curtain, and the curtain algorithms corresponding to the two are different. For a solid color curtain, you can assign values to the four color channels R, G, B, and A of the RGBA image texture through a custom rendering component to obtain the corresponding target solid color curtain. For blurred curtains, the Gaussian algorithm can be used to calculate the weight of each pixel in the texture, and then combined with the weight of each pixel above, the colors contained in all pixels can be synthesized by weighted summation, so as to obtain a curtain with a blurry visual effect. . Further, by creating the radius logic of the blur screen, the blur range can be adjusted by modifying the radius value of the blur screen. Finally, the above processing operations are performed on the first texture through the custom rendering component to obtain the first texture result.

Optionally, in a specific implementation manner, the first texture result may be rendered according to a preset beauty algorithm and filter algorithm. It can be understood that the first texture result carries the parameters processed by the screen scale adjustment, the rotation direction adjustment and the curtain algorithm, and the custom rendering component can continue to render the first texture result on this basis. Optionally, the custom rendering component can implement the beautification algorithm and the filter algorithm on the first texture result by adding the relevant parameters of the beautification and filter to the pixels corresponding to the first texture result. For example, parameters such as screen orientation, camera orientation, and render size can be added. Among them, the screen orientation refers to the horizontal screen or the vertical screen, and the camera orientation refers to the front or rear. Finally, a second texture result can be obtained according to the rendered first texture result.

Optionally, in a specific implementation manner, the second texture result may be rendered according to a preset sticker adding algorithm and text adding algorithm. Optionally, the logic of the sticker adding algorithm and the text adding algorithm can be created. For example, the code "stickerItem.getBitmap" can be added to the relevant field of the original program of the electronic device to obtain the logic of setting coordinates and start and end times for the sticker and text. Optionally, the custom rendering component can call the watermark filter rendering method, combine the above logic on the second texture result, render the sticker or text to be added on the second texture result in the form of a watermark or filter, and obtain the first texture result. Three texture results.

Optionally, in a specific implementation manner, the third texture result may be rendered according to a preset transition algorithm. It can be understood that the picture transition may refer to switching from playing the previous picture to playing the next picture during the picture playing process. Optionally, the custom rendering component can call the related logic of the transition algorithm. For example, the logic of the execution time of the transition algorithm can be: in the last 500ms of the playback of the previous picture data and the first 500ms of the playback of the next picture data, execute the transition. The effect of the field algorithm. The effect logic of the transition algorithm may include: transition movement, transition scaling and transition rotation, that is, during the transition of the picture data, the picture data may be moved, scaled and rotated. After the custom rendering component renders the third texture result and obtains the fourth texture result, the fourth texture result may be used as the frame texture result.

Optionally, in a specific implementation manner, the frame texture result can be bound to the target frame of the target video output by the electronic device, where the target video is a video generated by playing the picture to be played.

Among them, the electronic device can draw the target frame by calling the built-in video frame component SurfaceView. By binding the target frame drawn by the video frame component SurfaceView with the frame texture result rendered by the custom video frame component GLSurfaceView, this can be achieved. As shown in Figure 1c, the effect of real-time rendering of the picture data during the playback of the picture.

It can be seen from the above that in the process of obtaining the frame texture result, the processing of each texture result includes the processing parameters of the previous texture result, so that the final frame texture result obtained by rendering contains all the rendering methods used before. and logic, so that the frame buffer data of the picture to be played can be comprehensively and diversifiedly rendered through the custom rendering component. In addition, by combining the custom rendering components with the required algorithms through the above-mentioned method of increasing from difficulty to easy and adding layer by layer, the development difficulty of the extension program is also reduced and the development efficiency is improved.

According to the methods described in the above embodiments, further detailed description will be given below.

In this embodiment, the method of the embodiment of the present application will be described in detail by taking the electronic device using an extension program to perform a picture data processing flow as an example.

As shown in Figure 2, the specific flow of a picture data processing method is as follows:

201. In response to a first creation operation on the custom picture material class, create the custom picture material class on the basis of the media material class.

202. Create the custom single-frame timeline class based on the custom picture material class.

203. Use the custom picture reading class to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class.

204. Create a custom picture frame class based on the custom picture material class.

205. In response to the second creation operation on the custom picture reading class, create the custom picture reading class on the basis of the material sampling class based on the custom picture frame class.

206. Use a custom picture reading class to acquire picture data of the to-be-played picture according to the file path of the to-be-played picture, and transmit the picture data to the custom picture rendering class.

207. In response to the third creation operation on the custom picture rendering class, create the custom picture rendering class on the basis of the rendering class.

208. In response to the fourth creation operation on the custom player class, create the custom player class on the basis of the player class.

209. Use the custom picture rendering class to acquire the picture reading logic and the duration logic from the custom picture reading class.

210. Using the custom picture rendering class, according to the duration logic, the picture reading logic, the picture data obtained from the file path, and the playing logic, realize the playing of the picture to be played.

211. Obtain the playback logic of the picture data by using the custom single-frame timeline class.

212. Using the self-defined picture rendering class, according to the duration logic, the picture reading logic, the picture data obtained from the file path, and the playing logic, realize the playing of the picture to be played.

It can be seen from the above that the extension program of the embodiment of the present application includes a plurality of custom classes, and each custom class is realized by adding custom codes to the source code of the base class, and the involved custom codes are relatively simple and specific. Light weight. And because the basic program in the electronic device of the embodiment of the present application has high scalability, the electronic device can obtain comprehensive functions, better compatibility and stability on the basis of developing a lightweight extension program. The video player or software can be used to perform various picture playback and processing functions through the video player or software, thereby improving the problems of high development cost and long development cycle in the prior art of re-development of the player.

In order to better implement the above method, an embodiment of the present application further provides a picture data processing apparatus, and the picture data processing apparatus may specifically be integrated in an electronic device, and the electronic device may be a terminal. The terminal may be a mobile phone, a tablet computer, a smart Bluetooth device, a notebook computer, a personal computer, or other devices.

For example, in this embodiment, the method of this embodiment of the present application will be described in detail by taking the image data processing apparatus being specifically integrated in a terminal as an example.

For example, as shown in FIG. 3, the picture data processing apparatus may include:

The first obtaining unit 301 is configured to use a custom picture reading class to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class;

The second obtaining unit 302 is configured to use a custom picture reading class, obtain picture data of the picture to be played according to the file path of the picture to be played, and transmit the picture data to the custom picture rendering class;

The third obtaining unit 303 is configured to use the custom picture rendering class to obtain the picture reading logic and the duration logic from the custom picture reading class;

The picture playing unit 304 is configured to use the custom picture rendering class to play the picture to be played according to the duration logic, the picture reading logic, and the picture data obtained from the file path.

In some embodiments, the extension program further includes a custom single-frame timeline class; the picture playing unit 304 is specifically used for:

Use the custom single-frame timeline class to obtain the playback logic of the picture data;

Using the custom picture rendering class, according to the duration logic, the picture reading logic, the picture data obtained from the file path, and the playing logic, the to-be-played picture is played.

In some embodiments, the apparatus further includes:

A first creation unit, in response to a first creation operation on the custom picture material class, configured to create the custom picture material class on the basis of the media material class; wherein the custom picture material class is used for Define the file path of the to-be-played picture and the duration logic of the to-be-played picture.

In some embodiments, the apparatus further includes:

A custom picture frame class creation unit is used to create a custom picture frame class based on the custom picture material class, wherein the custom picture frame class is used to create the custom picture reading class, and the custom picture frame class is used to create the custom picture frame class. The picture reading class is used to define the picture reading logic.

In some embodiments, the apparatus further includes:

The second creation unit, in response to the second creation operation on the custom picture reading class, is configured to create the custom picture reading class on the basis of the material sampling class based on the custom picture frame class.

In some embodiments, the apparatus further includes:

A custom single-frame timeline class creation unit, configured to create the custom single-frame timeline class based on the custom picture material class, where the custom single-frame timeline class is used to define the playback logic.

In some embodiments, the apparatus further includes:

A third creation unit, in response to a third creation operation on the custom picture rendering class, is configured to create the custom picture rendering class on the basis of the rendering class; wherein, the custom picture rendering class uses The drawing logic is used to define the drawing logic of the picture data, and the drawing logic is used to present the picture corresponding to the picture data on the display interface.

In some embodiments, the apparatus further includes:

The custom player class creation unit, in response to the fourth creation operation on the custom player class, creates the custom player class on the basis of the player class; wherein, the custom player class is used for adding Each of the extension programs is added to the corresponding basic program.

In some embodiments, the apparatus further includes:

A rendering calling unit, in response to the calling operation to the open graphics library, for using the open graphics library to call the rendering component;

a frame buffer object acquisition unit, used for acquiring the frame buffer object of the picture to be played;

a frame texture result acquisition unit, configured to process the frame buffer object based on the rendering component to obtain a frame texture result;

A binding unit, configured to bind the frame texture result with a target frame of a target video output by the electronic device, where the target video is a video generated by playing the to-be-played picture.

In some embodiments, the frame texture result acquisition unit further includes:

The first texture result sub-unit is used to render the first texture of the frame buffer object with the preset aspect ratio, rotation direction and curtain algorithm, and obtain the first texture result, and the first texture result is with the first texture result. A textured framebuffer object;

The second texture result subunit is used to render the first texture result according to the preset beauty algorithm and filter algorithm to obtain a second texture result, and the second texture result is a frame with the second texture effect buffer object;

The third texture result subunit is used to render the second texture result according to the preset sticker adding algorithm and text adding algorithm to obtain a third texture result, where the third texture result is a frame with a third texture effect buffer object;

The fourth texture result subunit is used to render the third texture result according to the preset transition algorithm to obtain a fourth texture result, where the fourth texture result is a frame buffer object with a fourth texture effect, so The fourth texture result is the frame texture result.

Embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium stores a plurality of instructions, and the instructions are adapted to be loaded by a processor to execute any picture provided by the embodiments of the present application Steps in a data processing method.

In the picture data processing method provided by the embodiment of the present application, a custom picture reading class can be used to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class; Take the class, obtain the picture data of the picture to be played according to the file path of the picture to be played, and transmit the picture data to a custom picture rendering class; use the custom picture rendering class, from the self-defined picture rendering class Define a picture reading class to obtain the picture reading logic and the duration logic; use the custom picture rendering class, according to the duration logic, the picture reading logic, and the picture data obtained from the file path, Realize the playback of the picture to be played.

In the present application, the extension program of the embodiment of the present application includes a plurality of custom classes, each custom class is realized by adding custom code to the source code of the base class, and the involved custom code is relatively simple, Lightweight. And because the basic program in the electronic device of the embodiment of the present application has high scalability, the electronic device can obtain comprehensive functions, better compatibility and stability on the basis of developing a lightweight extension program. The video player or software can be used to perform various picture playback and processing functions through the video player or software, thereby improving the problems of high development cost and long development cycle in the prior art of re-development of the player.

Correspondingly, an embodiment of the present application also provides a computer device, the computer device may be a terminal or a server, and the terminal may be a smart phone, a tablet computer, a notebook computer, a touch screen, a game console, a personal computer, a personal digital assistant ( Personal Digital Assistant, PDA) and other terminal equipment.

As shown in FIG. 4 , which is a schematic structural diagram of a computer device provided by an embodiment of the application, the computer device 400 includes a processor 401 having one or more processing cores, and a memory having one or more computer-readable storage media 402 and a computer program stored on memory 402 and executable on the processor. The processor 401 is electrically connected to the memory 402 . Those skilled in the art can understand that the computer device structure shown in the figures does not constitute a limitation on the computer device, and may include more or less components than the one shown, or combine some components, or arrange different components.

The processor 401 is the control center of the computer device 400, and uses various interfaces and lines to connect various parts of the entire computer device 400, by running or loading the software programs and/or modules stored in the memory 402, and calling the software programs stored in the memory 402. to perform various functions of the computer device 400 and process data, so as to monitor the computer device 400 as a whole.

In this embodiment of the present application, the processor 401 in the computer device 400 loads the instructions corresponding to the processes of one or more application programs into the memory 402 according to the following steps, and the processor 401 executes the instructions stored in the memory. 402 application in order to achieve various functions:

Use the custom picture reading class to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class;

Using a custom picture reading class, obtain the picture data of the picture to be played according to the file path of the picture to be played, and transmit the picture data to the custom picture rendering class;

Using the custom picture rendering class, obtain the picture reading logic and the duration logic from the custom picture reading class;

Using the custom picture rendering class, the to-be-played picture is played according to the duration logic, the picture reading logic, and the picture data obtained from the file path.

For the specific implementation of the above operations, reference may be made to the foregoing embodiments, and details are not described herein again.

Optionally, as shown in FIG. 4 , the computer device 400 further includes: a touch display screen 403 , a radio frequency circuit 404 , an audio circuit 405 , an input unit 406 and a power supply 407 . The processor 401 is electrically connected to the touch display screen 403 , the radio frequency circuit 404 , the audio circuit 405 , the input unit 406 and the power supply 407 , respectively. Those skilled in the art can understand that the computer device structure shown in FIG. 4 does not constitute a limitation on the computer device, and may include more or less components than the one shown, or combine some components, or arrange different components.

The touch screen 403 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display 403 may include a display panel and a touch panel. Among them, the display panel can be used to display the information input by the user or the information provided to the user and various graphical user interfaces of the computer equipment. These graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light emitting diode (OLED, Organic Light-Emitting Diode), and the like. The touch panel can be used to collect the user's touch operations on or near it (such as the user's operations on or near the touch panel using a finger, stylus, etc., any suitable object or accessory), and generate corresponding operations instruction, and the operation instruction executes the corresponding program. Optionally, the touch panel may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 401, and can receive the command sent by the processor 401 and execute it. The touch panel can cover the display panel, and when the touch panel detects a touch operation on or near it, it is transmitted to the processor 401 to determine the type of the touch event, and then the processor 401 provides the display panel according to the type of the touch event. Corresponding visual output. In this embodiment of the present application, the touch panel and the display panel may be integrated into the touch display screen 403 to implement input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to implement input and output functions. That is, the touch display screen 403 can also be used as a part of the input unit 406 to realize the input function.

In this embodiment of the present application, the processor 401 executes a game application program to generate a graphical user interface on the touch display screen 403, the virtual scene on the graphical user interface includes at least one skill control area, and the skill control area includes at least one skill controls. The touch display screen 403 is used for presenting a graphical user interface and receiving operation instructions generated by a user acting on the graphical user interface.

The radio frequency circuit 404 can be used for transmitting and receiving radio frequency signals, so as to establish wireless communication with network equipment or other computer equipment through wireless communication, and send and receive signals with the network equipment or other computer equipment.

Audio circuitry 405 may be used to provide an audio interface between the user and computer equipment through speakers, microphones. The audio circuit 405 can convert the received audio data into an electrical signal, and transmit it to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is converted after being received by the audio circuit 405. In the form of audio data, the audio data is output to the processor 401 for processing, and then sent to, for example, another computer device via the radio frequency circuit 404, or the audio data is output to the memory 402 for further processing. Audio circuitry 405 may also include an ear jack to provide for communication of peripheral headphones with computer equipment.

The input unit 406 can be used to receive input numbers, character information or user characteristic information (such as fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control .

Power supply 407 is used to power various components of computer device 400 . Optionally, the power supply 407 may be logically connected to the processor 401 through a power management system, so that functions such as charging, discharging, and power consumption management are implemented through the power management system. The power source 407 may also include one or more DC or AC power sources, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and any other components.

Although not shown in FIG. 4 , the computer device 400 may further include a camera, a sensor, a Wi-Fi module, a Bluetooth module, and the like, which will not be repeated here.

In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

It can be seen from the above that the computer device provided in this embodiment can use an extension program to execute a picture data processing process. The extension program in this embodiment of the present application includes a plurality of custom classes, and each custom class is passed in the source code of the base class. Adding custom code to implement, the custom code involved is relatively simple and lightweight. And because the basic program in the electronic device of the embodiment of the present application has high scalability, the electronic device can obtain comprehensive functions, better compatibility and stability on the basis of developing a lightweight extension program. The video player or software can be used to perform various picture playback and processing functions through the video player or software, thereby improving the problems of high development cost and long development cycle in the prior art of re-development of the player.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructions, or by instructions that control relevant hardware, and the instructions can be stored in a computer-readable storage medium, and loaded and executed by the processor.

To this end, the embodiments of the present application provide a computer-readable storage medium, in which a plurality of computer programs are stored, and the computer programs can be loaded by a processor to execute any image data processing method provided by the embodiments of the present application. steps in . For example, the computer program may perform the following steps:

Use the custom picture reading class to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class;

Using a custom picture reading class, obtain the picture data of the picture to be played according to the file path of the picture to be played, and transmit the picture data to the custom picture rendering class;

Using the custom picture rendering class, obtain the picture reading logic and the duration logic from the custom picture reading class;

Using the custom picture rendering class, the to-be-played picture is played according to the duration logic, the picture reading logic, and the picture data obtained from the file path.

For the specific implementation of the above operations, reference may be made to the foregoing embodiments, and details are not described herein again.

Wherein, the storage medium may include: a read only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and the like.

Since the computer program stored in the storage medium can execute the steps in any of the picture data processing methods provided in the embodiments of the present application, it is possible to implement the steps in any of the picture data processing methods provided in the embodiments of the present application. For the beneficial effects that can be achieved, see the foregoing embodiments for details, which will not be repeated here.

A picture data processing method, device, storage medium, and computer equipment provided by the embodiments of the present application have been described in detail above. The principles and implementations of the present application are described with specific examples in this paper. The descriptions of the above embodiments It is only used to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. The contents of the description should not be construed as limiting the application.

Claims (13)

1. a picture data processing method, is characterized in that, is applied to electronic equipment, described electronic equipment utilizes extension program to carry out picture data processing flow, and described extension program comprises custom picture rendering class, custom picture material class and custom Image reading class; The method includes: Use the custom picture reading class to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class; Using a custom picture reading class, obtain the picture data of the picture to be played according to the file path of the picture to be played, and transmit the picture data to the custom picture rendering class; Using the custom picture rendering class, obtain the picture reading logic and the duration logic from the custom picture reading class; Using the custom picture rendering class, the to-be-played picture is played according to the duration logic, the picture reading logic, and the picture data obtained from the file path. 2. The method according to claim 1, wherein the extension program further comprises a custom single-frame timeline class; The use of the custom picture rendering class to realize the playback of the to-be-played picture according to the duration logic, the picture reading logic, and the picture data obtained from the file path includes: Use the custom single-frame timeline class to obtain the playback logic of the picture data; Using the custom picture rendering class, according to the duration logic, the picture reading logic, the picture data obtained from the file path, and the playing logic, the to-be-played picture is played. 3. The method according to claim 1, characterized in that, before the use of the self-defined picture reading class to obtain the file path of the to-be-played picture from the self-defined picture material class, the method further comprises: In response to the first creation operation on the custom picture material class, the custom picture material class is created on the basis of the media material class; wherein, the custom picture material class is used to define the content of the picture to be played. The file path, and the duration logic of the picture to be played. 4. The method according to claim 3, wherein, after the custom picture material class is created on the basis of the media material class in response to the first creation operation on the custom picture material class , the method also includes: Create a custom picture frame class based on the custom picture material class, wherein the custom picture frame class is used to create the custom picture reading class, and the custom picture reading class is used to define the picture read logic. 5 . The method according to claim 4 , wherein after creating a custom picture frame class based on the custom picture material class, the method further comprises: 5 . In response to the second creation operation on the custom picture reading class, the custom picture reading class is created on the basis of the material sampling class based on the custom picture frame class. 6. The method according to claim 3, characterized in that, after the custom picture material class is created on the basis of the media material class in response to the first creation operation on the custom picture material class , the method also includes: The custom single-frame timeline class is created based on the custom picture material class, where the custom single-frame timeline class is used to define the playback logic. 7 . The method according to claim 1 , wherein, before the use of the custom picture rendering class to obtain the picture reading logic and the duration logic from the custom picture reading class, the Methods also include: In response to the third creation operation on the custom picture rendering class, the custom picture rendering class is created on the basis of the rendering class; wherein, the custom picture rendering class is used to define the picture data. Drawing logic, the drawing logic is used to present the picture corresponding to the picture data on the display interface. 8. The method according to any one of claims 1 to 7, wherein the method further comprises: In response to the fourth creation operation on the custom player class, the custom player class is created on the basis of the player class; wherein the custom player class is used to add each of the extensions to in the corresponding basic program. 9. The method of claim 1, wherein the method further comprises: In response to the calling operation to the open graphics library, using the open graphics library, the custom rendering component is called; Obtain the frame buffer object of the picture to be played; processing the frame buffer object based on the custom rendering component to obtain a frame texture result; Binding the frame texture result with a target frame of a target video output by the electronic device, where the target video is a video generated by playing the to-be-played picture. 10. The method according to claim 9, wherein the processing the frame buffer object comprises: Render the first texture of the frame buffer object according to the preset aspect ratio, rotation direction and curtain algorithm, and obtain a first texture result, where the first texture result is the frame buffer object with the first texture; According to the preset beauty algorithm and filter algorithm, the first texture result is rendered, and the second texture result is obtained, and the second texture result is a frame buffer object with the second texture effect; According to the preset sticker adding algorithm and text adding algorithm, the second texture result is rendered to obtain a third texture result, and the third texture result is a frame buffer object with a third texture effect; According to a preset transition algorithm, the third texture result is rendered to obtain a fourth texture result, where the fourth texture result is a frame buffer object with a fourth texture effect, and the fourth texture result is the frame Texture result. 11. A picture data processing device, characterized in that it is applied to an electronic device, and the electronic device uses an extension program to execute a picture data processing flow, and the extension program includes a custom picture rendering class, a custom picture material class, and a custom picture material class. Image reading class; The device includes: a first obtaining unit, configured to use the custom picture reading class to obtain the file path of the picture to be played and the duration logic of the picture to be played from the custom picture material class; a second obtaining unit, configured to use a custom picture reading class, obtain picture data of the to-be-played picture according to the file path of the to-be-played picture, and transmit the picture data to the custom picture rendering class; a third obtaining unit, configured to use the custom picture rendering class to obtain the picture reading logic and the duration logic from the custom picture reading class; The picture playing unit is configured to use the custom picture rendering class to play the picture to be played according to the duration logic, the picture reading logic, and the picture data obtained from the file path. 12. An electronic device, comprising a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads the instructions from the memory to execute the instructions according to any one of claims 1 to 10. The steps in the image data processing method described above. 13. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a plurality of instructions, and the instructions are adapted to be loaded by a processor, so as to execute the method according to any one of claims 1 to 10. The steps in the image data processing method.

Images