CN118075125A - Node management method, electronic equipment and medium - Google Patents

Abstract

The present application provides a node management method, electronic device and medium, and relates to the field of terminal technology. The method includes: querying a target node associated with a target application, the target node is used to characterize the functions supported by the target application on the electronic device; if the target node is not queried, obtaining the configuration information of the target node provided by the target application; configuring the target node according to the node configuration template and the configuration information of the target node. Thus, if the special function of the target application is not supported by the electronic device, the post-processing management module of the electronic device can display the function control corresponding to the custom node in the relevant interface of the built-in application by adding a custom node, so that the special function of the application is adapted to the electronic device, and the customization capability of the target application is provided to the user.

Description

A node management method, electronic equipment and medium

Technical Field

The present application relates to the field of terminal technology, and in particular to a node management method, electronic equipment and medium.

Background technique

With the development of terminal technology, electronic devices such as mobile phones have become more and more functional and powerful. Electronic devices can present a colorful graphical user interface (GUI), in which a variety of functional controls are presented for users to use.

Currently, electronic devices can query node capabilities to obtain the functions supported by the electronic device on the target application, and then decide to display the function controls of the supported nodes in the user interface of the target application. However, some applications have special functions, but the electronic device does not support the special functions and cannot adapt to the target application. The software logic of the electronic device needs to be redesigned, which takes a long time and is costly.

Summary of the invention

The purpose of the present application is to provide a node management method, an electronic device and a medium, which can adapt the special functions of an application to the electronic device.

In the first aspect, the present application discloses a node management method, which is applied to electronic devices such as mobile phones, PADs, and large screens. The method includes: querying a target node associated with a target application, where the target node is used to characterize the functions supported by the target application on the electronic device; if the target node is not found, obtaining the configuration information of the target node provided by the target application; and configuring the target node according to a node configuration template and the configuration information of the target node.

Therefore, if the special functions of the target application are not supported by the electronic device, the post-processing management module of the electronic device can add a custom node and display the function controls corresponding to the custom node in the relevant interface of the built-in application to adapt the special functions of the application to the electronic device and provide users with customization capabilities of the target application.

In some possible implementations, the target node is configured according to the node configuration template and the configuration information of the target node, including: writing the configuration information of the target node into the corresponding field in the node configuration template, generating a configuration file of the target node, so as to complete the configuration of the target node.

In some possible implementations, the corresponding fields in the node configuration template include: a node identification field, a node plug-in path field, a node support capability name field, a node support capability parameter field, a node input data type field, a node output data type field, a node constraint condition field, and a combination of one or more of the node open information fields.

Therefore, by directly writing the configuration information of the target node into the configuration template, the configuration file of the target node can be generated conveniently and quickly, providing the user with the customization capability of the target application.

In some possible implementations, the method further includes: displaying a function control corresponding to the target node in a user interface of the target application. Thus, the electronic device can directly provide the user with the customization capability of the target application.

In some possible implementations, the method further includes: in response to a trigger operation on a function control corresponding to the target node, loading a configuration file of the target node.

In some possible implementations, the electronic device includes an application layer and a media middle station post-processing framework layer; the application layer includes a target application, and the media middle station post-processing framework layer includes a post-processing management module, which queries a target node associated with the target application, including: the target application sends a node query instruction for the target node to the post-processing management module; after receiving the node query instruction, the post-processing management module queries the target node.

In some possible implementations, the target node is configured according to the node configuration template and the configuration information of the target node, including: a post-processing management module configures the target node according to the node configuration template and the configuration information of the target node.

In some possible implementations, the post-processing framework layer of the media middle station also includes: a post-processing pipeline module, a post-processing node construction module; in response to a trigger operation on a function control corresponding to a target node, loading a configuration file of the target node, including: the target application obtains a trigger operation on a function control corresponding to the target node; the target application sends a pipeline creation instruction to the post-processing pipeline module through the post-processing management module according to the trigger operation; the post-processing pipeline module sends a target node construction instruction to the post-processing node construction module based on the pipeline creation instruction; the post-processing node construction module loads the configuration file of the target node based on the target node construction instruction.

Therefore, if the special functions of the target application are not supported by the electronic device, the post-processing management module of the electronic device can add a custom node and display the function controls corresponding to the custom node in the relevant interface of the built-in application to adapt the special functions of the application to the electronic device and provide users with customization capabilities of the target application.

In a second aspect, the present application discloses an electronic device, comprising a processor and a memory; the memory is used to store computer execution commands; the processor is used to execute the computer execution commands stored in the memory, so that the processor executes the method in the first aspect.

In a third aspect, the present application discloses a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is executed, the method in the first aspect is implemented.

In a fourth aspect, the present application provides a computer program product. When the computer program product is run on a computer, the computer executes a node management method as described in any one of the first aspects.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

FIG2 is a schematic diagram of a software structure of an electronic device provided in an embodiment of the present application;

FIG3 is a desktop schematic diagram of an electronic device provided in an embodiment of the present application;

FIG4 is a schematic diagram of a camera page of an electronic device provided in an embodiment of the present application;

FIG5 is a schematic diagram of a gallery page of an electronic device provided in an embodiment of the present application;

FIG6 is a schematic diagram of an editing page of an electronic device provided in an embodiment of the present application;

FIG7 is a timing diagram of a node management method provided in an embodiment of the present application;

FIG8 is a schematic diagram of a pipeline provided in an embodiment of the present application.

Detailed ways

The terms "first", "second", "third", etc. in the specification, claims and drawings of this application are used to distinguish different objects rather than to limit a specific order.

In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

In order to make the description of the following embodiments clear and concise, a brief introduction to the related technology is first given:

The media middle station post-processing framework refers to a framework that integrates multiple functions for media data processing. Different functions can be reflected through different nodes, that is, different nodes reflect different functions. In some examples, different electronic devices have different node capabilities of the media middle station post-processing framework. Applications at the application layer can query the capabilities supported by electronic devices through the media middle station post-processing framework and call related capabilities to achieve various functions, such as video editing, image capture, etc. In some examples, electronic devices can dynamically display function controls. Therefore, for different electronic devices, different users experience different functions.

With the development of terminal technology, electronic devices such as mobile phones have become more and more functional and powerful. Electronic devices can present a colorful graphical user interface (GUI), in which a variety of functional controls are presented for users to use.

Currently, electronic devices can query node capabilities to obtain the functions supported by the electronic device on the target application, and then decide to display the function controls of the supported nodes in the user interface of the target application. However, some applications have special functions, but the electronic device does not support the special functions and cannot adapt to the target application. The software logic of the electronic device needs to be redesigned, which takes a long time and is costly.

In view of this, an embodiment of the present application provides a node management method, an electronic device and a medium. In the method, if the special functions of the target application are not supported by the electronic device, the post-processing management module of the electronic device can add a custom node and display the function control corresponding to the custom node in the relevant interface of the built-in application to adapt the special functions of the application to the electronic device and provide the user with customization capabilities of the target application.

First, an exemplary electronic device 100 provided in an embodiment of the present application is introduced. In some embodiments, the electronic device 100 may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, and a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device and/or a smart city device. The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device 100. Referring to FIG. 1 , the figure is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application.

As shown in FIG1 , the electronic device may include a processor 110, an internal memory 121, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a sensor module 180, a display screen 194, etc. The sensor module 180 may include a touch sensor 180K, etc.

It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. For example, in the present application, the processor 110 can query the target node associated with the target application, and the target node is used to characterize the functions supported by the target application on the electronic device; if the target node is not queried, the configuration information of the target node provided by the target application is obtained; according to the node configuration template and the configuration information of the target node, the target node is configured. Therefore, if the special function of the target application is not supported by the electronic device, the post-processing management module of the electronic device can display the function control corresponding to the custom node in the relevant interface of the built-in application by adding a custom node, so that the special function of the application is adapted to the electronic device, and the customization capability of the target application is provided to the user.

The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K and the like through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface to realize the touch function of the electronic device. Based on the touch function of the electronic device, after the user touches the application icon displayed by the electronic device, the electronic device can start the application.

The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160.

The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera communicate via the CSI interface to implement the shooting function of the electronic device. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device. For example, the electronic device can display a related interface based on the display function.

The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with a camera, a display screen 194, a wireless communication module 160, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

It is understandable that the interface connection relationship between the modules illustrated in this embodiment is only a schematic illustration and does not constitute a structural limitation of the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 can provide solutions for wireless communications including 2G/3G/4G/5G, etc., applied to electronic devices. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to electronic devices. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

In some embodiments, the antenna 1 of the electronic device is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technology. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and/or satellite based augmentation system (SBAS).

In some examples, based on the wireless communication technology of the electronic device, the electronic device can download corresponding files, such as cloud configuration files, from the cloud.

The electronic device implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oled, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device may include 1 or N display screens 194, where N is a positive integer greater than 1.

A series of graphical user interfaces (GUIs) can be displayed on the display screen 194 of the electronic device, and these GUIs are the main screens of the electronic device. Generally speaking, the size of the display screen 194 of the electronic device is fixed, and only limited controls can be displayed on the display screen 194 of the electronic device. A control is a GUI element, which is a software component included in an application program, and controls all data processed by the application program and interactive operations on these data. Users can interact with the control through direct manipulation to read or edit relevant information of the application program. Generally speaking, controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. In some examples, when the functions supported by the electronic device are different, the functional controls displayed by the electronic device will be different.

The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121. For example, in this embodiment, the processor 110 can query the nodes supported by itself by executing the instructions stored in the internal memory 121, and then display the functional controls corresponding to the nodes supported by itself in the relevant interface of the target application. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.). The storage data area may store data created during the use of the electronic device (such as audio data, a phone book, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121, and/or the instructions stored in the memory provided in the processor.

In addition, an operating system is running on the above components, such as the iOS operating system developed by Apple, the Android open source operating system developed by Google, and the Windows operating system developed by Microsoft. Application programs can be installed and run on the operating system.

The operating system of the electronic device may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device.

See Fig. 2, which is a schematic diagram of the software structure of an electronic device provided in an embodiment of the present application. The present application embodiment takes the Android system with a layered architecture as an example to exemplarily illustrate the software structure of the electronic device 100.

The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: application layer (Applications, APP), framework layer (Framework, FWK), hardware abstraction layer (HAL) and kernel layer (Kernel).

Among them, the application layer may include a series of application packages. In some embodiments, the application layer may include applications such as video editing and preview players. The framework layer provides an application programming interface (API) and a programming framework for the application layer, and the framework layer may include some predefined functions. In some embodiments, the framework layer may include a media middle station post-processing framework (HnMediaGraph), etc., and the media middle station post-processing framework may include a management module, a graph generation module, a pipeline module, a node construction module, etc. The media middle station post-processing framework refers to a framework that integrates a variety of media data processing functions. Different functions can be embodied through different nodes, that is, different nodes have different functions. In some examples, different electronic devices have different node capabilities of the media middle station post-processing framework. The application layer application can query the capabilities supported by the electronic device through the media middle station post-processing framework, and call the relevant capabilities to achieve a variety of functions, such as video editing, shooting images, etc. The hardware abstraction layer defines the interface of the hardware "driver" to reduce the coupling degree between the Android operating system and the hardware. In some embodiments, the hardware abstraction layer may include filter algorithms, animation algorithms, text algorithms, etc. The kernel layer is responsible for managing the system's processes, memory, device drivers, files, and network systems, and determines the system's performance and stability.

In some embodiments, after the user opens the application video editing APP, the user can add or delete filter effects based on the pipeline in the post-processing management module on the video editing APP, and after adding or deleting filter effects according to the auxiliary filter algorithm, the video frame data is transmitted to the preview player of the video editing APP.

It should be noted that although the embodiment of the present application is described using the Android system as an example, its basic principles are also applicable to electronic devices 100 based on operating systems such as iOS and Windows.

Refer to Figure 3, which is a schematic diagram of the desktop of an electronic device provided in an embodiment of the present application. The scene includes an electronic device 100, and the electronic device 100 is described as a smart phone. The electronic device 100 can present a human-computer interaction interface. After the user unlocks the electronic device 100, the electronic device 100 can present a desktop 300 to the user. The desktop 300 may include icons of multiple applications, for example, a camera icon 301, a gallery icon 302, a music icon, and the like. The user can use a finger or a stylus to perform touch operations on the application icons in a variety of ways, and the present application does not limit the touch operation method.

In some embodiments, when the user clicks the camera icon 301 in the desktop 300, the electronic device 100 can present a camera page 400 to the user. Referring to FIG. 4, the figure is a schematic diagram of a camera page of an electronic device provided in an embodiment of the present application. The camera page 400 includes a gallery button 401, a lens flip button, a shooting button, etc. The user can click the gallery button 401 in the camera page 400 to enter the gallery page 500. Referring to FIG. 5, the figure is a schematic diagram of a gallery page of an electronic device provided in an embodiment of the present application. The gallery page 500 includes an edit button 501, a favorite button, a share button, etc. The user can further click the edit button 501 to enter the edit page 600. Referring to FIG. 6, the figure is a schematic diagram of an edit page of an electronic device provided in an embodiment of the present application. The edit page 600 includes a text button, a filter button, an adjustment button, a more button, etc., wherein the filter button can also include an original picture button, a morning light button, a dusk button, a halo button, a childhood button, etc., and by clicking on the button, operations such as editing, adding or deleting pictures or videos can be performed.

In other embodiments, the user can also click on the gallery icon 302 in the desktop 300. After the electronic device 100 presents the gallery page to the user, the user can click on the picture or video to be edited and perform an editing operation on it. It should be noted that the present application does not limit the method for selecting the video to be edited.

See Figure 7, which is a timing diagram of a node management method provided in an embodiment of the present application. The method includes:

S701: The electronic device starts a target application.

The target application can be any application in the above application layer, for example, it can be a gallery application or a camera application, and the target application can edit photos or videos. It should be noted that in addition to editing applications, it can also be other applications, such as game applications. This application does not limit the specific application. For ease of understanding, the following takes the electronic device as a mobile phone and the target application as a gallery application as an example to introduce the technical solution of this application.

In some specific implementations, the electronic device can receive a user's touch operation on the icon of the target application in the main interface and start the target application. The touch sensor 180K of the mobile phone can receive the user's touch operation on the icon of the target application in the main interface of the mobile phone and report it to the processor 110. The processor 110 can respond to the touch operation and display the user interface of the target application on the display screen 194. In addition, in the embodiment of the present application, other methods can be used to enable the mobile phone to start the gallery application and display the user interface of the gallery application on the display screen 194. For example, when the mobile phone is in a black screen, a lock screen, or the user interface of a certain application, the processor 110 can respond to the user's voice command or shortcut operation, etc., to start the gallery application and display the user interface of the gallery application on the display screen 194.

S702: The target application sends a version query instruction to the post-processing management module.

The version query instruction is used to query the current version number of the media middle station post-processing framework of the electronic device. The capabilities of the nodes supported by the version number of the current version of the media middle station post-processing framework can be further queried. A node refers to a function supported by an electronic device or a capability possessed by an electronic device. For example, if the electronic device supports a filter function, a filter node corresponding to the filter function exists in the electronic device. If the electronic device does not support the filter function, a filter node corresponding to the filter function does not exist in the electronic device. In other words, the target application can query the version number of the media middle station post-processing framework of the electronic device through the interface, and then query the currently available media nodes supported by the version of the media middle station post-processing framework, as well as the media capability description that the node can support, thereby further allowing the user to experience these different capabilities. Therefore, by setting the version number of the media middle station post-processing framework of different electronic devices, forward compatibility can be ensured, and version identification can be added to facilitate subsequent interface expansion.

It should be noted that the above query is only performed using the version number as an example. In other embodiments, it may be other identifiers that can be used to uniquely indicate the version, such as a serial number.

In some specific implementations, after the target application, ie, the gallery, is started, the gallery will send a version query instruction to the post-processing management module, and the capabilities of the nodes supported by the version can be further queried through the version number of the current version.

S703: The post-processing management module queries the version number.

After receiving the version query instruction issued by the target application, the post-processing management module can query the version number of the current media middle station post-processing framework, and then query the capabilities of the nodes supported by the version of the media middle station post-processing framework.

It should be noted that when the post-processing management module queries the capabilities of the nodes supported by the version of the post-processing framework of the media center, it is necessary to first load the configuration file (such as an XML file) of the node capabilities. The configuration file includes at least field information such as the node name and the node's plug-in library path. When the configuration file is loaded, the post-processing management module can parse the node capabilities of the configuration file to generate a suitable data structure and cache it for business queries.

It is understandable that when the configuration file supports a certain node capability, it indicates that the electronic device supports the function corresponding to the node; when the configuration file does not support a certain node capability, it indicates that the electronic device does not support the function corresponding to the node.

S704: The post-processing management module returns the version number to the target application.

After the post-processing management module queries the version number of the current version, it returns the version number to the target application. In a possible implementation, the post-processing management module returns the version number "version number 1" to the target application.

S705: The post-processing management module parses the configuration file of the node corresponding to the current version number.

The configuration file carries information such as the node name of the node, the node's plug-in library path, etc. After the post-processing management module obtains the node configuration file, it can parse the configuration file for node capabilities to obtain the node name and the plug-in library path. In a specific implementation, the post-processing management module can parse the configuration file of the filter node for node capabilities to obtain the node name of the filter node and the plug-in library path of the filter node.

In some examples, the node names of the filter nodes may include filter 1 (morning light), filter 2 (dusk), and filter 3 (halo), and the plug-in library path may include filter 1 plug-in library path, filter 2 plug-in library path, and filter 3 plug-in library path. The filter 1 plug-in library path, the filter 2 plug-in library path, and the filter 3 plug-in library path may be the same or different. It can be seen from the node names of the filter nodes that the electronic device may support the above-mentioned filter functions such as morning light, dusk, and halo.

S706: The post-processing management module obtains the plug-in library of the node.

After the post-processing management module completes parsing of the node capabilities of the configuration file, it can obtain the node name and the plug-in library path of the node, and obtain the plug-in library based on the plug-in library path.

In a specific implementation, taking the node name as Chenguang and the plug-in library path as the Chenguang plug-in library path as an example, the post-processing management module can obtain the Chenguang plug-in library based on the Chenguang plug-in library path.

S707: The post-processing management module loads and parses the plug-in library of the node.

Loading refers to loading the plug-in library into the process of the target application. The post-processing management module can load the plug-in library of the node into the process of the target application.

Parsing refers to parsing the node's plug-in library to obtain an interface to query whether the node exists, such as createMediaNodeByName(std::stringnodeName). The post-processing management module can parse the plug-in library to obtain an interface to query whether the node exists. Then, the post-processing management module can pass the node name of the target node to the interface to query whether the node exists, so as to query whether the target node exists in the plug-in library.

In some embodiments, after the post-processing management module parses the plug-in library, a node query function can be obtained, and the node query function is used to query whether a corresponding node exists in the plug-in library. For example, the node query function can be called to query the node in the plug-in library of the node with the node name, and then obtain a query result of whether the plug-in library includes the node. It should be noted that the above interface for querying whether a node exists can be a specific form of the node query function.

During the query process, a set including multiple nodes is maintained in the plug-in library. After the node name is passed to the interface of the plug-in library, the node name is compared with the node name in the set. If the node name exists in the set, it means that the plug-in library includes the node, that is, the electronic device supports the function corresponding to the node; if the node name does not exist in the set, it means that the plug-in library does not include the node, that is, the electronic device does not support the function corresponding to the node.

It should be noted that the node names compared during the query process are only examples, and those skilled in the art can select appropriate content for comparison based on actual needs to determine whether the target node is included in the plug-in library.

In some examples, the post-processing management module can load the Chenguang plug-in library into the process of the library, and then parse the Chenguang plug-in library to obtain the interface of the Chenguang plug-in library for querying whether a node exists. After obtaining the interface of the Chenguang plug-in library for querying whether a node exists, the post-processing management module passes the above node name such as Chenguang to the interface for querying whether a node exists, and then obtains the result of whether the Chenguang node exists in the Chenguang plug-in library.

In other examples, the post-processing management module can load the dusk plug-in library into the process of the library, and then parse the dusk plug-in library to obtain the interface of the dusk plug-in library for querying whether a node exists. After obtaining the interface of the dusk plug-in library for querying whether a node exists, the post-processing management module passes the above node name such as dusk to the interface for querying whether a node exists, and then obtains the result of whether the dusk node exists in the dusk plug-in library.

Among them, the above-mentioned Morning Light plug-in library and Dusk plug-in library can be the same plug-in library, that is, the path of the Morning Light plug-in library is the same as the path of the Dusk plug-in library. Of course, the above-mentioned Morning Light plug-in library and Dusk plug-in library can also be different plug-in libraries, that is, the path of the Morning Light plug-in library is different from the path of the Dusk plug-in library.

After obtaining the result of whether the node exists in the plug-in library, the post-processing management module can record the nodes existing in the plug-in library in the node capability information table. In some examples, the node capability information table can be shown in Table 1 below:

Node Name Support Morning Light yes dusk no Halo yes … …

S708: The post-processing management module determines whether the nodes corresponding to the current version number include the required nodes.

Required nodes refer to nodes provided by the target application that can achieve a certain effect. For example, text nodes, animation nodes, etc. can all be required nodes. In the prior art, there is a problem that some applications have special functions, but the electronic device does not support the special functions, that is, the electronic device cannot adapt to the target application. Therefore, the post-processing management module can first determine whether the nodes corresponding to the version number of the current framework contain the required nodes.

Since the post-processing management module has completed the parsing of the configuration file of the node corresponding to the current version number, the post-processing management module has obtained the node name and the plug-in library of the node corresponding to the current version number. In a specific implementation, the node name can be queried in the plug-in library of the node by calling the node query function, and then the query result of whether the plug-in library includes the node can be obtained.

If the post-processing management module determines that the node corresponding to the current version number does not contain the required node, S709 and subsequent operations are executed. If the post-processing management module determines that the node corresponding to the current version number already contains the required node, it continues to determine whether the node corresponding to the current version number contains the next required node.

S709: Add a custom node to the post-processing management module.

Adding a custom node means expanding the required nodes that are not included in the nodes corresponding to the current version number. The post-processing management module can add a custom node and display the function controls corresponding to the custom node in the relevant interface of the built-in application to adapt the special functions of the application to the electronic device and provide users with the customization capability of the target application.

In a specific implementation, when the target application needs to provide a function of inserting text into a video file, and the media middle platform post-processing framework of the electronic device does not support the function of inserting text into a video file, the post-processing management module can add a text node as a custom node to customize the text customization capability that meets the requirements. For ease of understanding, the following description will be based on the custom node as the text node.

In some instances, the post-processing management module can generate a configuration file for the target node by writing the configuration information of the target node into the corresponding field in the node configuration template to complete the configuration of the target node. The node configuration template may include fields such as the node identification field, the node plug-in path field, the node support capability name field, the node support capability parameter field, the node input data type field, the node output data type field, the node constraint condition field, and the node open information field. The configuration information may be the field value to be written into the above fields. Specifically, the node configuration template may be as follows:

＜? xmlverson="1.0"encoding="utf-8"? >

<MediaNodes>

<!--Node Configuration Properties-->

<!--name, node name and ID -->

<！ --path, the plugin path where the node is located -->

<Nodename="xxx", path="xxx/xx/xx.so">

<! --Capabilities supported by the node, parameters that can be set, and parameter values -->

<Capsname="xxx"value="xxx"/>

<Capsname="xxx"value="xxx"/>

<!--Node input and data type, supports multiple -->

<Input name="xxx" type="xxx"/>

<!--Node output and data type, supports multiple -->

<Outputname="xxx"type="xxx"/>

<! -- Usage constraints, node dependence on the platform, invisible to the application -->

<Limitname="deps"value="system|chip"/>

<! --Is it open to the outside world? -->

<Limitname="opens"value="true|false"/>

</Node>

<Nodename="xxx">

<!--Node attributes and capabilities-->

</Node>

<MediaNodes>

It should be noted that there may be other forms of node configuration templates, and this application does not limit the specific content of the node configuration templates.

S710: The post-processing management module loads the configuration file of the custom node.

Similar to S703, the post-processing management module can load a configuration file (e.g., an XML file) of a custom node. The configuration file includes at least field information such as the node name and the node's plug-in library path. When the configuration file is loaded, the post-processing management module can parse the configuration file for node capabilities, thereby generating a suitable data structure and caching it for business queries.

S711: The post-processing management module parses the configuration file of the custom node.

Similar to S705, the configuration file of the custom node carries information such as the node name of the custom node, the plug-in library path of the custom node, etc. After the post-processing management module obtains the configuration file of the custom node, it can parse the configuration file for node capabilities to obtain the custom node name and the plug-in library path.

In some examples, the node name of the custom node may include text 1 (Songti) and text 2 (Kaiti), etc., and the plug-in library path may include text 1 plug-in library path and text 2 plug-in library path. The text 1 plug-in library path and the text 2 plug-in library path may be the same or different. It can be known from the node name of the text node that the electronic device may support the above-mentioned text functions such as Songti and Kaiti.

S712: The post-processing management module obtains a plug-in library of the custom node.

Similar to S706, after the post-processing management module completes parsing the node capability of the configuration file of the custom node, it can obtain the custom node name and the plug-in library path of the custom node, and obtain the plug-in library based on the plug-in library path.

In a specific implementation, taking the node name as Songti and the plug-in library path as the Songti plug-in library path as an example, the post-processing management module can obtain the Songti plug-in library based on the Songti plug-in library path.

S713: The post-processing management module loads the plug-in library of the custom node.

The post-processing management module can load the plug-in library of the custom node into the process of the target application, thereby generating the corresponding node information and capabilities.

Therefore, if the special functions of the application are not supported by the electronic device, the post-processing management module of the electronic device can add a custom node and display the function controls corresponding to the custom node in the relevant interface of the built-in application to adapt the special functions of the application to the electronic device and provide users with customization capabilities of the target application.

S714: The target application obtains the file to be processed and a selection operation of the effect of the editing page.

The file to be processed selected by the user may be a picture file or a video file. The electronic device 100 may obtain the file to be processed selected by the user by obtaining the storage location of the file to be processed selected by the user in the electronic device 100. For ease of understanding, the following description will be based on the file to be processed being a video file.

The target application of the electronic device 100 can obtain the effect selected by the user to be added to the file to be processed. Specifically, the user enters the editing interface displayed by the electronic device 100. The editing page includes effects such as text, filters, and adjustments. At this time, the editing interface has displayed the customization capability, that is, the text effect. For ease of understanding, the following will be explained with the selected effects as filter effects and text effects.

In some embodiments, the user can click on the filter button and select the filter type, such as morning light, dusk, halo, etc., to add the filter effect to the corresponding picture or video. In other embodiments, the user can click on the text button to add text effects to the picture or video file; in other embodiments, the user can click on the adjustment button to adjust the display parameters of the picture or video.

S715: The target application calls the version number interface to the post-processing management module.

After obtaining the version number of the post-processing management module, the target application will call the post-processing interface supported by the version. In a possible implementation, if in S704, the post-processing management module returns the version number "version 1" to the target application, the version number interface called by the target application to the post-processing management module is the interface of version 1.

S716: The target application sends the file to the post-processing pipeline module and issues an instruction to create a pipeline.

A pipeline is a linear communication model that can be viewed as an assembly line. In simple terms, it is a comprehensive solution for a system that provides a one-stop service for obtaining results.

After the target application obtains the video file to be processed and the selection operation of the effect of the editing page, the target application sends the video file to the post-processing pipeline module and issues an instruction to create a video analysis pipeline.

S717: The post-processing pipeline module sends an instruction to construct a decoding node to the post-processing node construction module.

The decoding node is a functional node used to implement decoding. Decoding is a process of using a specific method to restore digital data to the content it represents or convert electrical pulse signals, optical signals, radio waves, etc. into the information, data, etc. it represents. Decoding is the process by which the recipient restores the received symbols or codes to information, corresponding to the encoding process. For example, in this application, the decoding node can decode a video stream in the H264 format and an audio stream in the ACC format, and further construct a video stream control node and an audio stream control node.

When the post-processing pipeline module receives the instruction to create a pipeline from the target application, it sends an instruction to construct a decoding node to the post-processing node construction module.

S718: The post-processing node construction module constructs a decoding node.

The post-processing node construction module constructs the decoding node based on the acquired instruction for constructing the decoding node. It should be noted that the construction here refers to loading into the memory.

S719: The post-processing pipeline module sends an instruction to construct a filter node to the post-processing node construction module.

The filter node is a functional node for adding a filter. In the present application, for example, the filter node may be a dusk filter node. By constructing the dusk filter node, a dusk filter may be added to a video file so that a user can watch the video file after the dusk filter is added.

When the post-processing pipeline module receives the instruction to create a pipeline from the target application, it sends an instruction to construct a filter node to the post-processing node construction module.

S720: The post-processing node construction module constructs a filter node.

The post-processing node construction module constructs the filter node based on the acquired instruction for constructing the filter node. It should be noted that the construction here refers to loading into the memory.

S721: The post-processing pipeline module sends an instruction to construct a custom node to the post-processing node construction module.

When the post-processing pipeline module receives the instruction to create a pipeline from the target application, it sends an instruction to build a custom node to the post-processing node construction module. In some possible implementations, if the application has a special function of adding text to a video file, but the electronic device does not support this special function, the post-processing management module can add a text node as a custom node to adapt the special function of the application to the electronic device and provide the user with the customization capability of the target application. At this time, the instruction to build a custom node sent by the post-processing pipeline module to the post-processing node construction module is an instruction to build a text node.

S722: The post-processing node construction module constructs a custom node.

The post-processing node construction module constructs the custom node based on the acquired instruction for constructing the custom node. It should be noted that the construction here refers to loading into the memory.

S723: The post-processing pipeline module sends a pipeline construction instruction to the post-processing graph generation module.

After the target application sends an instruction to create a pipeline to the post-processing pipeline module, the post-processing pipeline module sends instructions to the post-processing node construction module to construct decoding nodes, filter nodes, and custom nodes. After the post-processing node construction module completes the construction of decoding nodes, filter nodes, and custom nodes, the post-processing pipeline module sends instructions to the post-processing graph generation module to build a pipeline based on the above nodes. It should be noted that in addition to decoding nodes, filter nodes, and custom nodes, the constructed nodes can also include other nodes, such as decapsulation nodes, encapsulation nodes, animation nodes, etc. This application does not limit the specific node names and their functions.

S724: The post-processing graph generation module constructs a pipeline.

The post-processing graph generation module can construct a pipeline based on nodes such as decoding nodes, filter nodes, custom nodes, etc. See Figure 8, which is a schematic diagram of a pipeline provided by an embodiment of the present application. A pipeline can be a video file that flows sequentially to a decoding node, a text A node, and a filter B node, so that a user can obtain a video file with text A and filter B added.

In some possible implementations, after the post-processing graph generation module constructs the pipeline, the parameters of the pipeline can also be configured. In some embodiments, "decoding to YUV format" or "decoding to RGB format" can be set at the decoding node. It should be noted that the parameter configurations of different nodes are different, and this application does not limit the configuration of the parameters.

S725: The post-processing graph generation module sends the pipeline to the post-processing pipeline module.

S726: The post-processing pipeline module runs the file based on the constructed pipeline.

The post-processing pipeline module attempts to run the pipeline that was started. In some specific implementations, you can click start at the beginning of the pipeline that needs to be run to run the pipeline. By running the pipeline, the video to be processed is processed to obtain a video file with filters and text effects.

It should be noted that after starting the pipeline, the capacity can be reconfigured by changing the node capacity.

S727: The post-processing pipeline module sends the file to the target application.

The post-processing pipeline module outputs the video with effects to the target application of the electronic device 100. At this time, the user's electronic device 100 can preview the processed video file with filters and text effects.

The present application provides a node management method, in which, if the special functions of an application are not supported by an electronic device, a post-processing management module of the electronic device can add a custom node and display the function controls corresponding to the custom node in the relevant interface of the built-in application to adapt the special functions of the application to the electronic device and provide users with customization capabilities of the target application.

An embodiment of the present application further provides a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is executed, each function or step performed by the electronic device 100 in the above method embodiment is implemented.

Another embodiment of the present application further provides a computer program product including instructions. When the computer program product is run on a computer or a processor, the computer or the processor executes one or more steps in any of the above methods.

Claims (10)

1. A node management method, characterized in that it is applied to an electronic device, the method comprising: Querying a target node associated with a target application, wherein the target node is used to represent a function supported by the target application on the electronic device; If the target node is not found, obtaining configuration information of the target node provided by the target application; The target node is configured according to the node configuration template and the configuration information of the target node. 2. The method according to claim 1, characterized in that configuring the target node according to the node configuration template and the configuration information of the target node comprises: The configuration information of the target node is written into the corresponding field in the node configuration template, and a configuration file of the target node is generated to complete the configuration of the target node. 3. The method according to claim 2, characterized in that the corresponding fields in the node configuration template include: A combination of one or more of the following: node identification field, node plug-in path field, node support capability name field, node support capability parameter field, node input data type field, node output data type field, node constraint condition field, and node open information field. 4. The method according to any one of claims 1 to 3, characterized in that the method further comprises: In the user interface of the target application, a function control corresponding to the target node is displayed. 5. The method according to claim 4, characterized in that the method further comprises: In response to a triggering operation on a function control corresponding to the target node, a configuration file of the target node is loaded. 6. The method according to any one of claims 1 to 5, characterized in that the electronic device includes an application layer and a media middle station post-processing framework layer; the application layer includes a target application, the media middle station post-processing framework layer includes a post-processing management module, and the querying of the target node associated with the target application includes: The target application sends a node query instruction for the target node to the post-processing management module; After receiving the node query instruction, the post-processing management module queries the target node. 7. The method according to claim 6, characterized in that configuring the target node according to the node configuration template and the configuration information of the target node comprises: The post-processing management module configures the target node according to the node configuration template and the configuration information of the target node. 8. The method according to claim 6 or 7, characterized in that the media middle station post-processing framework layer further comprises: a post-processing pipeline module and a post-processing node construction module; the configuration file of the target node is loaded in response to the triggering operation of the function control corresponding to the target node, comprising: The target application obtains a trigger operation for a function control corresponding to the target node; The target application sends a pipeline creation instruction to the post-processing pipeline module through the post-processing management module according to the trigger operation; The post-processing pipeline module sends a construction instruction of a target node to the post-processing node construction module based on the instruction to create the pipeline; The post-processing node construction module loads the configuration file of the target node based on the construction instruction of the target node. 9. An electronic device, comprising a processor and a memory; The memory is used to store computer-executable instructions; The processor is configured to execute the computer-executable instructions stored in the memory, so that the processor executes the method according to any one of claims 1 to 8. 10. A computer-readable storage medium, characterized in that a computer program or instruction is stored in the computer-readable storage medium, and when the computer program or instruction is executed, the method according to any one of claims 1 to 8 is implemented.