WO2024198989A1 - Video generation method and apparatus - Google Patents

Abstract

The present disclosure relates to the technical field of video processing, and provides a video generation method and apparatus. A specific embodiment of the method comprises: in response to acquiring a video generation request, acquiring video element information on the basis of the video generation request (201); obtaining a target animation on the basis of a new animation description file and an animation template file (202); executing a screenshot operation on the basis of the target animation, and obtaining an ordered picture sequence (203); and generating a target video on the basis of the ordered picture sequence (204).

Description

Video generation method and device

CROSS-REFERENCE TO RELATED APPLICATIONS

This patent application claims priority to the Chinese patent application filed on March 24, 2023, with application number 202310298310.5 and invention name “Video Generation Method and Device”, the full text of which is incorporated by reference into this application.

Technical Field

The present disclosure relates to the field of computer technology, specifically to the field of video processing technology, and more particularly to a video generation method and device.

Background Art

In the field of e-commerce, advertising creativity in various forms such as copywriting, pictures and videos can effectively increase users' attention to products and improve the overall marketing effect by visually presenting key information such as product features and selling points to users. Among them, video creativity integrates video, audio, pictures and text, and is more vivid in expression. It is the most effective way to promote users' cognition, preference and purchase intention of products. Therefore, it is necessary to provide a convenient and efficient video creative generation solution to help advertisers promote and market their products.

Summary of the invention

Embodiments of the present disclosure provide a video generation method, apparatus, device, and storage medium.

According to the first aspect, an embodiment of the present disclosure provides a video generation method, the method comprising: in response to obtaining a video generation request, obtaining video element information based on the video generation request; obtaining a target animation based on a new animation description file and the animation template file; based on the target animation, performing a screenshot operation to obtain an ordered image sequence; and generating a target video based on the ordered image sequence.

According to a second aspect, an embodiment of the present disclosure provides a video generation device, the device comprising: an acquisition module, configured to respond to a video generation request and obtain video element information based on the video generation request; a replacement module, configured to replace the video element information based on the new animation description; file and the animation template file to obtain the target animation; the screenshot module is configured to perform a screenshot operation based on the target animation to obtain an ordered image sequence; the generation module is configured to generate a target video based on the ordered image sequence.

According to the third aspect, an embodiment of the present disclosure provides an electronic device, which includes one or more processors; a storage device on which one or more computer programs are stored, and when the one or more computer programs are executed by the one or more processors, the one or more processors implement a video generation method as in any embodiment of the first aspect.

According to a fourth aspect, an embodiment of the present disclosure provides a non-transitory computer-readable medium having computer instructions stored thereon, which, when executed by a computer, implements a video generation method as in any embodiment of the first aspect.

It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is an exemplary system architecture diagram in which the present disclosure may be applied;

FIG2 is a flow chart of an embodiment of a video generation method according to the present disclosure;

FIG3 is a schematic diagram of an application scenario of the video generation method according to the present disclosure;

FIG4 is a flow chart of another embodiment of a video generation method according to the present disclosure;

FIG5 is a schematic diagram of an embodiment of a video generating apparatus according to the present disclosure;

FIG6 is a schematic diagram of one embodiment of a video generation system according to the present disclosure;

FIG. 7 is a schematic diagram of the structure of a computer system suitable for implementing a server of an embodiment of the present disclosure.

DETAILED DESCRIPTION

The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

FIG. 1 shows an exemplary system architecture 100 to which an embodiment of the video generation method of the present disclosure may be applied.

As shown in Fig. 1, system architecture 100 may include terminal devices 101, 102, 103, network 104 and server 105. Network 104 is used to provide a medium for communication links between terminal devices 101, 102, 103 and server 105. Network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

The terminal devices 101, 102, 103 interact with the server 105 via the network 104 to receive or send messages, etc. Various communication client applications, such as video playback applications, communication applications, etc., may be installed on the terminal devices 101, 102, 103.

Terminal devices 101, 102, 103 can be hardware or software. When terminal devices 101, 102, 103 are hardware, they can be various electronic devices with display screens, including but not limited to mobile phones and laptops. When terminal devices 101, 102, 103 are software, they can be installed in the electronic devices listed above. They can be implemented as multiple software or software modules (for example, to provide video generation services), or as a single software or software module. No specific limitation is made here.

Server 105 can be a server that provides various services, for example, in response to obtaining a video generation request, obtaining video element information based on the video generation request; obtaining a target animation based on a new animation description file and the animation template file; performing a screenshot operation based on the target animation to obtain an ordered image sequence; and generating a target video based on the ordered image sequence.

It should be noted that the server 105 can be hardware or software. When the server 105 is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, for providing video generation services), or it can be implemented as a single software or software module. No specific limitation is made here.

It should be noted that the video generation method provided in the embodiment of the present disclosure can be executed by the server 105, can be executed by the terminal devices 101, 102, 103, or can be executed by the server 105 and the terminal devices 101, 102, 103 in cooperation with each other. The various parts (such as various units, sub-units, modules, sub-modules) included in the device can be all set in the server 105, or all set in the terminal devices 101, 102, 103, or respectively set in the server 105 and the terminal devices 101, 102, 103.

It should be understood that the number of terminal devices, networks and servers in Figure 1 is only illustrative. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

FIG2 shows a process 200 of an embodiment of a video generation method that can be applied to the present disclosure. In this embodiment, the video generation method includes the following steps:

Step 201: in response to obtaining a video generation request, obtaining video element information based on the video generation request.

In this embodiment, the execution entity (such as the server 105 or the terminal devices 101, 102, 103 shown in FIG1) can obtain the video generation request in a wired or wireless manner, and obtain the video element information based on the video generation request.

The video element information may include: an animation template file, an animation description file, and a target material.

Here, the video generation request may directly include information such as the animation template file, animation description file, target material, etc., or it may only include information such as the animation template file storage path, animation description file storage path, target material storage path, etc. After obtaining the video generation request, the execution entity may obtain the animation template file, animation description file and target material according to the animation template file storage path, animation description file storage path and target material storage path respectively.

Among them, the animation template file is a JSON file used to describe the animation and is stored in the animation template database. The animation is produced by animators using the animation software AE (Adobe After Effects), and combined with the Bodymovin plug-in, the animation produced on AE is exported as a JSON file, which supports rendering and playback on Web/Android/IOS, etc. This JSON file is called an animation template file, which includes basic animation information such as picture collection, layer collection, view width and height, start and end keyframes, frame rate, etc.

The animation description file uses a script to extract the relevant animation information that the backend video generation depends on from the animation template file. Each animation template file has a corresponding animation description file. The animation description file includes the animation duration and animation material information. The animation material information is divided into two categories: picture materials and text materials, which are distinguished by the type field. Including the image URL, local file name, width, height, layer subscript, etc. The text material includes the text content, minimum and maximum text length, layer subscript, etc.

It should be noted that the video element information may also include information such as the width, height, frame rate, and duration of the target video.

Among them, the above-mentioned wireless connection methods may include but are not limited to 3G/4G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other wireless connection methods currently known or to be developed in the future.

In some optional methods, based on the video generation request, video element information is obtained, including: obtaining the animation template file, the animation description file and the target material according to the animation template file storage path, the animation description file storage path and the target material storage path.

In this implementation, the video generation request may include the animation template file storage path, the animation description file storage path, and the target material storage path. The execution entity may obtain the animation template file, the animation description file, and the target material based on the animation template file storage path, the animation description file storage path, and the target material storage path.

This implementation method reduces the amount of data transmission, improves information transmission efficiency, and further improves video generation efficiency by obtaining animation template files, animation description files, and target materials according to the image template file storage path, animation description file storage path, and target material storage path.

Step 202: Get the target animation based on the new animation description file and the animation template file.

In this embodiment, the execution entity can replace the material in the animation description file according to the target material to obtain a new animation description file, read the contents of the animation template file and the new animation description file, and fill the read contents into the HTML page of the Lottie code to obtain the target animation.

Step 203: Based on the target animation, a screenshot operation is performed to obtain an ordered sequence of pictures.

In this embodiment, the execution subject can perform a screenshot operation on the target animation, that is, render, play and screenshot the target animation to obtain an ordered sequence of pictures.

Specifically, the execution subject can first create a Chrome browser and open an HTML page in a non-interface manner through Puppeteer, jump to a specified frame through the Lottie animation library, and then use Puppeteer to take a screenshot of the specified frame and save it to a storage medium cluster.

In some optional embodiments, the method further includes: managing the browser using a resource pool, specifically including at least one of the following: initializing the browser before obtaining a video generation request; and recycling the used browser after the browser is used.

In this embodiment, since the screenshot operation includes creating a browser for taking screenshots, such as using Puppeteer to create a Chrome browser, if a browser needs to be created after each request, a high creation process overhead will be generated. In order to reduce the process overhead generated by repeated browser creation and reduce resource consumption, the execution entity can use a resource pool to uniformly manage browser resources.

Specifically, the execution subject can initialize some browsers from the resource pool before the video generation request arrives, and can directly obtain the browser from the resource pool after each video generation request arrives. After use, the resource pool is responsible for recycling the used browser resources.

This implementation method realizes unified management of browser resources by initializing the browser before obtaining a video generation request and recycling the used browser after the browser is used, avoiding repeated operations of creating a browser for each request and effectively reducing resource consumption.

Step 204: Generate a target video based on the ordered picture sequence.

In this embodiment, the execution subject can directly encode the ordered picture sequence through a video encoding tool to generate a target video, or it can encode the ordered picture sequence and a video generation command through a video encoding tool to generate a target video. This disclosure does not limit this.

Among them, the video generation command can be included in the above-mentioned video generation request, and the video generation command can include at least one of the following: specifying the image sequence path, truncating or repeating the music according to the duration specified in the animation template, and superimposing barrage and special effects.

In some optional methods, generating a target video based on an ordered picture sequence includes: generating a target video based on an ordered picture sequence and a video generation command.

In this implementation, the video element information also includes: a video generation command, which includes at least one of the following: specifying a picture sequence path, truncating or repeating the music according to the duration specified in the animation template, and superimposing barrage and special effects.

After obtaining the ordered picture sequence, the execution subject can encode the ordered picture sequence and the video generation command through the video encoding tool to generate the target video, and then convert the video file into And the video MD5 verification file is synchronized to the storage medium cluster.

This implementation method generates a target video based on an ordered image sequence and a video generation command, thereby effectively improving the effectiveness of the generated target video.

Continuing to refer to FIG. 3 , FIG. 3 is a schematic diagram of an application scenario of the video generation method according to this embodiment.

In the application scenario of Figure 3, the execution entity 301 can monitor the video generation request 302 in real time or periodically in a wired or wireless manner, and in response to obtaining the video generation request 302, obtain video element information based on the video generation request, wherein the video element information includes: an animation template file 303, an animation description file 304 and a target material 305; based on a new animation description file 306 and the animation template file 303, obtain a target animation 307, wherein the new animation description file is obtained by replacing the material in the animation description file with the target material; based on the target animation 307, perform a screenshot operation 308 to obtain an ordered image sequence 309; based on the ordered image sequence 309, generate a target video 310.

The video generation method disclosed in the present invention obtains video element information based on the video generation request in response to obtaining a video generation request; obtains a target animation based on a new animation description file and an animation template file; performs a screenshot operation based on the target animation to obtain an ordered image sequence; and generates a target video based on the ordered image sequence, that is, fully utilizing the extensibility and reusability of animation templates, enriching video styles, and reducing development costs, effectively overcoming the problems of limited video diversity and high development costs in template-based video generation systems in related technologies.

Further reference is made to Fig. 4, which shows a process 400 of yet another embodiment of the video generation method shown in Fig. 2. In this embodiment, the process 400 of the video generation method may include the following steps:

Step 401: in response to obtaining a video generation request, obtaining video element information based on the video generation request.

In this embodiment, the implementation details and technical effects of step 401 can refer to the description of step 201 and will not be repeated here.

Step 402, based on the new animation description file and animation template file, obtain the target animation painting.

In this embodiment, the implementation details and technical effects of step 402 can refer to the description of step 202 and will not be repeated here.

Step 403: Divide the target animation into a preset number of sub-segments.

In this embodiment, since rendering, playback and screenshot are operations that consume a large amount of CPU and memory resources, for a single video generation request on a single machine, in order to utilize multi-core performance and improve CPU utilization, rendering, playback and screenshot are split into multiple different processes and performed simultaneously.

To this end, the execution entity may divide the target animation into a preset number of sub-segments, wherein the preset number may be set according to actual needs, for example, 5, 7, etc., and the present disclosure does not limit this.

Step 404 , running a preset number of sub-processes in parallel to perform screenshot operations on a preset number of sub-segments to obtain a preset number of sub-picture sequences.

In this embodiment, the execution entity may run a preset number of sub-processes in parallel to perform screenshot operations on a preset number of sub-segments to obtain a preset number of sub-picture sequences.

Among them, the number of sub-processes running in parallel is the same as the number of sub-segments, for example, the preset number is 6. Each sub-process performs a screenshot operation on a sub-segment to obtain a sub-image sequence. The sub-segments corresponding to each sub-process are different, that is, each animation is screenshoted in parallel by multiple sub-processes, and each sub-process is responsible for capturing a part of the animation. The captured image ranges between sub-processes do not overlap.

Step 405: Generate an ordered picture sequence based on a preset number of sub-picture sequences.

In this embodiment, the execution subject may sort the sub-picture sequence according to the range of the interception operation executed by each sub-process and the position of the image frame to obtain an ordered picture sequence.

Specifically, the scope of the interception operation performed by each child process can be calculated by the following formula:

Set the number of subprocesses to n, the frame rate to fps (frames/s), the total duration of the animation to total_duration(s), and i to be the number of pictures before the sub-segment corresponding to the current subprocess in the animation. Then the index-th subprocess performs an interception operation on the corresponding segment, and the duration range of the subsequence is:
(i+index*m _index )*msTimeStep,0≤i<m _index (1)

Among them, m _index is the number of pictures that the index-th child process needs to capture:

msTimeStep is the millisecond step size:
msTimeStep＝ 1000/fps (3)

k is the total number of frames:
k＝fps*total_duration (4)

Step 406: Generate a target video based on the ordered picture sequence.

In this embodiment, the implementation details and technical effects of step 406 can refer to the description of step 204 and will not be repeated here.

As can be seen from Figure 4, compared with the embodiment corresponding to Figure 2, the process 400 of the video generation method in this embodiment embodies dividing the target animation into a preset number of sub-segments, running a preset number of sub-processes in parallel to perform screenshot operations on a preset number of sub-segments, obtaining a preset number of sub-picture sequences, generating an ordered picture sequence based on the preset number of sub-picture sequences, and generating a target video based on the ordered picture sequence. This method creates multiple sub-processes for rendering, playback and screenshots in parallel to speed up the picture capture speed, thereby effectively speeding up the video generation speed.

Further referring to FIG. 5 , as an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a video generating device, which corresponds to the method embodiment shown in FIG. 2 , and can be specifically applied to various electronic devices.

As shown in FIG. 5 , the video generating device 500 of this embodiment includes: an acquiring module 501 , a replacing module 502 , a screenshot module 503 and a generating module 504 .

The acquisition module 501 may be configured to acquire video element information based on the video generation request in response to acquiring the video generation request.

The replacement module 502 may be configured to obtain a target animation based on a new animation description file and the animation template file.

The screenshot module 503 may be configured to perform a screenshot operation based on the target animation to obtain an ordered sequence of images.

The generating module 504 may be configured to generate a target video based on the ordered picture sequence.

In some optional modes of this embodiment, the screenshot module is further configured to: divide the target animation into a preset number of sub-segments; run a preset number of sub-processes in parallel to perform screenshot operations on a preset number of sub-segments to obtain a preset number of sub-image sequences; and generate an ordered image sequence based on the preset number of sub-image sequences.

In some optional aspects of this embodiment, the acquisition module is further configured to acquire the animation template file, the animation description file and the target material according to the animation template file storage path, the animation description file storage path and the target material storage path.

In some optional aspects of this embodiment, the generation module is further configured to: generate a target video based on an ordered picture sequence and a video generation command.

In some optional modes of this embodiment, the video generation command includes at least one of the following: specifying a picture sequence path, truncating or repeating the music according to the duration specified in the animation template, and superimposing barrage and special effects.

In some optional aspects of this embodiment, the screenshot operation includes creating a browser to take the screenshot.

In some optional aspects of this embodiment, the device further includes a management module, which is configured to manage the browser using a resource pool, specifically including at least one of the following: initializing the browser before obtaining a video generation request; and recycling the used browser after the browser is used.

With further reference to FIG. 6 , the present disclosure provides an embodiment of a video generation system.

In this embodiment, the system includes a request server 601 and a video generation sub-server 602 .

The request server 601 may be a server that provides various services, for example, generates multiple video generation requests based on user input information, and sends the multiple video generation requests to one or more video generation sub-servers in a video generation sub-server cluster.

The video generation sub-server 602 is used to execute the video generation method described in any of the above embodiments.

Wherein, based on the user input information, multiple video generation requests are generated, and the multiple video generation requests are sent to one or more video generation sub-servers in the video generation sub-server cluster, which may specifically include the following four steps:

Step 6011, video production request preprocessing. The request server first receives the video generation information selected by the advertiser through the front-end display page, such as the item ID, template ID, and ad slot ID, and then parses the request and determines whether the request is a valid request and whether it contains necessary information such as the item ID, template ID, and ad slot ID. If not, the request is considered to be an invalid request, and a failure message is returned, and the video generation progress is set to an invalid progress. If it is a valid request, go to step 6012.

Step 6012, material acquisition. The related materials that video production relies on include text materials, picture materials, music materials, template materials, etc. If the advertiser uploads local materials on his own, go to step 6014. Otherwise, go to step 6013 by obtaining materials from local files or remote material databases. For example, text materials can be obtained by accessing the text information database, which stores the mined or processed text information of items, including product descriptions, brand names, and other information. Picture materials can be obtained by accessing the item basic database, which stores the basic attribute information of the main picture information of the item, the item details page, and the carousel picture, as well as image detection result information, such as face detection, text detection, etc., for use in video generation.

Step 6013, material screening. The material screening stage is mainly responsible for screening out a set of qualified material candidates from multiple pictures and multiple texts. After obtaining information such as the basic attributes of the picture and the image detection results, the pictures are first filtered according to rules such as image face detection, text detection, and picture similarity to obtain a candidate set of pictures that meet the rules. Combined with the number of pictures supported by the animation template, multiple pictures are randomly selected from the candidate set. The texts are screened in a random manner. According to the number of texts supported by the animation template, multiple texts are randomly selected from the text candidate set.

Step 6014, material processing. In the material processing stage, the image material is usually processed, and the image file is scaled according to the width and height of the template to generate an image file that meets the specifications.

Step 6015: Distributed video generation: Generate one or more video generation requests based on the processed material and animation template information, and send the multiple video generation requests to one or more video generation sub-servers in the video generation sub-server cluster in a polling manner.

By providing a video generation system including a request server and a video generation sub-server, the diversity of generated videos is improved while effectively overcoming the problem of template-based video in related technologies. The video generation stage in the video generation system is tightly coupled with functions such as material acquisition, screening, and processing, and can only be upgraded or performance optimized as a whole, which is not conducive to system maintenance.

In some optional methods, the request server is further used to obtain the target video generated by the video generation sub-server and store the target video.

In this implementation, the requesting server can obtain the target video generated by the video generation sub-server, upload the target video to the remote file storage system, and store the basic information of the target video, such as URL, width, height, template ID, etc., to the video creative library.

Furthermore, during the target video generation process, the target video generation progress will be updated in real time over time and written into the progress database. After the target video storage is completed, the target video generation progress is 100%, and the video production request for the item has been processed.

It should be understood that the number of request servers 601 and video generation sub-servers 602 in Fig. 6 is only for illustration purposes. Any number of request servers and video generation sub-servers may be provided as required.

In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

According to an embodiment of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.

As shown in FIG. 7 , it is a block diagram of an electronic device according to a video generating method according to an embodiment of the present disclosure.

700 is a block diagram of an electronic device according to a video generation method of an embodiment of the present disclosure. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and/or required herein.

As shown in FIG7 , the electronic device includes: one or more processors 701, a memory 702, and interfaces for connecting various components, including a high-speed interface and a low-speed interface. The components are interconnected using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of the GUI on an external input/output device (such as a display device coupled to the interface). In other embodiments, if necessary, multiple processors and/or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). A processor 701 is taken as an example in Figure 7.

The memory 702 is a non-transient computer-readable storage medium provided by the present disclosure. The memory stores instructions executable by at least one processor to enable the at least one processor to perform the video generation method provided by the present disclosure. The non-transient computer-readable storage medium of the present disclosure stores computer instructions, which are used to enable a computer to perform the video generation method provided by the present disclosure.

The memory 702, as a non-transient computer-readable storage medium, can be used to store non-transient software programs, non-transient computer executable programs and modules, such as program instructions/modules corresponding to the video generation method in the embodiment of the present disclosure (for example, the acquisition module 501, the replacement module 502, the screenshot module 503 and the generation module 504 shown in FIG. 5). The processor 701 executes various functional applications and data processing of the server by running the non-transient software programs, instructions and modules stored in the memory 702, that is, the video generation method in the above method embodiment is implemented.

The memory 702 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the use of the video-generating electronic device, etc. In addition, the memory 702 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 702 may optionally include a memory remotely arranged relative to the processor 701, and these remote memories may be connected to the video-generating electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The electronic device of the video generation method may further include: an input device 703 and an output device 704. The processor 701, the memory 702, the input device 703 and the output device 704 may be connected via a bus or other means, and FIG7 takes the connection via a bus as an example.

The input device 703 can receive input digital or character information, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a track ball, a joystick, and other input devices. The output device 704 may include a display device, an auxiliary lighting device (e.g., an LED), and a tactile feedback device (e.g., a vibration motor). The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some embodiments, the display device may be a touch screen.

Various implementations of the systems and techniques described herein can be realized in digital electronic circuit systems, integrated circuit systems, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various implementations may include: being implemented in one or more computer programs that can be executed and/or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for programmable processors and can be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, device, and/or means (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and/or data to a programmable processor.

To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual sensory feedback, auditory feedback, or tactile feedback); and can receive input from the user in any form (including acoustic input, voice input, or tactile input).

The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.

According to the technical solution of the embodiment of the present disclosure, the generated video styles are effectively enriched and the development costs are reduced.

It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution disclosed in this disclosure can be achieved, and this document is not limited here.

The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims (14)

A video generation method, the method comprising: In response to obtaining a video generation request, obtaining video element information based on the video generation request, the video element information including: an animation template file, an animation description file, and a target material; Based on a new animation description file and the animation template file, a target animation is obtained, wherein the new animation description file is obtained by replacing a material in the animation description file with the target material; Based on the target animation, a screenshot operation is performed to obtain an ordered sequence of pictures; Based on the ordered picture sequence, a target video is generated. The method according to claim 1, wherein the step of performing a screenshot operation based on the target animation to obtain an ordered sequence of pictures comprises: Dividing the target animation into a preset number of sub-segments; Running a preset number of sub-processes in parallel to perform a screenshot operation on the preset number of sub-segments to obtain a preset number of sub-image sequences, wherein each sub-process performs a screenshot operation on a sub-segment to obtain a sub-image sequence, and the sub-segments corresponding to the sub-processes are different; Based on the preset number of sub-picture sequences, an ordered picture sequence is generated. The method according to claim 1, wherein the video generation request includes: an animation template file storage path, an animation description file storage path and a target material storage path, and the acquiring of video element information based on the video generation request includes: According to the animation template file storage path, the animation description file storage path and the target material storage path, the animation template file, the animation description file and the target material are acquired. The method according to claim 1, wherein the video element information further includes: a video generation command, and the generating a target video based on the ordered picture sequence comprises: A target video is generated based on the ordered image sequence and a video generation command, wherein the video generation command includes at least one of the following: specifying an image sequence path, truncating or repeating music according to a duration defined in an animation template, and superimposing barrage and special effects. The method according to any one of claims 1 to 4, wherein the screenshot operation comprises creating a browser to take a screenshot, and the method further comprises: The browser is managed by using a resource pool, specifically including at least one of the following: initializing the browser before obtaining a video generation request; and recycling the used browser after the browser is used. A video generating device, the device comprising: An acquisition module is configured to, in response to acquiring a video generation request, acquire video element information based on the video generation request, wherein the video element information includes: an animation template file, an animation description file, and a target material; A replacement module is configured to obtain a target animation based on a new animation description file and the animation template file, wherein the new animation description file is obtained by replacing a material in the animation description file with the target material; A screenshot module is configured to perform a screenshot operation based on the target animation to obtain an ordered sequence of pictures; The generating module is configured to generate a target video based on the ordered picture sequence. The device according to claim 6, wherein the screenshot module is further configured to: Dividing the target animation into a preset number of sub-segments; Running a preset number of sub-processes in parallel to perform a screenshot operation on the preset number of sub-segments to obtain a preset number of sub-image sequences, wherein each sub-process performs a screenshot operation on a sub-segment to obtain a sub-image sequence, and the sub-segments corresponding to the sub-processes are different; Based on the preset number of sub-picture sequences, an ordered picture sequence is generated. The device according to claim 6, wherein the acquisition module is further configured Set to: According to the animation template file storage path, the animation description file storage path and the target material storage path, the animation template file, the animation description file and the target material are acquired. The apparatus according to claim 6, wherein the generating module is further configured to: A target video is generated based on the ordered image sequence and a video generation command, wherein the video generation command includes at least one of the following: specifying an image sequence path, truncating or repeating music according to a duration defined in an animation template, and superimposing barrage and special effects. According to any one of claims 6-9, the screenshot operation includes creating a browser for taking a screenshot, and the device also includes a management module, which is configured to manage the browser using a resource pool, specifically including at least one of the following: initializing the browser before obtaining a video generation request; and recycling the used browser after the browser is used. A video generation system, the system comprising: a request server and a video generation sub-server, The request server is used to generate multiple video generation requests based on user input information, and send the multiple video generation requests to one or more video generation sub-servers in the video generation sub-server cluster; The video generation sub-server is used to execute the method according to any one of claims 1-5. The system according to claim 11, wherein the request server is further configured to: The target video generated by the video generation sub-server is obtained, and the target video is stored. An electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores one or more computer programs, and when the one or more computer programs are executed by the at least one processor, the at least one processor implements the method according to any one of claims 1 to 5. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the method according to any one of claims 1 to 5.