CN109672832B - Processing method for realizing dynamic special effect display of digital film song-inserting lyrics captions - Google Patents
Processing method for realizing dynamic special effect display of digital film song-inserting lyrics captions Download PDFInfo
- Publication number
- CN109672832B CN109672832B CN201811592234.4A CN201811592234A CN109672832B CN 109672832 B CN109672832 B CN 109672832B CN 201811592234 A CN201811592234 A CN 201811592234A CN 109672832 B CN109672832 B CN 109672832B
- Authority
- CN
- China
- Prior art keywords
- subtitles
- lyric
- special effect
- processing
- effect display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/278—Subtitling
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Circuits (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a processing method for realizing dynamic special effect display of digital film song insertion lyric subtitles, which is characterized in that the digital film song insertion lyric subtitles are independently processed as a component of the whole digital film subtitles, the specific processing at least comprises the steps of carrying out dynamic special effect display processing on the digital film song insertion lyric subtitles according to subtitles mapped by the digital film song insertion lyric content, singing rhythm of singers and film showing frame rate, and the processed song insertion lyric subtitles and main film subtitles are fused into a whole word subtitle track. The method of the invention solves the problem of the dynamic special effect display mode of the current digital film song insertion lyrics, changes the defects of single font and static display mode of the subtitles of the original digital film song insertion lyrics, enables the digital film to have more vitality and practical value, and also brings positive social and economic benefits.
Description
Technical Field
The invention relates to the technical field of video and audio processing, in particular to a processing method for realizing dynamic special effect display of digital movie inserting lyric subtitles.
Background
The resolution of the video technology of the modern digital film is developed from 2K to 4K or even 8K, and the stereoscopic effect is developed from 2D to 5D; audio technology has evolved from 5.1 channels to dolby panoramas 64 channels, or alternatively to multidimensional immersion sound infinite channels. Therefore, the viewing effect of the electronic map makes the audience have an experience which is personally on the scene and has no more impact.
Although the traditional progress of the modern digital movie in the aspects of video and audio is subverted, the display mode of the lyric subtitles of the inserted music of the movie still stays in the traditional mode of single font and static display, and cannot bring better audio-visual experience to audiences.
Disclosure of Invention
The invention aims to overcome the defects in the background technology, provides a processing method for realizing dynamic special effect display of digital movie song-inserting lyric subtitles, can solve the technical problem of displaying the digital movie song-inserting lyric subtitles, achieves the purpose of dynamic special effect display, gives more practical value to the digital movie, and provides better audio-visual experience for audiences.
In order to achieve the technical effects, the invention adopts the following technical scheme:
a method for realizing dynamic special effect display of digital film song insertion lyric caption includes carrying out individual treatment to digital film song insertion lyric caption as component of whole digital film caption, carrying out dynamic special effect display treatment according to caption mapped by digital film song insertion lyric content, singer singing rhythm and film showing frame rate, merging it with film main caption into a whole word caption track, finally entering into follow-up routine flow treatment including film post-period comprehensive processing, packing and encryption, packaging and issuing.
The technical scheme of the invention specifically comprises two implementation modes, wherein the first mode is intervention processing during shooting and manufacturing of the digital film, the second mode is post intervention processing on the digital film which is already taken, the main processes of the two implementation modes comprise that firstly, inserted lyrics subtitles of the digital film are independently processed as the components of the whole digital film subtitles to obtain independent lyrics subtitles files, then, static special effect processing and synchronous dynamic special effect display processing are respectively carried out on the lyrics subtitles, finally, the processed lyrics and the digital film main subtitles are fused into a whole subtitle track, and the post comprehensive processing, encryption, packaging, issuing and the like of the film are carried out by the subsequent processes.
When the implementation mode of intervention processing during digital film shooting and production is adopted, firstly, it needs to be explained that the 'digital film shooting and production period' in the technical scheme is regarded as the earlier stage of the digital film production, and three main materials (namely a caption rail material, an audio rail material and a video rail material) are all prepared and completed, and meanwhile, a film inserting material is contained according to the plot requirement and is a 'later stage comprehensive processing' processing stage to be sent to the next flow.
Therefore, during the shooting and production of the digital movie, the caption track material of one of the three main materials contains the caption content of the lyrics of inserting songs, and the core of the implementation mode of the digital movie shooting production intervention processing mainly comprises the following processing flows:
firstly, video clips, audio clips and lyric subtitles of a movie inserting song are respectively extracted from three material files, then format editing of the lyric subtitles is carried out, then static special effect processing of the lyric subtitles is carried out, synchronous dynamic special effect processing of the lyric subtitles is carried out, and finally integral subtitle track fusion and format conversion are carried out. After the steps are completed, the prints are processed by the subsequent processes until the prints meeting the issuing standard are completed.
Specifically, when the implementation mode of the intervention processing during the shooting and production of the digital cinema is adopted, the method can be summarized into the following five important processes: extracting video clips, audio clips and lyric subtitles of a film music inserting, editing lyric subtitle formats, processing static special effects of the lyric subtitles, displaying synchronous dynamic special effects of the lyric subtitles, fusing integral subtitle tracks and converting formats. The method comprises the following specific steps:
firstly, extracting video clips, audio clips and lyric subtitles of a movie clip. Namely, video clips, audio clips and lyric subtitle files of the film clips are respectively extracted from the three material tracks of the film. The video clip and the audio clip are temporarily used for completing the following (fourth step) coordinate positioning of the special effect caption in the picture and the dynamic special effect display function of the synchronous lyric caption.
As mentioned above, the main subtitle track material file of the film already contains the lyrics subtitle content of the episode and is mostly in a common format, so that the main word processing software can be directly extracted for standby (or extracted from the script by a similar method) during the specific implementation.
And secondly, editing the format of the caption of the song word. Specifically, the content of the caption of the lyrics of the inserted music is accurately corrected; then carrying out rough typesetting, segment dividing and sentence breaking according to the language type (including monolingual or bilingual) of the lyrics of the music inserting song; secondly, assigning time code allocation according to the song insertion singing duration; and finally, distributing the lyric subtitle coordinate positions according to the format specification of the film.
And thirdly, carrying out static special effect processing on the song subtitle. Mainly editing and determining the font, font size, artistic special effect rendering form and the like of the lyric subtitles of the inserted music; and determining the primary and secondary colors of the lyric guide caption and the barrier caption following along with the singing rhythm.
And fourthly, carrying out synchronous dynamic special effect display processing on the caption of the song words. Firstly, simultaneously operating the extracted video clip and audio clip (singer voice) of the film album and the lyric caption static special effect display file finished in the third step as a clip in the whole film; then, according to the video (picture) scene and singer position (or moving range) of the music-inserting fragment, accurately adjusting and freezing the relative position (coordinate) of the lyric caption in the picture; and then according to the frame rate (showing speed) of the song insertion fragment and the singing rhythm of the singer (voice), precise time code allocation is given to the song subtitle sentence by sentence or word by word, and simultaneously, the barrier subtitle precisely and synchronously follows the guide subtitle covering the just sung song, so that the dynamic special effect display of the movie song insertion lyric subtitle is realized.
Fifthly, fusing and format converting the caption rail. Through the first four steps of processing, the film song insertion lyric dynamic special effect display file is used as a part of a main caption rail material of the film, and the main caption rail is required to be merged and submitted to the next step of processing. The specific method comprises the following steps: and embedding the processed dynamic special effect display captions of the lyrics of the inserted music one by one according to the positions of the time blocks of the original captions distributed in the main caption file to replace the captions of the original lyrics. And finally, converting the subtitle file with the fused track into a subtitle format (such as a PNG format) meeting the requirement of a post comprehensive processing flow and submitting the subtitle file.
The subsequent processing flow is not within the scope of the technical solution of the present invention, and therefore, is not described in detail.
When the implementation of post-intervention processing on the issued digital cinema is adopted, it should be noted that the method is performed under the condition of acquiring a master disc (DCDM) after the digital cinema feature is issued. Generally, after a digital movie is processed in later stage, a master disc (DCDM) is prepared, then the master disc is provided to different regions of the world for adaptation according to requirements (mainly relating to the modification and replacement of audio tracks by language adaptation of different regions, or editing uncomfortable contents in the movie for regional political and religious reasons, etc.), and finally DCP packaging and distribution are carried out to adapt to local region showing.
When the implementation mode of performing post intervention processing on the sent digital film is adopted, the method mainly comprises the following processing flows:
firstly, separating a video track, an audio track and a subtitle track file from a master plate; then extracting video clips, audio clips and lyric subtitles of the film clips from the three files respectively; and then entering the editing of the lyric caption format of inserting music, then carrying out static special effect processing on the lyric caption, then carrying out synchronous dynamic special effect processing on the lyric caption, and finally carrying out integral caption track fusion and format conversion. After the steps are completed, the prints are processed by the subsequent processes until the prints meeting the issuing standard are completed.
Specifically, when the implementation mode of performing the post intervention processing on the sent digital film is adopted, the method can be summarized into the following six important processes: 1. separating a video track, an audio track and a subtitle track file from the master plate; 2. extracting video clips, audio clips and lyric subtitles of the film clips from the three separated files respectively; 3. editing the lyric subtitle format; 4. static special effect processing of lyric subtitles; 5. synchronous dynamic special effect display processing of lyric subtitles; 6. and integrating the subtitle track and converting the format.
First, separating the video track, the audio track and the caption track file from the digital movie master plate. The specific implementation mode is as follows: the digital cinema master plate (DCDM) has a characteristic that a video track, an audio track and a subtitle track exist independently without being fused, and are respectively stored in three 'special containers' so as to be convenient for later modification, which is also the reason that the digital cinema master plate cannot be directly used for showing. In this step, the video track, the audio track, and the subtitle track need to be taken out from three "special containers", respectively, to complete the separation.
And secondly, extracting video clips, audio clips and lyric subtitles of the film inserting music. The specific requirements and implementation modes are as follows: and respectively extracting video clips, audio clips and lyric subtitles of the film inserted music from the three separated track files, wherein the video clips and the audio clips of the film inserted music are temporarily used for completing the following (fifth step) coordinate positioning of the special subtitles in the picture and the dynamic special effect display function of synchronizing the lyric subtitles.
And thirdly, editing the format of the extracted lyric subtitles. The specific requirements and implementation modes are as follows: firstly, finely correcting the content of the lyrics and subtitles of the inserted music; then carrying out rough typesetting, segment dividing and sentence breaking according to the language type (including monolingual or bilingual) of the lyrics of the music inserting song; secondly, assigning time code allocation according to the song insertion singing duration; and finally, distributing the lyric subtitle coordinate positions according to the format specification of the film.
And fourthly, carrying out static special effect processing on the caption of the song word. The specific requirements and implementation modes are as follows: firstly, editing and determining the font, font style, font size, artistic special effect rendering form and the like of the lyric subtitles of the inserted music; then, the main and secondary colors of the lyric guide caption and the barrier caption following along with the singing rhythm are determined.
And fifthly, carrying out synchronous dynamic special effect display processing on the song subtitle, wherein the step is finished at least by combining the video clip and the audio clip of the extracted film episode in a matched manner, and the specific requirements and the realization mode are as follows: firstly, importing the extracted video clip and audio clip (singer voice) of the film album and the static special effect display file of the lyric caption completed in the fourth step at the same time and operating as one clip in the whole film; then, according to the video (picture) scene and singer position (or moving range) of the music-inserting fragment, accurately adjusting and freezing the relative position (coordinate) of the lyric caption in the picture; and then according to the frame rate (showing speed) of the song insertion fragment and the singing rhythm of the singer (voice), precise time code allocation is given to the song subtitle sentence by sentence or word by word, and meanwhile, the barrier subtitle is utilized to precisely and synchronously follow and cover the guide subtitle which is just sung, so that the dynamic special effect display of the movie song insertion lyric subtitle is realized.
Sixthly, performing caption rail fusion on the processed lyric captions and the extracted digital movie main captions, wherein the concrete requirements and the realization mode are as follows: through the first five steps of processing, the film song insertion lyric dynamic special effect display file is used as a part of the film main caption rail material and needs to be merged into the main caption rail and submitted to the next step of processing. The specific method comprises the following steps: and embedding the processed dynamic special effect display captions of the lyrics of the inserted music one by one according to the positions of the time blocks of the original captions distributed in the main caption file to replace the captions of the original lyrics. And finally, converting the subtitle file with the fused track into a subtitle format (such as PNG) meeting the requirement of a post comprehensive processing flow to submit.
The following subsequent processing flow does not belong to the scope of the claimed invention, and is not described herein again.
Further, in the above two implementation manners, when the synchronous dynamic special effect display processing is performed on the lyric subtitle, the specific font and display form of the lyric can be selectively set according to the regional language characteristics, such as the continental China and the hong tai region, and the dynamic special effect display of simplified subtitles, the dynamic special effect display of traditional subtitles, and the dynamic special effect display of bilingual (such as english + simplified subtitles or traditional subtitles) subtitles can be set. Other parts of the world may be treated as english, russian, german, japanese … …, etc. for dynamic special effects display subtitles.
The invention has the outstanding characteristics of strong compatibility and wide application range in the aspect of dynamic special effect display processing of digital movie song insertion lyric subtitles, and is a digital movie subtitle processing platform established on the basis of a PC (personal computer), wherein all word banks can be used for processing dynamic special effect display subtitles.
Therefore, aiming at the implementation mode that various language characters are used for the dynamic special effect display processing of the lyric subtitles of the digital movie inserting song, the implementation method is very simple when the invention is taken as a basic application framework. Take Chinese characters and English characters as examples: if lyric dynamic special effect display subtitles are made by using 20# black characters of the Chinese simplified body, and the lyric dynamic special effect display subtitles need to be changed into English dynamic special effect display subtitles, the Chinese simplified body characters are replaced by English fonts only from the third step of the core processing step, and then the character type, the character size, the artistic special effect rendering, the coordinate position in a picture, the dynamic synchronous tracking of the guide subtitles and the barrier subtitles and the like are finely adjusted. The dynamic special effect display processing of the lyric subtitles of the movie episode only needs to repeat the core processing steps from the third step to the last step when the language character change is involved.
Compared with the prior art, the invention has the following beneficial effects:
the processing method for realizing the dynamic special effect display of the digital film song insertion lyrics subtitles solves the problems of the existing dynamic special effect display mode of the digital film song insertion lyrics, changes the defects of single font and static display mode of the original digital film song insertion lyrics subtitles, enables the digital film to have more vitality and practical value, and also brings positive social and economic benefits.
Drawings
Fig. 1 is a flow chart illustrating the steps of the method of the present invention when implemented as an interventional procedure during production of a digital film shot in one embodiment of the present invention.
Fig. 2 is a flowchart illustrating steps of the method according to the present invention when the post-intervention processing is performed on the already-sent digital film in an embodiment of the present invention.
Fig. 3 is an effect diagram of the lyric subtitle displayed by using the monolingual dynamic special effect of the Chinese simplified body in one embodiment of the invention.
Fig. 4 is an effect diagram of the lyric subtitle displayed by using the dynamic effect of the traditional Chinese monolingual words in one embodiment of the invention.
Fig. 5 is an effect diagram of the lyric subtitle displayed in a monolingual dynamic special effect in english according to an embodiment of the present invention.
Fig. 6 is an effect diagram of the lyric subtitle displayed by using a bilingual dynamic special effect of chinese simplified + english in one embodiment of the invention.
Fig. 7 is an effect diagram of the lyric subtitle displayed by using a dynamic special effect of a bilingual Chinese traditional + english language in an embodiment of the invention.
Detailed Description
The invention will be further elucidated and described with reference to the embodiments of the invention described hereinafter.
Example (b):
the first embodiment is as follows:
a digital film insert lyrics subtitle realizes the processing method that the dynamic special effect reveals, said method is mainly through taking the lyrics subtitle of inserting song of the digital film as the component of the subtitle of the whole digital film to process alone, the concrete processing includes according to subtitle, singer's sentiment and rhythm, showing the frame rate of the film etc. that the lyrics content of inserting song of the digital film maps, carry on the display processing of the dynamic special effect, and fuse into a complete word curtain rail together with the main subtitle of the film, enter the subsequent routine flow to process finally: the method mainly comprises the steps of later-stage comprehensive processing, packaging encryption, packaging distribution and the like of the film.
Specifically, the technical solution of this embodiment specifically includes two implementation manners, the first is intervention processing during the shooting and manufacturing of digital films, the second is post intervention processing on already-sent digital films, the main processes of the two implementation manners both include that the inserted lyrics subtitles of a digital film are treated separately as the components of the entire digital film subtitles to obtain separate lyrics subtitle files, then static special effect processing and synchronous dynamic special effect display processing are respectively performed on the lyrics subtitles, and finally the processed lyrics subtitles and the main subtitles of the digital film are fused into a complete lyrics subtitle track for subsequent processing beyond the present invention: the method mainly comprises the steps of later-stage comprehensive processing, packaging encryption, packaging distribution and the like of the film.
As shown in fig. 1, when an implementation manner of an intervention process during digital cinema shooting and production is adopted, the process is described with reference to the flow shown in fig. 1, where fig. 1 shows a method and a necessary flow for generating a complete digital cinema, and the content in the dashed frame of fig. 1 is the first core of the technical solution in the implementation manner.
First, it should be noted that the meaning of "during the digital cinema shooting and production" in this embodiment is that the above-mentioned period (the digital cinema shooting and production period) is regarded as the earlier stage of the digital cinema, and the three main materials (the caption track material, the audio track material, and the video track material) are already prepared (and contain the movie album material according to the scenario requirement), and are in the stage of the "post-stage integrated processing" to be sent to the next process.
Therefore, in the "caption track material" of one of the three main materials, the caption track material already contains the caption content of the lyrics of the inserted song, and based on the background, the core of the invention mainly comprises the following processing procedures:
firstly, video clips, audio clips and lyric subtitles of a movie inserting song are respectively extracted from three material files, then format editing of the lyric subtitles is carried out, then static special effect processing of the lyric subtitles is carried out, synchronous dynamic special effect processing of the lyric subtitles is carried out, and finally integral subtitle track fusion and format conversion are carried out. After the steps are completed, the prints are processed by the subsequent processes beyond the present invention until the prints meeting the release standards are completed.
Specifically, when an implementation manner of an intervention process during shooting and production of a digital movie is adopted, in order to better understand the technical solution, it needs to be explained that the core content in the technical solution at least includes five important processes, specifically: extracting video clips, audio clips and lyric subtitles of a film music inserting, editing lyric subtitle formats, processing static special effects of the lyric subtitles, displaying synchronous dynamic special effects of the lyric subtitles, fusing integral subtitle tracks and converting formats. The method comprises the following specific steps:
firstly, extracting video clips, audio clips and lyric subtitles of a movie clip. In practice, this step can be implemented by using existing professional software, that is, the professional software extracts video clips, audio clips and lyrics subtitle files of the movie clips from the three major material tracks of the movie respectively. The video clip and the audio clip are temporarily used for completing the following (fourth step) coordinate positioning of the special effect caption in the picture and the dynamic special effect display function of the synchronous lyric caption.
As mentioned above, the main subtitle track material file of the film already contains the lyrics subtitle content of the episode and is mostly in a common format, so that it can be directly extracted for standby by the existing mainstream word processing software (and can be extracted from the script by a similar method).
And secondly, editing the format of the caption of the song word. Specifically, the content of the caption of the lyrics of the inserted music is accurately corrected; then carrying out rough typesetting, segment dividing and sentence breaking according to the language type (including monolingual or bilingual) of the lyrics of the music inserting song; secondly, assigning time code allocation according to the song insertion singing duration; and finally, distributing the lyric subtitle coordinate positions according to the format specification of the film.
In practice, this step may also be performed in the existing text-type special subtitle processing software, and if a specific software tool is selected for implementation, a preamble step needs to be added, that is, the extracted lyric subtitle file needs to be converted into a format (such as srt format) that can be accepted by the text-type special subtitle processing software; then, the content of the inserted lyrics and the subtitles is accurately corrected, and the like.
And thirdly, carrying out static special effect processing on the song subtitle. Mainly editing and determining the font, font size, artistic special effect rendering form and the like of the lyric subtitles of the inserted music; and determining the primary and secondary colors of the lyric guide caption and the barrier caption following along with the singing rhythm.
Similarly, in practice, this step may also be performed in existing caption software with a static special effect processing function, and if a specific software tool is selected for implementation, a preamble step is added, that is, format conversion is performed again on roughly processed caption of song lyrics of the album in srt format, for example, the caption lyrics are converted into ass format, so as to adapt to the caption software with a static special effect processing function for further processing; on the basis, the characters, the font size, the artistic special effect rendering and the like of the lyric subtitles of the inserting music are edited and determined.
And fourthly, carrying out synchronous dynamic special effect display processing on the caption of the song words. The extracted video clip and audio clip of the film album (singer voice) and the lyric caption static special effect display file completed in the third step are simultaneously used as one clip in the whole film to operate; then, according to the video (picture) scene and singer position (or moving range) of the music-inserting fragment, accurately adjusting and freezing the relative position (coordinate) of the lyric caption in the picture; and then according to the frame rate (showing speed) of the song insertion fragment and the singing rhythm of the singer (voice), precise time code allocation is given to the song subtitle sentence by sentence or word by word, and simultaneously, the barrier subtitle precisely and synchronously follows the guide subtitle covering the just sung song, so that the dynamic special effect display of the movie song insertion lyric subtitle is realized.
Similarly, in practice, this step can also be implemented in the existing professional software, that is, the extracted video clip and audio clip of the movie clip (singer's voice) and the lyric subtitle static special effect display file completed in the third step are simultaneously imported and operated as one clip in the whole movie; then, according to the video (picture) scene and singer position (or moving range) of the music-inserting fragment, accurately adjusting and freezing the relative position (coordinate) of the lyric caption in the picture; then according to the frame rate (showing speed) of the inserted song fragments and the singing rhythm and sentiment of the singer (voice), the Karaoke function of the software is utilized to carry out precise time code allocation on the lyric subtitles sentence by sentence or word by word, meanwhile, the barrier function of the software is utilized to precisely and synchronously follow and cover the guide subtitles which are just sung by the barrier subtitles, and thus, the dynamic special effect display of the film inserted song lyrics is realized.
Fifthly, fusing and format converting the caption rail. Through the first four steps of processing, the film song insertion lyric dynamic special effect display file is used as a part of a main caption rail material of the film, and the main caption rail is required to be merged and submitted to the next step of processing. The specific method comprises the following steps: and embedding the processed dynamic special effect display captions of the lyrics of the inserted music one by one according to the positions of the time blocks of the original captions distributed in the main caption file to replace the captions of the original lyrics. And finally, converting the subtitle file with the fused track into a subtitle format (such as PNG) required by a post comprehensive processing flow according to requirements by using professional software and submitting the subtitle file.
The subsequent processing flow is not within the scope of the technical scheme claimed in the invention, and is not described in detail.
As shown in fig. 2, when an implementation manner of performing post-intervention processing on a sent digital film is adopted, the flow shown in fig. 2 will be explained, and the content in the dashed box of fig. 2 is the core of the implementation manner.
First, it should be noted that the method is performed under the condition of acquiring a master (DCDM) after the release of the digital cinema feature. Generally, after a digital movie is processed in later stage, a master disc (DCDM) is prepared, then the master disc is provided to different regions of the world for adaptation according to requirements (mainly relating to the modification and replacement of audio tracks by language adaptation of different regions, or editing uncomfortable contents in the movie for regional political and religious reasons, etc.), and finally DCP packaging and distribution are carried out to adapt to local region showing.
When the implementation mode of performing post intervention processing on the sent digital film is adopted, the method mainly comprises the following processing flows:
firstly, separating a video track, an audio track and a subtitle track file from a master plate; then extracting video clips, audio clips and lyric subtitles of the film clips from the three files respectively; and then entering the editing of the lyric caption format of inserting music, then carrying out static special effect processing on the lyric caption, then carrying out synchronous dynamic special effect processing on the lyric caption, and finally carrying out integral caption track fusion and format conversion. After the steps are completed, the prints are processed continuously by the subsequent processes beyond the present invention until the prints meeting the release standards are completed.
Specifically, when the implementation mode of performing the post intervention processing on the sent digital film is adopted, the method can be summarized as the following steps: in order to better understand the following steps, it needs to be explained that the core content in the present technical solution at least includes six important processes, specifically: 1. separating a video track, an audio track and a subtitle track file from the master plate; 2. extracting video clips, audio clips and lyric subtitles of the film clips from the three separated files respectively; 3. editing the lyric subtitle format; 4. static special effect processing of lyric subtitles; 5. synchronous dynamic special effect display processing of lyric subtitles; 6. and integrating the subtitle track and converting the format. Meanwhile, some step operations in the method can be directly performed by means of existing professional tool software, and in this embodiment, the step operations can be performed by means of the tool software directly by means of the tool software, specifically as follows:
first, separating the video track, the audio track and the caption track file from the digital movie master plate. The specific implementation mode is as follows: the digital cinema master plate (DCDM) has a characteristic that a video track, an audio track and a subtitle track exist independently without being fused and are respectively stored in three special containers so as to be convenient for later modification, which is also the reason that the digital cinema master plate cannot be directly used for showing. The video track, the audio track and the subtitle track are respectively taken out from three special containers by using professional software, and the separation is finished.
And secondly, extracting video clips, audio clips and lyric subtitles of the film inserting music. The specific requirements and implementation modes are as follows: the video clip, audio clip and lyric subtitle of the movie clip can be respectively extracted from the three separated track files by using the existing professional software, and converted into the format (such as the video format being avi, the audio format being wav, the subtitle format being srt, etc.) meeting the requirements of the subsequent processing link. The video and audio segments of the video clip are temporarily used to perform the following (fifth step) coordinate positioning of special effect subtitles in the picture and the dynamic special effect display function of synchronous lyric subtitles.
And thirdly, editing the format of the extracted lyric subtitles. The specific requirements and implementation modes are as follows: on the premise that the caption file of the inserted song lyrics is converted into a format (such as srt) which can be accepted by the text-type special caption processing software, then the caption content of the inserted song lyrics is accurately corrected; then carrying out rough typesetting, segment dividing and sentence breaking according to the language type (including monolingual or bilingual) of the lyrics of the music inserting song; secondly, assigning time code allocation according to the song insertion singing duration; and finally, distributing the lyric subtitle coordinate positions according to the format specification of the film.
And fourthly, carrying out static special effect processing on the caption of the song word. The specific requirements and implementation modes are as follows: firstly, carrying out format conversion (such as ass) on srt song-inserting lyric subtitles which are roughly processed again so as to adapt to subtitle software with a static special effect processing function for further processing; on the basis, the fonts, the font styles, the font sizes, the artistic special effect rendering and the like of the lyric subtitles of the inserting music are edited and determined; and finally, determining the primary and secondary colors of the lyric guide caption and the barrier caption following along with the singing rhythm according to the Karaoke function of the software.
And fifthly, carrying out synchronous dynamic special effect display processing on the song subtitle, wherein the step is finished at least by combining the video clip and the audio clip of the extracted film episode in a matched manner, and the specific requirements and the realization mode are as follows: firstly, the extracted video clip and audio clip (singer voice) of the film album and the static special effect display file of the lyric caption finished in the fourth step are simultaneously imported by using the existing professional tool software and are operated as a clip in the whole film; then, according to the video (picture) scene and singer position (or moving range) of the music-inserting fragment, accurately adjusting and freezing the relative position (coordinate) of the lyric caption in the picture; then according to the frame rate (showing speed) of the inserted song fragments and the singing rhythm and sentiment of the singer (voice), the Karaoke function of the software is utilized to carry out precise time code allocation on the lyric subtitles sentence by sentence or word by word, and simultaneously the barrier function of the software is utilized to precisely and synchronously follow and cover the guide subtitles which are just sung by the barrier subtitles, thereby realizing the dynamic special effect display of the movie inserted song lyric subtitles.
Sixthly, performing caption rail fusion on the processed lyric captions and the extracted digital movie main captions, wherein the concrete requirements and the realization mode are as follows: through the first five steps of processing, the film song insertion lyric dynamic special effect display file is used as a part of the film main caption rail material and needs to be merged into the main caption rail and submitted to the next step of processing. The specific method comprises the following steps: and embedding the processed dynamic special effect display captions of the lyrics of the inserted music one by one according to the positions of the time blocks of the original captions distributed in the main caption file to replace the captions of the original lyrics. And finally, converting the subtitle file with the fused track into a subtitle format (such as a PNG format) meeting the requirement of a post comprehensive processing flow by using professional software and submitting the subtitle file.
The following subsequent processing flow is not described again.
Preferably, as shown in fig. 3 to 7, in the two implementation manners, when the synchronous dynamic special effect display processing is performed on the lyric subtitle, the specific font and the display form of the lyric can be selectively set according to the characteristics of the regional languages, such as the continental china and the harbor terrace, and the dynamic special effect display of the simplified subtitle, the dynamic special effect display of the traditional subtitle, and the dynamic special effect display of the bilingual (such as english + simplified or traditional) subtitle can be set. Other parts of the world may be treated as english, russian, german, japanese … …, etc. for dynamic special effects display subtitles.
In summary, the invention has the outstanding characteristics of strong compatibility and wide application range in the aspect of dynamic special effect display processing of digital movie song insertion lyric subtitles, and all word banks can be used for processing dynamic special effect display subtitles in a digital movie subtitle processing platform established on the basis of a PC. Therefore, aiming at the implementation mode that various language characters are used for the dynamic special effect display processing of the lyric subtitles of the digital movie inserting song, the implementation method is very simple when the invention is taken as a basic application framework. Take Chinese characters and English characters as examples: if lyric dynamic special effect display subtitles are made by using 20# black characters of the Chinese simplified body, and the lyric dynamic special effect display subtitles need to be changed into English dynamic special effect display subtitles, the Chinese simplified body characters are replaced by English fonts only from the third step of the core processing step, and then the character type, the character size, the artistic special effect rendering, the coordinate position in a picture, the dynamic synchronous tracking … … of the guide subtitles and the barrier subtitles and the like are finely adjusted. In the technical scheme of the invention, aiming at the dynamic special effect display processing of the lyric subtitles of the movie inserting music, the core processing steps are repeated from the third step to the last step to finish all the steps when the language character change is involved.
It will be understood that the above embodiments are merely exemplary embodiments taken to illustrate the principles of the present invention, which is not limited thereto. It will be apparent to those skilled in the art that various modifications and improvements can be made without departing from the spirit and substance of the invention, and these modifications and improvements are also considered to be within the scope of the invention.
Claims (6)
1. The processing method for realizing dynamic special effect display of the digital film song insertion lyric subtitles is characterized in that the digital film song insertion lyric subtitles are independently processed as a component of the whole digital film subtitles, the specific processing at least comprises the steps of carrying out dynamic special effect display processing on the digital film song insertion lyric subtitles according to subtitles mapped by the digital film song insertion lyric content, singing rhythm of singers and film showing frame rate, and fusing the processed song insertion lyric subtitles and main film subtitles into a whole word subtitle track; the processing method for realizing the dynamic special effect display of the lyric subtitles of the digital movie song insertion comprises two realization modes, wherein the first mode is intervention processing during the shooting and manufacturing of the digital movie, and the second mode is post intervention processing on the sent digital movie;
the implementation of the intervention process during the production of the digital film shooting specifically comprises the following steps:
firstly, extracting video clips, audio clips and lyric subtitles of movie clips;
secondly, format editing is carried out on the extracted lyric subtitles;
thirdly, carrying out static special effect processing on the song word subtitle;
fourthly, carrying out synchronous dynamic special effect display processing on the caption of the song word;
fifthly, fusing and format converting the caption rail;
the implementation mode of performing post intervention processing on the sent digital film specifically comprises the following steps:
the method comprises the following steps: separating a video track, an audio track and a subtitle track file from the digital movie master plate;
step two: extracting video clips, audio clips and lyric subtitles of the film inserting music;
step three: editing the format of the extracted lyric subtitles;
step four: carrying out static special effect processing on the lyric subtitles;
step five: synchronous dynamic special effect display processing is carried out on the lyric subtitles;
step six: performing caption rail fusion on the processed lyric captions and the extracted digital movie main captions;
the method specifically comprises the following steps of:
s1, simultaneously importing the extracted video clip and audio clip of the album and the lyric caption which finishes the static special effect processing into a clip in the whole film for operation;
s2, accurately adjusting and freezing the relative position of the lyric subtitles in the picture according to the video picture scene, the singer position or the activity range of the episode;
and S3, according to the frame rate or showing speed of the song inserting segment and the singing rhythm of the singer, performing accurate time code allocation on the lyric subtitles sentence by sentence or word by word, and simultaneously enabling the barrier subtitles to accurately and synchronously follow and cover the guide subtitles which are just sung.
2. The method for realizing dynamic special effect display of lyrics subtitles of digital cinema album insertion according to claim 1, wherein the format editing of the lyrics subtitles comprises the following steps:
s1, performing content fine correction on the extracted lyric subtitles;
s2, carrying out rough typesetting, segmenting and sentence breaking according to the language form of the song inserting lyrics;
s3, assigning time code distribution according to the song insertion singing duration;
and S4, carrying out lyric subtitle coordinate position distribution according to the format specification of the film.
3. The method for realizing dynamic special effect display of lyrics subtitles of digital cinema album insertion according to claim 1, wherein the static special effect processing of the lyrics subtitles comprises the following steps:
s1, editing fonts, character shapes and character sizes of lyric subtitles and performing artistic special effect rendering;
and S2, determining lyric guide subtitles, and determining the primary color and the secondary color of the follow-up barrier subtitles according to the singing rhythm.
4. The processing method for realizing dynamic special effect display of digital movie illustration lyrics subtitles according to claim 1, wherein the specific implementation manner of subtitle track fusion is as follows: and finally, converting the caption file with the fused track into a caption format meeting the requirement of a post-processing flow according to the requirement and submitting the caption file.
5. The method as claimed in claim 1, wherein the synchronous dynamic special effect display is performed on the lyrics caption by selecting and setting the specific font and display form of the lyrics according to the regional language characteristics.
6. The processing method of realizing dynamic special effect display of lyrics subtitles of a digital cinema album insert according to claim 5, wherein the lyrics subtitles display at least comprises dynamic special effect display of simplified subtitles, dynamic special effect display of complex subtitles and dynamic special effect display of bilingual subtitles.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811592234.4A CN109672832B (en) | 2018-12-20 | 2018-12-20 | Processing method for realizing dynamic special effect display of digital film song-inserting lyrics captions |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811592234.4A CN109672832B (en) | 2018-12-20 | 2018-12-20 | Processing method for realizing dynamic special effect display of digital film song-inserting lyrics captions |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109672832A CN109672832A (en) | 2019-04-23 |
| CN109672832B true CN109672832B (en) | 2021-07-02 |
Family
ID=66147170
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811592234.4A Active CN109672832B (en) | 2018-12-20 | 2018-12-20 | Processing method for realizing dynamic special effect display of digital film song-inserting lyrics captions |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109672832B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112153307A (en) * | 2020-08-28 | 2020-12-29 | 北京达佳互联信息技术有限公司 | Method and device for adding lyrics in short video, electronic equipment and storage medium |
| CN112714355B (en) * | 2021-03-29 | 2021-08-31 | 深圳市火乐科技发展有限公司 | Audio visualization method and device, projection equipment and storage medium |
| CN113421214B (en) * | 2021-07-15 | 2024-11-29 | 北京小米移动软件有限公司 | Specific character generation method and device, storage medium and electronic equipment |
| CN113611267B (en) * | 2021-08-17 | 2024-07-02 | 网易（杭州）网络有限公司 | Word song processing method and device, computer readable storage medium and computer equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102014258B (en) * | 2009-09-07 | 2013-01-16 | 艾比尔国际多媒体有限公司 | Multimedia caption display system and method |
| CN101984490B (en) * | 2010-11-23 | 2012-06-27 | 亿览在线网络技术（北京）有限公司 | Word-for-word synchronous lyric file generating method and system thereof |
| JP2015524233A (en) * | 2012-06-19 | 2015-08-20 | トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ | Improved playlist content selection system and method |
| CN108924599A (en) * | 2018-06-29 | 2018-11-30 | 北京优酷科技有限公司 | Video caption display methods and device |
-
2018
- 2018-12-20 CN CN201811592234.4A patent/CN109672832B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109672832A (en) | 2019-04-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109672832B (en) | Processing method for realizing dynamic special effect display of digital film song-inserting lyrics captions | |
| KR102481871B1 (en) | Automated voice translation dubbing of pre-recorded videos | |
| US8572488B2 (en) | Spot dialog editor | |
| US20060285654A1 (en) | System and method for performing automatic dubbing on an audio-visual stream | |
| US20020087569A1 (en) | Method and system for the automatic generation of multi-lingual synchronized sub-titles for audiovisual data | |
| CN103226947B (en) | Audio processing method and device based on mobile terminal | |
| TWI246036B (en) | Information storage medium containing subtitle data for multiple languages using text data and downloadable fonts and apparatus therefor | |
| US20160042766A1 (en) | Custom video content | |
| KR20010072936A (en) | Post-Synchronizing an information stream | |
| CN116847123A (en) | Video later editing and video synthesis optimization method | |
| EP2041974A1 (en) | Method and apparatus for encoding/decoding signal | |
| CN109963092B (en) | Subtitle processing method and device and terminal | |
| WO2010070519A1 (en) | Method and apparatus for synthesizing speech | |
| CN112714348A (en) | Intelligent audio and video synchronization method | |
| WO2020188101A1 (en) | A method and system for content internationalization & localisation | |
| EP3735778B1 (en) | Coordinates as ancillary data | |
| Fresco | Accessible filmmaking in documentaries | |
| CN114648975A (en) | Method for automatically cutting English film to generate dubbing materials according to knowledge points | |
| Eslamieh et al. | Domestication and Foreignisation in Dubbing and Subtitling of Duncan Jones‟ English Movie Warcraft into Persian | |
| CN115633136A (en) | Full-automatic music video generation method | |
| Park et al. | Automatic subtitles localization through speaker identification in multimedia system | |
| KR102770765B1 (en) | Automatic video editing support system | |
| Moussa et al. | Insights into the subtitling of films from Arabic into Spanish | |
| Halbout et al. | Matignon-LSF: a Large Corpus of Interpreted French Sign Language | |
| JP7267568B2 (en) | Video/audio synthesis method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |