TWI777529B - Video stage performance system and method for providing video stage performance - Google Patents

Abstract

[Problem] When the stage performance by video is provided, even if the music to be played is divided into a plurality of files and prepared, it is possible to easily make other elements and video without complicated mechanism or operation. Get synced. [Solution] According to the time-series arrangement information indicating that all the images are arranged in time-series, the images and time information are memorized in a state of being connected; the synchronization signal outputted with the reproduction of the images contains : Time information associated with the image of the object to be reproduced; other elements to be synchronized are memorized by being associated with the time information according to the time-series configuration information, whereby the other elements reproduced according to the synchronization signal will be related to the time information. The reproduced pre-video is synchronized.

Description

Video stage performance system and method for providing video stage performance

The present invention relates to a video stage performance system and a method for providing video stage performance.

In recent years, it has been carried out to sell created characters as virtual idols. The performances caused by such virtual idols are provided through video through streaming distribution caused by the Internet or video software products such as DVD due to their characteristics, but video technology is also applied. A simulacrum stage performance will be provided.

When presenting a stage performance by images and sounds to the listeners, it is the biggest premise that the images and sounds are synchronized with the intended timing for the listeners to perceive. As a method for synchronizing video and audio, a method of superimposing time codes on audio tracks of video data has been proposed (for example, refer to Patent Document 1).

In the technique disclosed in Patent Document 1, the audio signal on which the time code has been superimposed and the video are superimposed and recorded as the main content, and the audio signal associated with the time code is recorded as a different other information about the content is recorded. Then, the time code is generated by demodulating the audio signal superimposed with the time code, which was output when the main content was reproduced. synchronization to reproduce the sound.

Furthermore, as a method of synchronizing the video with other elements when the video is provided to a large audience, a method using a time code recorded for each frame of the video has been proposed (for example, refer to Patent Document 2). The technique disclosed in Patent Document 2 discloses the use of LTC (Linear Time Code) as an example of the time code, and also discloses a method of synchronizing the motion of the seat with the video in a movie theater or the like. [Prior Art Literature] [Patent Literature]

[Patent Document 1] Japanese Patent Laid-Open No. 2012-114779 [Patent Document 2] Japanese Patent Application Laid-Open No. 2015-514443

[The problem to be solved by the invention]

In the provision of such a stage performance by video, in addition to the above-mentioned synchronization of the timing of video and sound or other elements is very important, the preparation stage before the day, especially the preparation of video or sound, will require a huge amount of work. 's labor. Furthermore, regarding the final quality of the image, the test using the large-scale display equipment installed in the venue cannot be carried out at any time. In the preparation stage, it will be confirmed through the screen of a terminal such as a PC (Personal Computer).

Moreover, as a result of the first test conducted at the venue the day before the official performance, if the image was significantly different from the intended appearance, it became necessary to correct the image. In this case, if the video of the entire stage performance is already assembled into one file, even if only a part of the correction is made, it is necessary to re-output the video of the entire live performance as a file for reproduction. At this time, if it is a video using CG (Computer Graphics), since the calculation processing of CG is required, a huge amount of time is required. In particular, if it is the day before the official performance, there may be cases where corrections cannot be made due to lack of time.

Therefore, it is preferable that the images of the music to be played are prepared separately for each music piece in the form of a file, or at least for several pieces. Thereby, even in the case where correction is required as described above, only a part of the file including the part can be output, and the object can be achieved.

In such a case, the next problem is the operation of audio or other elements that must be reproduced in synchronization with the video. If the video of the whole live performance is collected into one file as before, the sound and other elements to be synchronized with the video are also constituted along one time line, so as long as no synchronization deviation occurs during reproduction. Otherwise, all elements will be output in a synchronized state.

On the other hand, when the video of each piece of music is prepared as a different file as described above, or when it is prepared as a file that is assembled for every number of pieces, in order to ensure that the video and the The synchronization of other elements requires a special mechanism. For example, when audio or other elements are prepared on a one-to-one basis for each video file, it becomes necessary to perform a complicated mechanism or manual operation required for synchronous reproduction in order to match the files.

The present invention has been developed in response to the above-mentioned problems, and an object of the present invention is to eliminate the need for cumbersome work even when the reproduced video is prepared by dividing into a plurality of files when providing a stage performance by video. mechanism or operation to easily synchronize other elements with the image. [means to solve the problem]

In order to solve the above-mentioned problem, one aspect of the present invention is a video stage performance system for providing stage performances to audiences by reproducing video images in a venue, characterized by comprising: a video file storage medium for performing on stage The reproduced image is divided into a plurality of image files to be memorized; and the image reproduction unit reproduces the multiple image files memorized in the previous image file storage medium in a predetermined order, and reproduces the images. The corresponding synchronization signal is output; and the synchronization element reproduction unit, which is to be synchronized with the image reproduced by the preceding image reproduction unit, reproduces according to the preceding synchronization signal; the preceding image file storage medium is based on images and time. The information is a state in which a relationship is established according to the time-series configuration information, and the preceding image files are memorized, wherein the time-series configuration information indicates that all the preceding images are arranged in a time-series state; The output synchronization signal contains: the pre-recorded time information associated with the image being reproduced; the pre-recorded synchronization element regenerating part is based on the pre-recorded time sequence arrangement information and the pre-recorded other elements are associated with the time information and memorize, thereby, Other elements reproduced in accordance with the aforementioned synchronization signal are synchronized with the image reproduced by the aforementioned image reproduction unit. [Inventive effect]

According to the present invention, even if the reproduced video is prepared by dividing into a plurality of files when providing a stage performance by video, it is possible to easily make other files without complicated mechanisms or operations. Features and imagery are synchronized.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In this embodiment, the data structure and the operation mechanism of the system and the data used for providing the system required for the stage performance caused by the image are described.

FIG. 1 is a diagram showing the overall configuration of the video stage performance system 1 according to the present embodiment. As shown in FIG. 1 , the video stage performance system 1 of this embodiment includes: an editing software terminal 100 , video file storage media 110 a and 110 b (hereinafter collectively referred to as video file storage media 110 ), a control server 200 , and a control box 300. Synchronization systems 400a and 400b (hereinafter collectively referred to as synchronization system 400), video switcher 500, display device 510, sound switcher 600, PA (Public Address) system 610, speakers 611, live music monitor 612, video switch device 700 and display device 710. In addition, the synchronization systems 400a and 400b include a video player 401, an fps (frames per second) converter 402, an LTC (Linear Time Code) converter 403, a DAW (Digital Audio Workstation) terminal 410, and a background video terminal 420, respectively.

The editing software terminal 100 is a terminal required for producing and editing images required for reproduction on stage performance, and is realized by a PC (Personal Computer) installed with dedicated software. In addition, the editing software terminal 100 has a function of operating the video player 401 included in the synchronization system 400 through the control server 200 . The editing software terminal 100 is connected to the control server 200 through the network A so as to be communicable.

In addition, the editing software terminal 100 writes out the created/edited image file and stores it in the image file storage medium 110 . The video file storage medium 110 is inserted into the video player 401 . In this way, the stored video files can be reproduced by the video player 401 .

The network A is a network line capable of bidirectional communication such as a LAN (Local Area Network). The control server 200 is a server having functions required for controlling the video player 401 included in the synchronization system 400 . The control box 300 is an operation unit required to easily operate the video player 401 in a stage performance venue, and is connected to the control server 200 through a dedicated I/F.

The control server 200 controls the reproduction of the image by the image player 401 included in the synchronization system 400 in response to the control signal input from the editing software terminal 100 or the control box 300 . That is, the control server 200 functions as a video reproduction control unit. As shown in the figure, the synchronization system 400 described in this embodiment is duplexed as a main system and a backup system, and the control server 200 sends control signals to both of them simultaneously.

The synchronization system 400 is a system that provides a function of reproducing an image file stored in the image file storage medium 110 and synchronizing with the image to reproduce a sound, a background image, and the like. The video player 401 is a video reproduction unit that reproduces video files stored in the video file storage medium 110 and outputs video signals to the video switcher 500 .

The video switcher 500, in principle, selects the video signal input from the video player 401 of the synchronization system 400a, which is the main system, and outputs it to the display device 510, but when the video signal is input from the video player 401 In the case of interruption of the video signal, it will automatically switch to the selection of the video signal input from the video player 401 of the synchronization system 400b which is a subsystem. The display device 510 is a display device for displaying desired images for audience viewing in the venue of the stage performance, and is realized by a large-scale display, a projector, or the like.

In addition, the video player 401 outputs, through the video switcher 500, a synchronization signal to the fps converter 402 for synchronizing the video displayed on the display device 510 with the audio or background video. The fps converter 402 converts the fps of the synchronization signal input from the video player 401 into the fps corresponding to the latter device, that is, the LTC converter 403, and outputs it. As the fps converter 402, for example, Teranex Express from Blackmagic Design can be used.

The LTC converter 403 converts the synchronization signal input from the fps converter 402 into a general time code, that is, an LTC signal, and then outputs it to the DAW terminal 410 or the background image terminal 420 . As the LTC converter 403, for example, Teranex Mini Audio to SDI 12G from Blackmagic Design can be used.

The DAW terminal 410 is constituted by a PC on which DAW software is installed. The DAW terminal 410 is synchronized with the LTC signal input from the LTC converter 403 to output the audio signal by the function of the DAW. The audio signal output from the DAW terminal 410 is input to the audio switch 600 by the synchronization systems 400a and 400b.

The background image terminal 420 is a terminal having a function of reproducing a background image, and is realized by a PC installed with dedicated software. The background image terminal 420 is synchronized with the LTC signal input from the LTC converter 403 to output the image signal of the background image by the function of the installed software. The video signal output from the background video terminal 420 is input to the video switcher 700 by the synchronization systems 400 a and 400 b.

In principle, the audio switch 600 selects the audio signal input from the DAW terminal 410 of the synchronization system 400a, which is the main system, and outputs it to the PA system 610, but in the DAW terminal 410, as long as the DAW operates normally, In the event of interruption of the signal that will be transmitted all the time, it will automatically switch to the selection of the audio signal input from the DAW terminal 410 of the synchronization system 400b which is a subsystem.

The PA system 610 is a system including audio equipment such as a mixer for distributing audio signals to a speaker 611 or a sound system such as a live band ear return 612 . The loudspeaker 611 will be used for the audience in the venue of the stage performance to listen to the desired sound and output it. The ear return 612 used by the live orchestra is worn by the performers who actually perform the musical instruments in the stage performance.

In principle, the video switcher 700 selects the video signal input from the background video terminal 420 of the synchronization system 400 a which is the main system, and outputs it to the display device 710 , but when the video signal is input from the background video terminal 420 In the event of interruption of the video signal of the sub-system, it will automatically switch to the selection of the video signal input from the background video terminal 420 of the synchronization system 400b, which is a subsystem.

The display device 710 is a display device that displays the image displayed by the display device 510 in the venue of the stage performance and uses the image as the background image to display the desired image for the audience to view. projector, etc. Synchronizing the image displayed by the display device 510 with the sound output by the speaker 611 or the background image displayed on the display device 710 is the main function of the synchronization system 400 .

In addition, the DAW terminal 410 or the background image terminal 420 reproduces and outputs the sound or background image by synchronizing with the LTC signal input from the LTC converter 403 as described above, but the timing thereof corresponds to the speaker 611, The live band uses the output of the ear return 612 and the display device 710 for manual adjustment. That is, the DAW terminal 410 or the background image terminal 420 can be based on the synchronization of the LTC signal input from the LTC converter 403 according to the delay or advance setting value manually set by the operator. The sound or background image is reproduced and output. In this way, it is possible to respond to the difference of the signal transmission environment of each venue where the video stage performance is provided.

FIG. 2 is a diagram showing the hardware configuration of information equipment such as the editing software terminal 100, the control server 200, the DAW terminal 410, and the background image terminal 420 included in the system according to this embodiment. These information machines can be realized by the hardware configuration of general information processing machines. As shown in FIG. 2, a CPU (Central Processing Unit) 10, a RAM (Random Access Memory) 20, a ROM (Read Only Memory) 30, HDD (Hard Disk Drive) 40 and I/F 50 are connected through bus bar 80 . In addition, an LCD (Liquid Crystal Display) 60 and an operation unit 70 are connected to the I/F 50 .

The CPU 10 is an arithmetic means, and controls the entire operation of the information equipment. The RAM 20 is a highly volatile memory medium capable of reading and writing information, and is used as a work area when the CPU 10 processes information. The ROM 30 is a read-only non-volatile memory medium that stores programs such as firmware. HDD40 is a non-volatile memory medium that can read and write information, and stores OS (Operating System) or various control programs, application programs, etc.

The I/F 50 connects and controls the bus bar 80 with various hardwares, networks, and the like. The LCD 60 is a visual user interface required for the user to confirm the status of the information machine. The operation part 70 is a keyboard, a mouse, various physical buttons, a touch panel, etc., and is a user interface required for the user to input information to the information machine. In addition, since the control server 200 is used as a server, the user interface such as the LCD 60 and the operation unit 70 can be omitted.

In such a hardware configuration, programs stored in a storage medium such as the ROM 30, the HDD 40, or an unillustrated optical disc are read out to the RAM 20, and the CPU 10 operates according to these programs, thereby constituting a software control. department. The combination of the software control unit and the hardware thus constituted constitutes functional blocks necessary for realizing the functions of the respective devices that constitute the video stage performance system described in the present embodiment.

In such a system, the gist of the present embodiment is based on the premise of the function of synchronizing the video and sound by the synchronization system 400 and reproducing the other elements. Or the structure required to facilitate the manipulation of the material data of the sound.

As described above, when the stage performance by video is provided, the video reproduced by the video player 401, the sound reproduced by the DAW terminal 410, or the background video terminal 420 are reproduced. The background image is synchronized and provided to the audience. Such a configuration is necessary mainly because video and sound or background video are prepared separately. In addition, there are differences in the configurations of the PA system 610 or the speakers 611 depending on the venue, resulting in different signal delay patterns, so individual delay control is required, and such a configuration is suitable.

In such a configuration, it goes without saying that the video is reproduced by the video player 401, the sound is reproduced by the DAW terminal 410, and the background video is reproduced by the background video terminal 420, respectively. Therefore, the operator who manages the video stage performance must manage the data of each of the video, audio, and background video materials individually, and must perform the reproduction operation individually on the day of the stage performance, resulting in the operation becoming very difficult. cumbersome.

On the other hand, in the system described in the present embodiment, when the video reproduced by the video player 401 is created using the dedicated software in the editing software terminal 100, all the video played in the stage performance is Songs are created in a time-series configuration according to a set list. Then, the information representing the time-series arrangement state of the music piece in the software is shared as time-series arrangement information with producers of other elements that need to be synchronized, such as sound and background images.

In the DAW terminal 410 or the background image terminal 420, according to the above-mentioned time series configuration information, the time codes are aligned to create/edit the sound or background image. Thereby, the sound of the DAW terminal 410 or the time code of the background image of the background image terminal 420 are stored in the image file storage medium 110 and correspond to the time code of the image file reproduced by the image player 401 .

Therefore, on the day of the stage performance, in the video player 401, the video files stored in the video file storage medium 110 can be reproduced according to the order of the setting list, as long as the time code corresponding to the reproduction timing is displayed The synchronization signal is input to the DAW terminal 410 or the background image terminal 420, and the DAW terminal 410 or the background image terminal 420 will reproduce the time code as the corresponding sound or background image. Therefore, the operator does not need such a cumbersome operation of managing the correspondence of the files to be reproduced, and the manipulation of the material can be facilitated.

FIG. 3 is a diagram showing a GUI (Graphical User Interface) of the video editing software installed in the editing software terminal 100 . In Figure 3, the video track is shown as "TRACK01", and the audio track is shown as "TRACK02", as shown in "01:00:00" ~ "01:06:00", the left and right directions are sequentially.

The period in which the material is allocated in the video track is indicated by diagonal lines. In addition, from the viewpoint of convenience during editing, a sound track is also included as shown in "TRACK02" in FIG. 3, but this sound is not actually reproduced during the stage performance, but is sound for confirmation.

In FIG. 3 , only “TRACK01” is illustrated as an image track as an example, but it may also be a state in which a plurality of image tracks are displayed overlappingly. In stage performances based on images, the images of CG characters are mainly used, but if there are other images that can be visually displayed, such as hand-drawn animation images or live-action images that have been captured, the same can be done in the same way. Be applicable.

However, one of the purposes of the present invention is to divide the image of the entire stage into a plurality of files instead of one file, and ideally according to the setting of the image to be reproduced in the stage performance. Each song in the list is divided into individual files. In this way, when an image is redone, it is not necessary to re-remember the entire image of the stage to the image file storage medium 110 , but only to re-remember the image including the redoed portion to the image file storage medium 110 .

Such an effect can be maximized when the time required for the image file to be stored in the image file storage medium 110 is long. In this case, for example, when the image reproduced in the stage performance is CG, and the image file is memorized in the image file storage medium 110, the image processing of the CG is required.

In addition, in FIG. 3, as shown in "01:00:00" - "01:06:00", the time series starts from "01:00:00". This is according to the usual practice in the video production industry, but as far as the effect of obtaining this patent is concerned, there is no problem even starting from "00:00:00".

As shown in FIG. 3 , a silent period T _01-02 is provided between timing t _01ED indicating the end timing of one song and t _02OP indicating the start timing of the next song. The silent period T _01-02 is not an actual stage performance, but is set with a longer margin. In this way, the silent period T _01-02 is used to adjust the time between songs in an actual stage performance. Details will be described later.

The information indicating the arrangement period of the music pieces indicated by slanted lines in FIG. 3 is used as the above-mentioned time-series arrangement information. FIG. 4 is a diagram showing the data structure of the time series configuration information according to this embodiment. As shown in FIG. 4 , the time-series configuration information described in this embodiment includes information such as “setting list No”, “start sequence”, “content ID”, and “content length”.

The "setting list No" is a value indicating the order of the music pieces in the stage performance. The "start timing" is a value indicating the start timing of each piece of music in the time series. The "content ID" is information for specifying each piece of music, and the file name or song name of the sample data provided to the operator of the DAW terminal 410 or the background image terminal 420 together with the time-series configuration information is used.

The "content length" is a value indicating the length of each musical piece, and is a value indicating a period from the left end to the right end of the oblique line range shown in FIG. 3 . In addition, as shown in FIG. 4, the time such as "start timing" or "content length" is information indicating timing, that is, time code, and is shown as "01:00:0***/60", indicating that Information in the form of hours, minutes, seconds and frames. This form is effective in representing time-series images or sounds in frame units according to the frame rate of the image.

The editing software terminal 100 described in this embodiment creates/edits images at a frame rate of 60 fps. Therefore, the part of the numerator of "**/60" of the time information expressed in the form of "01:00:0***/60" takes a value from 0 to 59, and when it reaches 60, it changes back to 0 and the seconds will increase by 1. In other words, the part of "**/60" is a value that expresses the time sequence between 1 second in accordance with the frame rate.

Since such information is included, by sharing the time series configuration information, the time code of the video created by the software of the editing software terminal 100 as shown in the GUI of FIG. 3 can be shared with other operators. shared. As a result, for the time code that is output in parallel by reproducing the video file stored in the video file storage medium 110 by the video player 401, the sound reproduced in the DAW terminal 410 or the background video terminal 420 can be reproduced. Or the time code of the image, which can correspond to it.

In addition, as described above, the silent period T _01-02 shown in FIG. 3 is not a song interval in an actual stage performance. Therefore, when writing the image edited by the editing software as an image file and storing it in the image file storage medium 110, the writing period must be specified according to each music included in the setting list. FIG. 5 is a diagram showing an example of specifying information for specifying image writing required during such a period.

As shown in FIG. 5 , the image writing designation information in this embodiment includes the information of “setting list No”, “starting sequence”, and “designated length”. The "setting list No" is the same value as the "setting list No" explained in FIG. 4 . The "start timing" is a value specifying the start timing of the period during which the music pieces corresponding to each setup list No. are written, and corresponds to the time sequence shown in FIG. 3 . The "content length" is a value indicating the length of the period during which the music corresponding to each set list No. is written, and corresponds to the time sequence shown in FIG. 3 similarly to the "start sequence".

FIG. 6 is a conceptual illustration of the designation of the writing period due to the image writing designation information shown in FIG. 5 . As illustrated in FIG. 3 , the period between the end t _nED of Set _n and the beginning t _n+ 1OP of the next song is the space period T _n-n+1 on the editing software. In this regard, in the writing specification information described in FIG. 5, the "start timing" of Set _n+1 is specified to be earlier than the start time t _n+1OP of the next song by a period T'n _{-n+ t} ' _n+1OP of 1. In this way, the music of Set _n+1 is written as an image file including the period of the period T'n _-n+1 before the timing when the image or sound actually starts, that is, tn _+1OP .

In this way, the editing software terminal 100 takes the images from the time sequence specified by the "start sequence" to the period specified by the "specified length" in the time sequence of the above-mentioned time sequence configuration information as the setting list. Write out the image files of each piece of music contained in it. At this time, when the editing software terminal 100 automatically and continuously reproduces in the order of file names, the file names are assigned in such a manner that each video file is reproduced in the order of the setting list.

As a result, as shown in FIG. 7 , in the image file storage medium 110, the image file is written with the file name according to the setting list. In this way, once the image files stored in the image file storage medium 110 are reproduced by the image player 401 in the order of the file names, as shown in FIG. 8 , about Set _n shown in FIG. 6 The music and the music of Set _n+1 , the period _T'n-n+1 will be the actual song. That is, in writing the specified information, by adjusting the period T' _n-n+1 , the music interval on the day of the stage performance can be adjusted.

FIG. 9 is a diagram illustrating the data structure of the image files stored in the image file storage medium 110 . The image file stored in the image file storage medium 110 contains "image", "sound" and "time code" in time series according to a predetermined frame rate. As described above, the frame rate in this embodiment is 60 fps. In addition, as described above, the "sound" contained in the image file stored in the image file storage medium 110 is not provided to the audience during the actual stage performance, but is temporary data when the image is confirmed. In the example of FIG. 9, the "time code" is used as time information associated with the image.

Next, the function of the control server 200 will be described with reference to FIG. 10 . As shown in FIG. 10 , the control server 200 includes a control unit 210 , a network I/F 220 and a dedicated I/F 230 . In addition, the control unit 210 includes a control application 211 and a network control unit 212 .

The network I/F 220 is an interface required for the control server 200 to communicate with other devices through a network, and uses an interface such as Ethernet (registered trademark). The dedicated I/F 230 is a dedicated interface required for the control server 200 to exchange signals with the control box 300 or the video player 401 .

The control application 211 receives control signals from the control box 300 through the dedicated I/F 230 . In addition, the control application 211 sends a control signal to the video player 401 through the dedicated I/F 230 . In FIG. 10, the control box 300 and the video player 401 are shown as being connected to a single dedicated I/F 230, but there may be cases where each is connected to an individual dedicated I/F.

The control unit 210 is constituted by a combination of software and hardware, and realizes the main function of the control server 200 . The control application 211 is a configuration that provides the main function of the control server 200 , and controls the video player 401 .

For example, when the operator operates the control box 300 to operate the video player 401 , the control box 300 sends the operation signal corresponding to the operator's operation to the control application 211 through the dedicated I/F 230 . The control application program 211 sends the control signal required for the operation of the video player 401 to the video player 401 through the dedicated I/F 230 according to the operation signal received from the control box 300 .

In addition, the editing software terminal 100 described in this embodiment not only has the function of editing and producing the image files required to be stored in the image file storage medium 110, but also has the function of operating the image player through the GUI of the editing software. 401 function. The control application 211 has the function of mediating control signals for this purpose.

For example, in the GUI of the editing software of the editing software terminal 100 illustrated in FIG. 3 , the waveforms of images or sounds of the frames at the designated timing on the time line are displayed on the GUI. Thereby, the operator can easily check the video at any time series. That is, the editing software terminal 100 functions as a video arrangement control unit.

In the state where the arbitrary timing has been specified, the editing software terminal 100 transmits a control signal to the control server 200 through the network A when the reproduction on the video player 401 is instructed. In this case, the control signal transmitted from the editing software terminal 100 includes, in addition to an identifier indicating a command to playback on the video player 401, a time code indicating the designated timing. The time code corresponds to the time code explained in FIG. 9 .

In the control server 200 , the control application 211 receives the control signal sent from the editing software terminal 100 through the network I/F 220 and the network control unit 212 . The control application 211 interprets the playback command to be sent to the video player 401 based on the identifier contained in the control signal, and sends the playback command together with the above-mentioned time code through the dedicated I/F 230 to the video player 401.

In the video player 401, based on the control signal received from the control server 200, firstly, the designated time code is used as the retrieval key to retrieve the image file stored in the image file storage medium 110. As illustrated in FIG. 4 and the like, the time code contained in the image file stored in the image file storage medium 110 is the time code of the state in which all the music pieces are arranged in time series.

Therefore, the time code of any timing selected in the editing software terminal 100 corresponds to only one of the plurality of image files stored in the image file storage medium 110 . As a result of the search, the video player 401 extracts the video file containing the time code of the search key, and reproduces the video file from the timing of the designated time code.

With such a configuration, the timing of each musical piece can be visually confirmed through the editing software terminal 100, and the video player 401 can be made to reproduce the musical piece at an arbitrary timing. Such a configuration is effective in, for example, a rehearsal of a stage performance. In the rehearsal, in addition to the case where the test is performed by running the entire piece of music, there are also cases where the test only needs to be performed on an arbitrary timing of a specific piece of music. In such a case, the rehearsal can be efficiently performed with such a configuration.

In addition, the configuration of the control server 200 is adopted in response to the limitation of the interface of the video player 401 . When a device operating like the video player 401 is controlled from the outside, an interface for external control provided in the video player 401 is used.

However, the I/F for external control only supports one-to-one connection, and the configuration that can directly accept control from both the control box 300 and the editing software terminal 100 as in the present embodiment is generally not supported. This limitation can be avoided by connecting the control server 200 to the video player 401 so that the control server 200 accepts commands from a plurality of machines.

In this way, the video player 401 reproduces the video file stored in the video file storage medium 110 based on the control signal from the control server 200 , and outputs the video signal to the video switch 500 . The output of the video signal by the video player 401 may use a general video signal such as an HDMI (High-Definition Multimedia Interface) signal.

In addition, the video player 401, in parallel with the video signal output to the video switcher 500 due to the reproduction of the video file, treats the time code corresponding to the frame output as the current video signal as the synchronization signal. Output to fps converter 402 . The corresponding relationship between the video frame and the time code is as described in FIG. 9 .

In addition, the output of the synchronization signal from the video player 401 to the fps converter 402 is not only in the form of extracting and outputting the time code, but also by simply converting the video signal to the video switch 500 and fps A mode in which the outputs of the two devices 402 are systematically performed in parallel. Such an aspect can be realized only when, for example, the video player 401 has HDMI outputs with two systems.

The fps converter 402 converts the frame rate of the synchronization signal outputted from the video player 401 into a format corresponding to the subsequent equipment and outputs it to the LTC converter 403 . As mentioned above, the frame rate of the image file in this embodiment is 60fps, and the fps converter 402 converts it to 30fps.

FIG. 10 is a diagram showing an example of the result of converting the frame rate of the image file shown in FIG. 9 to 30 fps. As shown in FIG. 10 , the 60fps is converted into 30fps by the fps converter, and the image frame is deducted by 1 frame every 2 frames. In addition, "time code" is expressed in the form of "**/60", which is less than hours, minutes and seconds, and is converted into the form of "**/30".

As shown in FIG. 10, even after the frame rate of the sync signal has been converted, the timing represented by the time code in each frame between 1 second is the same before and after conversion. Therefore, the correct time code corresponding to each image frame will be transmitted to the equipment in the later stage, and the sound reproduced by the DAW terminal 410 or the background image reproduced by the background image terminal 420 will follow the synchronization signal. It is synchronized with the video reproduced by the video player 401 .

Although the purpose of the fps converter 402 is to convert the frame rate of the synchronization signal, as described above, the signal supplied to the fps converter 402 in this embodiment is an image signal such as an HDMI signal. Therefore, the fps converter 402 described in this embodiment may be a device that simply has the function of converting the frame rate of the supplied video signal. With such a configuration, the configuration described in the present embodiment can be realized by the function of the existing device.

The LTC converter 403 generates an LTC signal based on the frame rate-converted synchronization signal input from the fps converter 402 , and outputs the LTC signal to the DAW terminal 410 or the background image terminal 420 . The process of converting a synchronization signal containing a time code into an LTC signal can be easily realized by using an existing process, but in this embodiment, it is realized by using the function of an existing product as described above.

Next, the function of the DAW terminal 410 will be described with reference to FIG. 12 . As shown in FIG. 12 , the DAW terminal 410 according to this embodiment includes a control unit 411 , an audio I/F 412 and an LTC I/F 413 in addition to the LCD 60 and the operation unit 70 described in FIG. 2 . Further, the control unit 411 includes an operation control unit 414 , a display control unit 415 , a DAW application 416 , an audio I/F control unit 417 , and an LTC processing unit 418 .

The audio I/F 412 is hardware for outputting audio signals when the DAW terminal 410 reproduces audio by the function of the DAW application 416 . As the audio I/F412, it is a general audio interface that can use terminals corresponding to RCA cables, mini cables, microphone cables, and XLR cables.

The LTC I/F 413 is hardware provided with a necessary terminal for receiving the LTC signal input from the LTC converter 403 . As the LTC I/F412 system, an interface including a D-sub terminal, a coaxial terminal, and an XLR cable, which are common terminals used for LTC signals, can be used.

The control unit 411 is constituted by a combination of software and hardware, and is a control unit that controls the entirety of the DAW terminal 410 . The operation control part 414 acquires the signal of the operation content performed by the user on the operation part 70, and transmits it to the software module which operates in the DAW terminal 410, such as the DAW application 416. The display control unit 415 is a GUI (Graphical User Interface) of software that causes the OS of the DAW terminal 410 or the DAW application 416 to operate in the DAW terminal 410 , and is displayed on the LCD 60 .

The DAW application 416 is software that provides various functions related to sound, and in this embodiment, performs reproduction processing of various sounds in addition to the sound provided to the audience during the stage performance. In particular, the DAW application 416 according to the present embodiment reproduces the sound in synchronization with the MTC (MIDI Time Code) input from the LTC processing unit 418 . Thereby, by synchronizing with the video reproduced in the video player 401 and reproducing the sound by the DAW terminal 410, the audience of the stage performance can be provided in synchronization with the video and the sound.

The audio I/F control unit 417 controls the audio I/F 412 to output audio signals in response to audio reproduction processing by the DAW application 416 . The audio I/F control unit 417 is configured to control driver software required for the audio I/F, which is configured as hardware for outputting audio signals.

The LTC processing unit 418 obtains the LTC signal input from the LTC converter 403 to the LTC I/F 413 and converts it into an MTC signal, which is a signal required for conveying the synchronization timing to the DAW application 416 . In addition, the LTC processing unit 418 described in this embodiment includes a function for ignoring the influence of an unintended change in the signal, such as when a noise or the like is mixed into the input LTC signal. . Such a function will be described with reference to FIGS. 13 and 14 .

FIG. 13 is a diagram showing information temporarily memorized by the LTC processing unit 418 during operation. The LTC processing unit 418 described in this embodiment uses the information of "fps setting value", "output value", and "conversion value" when processing. The “fps setting value” is a value preset for the frame rate when the LTC processing unit 418 operates, and corresponds to the frame rate converted by the fps converter 402 . As described above, the "fps setting value" in this embodiment is "30fps".

The "output value" is the MTC value output by the LTC processing unit 418 to the DAW application 416 . The "output value" is not only used as an output value to the MTC of the DAW application 416, but also used when checking the MTC output value of the previous frame during processing by the LTC processing unit 418.

The "conversion value" is the value of the conversion result obtained by the LTC processing unit 418 converting the LTC received through the LTC I/F 413 into MTC. The "conversion value" is not only used as a memory value of MTC converted from LTC, but also used when confirming the conversion value of MTC of the previous frame during processing by the LTC processing unit 418 . Each information shown in FIG. 13 is stored in a memory area secured in the RAM 20 .

FIG. 14 is a flowchart showing the operation of the LTC processing unit 418 according to this embodiment. As shown in FIG. 13, the LTC processing unit 418 receives the LTC signal input to the LTC I/F 413, and converts the signal into MTC (S1401). Then, the LTC processing unit 418 refers to the MTC output value of the previous frame stored as the "output value" described in FIG. 13 to check whether the converted value obtained in S1401 represents the next frame of the previous output value. grid (S1402).

As illustrated in FIG. 4 and the like, the time code described in this embodiment is in the form of hour, minute, second + frame number. Therefore, as the process of S1402, it is possible to directly check whether or not the frames are advancing in time series.

On the other hand, for example, when the time code is represented by the number of decimal places and the number of seconds, the LTC processing unit 418 obtains 1 based on the "fps setting value" as the process of S1402. The assumed change value of the frame is calculated based on the value and the previous output value, and the assumed time code is calculated and compared with the converted value to perform the determination in S1402.

The change value assumed here is the number of seconds equivalent to one frame of the "fps setting value". In this case, the judgment in S1402 does not have to be strictly judged to be completely consistent, as long as a certain degree of error is allowed to judge whether it falls within the expected range. In any case, the processing of S1402 only needs to detect whether the inputted LTC signal has a change different from the change of the continuous time series, and can be appropriately executed according to the information form of the time code.

In addition, as illustrated in FIG. 11, the LTC signal input to the LTC processing unit 418 described in this embodiment is converted from 60 fps to 30 fps, and the result is in the form of hours, minutes, seconds + the number of frames, the number of frames The part is in the form of "**/30". Therefore, in S1402 described in this embodiment, the LTC processing unit 418 determines whether or not the part of the numerator of the number of frames is the previous output value+1.

As a result of this determination, if the value of MTC indicates the previous next frame (S1402/YES), the LTC processing unit 418 determines the song required for skipping the time code between the songs The time judgment counter is reset (S1403), the MTC obtained by the conversion process in S1401 is memorized as a "conversion value" and an "output value", and the "output value" is notified to the DAW application 416 (S1404 ), and repeat the process from S1401.

On the other hand, if the value of MTC does not indicate the previous next frame (S1402/NO), then the LTC processing unit 418, referring to FIG. 13 as the “conversion value”, is processed The MTC conversion value of the previous frame is stored, and it is checked whether the conversion value obtained in S1401 represents the next frame of the previous conversion value (S1405). The process of S1405 is the same process as the process of S1402, which is performed by comparing with the previous conversion value, and is appropriately executed according to the format of the time code, and the same is true.

As a result of the determination, if the value of MTC is the next frame indicating the previous conversion value (S1405/YES), the LTC processing unit 418 increments the music interval determination counter (S1406). The LTC processing unit 418, upon incrementing the value of the inter-music determination counter, compares the value with a predetermined threshold value (S1407).

As a result, if the value of the inter-song determination counter is less than the threshold value (S1407/YES), the LTC processing unit 418 determines that the unexpected change in the MTC determined in S1402 is only temporary. Sexually unintended change. Then, the LTC processing unit 418 memorizes the MTC obtained by the conversion process of S1401 as a "conversion value", and at the same time, the MTC of the previous frame is a representation of the value memorized as an "output value" The value of the next frame is memorized as a new "output value", the "output value" is notified to the DAW application 416 (S1408), and the processing from S1401 is repeated.

On the other hand, when the value of the inter-song determination counter is equal to or greater than the threshold value (S1407/NO), the LTC processing unit 418 determines that the unexpected change of the MTC determined in S1402 is a musical interval After resetting the inter-song judgment counter (S1403), the process of S1404 is performed, and the process from S1401 is repeated.

Also, as a result of the determination in S1405, when the MTC value is not the value of the next frame representing the previous conversion value (S1405/NO), the LTC processing unit 418 determines that the LTC signal is an irregular change, and The interval determination counter is reset (S1409), the process of S1408 is performed, and then the process from S1401 is repeated.

The LTC processing unit 418 repeats the processing shown in FIG. 14 at the frame rate set in the "fps setting value". In the present embodiment, the frame rate of the synchronization signal is converted to 30 fps by the fps converter 402 first, and then the LTC signal of 30 fps is outputted by the LTC converter 403 . In response to this, the LTC processing unit 418 is preset with a frame rate of 30 fps, and repeats the cycle of S1401 to S1409 at a cycle of about 0.033 seconds.

Therefore, the determination in S1407 of FIG. 14 is equivalent to that the time stamp indicated by the LTC signal received by the LTC processing unit 418 has unexpectedly changed, and the value after the change is assumed based on fps The change of the amount of change is the judgment of whether it continues to the set number of frames. The predetermined number of frames is the threshold value in S1407; the threshold value is based on the level of noise expected in the environment and the actual value represented as _T'n-n+1 in FIG. 8 . The value between songs, and make appropriate settings, for example, in the case of 1 second and 30fps, it is 30.

FIG. 15 is a diagram showing the change of the frame between the songs and the change of the time stamp indicated by the MTC in the case where the continuous music is reproduced continuously in the setting list, as explained in FIG. 8 . As illustrated in FIG. 6 , the video files that are created and edited by being arranged in a series of time series in the editing software terminal 100 are written as individual video files for each piece of music. Parts that are arranged with a margin between the music pieces and spaced by the blank period are cut out temporally and written. Therefore, in FIG. 15, as shown by the time stamps of the frames "N+3" and "N+4", the change of the time stamps between the music pieces is non-linear.

In order to enable the DAW application 416 to follow such a change, it is not a problem to simply generate the MTC according to the LTC signal input to the LTC processing unit 418 to operate the DAW application 416, but there is still a problem with the analog signal. The LTC signal of the superimposed unintended noise, the time stamp represented by it becomes an unintended value. In order to ignore the influence of such noise, it is necessary to make a judgment with a certain level of threshold as in S1407 in FIG. 14 .

In addition, when the frame N+3 shown in FIG. 15 is changed to N+4, the LTC processing unit 418 does not immediately output the time stamp corresponding to N+4 by performing the determination as in S1406, and by S1407 In the processing, the time code corresponding to N+3 is added to the time code of 1 frame of 30 fps and output. After such processing continues across 29 frames, the time code of the MTC conversion result will be output when the 30th frame, that is, the frame N+33 is reached.

30 frames at 30fps is 1 second. That is, when the threshold value of S1407 is 30, in the processing between songs as shown in FIG. 15, the output of the MTC corresponding to the next song is delayed by about 1 second. This delay is absorbed by the period T' _n-n+1 between the curves as described in FIG. 8 .

In addition, the LTC processing unit 418 according to the present embodiment uses the "fps setting value" described in FIG. 13 to output the MTC in synchronization with the LTC signal as soon as possible with the above-mentioned delay of about 30 frames. . In this regard, when the frame rate is not preset, the LTC processing unit 418 first observes the change of the LTC signal in a predetermined period, and then determines the frame rate of the signal. In this case, it generally takes several seconds to determine the frame rate.

After that, the processing shown in FIG. 13 is started, and then the LTC processing section 418 finally starts to output the MTC. Therefore, during the few seconds, the video player 401 will reproduce the video file and the video will be displayed on the display device 510. Regardless of whether the synchronization signal is output, the DAW application 416 will not operate and the sound will not be reproduced. On the other hand, the LTC processing unit 418 described in the present embodiment can eliminate the delay of several seconds mentioned above by using the "fps setting value", which is necessary to correspond to the skipping of the LTC signal explained in FIG. 14 . In several frames, the MTC synchronized with the LTC signal can be output.

In this way, when the LTC processing unit 418 outputs the MTC, the DAW application 416 reproduces the sound corresponding to the time stamp specified by the input MTC. The audio I/F 412 outputs audio signals according to the control by the audio I/F control unit 417 by the reproduction of the audio by the DAW application 416 .

FIG. 16 is an illustration of an example of the GUI of the DAW application 416 . The DAW application 416 is software that integrates sound-related functions. As shown in FIG. 16 , a plurality of sound tracks are arranged in time series. Also, as shown in FIG. 16, the DAW application 416 according to the present embodiment imports the time-series configuration data shared from the editing software terminal 100, and thereby the time-series configuration data is stored in the music. During configuration, make a visual display. In FIG. 16 , the periods in which the music pieces are arranged in the time-series arrangement data are indicated by the range of halftone dots.

With such a function, the operator of the DAW application 416 can create/edit the sound corresponding to the time stamp of the time series configuration data. Thereby, the sound created/edited in the DAW application 416 is in a state corresponding to the time code of the time series configuration data described in FIG. 4 . In such a configuration, the DAW application 416 synchronizes with the MTC input from the LTC processing unit 418 and reproduces the sound, whereby the reproduced sound is synchronized with the video reproduced by the video player 401 .

In addition, the sound switcher 600 and the PA system 610 described in this embodiment have a plurality of channels corresponding to the sound track of the DAW terminal 410, and can be used for the speaker 611 or the live band according to the channels. Return to the output destination such as 612, and output the sound individually. As illustrated in Figure 16, in the DAW application 416, a plurality of audio tracks are associated with a timeline. One of the plurality of sound tracks is the clock sound required for listening to the rhythm by the player who actually plays the musical instrument in the stage performance. The clock sound, which is in the channels of the sound switch 600 and the PA system 610 , will only be output in the channel corresponding to the live orchestra use ear return 612 .

The DAW terminal 410 is in charge of the sound in the synchronization system 400. As shown in FIG. 16, the sound and the time code are associated and memorized according to the time series configuration information, and the associated sound can be synchronized and output according to the LTC signal. . On the other hand, the background image terminal 420 is in charge of the background image in the synchronization system 400 .

Therefore, instead of the sound of the DAW terminal 410 , the associated background image can be output synchronously according to the LTC signal. Its functional configuration is the configuration of the DAW terminal 410 described in FIG. 12 , and the DAW application 416 is replaced by the function related to the background image, and the audio I/F control unit 417 and the audio I/F 412 are replaced by the video output. Except for the function of , the rest are the same, so the detailed description is omitted.

As described above, the synchronization system 400 of this embodiment is based on the time-series configuration information described in FIG. 4 . Then, the video file reproduced by the video player 401 is stored in the video file storage medium 110 in which the time code and the video frame indicated by the time-series arrangement information are associated with each other. Furthermore, in the DAW terminal 410, the time code and the sound indicated by the time series configuration information are associated and memorized. In addition, in the background image terminal 420, the time code and the background image shown in the time series configuration information are associated and memorized.

Then, the DAW terminal 410 or the background video terminal 420 synchronizes with the synchronization signal output by the video player 401 in response to the reproduction of the video, and reproduces the audio or the background video. In this case, cumbersome operations such as manual file selection are not required. With such a configuration, even if the reproduced video is prepared by dividing into a plurality of files when providing the stage performance by the video, it is possible to easily make other files without complicated mechanisms or operations. Features and imagery are synchronized. The video stage performance system 1 described in this embodiment is composed of all the elements shown in FIG. 1 , but the synchronization system 400a and the video file storage medium 110a are the most basic components of the video stage performance system.

In addition, in this embodiment, the case where the fps converter 402 converts the frame rate of the synchronization signal and the LTC converter 403 converts the synchronization signal into the LTC signal is taken as an example for description. That is, the fps converter 402 and the LTC converter 403 function as a synchronization signal converter. This is used to convert the synchronization signal output by the video player 401 into a format supported by the DAW terminal 410 , that is, the structure required for the LTC signal. With such a configuration, the signal processing system including the interface does not need to provide special functions, and can use the existing mechanism.

Furthermore, in the time-series arrangement information described in this embodiment, the music pieces are arranged in the order of the setting list performed in the stage performance. Thereby, in the GUI shown in FIG. 3 or FIG. 16 , the music pieces are displayed in a state of being arranged in the order included in the setting list, and editing and management can be performed more intuitively.

However, even if the arrangement order of the music pieces in the time-series arrangement information is different from the order of the setting list, the editing software terminal 100, the DAW terminal 410, and the background image terminal 420 only need to create according to the common time-series arrangement information. Each element, video, sound, and background video will correspond to each other and be reproduced synchronously. Therefore, even after the image files are stored in the image file storage medium 110, by adjusting the reproduction order of the image files in the image player 401, the order of the setting list can be easily changed.

The adjustment of the reproduction order of the video files in the video player 401 is, for example, in the configuration in which the video player 401 reproduces the video files in sequence according to the file names of the video files, by changing the video file storage medium 110 The file name of the image file to be remembered can be performed.

Furthermore, in the above-described embodiment, as other elements necessary for synchronizing with the video reproduced by the video player 401, the sound reproduced by the DAW terminal 410 or the background The background video reproduced by the video terminal 420 is described as an example. That is, the DAW terminal 410 or the background video terminal 420 functions as a synchronization element reproduction unit. However, this is only an example, and it can be applied to any stage performance as long as it is an element that needs to synchronize the video. Other elements are, for example, special effects such as paper sprinkles, lighting effects, and camera movement.

In addition, the video file described in the present embodiment will be described by taking, as an example, the video of the music included in the set list performed in the stage performance. However, in the stage performance provided to the audience by the reproduction of the video, the MC (host comment) between the music and the music may be provided by the video. Therefore, the image file stored in the image file storage medium 110 includes not only the image of the music but also the image of the MC. In such a case, in the DAW terminal 410 or the background image terminal 420, the sound or background image corresponding to the MC is created/edited according to the time-series arrangement information.

Furthermore, in the above-described embodiment, as described in FIG. 1 , as the video switcher 500 , the audio switcher 600 and the video switcher 700 , a switching unit for switching the main system and the backup system is provided individually. example to illustrate. In addition, the switching can also be performed by a single switching unit that accepts and switches all the signals output from the video player 401 , the DAW terminal 410 and the background video terminal 420 .

1: Video stage performance system 10: CPU 20: RAM 30:ROM 40:HDD 50:I/F 60: LCD 70: Operation Department 80: Busbar 100: Edit software terminal 110, 110a, 110b: Image File Memory Media 200: Control the server 210,411: Control Department 211: Control application 212: Network Control Department 220: Network I/F 230: Dedicated I/F 300: Control Box 400, 400a, 400b: Synchronized Systems 401: Video Player 402: fps converter 403: LTC Converter 410: DAW Terminal 412: Sound I/F 413: LTC I/F 414: Operation Control Department 415: Display Control Department 416: DAW applications 417: Sound I/F Control Section 418: LTC Processing Department 420: Background image terminal 500,700: Video switcher 510,710: Display devices 600: Sound Switcher 610: PA System 611: Speaker 612: Ear Return for Live Orchestra

Fig. 1 is a diagram showing the overall configuration of the video stage performance control system according to the embodiment of the present invention. [FIG. 2] A diagram showing a hardware configuration of an information device included in the system according to the embodiment of the present invention. [ Fig. 3] Fig. 3 is a diagram showing an example of GUI of the image editing software according to the embodiment of the present invention. [ Fig. 4] Fig. 4 is a diagram showing the data structure of the time-series configuration information according to the embodiment of the present invention. [ Fig. 5] Fig. 5 is a diagram showing an example of image writing designation information according to the embodiment of the present invention. [Fig. 6] A conceptual illustration of the content of the image writing specified information according to the embodiment of the present invention. [Fig. [ Fig. 7] Fig. 7 is a diagram showing an example of an image file group memorized in the image file storage medium according to the embodiment of the present invention. [ Fig. 8 ] A conceptual illustration of a song between when the video file group according to the embodiment of the present invention is reproduced. 9 is a conceptual diagram of the data structure of the image file stored in the image file storage medium according to the embodiment of the present invention. Fig. 10 is a block diagram showing the functional configuration of the control server according to the embodiment of the present invention. [ Fig. 11 ] A conceptual diagram of an image file that has been fps-converted by an fps device according to an embodiment of the present invention. 12 is a block diagram showing the functional configuration of the DAW terminal according to the embodiment of the present invention. [ Fig. 13 ] A diagram of information memorized and used by the LTC processing unit according to the embodiment of the present invention. 14 is a flowchart of LTC processing by the LTC processing unit according to the embodiment of the present invention. [ Fig. 15] Fig. 15 is a diagram showing an example of the content of the LTC signal inputted at the timing between songs in the setting list in the LTC processing unit according to the embodiment of the present invention. [ Fig. 16 ] A diagram showing an example of the GUI of the DAW application according to the embodiment of the present invention.

1: Video stage performance system

100: Edit software terminal

110a, 110b: Image file memory media

200: Control the server

300: Control Box

400a, 400b: Synchronized Systems

401: Video Player

402: fps converter

403: LTC Converter

410: DAW Terminal

420: Background image terminal

500,700: Video switcher

510,710: Display devices

600: Sound Switcher

610: PA System

611: Speaker

612: Ear Return for Live Orchestra

A: Internet

Claims (11)

A video stage performance system is a video stage performance system that provides stage performances to audiences by reproducing images, and is characterized by comprising: a video file memory medium for dividing the images reproduced in the stage performance into a plurality of image files to be memorized; and an image reproduction unit that reproduces the plurality of image files memorized in the previous image file storage medium in a predetermined order, and outputs a synchronization signal corresponding to the reproduction of the images; and The synchronization element reproduction part is the synchronization reproduction element to be synchronized with the image reproduced by the preceding image reproduction part, and reproduces according to the preceding synchronization signal; In the state of being connected, the preceding image file is memorized, wherein the time-series arrangement information indicates that the images reproduced in the preceding stage performance are arranged in a time-series state; the output of the preceding image reproducing unit The synchronization signal includes: the pre-recorded time information associated with the image being reproduced; the pre-recorded synchronization element regenerating part is based on the pre-recorded time sequence arrangement information to associate the pre-recorded synchronization reproduction element with the time information and memorize, thereby, The synchronous reproduction element reproduced in accordance with the aforementioned synchronization signal is synchronized with the video reproduced by the aforementioned video reproduction unit. The video stage performance system according to claim 1, wherein the aforementioned time-series configuration information indicates that the images reproduced in the aforementioned stage performance are chronologically arranged in accordance with the order of reproduction in the aforementioned stage performance. Information about the configured state. The video stage performance system according to claim 2, wherein the aforementioned time-series configuration information indicates that the images reproduced in the aforementioned stage performance are time-series in the order of being reproduced in the aforementioned stage performance At the same time, each image is the information of the state of being arranged with a predetermined space period; the image file stored in the pre-recorded image file storage medium is, in the time sequence of the pre-recorded time-series configuration information, by the pre-recorded image. Individual image files are generated by selecting each of the existing periods. The video stage performance system according to claim 3, wherein the preamble synchronization element reproducing unit is set when the time information indicated by the input preamble synchronization signal is a change different from a continuous time series change, The time information obtained by adding the change value of the time series to the time information before the change is used as a synchronization signal, and the preamble synchronization reproduction element is reproduced; the time information shown in the input preamble synchronization signal is set to be continuous with If the time information after the change is different from the change in the time series, and the time information after the change is a continuous time series change for a predetermined period of time, the time information after the change in the previous record is regarded as a synchronization signal, and the synchronization reproduction element of the previous record is used. Regenerate. The video stage performance system according to claim 1, further comprising: a synchronization signal conversion unit that converts the preamble synchronization signal output by the preamble video reproduction unit into a format corresponding to the preamble synchronization element reproduction unit. The video stage performance system according to claim 5, wherein the preamble synchronizing signal converting unit converts the synchronizing signal output by the preamble video reproducing unit into an audio signal representing time. The video stage performance system according to claim 1, wherein the preamble synchronization element reproduction unit interprets the preamble synchronization signal according to a frame rate determined in advance. The video stage performance system as set forth in claim 1, further comprising a video reproduction control unit having a function of externally controlling the aforementioned video reproduction unit and receiving from a plurality of devices necessary for operating the aforementioned video reproduction unit The function of the operation signal. The video stage performance system according to claim 8, further comprising a video arrangement control unit including: corresponding to the preceding time-series arrangement information, the video to be reproduced in the preceding stage performance is arranged in time series The state is visually displayed, and the function of instructing the pre-image reproduction unit to perform image reproduction by specifying an arbitrary time sequence in the time series; the pre-image reproduction unit obtains the designated pre-image time through the pre-image reproduction control unit The reproduction command of an image at an arbitrary time sequence in the sequence; the pre-image file memorized in the pre-image file storage medium will contain the image of the image that has been associated with the time information corresponding to the designated pre-time sequence. The file is reproduced from the time recorded before it has been designated. The video stage performance system as set forth in claim 1, wherein the structure for reproducing the pre-image and the pre-synchronized reproduction element constituted by the pre-image file storage medium, the pre-image reproduction unit, and the pre-synchronization element reproduction unit is: It has a complex number system; it includes: a switching part, which selects and outputs any one of the image signals and the signals of the synchronous reproduction elements output from each of the above-mentioned complex number systems; the above-mentioned switching part is normal in the main system In the case of operation, when the signal that is being output at all times is interrupted, it switches to the signal output by the sub-system. A method for providing a video stage performance is a method for providing a video stage performance for providing audiences with a stage performance by reproducing an image, which is characterized in that the image reproduced in the stage performance is divided into a plurality of video files and Memory to the memory medium; reproduce the multiple image files memorized in the previous memory medium in a predetermined order, and output the synchronization signal corresponding to the reproduction of the image; The synchronous reproduction element to be synchronized with the image to be reproduced is reproduced according to the pre-recorded synchronization signal; the pre-recorded memory medium is in a state in which the image and time information are related according to the time-series configuration information, and the pre-recorded image file is added. Memory, wherein the time-series configuration information represents the state in which all the preceding images are arranged in time series; the synchronization signal output with the regeneration of the preceding images includes: the preceding time associated with the image being reproduced The information; the preamble synchronous reproduction element is memorized in association with the time information according to the preamble time series arrangement information, whereby the synchronous reproduction element reproduced in accordance with the preamble synchronization signal is synchronized with the reproduced preamble image.

Images