JP2004040274A - Video-mixing apparatus and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video mixer and a method thereof which allows persons who appreciate participating in creating image products. <P>SOLUTION: A video mixer 10 stores messages received over a network 12. The messages include images, videos, texts (characters) and the like and are sent from portable terminals 16 of many customers 14 for seeing image products, for example, to a server 18 by electronic mails or written information on accessed Web pages and the like. When a message is selected through a VJ 20 for creating an image, its image product is influenced, based on the message. The message is utilized as a material, for example, and presented in the image, and also utilized as a parameter for creating the image, thereby creating an image product which reflects creativity and the expression of the customer 14 by the message. Thus the persons who appreciate or customers can participate in the creation of the image products. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
[Industrial applications]
The present invention relates to a video mixing apparatus and method, and more particularly to a video mixing apparatus and method for creating a video work by combining a plurality of materials such as images, videos, and characters.
[0002]
[Prior art]
In recent clubs and the like, in addition to a DJ (Disk Jockey) mixing and playing music by using a playback device such as a record player or a CD player, a VJ (Visual Jockey or Video Jockey) is used to create a space or an image by video. The production of the place is being performed. That is, the VJ uses a video mixing device such as a PC in which software capable of real-time video mixing is installed. As software capable of mixing this kind of video, “motion dive” (seller: Sourcenext Co., Ltd., planning / development: Digital Stage Co., Ltd.) and the like are known. The VJ creates one video work by performing operations such as superimposing or switching over a plurality of materials such as images and videos in accordance with music, for example. The created video is displayed in real time on a display device such as a display device or a screen. Such a conventional video mixing device also has a function of displaying a text telop on a video, for example, and the VJ operates an input device to input a text, and outputs a text message on the spot. It can also be presented to customers. In this way, the atmosphere of the place / space is created by the VJ.
[0003]
[Problems to be solved by the invention]
However, in the prior art, only a user (VJ) can create a video by operating a material, and cannot be operated by a large number of people. In other words, the customers of the club or the like who share the place are the viewers with respect to the video work by the VJ, and can only enjoy watching. If you can participate in this video production, customers will have more fun.
[0004]
SUMMARY OF THE INVENTION It is, therefore, a primary object of the present invention to provide a video mixing apparatus and method that allows a viewer to participate in creating a video work.
[0005]
[Means for Solving the Problems]
A first invention is a video mixing apparatus for creating a video work by synthesizing a plurality of materials, a message storage means for storing a message received through a network, and a use of a message which affects the video work based on the message. A video mixing device comprising means.
[0006]
A second invention is a video mixing method for creating a video work by combining a plurality of materials, comprising a step of storing a message received through a network, and a step of affecting the video work based on the message. This is a video mixing method.
[0007]
[Action]
For example, a message received through a network such as the Internet is stored by a message storage unit. The message specifically includes an image, a video, a text (character), and the like, and is transmitted from, for example, a mobile communication terminal of a large number of customers who appreciate the video work by e-mail or writing on an accessed Web page. Then, when a message is selected by a user such as a VJ, the created video work is influenced by the message using means based on the message. For example, a message is used as a material and presented in a video work. In this case, the customer can see his message directly in the video work. The message is used as a parameter when creating a video work. In the video work created in this way, the creativity and expression of the customer are reflected by the message.
[0008]
Further, when the message is a tagged message including tag information, the message is used after being subjected to processing according to the tag information. In this case, the influence of the customer appears more strongly on the video work.
[0009]
【The invention's effect】
According to the present invention, a customer can participate in creation of a video work by transmitting a message. That is, a customer who was only a viewer in the past can be a participant in video creation, and therefore can enjoy the space and atmosphere more. In this way, deeper and more intimate communication can be realized between the customer sharing the space and the VJ, event organizer, or the like. For example, if the message is text, communication between customers can be expected to be created through the text telop presented on the work.
[0010]
The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.
[0011]
【Example】
With reference to FIG. 1, a video mixing apparatus 10 of this embodiment is to create a video work by synthesizing a plurality of materials (image, video, text, etc.). The video work is influenced based on messages received over a network 12, such as the Internet, an intranet, a public telephone network or a cellular telephone network. For example, the video mixing device 10 can use a message as a material. That is, the message can be presented on the video. Also, for example, a message can be used as a parameter when creating a video. The message is transmitted from each mobile communication terminal 16 by a plurality of viewers or customers 14 who appreciate this video work.
[0012]
The video mixing device 10 is a computer such as a PC that can be connected to the network 12. The video mixing apparatus 10 includes a CPU (not shown), which includes, for example, a memory via a bus, a storage device such as a built-in or separately prepared hard disk, and a display device such as an LCD or a CRT. , A pointing device such as a mouse, and an input device such as a keyboard. The storage device stores a main program for realizing the video mixing method and functions, and the CPU executes processing according to the program.
[0013]
A server 18 is connected to the video mixing device 10 via a network 12 or the like. The server 18 is a computer such as a PC, for example, like the video mixing device 10, and includes a CPU (not shown) and an internal or external storage device. The server 18 is connected to the network 12 via, for example, a dial-up router. The server 18 of this embodiment functions as a mail server, and can receive an electronic mail transmitted from the portable communication terminal 16 of the customer 14. Further, the server 18 functions as a WWW server, and includes, as contents, a Web page to which the customer 14 can access the portable communication terminal 16 to write and transmit a message. In FIG. 1, the server 18 is configured as a single computer. However, for example, the mail server and the WWW server may be configured separately.
[0014]
The mobile communication terminal 16 is, for example, a mobile phone, a PDA, a mobile PC, or the like, and includes a CPU, a memory, an operation panel, a display device, and the like (not shown). The mobile communication terminal 16 can be connected to the network 12 and can send an e-mail or browse the Web.
[0015]
A video work created by operating the VJ (user) 20 in the video mixing device 10 is provided to an exhibition device 22 installed in a venue such as a club or an event hall, for example, displayed and mixed by the DJ 24, for example. Create the atmosphere of the place with the music that is played. The user 20 operates the input device of the device 10 while viewing the information on the material displayed on the display device of the video mixing device 10 to create a video work by operating the material. The materials that can be used at the time of creation are obtained in real time from images and videos prepared by the VJ 20 in advance and stored in the storage device of the video mixing device 10, cameras and the like (not shown) connected to the video mixing device 10. And the like, as well as messages transmitted from the communication portable terminal 16 of the customer 14.
[0016]
The display device 22 is a device on which a video work is displayed so as to be viewed by the customer 14, and is, for example, a display device such as an LCD or a CRT. The display device 22 is provided with display video data signals of a type corresponding to the type of the display device 22 from the video mixing device 10, and displays a display screen as shown in FIG. 1, for example. The display device 22 may be, for example, a projection screen (screen). In this case, for example, display video data is given to a projector or the like and projected on a screen.
[0017]
On the exhibition screen of FIG. 1, a work area 26 in which the generated video work is displayed is provided. Further, guidance information for the customer 14 is displayed in the guidance information area 28. As the guidance information, for example, "Access the following homepage on the customer's mobile terminal, select the message and motion to be displayed, and press the send button. URL http: //www.****.com/" Displays a description of the message transmission method including the URL of the Web page for message writing transmission. Also, an e-mail address that accepts e-mail messages is displayed, such as "E-mail: e-mail: vj@****.com". Further, a motion area 30 is provided in which a pattern of a motion to be taken by the transmitted text message is displayed. FIG. 1 shows five motions AE when the text message is “TALK”. Guidance information such as a designated e-mail address and a designated URL or motion may be given to the customer 14 in advance by another means (flyer, e-mail, etc.), but when displayed on the exhibition screen as shown in FIG. Not only can the customer 14 who appreciates the video work be encouraged to participate, but also the customer 14 can easily participate. When the guide information area 28 is not provided in the display screen, the designated URL, the mail address, and the like may be presented as a text telop in the video work by operating the VJ 20.
[0018]
The customer 14 can send a message to the VJ 20 (video mixing device 10) by sending an e-mail to a designated mail address, or by accessing a designated URL and writing and sending a message. The message includes text, images and videos. The text message is a character string written in a mail text or an input field of a Web page. The image and the video message include image and video data prepared in advance in the mobile communication terminal 16 or captured by the mobile communication terminal 16, for example, attaching a file to an e-mail or displaying a file on an input screen of a Web page. By inputting and transmitting the name, it is sent to the video mixing device 10.
[0019]
When the customer 14 operates the operation panel of the mobile communication terminal 16 to access the designated URL, the display device of the mobile communication terminal 16 displays, for example, a menu screen of a Web page as shown in FIG. In FIG. 2, three menu items of "text message", "image message" and "video message" are displayed. Subsequently, when “text message” is selected by operating the operation panel, for example, an input screen as shown in FIG. 3 is displayed. In FIG. 3, a message input field, a radio button for selecting a motion, and a send button are provided. When the customer 14 operates the operation panel to input text in the message input field, input a motion and select the send button, the input text and the selected motion are transmitted as a text message. When "image message" or "video message" is selected in FIG. 2, a similar input screen is displayed, and the customer 14 inputs the file name of the image data or video data in the input field, and clicks the send button. By selecting, the message is sent.
[0020]
The message transmitted by the customer 14 is provided to the server 18 through the wireless base station 32 and the network 12. When receiving the message, the server 18 determines the type of the message, for example, and stores the message in a predetermined area of the storage device of the server 18 for each type. The message is recorded in a log file format, for example. The written and transmitted text message is stored with the selected motion. A message to which tag information such as a command or an instruction for a message processing method such as a motion is added is called a tagged message. Also, when received by e-mail, the e-mail body is extracted and made into a text message. If there is an attached file in the mail, the attached file is extracted and made into an image or video message according to the type.
[0021]
The video mixing device 10 has a video mixing function of synthesizing a plurality of materials. The VJ 20 can select a material to be used in a video work from available materials. The material selected by the VJ 20 is subjected to operations such as processing, deformation or editing by various mixing means, and is synthesized into one video work. For example, the VJ 20 selects a mixing unit to be used in real time when creating a video. The order of the mixing means to be used and the like may be determined in advance, and the video may be automatically synthesized according to this programming.
[0022]
In the video mixing apparatus 10, various mixing means can be defined, and their parameters can be set. The mixing means includes, for example, various effects, superimposition, chroma key synthesis, and the like. As the various effects, for example, those that provide various video effects such as division, enlargement, blurring, blurring, inversion, sepia color, noise, and trimming can be provided. The superimposition is to superimpose another text, image, video, etc. on one image, video, etc., and the chroma key composition is to remove a portion of a predetermined color and to place another image, video, etc. on that portion. It is something to stick. In the video mixing device 10, the VJ 20 can input text and present it as a text telop on a video. Further, as another mixing means, for example, a means for superimposing another picture or the like in a transparent state on one picture or the like, a means for switching images and pictures while giving a movement such as movement or rotation, or a telop is displayed. (Motion) that gives a predetermined motion to text or the like can also be set.
[0023]
For example, when giving a motion, the coordinates at which the text is displayed can be recorded and set in advance. In addition, the design of the size, font, color, etc. of the text / telop can be set. When a motion is applied, for example, the motion of an operation of an input device (such as a mouse) on the spot of the VJ 20 may be recorded and the motion may be applied to the material.
[0024]
Further, the video mixing device 10 has a switch function for switching between a VJ priority mode in which the operation of the VJ 20 is prioritized and a tag priority mode in which the method based on the tag information is prioritized. For example, a priority mode changeover switch is provided on a GUI (not shown), and the VJ 20 can operate the input device to operate the input device to freely switch the priority mode to create an image. In the case of the VJ priority mode, even when a message with a tag is selected, presentation is not performed according to the tag information, and the message is used in accordance with the operation of the VJ 20. In this case, the creativity and expression by the VJ 20 appear strongly in the video. On the other hand, in the case of the tag priority mode, the received message with a tag can be presented by performing processing according to the method of designating the tag information. In this case, since the presentation according to the tag information designated by the customer 14 is performed, the creativity and expression of the customer 14 will be strongly reflected in the video, and the customer 14 will be able to enjoy more.
[0025]
The video mixing device 10 can receive the message transmitted by the customer 14 and use the message when creating a video. That is, the video mixing device 10 receives a message from the server 18 when creating a video. After establishing a connection to the server 18, the video mixing apparatus 10 executes a message acquisition process. For example, when the VJ 20 operates an input device of the video mixing apparatus 10, the video mixing apparatus 10 transmits a message transmission request signal to the server 18. Further, for example, the video mixing device 10 may transmit a message transmission request signal to the server 18 every time a predetermined time elapses. When the server 18 receives the message transmission request signal from the video mixing device 10, the server 18 extracts the message received from the storage device after responding to the previous transmission request to the current request, and transmits the message to the video mixing device 10. .
[0026]
Upon receiving the message from the server 18, the video mixing device 10 stores the message in a predetermined area of the storage device. The video mixing device 10 determines the type of the stored received message, and additionally displays the received message on a console screen for a text message, an image message, or a video message for each type. For example, as shown in FIG. 4, when the message is a text message, the text message is displayed on the text message console screen. FIG. 4 shows, for each message, the message number, the text, and the selected motion. The VJ 20 can select a message to be taken into a video work from these console screens.
[0027]
When a message is selected by the VJ 20, the video mixing device 10 executes a message use process. In this embodiment, messages are used as parameters and materials. That is, when a message displayed on the console screen is selected by operating the VJ 20, the video mixing device 10 sets parameters from the message. For example, if the message is a text message, parameters for video synthesis, control parameters for video real-time effects, and the like are set based on data such as the number of characters. As an example, the size and font of the telop may be set, the message may be converted into, for example, an ASCII code, and the numerical value may be used as a text color parameter.
[0028]
The video mixing device 10 determines whether the mode is the VJ operation priority mode or the tag priority mode. In the VJ priority mode, the operation of the mixing means is performed on the message according to the operation and the parameters of the VJ, and the message is presented on the video as a material. On the other hand, in the tag priority mode, if the message is a tagged message, the mixing means is operated on the message in accordance with the method and parameters specified by the tag information, and the message is presented on the video as a material. If the message is not a tagged message, the same processing as in the VJ operation priority mode is performed on the message.
[0029]
In this embodiment, the tag information indicates a motion. However, various tag information may be specified. In another embodiment, for example, font, color, size, etc. may be specified as tag information.
[0030]
Then, the generated video is displayed in real time on a preview screen as shown in FIG. 5, for example. This preview screen is displayed on the display device of the video mixing apparatus 10, and the VJ 20 can check the content of the created video on this screen. Further, the video mixing device 10 outputs a display video data signal to display the created video on the display device 22. The display device 22 receives the display video data and displays a video work. For example, in the preview screen of FIG. 5, an image in which a human image is subjected to effects such as division and inversion and a text message in FIG. 4 is selected and presented as a material are displayed. As shown, the same image is displayed in the work area 26 of the display device 22.
[0031]
As described above, the message transmitted by the customer 14 when the video work is created by the VJ 20 is used, and the video work affected by the message is displayed. In the created video work, the message reflects the creativity and expression of the customer. That is, the customer 14 can be a participant in video creation. If the message is used as a material, the customer 14 can directly see his message in the video work.
[0032]
When receiving a message by e-mail, the CPU of the server 18 executes e-mail reception processing in accordance with a flowchart as shown in FIG. The server 18 first determines in step S1 whether a mail has arrived. If "YES", the process proceeds to step S3, in which the body of the mail is extracted and stored as a text message in a predetermined area of the storage device. In a succeeding step S5, it is determined whether or not there is an attached file in the mail, and if "NO", the reception processing is ended. On the other hand, if "YES" in the step S5, the mail includes an image or a video message. Therefore, in a step S7, if the attached file is an image file, the mail is an image message. For example, the video message is stored in a predetermined area of the storage device as a video message, and the reception process ends.
[0033]
Further, when receiving a message by writing a Web page, the CPU of the server 18 executes a writing / receiving process according to a flowchart as shown in FIG. 7. When accessed from the mobile communication terminal 16, the server 18 transmits a menu screen as shown in FIG. 2 to the mobile communication terminal 16 in step S9. In response, a menu screen is displayed on the display device of portable communication terminal 16. When any of “text message”, “image message”, or “video message” is selected from the menu item by the operation of the customer 14, an input screen request for the selected menu is transmitted to the server 18. Upon receiving the input screen request, the server 18 transmits an input screen (FIG. 3 and the like) corresponding to the selection to the mobile communication terminal 16 in step S11. In response to this, an input screen is displayed on the display device of the mobile communication terminal 16, a message is input in the input field by the operation of the customer 14, a motion is selected as necessary, and the send button is selected. Then, a write message is transmitted to the server 18.
[0034]
Upon receiving the write message, the server 18 stores the write message in a predetermined area of the storage device. Then, in subsequent steps S13, S15 and S17, it is determined whether the received message is a text message, an image message or a video message, and thereafter, a process corresponding to the type of the message is executed. If the received message is a text message, "YES" is determined in the step S13, a motion is associated with the text message and stored as a tagged message in a predetermined area of the storage device in a step S19, and the writing / receiving process is completed. I do. On the other hand, if the received message is an image message, "YES" is determined in the step S15, the image message is stored in a predetermined area of the storage device in a step S21, and the writing / receiving process is ended. On the other hand, if the received message is a video message, "YES" is determined in the step S17, the video message is stored in a predetermined area of the storage device in a step S23, and the writing / receiving process is ended.
[0035]
The CPU of the video mixing device 10 executes a message acquisition process according to a flowchart as shown in FIG. When the VJ 20 operates the input device or the like, the video mixing device 10 first transmits a message transmission request signal to the server 18 in step S25. In response to this, the server 18 takes out the message received and stored from the storage device to the video mixing device 10 after responding to the previous transmission request and before this request.
[0036]
Upon receiving the message from the server 18, the video mixing device 10 stores the received message in a predetermined area of the storage device in step S27. Then, in subsequent steps S29, S31 and S33, it is determined whether the received message is a text message, an image message, or a video message, and thereafter, a process corresponding to the type of the message is executed. If the received message is a text message, "YES" is determined in the step S29, and the message is displayed on a text message console as shown in FIG. 4 in a step S35.
[0037]
On the other hand, if the received message is an image message, "YES" is determined in the step S31, and the message is displayed on the image message console in a step S37. On the other hand, if the received message is a video message, "YES" is determined in the step S33, and the message is displayed on the video message console in a step S39. As for the display of the image and the video message, the image and the video may be displayed as they are on the respective consoles, but may be displayed by another method. For example, the file name and size may be displayed so that the content can be confirmed on a separate screen when the file is selected, or a thumbnail image (still image of the video) is created from the message data. This may be displayed. In this way, the message is displayed on each console screen. The VJ 20 can select a material to be used as a material or a parameter from the displayed message.
[0038]
When a message is used, the CPU of the video mixing device 10 executes a message use process according to a flowchart as shown in FIG. First, it is determined in step S41 whether a message has been selected. If "YES", the flow advances to the subsequent step S43. In step S43, a process for setting parameters from the message is executed. For example, as described above, parameters for synthesis and effect parameters are set based on data such as the number of characters of text. Subsequently, in a step S45, it is determined whether or not the mode is the VJ operation priority mode. If "YES" in the step S45, a mixing process according to the operation of the VJ and the set parameters is executed in a step S47. Specifically, the operation of the mixing means is performed on the message in accordance with the operation and the parameters of the VJ 20, and the message is used as the material to generate video data presented on the video.
[0039]
On the other hand, if “NO” in the step S45, that is, if the mode is the tag priority mode, the process proceeds to a step S49 to determine whether or not the message is a message with a tag. If “NO” in the step S49, that is, if the tag information is not added to the message, the process proceeds to a step S47 to execute the mixing process according to the operation and the parameters of the VJ. On the other hand, if “YES” in the step S49, a mixing process according to the tag information and the parameter is executed in a step S51. Specifically, the operation of the mixing means is performed on the message in accordance with the method and the parameter specified by the tag information, and the message is used as a material to generate video data presented on the video.
[0040]
Subsequently, the image generated in the processing of step S47 or S51 is displayed on the preview screen as shown in FIG. 5 in step S53, and the display image data signal for the display device 22 is output in step S55. I do. That is, the mixed video is output to the preview screen and the display device 22 in real time. Therefore, the VJ 20 can check the video on the preview screen displayed on the display device of the video mixing device 10 while performing the mixing operation, while the customer 14 watches the video work displayed on the exhibition device 22. be able to.
[0041]
According to this embodiment, the customer 14 can participate in the creation of the video work. In other words, the customer 14 who was only a viewer in the past can be a participant in video creation, and therefore can enjoy the space and atmosphere more. In this manner, deeper and more intimate communication can be realized between the customer 14 who shares the space with the VJ 20 or the event organizer. In addition, communication between the customers 14 can be expected through the text and telop presented on the work.
[0042]
In the above-described embodiment, the message is used in both the form of the material and the parameter. However, the message may be used in only one of the forms.
[0043]
In the video mixing apparatus 10 of another embodiment, the video may be further influenced based on the music information. For example, a microphone or a playback device for the DJ 24 is connected to the video mixing device 10 to input music provided by the DJ 24 or the like. Then, the music information (volume change, energy transition on frequency, etc.) is analyzed in real time, and based on the generated analysis data, the type and parameters of mixing means such as effects are switched. Specifically, for example, in steps S47 and S51 in the flowchart of FIG. 9, a mixing process based on the music information may be additionally performed. In this case, since the image is affected and changes based on the music information, the image and the music can be harmonized, and a better space and atmosphere can be created.
[0044]
Further, in each of the above embodiments, the video mixing device 10 is connected to the server 18 via the network 12, but both may be connected through a dedicated line. In addition, the video mixing device 10 and the server 18 are configured by different machines, but the video mixing device 10 may include the server 18.
[Brief description of the drawings]
FIG. 1 is an illustrative view showing one embodiment of the present invention;
FIG. 2 is an illustrative view showing one example of a menu screen displayed on the mobile communication terminal;
FIG. 3 is an illustrative view showing one example of an input screen displayed on the mobile communication terminal;
FIG. 4 is an illustrative view showing one example of a text message console screen;
FIG. 5 is an illustrative view showing one example of a preview screen;
FIG. 6 is a flowchart illustrating an example of a mail receiving process of the server.
FIG. 7 is a flowchart illustrating an example of a write / receive process of a server.
FIG. 8 is a flowchart showing an example of a message acquisition process of the video mixing device.
FIG. 9 is a flowchart showing an example of a message use process of the video mixing device.
[Explanation of symbols]
10 Video mixing equipment
12 Network
16… Communication mobile terminal
18… Server

Claims (5)

A video mixing device that combines a plurality of materials to create a video work,
A video mixing apparatus comprising: a message storage unit that stores a message received through a network; and a message use unit that influences the video work based on the message. The video mixing device according to claim 1, wherein the message using unit uses the message as the material. The video mixing device according to claim 1, wherein the message using unit uses the message as a parameter when the video work is created. 4. The video mixing apparatus according to claim 1, wherein the message includes a tagged message, and the message using unit processes the tagged message according to tag information. A video mixing method for creating a video work by combining a plurality of materials,
A video mixing method comprising: storing a message received over a network; and influencing the video work based on the message.

Images