JP6840485B2 - Video recording device, video distribution method and program - Google Patents

Description

The present invention relates to a moving image recording device, a moving image distribution method, and a program.

In recent years, in addition to playing games standalone, game devices installed in game centers and amusement facilities, personal computers and dedicated game machines used in the home, etc., play against opponents connected via a network. It is common to play games.

In addition, the game video (including the game sound) during the game executed by the player is stored, and the player can acquire the game video after the game is completed. For example, a player can copy game video data from a game device installed in an amusement facility to a recording medium such as a USB (Universal Serial Bus) memory and take it home. The player can view the game video at home or the like to check the input operation during the game and consider measures for the next game.

Japanese Unexamined Patent Publication No. 2001-170360

However, in the prior art, only the game video is stored as it is so that the game video that was viewed during the game execution can be viewed after the game is completed.

The present invention has been made in consideration of the above-mentioned circumstances, and an object of the present invention is to provide a moving image recording device, a moving image distribution method, and a program that enable more effective use of game images.

In order to solve the above problems, the moving image recording device of the present invention has a game processing means for executing a game while displaying a game image, and a first method according to the game image data of the game image and the execution state of the game. Based on the first video data recording means for recording control data , the video means for inputting video data, the second video data recording means for recording the video data in association with the game video data, and the video data. The control data generation means for generating the second control data according to the change in the image and the first control data are recorded in association with the game image data based on the occurrence time of the execution status, and the second control data is recorded. A control data recording means that records control data in association with the game video data based on the time when the change in the video occurs , the game video data, the video data, the first control data , and the second. It has a generation means for generating first play moving image data including control data.

According to the present invention, it is possible to provide a moving image recording device and a moving image distribution method that enable more effective use of game moving images.

The block diagram which shows the structure of the moving image distribution system in this embodiment. The block diagram which shows an example of the structure of the store system in this embodiment. The block diagram which shows an example of the structure of the store server in this embodiment. The block diagram which shows the structure of the game apparatus in this embodiment. The block diagram which shows the structure of the game apparatus and the moving image output apparatus in this embodiment. The figure which shows the frame pattern setting data prepared for the image processing (image processing program) in this embodiment. The figure which shows an example of the frame pattern (video reproduction frame) in this embodiment. The figure which shows an example of the data format of the play moving image data in this embodiment. The figure which shows an example of the execution state (event) of various games shown by the control data in this embodiment. The figure which shows an example of the other data format of the 1st play moving image data format in this embodiment. The figure which shows an example of the 2nd play video data format which is the data format which edited the video data of a plurality of video in this embodiment into one video data. The block diagram which shows the structure of the play video mediation server in this embodiment. The figure which conceptually shows the storage format of the play video data of the play video mediation server in this embodiment. The figure which conceptually shows the data format of the distribution setting data of the play video intermediary server in this embodiment. The block diagram which shows the structure of the studio system in this embodiment. The flowchart which shows the operation of the game apparatus in this embodiment. The flowchart for demonstrating the operation of the play moving image setting process in this embodiment. The flowchart which shows an example of the distribution by the data center (the first distribution method, the second distribution method) in this embodiment. The flowchart which shows an example of the distribution of the play video data by the 3rd distribution method by the play video mediation server in this embodiment. The flowchart which shows an example of the moving image play processing in this embodiment. The figure for demonstrating the moving image reproduction processing in this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a moving image distribution system according to the present embodiment. The video distribution system shown in FIG. 1 is a system capable of more effectively using a play video showing a state of a game executed by a game device in a store system 10 provided in a game center or an amusement facility. .. The video distribution system includes a plurality of store systems 10 (10-1, 10-2, ..., 10-n) existing nationwide, a data center 12, a studio system 14, a video distribution server 16, an electronic device 18, and the like. Each is connected to each other via a network 2 such as the Internet. The store system 10 includes at least one game device.

In the video distribution system of the present embodiment, the play video includes the game video displayed on the screen when the game is executed and the game sound output when the game is executed on the game device, as well as other images taken through the camera when the game is executed. Includes video and audio input through a microphone. Other images taken during game execution include, for example, images of the player playing the game during game operation (whole body, face, upper body, hands and feet operating the game, etc.), and are executed by the game device. Includes images of the surrounding audience watching the game, images of video (still image) files recorded separately from the execution of the game (for example, commercial images, production images, etc.). The sounds input when the game is executed include the sounds emitted by the player, the sounds around the game device (including the audience), the sounds emitted by people other than the player such as commentary on the game situation, and the execution of the game in advance. Includes sounds from separately recorded audio files (eg, sound effects, BGM (back ground music)) and the like.

Further, the video (game video, shot video) included in the play video includes control data used for display control of the play video. The control data is, for example, data indicating the execution status of various games, and is stored in association with the video data based on the occurrence time of the execution status of various games. The execution status of the game includes, for example, the start / end of the game, the occurrence of various events according to the input commands, and the determination of the outcome of the game and the success / failure of the event based on the game content. Furthermore, the game execution status includes the actions and sounds of the player playing the game, the actions and sounds of the spectators watching the game, and other things that occur with the execution of the game but are not directly related to the game content. including.

Further, the play video data (play video data) includes the first play video data format, which is a data format capable of individually processing the video data of a plurality of videos, and one video by editing the video data of the plurality of videos. There is a second play video data format of the data format converted into data. The control data included in the play video data can be displayed by editing the play video data in the first play video data format by video processing (video processing program) that displays / edits the video data, or the first play. It can be used when changing the play video data in the video data format to the second play video data format. For example, the video processing program automatically performs editing such as changing the video to be displayed on the screen, changing the frame pattern indicating the form of displaying the video on the screen, and adding an effect to the video according to the control data. To execute.

The store system 10 is provided in a game center or an amusement facility, and includes at least one game device. The store system 10 can store the play moving image data of the game executed in the game device and distribute or output it to the outside. In the distribution of play video data, as soon as the play video data is generated during the execution of the game, it is output to the outside. As the distribution destination of the play video data, there are a data center 12 (play video mediation server 12e), a studio system 14, a video distribution server 16, and the like. In the output of the play video data, when there is an output request for the stored play video data, it is output (copied) to the specified output destination. As the output destination of the play moving image data, a recording medium such as a USB memory or a portable electronic device can be targeted inside the store system 10.

The game device provided in the store system 10 stores, for example, game programs of a plurality of games distributed from the data center 12 (authentication / distribution server 12a), and executes any of the games selected by the operation of the player. Can be done. In addition, the game device can execute a competitive game with another game device in the same store or another game device provided in the other store system 10.

The data center 12 is a group of servers for managing the distribution of games and video data executed in a plurality of store systems 10. For example, an authentication / distribution server 12a, a ranking server 12b, a billing / storage server 12c, and a matching server 12d. , Play video mediation server 12e is included.

The authentication / distribution server 12a executes an authentication process for the identification data (card ID recorded on the card) presented by the player who uses the game device of the store system 10. Further, the authentication / distribution server 12a distributes a program, data, or the like for executing the game selected by the player to the game device in which the identification data (card ID) is presented.

The ranking server 12b aggregates the game results of the games executed in the game devices of all the store systems 10 and generates ranking data for each identification data (card ID) authenticated by the authentication / distribution server 12a. The ranking server 12b generates ranking data for each of a plurality of games that can be executed in the game device. The ranking server 12b can distribute ranking data to, for example, a game device or an electronic device (personal computer, smartphone, etc.) used by a player.

The billing / storage server 12c generates a bill when the game is executed in the game device of the store system 10, and records, for example, the billing amount for each store system 10.

The matching server 12d matches a player (identified by a card ID) in a battle waiting state when the game executed in the game device of the store system 10 is a battle game. For example, the matching server 12d has an in-store match that executes a match game between game devices of different store systems 10 and an in-store match that executes a match game between other game devices in the same store system 10. Perform matching according to each. In the case of a store-to-store match, the matching server 12d matches players by any of (a) rank matching, (b) friend matching, and (c) store matching, for example, according to a designation from the player. be able to.

(A) In rank matching, a player specifies a rank (or a numerical value such as a rank or a point) set based on a game result for each player (card ID), and the designated rank (dan or point) is specified. Etc.) Matches with other players waiting for a match. (B) In friend matching, matching is performed only with the opponent specified by the player. (C) Store matching matches with an opponent who is waiting for a match in a game device installed in a designated store (store system 10). The matching server 12d notifies the plurality of game devices used by the matched players as opponents of the execution of the battle game. The game device notified from the matching server 12d that the battle game is executed executes the game while transmitting and receiving data and the like necessary for executing the battle game to each other.

The play video mediation server 12e receives and records the play video data distributed from the store system 10, and distributes the play video data to the studio system 14, the video distribution server 16, the electronic device 18, and the like. The play video mediation server 12e is a first data format distribution method that directly distributes the play video data (first play video data format) received from the store system 10, and a plurality of play video data included in the play video data received from the store system 10. It is possible to execute a second data format distribution method in which the video data (or audio data) of the above is edited to generate and distribute the play video data (second play video data format) for distribution.

The studio system 14 is a system for generating video contents (broadcast programs) for Internet broadcasting and distributing them through the network 2. The studio system 14 distributes video content such as a live game executed on a game device based on play video data distributed from, for example, a store system 10 or a data center 12 (play video mediation server 12e). In particular, the studio system 14 edits game images displayed on a plurality of game devices, images of commentators and spectators in the studio, and the like when a competitive game is executed between a plurality of game devices. It is possible to generate video content that is combined with each other.

The video distribution server 16 is, for example, a server that opens a video sharing site (video posting site) on the Internet, records videos posted (uploaded) by the user, and responds to a request from the user to network 2 (Internet). Deliver videos via. The video distribution server 16 receives a post of play video data including a game video distributed from the data center 12 (play video mediation server 12e) or the store system 10 and distributes it in the same manner as other general videos. For example, the video distribution server 16 can store the posted play video data and distribute it in response to an access request through the network 2, or can distribute the posted play video data in real time.

The electronic device 18 is, for example, a device owned by a player who plays a game in the game device of the store system 10. The electronic device 18 is a device having a communication function, such as a personal computer (PC), a tablet PC, a smartphone, a mobile phone, or a game machine. In the electronic device 18, the moving image distributed from the studio system 14 and the moving image distribution server 16 can be received and viewed through the network 2.

FIG. 2 is a block diagram showing an example of the configuration of the store system 10 in the present embodiment.
As shown in FIG. 2, the store system 10 is connected to the network 2 through the router 20. A store server 24, a plurality of game devices 26 (26-1, 26-2, ..., 26-m), a moving image output device 28, and the like are connected to the router 20 through a hub 21. The store server 24, the plurality of game devices 26 (26-1, 26-2, ..., 26-m), and the moving image output device 28 are connected to each other via a network such as a LAN (Local Area Network).

The store server 24 has a function for managing a plurality of game devices 26 installed in the store. For example, the store server 24 sets or changes a function for storing (recording) / outputting / distributing game play video data executed in each of the plurality of game devices 26. Further, the store server 24 can execute storage (recording) / output / distribution of play moving image data including a game image of a game executed by, for example, the game device 26 instead of the game device 26. Further, the store server 24 has a function of copying (outputting) the stored play moving image data to a recording medium such as a USB memory owned by the player or a portable electronic device.

The game device 26 is a device that executes a game in response to an input operation of the player. The game device 26 stores, for example, game programs of a plurality of games distributed from the data center 12 (authentication / distribution server 12a), and executes any game selected by the operation of the player. In addition, the game device 26 is a stand-alone solo play by one player, an in-store battle play against a player of another game device 26 in the same store, and an inter-store battle play against a game device 26 of another store. You can run the game. Further, the game device 26 has a function of storing (recording) / outputting / distributing game play moving image data according to the setting by the store server 24. The game device 26 has a function of copying (outputting) the stored play moving image data to a recording medium such as a USB memory owned by the player or a portable electronic device.

The moving image output device 28 has a function of storing (recording) / outputting / distributing the play moving image data of the game executed in the game device 26 instead of the game device 26. The video output device 28 inputs various data for generating play video data from peripheral devices such as a game device 26, a camera, and a microphone, and stores (records) / outputs / distributes the play video data. Generate.

FIG. 3 is a block diagram showing an example of the configuration of the store server 24 in the present embodiment.
As shown in FIG. 3, the store server 24 includes a processor 24a, a memory 24b, a storage device 24c, a display unit 24d, an input unit 24e, a communication unit 24f, a media I / F 24g, and a card reader 24j.

The processor 24a executes various processes such as overall control of the store server 24, management of data stored in the storage device 24c, and control of the game device 26, based on the programs and data stored in the memory 24b.

The memory 24b stores various programs executed by the processor 24a, temporary data executed by various processes, and the like. The programs stored in the memory 24b include a basic program (OS (Operating System)), an authentication process for the card ID read by the card reader 24j, and a plurality of programs executed according to the operation of the store administrator. A setting processing program for setting processing related to recording / distribution / output of play video data in the game device 26 and the video output device 28, and processing (including video processing) related to recording / distribution / output of play video data in the store server 24. Contains a video processing program to run. In the setting process, for example, whether or not the play video data is stored (recorded), whether or not the play video data is delivered, where the play video data is delivered, whether or not the play video data is delivered in real time, and whether or not the play video data is output (storage medium). Recording / distribution / output of play video data such as presence / absence (copy to, etc.), data format of play video data to be recorded / distributed / output (first play video data format, second play video data format), etc. Record the setting data for control.

The storage device 24c stores various programs, data, and the like. In the storage device 24c, in addition to the play moving image data of the game executed by the game device 26, setting data indicating the setting contents by the setting process and the like are stored. The storage device 24c can also store a plurality of game programs distributed from the data center 12. When the play moving image data output from the plurality of game devices 26 is stored in the storage device 24c, it is stored in association with the card ID read from the card presented by the player. Further, not only the card ID but also other identification information for identifying the play moving image data may be stored in association with the card ID. The other identification information can be, for example, information generated by the game device 26 (for example, an alphanumeric string, a code image, etc.) each time the game is executed (every time the play moving image data is generated).

The display unit 24d displays a screen corresponding to the processing by the processor 24a on a display such as an LCD (Liquid Crystal Display).

The input unit 24e inputs data and instructions corresponding to various processes by the processor 24a through an input device such as a keyboard and a mouse.

The communication unit 24f controls communication via the network 2 under the control of the processor 24a.

The media I / F 24g is an interface for transmitting and receiving data to and from an external recording medium (USB memory or the like) or an electronic device. The media I / F 24g includes, for example, a connector for electrically connecting a recording medium or an electronic device, and a communication unit for controlling proximity wireless communication.

The card reader 24j reads the identification data (card ID) recorded on the card issued in advance to the player by, for example, proximity wireless communication.

FIG. 4 is a block diagram showing the configuration of the game device 26-1 according to the present embodiment. The game device 26-1 shows a configuration example in which the device main body is provided with a function of creating play moving image data.

As shown in FIG. 4, the game device 26-1 includes a processor 26-1a, a memory 26-1b, a storage device 26-1c, a display unit 26-1d, an input unit 26-1e, a communication unit 26-1f, and a media I. It has / F26-1g, input I / F26-1h, card reader 26-1j, camera 26c1,26c2,26c3, and microphone 26m1,26m2.

The processor 26-1a executes various processes such as overall control of the game device 26-1 based on the programs and data stored in the memory 26-1b. The processor 26-1a executes game processing based on the game program of the game selected by the operation of the player. Further, the processor 26-1a executes a process related to recording / distribution / output of play video data including a game video and a game sound generated by executing the game process based on the video processing program.

The memory 26-1b stores various programs executed by the processor 26-1a, temporary data executed by various processes, and the like. The program stored in the memory 26-1b is selected by operating the player, an authentication processing program that performs authentication processing for the card ID read by the card reader 26-1j, in addition to the basic program (OS (Operating System)). A game program that executes the game processing of the played game, a video processing program that executes processing (including video processing) related to recording / distribution / output of play video data accompanying the execution of the game processing, and the like are included.

The storage device 26-1c stores various programs, data, and the like. The storage device 26-1c stores programs corresponding to a plurality of different games (titles) distributed from the data center 12 (authentication / distribution server 12a), and the program of the game selected by the operation of the player can be stored. It is read into the memory 26-1b. Further, the storage device 26-1c stores setting data indicating the setting contents by the setting process by the store server 24, game play moving image data, and the like. The play moving image data is stored in association with the card ID (furthermore, other identification information issued for each game) read by the card reader 26-1j. Although the setting data is set by the setting process in the store server 24, it may be set by the setting process in each game device 26.

The display unit 26-1d displays a screen corresponding to the processing by the processor 26-1a on a display such as an LCD (Liquid Crystal Display).

The input unit 26-1e inputs data and instructions corresponding to various processes by the processor 26-1a through an input device such as a joystick, a button, a game-dedicated input device, and a touch panel.

The communication unit 26-1f controls communication via the network 2 under the control of the processor 26-1a.

The media I / F26-1g is an interface for transmitting and receiving data to and from an external recording medium (USB memory or the like) or an electronic device. The media I / F26-1g includes, for example, a connector for electrically connecting a recording medium or an electronic device, and a communication unit for controlling proximity wireless communication.

The input I / F26-1h is an interface for inputting data from an external device. The external device includes, for example, a plurality of cameras 26c1,26c2,26c3 and a plurality of microphones 26m1,26m2.

The card reader 26-1j reads the card ID recorded on the card issued in advance to the player by, for example, proximity wireless communication. By providing a card reader / writer (electronic money unit), it may be possible to send and receive data for settlement of play charges with a card used as electronic money.

The cameras 26c1, 26c2, 26c3 capture images. For example, the camera 26c1 is for inputting an image of a hand operating a player's input device, the camera 26c2 is for inputting an image of a figure including the player's face, and the camera 26c3 is for inputting an image of an audience. Used for.

The microphones 26m1, 26m2 input voice. For example, the microphone 26m1 is used to input the sound of the player, and the microphone 26m2 is used to input the sound around the game device 26-1 including the spectator.

FIG. 5 is a block diagram showing the configurations of the game device 26-2 and the moving image output device 28 in the present embodiment. The game device 26-2 does not have a function of recording play moving image data, and is configured as a dedicated game machine. When the recording / distribution / output of the play moving image is not required, the game device 26-2 is used independently without the moving image output device 28 being connected. A moving image output device 28 is connected when recording / distribution / output of a play moving image is required.

As shown in FIG. 5, the game device 26-2 includes a processor 26-2a, a memory 26-2b, a storage device 26-2c, a display unit 26-2d, an input unit 26-2e, a communication unit 26-2f, and an input I. It has / F26-2h and a card reader 26-2j. The portion having the same name as the game device 26-1 shown in FIG. 4 is assumed to have the same function as the game device 26-1, and detailed description thereof will be omitted.

Since the game device 26-2 does not execute the process related to the recording / distribution / output of the play moving image data, the program for this process is not stored. Further, in order to record / distribute / output the play video data in the video output device 28, the game device 26-2 displays the card ID read by the card reader 26-2j and the display unit 26-2d as the game is executed. The video data of the game video to be played and the audio data at the time of executing the game are output to the moving image output device 28. Further, the processor 26-2a outputs data indicating the execution status of the game to the moving image output device 28 as the game program is executed. The data indicating the execution status of the game includes, for example, data indicating the start / end of the game, the occurrence of various events according to the input command, the outcome of the game, the success / failure of the event, and the like.

As shown in FIG. 5, the moving image output device 28 includes a processor 28a, a memory 28b, a storage device 28c, a communication unit 28f, an input I / F 28h, and a media I / F 28g.

Based on the program and data stored in the memory 28b, the processor 28a controls the entire video output device 28, processes related to recording / distribution / output of play video data accompanying the execution of game processing, and stores the video output device 28c in the storage device 28c. Execute various processes such as management of data to be performed.

The memory 28b stores various programs executed by the processor 28a, temporary data executed by various processes, and the like. In addition to the basic program (OS (Operating System)), the program stored in the memory 28b includes processing (including video processing) related to recording / distribution / output of play video data accompanying execution of game processing in the game device 26-2. ) Is included in the video processing program.

The storage device 28c stores various programs, data, and the like. In the storage device 28c, in addition to the play moving image data of the game executed by the game device 26-2, setting data indicating the setting contents by the setting process by the store server 24 and the like are stored. The play moving image data is stored in association with the card ID (further, other identification information) read by the card reader 26-2j of the game device 26-2.

The communication unit 28f controls communication via the network 2 under the control of the processor 28a.

The input I / F 28h is connected to a camera 29c1, 29c2, 29c3 for inputting an image used for creating a play moving image, and a microphone 29m1,29m2 for inputting audio. FIG. 5 shows an example in which three cameras 29c1, 29c2, 29c3 and two microphones 29m1,29m2 are connected to the input I / F28h, but any number of cameras and microphones can be connected to each. it can.

The media I / F 28g is an interface for transmitting and receiving data to and from an external recording medium (USB memory or the like) or an electronic device. The media I / F 28g includes, for example, a connector for electrically connecting a recording medium or an electronic device, and a communication unit for controlling proximity wireless communication.

The moving image output device 28 can be connected to a game device 26-2 that does not have a function of recording play moving image data to execute recording / distribution / output of playing moving images. For example, the moving image output device 28 is used by connecting to the game device 26-2 when it is necessary to record / distribute a play moving image of a competitive game executed on a specific game device 26-2. Although one moving image output device 28 is shown in FIG. 2, any number of moving image output devices 28 can be installed as needed.

In the store system 10, play video data can be distributed / output from the store server 24, the game device 26, or the video output device 28, and each can be distributed / output from any one or a plurality of them. Can be operated. Further, in each of the store server 24, the game device 26, and the video output device 28, the play video data (first play video data format) is delivered as it is, the first data format distribution method, and the play video data in the first play video data format. A second data format distribution method can be used in which a plurality of video data (or audio data) included in the data are edited to generate play video data (second play video data format) for distribution and distributed. Whether to use the first data format distribution method or the second data format distribution method (at least one of them) may be set in advance in each device, and may be set in advance for the operation of the manager or player of the store system 10. It may be set accordingly.

Next, a mode for displaying the play moving image distributed / output in the moving image distribution system in the present embodiment will be described. In the video processing (video processing program), based on the play video data in the first play video data format, the video is displayed according to the frame pattern indicating the form in which the video is displayed on the screen. Further, in the video processing (video processing program), the play video data in the first play video data format can be edited (converted) into the second play video data format for displaying the screen according to the frame pattern.

FIG. 6 shows the frame pattern setting data prepared for the video processing (video processing program) in the present embodiment. As shown in FIG. 6, in the frame pattern setting data, different frame patterns 1, 2, ..., X are set in association with a plurality of frame numbers (numbers).

FIG. 7 shows an example of a frame pattern (moving image reproduction frame) in the present embodiment.
FIG. 7A shows an example of a frame pattern in which one screen is evenly divided into four and four images (1, 2, 3, 4) are displayed. Since the frame pattern shown in FIG. 7A divides the screen into four evenly, for example, when displaying a play moving image at 4K resolution, each of the four images can be displayed at 2K resolution (high definition). The frame pattern shown in FIG. 7B shows an example in which one image area is enlarged and a plurality of (for example, six) image areas are reduced. In FIG. 7B, by increasing the number of areas, for example, even if the game image output from the game device 26 and the three images taken by the camera are always displayed, the other two images (for example, , Commercial video, production video, studio composite video, etc.) can be displayed at the same time. In the frame pattern shown in FIG. 7B, a main image (for example, a game image) can be enlarged and displayed, and other images (for example, an image of a player or an audience) can be reduced and displayed. The frame pattern shown in FIG. 7C shows an example in which only one image is selected and displayed. The frame pattern shown in FIG. 7D includes an enlarged area and two reduced areas for displaying an image, as well as images and texts other than the image (for example, commercial images, explanatory texts, etc.). An example in which an area to be displayed is provided is shown.

The frame patterns shown in FIGS. 7 (a) to 7 (d) are examples, and patterns of other forms can be used. Further, the video displayed in each area of the frame pattern is not fixed, and can be switched according to, for example, the control data added to the video data. Further, while displaying one play moving image, it is possible to switch the frame pattern according to, for example, control data, or to dynamically deform the size and shape of a specific area in the frame pattern.

FIG. 8 is a diagram showing an example of the data format of the play moving image data in the present embodiment. FIG. 8 shows an example of the first play moving image data format, which is a data format capable of individually processing a plurality of video data.

For example, the game device 26 generates a game video (video data 1) and a game sound (audio data 1) as the game is executed. Further, the game device 26 may include, for example, an image (video data 2) of the hand operating the player's input device by the camera 26c1, an image (video data 3) of the image including the player's face by the camera 26c2, and a camera. A video (video data 4) of the audience captured by 26c3 is input. Further, the game device 26 inputs the player's voice through the microphone 26m1, inputs the surrounding sound of the game device 26-1 including the spectator through the microphone 26m2, and mixes them to generate the voice data 2. The audio data input from each of the microphones 26m1 and 26m2 may be independent data without mixing.

Further, the game device 26 generates control data indicating the execution status (event) of various games. The control data includes data indicating, for example, the occurrence time of the execution status of various games, the video to be associated with, and the execution status (event, etc.) of the game for one event.

FIG. 9 is a diagram showing an example of execution status (event) of various games indicated by the control data in the present embodiment.

For example, as an event before the start of the game, the card readers 26-1j and 26-2j read the card ID. When the video (video data 3) taken by the player before the start of the game is input by the camera 26c2, the control data corresponding to the event of reading the card ID is generated in association with the video data 3.

In addition, as events that occur while the game is being executed on the game device 26, for example, game start / end, occurrence of various events according to input commands (1, 2, ...), game win / loss, and event success / failure. and so on. When the above-mentioned event occurs, the game program outputs data indicating the event that has occurred. Control data is generated according to each of the events that occur with the execution of this game, and is associated with the game video (video data 1) generated with the execution of the game.

Further, it is also possible to detect a predetermined operation of the player based on the video data from the cameras 26c1 and 26c2 that shoot the player, and to generate an event. For example, using the existing image recognition processing based on the image (video data 3) of the image including the player's face taken by the camera 26c2, predetermined movements (arms raised, head moved greatly, smile, etc.) Detects a specific facial expression, etc.). When a predetermined operation is detected, control data associated with the video data 3 is generated. When an event is detected based on the video (video data 2) captured by the camera 26c1, control data associated with the video data 2 is generated in the same manner.

Further, it is also possible to detect the generation of a predetermined sound based on the voice data from the microphone 26m1 for inputting the voice of the player and set it as the occurrence of an event. For example, when a sound having a volume equal to or higher than a predetermined set value is input (for example, a player shouts), it is detected that a predetermined word is uttered by a voice recognition process for the input voice. When the generation of a predetermined sound is detected, control data associated with the voice data is generated.

Similarly, the occurrence of an event is detected based on the video data from the camera 26c3 that captures the audience or the audio data from the microphone 26m2 that inputs the sound around the game device 26-1 including the audience. Control data corresponding to each can be generated.

In this way, the execution status of the game includes the movements and sounds of the player playing the game, the movements and voices of the spectators watching the game, and other things that occur with the execution of the game but are not directly related to the content of the game. , And control data corresponding to each occurrence can be generated and stored in association with video data or audio data.

In the above description, the case where the game device 26 generates the play moving image data is described, but the moving image output device 28 also similarly generates a plurality of video data 1 to 4, audio data 1 to 2, and control data. Play video data can be generated based on this.

The video output device 28 inputs video data 1 and audio data 1 associated with the execution of game processing in the game device 26-2 from the game device 26-2, and inputs video data 2 to 4 from the cameras 29c1, 29c2, 29c3. Then, audio data is input from the microphones 29m1 and 29m2, respectively. Then, as described above, the moving image output device 28 detects the occurrence of an event based on the input video data and audio data, and generates control data according to the occurrence of each event. Further, the moving image output device 28 can receive the card ID read by the card reader 26-2j from the game device 26-2 and detect the event of reading the card ID.

FIG. 10 is a diagram showing an example of another data format of the first play moving image data format in the present embodiment. In the first play moving image data format shown in FIG. 8, control data is generated separately from the video data and the audio data, but in the data format shown in FIG. 10, the control data is included in the video data.

For example, the game video (video data 1) generated by the game device 26 is controlled together with the video data generated at the timing when the event occurs according to the event that occurs while the game is executed as described above. Store data. For example, the control data can be stored as extended data in the data format of the video data. Since the extended data is associated with the video data generated in time series, there is no need for data indicating the video to be associated with the time, such as the control data shown in FIG. 8 (g). That is, only the data indicating the game execution status (event, etc.) needs to be stored. Similarly, when an event corresponding to each of the video data 2 to 4 input by the cameras 26c1 to 26c3 occurs, the control data is stored together with the video data input at that timing.

As described above, since the first play video data format is a data format capable of individually processing a plurality of video data, for example, in the studio system 14, a plurality of video data are individually processed and edited by appropriately combining them. Can be displayed. At this time, in the video processing (video processing program), the frame pattern and the like are automatically switched based on the video data and the control data associated with the event occurrence time, regardless of the editing operation by human operation. You can edit video such as. For example, it is possible to switch the image to be displayed and change the shape and size of the area for displaying the image.

FIG. 11 shows an example of the second play moving image data format, which is a data format obtained by editing the video data of a plurality of moving images in the present embodiment into one video data. The second play moving image data format is used, for example, when a video edited by combining a plurality of video data is distributed / output as it is.

The video data shown in FIG. 11A is obtained by editing the video data 1 generated by the game device 26 shown in FIG. 8A and the video data 2 to 4 input from the cameras 1 to 3 by video processing. This is the video data created by The voice data shown in FIG. 11B is a mixture of the voice data 1 shown in FIG. 8B and the voice data 2 shown in FIG. 8F. The control data shown in FIG. 11C is generated according to the execution status (event) of various games detected based on the video data 1 to 4 and the audio data 1 to 3. The control data includes data indicating the occurrence time of various game execution statuses and the game execution status (events, etc.) for one event.

The video data in the second play video data format is associated with the video data based on the event occurrence time by the video processing (video processing program) as in the case of editing the first play video data format described above. It can be generated by video editing such as automatically switching frame patterns based on control data.

Next, the play moving image mediation server 12e in the present embodiment will be described.
FIG. 12 is a block diagram showing the configuration of the play video mediation server 12e in the present embodiment. As shown in FIG. 12, the play video mediation server 12e includes a processor 30a, a memory 30b, a storage device 30c, and a communication unit 30f.

Based on the programs and data stored in the memory 30b, the processor 30a controls the entire play video mediation server 12e, receives the play video data transmitted from the store system 10, and stores the play video in the storage device 30c. It executes various processes such as data management, video processing for editing video of play video data, and control of transmission (distribution) of play video data.

The memory 30b stores various programs executed by the processor 30a, temporary data executed by various processes, and the like. In addition to the basic program (OS (Operating System)), the programs stored in the memory 30b include a video storage / distribution processing program that executes video storage / distribution processing for transmitting and receiving play video data, and video about play video data. Includes a video processing program that executes video processing for editing. In the video storage / distribution process, for example, the play video stored in the storage device 30c, which is the first distribution method in which the play video data is received from the store system 10 and distributed in real time to, for example, the studio system 14 or the video distribution server 16. A second distribution method that distributes (posts) data to the video distribution server 16 or the like at a predetermined timing, or distributes play video data to, for example, the video distribution server 16 or the electronic device 18 in response to a request from the electronic device 18 or the like. There is a third delivery method to be used.

The storage device 30c stores various programs, data, and the like. The storage device 30c stores play moving image data received from the store system 10, distribution setting data indicating a distribution destination (recording destination) of the play moving image data, and the like.

The communication unit 30f controls communication via the network 2 under the control of the processor 30a.

FIG. 13 is a diagram conceptually showing a storage format of play video data of the play video mediation server 12e in the present embodiment. As shown in FIG. 13, in the play video mediation server 12e, the play video data received from the store system 10 is combined with the card ID (furthermore, other identification information issued for each game) received together with the play video data. It is associated and memorized.

In the third distribution method, for example, when the play video mediation server 12e receives a play video data distribution request from the electronic device 18, the play video mediation server 12e extracts and requests the play video data corresponding to the card ID specified by the electronic device 18. Deliver to the original.

FIG. 14 is a diagram conceptually showing the data format of the distribution setting data of the play video mediation server 12e in the present embodiment. As shown in FIG. 14, in the play video mediation server 12e, the play video recording indicating the distribution destination (play video recording destination) of the play video data is associated with the card ID received from the store system 10 as the distribution setting data. The destination data is stored.

For example, a player who executes a game on the game device 26 of the store system 10 registers the card ID and the play video recording destination data in the play video mediation server 12e in advance, so that the store system 10 (store server 24 or the game device) The play video data distributed from the play video mediation server 12e to the play video mediation server 12e can be distributed to the play video recording destination (for example, studio system 14, video distribution server 16, electronic device 18) indicated by the play video recording destination data. ..

Further, as the distribution setting data, the frame No. (number) of the frame pattern used for editing the play moving image data can be set in advance in association with the card ID. For example, when the play video data is distributed from the store system 10 to the play video mediation server 12e by the first data format distribution method, the play video mediation is performed by using the frame pattern indicated by the frame No. set as the distribution setting data. After the first play moving image data is edited in the second play moving image data format on the server 12e, it can be distributed to, for example, the studio system 14, the moving image distribution server 16, and the electronic device 18.

Further, as the distribution setting data, additional data can be set in advance in association with the card ID. The setting data includes images and effect effects added to the play video data distributed from the store system 10 (store server 24 or game device 26) to the play video mediation server 12e, and videos (still images) added to the play video data. This is data indicating a moving image (still image) file or the like. By setting the additional data, you can edit the play video data distributed from the store system 10 by adding a production effect to the video, or you can edit the video (still image) file video (for example, commercial video). , Production video, etc.) can be added and edited, and the play moving image data can be distributed to, for example, the studio system 14, the moving image distribution server 16, and the electronic device 18.

The distribution setting data can be set in the play video intermediary server 12e through the network 2, for example, by operating the store system 10 (store server 24 or game device 26) or operating the player with respect to the electronic device 18. Further, it can be set directly by the operation of the administrator of the data center 12 (play video mediation server 12e).

FIG. 15 is a block diagram showing the configuration of the studio system 14 in the present embodiment. The studio system 14 is a system capable of producing a program to be distributed through, for example, a network 2. The studio system 14 uses the game play video data executed in the store system 10, and is transmitted from the viewers of the program through the game play video, the video (audio) shot in the studio, and the network 2. A program that broadcasts the live game, for example, is produced by combining the data (for example, chat text data, data posted on a simple blog, etc.). In particular, the studio system 14 displays a program that broadcasts a competitive game executed between a plurality of store systems 10 (game devices 26) and a video that combines play video data distributed from each of the plurality of store systems 10. It can be generated and broadcast (network distribution) by adding video and audio of commentators and spectators in the studio.

As shown in FIG. 15, the studio system 14 includes a processor 32a, a memory 32b, a storage device 32c, a display unit 32d, an input unit 32e, a communication unit 32f, an input I / F 32h, a camera 32c1, 32c2, 32c3, and a microphone 32m1, It has 32 m2.

The processor 32a executes various processes such as overall control of the studio system 14 based on the programs and data stored in the memory 32b. The processor 32a executes a program production / distribution process for broadcasting using the play moving image data according to the operation of the program production staff of the studio or the control data of the play moving image data.

The memory 32b stores various programs executed by the processor 32a, temporary data executed by various processes, and the like. In the program stored in the memory 32b, in addition to the basic program (OS (Operating System)), a program production / distribution processing program for program production / distribution processing and processing related to recording / distribution / output of play video data are executed. Includes video processing programs to be used. The video processing program includes a video processing program for executing video processing for editing video of play video data.

The storage device 32c stores various programs, data, and the like. The storage device 32c stores play video data, program data for distribution, and the like received from the store system 10 or the data center 12 (play video mediation server 12e).

The display unit 32d displays a screen corresponding to the processing by the processor 32a on a display such as an LCD (Liquid Crystal Display).

The input unit 32e inputs data and instructions corresponding to various processes by the processor 32a through an input device such as a keyboard, a button, and a touch panel.

The communication unit 32f controls communication via the network 2 under the control of the processor 32a.

The input I / F 32h is an interface for inputting data from an external device installed in a studio or the like. Examples of the external device include a plurality of cameras 32c1, 32c2, 32c3, and a plurality of microphones 32m1, 32m2. Any number of cameras and microphones can be provided.

The cameras 32c1, 32c2, 32c3 are used, for example, to input images of a commentator, an audience, etc. in the studio.

The microphones 32m1 and 32m2 are used, for example, to input the voices of commentators and spectators in the studio, respectively.

The studio system 14 basically generates play video data in the second play video data format as program data for program distribution by video processing on the play video data received from the store system 10 or the play video mediation server 12e. , The second data format is distributed by the distribution method. By using the first data format distribution method, it is also possible to individually distribute a plurality of video data and audio data included in the play moving image data.

Next, the operation of the video distribution system in this embodiment will be described.
First, the operation of the game device 26-1 in the present embodiment will be described with reference to the flowchart shown in FIG. It should be noted that the description will be omitted assuming that the other game device 26 having the same function as the game device 26-1 also operates in the same manner.

When the power is turned on, the game device 26-1 (processor 26-1a) displays a game selection screen in which one of a plurality of game titles can be selected. When any game title is selected by the operation of the player on the input device, the game device 26 sets the selected game title and starts the corresponding game program (step A1).

When the coin insertion is detected or the payment from the electronic money is detected (step A2, yes), the game device 26-1 displays, for example, the display unit 26-1d "touches the card with the reader. A card authentication screen including a message such as "Please" is displayed, and the player identification card authentication screen is displayed (step A3). Here, the card reader 26-1j is made to read the card ID recorded on the card by the operation of the player.

After displaying the card authentication screen, for example, when the card reader 26-1j does not read the card even after a certain period of time has passed (step A4, none), the game device 26-1 has the merit of using the card. A screen for explaining is displayed to the player (step A5). After that, when the input of the fee required to start using the game or the payment from the electronic money is detected (step A6, yes), the game device 26-1 executes the mode setting process for setting the game mode. ..

On the other hand, is the game device 26-1 a usable card if the card ID is read by the card reader 26-1j before the coin insertion or the payment from the electronic money is detected (step A2, none)? Perform authentication processing. When the game device 26-1 is authenticated as a usable card (step A7, yes), the game device 26-1 transmits the card ID to the authentication / distribution server 12a of the data center 12, and the player corresponding to this card ID. Confirm registration.

The authentication / distribution server 12a determines whether the player data corresponding to the card ID received from the game device 26 is recorded. When the player data corresponding to the card ID is not recorded, the authentication / distribution server 12a notifies the game device 26 that the player is a new player, and when the player data corresponding to the card ID is recorded, the authentication / distribution server 12a notifies the game device 26. Player management data including data about the corresponding player is transmitted to the game device 26.

When the game device 26-1 is notified by the authentication / distribution server 12a that it is a new player (step A9, none), for example, "This card is an unregistered card in this game device. New registration is started. A new player registration screen containing the message "Do you want to do it?" Is displayed, prompting you to register the player name, for example. Here, when the game device 26-1 is instructed to execute the new registration, the operation screen for player registration is displayed, and the data related to the player such as the player name is registered by the operation of the player. The game device 26-1 transmits the card ID read from the new card and data such as the player name input by the player operation to the authentication / distribution server 12a for recording.

On the other hand, when the game device 26-1 receives the player management data from the authentication / distribution server 12a, that is, when the player has already been registered (step A9, yes), the data regarding the player included in the player management data (there is). Player information) is displayed on, for example, a display (step A11). For example, the player information includes a player name, a custom image, a level and a title, an acquired item, a player result, and setting contents of a play video setting process (described later) included in the player management data. In the play video setting process, various information for recording the play video is set.

In the game device 26-1 of the present embodiment, two players can execute the game at the same time. After the card ID is read by the card reader 26-1j (steps A7, Yes) and before the credit is established (steps A6, No), the game device 26-1 is again subjected to the card ID (steps A6, No) by the card reader 26-1j. When (different from the previous time) is read (step A8, Yes), a two-player mode in which two players participate in the game at the same time is set (step A12). When the two-player mode is set, the game device 26-1 displays the player information corresponding to each card ID.

When the credit condition is satisfied (step A6, yes), the game device 26-1 displays a mode selection screen for selecting the game mode on the display (step A13). The game modes that can be selected on the mode selection screen include, for example, a normal mode in which the game is executed only on the game device 26-1, and a battle mode. The battle mode is a mode in which a player who plays simultaneously on another game device 26 is played against a player, and a battle between stores that executes a battle game with a game device 26 of a different store system 10 and a battle between stores in the same store system 10 are performed. There is an in-store battle that executes a battle game with another game device 26. When a store-to-store match is specified by the player, the player is further asked to select a matching method of rank matching, friend matching, or store matching.

Further, in the game device 26-1 of the present embodiment, it is possible to specify by the operation of the player whether or not to record the play moving image on the mode selection screen.

When the game device 26-1 is designated to record the play video (steps A14, Yes), the game device 26-1 executes the play video setting process for making various settings related to the recording of the play video. In the play video setting process, the recording destination (delivery destination) of the play video data and the data for controlling the generation of the play video data can be set by the operation of the player when the game is executed.

FIG. 17 is a flowchart for explaining the operation of the play moving image setting process in the present embodiment.
First, the game device 26-1 determines whether the card ID of the card presented by the player has been authenticated and the player information received from the authentication / distribution server 12a includes the setting contents of the play moving image setting process. Here, in the game device 26-1, when the card ID is not authenticated, or when the card ID is authenticated but the player information does not include the setting contents of the play video setting process (steps B1, No.). ), Display the setting screen for setting various information for recording the play video.

First, the recording destination of the play moving image data is set according to the instruction of the player (step B4). As the recording destination of the play video data, for example, it is assumed that there are in-store recording (game device 26-1 or store server 24), data center recording recorded in the data center 12 (play video mediation server 12e), and video site posting. ..

In addition, the frame pattern of the screen for displaying the play video is set according to the instruction of the player. For example, a plurality of frame patterns (see FIG. 7) are displayed, and one of them is selected by the player. Further, when the number of cameras 26c1, 26c2, 26c3 and the microphones 26m1,26m2 used and the shooting (recording) target can be changed by the player, one of them may be selected according to the instruction of the player (instruction of the player). Step B5).

The game device 26-1 transmits the setting contents set (or changed) in the play video setting process to the play video mediation server 12e, and stores the setting contents in association with the card ID. The setting contents stored in the play moving image mediation server 12e can be read out and used when playing a game on any of the game devices 26 next time.

In this way, when the setting of various information for recording the play moving image is completed, the game device 26-1 transmits the data indicating the setting content in association with the card ID to the play moving image intermediary server 12e. The play video mediation server 12e stores the card ID and the setting contents in association with each other.

If the card ID has been authenticated and the player information includes the setting contents of the play video setting process (steps B1, Yes), the game device 26-1 has already been set based on the setting contents. The recording destination of the play video and the selected frame pattern are displayed (step B2). If there is no change in the setting contents (step B3, No), the game device 26-1 ends the play moving image setting process.

On the other hand, when there is a change in the setting contents (step B3, No), the game device 26-1 sets the recording destination of the play video and the frame pattern according to the instruction from the player as described above (step B3, No). Steps B4 to B6), the play video setting process is completed.

If the distribution destination of the play video data is set in the setting data for controlling the recording / distribution / output of the play video data, the setting contents of the play video set by the play video setting process are set. It may be set as the initial value (default) of the recording destination. Further, in the play video setting process, the above-mentioned setting process may be executed.

When the play video setting process is completed, the game device 26-1 starts recording the play video (step A16). That is, the recording of the image taken by the cameras 26c1, 26c2 and 26c3 and the recording of the sound input from the microphones 26m1,26m2 are started. Further, when the game processing is started by the game device 26-1, the play moving image data (video, audio) accompanying the execution of the game processing is recorded.

Further, when the battle mode is selected on the mode selection screen (steps A17, Yes), the game device 26-1 executes a player matching process for setting an opponent to play against (step A18). In the player matching process, when the in-store match is specified by the player, for example, the game device 26 instructed to execute the in-store match play first among the plurality of game devices 26 in the store becomes the host player, and other games. Recruit opponents (guests) for device 26. If there is no battle request within a predetermined fixed time, it is assumed that the battle game cannot be executed, and the mode return to the state of displaying the mode selection screen. The store server 24 may receive a match request from each game device 26 in the store and execute the matching process.

Further, in the player matching process, when the match between stores is specified by the player, the matching server 12d is requested to match the opponent by the matching method (rank matching, friend matching, store matching) instructed by the player.

When the game device 26 requests matching of the opponent, the matching server 12d executes matching according to the designated matching method. For example, when rank matching is specified, the matching server 12d causes the player to specify the rank (or numerical value such as rank, point, etc.) of the opponent player, and the specified rank (dan, point, etc.) is set. Matches other matching players waiting for a match. Further, when friend matching is specified, the matching server 12d causes the player to specify an opponent (for example, player name, card ID, etc.), and matches only when the opponent specified by the player requests a match. Do. Further, when the store matching is specified, the matching server 12d causes the player to specify a specific store (store system 10) (for example, specified from the store list), and waits for a match in the game device 26 installed in the specified store. Match with the opponent in the state.

The matching server 12d notifies the plurality of game devices 26 used by the matched players as opponents of the execution of the battle game.

When the matching process is completed (step A19, Yes), the game device 26-1 starts the game process. In the case of an inter-store battle, the game device 26-1 starts game processing when the matching server 12d notifies the execution of the battle game, and the game device 26-1 is notified from the matching server 12d with the game device 26 as the opponent. , P2P (peer-to-peer) is used to execute game processing while transmitting and receiving data and the like necessary for executing a competitive game to each other.

When the game in the normal mode is instructed by the player (steps A17, No), the game device 26-1 starts the game processing without performing the matching processing (steps A19, A20).

By starting the game processing, the game device 26-1 executes the game while displaying the game image on the display and outputting the sound of the game from the speaker or the like. The game device 26-1 generates and records play video data including game video and game sound generated by executing the game process according to the setting contents (setting data) and the setting contents by the play video setting process. To do. That is, the game device 26-1 records the game video data (including sound data) of the game video, and also uses the control data according to the game execution status as the game video data based on the time when the execution status occurs. It records in association with each other and generates play video data including game video data and control data. The game device 26-1 distributes / outputs the generated play moving image data to the recording destination (or the distribution destination indicated by the setting data) of the play moving image set by the play moving image setting process. It should be noted that the generation of the play moving image data will be omitted as it is executed as described with reference to FIGS. 8, 10 or 10 described above.

For example, when the setting data is set to deliver the play video data in real time, the game device 26-1 plays at the recording destination of the play video until the game processing is completed (steps A22, No). Distribute the video data (step A21). For example, when the game content executed by the game device 26-1 is used in real time in the program produced by the studio system 14, or when the game content is distributed in real time from the video distribution server 16, the game processing is executed in real time. Deliver play video data with.

The play video data may be distributed to the studio system 14 or the video distribution server 16 via the play video mediation server 12e, or directly from the store system 10 (store server 24 or game device 26-1). It may be distributed to the studio system 14 or the video distribution server 16.

When the game device 26-1 distributes the play video data to the studio system 14, for example, the game device 26-1 distributes the play video data in the first play video data format so that the play video data can be edited in the studio. On the other hand, when posting to the video distribution server 16, the game device 26-1 distributes the play video data in the edited second play video data format so that the play video can be distributed as it is from the electronic device 18. Since the process of generating the play video data in the second play video data format has a heavy load, when the data is distributed in real time, the data is distributed to the video distribution server 16 via the play video mediation server 12e. That is, the play video mediation server 12e receives the play video data from the game device 26-1 in the first play video data format, and uses the control data included in the play video data to play the play video in the second play video data format. Data is generated and distributed to the video distribution server 16.

When the game process is completed (step A22, Yes), the game device 26-1 stops recording the play moving image data (step A23). Then, the game device 26-1 records or distributes the play moving image data according to the setting contents of the setting data (step A24).

For example, when the setting data is set to be recorded in the game device 26-1 or the store server 24 (or both), the game device 26-1 causes the game device 26-1 to record the play moving image data in association with the card ID. The play moving image data stored in the game device 26-1 or the store server 24 can be output (copied) to a recording medium such as a USB memory owned by the player or a portable electronic device and taken back by the player.

Further, in the setting data, when the play video data is set in the studio system 14 or the video distribution server 16 instead of in real time, the game device 26-1 directly refers to the studio system 14 or the video distribution server 16. It is distributed or distributed to the studio system 14 or the video distribution server 16 via the play video mediation server 12e.

The settings such as the distribution destination of the play video data and the data format of the play video data described above are examples, and the settings can be arbitrarily changed by the player or the system administrator. Further, in the above description, the game device 26-1 is taken as an example, but the game device 26-2 and the moving image output device 28 operate in cooperation with each other, whereby the game device 26-1 described above is described. Performs the same processing as. That is, the game device 26-2 outputs various data necessary for generating the play video data to the video output device 28, and the video output device 28 executes processing for recording / distribution / output of the play video data. Let me.

In this way, in the store system 10 (game device 26, video output device 28), as the player executes the game, the control data generated according to the game execution status is based on the time when the execution status occurs. Play video data associated with game video data can be generated and recorded / distributed / output. The recording / distribution destination of the play video data, the data format, the frame pattern used when editing the play video data, etc. can be set in the setting process and the play video setting process, and the play video data (including the game video) can be set. Recording / distribution / output according to the purpose of use is possible. Therefore, the play video data (including the game video) can be used more effectively.

Next, the operation of the play moving image mediation server 12e in the present embodiment will be described.
The play video mediation server 12e receives and stores the play video data from the store system 10 by executing the video storage / distribution process, and of the first to third distribution methods according to the preset setting contents. Play video data can be distributed by either method.

In the first distribution method, for example, play video data is received from the store system 10 and distributed in real time to, for example, a studio system 14 or a video distribution server 16. In the second distribution method, the stored play video data is distributed (posted) to the video distribution server 16 or the like at a predetermined timing (for example, a predetermined time, a date and time specified by a player, a system administrator, etc.). ).

FIG. 18 is a flowchart showing an example of distribution (first distribution method, second distribution method) by the data center 12 in the present embodiment. In FIG. 18, an example is taken in which play video data of a competitive game executed between a plurality of game devices 26 is distributed. Here, it is assumed that the battle game is executed between the game devices A and B.

The competitive games of the game devices A and B are matched by the matching server 12d. The play video mediation server 12e receives information for identifying the game devices A and B for playing the battle game from the matching server 12d (step C1). For example, the play video intermediary server 12e uses the card ID read in each of the information to identify the game devices A and B, the information unique to the store system 10 and the game device in which the game devices A and B are installed, or the game device. The identification information issued for each game executed in A and B can be used.

When the battle game is executed in the game devices A and B, the play video data is generated in each of the game devices A and B as described above and transmitted to the play video mediation server 12e. The play video mediation server 12e receives the play video data A and B from the game devices A and B, respectively (step C2), and stores the play video data A and B in association with each other. That is, the play video mediation server 12e uses the play video data generated by the battle game based on the card ID (or identification information, information unique to the game device, etc.) added to each of the play video data A and B. Identify and associate.

When the real-time distribution is not specified (steps C3 and No), the play video mediation server 12e stores the play video data A and B in association with each other until the game on the game devices A and B ends. deep. The play moving image data stored here is distributed at a predetermined timing by, for example, a second distribution method.

On the other hand, when real-time distribution is specified (step C4, Yes), the play video mediation server 12e generates play video data for distribution (step C5), and the play video mediation server 12e generates a play video data for distribution (for example, a studio system). 14 or the video distribution server 16) (first distribution method) (step C6). The play video mediation server 12e generates play video data for distribution from the play video data A and B received from the game devices A and B, respectively, until the game on the game devices A and B ends, and sequentially distributes the play video data. It is transmitted first (steps C2 to C7).

For example, when distributing to the studio system 14, the play video mediation server 12e uses the first play video data as the play video data for distribution so that the play video data can be edited in the studio system 14. The play video data in the format is distributed as it is (first data format distribution method).

Further, for example, when distributing to the video distribution server 16, the play video mediation server 12e edits and distributes a plurality of video data (or audio data) included in the play video data in the first play video data format. Play video data (second play video data format) is generated and distributed (second data format distribution method). The data format for distribution can be arbitrarily set. The method of generating the play moving image data in the second play moving image data format will be described in the moving image reproduction process (FIG. 20) described later.

In the above-mentioned example, an example of a battle game in which one player plays against each other is described, but when a battle game is executed between a plurality of players and a plurality of players, a plurality of players are further mixed. It is also possible to target battle games that fight each other. The play video mediation server 12e receives the play video data from the game device 26 in which each player participating in the battle game plays the game, stores the play video data in association with each other, and performs the first distribution method or the first distribution method or the first in the same manner as described above. 2 It can be delivered by the delivery method.

FIG. 19 is a flowchart showing an example of distribution of play video data by the third distribution method by the play video mediation server 12e in the present embodiment.

When playing a game on the game device 26, the player sets, for example, to distribute (store) the play video data to the play video mediation server 12e. As a result, as described above, the play video data of the game executed by the player is stored in the play video mediation server 12e in association with the card ID (or identification information, information unique to the game device, etc.) presented by the player. ..

After that, the player accesses the play video mediation server 12e using the electronic device 18 at home or at an arbitrary place, and transmits a distribution request for the play video data.

When the play video mediation server 12e receives the distribution request from the electronic device 18 (steps D1, Yes), as information for identifying the play video data to be distributed, for example, the card ID presented at the time of game execution (further Other identification information such as an alphanumeric string or a code image) is transmitted from the electronic device 18.

The play video mediation server 12e receives the card ID (further other identification information) from the electronic device 18 (step D4), and identifies the play video data stored in association with the card ID (other identification information). (Step D3). The play video mediation server 12e transmits the play video data corresponding to the card ID to the electronic device 18 of the distribution request source (third distribution method) (step D4).

In this way, by receiving the play video data via the play video mediation server 12e, the second play in which a plurality of video data (or audio data) included in the play video data in the first play video data format is edited. The play moving image data in the moving image data format can be received by the electronic device 18 at an arbitrary timing desired by the player.

In this way, in the video distribution system of the present embodiment, not only the play video data including the game video of the game executed by the game device 26 is acquired by the game device 26 and the store server 24 in the store system 10, but also the data center 12 (Play video mediation server 12e), the studio system 14, the video distribution server 16, and the like can be distributed. Therefore, the game image can be used more effectively. In addition, since the play video data can be distributed in a data format (first play video data format, second play video data format) according to the purpose of use of the play video data at the distribution destination, effective use of the game video can be achieved. Can be efficient. In particular, in the play video data, control data generated according to the game execution status is recorded in association with the game video data based on the time when the execution status occurs, so video editing using the control data, etc. Is possible. For example, in the studio system 14, it is possible to edit a video using the control data of the play video data and play back the video.

Next, the moving image reproduction process executed by the studio system 14 of the present embodiment will be described. FIG. 20 is a flowchart showing an example of the moving image reproduction processing in the present embodiment. In the video playback processing, the play video data in the first play video data format received from the store system 10 or the play video mediation server 12e is edited (displayed) using the control data by the video processing (video processing program). It is possible to generate program data (play video data) for program broadcasting in the second play video data format and play the video. The studio system 14 automatically executes not only the operation by the program production staff of the studio but also the control of the program based on the control data, such as changing the video playback frame of the program video and switching the video to be displayed. be able to.

Here, for example, it is assumed that a video of a program showing a live battle game by two game devices A and B is generated and broadcast (network distribution) through the network 2. The studio system 14 combines the play video data received from each of the game devices A and B, the video (audio) of the commentator and the audience shot in the studio, and the commercial video (image) to play the game. Produce a program that broadcasts the actual situation of. It is also possible to create a video of the program by using other data such as data transmitted from the viewer of the program through the network 2 (text data of chat, data posted to a simple blog, etc.).

In the studio system 14, in order to create a video for a program, a moving image playback frame definition that defines the configuration of the video for the program is set (step E1). In the video playback frame definition, for example, a video playback frame (frame pattern) that displays video on the screen, data that specifies the video to be displayed in each frame in the frame pattern, and frame changes according to the control data included in the play video data. And data indicating changes in the video to be displayed are set.

When the studio system 14 starts video playback (program production / distribution processing) (step E2), it switches to the initial video playback frame set in the video playback frame definition (step E3), and displays the corresponding video in each frame. Display (step E4).

FIG. 21A shows an example of displaying an image using an initial moving image reproduction frame. FIG. 21A shows an example of a frame pattern in which one screen is evenly divided into four, and defines, for example, a display form before a battle game is started. The video data (A2) (FIG. 8 (c)) of the game device A is displayed on the frame F11, and the video data (B2) (FIG. 8 (c)) of the game device B is displayed on the frame F12. Is shown. That is, the images of the players of the game devices A and B before the start of the battle game are displayed. Further, in the frame F13, for example, an image (S1) of an audience photographed in a studio, image data (A4) (FIG. 8 (e)) of the game device A, and an image (B4) of the game device B (FIG. 8 (FIG. 8). It indicates that the display is switched between e)) and. The frame F14 indicates that a commercial image (C1) is displayed.

FIG. 21B shows an example of displaying a video using another initial moving image reproduction frame. FIG. 21B shows an example of a frame pattern in which a plurality of small frames F22, F23, and F24 are provided in the main frame F21 as the entire screen. It defines the display format before the battle game starts. In the frame F21, video data (A2) (B2) of the players of the game devices A and B, video data (A4) (B4) of the spectators of the game devices A and B (FIG. 8 (e)), Alternatively, it is shown that either of the images (S2) and (S3) taken by the two commentators in the studio is switched and displayed. Further, it is shown that different commercial images (C2) and (C3) are displayed on the frames F22 and F23. The frame F24 indicates that, for example, an image (S1) of an audience photographed in a studio is displayed.

When the occurrence of an event is detected from the control data of the play video data received from the game devices A and B (steps E5, Yes), the studio system 14 responds to the control data (event) according to the video playback frame definition. Switch to the video playback frame (step E6). In addition, the video to be displayed in each frame of the switched video playback frame is switched as necessary according to the video playback frame definition.

For example, when the control data indicating the start of the game is detected, the studio system 14 switches the moving image reproduction frame shown in FIG. 21A to the moving image reproduction frame shown in FIG. 21C during the competitive game. In FIG. 21C, one frame F31 is enlarged to serve as a main frame, and game images (A1) and (B1) of game devices A and B are displayed. If the game images in the battle game are the same on the game devices A and B (third party viewpoint), either one of the game images (A1) and (B1) may be displayed. If the game images displayed on the game devices A and B are different (for example, from the player's point of view), the game images can be switched according to the game situation (occurrence of an event). For example, the game image (A1) of the game device A is displayed in the case of the attack turn of the player of the game device A, and the game image (B1) of the game device B is displayed in the case of the attack turn of the player of the game device B. To do.

In addition, images (A2) and (B2) of the players of the game devices A and B are displayed on the frames F32 and F33, respectively, and the hands of the players of the game devices A and B are photographed on the frames F34 and F35, respectively. The images (A3) and (B3) are displayed respectively. That is, by displaying the game image and the state of the player and the image at hand, the execution status of the competitive game can be easily grasped. Further, the frame F36 displays an image (S1) of the audience photographed in the studio.

FIG. 21 (e) shows an example of displaying an image using a moving image reproduction frame when another event occurs. For example, an example is shown in which there is control data indicating that the player of the game device A has performed a special preset action (movement, vocalization, etc.). In this case, the image (A2) of the player of the game device A is displayed on the frame F51 of the main frame according to the control data (event). Further, the game image (A1) is displayed on the frame F52 in which the player of the game device A has been photographed until then. The frames F53, F54, and F55 continue to display the same images as the frames F33, F34, and F35 shown in FIG. 21 (c).

FIG. 21 (g) shows an example of displaying an image using a moving image reproduction frame when another event occurs. For example, an example is shown in which there is control data indicating that the player of the game device A has won the battle game. In this case, according to the control data (event), the game image (A1) at the end of the match of the game device A, that is, the image showing the match victory is displayed on the frame F71 of the main frame. The frames F72, F73, and F76 continue to display the same images as the frames F32, F33, and F37 shown in FIG. 21 (c). Since it is not necessary to display the images at the player's hand due to the end of the battle on the frames F74 and F75, for example, different commercial images (C4) and (C5) are displayed.

In this way, the video playback frame can be changed and the video displayed in the frame can be dynamically changed according to the game execution status included in the play video data and indicated by the control data.

Although FIGS. 21 (c), (e), and (g) show an example of a moving image playback frame in which the screen is divided into tiles (each frame does not overlap), FIGS. 21 (d) and 21 (f) show. As such, it is also possible to use a moving image playback frame in which the frame is changed so as to overlap with other frames.

FIG. 21D shows an example of a moving image playback frame for during a competitive game. In the moving image reproduction frame shown in FIG. 21D, the frame F41 for displaying the game image (A1) of the game device A and the frame F42 for displaying the game image (B1) of the game device B are overlapped. Further, the frames F43 and F44 display images (A2) and (B2) of the players of the game devices A and B, respectively.

Here, for example, when there is control data indicating that a special event has occurred in the game device A, the frame F61 for displaying the game image (A1) of the game device A is enlarged as shown in FIG. 21 (f). Then, it overlaps with other frames F62, F63, and F64. The images displayed on F61, F62, F63, and F64 continue to display the same images as the frames F41, F42, F43, and F44 shown in FIG. 21 (d).

FIG. 21H shows an example when there is control data indicating that the player of the game device A has won the battle game, for example. In this case, according to the control data (event), the entire screen is set as the frame F81 of the main frame, and the game image (A1) at the end of the match of the game device A, that is, the image showing the match victory is displayed. Further, the image (A2) taken by the player is displayed on the frame F82 which overlaps (overlaps) the frame F81.

In this way, by deforming the shape of the frame according to the execution status of the game indicated by the control data, it is possible to display a program image that can be expected to have various effects.

In the above description, the shape of the video playback frame and the video displayed in the frame are switched according to the game execution status (event) indicated by the control data included in the play video data. It can also be controlled according to the operation by the staff. The studio system 14 executes the switching of the moving image playback frame in response to the frame switching operation by the program production staff and the switching operation of the video to be displayed in the frame (steps E7, Yes) (step E7, Yes). Step E8).

The studio system 14 repeats the above-described processing (steps E4 to E9) until the moving image playback is completed (steps E9, Yes).

In this way, in the studio system 14, the video processing (video processing program) is used to edit the video (change the display form) using the control data included in the play video data, and play the second play video data format. Video data can be generated and played back. Therefore, it is possible to significantly reduce the operational burden on the program production staff of the studio, generate program data (play video data) for program broadcasting, and play back the video (network distribution). In particular, it is effective when delivering the actual condition of the game executed by the game device 26 in real time.

In the above description, the shape of the moving image playback frame and the switching of the video to be displayed in the frame are taken as an example, but the switching of the audio output is also performed in conjunction with the switching of the video. In addition, sounds not included in the play video data, such as sound effects such as jingles prepared in advance, can be added, and images prepared in advance such as superimpose can be added according to the timing indicated by the control data in the play video data. You can also add edits such as adding (including text) to the video.

Further, in the above description, the control data associated with the game video (video data 1 shown in FIG. 8A) is mainly taken as an example, but other video data (for example, a player and an audience are photographed). It is also possible to edit a moving image using control data associated with video) or other audio data (for example, the audio of a player or an audience). In this case, the data to be controlled according to the control data, such as switching the video according to the control data associated with the audio data, is video, audio, or any other data if it is set in the video playback frame definition. It may be any video (commercial, etc.).

Further, in the above-mentioned example, a case where a one-on-one battle game is played between the game devices A and B is taken as an example, but in a group battle game, a plurality of (3 or more) game devices 26 are used. Play video data including game video from each user's point of view is transmitted. In such a case, the video or audio may be selected and created according to the execution status of the game based on the control data included in any of the play video data.

As described above, the method of editing the video using the control data based on the play video data in the first play video data format and generating the play video data in the second play video data format is a store. It can be executed in the same manner in the system 10 (store server 24, game device 26) and the play video mediation server 12e.

Further, the present invention is not limited to the above-described embodiment as it is, and at the implementation stage, the components can be modified and embodied within a range that does not deviate from the gist thereof. In addition, various inventions can be formed by an appropriate combination of the plurality of components disclosed in the above-described embodiment. For example, some components may be removed from all the components shown in the embodiments. In addition, components across different embodiments may be combined as appropriate.

Further, the method described in the embodiment includes, for example, a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, Blu-ray) as a program (software means) that can be executed by a computer. It can also be stored in a recording medium such as a registered trademark), a semiconductor memory (ROM, RAM, flash memory, etc.), or transmitted and distributed by a communication medium. The program stored on the medium side also includes a setting program for configuring the software means (including not only the execution program but also the table and the data structure) to be executed by the computer in the computer. A computer that realizes this device reads a program recorded on a recording medium, constructs software means by a setting program in some cases, and executes the above-mentioned processing by controlling the operation by the software means. The recording medium referred to in the present specification is not limited to distribution, and includes a storage medium such as a magnetic disk or a semiconductor memory provided in a device connected inside a computer or via a network.

2 ... Network, 10 (10-1, 10-2, ..., 10-n) ... Store system, 12 ... Data center, 12a ... Authentication / distribution server, 12b ... Ranking server, 12c ... Billing / storage server, 12d ... Matching server, 12e ... Play video mediation server, 14 ... Studio system, 16 ... Video distribution server, 18 ... Electronic equipment, 24 ... Store server, 24a ... Processor, 24b ... Memory, 24c ... Storage device, 24d ... Display unit, 24e ... Input unit, 24f ... Communication unit, 24g ... Media I / F, 24j ... Card reader, 26 (26-1, 26-2, ..., 26-m) ... Game device, 28 ... Movie output device.

Claims (7)

A game processing means that executes a game while displaying a game image,
A first video data recording means for recording game video data of the game video and first control data according to the execution status of the game, and
Video means for inputting video data and
A second video data recording means for recording the video data in association with the game video data,
A control data generation means that generates a second control data according to a change in the video based on the video data, and a control data generation means.
The first control data is recorded in association with the game video data based on the occurrence time of the execution status, and the second control data is recorded in the game video based on the occurrence time when the change in the video occurs. Control data recording means for recording in association with data,
A moving image recording device having a generation means for generating a first play moving image data including the game video data , the video data, the first control data , and the second control data. A claim that further includes a moving image generating means that edits the game video data and the video data into one video based on the first control data and the second control data to generate the second play video data. 1. The moving image recording device according to 1. The moving image recording device according to claim 2 , wherein the moving image generating means changes the shape of a frame pattern that divides a screen into a plurality of frames and an image displayed on the frame according to the first control data and the second control data. An input means for inputting game video data of a game executed on a game device,
A control data input means for inputting the first control data according to the execution status of the game executed in the game device, and
Video means for inputting video data and
A second video data recording means for recording the video data in association with the game video data,
A control data generation means that generates a second control data according to a change in the video based on the video data, and a control data generation means.
The first control data is recorded in association with the game video data based on the occurrence time of the execution status, and the second control data is recorded as the game video data based on the occurrence time when the change in the video occurs. Control data recording means for recording in association with
A moving image recording device having a generation means for generating a first play moving image data including the game video data , the video data, the first control data , and the second control data. Run the game while displaying the game video,
The game video data of the game video and the first control data according to the execution status of the game are recorded.
Enter the video data and
The video data is recorded in association with the game video data,
Based on the video data, the second control data corresponding to the change in the video is generated.
The first control data is recorded in association with the game video data based on the time when the execution status occurs.
The second control data is recorded in association with the game video data based on the time when the change in the video occurs.
A video distribution method for distributing play video data including the game video data , the video data, the first control data , and the second control data. The first game video data representing the game video is associated with the first control data according to the execution status of the game based on the occurrence time of the execution status , and the first video data also includes the first video data. The first game video data, the first video data, and the first are associated with the second control data generated in response to the change in the video based on the time when the change in the video occurs. A first receiving means for receiving control data, first play moving image data including the second control data from the first game device, and
The second game video data representing the game video is associated with the third control data according to the execution status of the game based on the occurrence time of the execution status , and the second video data also includes the second video data. The second game video data, the second video data, and the third are associated with the fourth control data generated in response to the change in the video based on the time when the change in the video occurs. A second receiving means for receiving the control data and the second play moving image data including the fourth control data from the second game device, and
Based on the first to fourth control data, the first play video data and the second play video data are edited into one video, and the video generation means for generating the third play video data is provided. Video recording device. Computer,
A game processing means that executes a game while displaying a game image,
A first video data recording means for recording game video data of the game video and first control data according to the execution status of the game, and
Video means for inputting video data and
A second video data recording means for recording the video data in association with the game video data,
A control data generation means that generates a second control data according to a change in the video based on the video data, and a control data generation means.
The first control data is recorded in association with the game video data based on the occurrence time of the execution status, and the second control data is recorded in the game video based on the occurrence time when the change in the video occurs. Control data recording means for recording in association with data,
A program for functioning as a generation means for generating play video data including the game video data , the video data, the first control data , and the second control data.