JP6720575B2 - Video playback device and video processing device - Google Patents

Description

The present invention relates to a moving image reproducing device and a moving image processing device.

A technique for photographing and recording a viewer watching a program is known (see Patent Document 1). However, there is a problem that it is difficult to understand the relationship between the program and the viewer.

JP, 2007-104348, A

A moving image reproducing apparatus according to a first aspect of the present invention includes a reproduced image of a first moving image, a reproduced image of a second moving image of an animal watching the reproduced first moving image, and the first reproduced image of the first moving image. A display unit for displaying an image including information indicating the relationship between the moving image and the second moving image, and a reproducing unit for reproducing the moving image, and the image is the third image reproduced by the reproducing unit. It is a reproduced image of a moving image.
According to a second aspect of the present invention, there is provided a moving image reproduction apparatus, which includes a reproduced image of a first moving image, a reproduced image of a second moving image of an animal watching the reproduced first moving image, and the first reproduced image of the first moving image. A moving image and information indicating the relationship between the second moving image and an image, the information indicating the relationship between the first moving image and the second moving image is the first information. The information is that the shape or size of the reproduced image of the moving image or the reproduced image of the second moving image changes.
According to a third aspect of the present invention, there is provided a moving image reproduction apparatus, which includes a reproduced image of a first moving image, a reproduced image of a second moving image of an animal watching the reproduced first moving image, and the first reproduced image. A display unit that displays an image including information indicating the relationship between the moving image and the second moving image, the image further including information indicating the attention target of the animal in the reproduced image of the first moving image. Including.
According to a fourth aspect of the present invention, there is provided a moving image reproduction apparatus, which includes a reproduced image of a first moving image, a reproduced image of a second moving image of an animal watching the reproduced first moving image, and a reproduced image of the first moving image. A display unit that displays an image including information indicating the relationship between the moving image and the second moving image, a reproducing unit that reproduces the moving image, and a reproduced image of the first moving image that is reproduced by the reproducing unit. An image generation unit that generates the image including a reproduction image of the second moving image reproduced by the reproduction unit and information indicating a relationship between the first moving image and the second moving image. The image generation unit generates the image so that the attention target of the animal in the reproduced image of the first moving image is displayed.
A moving image processing apparatus according to a fifth aspect of the present invention is configured to transmit a second moving image capturing an animal watching a reproduced image of the first moving image and a communication unit that transmits the first moving image. A storage unit that stores information for displaying information indicating a relationship between the first moving image and the second moving image in a receiving terminal that receives the first moving image and the second moving image, The communication unit, when transmitting the first moving image and the second moving image, transmits information for displaying information indicating a relationship between the first moving image and the second moving image, and The information indicating the relationship between the first moving image and the second moving image is information that the shape or size of the reproduced image of the first moving image or the second moving image changes.
A moving image processing apparatus according to a sixth aspect of the present invention is a reproduced image of a second moving image, which is an image of an animal watching a reproduced image of the first moving image, a reproduced image of the first moving image, and a first reproduced image of the first moving image. A moving image including information indicating the relationship between the moving image and the second moving image, the communication unit transmitting the moving image to the receiving terminal based on the reproduction request of the moving image, and the first moving image and the second moving image. The information indicating the relationship is that the shape or size of the reproduced image of the first moving image or the second moving image changes.
A moving image processing device according to a seventh aspect of the present invention is provided with a second moving image capturing an animal watching a reproduced image of the first moving image, and a communication unit for transmitting the first moving image, A storage unit that stores information for displaying information indicating a relationship between the first moving image and the second moving image in a receiving terminal that receives the first moving image and the second moving image, The communication unit, when transmitting the first moving image and the second moving image, information for displaying information indicating a relationship between the first moving image and the second moving image; And information for displaying information indicating the target of interest of the animal in the reproduced image of the moving image.
A moving image processing apparatus according to an eighth aspect of the present invention is a reproduced image of a second moving image obtained by photographing an animal watching a reproduced image of the first moving image, a reproduced image of the first moving image, and the first reproduced image. A moving image including information indicating the relationship between the moving image and the second moving image, the communication unit transmitting the moving image to the receiving terminal based on the reproduction request of the moving image, and the communication unit reproduces the first moving image. The information for displaying the information indicating the attention target of the animal in the image on the receiving terminal is further transmitted.
A moving image processing device according to a ninth aspect of the present invention is a reproduced image of a second moving image in which an animal watching a reproduced image of a first moving image is photographed, a reproduced image of the first moving image, and a first reproduced image of the first moving image. A moving image including information indicating the relationship between the moving image and the second moving image, the communication unit transmitting the moving image to the receiving terminal based on the reproduction request for the moving image, and the moving image is a reproduced image of the first moving image. And further includes information indicating a target of interest of the animal in.

It is a figure which illustrates the whole structure of a moving image viewing system. 2A and 2B are views showing the appearance of the reproducing apparatus. FIG. 2A is a front view and FIG. 2B is a rear view. It is a block diagram which illustrates the principal part structure of a reproducing|regenerating apparatus. FIG. 4A and FIG. 4B are diagrams illustrating display screens. 5(a) to 5(f) are diagrams for explaining a reproduced image of a moving image. It is a flowchart explaining the processing procedure by a moving image viewing system. 7(a) to 7(c) are diagrams for explaining reproduced images of a moving image. 21 is a flowchart illustrating a processing procedure by the moving image viewing system according to the modification 9.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.
In the present embodiment, a moving image to be viewed by a viewer is called an original moving image, and a moving image of a reaction of a viewer who views the original moving image is called a reaction moving image. Here, by setting the reaction video as a viewing target by the viewer, the video of the reaction of the viewer who views the reaction video is also treated as a further reaction video. For this reason, for convenience, the reaction moving image in which the reaction of the viewer 1 who views the original moving image is captured is called a child moving image. Further, the reaction moving image in which the reaction of the viewer 2 who views the child moving image is photographed is called a grandchild moving image. Hereinafter, similarly, they will be referred to as grandchild video, great-grandchild video, and grandchild video. The viewer 1 and the viewer 2 may be the same person or different people.

<Use scene>
1 illustrates an example of a usage scene of a playback device in a moving image viewing system according to an embodiment of the present invention.
1. Promotional video of dance music For example, a promotion video of dance music is used as an original moving image, and a reproduced image of this promotion video is displayed on a display device. The viewer 1 imitates the dancer shown in the promotion video, dances, and shoots its appearance with a video camera. Let the recorded video be a child video.

The playback image of the child video is displayed on the display screen of the playback device together with the playback image of the promotion video that is the original video. The viewer 2 sees the dancer's dance shown in the promotion video and the viewer 1's dance shown in the child video, and suddenly blows into the gap. Such a figure of the viewer 2 is photographed with a video camera, and the photographed moving image is used as a grandchild moving image. The playback image of the grandchild video can be displayed on the display screen of the playback device together with the playback images of the original video and the child video.

2. Video showing the state of a cat For example, a video of a casual animal (for example, a cat) is used as an original moving image, and a reproduced image of the video of the cat is displayed on a display device. The viewer 1 reacts to the appearance of the cat in the video of the cat, and shoots the appearance of covering the dialogue with a video camera. Let the recorded video be a child video.

The reproduced image of the child moving image is displayed on the display screen of the reproducing device together with the reproduced image of the cat video that is the original moving image. The viewer 2 views the cat shown in the cat video and the post-recording moving image (child moving image) by the viewer 1 and makes an uncomfortable expression in the match condition. Such a figure of the viewer 2 is photographed with a video camera, and the photographed moving image is used as a grandchild moving image. The playback image of the grandchild video can be displayed on the display screen of the playback device together with the playback images of the original video and the child video. Enjoyment occurs when different people cover the lines and show their expressions at different places at different times.

3. A video of a person humming a rhythm A video of a person humming a rhythm is used as an original moving image, and a playback image of this video is displayed on a display device. The viewer 1 puts on the rhythm by hitting a desk, for example, on the rhythm of the person shown in the video. This viewer 1 is photographed with a video camera. Let the recorded video be a child video.

The reproduced image of the child moving image is displayed on the display screen of the reproducing device together with the reproduced image of the video of the original moving image. The viewer 2 sees the person shown in the video and the viewer 1 shown in the child moving image, and further hits the cup to cover the rhythm. Such a figure of the viewer 2 is photographed with a video camera, and the photographed moving image is used as a grandchild moving image. The playback image of the grandchild video can be displayed on the display screen of the playback device together with the playback images of the original video and the child video. Enjoyment occurs when different people play the same rhythm at different places and at different times.

4. A video of a person taking a pose is displayed by using a video of a person taking a pose of a person as a moving image. Viewer 1 has the same pose as the person shown in the video. This viewer 1 is photographed with a video camera. Let the recorded video be a child video.

The reproduced image of the child moving image is displayed on the display screen of the reproducing device together with the reproduced image of the video of the original moving image. The viewer 2 looks at the person shown in the video and the viewer 1 shown in the child moving image, and further takes the same pose. Such a figure of the viewer 2 is photographed with a video camera, and the photographed moving image is used as a grandchild moving image. The playback image of the grandchild video can be displayed on the display screen of the playback device together with the playback images of the original video and the child video. Funny poses occur when different people pose at the same place at different times.

As illustrated in the above usage scenes, different people watch the original video or the child video at different places and at different times, take a picture of the viewer with a video camera, and record the taken video as a child video or grandchild. Make it a video. By making these child videos and grandchild videos available for viewing, reaction videos increase in a chain.

When making such original videos, child videos, grandchild videos, etc. available for viewing, in order for the viewer to enjoy the reaction, the playback images of these videos are viewed on the same time axis. enable. Then, in order to easily understand what the animal (for example, a person) reflected in the child moving image or the grandchild moving image is reacting to, the reproduced images of the plurality of moving images displayed on the display device are displayed as follows.

<System configuration>
FIG. 1 is a diagram illustrating an overall configuration of a moving image viewing system 1. In FIG. 1, a server 2, a PC 4, and a wireless LAN (Local Area Network) access point 8 are connected to a network 6. Furthermore, the smartphone 10 is connected to the network 6 via the access point 8. The server 2 of the moving image viewing system 1 provides moving images to the viewer on the Internet. The moving image is provided in the form of streaming, download, or the like. The moving picture includes an original moving picture, a child moving picture, a grandchild moving picture,....

A viewer who receives the moving image accesses the server 2 that provides the moving image via a terminal such as the smartphone 10 or the PC (personal computer) 4. Note that the terminal (playback device) that receives the provision of the moving image is not limited to the smartphone 10 or the PC 4, and may be any electronic device that can connect to the network and view the moving image, such as a tablet terminal. The server 2 is installed in a data center or the like by a business operator who provides moving image information (hereinafter referred to as a provider). The positions of the provider and the server 2 are not particularly limited, and an individual may install the server at home as long as the moving image can be provided on the net. The video provided by the server 2 of the video viewing system 1 may be posted by a viewer or prepared by a provider.

The server 2 is configured by a storage device including a database, a data processing device, a communication control device with the network 6, and the like, manages data and the like necessary for providing moving images, and distributes moving images. The data managed by the server 2 is stored in a searchable manner. For example, they are searched by area such as "Tokyo", "Shinjuku", "Shibuya", or "Yokohama", or provided such as "animal", "landscape", "happening", etc. You can search by movie genre.

The access point 8 is installed in a station, a commercial facility or the like, and is called a hot spot or the like. Further, the access point 8 may be installed at home. The viewer accesses the server 2 from his/her home or office via the PC 4, or accesses the server 2 via the access point 8 using the wireless LAN function of the smartphone 10 or tablet computer. The smartphone 10 may access the server 2 on the network 6 via a mobile phone network not shown.

Hereinafter, an example of using the smartphone 10 as a playback device will be described. 2A and 2B are diagrams illustrating the appearance of the reproducing apparatus 10. FIG. 2A is a front view and FIG. 2B is a rear view. In FIG. 2A, a camera 11 and a display/input unit 20 are provided on the front of the playback device 10. In FIG. 2B, a camera 12 is provided on the back surface of the reproduction device 10.

The camera 11 in FIG. 2A is used as a camera when the playback device 10 shoots a viewer. The display/input unit 20 is configured by a touch panel liquid crystal display having both a display function of displaying an image, an icon 21 and the like on the display unit 22 and an operation unit function of receiving a touch operation by a viewer.

The display/input unit 20 is provided so as to cover the front surface of the housing of the playback device 10, and the display unit 22 is a display surface and an operation surface. When the display unit 22 is touch-operated by the viewer's finger, the display/input unit 20 outputs a detection signal indicating that the touch operation has been performed and the touch position, for example, based on the change in the capacitance of the touch unit. Output.

The reproducing apparatus 10 activates a program associated with the icon 21 displayed on the display unit 22 of the display/input unit 20 to activate each function such as a telephone function, a mail function, a content reproducing function, and a camera function. Demonstrate the functions realized by the program. The display content of the display unit 22 illustrated in FIG. 2A is an example of a so-called home screen. The camera 12 of FIG. 2B is used as a camera for shooting when the playback device 10 exerts a camera function.
It should be noted that the camera 11 and the camera 12 can also be used as cameras for shooting reaction moving images.

FIG. 3 is a block diagram illustrating the configuration of the main part of the playback device 10 of FIG. In FIG. 3, the playback device 10 includes a display/input unit 20, a control unit 30, the cameras 11 and 12, and a communication unit 13.

<Display/input section 20>
The display/input unit 20 includes a position detection unit 23 and a display unit 22. The position detection unit 23 receives the position detection signal indicating the contact position by the finger and the display information (information indicating where and what is being displayed on the display unit 22 of the display/input unit 20) included in the display control unit 32. Based on this, the target (icon 21 or the like) on the screen of the display/input unit 20 is specified. The display unit 22 is a display surface and an operation surface as described above.

<Control unit 30>
The control unit 30 includes a program execution unit 31, a display control unit 32, a content reproduction unit 33, a communication control unit 34, and a non-volatile memory 35, and controls the operation of each unit in the reproduction device 10.

The program execution unit 31 executes the program associated with the icon 21 specified by the position detection unit 23 of the display/input unit 20. The program is stored in the non-volatile memory 35.

The display control unit 32 causes the display unit 22 of the display/input unit 20 to display images (moving images, still images), icons 21, and the like. The content reproducing unit 33 reads out and reproduces a content file stored in the non-volatile memory 35. The types of content include, for example, moving image content, still image content, music content, and book content. Further, the content reproducing unit 33 can decode the compressed content by using a content decoding unit (decoder) not shown. The content reproduction unit 33 can also read and reproduce the content temporarily stored (buffered) in a volatile memory (not shown). Generally, the reproducing apparatus 10 stores the content file in the non-volatile memory 35 when the content file is downloaded and acquired from the server 2. On the other hand, when the content file is obtained by streaming from the server 2, the volatile memory is buffered.

The type of content to be reproduced is instructed by the viewer through a touch operation on the display/input unit 20. When reproducing the moving image content, the content reproducing unit 33 displays the reproduced image (video) based on the moving image data on the display unit 22 and outputs the sound based on the associated audio data to a speaker (not shown), wireless or wired. Play back with connected headphones (not shown). The moving image content includes moving images provided from the server 2 of the moving image viewing system 1.

When reproducing the still image content, the content reproducing unit 33 causes the display unit 22 to display the reproduced image based on the still image data. When reproducing music content, the content reproduction unit 33 reproduces a music piece based on music data. When reproducing the book content, the content reproducing unit 33 causes the display unit 22 to display the content of the book based on the book data.

The communication control unit 34 controls communication with an external device via the communication unit 13. The non-volatile memory 35 stores the program executed by the program execution unit 31 and the content file reproduced by the content reproduction unit 33. The programs and content files can be updated or additionally stored in the non-volatile memory 35 via the communication unit 13.

<Communication unit 13>
The communication unit 13 performs wireless communication according to an instruction from the communication control unit 34. The communication unit 13 is configured to be capable of communication via an access point of a wireless LAN (Local Area Network) and communication via a mobile phone network.

<Display example>
The playback device 10 displays, on the display/input unit 20, a playback image of a movie provided from the server 2 of the movie viewing system 1 as movie content. FIG. 4A and FIG. 4B are diagrams illustrating the display screen of the display/input unit 20.
1. Display of Reproduction List The reproduction device 10 displays the reproduction list of the moving image on the display/input unit 20 before displaying the reproduction image of the moving image. In FIG. 4A, the display/input unit 20 displays a moving image playlist. In the play list, for example, thumbnail images representing each moving image are displayed side by side for each moving image file. The thumbnail image may be one frame forming a moving image, and may be the first frame or the last frame. In FIG. 4A, N thumbnail images of moving image 1 to moving image N are displayed. The reproduction device 10 acquires the information necessary for displaying the reproduction list from the server 2.

The predetermined information (star mark in this example) attached to the thumbnail image indicates that the reaction moving image exists for the moving image corresponding to the thumbnail image. The reaction video may be the above-mentioned child video, grandchild video, or grandchild video. The thumbnail image to which the predetermined information is not attached indicates that the reaction moving image does not exist for the moving image corresponding thereto. In the example of FIG. 4A, the thumbnail images showing the moving image 1, the moving image 3, and the moving image 4 are marked, so that the reaction moving images are associated with these three moving images.
Although FIGS. 4A and 4B exemplify the horizontally long display by the display/input unit 20, the vertically long display may be used.

2. Display of Playback Preparation Screen In the playback device 10, the viewer taps the display position of one of the thumbnail images in the display screen of FIG. 4A, and the moving image corresponding to the thumbnail image tapped. The reproduction preparation screen of is displayed on the display/input unit 20.

<Video playback when reaction video does not exist>
The reproduction device 10 displays the reproduction preparation screen shown in FIG. 4B when the viewer taps the display position of the thumbnail image of the moving image 2 from the reproduction list of FIG. 4A. It is displayed on the input unit 20. FIG. 4B is a diagram illustrating a reproduction preparation screen of the moving image 2. In the video 2, the reaction video does not exist.

In FIG. 4B, a still image representative of the moving image 2 is displayed on the display/input unit 20, and a reproduction icon 25 is also displayed in an overlapping manner. The still image representing the moving image 2 may be generated based on the reproduced image of the moving image 2 (such as the top image when the moving image 2 is reproduced), and the reproducing device 10 reproduces the moving image 2 from the server 2 before reproducing the moving image. A representative still image is acquired.

The reproducing apparatus 10 causes the display/input unit 20 to display a reproduced image based on the image file of the moving image 2 when the viewer taps the reproduction icon 25 on the reproduction preparation screen of the moving image 2.
In the reproduction preparation screen of FIG. 4B, the still image representative of the moving image 2 is displayed on the entire display/input unit 20, but the still image representative of the moving image 2 is displayed on the display/input unit 20. It may be displayed on the department. Further, even when the reproduced image of the moving image 2 is displayed on the display/input unit 20, the moving image 2 may be displayed on the entire display/input unit 20, or the moving image 2 may be displayed on a part of the display/input unit 20. It may be displayed.

Further, when the viewer taps the display position of the thumbnail image of the moving image 2 from the reproduction list of FIG. 4A, the reproduction preparation screen shown in FIG. 4B is displayed/displayed on the input unit 20. Without, that is, without the reproduction icon 25 on the reproduction preparation screen being tapped by the viewer, the reproduction of the moving image 2 is started and the reproduced image based on the image file of the moving image 2 is displayed on the display/input unit 20. It may be done.

<Video playback when reaction video exists>
The reproducing apparatus 10 displays the reproduction preparation screen of the moving image 1 on the input/output unit 20 when the viewer taps the display position of the thumbnail image of the moving image 1 from the reproduction list of FIG. 4A. Display it. The movie 1 has a reaction movie. Although illustration is omitted, on the reproduction preparation screen of the moving image 1, a still image representing the moving image 1 is displayed on the display/input unit 20. Similar to the case of the reproduction preparation screen for the moving image 2, the reproducing device 10 acquires a still image representing the moving image 1 from the server 2 before reproducing the moving image. The still image representative of the moving image 1 may be generated based on the reproduced image of the moving image 1 (such as the top image when the moving image 1 is reproduced).

The reproduction device 10 causes the display/input unit 20 to display a reproduction image to be described later when the reproduction icon 25 is tapped by the viewer on the reproduction preparation screen of the moving image 1.
Note that when the viewer taps the display position of the thumbnail image of the movie 1 from the playback list of FIG. 4A, without displaying the playback preparation screen of the movie 1 on the display/input unit 20. The reproduction of the moving image 1 may be started and a reproduced image to be described later may be displayed on the display/input unit 20.

When there is a reaction video, the playback device 10 makes it possible to view the playback images of a plurality of videos including the original video and the reaction video in parallel on the same time axis, and the relationship between the plurality of videos being played back and displayed. (Displaying which moving image the animal (for example, a person) shown in the reaction moving image is watching) is displayed. FIG. 5 is a diagram illustrating a reproduced image of a moving image in which a reaction moving image exists.

(Display by picture-in-picture (PIP))
FIG. 5A shows a moving image in which the display region of the original moving image includes the display region of the reaction moving image, that is, the relationship of a plurality of moving images is shown by the relationship of picture-in-picture (PIP). It is a figure which illustrates the reproduction|regeneration image of. In FIG. 5A, the display/input unit 20 displays a reproduction image 50 of the moving image 1 (parent 1) which is the original moving image and a reproduction image 60 of the child moving image 1 (child 1) which is a reaction image for the moving image 1. Has been done.

According to FIG. 5A, by arranging the reproduced image 60 of the child moving image 1 in the display area of the reproduced image 50 of the moving image 1, the relationship that the child moving image 1 is a reaction moving image for the moving image 1 is shown. That is, the reproduced image 60 of the child moving image 1 that is a reaction image for the moving image 1 that is the original moving image is included in the display area of the reproduced image 50 of the moving image 1.

The reproducing apparatus 10 acquires the moving image 1 and the child moving image 1 from the server 2 when reproducing the moving image. The reproduced image of FIG. 5A displayed on the display/input unit 20 is a superimposed display of the moving image 1 and the child moving image 1. The playback device 10 may combine the moving image 1 and the child moving image 1 acquired from the server 2 into one moving image, or may acquire the moving image in which the moving image 1 and the child moving image 1 are combined into one moving image from the server 2. You may do it.
Although the reproduced image 50 of the moving image 1 is displayed on a part of the display/input unit 20 in FIG. 5A, it may be displayed on the entire display/input unit 20.

(Display of arrow)
FIG. 5B is a diagram exemplifying a reproduced image of a moving image, which shows the relationship between a plurality of moving images by connecting the display region of the original moving image and the display region of the reaction moving image with an arrow. In FIG. 5B, a playback image 50 of the moving image 1 (parent 1) which is the original moving image, a playback image 60 of the child moving image 1 (child 1) which is a reaction image for the moving image 1, and a child are displayed on the display/input unit 20. A reproduction image 70 of the grandchild video 1 (grandchild 1), which is a reaction image for the video 1, is displayed.

According to FIG. 5B, by displaying the information of the arrow from the reproduced image 60 toward the reproduced image 50, the relationship that the child moving image 1 is a reaction moving image for the moving image 1 is shown. Further, by displaying the information of the arrow from the reproduced image 70 to the reproduced image 60, the relationship that the grandchild moving image 1 is a reaction moving image for the child moving image 1 is shown.

Note that the playback device 10 may display the information of the arrow when playing the moving picture 1, the child moving picture 1, and the grandchild moving picture 1 acquired from the server 2, respectively. It is also possible to acquire a moving image in which the information of 1, the grandchild moving image 1, and the information of the arrow are combined as one moving image, and to play the acquired moving image.

Further, the display size of the reproduction image 60 may be different from that of the reproduction image 50, and the display size of the reproduction image 70 may be different from that of the reproduction image 60. In the example of FIG. 5B, the relationship between the original moving image and the reaction moving image with respect to the original moving image is shown by the information of the arrow between the reproduced images regardless of the display size of each reproduced image.
Furthermore, in the example of FIG. 5B, the example in which the moving image existing on the starting point side of the arrow is the reaction moving image for the moving image existing on the ending point side of the arrow has been described, but the direction of the arrow may be reversed. ..

(Display with different shapes)
FIG. 5C is a diagram exemplifying a reproduced image of a moving image, which shows the relationship between a plurality of moving images by making the shape of the display region of the original moving image different from the shape of the display region of the reaction moving image. In FIG. 5C, a playback image 50 of the moving image 1 (parent 1) that is the original moving image, a playback image 60 of the child moving image 1 (child 1) that is a reaction image for the moving image 1, and a child are displayed on the display/input unit 20. A reproduction image 70 of the grandchild video 1 (grandchild 1), which is a reaction image for the video 1, is displayed.

According to FIG. 5C, the display shape of the reproduced image 50 is a quadrangle, and the display shape of the reproduced image 60 is more than square, for example, octagonal, so that the child moving image 1 is a reaction moving image for the moving image 1. Show the relationship that there is. In addition, by setting the display shape of the reproduced image 70 to be a shape with more angles than octagons, for example, an elliptical shape, the relationship that the grandchild moving image 1 is a reaction moving image with respect to the child moving image 1 is shown.

The playback device 10 may combine the moving image 1, the child moving image 1, the grandchild moving image 1, and the information indicating the display shape of each moving image acquired from the server 2 into one moving image, or from the server 2 , The moving image 1, the child moving image 1, and the grandchild moving image 1 may be obtained as a single moving image combined in the above display shape.

Further, the reproduced images 50 to 70 may be displayed so as to be superimposed on each other. Further, the display size of the reproduction image 60 may be different from that of the reproduction image 50, and the display size of the reproduction image 70 may be different from that of the reproduction image 60. In the example of FIG. 5C, the relationship between the original moving image and the reaction moving image with respect to the original moving image is shown by the display shape of each reproduced image regardless of the display size of the reproduced images and the overlapping of the displays.
Further, in the example of FIG. 5C, the display shape is a quadrangle, an octagon, and an ellipse, but other display shapes may be adopted.

(Display with different display sizes)
FIG. 5D is a diagram exemplifying a reproduced image of a moving image, which shows the relationship between a plurality of moving images by making the display size of the display region of the original moving image different from the display size of the display region of the reaction moving image. In FIG. 5D, a playback image 50 of the moving image 1 (parent 1) which is the original moving image, a playback image 60 of the child moving image 1 (child 1) which is a reaction image for the moving image 1, and a child are displayed on the display/input unit 20. A reproduction image 70 of the grandchild video 1 (grandchild 1), which is a reaction image for the video 1, is displayed.

FIG. 5D shows the relationship that the child moving image 1 is a reaction moving image with respect to the moving image 1 by making the display size of the reproduced image 50 larger than the display size of the reproduced image 60. Further, by making the display size of the reproduced image 60 larger than the display size of the reproduced image 70, the relationship that the grandchild moving image 1 is a reaction moving image for the child moving image 1 is shown.

The playback device 10 may combine the moving image 1, the child moving image 1, the grandchild moving image 1, and the information indicating the display size, which are acquired from the server 2, into one moving image, or the server 2 may move the moving image 1 to the moving image 1. Alternatively, the moving image in which the child moving image 1 and the grandchild moving image 1 are combined into one moving image with the display size may be acquired.

Further, the reproduced images 50 to 70 may be displayed so as to be superimposed on each other. In the example of FIG. 5D, the relationship between the original moving image and the reaction moving image with respect to the original moving image is shown depending on the display size of each reproduced image regardless of the overlapping of the reproduced images.

(Display by overlapping playback images)
FIG. 5E is a diagram illustrating a moving image reproduction image showing the relationship between a plurality of moving images by overlapping display of the display region of the original moving image and the display region of the reaction moving image. In FIG. 5( e ), a playback image 50 of the moving image 1 (parent 1) that is the original moving image, a playback image 60 of the child moving image 1 (child 1) that is a reaction image for the moving image 1, and a child are displayed on the display/input unit 20. A reproduction image 70 of the grandchild video 1 (grandchild 1), which is a reaction image for the video 1, is displayed.

FIG. 5E shows the relationship that the child moving image 1 is a reaction moving image with respect to the moving image 1 by displaying a part of the reproduced image 60 over the reproduced image 50. Also, by displaying a part of the reproduced image 70 over the reproduced image 60, the relationship that the grandchild moving image 1 is a reaction moving image for the child moving image 1 is shown.

The playback device 10 may combine these as one moving image based on the moving image 1, the child moving image 1, the grandchild moving image 1, and the information indicating the stacking order of these obtained from the server 2, or from the server 2, You may make it acquire the moving image which combined the moving image 1, the child moving image 1, and the grandchild moving image 1 as one moving image by the said superposition order.

The display sizes of the reproduced images 50 to 70 may be different from each other. In the example of FIG. 5D, the relationship between the original moving image and the reaction moving image with respect to the original moving image is shown by the overlap of the reproduced images, regardless of the display size of each reproduced image.

(Display by blowing out)
FIG. 5( f) is a diagram exemplifying a reproduced image of a moving image, which shows the relationship between a plurality of moving images by connecting the display region of the original moving image and the display region of the reaction moving image by blowing out. In FIG. 5( f ), the display/input unit 20 displays a reproduction image 50 of the moving image 1 (parent 1) that is the original moving image and a reproduction image 60 of the child moving image 1 (child 1) that is a reaction image for the moving image 1. Has been done.

According to FIG. 5F, by displaying the blowing information from the reproduced image 60 toward the reproduced image 50, the relationship that the child moving image 1 is the reaction moving image for the moving image 1 is shown.

Note that the playback device 10 may combine the information of the moving image 1, the child moving image 1, and the blowing out acquired from the server 2 as one moving image, or the information of the moving image 1, the child moving image 1 and the blowing out from the server 2 may be combined. You may make it acquire the moving image synthesize|combined as one moving image.

Further, the display size of the reproduced image 60 may be different from that of the reproduced image 50. In the example of FIG. 5(f), the relationship between the original moving image and the reaction moving image with respect to the original moving image is shown by the information on the blowing out between the reproduced images regardless of the display size of each reproduced image.
Furthermore, in the example of FIG. 5(f), the example in which the moving image existing on the start point side of the blowing is the reaction moving image for the moving image existing in the blowing direction has been described, but the blowing direction may be reversed.

As described above, when the original moving image, the child moving image, the grandchild moving image, and so on can be viewed, since the display showing the relationship between the original moving image, the child moving image, and the grandchild moving image is displayed, they are reflected in the child moving image and the grandchild moving image It is possible to know which video the animal (for example, a person) is watching and reacting to. That is, the information indicating the relationship between each moving image indicates the moving image that the animal (for example, a person) shown in the child moving image or the grandchild moving image is watching. By showing the relationship between the original video, the child video, and the grandchild video, it is possible to further entertain the viewer who watches the reaction.

In the reproduced images of FIGS. 5(a) to 5(f), a position different from the main subject in the original moving image 1 is the reproduced image of the reaction moving image (reproduced image 60 of the child moving image 1, reproduced image of the grandchild moving image 1). 70) is the display position. For example, in FIG. 5A, by displaying the reproduced image 60 at a position that does not overlap the main subject of the moving image 1 (reproduced image 50), an animal (for example, a person) reflected in the child moving image (reproduced image 60) can view it. The main subject of the moving image 1 (reproduced image 50) that has been displayed is not hidden. By displaying the reproduced image 60 and the reproduced image 70 at a position where they do not cover the main subject in the moving image 1, it is possible to determine which moving image the animal (eg, person) in the child moving image or the grandchild moving image is watching and reacting to. You can make it easier to understand.

In each of FIGS. 5(a) to 5(f), the viewer displays the reproduced image 50 of the moving image 1 that is the original moving image, the reproduced image 60 of the child moving image 1, the reproduced image 70 of the grandchild moving image 1, and the like. The playback device 10 moves the display position of the target window within the screen of the display/input unit 20 by swiping the window. The window is a display area of the reproduced images 50, 60, and 70 of each moving image, and is not limited to a rectangle, and may be an octagon, an ellipse, or a blowout shape as described above. In addition, the playback device 10 may change the display size of the target window by the viewer performing a pinch-in/pinch-out operation on the window.

<Explanation of flow chart>
A processing procedure by the moving image viewing system 1 described above will be described with reference to a flowchart of FIG. In FIG. 6, the flow of processing by the server 2 is shown on the left side, and the flow of processing by the playback device 10 (may be PC 4) on the viewer side is shown on the right side.

<Processing of Reproducing Device 10>
For example, the control unit 30 of the reproduction device 10 starts the process shown in FIG. 6 when the reaction moving image reproduction application is activated. In step S21 of FIG. 6, the control unit 30 accesses the server 2 corresponding to the URL based on the URL (Uniform Resource Locator) information of the server 2. When the information of the moving picture playlist provided from the server 2 is transmitted to the reproducing apparatus 10, the control unit 30 displays the playlist list to the display/input unit 20 of the reproducing apparatus 10 in step S22 based on the received information. Display it. As a result, the viewer can browse the video playlist provided from the server 2. The play list is as illustrated in FIG.
The server 2 can provide, for example, the moving image information recorded in the database by narrowing it down by area or genre described above.

In step S23, the control unit 30 determines whether or not there is a reproduction instruction. When the display position of the thumbnail image illustrated in FIG. 4A is tapped, the control unit 30 requests the server 2 to transmit the corresponding moving image. The control unit 30 displays the reproduction preparation screen shown in FIG. 4B on the display/input unit 20 of the reproduction device 10 when the thumbnail image of the moving image 2 is tapped in the reproduction list of FIG. 4A, for example. Let The images forming the reproduction preparation screen are acquired from the server 2 prior to starting the reproduction of the moving image (step 25). Then, when the reproduction mark 25 is tapped on the reproduction preparation screen, an affirmative decision is made in step S23 and the operation proceeds to step S24. In step S24, a reproduction request of the moving picture 2, that is, the moving picture 2 corresponding to the thumbnail operated by tapping, is displayed. Request transmission to the server 2.

The control unit 30 displays the reproduction preparation screen of FIG. 4B on the display/input unit 20 of the reproduction device 10 when the thumbnail image of the moving image 2 is tapped in the reproduction list of FIG. Alternatively, the process may proceed to step S24 without sending the request, and in step S24, the reproduction request for the moving image 2 may be transmitted to the server 2. It is assumed that whether or not to display the reproduction preparation screen is set in advance by menu setting or the like.

Further, for example, when the thumbnail image of the moving image 1 is tapped in the reproduction list of FIG. 4A, the control unit 30 causes the display/input unit 20 of the reproducing device 10 to display the reproduction preparation screen for the moving image 1. As described above, the reproduction device 10 acquires the images forming the reproduction preparation screen from the server 2 before starting the reproduction of the moving image (step 25).

Even when the thumbnail image of the moving image 1 is tapped in the reproduction list of FIG. 4A, the process proceeds to step S24 without displaying the reproduction preparation screen for the moving image 1 on the display/input unit 20 of the reproducing device 10, In S24, the reproduction request of the moving image 1 may be transmitted to the server 2.

Note that whether or not to display the reproduction preparation screen on the display/input unit 20 of the reproduction device 10 may be set based on the information transmitted from the server 20.

The control unit 30 receives the moving image from the server 2 and starts the reproduction of the moving image in step S25. Specifically, the display/input unit 20 displays the reproduced image of the moving image requested to be reproduced. When the download reproduction is performed, the reproduction of the moving image is started after the moving image is received from the server 2 and stored in the nonvolatile memory 35. When streaming reproduction is performed, the moving image received by streaming from the server 2 is buffered in a volatile memory (not shown) and reproduction is started.

Here, for example, when the playback request is made for the moving image 1 in which the reaction moving image exists, the control unit 30 sends the reaction moving image child moving image 1 and grandchild moving image 1 from the server 2 in addition to the original moving image 1. To receive. Further, the information for displaying the information indicating the relationship between the original moving image and the reaction moving image is received from the server 2, and the reproduced image is displayed on the display/input unit 20 based on the received information. On the other hand, for example, when requesting reproduction of the moving image 2 in which no reaction moving image exists, the control unit 30 receives only the moving image 2 and displays the reproduced image on the display/input unit 20.

In step S26, the control unit 30 ends the reproduction of the moving image transmitted from the server 2, and returns to step S22. After returning to step S22, the control unit 30 repeats the above-described processing.

The information for displaying the information indicating the relationship between the original moving image and the reaction moving image is exemplified in FIGS. 5(a) to 5(f) in the playback device 10 that has received the moving image (the original moving image and the reaction moving image). This is information necessary for displaying (displaying the relationship between the original moving image, the child moving image, and the grandchild moving image). That is, at least which reaction video (child video) corresponds to a certain video, which reaction video (grandchild video) corresponds to a child video, and which reaction video (grandchild video) corresponds to a grandchild video. Contains identifiable information.

Based on the information for displaying the information indicating the relationship between the original moving image and the reaction moving image, the control unit 30 of the playback device 10 indicates the relationship between the original moving image and the reaction moving image, and the moving image 1 that is the original moving image. Even if an image displayed on the display/input unit 20 is generated by arranging the reproduced image 50 of No. 1, the reproduced image 60 of the child moving image 1 that is the reaction image, and the reproduced image 70 of the grandchild moving image 1 that is the reaction image. Good.

Further, the control unit 30 of the playback device 10 is the original moving image so as to show the relationship between the original moving image and the reaction moving image based on the information for displaying the information indicating the relationship between the original moving image and the reaction moving image. An image displayed on the display/input unit 20 by determining the display sizes of the reproduced image 50 of the moving image 1, the reproduced image 60 of the child moving image 1 that is a reaction image, and the reproduced image 70 of the grandchild moving image 1 that is a reaction image. May be generated.

Furthermore, the control unit 30 of the reproduction device 10 displays the relationship between the original moving image and the reaction moving image based on the information for displaying the information indicating the relationship between the original moving image and the reaction moving image. A display shape of a reproduced image 50 of a certain moving image 1, a reproduced image 60 of a child moving image 1 that is a reaction image, and a reproduced image 70 of a grandchild moving image 1 that is a reaction image is determined and displayed on the display/input unit 20. Images may be generated.

Further, the control unit 30 of the playback device 10 is a moving image that is an original moving image so as to show the relationship between the original moving image and the reaction moving image based on the information for displaying the information indicating the relationship between the original moving image and the reaction moving image. 1 is displayed, the reproduced image 60 of the child moving image 1 that is the reaction image, and the reproduced image 70 of the grandchild moving image 1 that is the reaction image are attached with the information of the arrow or the blowing information, and displayed/input. An image displayed on the unit 20 may be generated.

<Processing of server 2>
In step S11 of FIG. 6, the server 2 transmits the information of the play list of the playable moving image to the playback device 10, and proceeds to step S12.

In step S12, the server 2 determines whether there is a reproduction request from the reproduction device 10. When the server 2 receives the reproduction request from the reproduction device 10, the server 2 makes an affirmative decision in step S12 and the operation proceeds to step S13. When the server 2 does not receive the reproduction request from the reproduction device 10, the server 2 makes a negative determination in step S12 and returns to step S11.

In step S13, the server 2 transmits the target moving image. When the reaction video corresponding to the target video exists, the server 2 transmits the corresponding reaction video to the playback device 10 in addition to the target video. Further, the server 2 transmits to the reproducing device 10 information for displaying information indicating the relationship between the original moving image and the reaction moving image on the reproducing device 10. On the other hand, the server 2 transmits only the target moving image when the reaction moving image does not exist in the target moving image.
It should be noted that the original moving image, the reaction moving image (child moving image, grandchild moving image,...) And the information for displaying the information indicating the relationship between the original moving image and the reaction moving image are stored in a database (not shown), and the server 2 , And reads the above information from the database and transmits it to the reproducing apparatus 10.

The server 2 returns to step S11 after performing the above transmission to the playback device 10. The server 2 that has returned to step S11 repeats the above-described processing.

The information for displaying the information indicating the relationship between the original moving image and the reaction moving image is exemplified in FIGS. 5(a) to 5(f) in the playback device 10 that has received the moving image (the original moving image and the reaction moving image). This is information necessary for displaying (displaying the relationship between the original moving image, the child moving image, and the grandchild moving image). That is, at least which reaction video (child video) corresponds to a certain video, which reaction video (grandchild video) corresponds to a child video, and which reaction video (grandchild video) corresponds to a grandchild video. Contains identifiable information.

In the present embodiment, the original moving image and the reaction moving image (child moving image, grandchild moving image,...) Are individually stored in the database. That is, for example, the original moving image is stored in the database as one file, the child moving image 1 as one file, and the grandchild moving image 1 as one file. The server 2 has information for displaying information indicating the relationship between the original moving image and the reaction moving image on the playback device 10, and this information is displayed in step S13 as the moving image (original moving image, child moving image, grandchild moving image,... ) Is transmitted to the reproducing apparatus 10. The information for displaying the information indicating the relationship between the original moving image and the reaction moving image may be transmitted to the playback device 10 prior to transmitting the moving image.
In the reproduced images of FIGS. 5A to 5F, the reaction moving image (child moving image 1, grandchild moving image 1,...) Is displayed at a position different from the main subject in the moving image 1 which is the original moving image. The display position is based on information for displaying information indicating the relationship between the original moving image and the reaction moving image. The display position information is included in the information for displaying the information showing the relationship between the original video and the reaction video, or included in the information for displaying the information showing the relationship between the original video and the reaction video. 2 may be transmitted to the reproducing apparatus 10.

In the above-mentioned embodiment, when the original video is deleted in the server 2, the server 2 determines that the reaction video (child video, grandchild video,...) Corresponding to the original video or the relationship between the original video and the reaction video. The information for displaying the information indicating may also be deleted in conjunction.

The following modifications are also within the scope of the present invention, and one or more modifications can be combined with the above-described embodiment.
(Modification 1)
In the above-described embodiment, the example in which the original moving image and the reaction moving image (child moving image, grandchild moving image,...) Are individually (for example, as separate files) stored in the database has been described. Alternatively, the reaction video corresponding to the original video may be combined into one video (for example, one video file). In the first modification, the server 2 adds the replay image of the reaction video to a part of the replay image of the original video based on the information necessary to display the information indicating the relationship between the original video and the reaction video. Perform integration processing. Then, the moving image after the integration processing is stored in the database of the server 2 as a new original moving image (a moving image in which the original moving image and the reaction moving image are combined).

In the integration processing in the server 2, based on the information for displaying the information indicating the relationship between the original video and the reaction video, the playback image of the original video and the reaction video are displayed so as to show the relationship between the original video and the reaction video. The reproduced image is arranged, and the same image as the image displayed on the display unit 22 of the reproduction device 10 is generated. Further, a new original moving image is generated based on the image.

In addition, in the integration processing in the server 2, based on the information for displaying the information indicating the relationship between the original moving image and the reaction moving image, the reproduced image of the original moving image and the reaction are displayed so as to show the relationship between the original moving image and the reaction moving image. The size of the reproduced image of the moving image is determined, and the same image as the image displayed on the display unit 22 of the reproduction device 10 is generated. Further, a new original moving image is generated based on the image.

In addition, in the integration processing in the server 2, based on the information for displaying the information indicating the relationship between the original moving image and the reaction moving image, the reproduced image of the original moving image and the reaction are displayed so as to show the relationship between the original moving image and the reaction moving image. The shape of the reproduced image of the moving image is determined, and the same image as the image displayed on the display unit 22 of the reproduction device 10 is generated. Further, a new original moving image is generated based on the image.

In addition, in the integration processing in the server 2, based on the information for displaying the information indicating the relationship between the original video and the reaction video, the playback image and the reaction of the original video are displayed so as to show the relationship between the original video and the reaction video. A code or the like is added to the reproduced image of the moving image to generate the same image as the image displayed on the display unit 22 of the reproduction device 10. Further, a new original moving image is generated based on the image.

Further, in the integration processing in the server 2, based on the information for displaying the information indicating the relationship between the original video and the reaction video, the playback image and the reaction video of the original video are displayed so as to show the relationship between the original video and the reaction video. The same image as the image displayed on the display unit 22 of the reproducing apparatus 10 is generated by adding an arrow between the reproduced image and the reproduced image. Further, a new original moving image is generated based on the image.

According to the first modification, the reaction moving image is integrated with the original moving image and one moving image is generated, so that the load at the time of the reproduction processing is reduced as compared with the case where the original moving image and the reaction moving image are reproduced in parallel. be able to. Specifically, the server 2 only needs to transmit the moving image after the integration process to the playback device 10 in step S13. Further, the playback device 10 does not need to receive the information for displaying the information indicating the relationship between the original moving image and the reaction moving image, and only needs to play the moving image after the integration process in steps S25 to S26.

(Modification 2)
The integration process performed by the server 2 of the first modification may be performed by the playback device 10. That is, the reproduction device 10 performs an integration process of adding the reaction video to a partial area of the reproduction image of the original video based on the information for displaying the information indicating the relationship between the original video and the reaction video, and the integration process. Upload the later video to server 2. The server 2 saves the posted integrated moving image in the database of the server 2.

According to the second modification, the reproducing apparatus 10 integrates the reaction moving image into the original moving image, and thus the processing load on the server 2 side can be reduced.

(Modification 3)
In the above-described embodiment, an example has been described in which the server 2 and the viewer's playback device 10 configure the moving image viewing system 1, but the video playback system 1 may be configured in the viewer's playback device 10. In the case of the modified example 3, the viewer views a video stored in the playback device 10 (for example, the non-volatile memory 35), and the reaction video in which the reaction of the viewer who views this video is captured is played back by the viewer. It records in 10 (for example, non-volatile memory 35). That is, the playback device 10 displays, on the display/input unit 20, a playback image of a movie (original movie, reaction movie) stored in the playback device 10 instead of the movie provided from the server 2 as the movie content. To do.

According to the third modification, the original moving image, the child moving image, the grandchild moving image,... Can be viewed only by the playback device 10, and the viewer can enjoy the reaction. The original moving image stored in the playback device 10 may be downloaded from the server 20. Further, the reaction moving image stored in the playback device 10 does not necessarily have to be captured by the playback device 10, and may be downloaded from the server 20.

(Modification 4)
In the above embodiment, referring to the reproduced images of FIGS. 5(a) to 5(f), the reaction moving image (child moving image, grandchild moving image,...) At a position different from the main subject in the moving image 1 which is the original moving image. The example of displaying is explained. Instead of this, the reaction moving image (child moving image, grandchild moving image,...) May be displayed at a position different from the target of interest of the animal (eg, person) in the reaction moving image (child moving image, grandchild moving image,... ).

In the modified example 4, the reproducing apparatus 10 for photographing the reaction is provided with the line-of-sight detection function. The line-of-sight detection device detects the line-of-sight position of the viewer who views the screen of the display/input unit 20, and generates line-of-sight information indicating the screen region of the display/input unit 20 that the viewer is gazing at. For gaze detection, the corneal reflection method that detects the direction of the line of sight by reflecting infrared light on the cornea of the viewer's eye, the limbus tracking method that uses the difference in light reflectance between the cornea and the sclera, and the viewer There is an image analysis method in which a video of the eyeball is captured by the camera 11 and the visual line is detected by image processing, and any visual line detection method may be used. The playback device 10 that has photographed the reaction may upload the reaction moving image and the generated line-of-sight information when uploading the information associating the original moving image and the reaction moving image to the server 2. Further, the server 2 displays the line-of-sight information together with the information for displaying the information indicating the relationship between the original moving image and the reaction moving image, or the information for displaying the information indicating the relationship between the original moving image and the reaction moving image. And may be transmitted to the reproducing apparatus 10.

According to the modified example 4, the reproducing apparatus 10 that reproduces the reaction moving image focuses on the moving image 1 that is the original moving image, based on the received line-of-sight information, in which the animal (for example, a person) shown in the reaction moving image (child moving image) appears. It is possible to display a reaction video (child video) at a position different from the area. Similarly, it becomes possible to display the reaction moving image (grandchild moving image) at a position where an animal (for example, a person) shown in the reaction moving image (grandchild moving image) is different from the region of interest in the child moving image.

According to the modified example 4, the playback device 10 avoids a region in which an animal (for example, a person) shown in a reaction moving image (child moving image, grandchild moving image,...) In an original moving image (including a child moving image) avoids a reaction. By displaying the moving image, it is possible to know what the animal (for example, a person) reflected in the reaction moving image is reacting to and further entertain the viewer who sees the reaction.

(Modification 5)
In contrast to the modified example 4, the playback device 10 includes a frame surrounding a region in which an animal (for example, a person) in a reaction moving image (child moving image, grandchild moving image,...) Of an original moving image (including a child moving image) is focused. May be displayed, for example, so that the region of the original moving image in which the animal (for example, a person) noticed in the reaction moving image (child moving image, grandchild moving image,...) Attention is displayed in an easy-to-understand manner. According to the modified example 5, it is possible to show what the animal (for example, a person) reflected in the reaction video is reacting to.

(Modification 6)
In the above description, in each of the examples of FIGS. 5A to 5F, the viewer pinches in/pinchs the window displaying the child moving image 1, the child moving image 2, the child moving image N, the grandchild 1, the grandchild 2, etc. The example has been described in which the playback device 10 changes the display size of the target window by performing the out operation. Alternatively, the server 2 (or the reproduction device 10) may automatically change the display size of the window.

In the modified example 6, the server 2 detects the timing when the reaction becomes large in the reaction moving image (child moving image, grandchild moving image,... ). The timing is detected, for example, by at least one of a large amount of change in the facial expression of the animal reflected in the reaction video, a large amount of change in the image by the reaction video, and a large amount of change in the sound recorded with the reaction video. Detect the case corresponding to. Then, the server 2 reduces the display size of the original image when the detected timing is reached during the reproduction of the reaction moving image, and increases the size of the window for displaying the corresponding reaction moving image. In this way, the relationship between the original moving image and the reaction moving image is shown by synchronizing and changing the sizes of displaying the original moving image and the corresponding reaction moving image.
When the detected timing is reached, the display size of the original image may be increased and the size of the window for displaying the corresponding reaction moving image may be decreased.

(Modification 7)
FIG. 7A to FIG. 7C are diagrams for explaining another example of the reproduced image of the moving image when the reaction moving image exists.
(Display by code)
FIG. 7A is a diagram exemplifying a reproduced image of a moving image, which indicates the relationship between a plurality of moving images by displaying a code in the display region of the child moving image. In FIG. 7A, the display/input unit 20 displays the reproduced image 50 of the moving image 1 (parent 1) that is the original moving image and a plurality of child moving images. The plurality of child moving images are a reaction image 60a of a child moving image 1 (child 1) which is a reaction image for the moving image 1, a reproduced image 60b of a child moving image 2 (child 2) which is a reaction image for the moving image 1, and a reaction for the moving image 1. A reproduced image 60c of the child moving image 3 (child 3) which is an image is included.

According to FIG. 7A, the reference numeral 43a is displayed on the reproduction image 60a, the reference numeral 43b is displayed on the reproduction image 60b, and the reference numeral 43c is displayed on the reproduction image 60c. 3 shows the time before and after the time when each image was taken. For example, a larger value of the code may indicate that the image is captured later. A number, a character, a symbol, a figure, a mark, or the like may be attached instead of the code or in combination with the code.

In FIG. 7A, as in the case of FIG. 5E, by displaying a part of the reproduced image 60a, the reproduced image 60b, and the reproduced image 60c on the reproduced image 50, the child moving image 1 is displayed. ~ Indicates that the child moving image 3 corresponds to the moving image 1. In this way, when the relationship between the original moving image and the reaction moving image is shown by overlapping display, the display size of the reproduced image 50 may be the same as the display size of the reproduced images 60a, 60b, and 60c.

Note that, in FIG. 7A, as in the case of FIG. 5D, by reducing the display size of the reproduced image 60a, the reproduced image 60b, and the reproduced image 60c with respect to the display size of the reproduced image 50, the child image is displayed. It may be indicated that the moving image 1 to the child moving image 3 correspond to the moving image 1. In this way, when the relationship between the original moving image and the reaction moving image is indicated by different display sizes, the reproduced image 50 is reproduced from the reproduced image 50 without overlapping the reproduced image 60a, the reproduced image 60b, and the reproduced image 60c. The reproduced image 60a, the reproduced image 60b, and the reproduced image 60c may be displayed separately from each other.

In FIG. 7A, similarly to the case of FIG. 5A, the PIP display may indicate that the child moving images 1 to 3 correspond to the moving image 1. Further, as in the case of FIG. 5B, the display of the arrows may indicate that the child moving images 1 to 3 correspond to the moving image 1. Further, as in the case of FIG. 5C, it may be indicated that the sub-moving images 1 to 3 correspond to the moving image 1 depending on the shape of the moving image display area. Furthermore, as in the case of FIG. 5(f), it may be shown that the child moving images 1 to 3 correspond to the moving image 1 by blowing out.

Further, in addition to displaying the code in the display area of the child moving image, in the case of displaying the code in the display area of the parent moving image, the reproduced image 60a, the reproduced image 60b, and the reproduced image 60c are not necessarily reproduced for the reproduced image 50. No need to stack. Furthermore, it is not always necessary to reduce the display size of the reproduction image 60a, the reproduction image 60b, and the reproduction image 60c with respect to the display size of the reproduction image 50. In this way, when the relationship between the original moving image and the reaction moving image is shown by displaying the code, the reproduced image 60a, the reproduced image 60b, and the reproduced image 60c may be displayed apart from the reproduced image 50. The reproduction images 60a, 60b and 60c may have the same display size.

(Display of combination by PIP and arrow)
In FIG. 7B, in the display/input unit 20, in the display area of the reproduced image 50 of the moving image 1 (parent 1) which is the original moving image, the reproduced image of the child moving image 1 (child 1) which is the reaction image for the moving image 1. By arranging 60a and arranging the reproduced image 60b of the child moving image 2 (child 2) which is a reaction image for the moving image 1 in the display area of the reproduced image 50, the child moving image 1 and the child moving image 2 are respectively moved to the moving image 1. It shows the relationship that it is a reaction video for.

In FIG. 7B, reproduction images 70a to 70h of grandchild video a to grandchild video h that are reaction images for child video 1 (child 1) and grandchild video that is a reaction image to child video 2 (child 2) are further included. Playback images 70i to 70o of i to grandchild video o are displayed, respectively. By displaying the information of the arrows from the reproduced images 70a to 70h toward the reproduced image 60a, the relationship that the grandchild video a to the grandchild video h are the reaction video for the child video 1 (child 1) is shown. Further, by displaying the information of the arrows from the reproduced images 70i to 70o toward the reproduced image 60b, respectively, the relationship that the grandchild moving image i to the grandchild moving image o are reaction moving images for the child moving image 2 (child 2) is shown.

By displaying a code in each of the display areas of the reproduced images 70a to 70h of the grandchild videos a to h, the grandchild video a to the grandchild video h may be displayed before and after the time when they were respectively shot. Similarly, a symbol may be displayed in each of the display areas of the reproduced images 70i to 70o of the grandchild video i to the grandchild video o to indicate the time before and after the time when each of the grandchild video i to the grandchild video o was captured.

(Display different combinations of display sizes and arrows)
In FIG. 7(c), the display/input unit 20 displays a playback image 50 of the original movie 1 (parent 1), a playback image 60 of a child movie that is a reaction image of the movie 1, and a reaction image of the child movie. Playback images 70a to 70c of certain grandchild video a to grandchild video c, a playback image 80 of a grandchild video that is a reaction image for grandchild video b, and a playback image 90 of a grandchild video that is a reaction image to a grandchild video are displayed. There is.

FIG. 7C shows the relationship that the child moving image is a reaction moving image for the moving image 1 by making the display size of the reproduced image 50 larger than the display size of the reproduced image 60. Also, by displaying the information of the arrows from the reproduced images 70a to 70c toward the reproduced image 60, respectively, the relationship that the grandchild videos a to c are reaction videos to the child videos is shown. Further, by displaying the information of the arrow from the reproduced image 80 to the reproduced image 70b, the relationship that the grandchild video is the reaction video for the grandchild video b is shown. Furthermore, by displaying the information of the arrow from the reproduced image 90 toward the reproduced image 80, the relationship that the grandchild video is a reaction video with respect to the grandchild video is shown.

By displaying the codes in the display areas of the reproduced images 70a to 70c of the grandchild video a to the grandchild video c, respectively, it is possible to indicate the time before and after the time at which the grandchild video a to the grandchild video c were respectively captured.

As described above, when the original video, child video, grandchild video,... Can be viewed, the display showing the relationship between the original video, child video, grandchild video, great grandchild video, and grandchild video is made. It is possible to know which video the animal (for example, a person) shown in the video or the grandchild video is watching and reacting to. That is, the information indicating the relationship between each moving image indicates the moving image that the animal (for example, a person) shown in the child moving image or the grandchild moving image is watching. By showing the relationship between the original video, the child video, the grandchild video, etc., it is possible to further entertain the viewer who watches the reaction.
The example shown in FIG. 5A to FIG. 5F and the example shown in FIG. 7A to FIG.

(Modification 8)
In addition to the above-mentioned usage situations, the invention can be applied to the following cases.
1. When the moving image delivered live is the original moving image For example, the fighting game screen is used as the original moving image, and the reproduced image of the original moving image delivered live is displayed on the display device. The viewer 1 has the same pose and facial expression as the character operated by the player 1 on the game screen (playback image of the original moving image), and shoots the appearance with a video camera. The captured moving image is referred to as child moving image 1. This child moving image 1 is superimposed on the original image and delivered live.

The viewer 2 has the same pose and facial expression as the character operated by the player 2 on the game screen (reproduced image of the original moving image), and shoots the appearance with a video camera. The captured moving image is referred to as child moving image 2. This child moving image 2 is superimposed on the original image and delivered live.

After the live distribution is completed, the original video, the reaction video by the viewer 1 (child video 1), and the reaction video by the viewer 2 (child video 2) are combined and further published. The viewers 3, 4, and 5 who have seen it see the video and are invited to laugh at the funny poses and facial expressions. The reactions of the viewer 3, the viewer 4, and the viewer 5 are also photographed by the video camera to be grandchild moving picture 1, grandchild moving picture 2, and grandchild moving picture 3, respectively.

2. In the case where viewers who react react with each other in real time The type of the original moving image may be any of the above-mentioned usage scenes. If there are two or more (more than one) viewers watching the original video at the same time and the original video is playing at the same time, you can see the reaction of another viewer at the same time as your own reaction The reaction (that is, communication) to the reaction of the viewer can be performed.

At this time, whether the viewer 1 is reacting to the original moving image or the viewer 2 or the viewer 3 is determined by, for example, the line-of-sight detection of the viewer 1 (the playback device 10 of which the viewer 1 is gazing). This is possible by detecting the screen area of the display/input unit 20). The reproduction device 10 of the viewer 1 includes the line-of-sight information of the viewer 1 in the information necessary for synthesizing the display of the child moving image 1 in which the viewer 1 appears.

The playback device 10 of the viewer 1 displays the child moving image 1 in a smaller size than the original moving image, for example, and outputs a balloon including the child moving image 1 toward an area of the original moving image that is focused by the viewer 1. By displaying, the relationship between the original moving image and the child moving image 1 is shown.

Further, when the viewer 1's line of sight is not directed to the original video but to the child video 2 in which the viewer 2 is shown, the playback device 10 of the viewer 1 is the window of the child video 2 that is being watched by the viewer 1. By displaying a speech balloon including the child moving image 1 toward, the relationship between the child moving image 2 and the child moving image 1 is shown.

In this way, the window displaying the child moving image 1 in which the viewer 1 is reflected and the window displaying the child moving image 2 in which the viewer 2 who is the reaction target is changed to blow-out (may be an arrow) icon, The relationship between the child moving image 2 and the child moving image 1 can be graphically expressed.

According to the above-mentioned embodiment, the following effects can be obtained.
(1) The playback device 10 that displays a moving image includes a playback image of the original moving image 1, a playback image of a child moving image (reaction moving image) in which a viewer watching the played back moving image is captured, and the original moving image and the child moving image. And a display/input unit 20 for displaying an image including information indicating a relationship with. Accordingly, it is possible to show what the viewer reflected in the child moving image is reacting to (for example, the moving image that is the source of the reaction).

(2) The reproduction device 10 includes a control unit 30 that reproduces a moving image, a reproduced image of the original moving image reproduced by the control unit 30, a reproduced image of the child moving image reproduced by the control unit 30, and the original moving image and the child moving image. And a control unit 30 that generates an image including information indicating the relationship of With this, for example, when the original moving image and the child moving image are provided from the server 2, it is possible to indicate to which original moving image the viewer reflected in the child moving image reacts.

(3) The reproduction device 10 includes the control unit 30 that reproduces a moving image, and displays the reproduced image of the moving image in which the child moving image corresponding to the original moving image is combined. With this, for example, when a moving image is provided from the server 2, it is possible to indicate to which original moving image the viewer reflected in the child moving image reacts. Further, the moving image transmission load of the server 2 and the moving image reproduction load of the reproducing device 10 can be reduced.

(4) Based on the information that the reproduced image of the other moving image is arranged within the range of the reproduced image of one of the original moving image and the child moving image, to which original moving image the viewer reflected in the child moving image reacts Can be shown.

(5) It is possible to indicate to which original moving image the viewer reflected in the child moving image reacts by the arrow information pointing from the reproduced image of one of the original moving image and the child moving image to the reproduced image of the other moving image.

(6) At least one of a number, a character, a symbol, a code, a design, and a mark indicating the relationship between the original video and the child video indicates which original video the viewer in the child video is reacting to. You can

(7) By the information that the shape of the reproduced image of one of the original moving image and the child moving image is different from the shape of the reproduced image of the other moving image, it is possible to determine which original moving image the viewer in the child moving image is reacting to. Can be shown.

(8) Which original video the viewer in the child video is reacting to, based on the information that the size of the playback image of one of the original video and the child video is different from the size of the playback image of the other video Can be shown.

(9) By the information that the shape or size of the reproduced image of the original moving image or the child moving image changes, it is possible to indicate to which original moving image the viewer reflected in the child moving image reacts.

(10) In the playback device 10, the display/input unit 20 displays the information indicating the relationship between the original moving image and the child moving image, so that a normal moving image and a moving image having a reaction moving image (original moving image) can be distinguished. ..

(11) Even when there are a plurality of child videos as reaction videos, it is possible to indicate which original video the viewer in each child video is reacting to.

(12) Also, it is possible to indicate to which child video the viewer in the grandchild video is reacting.

(13) In the reproduction device 10, since the image displayed on the display/input unit 20 further includes information indicating the target of attention of the viewer in the reproduced image of the original moving image, what the viewer is reacting to (source It is possible to indicate which part of the reproduced image of the moving image is being reacted.

(14) In the reproduction device 10, the control unit 30 generates an image so that the attention target of the viewer (viewer reflected in the child video (grandchild video)) in the reproduced image of the original video is displayed. For example, by displaying the child moving image (grandchild moving image) at a position where the main subject in the original moving image is not covered by the child moving image (grandchild moving image), the child moving image (grandchild moving image) When the viewer shown in () captures the reaction, the target of attention can be visually recognized.

(15) The moving image viewing system 1 for processing a moving image receives a child moving image of a viewer watching a reproduced image of the original moving image and a server 2 that transmits the original moving image, and receives the transmitted original moving image and the subsidiary moving image. The playback device 10 includes a server 2 that stores information for displaying information indicating the relationship between the original moving image and the child moving image, and the server 2 transmits the original moving image and the child moving image when transmitting the original moving image and the child moving image. The information for displaying the information indicating the relationship with the moving image is transmitted. As a result, it is possible to provide the reproducing apparatus 10 with information indicating what the viewer in the child moving image is reacting to.

(16) The moving image viewing system 1 includes a reproduced image of a child moving image of a viewer who is watching a reproduced image of the original moving image, a reproduced image of the original moving image, and information indicating a relationship between the original moving image and the child moving image. The server 2 is provided for transmitting a moving image including the above based on a moving image reproduction request. This makes it possible to provide the playback device 10 with a moving image showing what the viewer in the child moving image is reacting to.

(17) In the moving image viewing system 1, the server 2 receives the child moving image and information indicating the relationship between the original moving image and the child moving image. Accordingly, for example, it is possible to obtain information indicating the relationship between the original moving image and the child moving image regarding the child moving image posted by the viewer.

(Modification 9)
The reaction device 10 may be configured to capture a reaction moving image and post the reaction moving image from the reproduction device 10 to the server 2. FIG. 8 is a flowchart illustrating a processing procedure by the moving image viewing system 1 according to the modified example 9. In FIG. 8, the processing flow by the server 2 is shown on the left side, and the processing flow by the playback device 10 (may be the PC 4) on the viewer side is shown on the right side.

In FIG. 8, the same steps as those in the flowchart of FIG. 6 are designated by the same step numbers as those in FIG. 6, and the description thereof will be omitted. Differences from FIG.

<Processing of Reproducing Device 10>
In step S250 following step S25 in FIG. 8, the control unit 30 of the playback device 10 causes the camera 11 to start shooting a moving image. The moving image captured by the camera 11 is a reaction moving image capturing a viewer who views the reproduced image displayed on the display/input unit 20.

The control unit 30 arranges the times of the start of the moving image reproduction (step S25) and the start of the moving image shooting (step S250) so that, for example, the timing of the happening in the reproduced image of the moving image and the reaction of the viewer in the reaction moving image can be determined. Match.

When the control unit 30 finishes the reproduction of the moving image distributed from the server 2 in step S26, it ends the moving image shooting by the camera 11 in step S252. The control unit 30 invalidates the operation of changing the display size (pinch-in/pinch-out) of the reproduced image of the moving image that is being reproduced while the reaction moving image is being captured.

In step S254, the control unit 30 generates information that associates the moving image (original moving image) reproduced in steps S25 to S26 with the reaction moving image recorded in steps S250 to S252. This generation information indicates that the reaction moving image corresponds to the original moving image.
The generation information is recorded in the non-volatile memory 35 by the control unit 30 together with the reaction moving image file.

In step S256, control unit 30 determines whether or not there is a posting instruction. The control unit 30 makes an affirmative decision in step S256 if the viewer has made an operation to post the reaction video to the server 2 side, and proceeds to step S258. In step S258, the control unit 30 uploads the reaction moving image and information associating the original moving image and the reaction moving image to the server 2 and returns to step S22. After returning to step S22, the control unit 30 repeats the above-described processing.

It should be noted that the disclosure period, disclosure range, etc. when the reaction video to be posted is made public so that it can be viewed by other viewers will be appropriately processed between the provider and the contributor.

On the other hand, when the viewer does not perform an operation of posting the reaction moving image to the server 2 side, the control unit 30 makes a negative determination in step S256 and returns to step S22. After returning to step S22, the control unit 30 repeats the above-described processing.

<Processing of server 2>
In the case of the modified example 9, with respect to the restriction on adding the reaction video to the original video (including the child video) that is the source of the reaction (range, period, number, etc. of viewers who can perform reaction) , The person who has the copyright of the original moving image (including the child moving image) that is the source of the reaction and the person who implements the moving image providing service shall be appropriately processed.

In step S140, which proceeds to step S13, the server 2 receives the moving image posted from the playback device 10, and proceeds to step S142. In step S142, the server 2 receives the association information (information that associates the original moving image with the reaction moving image), and proceeds to step S144.

In step S144, the server 2 generates information necessary for displaying the information of the playlist and the information indicating the relationship between the original moving image and the reaction moving image, and proceeds to step S146. The information of the reproduction list is information necessary for the reproduction device 10 to perform the display illustrated in FIG. That is, it is information indicating a representative thumbnail image of each reproducible moving image file and the presence or absence of a reaction moving image corresponding to each moving image.

Information necessary for displaying the information indicating the relationship between the original moving image and the reaction moving image is shown in FIGS. 5(a) to 5(f) on the playback device 10 side that has received the moving image (the original moving image and the reaction moving image). This is information necessary to perform the exemplified display (display indicating the relationship between the original moving image, the child moving image, and the grandchild moving image). That is, at least which reaction video (child video) corresponds to a certain video, which reaction video (grandchild video) corresponds to a child video, and which reaction video (grandchild video) corresponds to a grandchild video. Contains identifiable information.

In step S146, the server 2 updates the database that stores the moving image file. The server 2 adds the posted moving image, its associated information, and information for displaying information indicating the relationship between the original moving image and the reaction moving image to a database (not shown) and returns to step S11. The server 2 that has returned to step S11 repeats the above-described processing.

According to the modified example 9 described above, it is possible to capture a reaction movie on the playback device 10 side and post the captured movie to the server 2. Further, the server 2 can add the video posted from the playback device 10 to the database as a reaction video.

Although various embodiments and modifications have been described above, the present invention is not limited to these contents. Other modes that can be considered within the scope of the technical idea of the present invention are also included in the scope of the present invention.

1... Video viewing system, 2... Server, 10... Smartphone, playback device, 11, 12... Camera, 13... Communication unit, 20... Display/input unit, 30... Control unit

Claims (19)

A relationship between the reproduced image of the first moving image, the reproduced image of the second moving image obtained by photographing the animal watching the reproduced first moving image, and the relationship between the first moving image and the second moving image A display unit that displays an image including the information shown ,
It has a playback unit that plays back video
The moving image reproducing apparatus , wherein the image is a reproduced image of the third moving image reproduced by the reproducing unit. A relationship between the reproduced image of the first moving image, the reproduced image of the second moving image obtained by photographing the animal watching the reproduced first moving image, and the relationship between the first moving image and the second moving image a display unit for displaying an image including information indicating,
The moving image reproducing apparatus , wherein the information indicating the relationship between the first moving image and the second moving image is information that the shape or size of the reproduced image of the first moving image or the second moving image changes . A relationship between the reproduced image of the first moving image, the reproduced image of the second moving image obtained by photographing the animal watching the reproduced first moving image, and the relationship between the first moving image and the second moving image a display unit for displaying an image including information indicating,
The image reproduction apparatus further includes information indicating an attention target of the animal in the reproduction image of the first moving image . A relationship between the reproduced image of the first moving image, the reproduced image of the second moving image obtained by photographing the animal watching the reproduced first moving image, and the relationship between the first moving image and the second moving image A display unit that displays an image including the information shown ,
A playback unit that plays back movies
A relationship between the reproduced image of the first moving image reproduced by the reproducing unit, the reproduced image of the second moving image reproduced by the reproducing unit, and the relationship between the first moving image and the second moving image. And an image generation unit that generates the image including information indicating
The moving image reproduction device , wherein the image generation unit generates the image so that the attention target of the animal in the reproduced image of the first moving image is displayed . The video playback device according to any one of claims 1 to 4 ,
The information indicating the relationship between the first moving image and the second moving image is vector information that goes from the reproduced image of one of the first moving image and the second moving image to the reproduced image of the other moving image. Video playback device. The video playback device according to any one of claims 1 to 4 ,
The information indicating the relationship between the first moving image and the second moving image is at least a number, a character, a symbol, a code, a design, or a mark indicating the relationship between the first moving image and the second moving image. One video playback device. The video playback device according to any one of claims 1 to 4 ,
In the information indicating the relationship between the first moving image and the second moving image, the shape of the reproduced image of one of the first moving image and the second moving image is different from the shape of the reproduced image of the other moving image. Video playback device that is the information that there is. The video playback device according to any one of claims 1 to 7 ,
The display unit is a moving image playback device that displays information indicating a relationship between the first moving image and the second moving image. The video playback device according to any one of claims 1 to 8 ,
The image further includes a reproduced image of a fourth moving image obtained by photographing an animal watching the reproduced image of the first moving image, and information indicating a relationship between the first moving image and the fourth moving image. Video playback device including. The video playback device according to any one of claims 1 to 8 ,
The image further includes a reproduction image of a fourth moving image obtained by photographing an animal watching the reproduction image of the second moving image, and information indicating a relationship between the second moving image and the fourth moving image. Video playback device including. A second moving image in which an animal watching the reproduced image of the first moving image is photographed, and a communication unit for transmitting the first moving image,
A storage unit that stores information for displaying information indicating a relationship between the first moving image and the second moving image in a receiving terminal that receives the transmitted first moving image and the second moving image. Equipped with
The communication unit, when transmitting the first moving image and the second moving image, transmits information for displaying information indicating a relationship between the first moving image and the second moving image ,
The moving image processing apparatus , wherein the information indicating the relationship between the first moving image and the second moving image is information that the shape or size of the reproduced image of the first moving image or the second moving image changes . A relationship between the reproduced image of the second moving image obtained by photographing the animal watching the reproduced image of the first moving image, the reproduced image of the first moving image, and the relationship between the first moving image and the second moving image And a communication unit that transmits a video including information indicating to the receiving terminal based on a reproduction request of the video ,
The moving image processing apparatus , wherein the information indicating the relationship between the first moving image and the second moving image is information that the shape or size of the reproduced image of the first moving image or the second moving image changes . A second moving image in which an animal watching the reproduced image of the first moving image is photographed, and a communication unit for transmitting the first moving image,
A storage unit that stores information for displaying information indicating a relationship between the first moving image and the second moving image in a receiving terminal that receives the transmitted first moving image and the second moving image. Equipped with
The communication unit, when transmitting the second video and the first video information for displaying information indicating the relationship between the second video and the first video, the first And information for displaying information indicating the target of interest of the animal in the reproduced image of the moving picture. A relationship between the reproduced image of the second moving image, in which the animal watching the reproduced image of the first moving image is captured, the reproduced image of the first moving image, and the relationship between the first moving image and the second moving image. And a communication unit that transmits a moving image including information indicating to the receiving terminal based on a reproduction request of the moving image ,
The moving image processing device , wherein the communication unit further transmits information for displaying information indicating a target of interest of the animal in the reproduced image of the first moving image on the receiving terminal . A relationship between the reproduced image of the second moving image, in which the animal watching the reproduced image of the first moving image is captured, the reproduced image of the first moving image, and the relationship between the first moving image and the second moving image. And a communication unit that transmits a moving image including information indicating to the receiving terminal based on a reproduction request of the moving image ,
The moving image processing apparatus further includes information indicating a target of interest of the animal in the reproduced image of the first moving image . The moving image processing apparatus according to any one of claims 11 to 15 ,
The information indicating the relationship between the first moving image and the second moving image is vector information that goes from a reproduced image of one of the first moving image and the second moving image to a reproduced image of the other moving image. Video processing device. The moving image processing apparatus according to any one of claims 11 to 15 ,
The information indicating the relationship between the first moving image and the second moving image is at least a number, a character, a symbol, a code, a design, or a mark indicating the relationship between the first moving image and the second moving image. One video processing device. The moving image processing apparatus according to any one of claims 11 to 15 ,
In the information indicating the relationship between the first moving image and the second moving image, the shape of the reproduced image of one of the first moving image and the second moving image is different from the shape of the reproduced image of the other moving image. Video processing device that is the information that there is. The moving image processing apparatus according to any one of claims 11 to 18 ,
The communication unit is a moving image processing device, which further transmits information for displaying information indicating a relationship between the first moving image and the second moving image on the receiving terminal.

Images