JP5563625B2 - Image analysis apparatus, image analysis method, and image analysis system - Google Patents

Description

  The present invention relates to an image analysis device, an image analysis method, and an image analysis system.

  2. Description of the Related Art In recent years, technological development for presenting stereoscopic images has progressed, and a head mounted display (hereinafter referred to as “HMD”) capable of presenting stereoscopic images with depth has become widespread. Among these HMDs, we have also developed an optically transmissive HMD that uses a holographic element, a half mirror, etc. to present stereoscopic images to the user and allows the user to see the outside of the HMD in a see-through manner. Has been.

  On the other hand, an AR (Augmented Reality) that generates a video in which a video such as CG (Computer Graphics) is added to a real-world video captured by an imaging device such as a camera, and modifies a part of the real-world video presented to the user. ) Technology is also entering the practical stage. In the AR technology, there is a case where specific information such as a barcode is recognized and an image is generated in association with the information.

  By using an optically transmissive HMD in combination with a television monitor, displaying a marker on the television monitor and using the television monitor itself as a marker, the video displayed on the television monitor is displayed to the user wearing the optically transmissive HMD. It is possible to display an optically transmissive HMD video in an overlapping manner. On the other hand, considering that the content playback screen is also displayed on the television monitor, it is desirable to avoid as much as possible that the world view of the content is impaired due to the presentation of the marker.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a technique for achieving both maintenance of a world view of content and presentation of a monitor detection marker.

  In order to solve the above problems, an aspect of the present invention is an image analysis apparatus. This device includes a content playback unit that plays back content, a video acquisition unit that acquires video captured by an imaging device that captures video including a monitor that is displaying the playback screen of the content, and the video acquisition unit And a monitor specifying unit for specifying the position of the monitor from the video. Here, the content reproduction unit reproduces content including a marker displayed in a manner that is not recognized by a user observing the monitor, and the monitor specifying unit specifies from the video including the marker imaged by the imaging device. Based on the marker, the position of the monitor in the video is specified.

  Another aspect of the present invention is an image analysis method. In this method, a step of acquiring a video including a monitor displaying a content playback screen including a marker displayed in a manner not recognized by the user, and the marker is specified from the content playback screen included in the acquired video. And a step of identifying the position of the monitor in the video based on the identified marker.

  Yet another embodiment of the present invention is an image analysis system. The system displays a content playback unit that plays back content, a monitor that displays the playback screen of the content, an image sensor that captures video including the monitor, and a playback screen of the content that is captured by the image sensor A video acquisition unit that acquires a video including an internal monitor, and a monitor specifying unit that specifies the position of the monitor from the video acquired by the video acquisition unit. Here, the content reproduction unit reproduces content including a marker that can be recognized only by the monitor identification unit, and the monitor identification unit also includes a marker identified from an image including the marker imaged by the imaging element. And the position of the monitor in the video is specified.

  Yet another embodiment of the present invention is a program that causes a computer to implement the steps of the above method.

  This program may be provided as part of firmware incorporated in the device in order to perform basic control of hardware resources such as video and audio decoders. This firmware is stored in a semiconductor memory such as a ROM (Read Only Memory) or a flash memory in the device, for example. In order to provide the firmware or to update a part of the firmware, a computer-readable recording medium storing the program may be provided, and the program may be transmitted through a communication line.

  It should be noted that any combination of the above-described constituent elements and the expression of the present invention converted between a method, an apparatus, a system, a computer program, a data structure, a recording medium, and the like are also effective as an aspect of the present invention.

  ADVANTAGE OF THE INVENTION According to this invention, the technique for aiming at coexistence with the maintenance of the world view of a content and presentation of the marker for monitor detection can be provided.

It is a figure which shows typically the whole structure of the video presentation system which concerns on embodiment. It is a figure which shows typically an example of the external appearance of the three-dimensional image observation device which concerns on embodiment. It is a figure which shows typically the internal structure of the image analysis which concerns on embodiment. It is a figure which shows an example of the feature-value which the monitor specific | specification part which concerns on embodiment uses for pinpointing a table | surface form. It is a figure which shows the kind of image which the content reproduction part which concerns on embodiment reproduces, and the timing of ON / OFF of the optical shutter at that time in a table format. It is a flowchart which shows the flow of the monitor specific process by the image analysis apparatus which concerns on embodiment.

  FIG. 1 is a diagram schematically illustrating an overall configuration of a video presentation system 100 according to an embodiment. The video presentation system 100 according to the embodiment includes a stereoscopic video observation device 200, a monitor 300, and an information processing apparatus 400.

  The monitor 300 reproduces at least a part of the content reproduction screen. The monitor 300 can be realized by using a general television monitor, but is preferably a three-dimensional monitor that displays a stereoscopic image by a frame sequential method. In the following description, the monitor 300 is a three-dimensional monitor. Assumption. The three-dimensional monitor also has a function of a general television monitor that displays a two-dimensional image.

  Since the left and right eyes of a human are about 6 cm apart, parallax occurs between the image seen from the left eye and the image seen from the right eye. The human brain is said to use parallax images perceived by the left and right eyes as one piece of information for recognizing depth. For this reason, when a parallax image perceived by the left eye and a parallax image perceived by the right eye are projected onto the respective eyes, it is recognized as a video having a depth by humans. The monitor 300 alternately displays the parallax image for the left eye and the parallax image for the right eye in a time division manner. The monitor 300 can be realized using a known presentation device such as a liquid crystal television, a plasma display, or an organic EL monitor.

  The stereoscopic image observation device 200 is an optical transmission type HMD. Here, the stereoscopic image observation device 200 may include an optical shutter (not shown) for observing the monitor 300. The optical shutter opens and closes the left and right shutters in synchronization with the switching of the parallax image of the monitor 300. More specifically, when the monitor 300 displays a parallax image for the left eye, the right eye parallax is closed to the user wearing the stereoscopic video observation device 200 by closing the right eye shutter and opening the left eye shutter. Present an image. On the other hand, when the monitor 300 displays the right-eye parallax image, the left-eye shutter is closed and the right-eye shutter is opened, and the right-eye parallax image is presented to the user. The optical shutter can be realized using, for example, a known liquid crystal shutter.

  The stereoscopic video observation device 200 receives a synchronization signal for shutter switching. The synchronization signal is transmitted wirelessly from a signal transmission unit (not shown) provided in the monitor 300 or the information processing apparatus 400 using, for example, infrared light.

  The information processing apparatus 400 acquires a stereoscopic video to be presented by the video presentation system 100 and the synchronization signal described above. Examples of the information processing apparatus 400 include a stationary game machine and a portable game machine. The information processing apparatus 400 generates a stereoscopic video and a synchronization signal using a built-in processor, and acquires a stereoscopic video from another information processing apparatus such as a server via a network interface (not shown).

  FIG. 2 is a diagram schematically illustrating an example of the appearance of the stereoscopic video observation device 200 according to the embodiment. The stereoscopic video observation device 200 includes a presentation unit 202 that presents a stereoscopic video, an imaging element 204, and a housing 206 that houses various modules.

  The presentation unit 202 includes an optically transmissive HMD that presents a stereoscopic image to the user's eyes, and a liquid crystal shutter that changes the transmittance of external light that passes through the optically transmissive HMD. The imaging element 204 images a subject in an area including the field of view of the user wearing the stereoscopic video observation device 200. For this reason, the image sensor 204 is installed so as to be arranged around the user's eyebrows when the user wears the stereoscopic image observation device 200. The imaging device 204 can be realized by using a known solid-state imaging device such as a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.

  The housing 206 plays a role of a frame in the glasses-shaped stereoscopic image observation device 200 and accommodates various modules (not shown) used by the stereoscopic image observation device 200. The modules used by the stereoscopic image observation device 200 include an optical engine including a hologram light guide plate for realizing an optical transmission type HMD, a driver and a synchronization signal receiving unit for driving a liquid crystal shutter, and other Wi-Fi (registered trademark). A communication module such as a module, an electronic compass, an acceleration sensor, a tilt sensor, a GPS (Global Positioning System) sensor, and an illuminance sensor. These modules are examples, and the stereoscopic image observation device 200 does not necessarily need to be equipped with all of these modules. Which module is mounted may be determined according to the usage scene assumed by the stereoscopic video observation device 200.

  FIG. 2 is a diagram illustrating a glasses-type stereoscopic image observation device 200. The shape of the stereoscopic image observation device 200 may be various variations such as a hat shape, a belt shape that is fixed around the user's head, and a helmet shape that covers the entire user's head. Those skilled in the art can easily understand that the stereoscopic image observation device 200 having a shape is also included in the embodiment of the present invention.

  FIG. 3 is a diagram schematically illustrating an internal configuration of the image analysis apparatus 500 according to the embodiment. The image analysis apparatus 500 according to the embodiment is realized as a part of the information processing apparatus 400 described above. Alternatively, it may be realized in a server that generates a stereoscopic video to be transmitted to the information processing apparatus 400 via a network such as the Internet, or may be incorporated in the stereoscopic video observation device 200 or the monitor 300. Alternatively, the image analysis apparatus 500 may be an independent apparatus. Hereinafter, the image analysis apparatus 500 according to the embodiment will be described on the assumption that the image analysis apparatus 500 is realized as a part of the information processing apparatus 400 described above.

  Image analysis apparatus 500 according to the embodiment includes a video acquisition unit 502, a monitor identification unit 504, and a content reproduction unit 506.

  The content playback unit 506 plays back content such as movies, games, and television programs. At least a part of the content video to be played back by the content playback unit 506 is displayed on the monitor 300. In addition, a part of the content video to be played back by the content playback unit 506 is displayed on the optically transmissive HMD in the stereoscopic video viewing device 200.

  For example, when the content played back by the content playback unit 506 is a game application, a background image of the game video is displayed on the monitor 300, and a video or AR image of a character to be operated by the user is converted into an optically transmissive HMD. Is displayed.

  The imaging element 204 provided in the stereoscopic video observation device 200 captures an image including the monitor 300 that is displaying a playback screen of the content played back by the content playback unit 506. The video acquisition unit 502 acquires video captured by the image sensor 204. The monitor specifying unit 504 detects a marker shown in the video acquired by the video acquisition unit 502, and specifies the position of the monitor 300 based on the detected marker. For this reason, the content reproduction unit 506 causes the monitor 300 to display a marker used by the monitor specifying unit 504 for specifying the monitor 300. Based on the position of the monitor 300 specified by the monitor specifying unit 504, the content reproduction unit 506 displays the three-dimensional image superimposed on the monitor 300 displayed on the optical transmission type HMD.

  As described above, since the monitor 300 also displays the video of the content played back by the content playback unit 506, the user observes the monitor 300 via the optically transmissive HMD. Therefore, displaying a marker image different from the content video for the purpose of facilitating the identification of the monitor 300 by the monitor identifying unit 504 may impair the world view of the content. There is also a possibility of end.

  Therefore, the content reproduction unit 506 reproduces the content by including a marker displayed in a manner that is not recognized by the user observing the monitor 300. Here, as “display in a manner not recognized by the user”, displaying the video derived from the content reproduced by the content reproduction unit so that the user does not notice that it is a marker, Two display methods are conceivable, in which a marker is presented only on the image sensor 204 while the user's field of view is blocked. Hereinafter, a method for displaying a video derived from content to be reproduced by the content reproduction unit 506 and a method for presenting a marker only on the image sensor 204 will be described in order.

  First, a description will be given of displaying video derived from content to be reproduced by the content reproduction unit 506 as a marker.

  The monitor specifying unit 504 specifies a marker in the video by using a known pattern matching method such as template matching, DP (Dynamic Programming) matching, or feature amount analysis such as an edge. Therefore, it is preferable that the marker used for specifying a predetermined structure in the video is an image with as little change as possible in the video.

  In general, video of game content can be classified into character images that move around the video, such as characters and enemy characters that are subject to operation by the user, and background images that have relatively little change due to movement. Therefore, as an example of using a video derived from content as a mark, a background image in game content can be used as a marker.

The monitor specifying unit 504 acquires a background image serving as a marker, and extracts feature amounts such as edges, contours, corners, and color schemes of structures included in the acquired image from the background image. FIG. 4 is a diagram illustrating an example of a feature amount used for specifying a marker by the monitor specifying unit 504 according to the embodiment in a table format. The monitor specifying unit 504 analyzes the background image and manages what feature amount exists at which position in the background image. In the example shown in FIG. 4, Type 1 indicates that the corner (corner point) of the structure exists at the point (X ₁ , Y ₁ ) in the image. The monitor specifying unit 504 analyzes the video newly acquired from the video acquisition unit 502 and checks whether or not the above-described feature amount is included in the video, thereby obtaining a background image serving as a marker from the newly acquired video. Identify. The feature amount is stored in a recording unit (not shown) in the image analysis apparatus 500.

  By the way, the background image usually changes little by little as the game progresses even though the change due to movement is small compared to the character image moving around in the video. Therefore, the monitor specifying unit 504 also manages the difference information of the feature points once extracted. Specifically, the monitor specifying unit 504 manages the translation amount of each feature point accompanying the change of the background image, and the rotation angle when the feature value is rotated. In addition, depending on the position where the feature amount exists, it may disappear due to the movement of the background image, so it is also managed whether each feature amount is currently valid. As a result, even if the background image from which the feature amount is extracted changes, the background image that becomes the marker can be specified based on the feature amount. Moreover, since the monitor 300 is specified using the background of the game content itself as a marker, the user can be prevented from being conscious of the marker, and the game world view can be prevented from being impaired.

  Next, it will be described that a marker is presented only on the image sensor 204 while the user's field of view is blocked.

  As described above, the monitor 300 is a frame sequential type three-dimensional monitor, and the optical transmission type HMD includes an optical shutter used for observation of the frame sequential type three-dimensional monitor. Therefore, the content reproduction unit 506 monitors a marker used by the monitor specifying unit 504 to specify the position of the monitor 300 while the optical shutter blocks the field of view of the user observing the real space through the optical transmission type HMD. 300 is displayed.

  FIG. 5 is a table showing the types of images reproduced by the content reproduction unit 506 according to the embodiment and the on / off timing of the optical shutter at that time in a table format.

  As described above, when the monitor 300 displays a parallax image for the left eye, the right-eye shutter is turned on to block the right-eye field of view, the left-eye shutter is turned off, and the stereoscopic image observation device 200 is attached. The parallax image for the left eye is presented to the user. When the monitor 300 displays a right-eye parallax image, the left-eye shutter is turned on to block the left-eye field of view and the right-eye shutter is turned off to present the right-eye parallax image to the user. To do. After displaying the parallax image for the left eye and the parallax image for the right eye, the monitor 300 displays an image for the marker as the third image. At this time, both optical eyes are turned on to block the user's field of view.

  In this way, the monitor 300 presents the left-eye parallax image, the right-eye parallax image, and the marker image in order while changing them, and synchronizes the on / off control of the optical shutter with the presentation of the image, thereby using the monitor 300. Thus, a marker image can be presented only to the image sensor 204 so as not to be recognized by the user while presenting a stereoscopic video to the user. Since the user does not see the marker image, it is possible to prevent the game world view from being impaired.

  By the way, when the background image of the game video is displayed on the monitor 300 and the video of the character to be operated by the user is displayed on the optically transmissive HMD, the content specifying unit 504 specifies the content reproduction unit 506. An image is displayed based on the position of the monitor 300. For this reason, for example, if the position of the monitor 300 cannot be specified by the monitor specifying unit 504 due to, for example, the user's line of sight being off the monitor 300, the content reproduction unit 506 can appropriately display the video on the optically transmissive HMD. . Therefore, when the monitor identifying unit 504 fails to identify the marker, the content reproduction unit 506 temporarily stops the content reproduction. Thereafter, if the monitor identifying unit 504 succeeds in identifying the marker, the content reproduction unit 506 resumes the reproduction of the content.

  In addition, when the reproduction of the content is temporarily stopped because the monitor identification unit 504 fails to identify the marker, the content reproduction unit 506 displays a message indicating that the identification of the monitor has failed on the optical transmission type HMD. Thereby, the user understands that the progress of the game is interrupted. For example, if another job to be performed other than the game has occurred, the user may complete the job while interrupting the progress of the game. Further, if it is desired to continue the game, the monitor specifying unit 504 may specify the monitor by directing the image sensor 204 of the stereoscopic video observation device 200 toward the monitor 300.

  FIG. 6 is a flowchart showing a flow of monitor specifying processing by the image analysis apparatus 500 according to the embodiment. The processing in this flowchart starts when the image analysis apparatus 500 is powered on, for example.

  The content reproduction unit 506 reproduces content (S2). The monitor 300 displays the playback video of the content played back by the content playback unit 506 (S4). The image sensor 204 captures a video including the monitor 300 that displays the playback video of the content (S6).

  The monitor specifying unit 504 tries to detect a marker for specifying the monitor 300 from the video of the image sensor 204 acquired by the video acquisition unit 502 (S8). When the monitor identifying unit 504 fails to detect the marker (N in S10), the content reproduction unit 506 pauses the content being reproduced (S12). The content playback unit 506 also displays a message indicating that the monitor identification has failed on the optically transmissive HMD worn by the user (S14). After the content reproduction unit 506 displays a message on the optically transmissive HMD, the process returns to step S6 and the above processing is repeated.

  When the monitor specifying unit 504 succeeds in detecting the marker (Y in S10), the monitor specifying unit 504 specifies the position of the monitor 300 in the video based on the detected marker (S16). When the monitor specifying unit 504 specifies the position of the monitor 300, if the content is paused (Y in S18), the content reproduction unit 506 resumes the content reproduction (S20). If the content is not paused (N in S18), the content reproduction unit 506 continues to reproduce the content. When the content is not paused or when the content reproduction unit 506 resumes the reproduction of the content, the processing in this flowchart ends.

  The usage scenes of the video presentation system 100 configured as described above are as follows. When the user wears the stereoscopic video observation device 200 and observes the monitor 300, the image sensor 204 images the marker displayed in a manner that is not recognized by the user by the content reproduction unit 506. The monitor specifying unit 504 specifies the position of the monitor 300 existing in the video by detecting the marker.

  As described above, according to the video presentation system 100 according to the embodiment, it is possible to provide a technique for achieving both maintenance of the content worldview and presentation of the monitor detection marker.

  The present invention has been described based on the embodiments. The embodiments are exemplifications, and it will be understood by those skilled in the art that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are within the scope of the present invention. .

(First modification)
In the above, the case where the marker image is displayed on the monitor 300 and the position of the monitor 300 in the video is specified has been described. Once the monitor 300 has been successfully identified, information other than the image to be displayed on the monitor may be used as a marker. Specifically, for example, after the position of the monitor 300 is successfully identified, the frame of the monitor 300 may be used as a detection marker. Since the monitor frame does not change with time, it can be expected to specify the monitor 300 with higher accuracy.

(Second modification)
In the above, the case where the marker image is displayed on the monitor 300 and the position of the monitor 300 in the video is specified has been described. Here, when a shutter control signal for controlling the optical shutter of the optical transmission type HMD is transmitted through infrared light, an output unit of the shutter control signal is provided in the frame of the monitor 300 to detect the infrared light. By doing so, the position of the monitor 300 can also be specified.

  In general, an image sensor such as a CCD for realizing the image sensor 204 can also capture infrared light. Since infrared light is not visible light, it is rarely observed by the user's eyes. Therefore, if the source of infrared light transmitted from the frame of the monitor 300 is specified, it becomes an effective clue for specifying the frame of the monitor 300. Although an infrared shielding sheet is often attached to a general image sensor, it is preferable not to attach an infrared shielding sheet to the image sensor 204. This makes it easier to detect a shutter control signal that is infrared light.

(Third Modification)
In the above description, the case where the feature amount is directly extracted from the marker image displayed on the monitor 300 has been described. Instead, the content playback unit 506 may embed, for example, a known digital fingerprint or digital watermark in the playback video of the content. Thereby, although it is difficult for the user to visually recognize the embedded information, the monitor specifying unit 504 can detect the marker by executing a specific detection process.

(Fourth modification)
In the above, the on / off control of the optical shutter has been described with reference to FIG. 5, but the on / off timing of the optical shutter is not limited to the pattern shown in FIG. For example, the frequency of displaying the marker image for the pattern shown in FIG. 5 may be reduced. As a result, it is possible to reduce the influence of the crosstalk displayed by mixing the content video and the marker image.

  FIG. 5 shows an example in which the monitor 300 displays a 3D image, but the monitor 300 may display a normal 2D image. In this case, the content reproduction unit 506 may alternately display the content video and the marker image in a time-division manner, or may display the marker image on the monitor 300 after displaying a predetermined number of video frames of the content. The optical shutter of the stereoscopic video observation device 200 turns on the shutter only while the monitor 300 is displaying the marker image and shields the user's field of view, so that the marker is not displayed on the monitor 300 without the user perceiving the marker image. An image can be displayed.

  DESCRIPTION OF SYMBOLS 100 video presentation system, 200 stereoscopic video observation device, 202 presentation part, 204 imaging device, 206 housing | casing, 300 monitor, 400 information processing apparatus, 500 image analysis apparatus, 502 video acquisition part, 504 monitor specification part, 506 content reproduction part .

Claims (9)

A content playback unit for playing back content,
A video acquisition unit that acquires video captured by an imaging device that captures video including a monitor that is displaying the content playback screen;
A monitor specifying unit for specifying the position of the monitor from the video acquired by the video acquisition unit,
The imaging device is provided in an optically transmissive HMD that presents an image observed when a three-dimensional image in a virtual three-dimensional space generated by the content is projected into a real space,
The content reproduction unit reproduces content including a marker displayed in a manner that is not recognized by a user who wears the optically transmissive HMD and observes the monitor,
The monitor specifying unit specifies the position of the monitor in the video based on the marker specified from the video including the marker imaged by the imaging device ,
The content reproduction unit generates a three-dimensional image to be displayed on the monitor displayed on the optical transmission type HMD based on the position of the monitor specified by the monitor specifying unit. Analysis device.   The image analysis apparatus according to claim 1, wherein the monitor specifying unit specifies the position of the monitor using a video derived from the content reproduced by the content reproduction unit as a marker.   3. The image according to claim 1, wherein when the content played by the content playback unit is game content, the monitor specifying unit specifies the position of the monitor using a background screen of the game content as a marker. Analysis device.   4. The image analysis apparatus according to claim 1, wherein when the monitor specifying unit fails to specify a marker, the content playback unit stops playback of the content. 5. The monitor that displays the playback screen of the content is a frame sequential type three-dimensional monitor, and the optical transmission type HMD includes an optical shutter used for observation of the frame sequential type three-dimensional monitor,
The content reproduction unit uses a marker used by the monitor specifying unit to specify the position of the monitor while the optical shutter blocks the field of view of a user observing a real space through the optical transmission type HMD. The image analysis apparatus according to claim 1 , wherein the image analysis apparatus is displayed on the monitor. 6. The content reproducing unit causes the optical transmission type HMD to display a message indicating that the monitor has failed when the monitor identifying unit fails to identify the marker . The image analysis apparatus according to any one of the above. An image analysis method executed by a processor,
Using an imaging device to obtain a video including a monitor displaying a playback screen of content including a marker displayed in a manner not recognized by the user;
Identifying the marker from a playback screen of content included in the acquired video;
Identifying the position of the monitor in the video based on the identified marker ,
The image pickup device is provided in an optical transmission HMD worn by the user, and the optical transmission HMD projects a three-dimensional image in a virtual three-dimensional space generated by the content into a real space. The video that is observed in the case,
The image analysis method further includes a step of generating a three-dimensional image to be displayed on the monitor displayed on the optical transmission type HMD based on the specified position of the monitor. Method. A program for causing a computer to realize an image analysis function,
A function of acquiring an image including a monitor displaying a playback screen of content including a marker displayed in a manner not recognized by a user using an imaging device ;
Identifying the marker from a playback screen of content included in the acquired video;
Including the function of specifying the position of the monitor in the video based on the specified marker ,
The image pickup device is provided in an optical transmission HMD worn by the user, and the optical transmission HMD projects a three-dimensional image in a virtual three-dimensional space generated by the content into a real space. The video that is observed in the case,
The program further includes a function for generating a three-dimensional image to be displayed on the monitor displayed on the optical transmission type HMD based on the specified position of the monitor . A content playback unit for playing back content,
A monitor for displaying a playback screen of the content;
An image pickup device for picking up an image including the monitor;
An image acquisition unit that acquires an image captured by the image sensor and including a monitor displaying a playback screen of the content;
A monitor specifying unit for specifying the position of the monitor from the video acquired by the video acquisition unit,
The imaging device is provided in an optically transmissive HMD that presents an image observed when a three-dimensional image in a virtual three-dimensional space generated by the content is projected into a real space,
The content reproduction unit reproduces content including a marker displayed in a manner that is not recognized by a user who wears the optically transmissive HMD and observes the monitor,
The monitor specifying unit specifies the position of the monitor in the video based on the marker specified from the video including the marker imaged by the imaging device,
The content reproduction unit generates a three-dimensional image to be displayed on the monitor displayed on the optical transmission type HMD based on the position of the monitor specified by the monitor specifying unit. Analysis system.

Images