JP6921204B2 - Information processing device and image output method - Google Patents

Description

The present invention relates to a technique for outputting an image taken by a camera.

A head-mounted display (HMD) provides an image over the entire field of view of the user, enhancing the user's immersive feeling in the visual world. By providing the HMD with a head tracking function and providing an image of the three-dimensional space in conjunction with the posture and position of the user's head, the immersive feeling in the video world can be further enhanced.

For example, it is expected that the user can be given a sense of realism as if he / she is at the venue by live-streaming the camera image of the concert hall to the HMD. When a plurality of cameras are installed in a concert hall, it is preferable that the user can freely select the camera image to be viewed. Not only when using HMD, but also when live-streaming camera images to an output device such as a television, a user who effectively presents options to the user so that the user can freely select the camera image. It is preferred that an interface be provided.

The present invention has been made in view of these problems, and an object of the present invention is to provide a technique for effectively presenting a user with options of captured images taken by a plurality of cameras.

In order to solve the above problems, the information processing apparatus according to the present invention reduces the captured images taken by a plurality of cameras based on the reception unit that accepts the user operation and the user operation received by the reception unit. It includes an image acquisition unit that acquires a plurality of reduced images, and a display control unit that outputs a display image in which each of the plurality of reduced images is arranged at a position corresponding to the position of the captured camera.

Another aspect of the present invention is an image output method, which comprises a step of accepting a user operation and a step of acquiring a plurality of reduced images obtained by reducing each of the captured images taken by a plurality of cameras based on the user operation. Each of the plurality of reduced images has a step of outputting a display image arranged at a position corresponding to the position of the captured camera.

It should be noted that any combination of the above components, the expression of the present invention converted between a method, a device, a system, a computer program, a recording medium in which a computer program is readable, a data structure, and the like are also used in the present invention. It is effective as an aspect of.

According to the present invention, it is possible to provide a technique for presenting a user with options for captured images taken by a plurality of cameras.

It is a figure which shows the configuration example of the information processing system in an Example. It is a figure which shows the example of the appearance shape of an HMD. It is a figure which shows the functional block of HMD. It is a figure which shows the functional block of an information processing apparatus. It is a figure which shows an example of the live image displayed on the HMD. It is a figure which shows the user interface for the user to determine the photographed image to be displayed. It is a figure which shows the state which the selection of the reduced image is changed. It is a figure which shows the example which enlarged-displayed the user interface.

FIG. 1 shows a configuration example of the information processing system 1 in the embodiment. The information processing system 1 includes an information processing device 10, a head-mounted display (HMD) 100, an input device 16 operated by a user with fingers, an imaging device 14 for photographing a user wearing the HMD 100, and an output for displaying an image. The device 15 is provided. The output device 15 may be a television. The information processing device 10 is connected to an external network 2 such as the Internet via an access point (AP) 17. The AP 17 has the functions of a wireless access point and a router, and the information processing device 10 may be connected to the AP 17 by a cable or by a known wireless communication protocol.

The information processing device 10 connects to the distribution server 18 via the network 2. The distribution server 18 is a streaming distribution device that lively relays captured images taken by a plurality of cameras at an event venue such as a concert hall or a soccer field. In the example, at the event venue, six cameras A to F are installed at different positions toward the stage.

This event venue may be a concert hall with upstairs seats. Here, the cameras B are arranged in the audience seats near the front of the stage, and the cameras A and C are arranged on both sides of the stage. Cameras D to F are placed on the second floor seats of the venue, camera D is placed on the left side of the second floor seats, camera E is placed in the center of the second floor seats, and camera F is placed on the right side of the second floor seats when facing the stage. Has been done. The shooting format of each camera may be different depending on the production application of the live broadcast, and the cameras A, C, and E may be fisheye cameras, and the cameras B, D, and F may be ordinary cameras. The shooting direction of each camera may be fixed, but it may be moved according to the movement of a specific target person.

The HMD 100 is worn on the user's head to provide the user with a video world. In the embodiment, the HMD 100 provides the user with a camera image provided by the distribution server 18. By providing the HMD 100 with a head tracking function and updating the displayed image in conjunction with the movement of the user's head, the presence of the event venue can be given. In the embodiment, the user can view the live image in a desired line-of-sight direction and viewpoint position by moving the posture and position of the head.

The information processing device 10 includes a processing device 11, an output control device 12, and a storage device 13. The processing device 11 is a terminal device that receives the operation information input to the input device 16 by the user and provides the camera image distributed from the distribution server 18 to the HMD 100. The processing device 11 and the input device 16 may be connected by a cable, or may be connected by a known wireless communication protocol. The processing device 11 of the embodiment has a function of accepting the position information and the posture information of the HMD 100 as the user's operation information for changing the line-of-sight position and the line-of-sight direction, and updating the image displayed on the HMD 100. The output control device 12 is a processing unit that outputs the image data generated by the processing device 11 to the HMD 100, and the output control device 12 and the HMD 100 may be connected by a cable or by a known wireless communication protocol. May be good.

The image pickup device 14 is a stereo camera, which takes a picture of a user wearing the HMD 100 at a predetermined cycle and supplies the shot image to the processing device 11. As will be described later, the HMD 100 is provided with a marker (tracking LED) for tracking the user's head, and the processing device 11 detects the movement of the HMD 100 based on the position of the marker included in the captured image. The HMD 100 is equipped with an attitude sensor (accelerometer and gyro sensor), and the processing device 11 acquires the sensor data detected by the attitude sensor from the HMD 100, so that the image taken by the marker can be used and the accuracy is high. Tracking process is performed. Various methods have been conventionally proposed for the tracking process, and any tracking method may be adopted as long as the processing device 11 can detect the movement of the HMD 100.

Since the user views the image on the HMD 100, the output device 15 is not always necessary for the user wearing the HMD 100, but by preparing the output device 15, another user can view the display image of the output device 15. The output control device 12 or the processing device 11 may display the same image as the image viewed by the user wearing the HMD 100 on the output device 15.

The HMD 100 is a display device that displays an image on a display panel located in front of the user when the user wears it on the head. The HMD 100 separately displays an image for the left eye on the display panel for the left eye and an image for the right eye on the display panel for the right eye. These images constitute parallax images viewed from the left and right viewpoints, and realize stereoscopic vision. Since the user sees the display panel through the optical lens, the information processing device 10 supplies the parallax image data corrected for the optical distortion caused by the lens to the HMD 100. The optical distortion correction process may be performed by either the processing device 11 or the output control device 12.

The function of the output control device 12 may be incorporated in the processing device 11. The processing unit of the information processing device 10 may be composed of one processing device 11 or may be composed of the processing device 11 and the output control device 12. Hereinafter, the functions of providing images to the HMD 100 will be collectively described as the functions of the information processing apparatus 10.

The information processing device 10 detects the position coordinates and the posture of the user's head (actually, HMD100) by performing the user's head tracking process. Here, the position coordinates of the HMD 100 are position coordinates in a three-dimensional space with the reference position as the origin, and the reference position may be the position coordinates (latitude, longitude) when the power of the HMD 100 is turned on. The posture of the HMD 100 is an inclination in the three-axis direction with respect to the reference posture in the three-dimensional space. The reference posture is a posture in which the line-of-sight direction of the user is horizontal, and the reference posture may be set when the power of the HMD 100 is turned on.

The information processing device 10 can detect the position coordinates and the posture of the HMD 100 only from the sensor data detected by the posture sensor of the HMD 100, and further, by image-analyzing the marker (tracking LED) of the HMD 100 taken by the image pickup device 14. The position coordinates and orientation of the HMD 100 can be detected with high accuracy.

FIG. 2 shows an example of the appearance shape of the HMD 100. The HMD 100 is composed of an output mechanism unit 102 and a mounting mechanism unit 104. The mounting mechanism unit 104 includes a mounting band 106 that goes around the head and fixes the HMD 100 to the head when the user wears it. The wearing band 106 has a material or structure whose length can be adjusted according to the user's head circumference.

The output mechanism 102 includes a housing 108 having a shape that covers the left and right eyes when the HMD 100 is worn by the user, and internally includes a display panel that faces the eyes when worn. The display panel may be a liquid crystal panel, an organic EL panel, or the like. Inside the housing 108, a pair of left and right optical lenses, which are located between the display panel and the user's eyes and expand the viewing angle of the user, are further provided. The HMD 100 may further include a speaker or earphone at a position corresponding to the user's ear, and may be configured to be connected to external headphones.

Light emitting markers 110a, 110b, 110c, 110d are provided on the outer surface of the housing 108. In this example, the tracking LED constitutes the light emitting marker 110, but it may be another type of marker, and in any case, it is photographed by the imaging device 14 and the information processing device 10 can perform image analysis of the marker position. All you need is. The number and arrangement of the light emitting markers 110 are not particularly limited, but the number and arrangement must be such that the posture and position of the HMD 100 can be detected. In the illustrated example, the light emitting markers 110 are provided at the four corners on the front surface of the housing 108. Further, the light emitting marker 110 may be provided on the side portion or the rear portion of the mounting band 106 so that the user can take a picture even when the user turns his / her back to the imaging device 14.

The HMD 100 may be connected to the information processing apparatus 10 with a cable or may be connected with a known wireless communication protocol. The HMD 100 transmits the sensor data detected by the posture sensor to the information processing device 10, receives the image data output from the information processing device 10, and displays the image data on the left-eye display panel and the right-eye display panel.

FIG. 3 shows a functional block of the HMD 100. The control unit 120 is a main processor that processes and outputs various data such as image data, audio data, and sensor data, as well as instructions. The storage unit 122 temporarily stores data, instructions, and the like processed by the control unit 120. The attitude sensor 124 detects the attitude information of the HMD 100. The attitude sensor 124 includes at least a 3-axis accelerometer and a 3-axis gyro sensor.

The communication control unit 128 transmits the data output from the control unit 120 to the external information processing device 10 via a network adapter or an antenna by wired or wireless communication. Further, the communication control unit 128 receives data from the information processing device 10 via a network adapter or an antenna by wired or wireless communication, and outputs the data to the control unit 120.

When the control unit 120 receives the image data or the audio data from the information processing device 10, the control unit 120 supplies the image data or the audio data to the display panel 130 for display, and supplies the image data or the audio data to the audio output unit 132 for audio output. The display panel 130 is composed of a left-eye display panel 130a and a right-eye display panel 130b, and a pair of parallax images are displayed on each display panel. Further, the control unit 120 causes the communication control unit 128 to transmit the sensor data from the attitude sensor 124 and the voice data from the microphone 126 to the information processing device 10.

FIG. 4 shows a functional block of the information processing device 10. The information processing device 10 includes a sensor data receiving unit 20, a camera image receiving unit 22, an input data receiving unit 24, an image acquisition unit 40, and an image providing unit 52 as input / output interfaces with the outside. The information processing device 10 further includes an HMD information acquisition unit 30, a line-of-sight information determination unit 32, a reception unit 34, and a display control unit 50.

In FIG. 4, each element described as a functional block that performs various processes can be composed of a circuit block, a memory, and other LSIs in terms of hardware, and is loaded into the memory in terms of software. It is realized by a program or the like. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof, and is not limited to any of them.

The sensor data receiving unit 20 receives sensor data from the posture sensor 124 of the HMD 100 worn by the user at a predetermined cycle and supplies the sensor data to the HMD information acquisition unit 30. The camera image receiving unit 22 receives an image obtained by capturing the HMD 100 from the imaging device 14 at a predetermined cycle, and supplies the image to the HMD information acquisition unit 30. For example, the image pickup apparatus 14 captures the space in front every (1/60) seconds, and the camera image receiving unit 22 receives the camera image every (1/60) seconds. In the embodiment, the HMD information acquisition unit 30 derives posture information indicating the posture of the HMD 100 mounted on the user's head and position information indicating the position from the sensor data and the captured image. The HMD information acquisition unit 30 supplies the derived posture information and position information to the line-of-sight information determination unit 32.

The HMD information acquisition unit 30 detects changes in the attitude and position of the HMD 100 from the sensor data of the attitude sensor 124. At this time, the HMD information acquisition unit 30 may specify the attitude change of the HMD 100 from the sensor data of the 3-axis gyro sensor, and specify the position change from the sensor data of the 3-axis acceleration sensor. It is preferable that the HMD information acquisition unit 30 further utilizes the shooting result of the light emitting marker 110 for tracking to improve the detection accuracy of the posture change and the position change. The line-of-sight information determination unit 32 determines the line-of-sight direction and the viewpoint position of the user according to the posture information and the position information of the HMD 100. The line-of-sight information determination unit 32 provides the display control unit 50 with the determined line-of-sight direction and viewpoint position. The line-of-sight information determination unit 32 may determine only one of the line-of-sight direction and the viewpoint position and provide it to the display control unit 50.

The input data receiving unit 24 receives the key data input by the user from the input device 16 and supplies the key data to the receiving unit 34. The reception unit 34 receives the user operation input to the input device 16.

The information processing device 10 has a function of acquiring a captured image of a live event held at an event venue from a distribution server 18 and providing it to the HMD 100. This video providing function is realized by a live relay application that accesses the distribution server 18, acquires a captured video, and provides it to the HMD 100. The user can use the live relay application by downloading the live relay application from the content server to the information processing device 10.

When the user starts the live relay application, the image acquisition unit 40 transmits a distribution request for the camera image to the distribution server 18. In response to the distribution request from the information processing device 10, the distribution server 18 streams and distributes the captured image of the camera (for example, camera B) set as default for distribution to the information processing device 10. The image acquisition unit 40 acquires a camera-photographed image to be streamed and provides it to the display control unit 50. As will be described later, at this time, the image acquisition unit 40 acquires a high-resolution camera-photographed image.

FIG. 5 shows an example of a live image displayed on the HMD 100. Here, <image B> indicates that it is a live image taken by the camera B. The display control unit 50 uses the high-resolution camera-captured image acquired by the image acquisition unit 40 to generate a display image according to the line-of-sight direction and the viewpoint position of the HMD 100, and outputs the display image to the image providing unit 52. At this time, the display control unit 50 generates a display image for the left eye and a display image for the right eye. The image providing unit 52 provides the display image for the left eye and the display image for the right eye to the HMD 100, and the HMD 100 displays the display image on the display panel 130. As a result, the user can view the captured image of the camera B, which is set by default for distribution at the event venue. In this state, when the user operates a predetermined button of the input device 16, the user interface for switching the image captured by the camera being viewed is displayed on the display panel 130.

The reception unit 34 accepts a user operation for displaying a user interface for determining a captured image to be displayed. This user operation may be, for example, an operation of pressing a predetermined button of the input device 16. This predetermined button is a button for determining display / non-display of the user interface. When a predetermined button is pressed while the high-resolution camera-captured image is displayed, the camera-captured image is displayed at a low resolution and the user interface for determining the display image is superimposed and displayed. On the other hand, when a predetermined button is pressed while the user interface is superimposed and displayed, the user interface is hidden and a high-resolution camera-captured image is displayed.

When the reception unit 34 accepts the operation of pressing a predetermined button while the user interface is hidden, the image acquisition unit 40 transmits a distribution request for a plurality of camera images to the distribution server 18. In response to the distribution request from the information processing device 10, the distribution server 18 collects a plurality of reduced images (reduced in resolution) obtained by reducing the captured images taken by the plurality of cameras A to F, and collects the plurality of reduced images. Stream to. The image acquisition unit 40 acquires the reduced images of the plurality of cameras A to F to be distributed and provides them to the display control unit 50. Each reduced image is a low-resolution version of the camera-taken image.

The display control unit 50 generates a display image in which each of the plurality of reduced images is arranged at a position corresponding to the position of the captured camera based on the line-of-sight direction and the viewpoint position of the HMD 100, and outputs the display image to the image providing unit 52. ..

FIG. 6 shows a user interface for the user to determine a captured image to be displayed. The display control unit 50 generates a display image in which the user interface 200 is superimposed on the background image while displaying the image captured by the camera in the background. The display control unit 50 arranges a plurality of reduced images on the user interface 200. The user interface 200 has a shape that represents a virtual venue that imitates a venue in which a plurality of cameras A to F are arranged, and in the virtual venue, the images captured by each camera are located at positions corresponding to the positions of the cameras A to F. A reduced image is placed.

Specifically, the display control unit 50 arranges the display window 210 at a position in the user interface 200 corresponding to the camera position arranged in the actual venue, and displays a reduced image in the display window 210. As described above, in the actual venue, the cameras B are arranged in the audience seats near the front of the stage, and the cameras A and C are arranged on both sides of the stage. When facing the stage, the camera D is located on the left side of the second floor seat, the camera E is located in the center of the second floor seat, and the camera F is located on the right side of the second floor seat.

Therefore, in the virtual venue represented by the user interface 200, the display control unit 50 sets the display window 210a for displaying the captured image of the camera A at the left front position and the display window 210b for displaying the captured image of the camera B at the center front. A display window 210c for displaying the captured image of the camera C is arranged at the position of the front right. Further, the display control unit 50 displays the captured image of the camera F at the rear left position of the display window 210d for displaying the captured image of the camera D, and the captured image of the camera F at the rear rear position of the display window 210e for displaying the captured image of the camera E. The display windows 210f to be displayed are arranged at the rear right positions.

In this way, the display control unit 50 arranges the user interface 200 representing the virtual venue on the screen, and arranges a plurality of reduced images on the user interface 200 at positions corresponding to the camera positions of the actual venue. As a result, the user can intuitively understand the camera position in the venue and know what kind of image each camera is shooting by checking the reduced image displayed in each display window 210. can.

The display control unit 50 arranges information about the cameras A to F in association with each reduced image. Here, the display control unit 50 arranges information on the shooting format of the camera below the display window 210 as information on the camera. Note that (16: 9) expresses the aspect ratio of the photographed image, and (fisheye) expresses that the photographed image is taken with a fisheye lens. The display control unit 50 may arrange information about the shooting direction of the camera, information about the shooting target, and the like as information about the camera in association with the reduced image.

Further, the display control unit 50 displays a magnified image of one reduced image on the background of the user interface 200. In the example shown in FIG. 6, since the display request of the user interface 200 is generated in the state shown in FIG. 5, the captured image of the camera B is displayed as it is as the background image of the user interface 200. In the screen shown in FIG. 5, the display control unit 50 generated a display image using the captured image of the high-resolution camera B, but in the screen shown in FIG. 6, the display control unit 50 has a low resolution. The reduced image of the camera B is enlarged to generate a background image.

The display control unit 50 adds a selection mark 220 indicating that the reduced image is selected to the display window 210 of the reduced image displayed in the background. Here, a selection mark 220 is added to the display window 210b, so that the user can easily know which camera the image displayed in the background was taken by.

The user can operate the arrow buttons of the input device 16 to select a reduced image to be displayed in the background. When the reception unit 34 accepts the arrow button operation as the user's selection operation of the reduced image, the display control unit 50 arranges the selection mark 220 above the selected display window 210 according to the arrow button operation. Move to. At this time, the display control unit 50 generates a display image as a background image by stretching the reduced image of the display window 210 in which the selection mark 220 is arranged above while keeping the arrangement of the plurality of reduced images in the user interface 200.

FIG. 7 shows a state in which the selection of the reduced image is changed. In the example shown in FIG. 7, a selection mark 220 is added above the display window 210f, and the display control unit 50 does not change the arrangement of the plurality of reduced images in the user interface 200, and the reduced image of the camera F is used. Is generated as a background image by enlarging. Although the image of the camera F displayed as the background image has a low resolution, the user can determine whether the captured image of the camera F should be determined as the display image by viewing the image of the camera F as the preview screen.

In the embodiment, the display image is linked to the posture information and the position information of the HMD 100, and the user can change the display image by moving the HMD 100. For example, the user can enlarge the displayed image by moving forward with respect to the image pickup device 14.

FIG. 8 shows an example in which the user interface 200 is enlarged and displayed. In the example shown in FIG. 8, the display window 210d is enlarged and displayed on the screen, so that the user can easily check the image of the camera D displayed in the display window 210d. In this way, since the user interface 200 has a form in which a reduced image is displayed on each of the plurality of display windows 210, the user can enlarge and display each display window 210 without moving the selection mark 220. Then, the contents of each camera image can be easily confirmed.

When the user operates a predetermined button of the input device 16 while the user interface 200 is displayed, the reception unit 34 accepts the reduced image as a determination operation in the user interface 200. At this time, the image acquisition unit 40 transmits a distribution request for the camera image on which the selection mark 220 is arranged to the distribution server 18. The distribution server 18 receives a distribution request from the information processing device 10 and streams and distributes a high-resolution photographed image captured by the designated camera to the information processing device 10. The image acquisition unit 40 acquires a high-resolution captured image corresponding to the determined reduced image, and the display control unit 50 outputs the acquired captured image to the image providing unit 52. At this time, the display control unit 50 generates a display image according to the line-of-sight direction and the viewpoint position of the HMD 100, and outputs the display image to the image providing unit 52. The image providing unit 52 provides the display image to the HMD 100, whereby the user can see the live image from the selected camera.

The present invention has been described above based on examples. Examples are examples, and it will be understood by those skilled in the art that various modifications are possible for each of these components and combinations of each processing process, and that such modifications are also within the scope of the present invention. In the embodiment, the user can freely select the camera-captured image, but by selecting a predetermined display mode, the camera-captured image selected on the distribution server 18 side may be displayed.

In the modified example, a plurality of screens may be arranged in a virtual three-dimensional space, and images taken by the camera may be displayed on each screen. At this time, the user may freely set the arrangement of the plurality of screens, or the user may freely set the camera-captured image to be displayed on each screen.

In the embodiment, it has been described that the live image is delivered, but the delivered image does not have to be a live image and may be a photographed one. In this case, the information processing device 10 may be provided with the camera-captured image from the distribution server 18, or may be provided with the camera-captured image from a recording medium such as a DVD.

1 ... Information processing system, 10 ... Information processing device, 18 ... Distribution server, 20 ... Sensor data receiving unit, 22 ... Camera image receiving unit, 24 ... Input data receiving unit, 30 ... HMD information acquisition unit, 32 ... line-of-sight information determination unit, 34 ... reception unit, 40 ... image acquisition unit, 50 ... display control unit, 52 ... image provision unit, 100 ... HMD.

The present invention relates to a technique for outputting a camera-captured image.

Claims (8)

The reception department that accepts user operations and
An image acquisition unit that acquires a plurality of low-resolution reduced images obtained by reducing each of the captured images taken by a plurality of cameras based on the user operation received by the reception unit.
An HMD information acquisition unit that acquires posture information and / or position information of a head-mounted display mounted on the user's head, and
A line-of-sight information determination unit that determines the line-of-sight direction and / or viewpoint position according to the posture information and / or position information of the head-mounted display.
It is provided with a display control unit that generates a display image in which each of a plurality of low-resolution reduced images is arranged at a position corresponding to the position of the captured camera based on the line-of-sight direction and / or the viewpoint position of the head-mounted display. ,
Wherein the display control unit, place a virtual venue simulating a venue in which a plurality of cameras are arranged in the image, place the reduced image at a position corresponding to the camera position in the virtual venue,
When the reception unit receives the operation of selecting the reduced image, the display control unit generates a display image as a background image by stretching the selected reduced image while keeping the arrangement of the plurality of reduced images.
When the reception unit receives the operation of determining the reduced image, the image acquisition unit acquires a high-resolution captured image corresponding to the determined reduced image, and the display control unit acquires the acquired high-resolution captured image. Is used to generate a display image according to the line-of-sight direction and / or the viewpoint position of the head-mounted display.
An information processing device characterized by this. The display control unit adds a mark indicating that the selected reduced image has been selected to the reduced image.
The information processing apparatus according to claim 1. When the reception unit receives the operation of determining the reduced image, the display control unit hides the plurality of reduced images arranged in the virtual venue.
The information processing apparatus according to claim 1 or 2. The image acquisition unit acquires an image to be streamed.
The information processing apparatus according to any one of claims 1 to 3. The display control unit arranges information about the camera in association with the reduced image.
The information processing apparatus according to any one of claims 1 to 4. The display control unit arranges at least one of information about the shooting format of the camera, information about the shooting direction of the camera, and information about the shooting target as information about the camera in association with the reduced image.
The information processing apparatus according to claim 5. Steps to acquire multiple low-resolution reduced images, each of which is a reduced image taken by multiple cameras,
The step of acquiring the posture information and / or the position information of the head-mounted display mounted on the user's head, and
Steps to determine the line-of-sight direction and / or viewpoint position according to the posture information and / or position information of the head-mounted display, and
Based on the line-of-sight direction and / or viewpoint position of the head-mounted display, a virtual venue that imitates a venue where multiple cameras are arranged is arranged in the image, and each of the multiple low-resolution reduced images is displayed on the multiple cameras. Steps to generate a display image placed at the position corresponding to each position,
The step of accepting the selection operation of the reduced image and
Based on the selection operation, the step of enlarging the selected reduced image to generate a display image as a background image while keeping the arrangement of multiple reduced images as it is,
The step of accepting the decision operation of the reduced image and
The step of acquiring a high-resolution captured image corresponding to the determined reduced image based on the determination operation,
Using the acquired high-resolution captured image, a step of generating a display image according to the line-of-sight direction and / or the viewpoint position of the head-mounted display, and
An image output method characterized by having. On the computer
A function to acquire multiple low-resolution reduced images, which are reduced images taken by multiple cameras, and
A function to acquire posture information and / or position information of a head-mounted display mounted on the user's head, and
A function to determine the line-of-sight direction and / or the viewpoint position according to the posture information and / or the position information of the head-mounted display, and
Based on the line-of-sight direction and / or viewpoint position of the head-mounted display, a virtual venue that imitates a venue where multiple cameras are arranged is arranged in the image, and each of the multiple low-resolution reduced images is displayed on the multiple cameras. A function to generate a display image placed at the position corresponding to each position, and
A function that accepts the selection operation of reduced images and
Based on the selection operation, the function to generate a display image as a background image by enlarging the selected reduced image while keeping the arrangement of multiple reduced images,
A function that accepts the decision operation of the reduced image and
A function to acquire a high-resolution captured image corresponding to the determined reduced image based on the determination operation, and
A function to generate a display image according to the line-of-sight direction and / or the viewpoint position of the head-mounted display using the acquired high-resolution captured image, and
A program to realize.

Images