JP7537425B2 - Information processing device, information processing method, and program - Google Patents

Description

The present disclosure relates to an information processing device, an information processing method, and a program.

In sports broadcasts and the like, the video to be broadcast, distributed, recorded, or transferred (main video) is selected from the video captured by an imaging device. The selection of the main video is performed by a user of the system that processes the video, who reviews each video and determines which video is appropriate as the main video.

In this case, the user can more easily select the main image by understanding the state of the imaging device. For example, Patent Document 1 discloses a technology that displays the position, orientation, and imaging range of the imaging device on a map on a display screen.

Japanese Patent Application Publication No. 9-289606

Incidentally, changes to the state of the imaging device, such as its position and orientation, may be performed by the above-mentioned system or by workers at the site. However, Patent Document 1 does not take into consideration the fact that workers at the imaging site may move or change the orientation of the imaging device.

According to the present disclosure, there is provided an information processing device including an imaging position information calculation unit that calculates the position and orientation of an imaging device as imaging device position information based on camera data received from the imaging device and linked to video data, and an information display control unit that controls the display of the imaging device position information.

The present disclosure also provides an information processing method that includes a processor calculating a position and orientation of an imaging device as imaging device position information based on camera data received from the imaging device and linked to video data, and controlling display of the imaging device position information.

In addition, according to the present disclosure, a program is provided for causing a computer to function as an information processing device that includes an imaging position information calculation unit that calculates the position and orientation of the imaging device as imaging device position information based on camera data received from the imaging device and that is linked to video data, and an information display control unit that controls the display of the imaging device position information.

FIG. 1 is a diagram for explaining an example of the overall configuration of a system 1 according to an embodiment of the present invention. 10 is a diagram for explaining an example of acquisition of camera data by the imaging device 10 according to the embodiment. FIG. 11 is a diagram for explaining an example of superimposition of camera data by the imaging device 10 and the CCU 20 according to the embodiment. FIG. 2 is a diagram illustrating an example of a functional configuration of an information processing device 30 according to the embodiment. FIG. 13 is a diagram for explaining an example of a calculation process of the imaging range of the imaging device 10 by the imaging position information calculation unit 340 according to the embodiment. FIG. 13 is a diagram for explaining an example of display control by an information display control unit 360 according to the embodiment. FIG. 13 is a diagram for explaining an example of display control of the next main image candidate by the information display control unit 360 according to the embodiment. FIG. 13 is a diagram for explaining another example of display control by the information display control unit 360 according to the embodiment. FIG. 13 is a diagram for explaining an example of display control of the next main image candidate by the information display control unit 360 according to the embodiment. FIG. 11 is a diagram for explaining an example of display control of the imaging device 10 in a predetermined situation by the information display control unit 360 according to the embodiment. FIG. 13 is a diagram for explaining an example of control of the display mode by the information display control unit 360 according to the embodiment when at least one of the position and the orientation of the imaging device 10 does not satisfy the history information. FIG. 13 is a diagram for explaining an example of control of the display mode by the information display control unit 360 according to the embodiment when at least one of the position and the orientation of the imaging device 10 does not satisfy the history information. FIG. 13 is a diagram for explaining display control related to acceptance of an input operation of the information input unit 370 by the information display control unit 360 according to the embodiment, and an example of acceptance of the input operation by the information input unit 370. FIG. 11 is a diagram for explaining an example of an operation flow relating to a process of calculating imaging device position information of a plurality of imaging devices 10 by the information processing device 30 according to the embodiment. FIG. 13 is a diagram for explaining an example of an operational flow relating to a calculation process of the imaging range of the imaging device 10 by the imaging position information calculation unit 340 according to the embodiment and a display process of the imaging range by the information display control unit 360. FIG. 11 is a diagram for explaining an example of an operational flow relating to a process of selecting video data of which of a plurality of imaging devices 10 as a main video by the information processing device 30 according to the embodiment. 2 is a block diagram showing an example hardware configuration of an information processing device 30 according to an embodiment of the present disclosure. FIG.

A preferred embodiment of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that in this specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals to avoid redundant description.

The explanation will be given in the following order.
1. Background 2. Embodiment 2.1. Overall configuration example 2.2. Functional configuration example of information processing device 30 2.3. Display control example 2.3.1. Display control example 1
2.3.2. Display control example 2
2.3.3. Display control example 3
2.3.4. Display control example 4
2.3.5. Display control example 5
2.3.6. Display control example 6
2.3.7. Display control example 7
2.4. Operational examples 2.4.1. Operational example 1
2.4.2. Operation example 2
2.4.3. Operation example 3
3. Hardware configuration example 4. Summary

1. Background
First, the background of the present disclosure will be described. In a system for broadcasting, distributing, recording, and transferring video in the field of sports watching, etc., a user checks video generated by imaging of multiple imaging devices and selects which video to broadcast, distribute, record, and transfer as the main video. Therefore, when there are multiple generated videos, the user checks each video and determines in real time which video should be selected as the main video. For example, in a sports broadcast scene, the user selects a video in which the target player is shown larger, or a video in which a specific player is shown.

Furthermore, if the user can grasp the position and orientation of the imaging device placed at the imaging site, it will be possible to select more appropriate images. Patent Document 1 discloses a technology that displays the position, orientation, and imaging range of the imaging device on a map on a display screen. However, Patent Document 1 does not take into consideration changes in the display in response to a worker at the imaging site moving or changing the orientation of the imaging device.

The technical concept of the present disclosure has been conceived in consideration of the above points, and makes it possible to visually grasp the position, orientation, and imaging range of the imaging device in real time, and intuitively determine which imaging device generated the video data to select.

2. Embodiment
<<2.1. Overall configuration example >>
Next, an example of the overall configuration of a system 1 according to the present embodiment will be described with reference to Fig. 1. The system 1 according to the present embodiment includes an imaging device 10, a CCU (Camera Control Unit) 20, an information processing device 30, a network 40, and a post-processing device 50.

The imaging device 10 generates video data by capturing an image. The imaging device 10 may also acquire information indicating the state of the imaging device 10 as camera data. The camera data is linked to the video data, for example by being superimposed thereon, and transmitted to the CCU 20, which will be described later.

The CCU 20 controls the imaging device 10 and receives video data and camera data linked to the video data from the imaging device 10. The CCU 20 also transmits the video data to the information processing device 30 described later.

As shown in Figure 1, the system 1 may include a combination of multiple imaging devices 10a-10n and multiple CCUs 20a-20n. The imaging devices 10 and the CCU 20 may be connected by, for example, a camera cable. Here, an example of the acquisition and superimposition of camera data by the imaging device 10 and CCU 20 according to this embodiment will be described with reference to Figures 2 and 3.

Figure 2 is a diagram for explaining an example of camera data acquisition by the imaging device 10 according to this embodiment. The imaging device 10 is shown in FIG. 2. The imaging device 10 acquires various information from each part. For example, a CPU (Central Processing Unit) provided in the imaging device 10 may acquire, as camera data, data such as zoom value and focus distance from a lens, acceleration information and angle information of the imaging device 10 from a motion sensor, and information regarding pan and tilt from a tripod attached to the imaging device 10. The CPU of the imaging device 10 transmits the acquired information to the CCU 20 described later.

Figure 3 is a diagram for explaining an example of camera data superimposition by the imaging device 10 and CCU 20 according to this embodiment. In Figure 3, the imaging device 10 and CCU 20 are shown in outline. The imaging device 10 transmits the camera data shown in Figure 2 to the CPU of the CCU 20 via the camera cable. Meanwhile, the camera processor of the imaging device 10 transmits the imaging data generated by imaging to the video processor of the CCU 20 via the camera cable. The video formatter (software) of the CCU 20 superimposes the camera data on the video data and transmits the video data on which the camera data is superimposed to the information processing device 30 in SDI (Serial Digital Interface) format. Note that a time code is superimposed on the video data.

The video data and camera data may be transmitted to the information processing device 30 via a network such as Ethernet (registered trademark) by superimposing the camera data on a header of a video streaming format. In the following specification, an example in which camera data is transmitted to the information processing device 30 in SDI format is described, but the transmission and reception of camera data is not limited to this example. For example, the information processing device 30 may acquire the camera data of the imaging device 10 by using a GPS (Global Positioning System).

Referring again to Figure 1, an example of the overall configuration of system 1 in this embodiment will be described.

The information processing device 30 calculates the position and orientation of the imaging device 10 based on the camera data received from the CCU 20 in SDI format, and displays information indicating the position and orientation of the imaging device based on the calculation result. Hereinafter, the information indicating the position and orientation of the imaging device is also referred to as imaging device position information. The information processing device 30 may also calculate the imaging range of the imaging device 10 based on the camera data, and display information indicating the calculated imaging range. In other words, the imaging device position information includes information indicating the position, orientation, and imaging range of the imaging device 10. The information processing device 30 may be equipped with a display device, for example, and may display the above information.

The information processing device 30 may receive auxiliary data from an external database server via the network 40 described below. Here, auxiliary data refers to information related to an object that is the subject of imaging and exists at the imaging site. Information related to the object includes, for example, object position information indicating the position of the object. For example, when the system 1 is used for sports broadcasting, the object is a player or a ball.

The information processing device 30 may display information related to the field (imaging site), object position information, and imaging device position information in association with each other based on the video data, camera data, and auxiliary data. Details of various processes performed by the information processing device 30 will be described later.

The network 40 has a function of connecting the information processing device 30 to an external database server. The network 40 may include public line networks such as the Internet, telephone line networks, and satellite communication networks, as well as various LANs (Local Area Networks) including Ethernet (registered trademark), and WANs (Wide Area Networks). The network 40 may also include dedicated line networks such as IP-VPN (Internet Protocol-Virtual Private Network). The network 40 may also include wireless communication networks such as Wi-Fi (registered trademark) and Bluetooth (registered trademark). The auxiliary data is transmitted from the external database server to the information processing device 30 via the network 40.

Based on a request from the information processing device 30, the post-processing device 50 performs switching of the main video and creation of a highlight video using various data transmitted from the information processing device 30. Note that the post-processing device 50 may receive some of the video data and camera data from the imaging device 10 or the CCU 20 without going through the information processing device 30.

<<2.2. Example of functional configuration of information processing device 30>>
Next, an example of the functional configuration of the information processing device 30 according to this embodiment will be described with reference to Fig. 4. The information processing device 30 according to this embodiment includes a data communication unit 310, a video camera data acquisition unit 320, an auxiliary data acquisition unit 330, an imaging position information calculation unit 340, a production data analysis unit 350, an information display control unit 360, an information input unit 370, a post-processing request unit 380, a storage unit 391, and a memory unit 392.

The data communication unit 310 receives video data and camera data linked to the video data from the CCU 20. The data communication unit 310 may also receive auxiliary data from an external database server via the network 40. The data communication unit 310 may also perform other required communications between the CCU 20 and the external database server.

The video camera data acquisition unit 320 acquires video data and camera data from the data received by the data communication unit 310. The video camera data acquisition unit 320 transmits the acquired video data and camera data to the imaging position information calculation unit 340 and the production data analysis unit 350, respectively.

The auxiliary data acquisition unit 330 acquires auxiliary data from the data received by the data communication unit 310. The auxiliary data acquisition unit 330 transmits, from the acquired auxiliary data, for example, object position information to the imaging position information calculation unit 340, and also transmits data used in subsequent processing by the subsequent processing device 50 to the production data analysis unit 350.

The imaging position information calculation unit 340 calculates the position and orientation of the imaging device 10 as imaging device position information based on the camera data linked to the video data and received from the imaging device 10. The imaging position information calculation unit 340 may further calculate the imaging range of the imaging device 10 based on information indicating the angle of view and focus distance of the imaging device 10 included in the received camera data.

Here, an example of calculation of the imaging range of the imaging device 10 by the imaging position information calculation unit 340 will be described. First, the imaging position information calculation unit 340 stores information indicating the characteristics of the imaging device 10 and information indicating the characteristics of the lens attached to the imaging device 10 in advance as a data table. The characteristics of the imaging device 10 and the characteristics of the lens may be stored so as to be associated with the model number of the imaging device 10 and the model number of the lens, respectively.

The imaging position information calculation unit 340 calculates the angle of view based on, for example, a zoom value included in the camera data. The imaging position information calculation unit 340 calculates the horizontal distance from the imaging device 10 that an object to be imaged is located based on the zoom value and the focus distance. Finally, the imaging position information calculation unit 340 calculates the imaging range based on the angle of view and the focus position.

In addition, when the imaging device 10 is turned up or down, such as when there is a vertical distance between the imaging device 10 and the object (different heights), the horizontal distance of the imaging range of the imaging device 10 is shorter than when the imaging device 10 is facing horizontally.

Here, an example of a calculation process of the imaging range of the imaging device 10 by the imaging position information calculation unit 340 according to this embodiment will be described with reference to Fig. 5. On the left side of Fig. 5, a diagram CA1 showing the imaging range of the imaging device 10 and a diagram CV showing the respective distances when a vertical distance exists between the imaging device 10 and an object are shown.

Diagram CA1 showing the imaging range of the imaging device 10 on the left side of Figure 5 shows the imaging range of the focus distance L and the angle of view θa. The imaging range shown here is the range when there is no elevation difference, i.e. when the imaging device 10 is facing horizontally. Also, diagram CV showing the respective distances when there is a vertical distance between the imaging device 10 and the object on the left side of Figure 5 shows the focus distance L, elevation angle θb, horizontal distance D, and vertical distance h. The focus distance L here is the same as the focus distance L shown in diagram CA1 showing the imaging range of the imaging device 10.

The vertical distance h may be calculated, for example, using heights measured in advance at each position on the field where the image is captured. Alternatively, the vertical distance h may be calculated using heights detected based on sensors provided on the image capture device 10 and the object. In addition, in cases where most of a field, such as a soccer field, is the same height, the height of a predetermined position may be regarded as the height of the entire field, and the vertical distance h may be calculated using the difference between that height and the height of the image capture device 10 or the object.

The imaging position information calculation unit 340 calculates the horizontal distance D based on the focal distance L and the vertical distance h calculated by the method described above. Next, based on the calculated horizontal distance D, the imaging position information calculation unit 340 calculates the imaging range when there is a difference in height between the imaging device 10 and the object, i.e., when the imaging device 10 is turning up and down, as shown in FIG. CA2 showing the imaging range of the imaging device 10 shown on the right side of FIG. 5.

In this way, even if there is a height difference between the imaging device 10 and the object, it is possible to check the imaging range in horizontal distance, making it possible to more accurately select the imaging device 10 capturing the image to be selected as the main image.

Alternatively, the imaging position information calculation unit 340 may calculate object position information indicating the position of the object to be imaged, for example, based on the video data and auxiliary data, and may associate the object position information with the imaging device position information. The object position information may be calculated based on whether the object to be imaged is captured in the video data, and, if so, how large it is captured. Furthermore, the imaging position information calculation unit 340 may identify the imaging device 10 corresponding to the video data to be used as the main video, or the imaging device 10 expected to generate the video data to be used as the main video next, based on the camera data and auxiliary data. Furthermore, the imaging position information calculation unit 340 may further calculate the position of the object to be imaged and the position of the imaging device 10 by associating them.

In addition, when multiple imaging devices 10 are connected to the information processing device 30 via the CCU 20, the imaging position information calculation unit 340 may perform the above processing for each imaging device 10.

Referring again to Figure 4, an example of the functional configuration of the information processing device 30 in this embodiment will be described.

The production data analysis unit 350 acquires the video data, camera data, and auxiliary data from the video camera data acquisition unit 320, and the auxiliary data from the auxiliary data acquisition unit 330, and stores them in the storage unit 392 described below. The production data analysis unit 350 may also store the video data and camera data in the storage unit 392 by linking them to a time code.

The production data analysis unit 350 is an example of a video creation control unit that provides predetermined video data and camera data to the post-processing request unit 380 based on a request from the post-processing request unit 380 described below. The video data, camera data, and auxiliary data provided by the production data analysis unit 350 are transmitted to the post-processing device 50 via the post-processing request unit 380, and can be used for switching the main video, creating highlight footage, and the like.

The information display control unit 360 controls the display of information indicating the position and orientation of the imaging device 10 calculated by the imaging position information calculation unit 340. When the imaging position information calculation unit 340 has calculated the imaging range of the imaging device 10, the information display control unit 360 may control the display of the calculated imaging range. Furthermore, when the imaging position information calculation unit 340 has calculated the position of an object, the information display control unit 360 may control the display of the calculated position of the object so that it corresponds to the position of the imaging device 10.

Specific examples of display control by the information display control unit 360 will be described later.

The information input unit 370 accepts an input operation on the information displayed by the information display control unit 360. For example, the information input unit 370 may be provided with a touch panel superimposed on the information display control unit 360, and may accept a touch operation on the information displayed by the information display control unit 360. The information input unit 370 may also accept a request to create a highlight video using video data generated by imaging by the imaging device 10.

The post-processing request unit 380 requests the post-processing device 50 to switch the imaging device 10 selected as the main video. The post-processing request unit 380 may also request the post-processing device 50 to create a highlight video using imaging data generated by multiple imaging devices 10. The request for switching the imaging device 10 and the creation of the highlight video may be executed by the post-processing request unit 380 based on, for example, input received by the information input unit 370. When requesting the creation of a highlight video, the post-processing request unit 380 receives the video data required to generate the highlight video, the camera data linked to the video data, and auxiliary data from the production data analysis unit 350.

The storage unit 391 stores history information indicating the change history of the imaging device 10. The history information stored in the storage unit 391 is used for display control by the information display control unit 360 when at least one of the position or orientation of the imaging device 10 does not satisfy the history information.

The storage unit 392 stores the video data transmitted from the imaging device 10, the camera data linked to the video data, and the auxiliary data transmitted from an external database server via the network 40. The storage unit 392 provides the above data to the production data analysis unit 350 as appropriate based on the control of the production data analysis unit 350.

An example of the functional configuration of the information processing device 30 according to this embodiment has been described above. Note that the functional configuration described above using FIG. 4 is merely an example, and the functional configuration of the information processing device 30 according to this embodiment is not limited to this example.

<<2.3. Display control example>>
Next, a specific example of display control by the information display control unit 360 according to the present embodiment will be described with reference to FIGS.

[2.3.1. Display control example 1]
First, an example of display control by the information display control unit 360 according to the present embodiment will be described with reference to FIG. 6. The information display control unit 360 controls the display of information indicating the position and orientation of the imaging device 10 as imaging device position information calculated by the imaging position information calculation unit 340. For example, the display control of the information indicating the position and orientation of the imaging device 10 may be expressed by displaying an icon of the imaging device 10 at a corresponding position in the field and in a direction that allows the user to know the direction in which the imaging device 10 is actually facing. In addition, the information display control unit 360 may control the display of information indicating the position and orientation of the imaging device 10 selected as the main image from among the multiple imaging devices 10 so as to be different from information indicating the positions and orientations of the other imaging devices 10.

An example will be described with reference to FIG. 6. FIG. 6 shows an example of a screen display by the information display control unit 360. Specifically, FIG. 6 shows information indicating the field where the imaging is taking place, icons 10a-10k of the imaging devices 10, imaging ranges ARa-ARk corresponding to the icons 10a-10k, respectively, and objects O1-O3 which are racing cars. Here, the imaging device 10g generates video data that has been selected as the main video, for example. Here, the video data has been selected as the main video, but is displayed differently from the other imaging devices 10.

In this way, by displaying the information relating to the imaging device 10 and the object calculated by the imaging position information calculation unit 340 on a single screen of the information display control unit 360, the user can intuitively grasp the positional relationship between the imaging device 10, including the imaging range, and the object.

The information display control unit 360 may control the display of the above information in real time. Specifically, when a change in position or orientation occurs due to the imaging device 10 moving or rotating, the information display control unit 360 may control the display to reflect the change in real time. As described above, the video data and the camera data linked to the video data are transmitted from the imaging device 10 to the information processing device 30 via the CCU 20. Therefore, even if the user of the information processing device 30 does not control the position or orientation of the imaging device 10, such as when the imaging device 10 is moved or rotated by an operator at the imaging site, the information display control unit 360 can display the position and orientation of the imaging device 10 in real time.

The information input unit 370 may also receive an input operation for the information indicating the position and orientation of the imaging device 10 displayed by the information display control unit 360. The input operation here is, for example, a touch operation for the information indicating the position and orientation of the imaging device 10 as imaging device position information displayed on a display on which a touch panel is superimposed. The post-processing request unit 380 may request the post-processing device 50 to perform switching processing for the imaging device 10 selected as the main image based on the input operation for the information indicating the position and orientation of the imaging device 10 received by the information input unit 370.

In an example of Figure 6, when the information input unit 370 receives, for example, a touch operation on the icon of the imaging device 10k displayed by the information display control unit 360, the post-processing request unit 380 may request the post-processing device 50 to perform processing to switch the video data of the imaging device 10k as the main image.

In this way, the imaging device 10 that generates the video data as the main image can be selected based on visual information, making it possible to perform switching processing without unnecessary effort.

[2.3.2. Display control example 2]
Next, an example of display control of the next main video candidate by the information display control unit 360 according to the present embodiment will be described with reference to Fig. 7. The information display control unit 360 may control the output mode of the imaging device 10 that is the next main video candidate based on the camera data and auxiliary data. For example, the information display control unit 360 may change the output mode of the imaging device 10 in which the object is currently present within the imaging range as the imaging device 10 that generates video data as the next main video candidate.

An example will be described in FIG. 7. FIG. 7 shows an example of a screen display by the information display control unit 360. Specifically, FIG. 7 shows information indicating the field where the imaging took place, icons 10a-10k of the imaging devices 10, imaging ranges ARa-ARk corresponding to the icons 10a-10k, and objects O1-O3. In this situation, the video data of the imaging device 10g has been selected as the main video, and object O1 is present in the imaging range ARb of the imaging device 10. Here, the information display control unit 360 changes the display mode of the imaging device 10b and the imaging range ARb based on this situation.

In this way, by changing the output mode of the imaging device 10 when an object is within the imaging range based on the camera data, it is possible to prevent missing the timing to capture the object.

[2.3.3. Display control example 3]
Next, a further example of display control by the information display control unit 360 according to the present embodiment will be described with reference to Fig. 8. Although an example in which the object is a racing car has been described in Fig. 6 and Fig. 7, the object may also be a ball in the field of sports. In the example shown in Fig. 8, the information display control unit 360 may display an object O4 which is a ball, and control the display so that the display mode of an imaging device 10 in which the object O4 is within the imaging range is different from that of other imaging devices 10.

An example will be described with reference to FIG. 8. In FIG. 8, the video data of imaging device 10n, in which object O4 is present in the imaging range, is selected as the main video. Note that object O4 is also present in the imaging ranges of imaging device 10m and imaging device 10p. In such a case, for example, of the imaging data of multiple imaging devices 10, the imaging data that is able to capture the object largest may be selected as the main video.

[2.3.4. Display control example 4]
Next, an example of display control of the next main video candidate by the information display control unit 360 according to the present embodiment will be described with reference to Fig. 9. The information display control unit 360 may control the display mode so that the imaging device position information of the imaging device 10 of which the video data to be generated is selected as the main video among the multiple imaging devices 10 is different from the imaging device position information of the other imaging devices 10. Furthermore, the information display control unit 360 may specify the imaging device 10 that is the next main video candidate based on the imaging device position information and the object position information. For example, the information display control unit 360 may specify the imaging device 10 in which an object is expected to be present within the imaging range after a predetermined time as the imaging device 10 that will generate video data as the next main video candidate.

An example of Figure 9 will be described. Figure 9 shows an example of a screen display by the information display control unit 360. Figure 9 differs from Figure 6 in that object O1 is present near the imaging range ARb of imaging device 10b and is expected to move into imaging range ARb after a predetermined time.

In the example of Figure 9, the information display control unit 360 controls the display mode so that the imaging device position information of the imaging device 10b is different (distinguishable) from the imaging device position information of the other imaging devices 10, because it is expected that the object O1 will move into the imaging range ARb of the imaging device 10b.

In this way, by displaying the imaging device position information of the imaging device 10 that is the next candidate for the main image in a display format different from the imaging device position information of the other imaging devices 10 based on the camera data and auxiliary data, the user can quickly determine which imaging device 10 to select next.

[2.3.5. Display control example 5]
Next, an example of display control of the imaging device 10 in a predetermined situation by the information display control unit 360 according to the present embodiment will be described with reference to Fig. 10. The information display control unit 360 may control the display mode of the imaging device position information of the imaging device 10 in which at least one of the position and the orientation does not change for a predetermined time or more based on the camera data so as to be different from the position information of the other imaging devices 10. Alternatively, the information display control unit 360 may control the display mode of the imaging device position information of the imaging device 10 in which at least one of the position and the orientation should be changed based on the camera data so as to be different from the position information of the other imaging devices 10. For example, the information display control unit 360 may control the display mode so as to indicate that an imaging device 10 suitable for imaging an object among the multiple imaging devices 10 is unable to image the object.

An example of FIG. 10 will be described. FIG. 10 shows an example of a screen display by the information display control unit 360. Specifically, FIG. 10 shows information indicating the field where the imaging is taking place, icons 10a-10k of the imaging device 10 and their corresponding imaging ranges ARa-ARk and objects O1-O3. In FIG. 10, the camera data indicates that imaging device 10b has maintained a state in which its imaging range ARb is facing in a direction that does not include object O1 for a predetermined period of time or more. Here, the information display control unit 360 changes the display mode of imaging device 10b and imaging range ARb based on this situation.

In this way, by changing the output mode of the imaging device 10 that has not been moved for a predetermined period of time or that needs to be moved based on the camera data, an operator can give instructions to the worker of the imaging device 10 at the imaging site, or a user of the information processing device 30 can directly control the imaging device 10 to the appropriate position and orientation.

[2.3.6. Display control example 6]
Incidentally, an object captured by the imaging device 10 may move periodically. For example, the racing car described above as a specific example runs along a predetermined course. As another example of an object moving periodically, in baseball, the ball often moves back and forth between the pitcher and the catcher. When such an object moves in a manner different from the periodic movements, it may be a scene that is worthy of attention, that is, the video data capturing the scene may be the main video. For example, in baseball, the ball usually moves back and forth between the pitcher and the catcher, but when an event such as a hit occurs, an unusual change in position may occur, such as the ball moving to the outfield.

For example, when an imaging device 10 captures an image by tracking an object and a change in position or orientation occurs that is different from the usual changes in position or orientation, the display mode of the imaging device position information of the imaging device 10 may change to notify the user that a noteworthy scene may currently be occurring.

Therefore, the information display control unit 360 may control the display mode of the imaging device position information of an imaging device 10 in which at least one of the position or orientation of the imaging device 10 does not satisfy the history information, so that the imaging device position information is different from the imaging device position information of other imaging devices 10. For example, when it is indicated that an object has changed by a predetermined distance or more compared to periodic position changes based on the history information indicated by the change history of the imaging device position information of the imaging device 10 stored in the storage unit 391, the information display control unit 360 may control the display mode of the imaging device position information of an imaging device 10 in which the object is present in the imaging range, so that the imaging device position information is different from the position information of other imaging devices 10.

11A and 11B, an example of control of the display mode by the information display control unit 360 according to this embodiment when at least one of the position or orientation of the imaging device 10 does not satisfy the history information will be described. Figures 11A and 11B show an example in which the position and orientation of the imaging device 10 and the position of the ball during a baseball game are displayed.

In Fig. 11A, the information display control unit 360 displays the imaging device 10r, the imaging range ARr of the imaging device 10r, and the object O5. Here, the object O5 moves periodically between two predetermined points, as shown on the left and right sides of Fig. 11A. This periodic change in position of the object O5 is stored by the storage unit 391 as imaging information position information of the imaging device 10r, which is changing its orientation to follow the object O5. Also, the imaging device 10r changes its own orientation to follow the change in position of the object O5, i.e., so that the object O5 is located in the imaging range ARr.

Here, when a position change different from the periodic position change of object O5 shown in Fig. 11A occurs, the information display control unit 360 changes the display mode of the imaging device 10r and the imaging range ARr. In the example shown in Fig. 11B, when the change history of the imaging device 10r provided from the storage unit 391 indicates that the object O5, which is the ball, has moved toward the outfield, the information display control unit 360 changes the display mode of the imaging device 10r and the imaging range ARr.

In this way, by informing the user of position changes that differ from the periodic position changes of the object based on the imaging device position information of the imaging device 10, the user can select an image showing a specific scene as the main image without missing it.

The above-mentioned history information may be stored in the storage unit 391 at a predetermined timing as a change history indicating periodic changes in the imaging device position information of the imaging device 10. Furthermore, after being stored in the storage unit 391, the history information may be appropriately updated based on changes in the position of the imaging device 10. On the other hand, the history information may also be confirmed or corrected by the user via the information input unit 370.

For example, a position change different from a periodic position change may be detected when an operator of the imaging device 10 presses a button or the like provided on the imaging device 10. When a button or the like provided on the imaging device 10 is pressed, a predetermined signal is superimposed on the image, and the information processing device 30 may determine that a predetermined scene has occurred based on the predetermined signal.

In addition, a position change other than a periodic position change may be detected, for example, based only on a change in the orientation of the imaging device 10. The information display control unit 360 may change the display mode of both the information indicating the position and orientation of the imaging device 10 that does not satisfy the history information and the information indicating the imaging range, or may change either one of them.

[2.3.7. Display control example 7]
Next, an example of display control related to reception of an input operation of the information input unit 370 by the information display control unit 360 according to this embodiment and reception of the input operation by the information input unit 370 will be described with reference to Fig. 12. In Fig. 12, field information, imaging device position information, and object position information are shown as an image G. Also, in Fig. 12, a time series slider S, a switching button B1, and a highlight video creation button B2 are shown below the image G.

An example of FIG. 12 will be described below. Image G is the same as the display screen shown in FIG. 6 to FIG. 11. Slider S is a slider that allows the user to select which time in the time series of video data is to be displayed as image G, either from the time from the start of imaging to the present or from the time from the end of imaging. Switching button B1 is a button that allows the user to request the post-processing device 50 to switch the video data of the imaging device 10 selected in image G as the main video. Highlight video creation button B2 is a button that allows the user to request the post-processing device 50 to generate a highlight video that satisfies specified conditions.

In this way, various editing operations can be performed more easily by the information input unit 370 accepting the input operation for the information displayed by the information display control unit 360. Of course, the display control related to the acceptance of the input operation of the information input unit 370 by the information display control unit 360 and the acceptance of the input operation by the information input unit 370 are not limited to the above example.

<<2.4. Operation example>>
[2.4.1. Operation example 1]
Next, an example of the flow of operations related to the calculation process of the imaging device position information of the multiple imaging devices 10 by the information processing device 30 according to the present embodiment will be described with reference to Fig. 13. First, the video camera data acquisition unit 320 acquires the camera data of any one of the imaging devices 10 from the data communication unit 310 (S101). Next, the video camera data acquisition unit 320 stores the camera data acquired in step S101 in memory together with the time code (S102). Next, if the camera data of all the imaging devices 10 have not been stored in memory together with the time code (S103: NO), the process returns to step S101.

On the other hand, if the camera data of all the imaging devices 10 has been stored in memory together with the time code (S103: YES), the auxiliary data acquisition unit 330 acquires the auxiliary data from the data communication unit 310 (S104). Note that step S104 may be executed before steps S101 and S102, or may be executed in parallel with steps S101 and S102. Next, the imaging position information calculation unit 340 calculates the area of the entire field, which is the imaging site, based on the camera data of the multiple imaging devices 10 stored in step S102 (S105).

Next, the imaging position information calculation unit 340 calculates the position and orientation of any one of the imaging devices 10 based on the camera data acquired in step S101 (S106). Next, the information display control unit 360 displays information indicating the position and orientation of the imaging device 10 calculated in step S106 (S107).

Next, the imaging position information calculation unit 340 calculates the imaging range of the imaging device 10 for which information indicating the position and orientation is displayed in step S107 based on the camera data acquired in step S101 and the auxiliary data acquired in step S106 (S108). Next, the information display control unit 360 displays the information indicating the imaging range of the imaging device 10 calculated in step S108 (S109).

Next, if information indicating the positions, orientations, and imaging ranges of all imaging devices 10 is not displayed as the imaging device position information (S110: NO), the process returns to step S106. On the other hand, if information indicating the positions, orientations, and imaging ranges of all imaging devices 10 is displayed as the imaging device position information (S110: YES), the information processing device 30 ends its operation.

[2.4.2. Operation example 2]
Next, an example of the flow of operations related to the calculation process of the imaging range of the imaging device 10 by the imaging position information calculation unit 340 according to this embodiment and the display process of the imaging range by the information display control unit 360 will be described with reference to Fig. 14. First, the imaging position information calculation unit 340 acquires information indicating the characteristics of the imaging device 10 and the lens attached to the imaging device 10 from the video camera data acquisition unit 320 (S201). Next, the imaging position information calculation unit 340 acquires a table of the zoom value and the angle of view of the imaging device 10 from the video camera data acquisition unit 320 (S202).

Next, the imaging position information calculation unit 340 calculates the angle of view corresponding to the zoom value using the zoom value of the imaging device 10 included in the camera data acquired in step S101 of Fig. 13 and the table acquired in step S202 (S203). Next, the imaging position information calculation unit 340 calculates the focus position based on the zoom value or focus distance included in the camera data acquired in step S101 of Fig. 13 (S204). Next, the imaging position information calculation unit 340 calculates the vertical distance between the imaging device 10 and the object based on the camera data acquired in step S101 of Fig. 13 (S205).

Next, the imaging position information calculation unit 340 calculates the horizontal distance between the imaging device 10 and the object from the focus position calculated in step S204 and the vertical distance calculated in step S205 (S206). Next, based on the angle of view calculated in step S203 and the horizontal distance calculated in step S206, the imaging range of the imaging device 10 is displayed in a sector shape (S207). Next, if the imaging range is not displayed in all imaging devices 10 (S208: NO), the process returns to step S203. On the other hand, if the imaging range is displayed in all imaging devices 10 (S208: YES), the information processing device 30 ends its operation.

[2.4.3. Operation example 3]
Next, an example of the flow of operations related to the process of selecting video data of one of the multiple imaging devices 10 as the main video by the information processing device 30 according to this embodiment will be described with reference to Fig. 15. First, if an object is present within the imaging range of any of the imaging devices 10 (S301: YES), the production data analysis unit 350 stores information indicating the position and orientation of the imaging device 10 in memory as imaging device position information (S302), and proceeds to step S303. On the other hand, if an object is not present within the imaging range of any of the imaging devices 10 (S301: NO), proceeds to step S303.

If the processing of step S301 has not been executed in all of the imaging devices 10 (S303: NO), the process returns to step S301. On the other hand, if the processing of step S301 has been executed in all of the imaging devices 10 (S303: YES) and there is no imaging device 10 that has generated video data in which an object is captured (S304: NO), the information processing device 30 ends its operation.

On the other hand, if the processing of step S301 has been executed by all imaging devices 10 (S303: YES) and there is no imaging device 10 that has generated video data in which an object is captured (S304: NO), the information processing device 30 ends its operation. On the other hand, if the processing of step S301 has been executed by all imaging devices 10 (S303: YES) and there is an imaging device 10 that has generated video data in which an object is captured (S304: YES), the imaging position information calculation unit 340 calculates the size of the captured object (S305).

Next, if the object size calculated in the most recent step S305 is the largest compared to the object size calculated in the previous step S305 (S306: YES), the imaging position information calculation unit 340 stores the imaging device 10 corresponding to the object size calculated in the most recent step S305 as a selection candidate in memory (S307). On the other hand, if the object size calculated in the most recent step S305 is not the largest compared to the object size calculated in the previous step S305 (S306: NO), the process proceeds to step S308.

Next, if the size has not been calculated for all of the imaging devices 10 in which the object is captured (S308: NO), the process returns to step S304. On the other hand, if the size has not been calculated for all of the imaging devices 10 in which the object is captured (S308: YES), the post-processing request unit 380 requests the post-processing device 50 to switch the image data of the imaging device 10 stored in memory in step S307 as the main image (S309), and the information processing device 30 ends its operation.

3. Hardware configuration example
Next, a hardware configuration example of the information processing device 30 according to an embodiment of the present disclosure will be described. FIG. 16 is a block diagram showing a hardware configuration example of the information processing device 30 according to an embodiment of the present disclosure. Referring to FIG. 16, the information processing device 30 has, for example, a processor 871, a ROM 872, a RAM 873, a host bus 874, a bridge 875, an external bus 876, an interface 877, an input device 878, an output device 879, a storage 880, a drive 881, a connection port 882, and a communication device 883. Note that the hardware configuration shown here is an example, and some of the components may be omitted. In addition, the information processing device 30 may further include components other than the components shown here.

(Processor 871)
The processor 871 functions, for example, as an arithmetic processing device or control device, and controls the overall operation or part of the operation of each component based on various programs recorded in the ROM 872, the RAM 873, the storage 880, or the removable recording medium 901.

(ROM872, RAM873)
The ROM 872 is a means for storing the programs read by the processor 871 and data used in the calculations. The RAM 873 stores, for example, the programs read by the processor 871 and various parameters that change appropriately when the programs are executed. It may be stored temporarily or permanently.

(Host bus 874, bridge 875, external bus 876, interface 877)
The processor 871, ROM 872, and RAM 873 are connected to one another via, for example, a host bus 874 capable of high-speed data transmission. On the other hand, the host bus 874 is connected to an external bus 876 having a relatively low data transmission speed via, for example, a bridge 875. In addition, the external bus 876 is connected to various components via an interface 877.

(Input device 878)
The input device 878 may be, for example, a mouse, a keyboard, a touch panel, a button, a switch, a lever, etc. Furthermore, a remote controller capable of transmitting a control signal using infrared rays or other radio waves may be used as the input device 878. The input device 878 may also include an audio input device such as a microphone.

(Output device 879)
The output device 879 is a device capable of visually or audibly notifying the user of acquired information, such as a display device such as a CRT (Cathode Ray Tube), LCD, or organic EL, an audio output device such as a speaker or a headphone, a printer, a mobile phone, a facsimile, etc. The output device 879 according to the present disclosure also includes various vibration devices capable of outputting tactile stimuli.

(Storage 880)
The storage 880 is a device for storing various types of data. For example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device is used as the storage 880.

(Drive 881)
The drive 881 is a device that reads information recorded on a removable recording medium 901 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or writes information to the removable recording medium 901 .

(Removable Recording Medium 901)
The removable recording medium 901 is, for example, a DVD medium, a Blu-ray (registered trademark) medium, an HD DVD medium, various semiconductor storage media, etc. Of course, the removable recording medium 901 may be, for example, an IC card equipped with a non-contact type IC chip, an electronic device, etc.

(Connection port 882)
The connection port 882 is a port for connecting an external device 902, such as a Universal Serial Bus (USB) port, an IEEE 1394 port, a Small Computer System Interface (SCSI), an RS-232C port, or an optical audio terminal.

(External connection device 902)
The external connection device 902 is, for example, a printer, a portable music player, a digital camera, a digital video camera, or an IC recorder.

(Communication device 883)
The communication device 883 is a communication device for connecting to a network, such as a wired or wireless LAN, Bluetooth (registered trademark), or a communication card for WUSB (Wireless USB), a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication.

<4. Summary>
As described above, the information processing device 30 disclosed herein enables a user to visually grasp the position, orientation, and imaging range of the imaging devices in real time, and intuitively determine which imaging device generated the video data to select.

Although the above describes specific examples of cameras that are imaging devices 10 mainly in the field of sports, application examples of the present disclosure are not limited to such examples. For example, the imaging device 10 in system 1 may instead be a wearable camera or a drone. By displaying imaging device position information of a wearable camera worn by a worker or an automatically moving drone to the user by the information display control unit 360, it becomes possible to apply the present disclosure not only to the field of sports but also to various situations such as news reports.

Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person with ordinary knowledge in the technical field of the present disclosure can conceive of various modified or revised examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

In addition, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology disclosed herein may provide other effects that are apparent to a person skilled in the art from the description herein, in addition to or in place of the above effects.

Note that the following configurations also fall within the technical scope of the present disclosure.
(1)
an imaging position information calculation unit that calculates a position and an orientation of the imaging device as imaging device position information based on camera data associated with the video data and received from the imaging device;
an information display control unit that controls display of the imaging device position information;
An information processing device comprising:
(2)
the camera data includes information indicating an angle of view and a focus distance of the imaging device;
the imaging position information calculation unit further calculates an imaging range of the imaging device as the imaging device position information based on information indicating an angle of view and a focus distance of the imaging device;
the information display control unit controls display of the imaging device position information including the imaging range.
The information processing device according to (1).
(3)
The camera data further includes characteristics of a lens attached to the imaging device;
The imaging position information calculation unit calculates the imaging range based on characteristics of the lens.
The information processing device according to (2).
(4)
The imaging position information calculation unit calculates the imaging range further based on a vertical position of the imaging device.
The information processing device according to (2) or (3).
(5)
the imaging position information calculation unit associates object position information indicating a position of an object to be imaged with the imaging device position information;
the information display control unit controls display of the object position information with respect to the imaging device position information.
The information processing device according to any one of (1) to (4).
(6)
The imaging position information calculation unit calculates the object position information based on the video data.
The information processing device according to (5).
(7)
The imaging position information calculation unit calculates the object position information based on auxiliary data including data related to the object.
The information processing device according to (5).
(8)
the imaging position information calculation unit calculates the imaging device position information corresponding to the plurality of imaging devices based on the camera data received from the plurality of imaging devices;
the information display control unit controls display of the imaging device position information corresponding to the plurality of imaging devices.
The information processing device according to any one of (5) to (7).
(9)
the information display control unit controls a display mode of the imaging device position information of an imaging device, the image data of which is selected as a main image among the plurality of imaging devices, so as to be different from the imaging device position information of the other imaging devices.
The information processing device according to (8).
(10)
the imaging position information calculation unit identifies an imaging device from among the plurality of imaging devices, the imaging device from which the generated video data is a next main video candidate;
the information display control unit controls a display mode of the imaging device position information of the imaging device that is the next main image candidate identified by the imaging position information calculation unit so as to be different from the imaging device position information of the other imaging devices.
The information processing device according to (9) above.
(11)
the imaging position information calculation unit specifies an imaging device that is the next main image candidate based on the imaging device position information and the object position information;
The information processing device according to (10).
(12)
the information display control unit controls a display mode of the imaging device position information, of which at least one of a position and an orientation does not change for a predetermined period of time or more, based on the camera data, so as to be different from the imaging device position information of other imaging devices.
The information processing device according to (8).
(13)
a storage unit for storing history information indicating a change history of the imaging device position information,
the information display control unit controls a display mode of the imaging device position information of an imaging device in which at least one of a position or an orientation of the imaging device based on the camera data does not satisfy the history information so as to be different from the imaging device position information of other imaging devices.
The information processing device according to any one of (8) to (12).
(14)
a post-processing request unit that requests a post-processing device to perform switching processing from the imaging device selected as the main video to the other imaging device selected, among the plurality of imaging devices, for which the generated video data is to be used as a next main video;
Further comprising:
The information processing device according to any one of (9) to (13).
(15)
an information input unit that accepts an input operation for the imaging device position information;
Further equipped with
the post-processing request unit requests the post-processing device to perform the switching process based on an input from a user related to the switching process received by the information input unit;
The information processing device according to (14) above.
(16)
the information input unit further receives an input of a request for creating a highlight video;
the post-processing request unit requests the post-processing device to create the highlight video based on the video data of the plurality of imaging devices;
The information processing device according to (15) above.
(17)
the highlight video is constructed using the video data of the imaging device showing a predetermined object,
the post-processing request unit requests the post-processing device to create the highlight video including an image of the predetermined object;
The information processing device according to (16).
(18)
an image creation control unit that causes the post-processing request unit to request the post-processing device to create the highlight image based on auxiliary data including the camera data and data related to the object;
Further comprising:
The information processing device according to (16) or (17).
(19)
The processor:
Calculating a position and an orientation of the imaging device as imaging device position information based on camera data received from the imaging device and associated with the video data;
Controlling a display of the imaging device position information;
Including,
Information processing methods.
(20)
Computer,
an imaging position information calculation unit that calculates a position and an orientation of the imaging device as imaging device position information based on camera data associated with the video data and received from the imaging device;
an information display control unit that controls display of the imaging device position information;
Equipped with
Information processing device,
A program to function as a

1 System 10 Imaging device 20 CCU
30 Information processing device 310 Data communication unit 320 Video camera data acquisition unit 330 Auxiliary data acquisition unit 340 Imaging position information calculation unit 350 Production data analysis unit 360 Information display control unit 370 Information input unit 380 Post-processing request unit 391 Storage unit 392 Memory unit 40 Network 50 Post-processing device

Claims (22)

an imaging position information calculation unit that calculates a position and an orientation of the imaging device as imaging device position information based on camera data associated with the video data and received from the imaging device;
an information display control unit that controls display of the imaging device position information;
a storage unit for storing history information indicating a change history of the imaging device position information,
the imaging position information calculation unit calculates the imaging device position information corresponding to the plurality of imaging devices based on the camera data received from the plurality of imaging devices, and associates the imaging device position information with object position information indicating a position of an object to be imaged;
the information display control unit controls display of the imaging device position information corresponding to the plurality of imaging devices and display of the object position information with respect to the imaging device position information;
the information display control unit controls a display mode of the imaging device position information of an imaging device in which at least one of a position or an orientation of the imaging device based on the camera data does not satisfy the history information so as to be different from the imaging device position information of other imaging devices.
Information processing device. the information display control unit controls a display mode of the imaging device position information of an imaging device, the image data of which is selected as a main image among the plurality of imaging devices, so as to be different from the imaging device position information of the other imaging devices.
The information processing device according to claim 1 . a post-processing request unit that requests a post-processing device to perform switching processing from the imaging device selected as the main video to the other imaging device selected, among the plurality of imaging devices, for which the generated video data is to be used as a next main video;
Further comprising:
The information processing device according to claim 2 . an information input unit that accepts an input operation for the imaging device position information;
Further equipped with
the post-processing request unit requests the post-processing device to perform the switching process based on an input from a user related to the switching process received by the information input unit;
The information processing device according to claim 3 . the information input unit further receives an input of a request for creating a highlight video;
the post-processing request unit requests the post-processing device to create the highlight video based on the video data of the plurality of imaging devices;
The information processing device according to claim 4 . the highlight video is constructed using the video data of the imaging device showing a predetermined object,
the post-processing request unit requests the post-processing device to create the highlight video including an image of the predetermined object;
The information processing device according to claim 5 . an image creation control unit that causes the post-processing request unit to request the post-processing device to create the highlight image based on auxiliary data including the camera data and data related to the object;
Further comprising:
7. The information processing device according to claim 5 or 6 . an imaging position information calculation unit that calculates a position and an orientation of the imaging device as imaging device position information based on camera data associated with the video data and received from the imaging device;
an information display control unit that controls display of the imaging device position information;
a post-processing request unit that requests a post-processing device to switch the imaging device;
an information input unit that accepts an input operation for the imaging device position information,
the imaging position information calculation unit calculates the imaging device position information corresponding to the plurality of imaging devices based on the camera data received from the plurality of imaging devices, and associates the imaging device position information with object position information indicating a position of an object to be imaged;
the information display control unit controls display of the imaging device position information corresponding to the plurality of imaging devices and display of the object position information with respect to the imaging device position information;
the information display control unit controls a display mode such that the imaging device position information of an imaging device, the generated video data of which is selected as a main video among the plurality of imaging devices, is different from the imaging device position information of the other imaging devices;
the post-processing request unit requests the post-processing device to perform the switching process from the imaging device selected as the main video to the other imaging device, of the plurality of imaging devices, the imaging device having the generated video data selected as a next main video, based on an input from a user related to the switching process received by the information input unit;
the information input unit further receives an input of a request for creating a highlight video;
the post-processing request unit requests the post-processing device to create the highlight video based on the video data of the plurality of imaging devices;
Information processing device. the highlight video is constructed using the video data of the imaging device showing a predetermined object,
the post-processing request unit requests the post-processing device to create the highlight video including an image of the predetermined object;
The information processing device according to claim 8 . an image creation control unit that causes the post-processing request unit to request the post-processing device to create the highlight image based on auxiliary data including the camera data and data related to the object;
Further comprising:
10. The information processing device according to claim 8 or 9 . the imaging position information calculation unit identifies an imaging device from among the plurality of imaging devices, the imaging device from which the generated video data is a next main video candidate;
the information display control unit controls a display mode of the imaging device position information of the imaging device that is the next main image candidate identified by the imaging position information calculation unit so as to be different from the imaging device position information of the other imaging devices.
The information processing device according to any one of claims 2 to 10 . the imaging position information calculation unit specifies an imaging device that is the next main image candidate based on the imaging device position information and the object position information;
The information processing device according to claim 11 . the camera data includes information indicating an angle of view and a focus distance of the imaging device;
the imaging position information calculation unit further calculates an imaging range of the imaging device as the imaging device position information based on information indicating an angle of view and a focus distance of the imaging device;
the information display control unit controls display of the imaging device position information including the imaging range.
The information processing device according to any one of claims 1 to 12 . The camera data further includes characteristics of a lens attached to the imaging device;
The imaging position information calculation unit calculates the imaging range based on characteristics of the lens.
The information processing device according to claim 13 . The imaging position information calculation unit calculates the imaging range further based on a vertical position of the imaging device.
15. The information processing device according to claim 13 or 14 . The imaging position information calculation unit calculates the object position information based on the video data.
The information processing device according to any one of claims 1 to 15 . The imaging position information calculation unit calculates the object position information based on auxiliary data including data related to the object.
The information processing device according to any one of claims 1 to 15 . the information display control unit controls a display mode of the imaging device position information, of which at least one of a position and an orientation does not change for a predetermined period of time or more, based on the camera data, so as to be different from the imaging device position information of other imaging devices.
The information processing device according to any one of claims 1 to 17 . 1. An information processing method executed by a processor, comprising :
an imaging position information calculation step of calculating a position and an orientation of the imaging device as imaging device position information based on camera data associated with the video data and received from the imaging device;
an information display control step of controlling a display of the imaging device position information;
and storing history information indicating a change history of the imaging device position information,
In the imaging position information calculation step, the imaging device position information corresponding to the plurality of imaging devices is calculated based on the camera data received from the plurality of imaging devices, and the imaging device position information is associated with object position information indicating a position of an object to be imaged;
In the information display control step, a display of the imaging device position information corresponding to the plurality of imaging devices and a display of the object position information with respect to the imaging device position information are controlled;
In the information display control step, a display mode of the imaging device position information of an imaging device in which at least one of a position or an orientation of the imaging device based on the camera data does not satisfy the history information is controlled so as to be different from the imaging device position information of other imaging devices.
Information processing methods. 1. An information processing method executed by a processor, comprising:
an imaging position information calculation step of calculating a position and an orientation of the imaging device as imaging device position information based on camera data associated with the video data and received from the imaging device;
an information display control step of controlling a display of the imaging device position information;
a post-processing request step of requesting a post-processing device to switch the imaging device;
and an information input step of receiving an input operation for the imaging device position information,
In the imaging position information calculation step, the imaging device position information corresponding to the plurality of imaging devices is calculated based on the camera data received from the plurality of imaging devices, and the imaging device position information is associated with object position information indicating a position of an object to be imaged;
In the information display control step, a display of the imaging device position information corresponding to the plurality of imaging devices and a display of the object position information with respect to the imaging device position information are controlled;
In the information display control step, a display mode of the imaging device position information of an imaging device, the image data of which is selected as a main image among the plurality of imaging devices, is controlled so as to be different from the imaging device position information of the other imaging devices.
In the post-processing request step, a request is made to the post-processing device to perform the switching process from the imaging device selected as the main image to the other imaging device, of the plurality of imaging devices, the imaging device having the generated image data selected as a next main image, based on an input from a user related to the switching process received in the information input step;
The information input step further includes receiving an input of a request for creating a highlight video;
the post-processing request step requests the post-processing device to create the highlight video based on the video data of the plurality of image capture devices;
Information processing methods. an imaging position information calculation unit that calculates a position and an orientation of the imaging device as imaging device position information based on camera data associated with the video data and received from the imaging device;
an information display control unit that controls display of the imaging device position information;
a storage unit that stores history information indicating a change history of the imaging device position information;
the imaging position information calculation unit calculates the imaging device position information corresponding to the plurality of imaging devices based on the camera data received from the plurality of imaging devices, and associates the imaging device position information with object position information indicating a position of an object to be imaged;
the information display control unit controls display of the imaging device position information corresponding to the plurality of imaging devices and display of the object position information with respect to the imaging device position information;
the information display control unit controls a display mode of the imaging device position information of an imaging device in which at least one of a position or an orientation of the imaging device based on the camera data does not satisfy the history information so as to be different from the imaging device position information of other imaging devices.
program. Computer,
an imaging position information calculation unit that calculates a position and an orientation of the imaging device as imaging device position information based on camera data associated with the video data and received from the imaging device;
an information display control unit that controls display of the imaging device position information;
a post-processing request unit that requests a post-processing device to switch the imaging device;
an information input unit that receives an input operation for the imaging device position information;
the imaging position information calculation unit calculates the imaging device position information corresponding to the plurality of imaging devices based on the camera data received from the plurality of imaging devices, and associates the imaging device position information with object position information indicating a position of an object to be imaged;
the information display control unit controls display of the imaging device position information corresponding to the plurality of imaging devices and display of the object position information with respect to the imaging device position information;
the information display control unit controls a display mode such that the imaging device position information of an imaging device, the generated video data of which is selected as a main video among the plurality of imaging devices, is different from the imaging device position information of the other imaging devices;
the post-processing request unit requests the post-processing device to perform the switching process from the imaging device selected as the main video to the other imaging device, of the plurality of imaging devices, the imaging device having the generated video data selected as a next main video, based on an input from a user related to the switching process received by the information input unit;
the information input unit further receives an input of a request for creating a highlight video;
the post-processing request unit requests the post-processing device to create the highlight video based on the video data of the plurality of imaging devices;
Program.

Images