JP7678211B1 - Information processing device and information processing method - Google Patents

Abstract

To make it possible to adjust collected sounds at an event venue.
[Solution] The information processing device 1 has an acquisition unit 131 that acquires sound information indicating sound collected at an event held in a specified space, which is a virtual space or a real space, an identification unit 132 that identifies the positions of one or more sound sources in the specified space based on the sound information acquired by the acquisition unit 131, a generation unit 134 that uses the sound information to generate modified sound information indicating the sound when collected when the position of at least one of the one or more sound sources in the specified space is changed, and an output unit 135 that outputs the modified sound information generated by the generation unit 134.
[Selected figure] Figure 2

Description

The present invention relates to an information processing device and an information processing method.

Conventionally, a system is known in which images and collected sounds at an event venue, such as a live concert, are delivered to a device worn by a user located in a location other than the event venue for viewing the images and sounds, allowing the user to simulate an experience of the event (see, for example, Patent Document 1).

JP 2022-134638 A

Depending on the location where sound is collected at an event venue, problems have arisen such as cheers being heard unevenly or users having difficulty hearing the sounds emitted by performers that they want to hear. Also, some event operators have expressed a desire to adjust the location where the sound source is generated.

The present invention was made in consideration of these points, and aims to make it possible to adjust the sounds collected at event venues.

The first aspect of the present invention is an information processing device. This information processing device has an acquisition unit that acquires sound information indicating sounds collected at an event held in a specified space, which is a virtual space or a real space, an identification unit that identifies the positions of one or more sound sources in the specified space based on the sound information acquired by the acquisition unit, a generation unit that uses the sound information to generate changed sound information indicating sounds when collected when the position of at least one of the one or more sound sources in the specified space is changed, and an output unit that outputs the changed sound information generated by the generation unit.

The generation unit may determine whether there is a bias in the positions of the multiple sound sources in the specified space, and if it determines that there is a bias, may generate the changed sound information corresponding to a case in which the positions of the multiple sound sources are changed so as to suppress the bias.

When the generation unit determines that there is a bias in the positions of multiple sound sources corresponding to cheers in the specified space relative to a specified position from which the sound information was acquired in the specified space, the generation unit may generate the changed sound information corresponding to a case in which the positions of the multiple sound sources are changed so as to suppress the bias.

The system may further include a reception unit that receives a selection of a sound source whose position is to be changed, and the generation unit may generate the changed sound information corresponding to a case where the position of a sound source selected by the reception unit among the one or more sound sources is changed.

The reception unit may receive a selection of the sound source whose position is to be changed from a user of a viewing device to which the changed sound information is output.

The reception unit may receive a selection of the sound source whose position is to be changed from the organizer of the event.

The reception unit may receive a new position of the sound source whose position is to be changed, and the generation unit may generate the new sound information corresponding to the case where the position of the sound source whose selection has been accepted by the reception unit is changed to the new position accepted by the reception unit.

The receiving unit may receive a position of the sound source after the change within a predetermined range in the specified space.
The generation unit may generate the changed sound information indicating a sound collected when a direction of at least one of the one or more sound sources in the specified space is changed.

The generation unit may identify, from among a plurality of sound sources, a sound source that is preferred by a user of a viewing device to which the changed sound information is output, and may generate the changed sound information corresponding to a case in which the position of the identified sound source is changed.

The acquisition unit may acquire video captured at the event, the output unit may output the sound information and the video before the generation unit generates the changed sound information to the viewing device for the user to view the sound and the video, the acquisition unit may acquire viewing position information indicating the position viewed by the user when the user views the video, and the generation unit may identify the sound source preferred by the user based on the viewing position information acquired by the acquisition unit.

The generator may generate the modified sound information indicating the sound collected when the position of at least one of the one or more sound sources is changed and an object that changes the sound is added or moved to the specified space.

The specified space may be a virtual space, the acquisition unit may acquire object position information indicating the position of an object that is present in the specified space and generates a sound, and the identification unit may identify the positions of one or more sound sources based on the sound information and the object position information acquired by the acquisition unit.

The acquisition unit may acquire the sound information collected at a predetermined position in the predetermined space, and the generation unit may generate the changed sound information indicating the sound when collected at the predetermined position when the position of at least one of the one or more sound sources is changed in the predetermined space.

The system may have a reception unit that receives a sound collection position in the specified space, and the generation unit may generate the changed sound information indicating the sound when the sound is collected at the sound collection position received by the reception unit when the position of at least one of the one or more sound sources in the specified space is changed.

The second aspect of the present invention is an information processing method. This information processing method includes the steps of acquiring sound information indicating sounds collected at an event held in a specified space, which is a virtual space or a real space, executed by a computer, identifying the positions of one or more sound sources in the specified space based on the acquired sound information, generating modified sound information using the sound information indicating sounds that are collected when the positions of at least one of the one or more sound sources in the specified space are changed, and outputting the generated modified sound information.

The present invention has the effect of making it possible to adjust the sounds collected at an event venue.

FIG. 1 is a diagram illustrating an overview of an information processing device. FIG. 2 is a diagram illustrating a functional configuration of an information processing device. FIG. 13 is a diagram illustrating an example of a selection receiving screen. 10 is a flowchart showing a process flow until an information processing device outputs audio information and video information to a viewing device.

[Overview of information processing device 1]
1 is a diagram illustrating an overview of an information processing device 1. The information processing device 1 is a computer that acquires audio information indicating sounds collected at an event venue and video information indicating videos captured at the event venue, and outputs the information to a viewing device provided in a location different from the event venue.

The information processing device 1 is communicatively connected to a sound collection device 2, a photographing device 3, and a viewing device 4 via a communication network such as the Internet or a mobile phone line. The sound collection device 2 is installed, for example, at an event venue, and collects sounds generated at the event venue. The photographing device 3 is installed, for example, at the event venue, and photographs an event taking place at the event venue. The viewing device 4 is, for example, a VR (Virtual Reality) headset installed in a location different from the event venue and worn by a user. Note that the viewing device 4 is not limited to a VR headset, and may be composed of multiple devices installed near the user, such as a display and a speaker.

The information processing device 1 acquires from the sound collection device 2 sound information indicating sounds collected at an event held in a specific space, which may be a virtual space or a real space, and acquires from the imaging device 3 video information indicating video footage of the event ((1) and (2) in FIG. 1).

The information processing device 1 identifies the positions of one or more sound sources in a specified space based on the acquired sound information ((3) in FIG. 1). If the event is a live performance or concert, the sound sources may be, for example, the voices of performers, sounds produced by musical instruments, and cheers from the audience.

The information processing device 1 generates modified sound information indicating the sound collected when the position of at least one of one or more sound sources in a specified space is changed ((4) in FIG. 1). The information processing device 1 outputs the generated modified sound information and the acquired video information to the viewing device 4 ((5) in FIG. 1). In this way, the information processing device 1 can adjust and output the sound collected at the event venue. In addition, the user can remotely view an event held in a specified space with the sound adjusted.

[Functional configuration of information processing device 1]
Next, a description will be given of the functional configuration of the information processing device 1. Fig. 2 is a diagram showing the functional configuration of the information processing device 1. The information processing device 1 has a communication unit 11, a storage unit 12, and a control unit 13.

The communication unit 11 is a communication interface for transmitting and receiving data to and from external devices such as the sound collection device 2, the image capture device 3, the viewing device 4, and a communication device that manages a communication network.
The storage unit 12 is a storage medium that stores various data, and includes a read only memory (ROM), a random access memory (RAM), a hard disk, etc. The storage unit 12 stores a program executed by the control unit 13. The storage unit 12 stores a program that causes the control unit 13 to function as an acquisition unit 131, an identification unit 132, a reception unit 133, a generation unit 134, and an output unit 135.

The control unit 13 is, for example, a CPU (Central Processing Unit). The control unit 13 executes the programs stored in the storage unit 12, thereby functioning as an acquisition unit 131, an identification unit 132, a reception unit 133, a generation unit 134, and an output unit 135.

The acquisition unit 131 acquires sound information indicating sounds collected at an event held in a specified space, which is a virtual space or a real space, and video information indicating videos captured at the event. For example, the acquisition unit 131 acquires, via a communication network, sound information collected by a sound collection device 2 installed at a specified position in a specified space as an event venue, and video information indicating videos captured by a shooting device 3 installed in the specified space. When the specified space is a real space, the sound collection device 2 is, for example, an array microphone having multiple microphones. When the specified space is a virtual space, the sound collection device 2 is, for example, a virtual array microphone installed in the virtual space. The acquisition unit 131 may acquire sound information collected by a sound collection device 2 installed at multiple specified positions in the specified space. The acquisition unit 131 may also acquire video information generated by one or more shooting devices 3 installed at positions different from the specified position.

The identification unit 132 identifies the positions of one or more sound sources in a specified space based on the sound information acquired by the acquisition unit 131. For example, the identification unit 132 identifies the positions of one or more sound sources in a specified space by estimating the direction and distance from which a sound arrives based on the sound collection results of multiple microphones in the Ike array. When the specified space is a virtual space, the acquisition unit 131 may acquire object position information indicating the positions of objects that generate sound, including avatars of other users that exist in the virtual space, from a server (not shown) that manages the virtual space. Then, the identification unit 132 may identify the positions of one or more sound sources based on the sound information acquired by the acquisition unit 131 and the object position information.

Here, when one or more performers who will appear at the event are predetermined, feature information indicating the features of the sound emitted by each of the one or more performers may be stored in the storage unit 12. Then, the identification unit 132 may identify the features of the sound emitted by each of the one or more sound sources whose positions have been identified based on the sound information. Then, the identification unit 132 may identify the performers corresponding to each of the one or more sound sources by matching the identified sound features with the sound features indicated by the feature information corresponding to each of the one or more performers stored in the storage unit 12. In this way, the information processing device 1 can identify the position of each of the multiple performers as a sound source.

The reception unit 133 receives a selection of a sound source whose position is to be changed from a user who is watching an event and who is using the viewing device 4. For example, in response to receiving a display request for a selection acceptance screen that accepts the selection of a sound source whose position is to be changed from a user terminal (not shown) such as a smartphone used by the user, the reception unit 133 displays a selection acceptance screen on the user terminal. Note that changing the position of the sound source does not change the actual position of the sound source, but rather changes the virtual position of the sound source so that the user can listen to the sound with the sound source in a changed position.

The reception unit 133 generates a selection acceptance screen that indicates, for example, the position of the sound source identified by the identification unit 132 in the event venue at the time when the display request for the selection acceptance screen is received, and accepts a change to the position of the sound source. The reception unit 133 transmits the generated selection acceptance screen to the user terminal, thereby causing the selection acceptance screen to be displayed on the user terminal. The reception unit 133 then accepts, from the user terminal via the selection acceptance screen, a selection of the sound source whose position is to be changed, and the new position of the sound source whose position is to be changed.

For example, if one or more performers who will appear at an event have been determined in advance, the reception unit 133 displays a selection reception screen on the user terminal to receive a performer whose position will be moved from among the one or more performers, and receives from the user a selection of a performer as the sound source whose position will be moved.

Figure 3 is a diagram showing an example of a selection reception screen. In Figure 3, the layout of the event venue is displayed, and it can be seen that icons representing performers A to G and icons representing multiple cheers are displayed on the layout at positions corresponding to the multiple sound sources identified by the identification unit 132. In addition, the layout shown in Figure 3 displays "Self" and an icon representing the sound collection device 2.

A user can select an icon corresponding to at least one of multiple sound sources, such as performers or cheers, displayed on the layout, and move the selected sound source to the position on the layout that the user desires. In this way, for example, if a performer the user is cheering for is singing at the edge of the stage, the user can select the performer and move the changed position to the center of the stage, allowing the user to listen to the song as the performer sings in the center of the stage. Also, if the cheers sound biased toward the sound collection position, the user can change the position of the cheers and listen to the sounds generated by the event without the cheers being biased.

There may be cases where the user wishes to listen to sounds generated at an event at a location other than the location where the sound collection device 2 is installed. For this reason, the reception unit 133 may accept a change to the sound collection location, which is the location where sound is collected. For example, the reception unit 133 accepts a change to the sound collection location by accepting an operation to move the icon representing the sound collection device 2 on the selection reception screen. In this way, the user can listen to sounds generated at an event when the sound is collected at the location of the user's choice at the event venue.

In addition, there may be places in the specified space that are not suitable for generating sound, such as places away from the stage. In response to this, the reception unit 133 may be configured to receive the changed position of the sound source within a predetermined range in the specified space. In this way, the information processing device 1 can prevent the user from moving the sound source to a place that is not suitable for generating sound and listening to it.

In addition, the reception unit 133 receives a selection of a sound source whose position is to be changed from a user who uses the viewing device 4, but this is not limited to the above. The reception unit 133 may also receive a selection of a sound source whose position is to be changed from an event organizer. In this way, the event organizer can freely adjust the generation position of the sound source depending on, for example, the situation of the event, and allow the user to hear it.

The generation unit 134 uses the sound information acquired by the acquisition unit 131 to generate changed sound information indicating the sound collected when the position of at least one of the one or more sound sources in the specified space is changed. The generation unit 134 generates changed sound information corresponding to the case where the position of a sound source selected by the reception unit 133, among the one or more sound sources whose positions are identified by the identification unit 132, is changed to the changed position accepted by the reception unit 133.

When the generation unit 134 does not receive a request from the user to change the position of the sound collection device 2, it generates changed sound information indicating the sound that is collected when the position of at least one of the one or more sound sources in the specified space is changed at the specified position where the sound collection device 2 is installed.

In this case, the generation unit 134 determines the amount of change in volume of the sound generated by the target sound source at a predetermined position based on the distance between the position of the target sound source, which is the sound source whose position is being changed, before the position is changed and the predetermined position, and the distance between the position of the target sound source after the position is changed and the predetermined position. The generation unit 134 also determines the direction of the target sound source after the position is changed based on the predetermined position. The generation unit 134 then generates changed sound information by changing the sound of the target sound source included in the sound information based on the determined amount of change in volume and the direction after the position is changed.

When the generation unit 134 receives a request from the user to change the position of the sound collection device 2, and when the position of at least one of the one or more sound sources in the specified space is changed, the generation unit 134 generates changed sound information indicating the sound when the sound is collected at the changed sound collection position received by the reception unit 133.

For example, when the installation position of the sound collection device 2 is changed, the generation unit 134 determines the amount of change in the volume of the sound generated by each of the multiple sound sources when the installation position of the sound collection device 2 is changed, based on the distance between the installation position of the sound collection device 2 before the change and the position of each of the multiple sound sources before the change, and the distance between the installation position of the sound collection device 2 after the change and the position of each of the multiple sound sources after the change.

The generation unit 134 also identifies the direction of each of the multiple sound sources based on the changed installation position of the sound collection device 2. The generation unit 134 then generates changed sound information by changing the sound of each of the multiple sound sources included in the sound information based on the identified amount of change in volume and the direction after the position change.

The generation unit 134 may determine whether there is a bias in the positions of the multiple sound sources in the specified space, and if it determines that there is a bias, generate changed sound information corresponding to a case where the positions of the multiple sound sources are changed so as to suppress the bias. In this case, the generation unit 134 determines whether there is a bias in the positions of the multiple sound sources corresponding to cheers in the specified space.

For example, the generation unit 134 divides the audience space into the right and left sides of the stage. Based on the position and volume of each of the multiple cheers identified by the identification unit 132, the generation unit 134 determines whether the volume of the cheers, when collected at the center of the audience space, is biased toward either the right or the left side by a predetermined amount or more.

When the generating unit 134 determines that the sound sources are biased to either the right or left side by a predetermined amount or more, it generates changed sound information corresponding to the case where the positions of the multiple sound sources are changed so as to reduce the bias. In this way, the information processing device 1 can reduce the situation where the cheers sound unnatural due to being biased from one part of the audience space.

In addition, sound sources generated at an event venue may include sound sources with directionality. In response to this, the receiving unit 133 may receive the orientation of the sound source whose position is to be changed after the position is changed. The generating unit 134 may then generate changed sound information corresponding to the case where the orientation of the sound source whose selection has been accepted by the receiving unit 133 has been changed to the orientation accepted by the receiving unit 133. In this way, the information processing device 1 can generate changed sound information that takes into account the directionality of the sound generated by the sound source.

The output unit 135 outputs the changed sound information and video information generated by the generation unit 134 to the viewing device 4. The output unit 135 transmits the changed sound information and video information to the viewing device 4 via a communication network, thereby causing the changed sound information and video information to be output from the viewing device 4.

[Operation flow]
Next, the flow of processing in the information processing device 1 will be described. The information processing device 1 independently executes a process of outputting audio information and video information to the viewing device 4 and a process of changing the position of the sound source. First, the flow of processing related to the process of outputting audio information and video information to the viewing device 4 will be described. Fig. 4 is a flowchart showing the flow of processing until the information processing device 1 outputs audio information and video information to the viewing device 4. The flowchart shown in Fig. 4 is executed repeatedly while the user is viewing an event.

First, the acquisition unit 131 acquires from the sound collection device 2 sound information indicating sounds collected at an event held in a specified space, and acquires from the imaging device 3 video information indicating video footage of the event (S1).

Next, the identification unit 132 identifies the positions of one or more sound sources in the specified space based on the sound information acquired by the acquisition unit 131 (S2).

Then, the reception unit 133 determines whether or not a display request for the selection reception screen has been received (S3). If the reception unit 133 determines that a display request has been received (YES in S3), the process proceeds to S4, where the reception unit 133 receives, via the selection reception screen, a selection of the sound source whose position is to be changed and the position of the sound source after the change. If the reception unit 133 determines that a display request has not been received (NO in S3), the process proceeds to S5.

Then, the generation unit 134 determines whether or not there has been a change in the sound source position (S5). If the reception unit 133 determines that there has been a change in the sound source position (YES in S5), the generation unit 134 moves the process to S6 and generates changed sound information that indicates the sound that will be collected when the position of the sound source whose change in position has been accepted by the reception unit 133 is changed to the changed position. The output unit 135 then outputs the changed sound information and the video information to the viewing device 4 (S7).

When the reception unit 133 determines that the position of the sound source has not changed (NO in S5), the generation unit 134 proceeds to S8. The output unit 135 outputs the sound information and video information to the viewing device 4 (S8).

Next, the output unit 135 determines whether or not an instruction to end the output of the audio information and video information has been received (S9). If the output unit 135 determines that an instruction to end has been received (YES in S9), it ends the process related to this flowchart, and if it determines that an instruction to end has not been received (NO in S9), it proceeds to S1.

[Modification]
In the above embodiment, the generating unit 134 generates changed sound information corresponding to a case where the position of a sound source selected by the receiving unit 133 is changed among one or more sound sources identified by the identifying unit 132, but this is not limited thereto. The generating unit 134 may identify a sound source preferred by the user among a plurality of sound sources, and generate changed sound information corresponding to a case where the position of the identified sound source is changed.

In this case, the viewing device 4 includes a device for detecting the line of sight, such as an eye tracker, and the viewing device 4 transmits viewing position information indicating the position at which the user viewed the video to the information processing device 1. The acquisition unit 131 acquires the viewing position information from the viewing device 4.

The generation unit 134 identifies the user's preferred sound source based on the viewing position information acquired by the acquisition unit 131. For example, the generation unit 134 identifies the sound source that the user views for the longest time based on the user's viewing positions at each of the multiple times indicated by the viewing position information as the user's preferred sound source. The generation unit 134 then changes the position of the sound source so that the user's preferred sound source is located at a location previously designated by the user, such as the center of a stage set up at an event venue, and generates changed sound information corresponding to the case where the identified sound source position has been changed. In this way, the information processing device 1 can automatically change the position of the sound source and allow the user to listen to the sound generated at the event corresponding to the case where the sound source position has been changed.

Note that the generation unit 134 positions the user's preferred sound source at a location designated in advance by the user, but this is not limited to the above. The reception unit 133 may display a selection reception screen on the user terminal and receive the changed position of the user's preferred sound source. The generation unit 134 may then generate changed sound information corresponding to the case where the position of the user's preferred sound source is changed to the position received by the reception unit 133.

The receiving unit 133 may also receive the user's preferred orientation of the sound source after the position change. For example, the receiving unit 133 may receive a request to set the user's preferred orientation of the sound source after the position change to a predetermined orientation or to automatically set the orientation to an orientation that corresponds to the user's direction, and the generating unit 134 may generate changed sound information corresponding to the case where the user's preferred orientation of the sound source after the position change is changed to the orientation received by the receiving unit 133.

The generation unit 134 may also generate changed sound information indicating the sound when collected at a specified position in a state in which an object that changes the sound has been added, changed, or moved to the specified space. In this case, the reception unit 133 may receive, via a selection reception screen, the addition, change, or movement of an object that changes the sound to the specified space. The object is, for example, a wall that changes the sound, or a reflective panel that reflects sound. Furthermore, changing the object includes changing the structure of the specified space, including the wall of the object, to the structure of another event venue.

Then, the generation unit 134 generates changed sound information indicating the sound when the sound is collected at the specified position in a state in which the position of at least one of the one or more sound sources has been changed and the object accepted by the reception unit 133 has been added or moved to the specified space. For example, when the specified space is a virtual space, the generation unit 134 places the object that the reception unit 133 has accepted for addition, change, or movement in the virtual space in the state accepted by the reception unit 133. Furthermore, when the specified space is a real space, the generation unit 134 places the object that the reception unit 133 has accepted for addition, change, or movement in the virtual space that imitates the real space in the state accepted by the reception unit 133.

Then, the generation unit 134 generates changed sound information in the virtual space in a state where the position of at least one of the one or more sound sources has been changed. In this way, the user can hear the sound in the event when the acoustic state of the specified event has been changed by the object.

[Effects of information processing device 1]
As described above, the information processing device 1 according to the present embodiment identifies the positions of one or more sound sources in a predetermined space based on sound information indicating sounds collected at an event held in a predetermined space, which may be a virtual space or a real space, and generates and outputs changed sound information indicating sounds collected when the positions of at least one of the one or more sound sources in the predetermined space are changed. In this way, the information processing device 1 can adjust the sounds collected at the event venue.

Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is "Build resilient infrastructure, promote inclusive and sustainable industrialization, and promote innovation and infrastructure."

Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination also has the effect of the original embodiment.

REFERENCE SIGNS LIST 1 Information processing device 11 Communication unit 12 Storage unit 13 Control unit 131 Acquisition unit 132 Identification unit 133 Reception unit 134 Generation unit 135 Output unit

Claims (16)

an acquisition unit that acquires sound information indicating sounds collected at an event held in a predetermined space, which is a virtual space or a real space;
an identification unit that identifies positions of one or more sound sources in the predetermined space based on the sound information acquired by the acquisition unit;
A generator that uses the sound information to generate changed sound information indicating a sound collected when at least one position of the one or more sound sources and at least one orientation of the one or more sound sources are changed in the predetermined space; and
an output unit that outputs the changed sound information generated by the generation unit;
An information processing device having the above configuration. an acquisition unit that acquires sound information indicating sounds collected at an event held in a predetermined space, which is a virtual space or a real space;
an identification unit that identifies positions of a plurality of sound sources in the predetermined space based on the sound information acquired by the acquisition unit;
a generation unit that generates, using the sound information, changed sound information indicating a sound collected when a position of at least one of the plurality of sound sources in the predetermined space is changed; and
an output unit that outputs the changed sound information generated by the generation unit to a listening device;
having
The generating unit identifies a sound source preferred by a user of the listening device from among the plurality of sound sources identified by the identifying unit, and generates the changed sound information corresponding to a case where a position of the identified sound source is changed.
Information processing device. The acquisition unit acquires video captured at the event,
the output unit outputs the sound information and the video before the generation unit generates the changed sound information to the viewing device for the user to view the sound and the video;
The acquisition unit acquires viewing position information indicating a position where the user viewed the video when the user viewed the video,
The generation unit identifies a sound source preferred by the user based on the visual recognition position information acquired by the acquisition unit.
The information processing device according to claim 2 . The generation unit determines whether there is a bias in positions of the plurality of sound sources in the predetermined space, and when it determines that there is a bias, generates the changed sound information corresponding to a case where the positions of the plurality of sound sources are changed so as to suppress the bias.
3. The information processing device according to claim 1 or 2. When the generation unit determines that there is a bias in positions of a plurality of sound sources corresponding to cheers in the specified space with respect to a predetermined position that is an acquisition position of the sound information in the specified space, the generation unit generates the changed sound information corresponding to a case where the positions of the plurality of sound sources are changed so as to suppress the bias.
3. The information processing device according to claim 1 or 2. A reception unit is further provided for receiving a selection of a sound source whose position is to be changed,
The generating unit generates the changed sound information corresponding to a case where a position of the sound source selected by the receiving unit is changed.
3. The information processing device according to claim 1 or 2. the receiving unit receives a selection of a sound source whose position is to be changed from a user of a listening device that is an output destination of the changed sound information;
The information processing device according to claim 6. the reception unit receives, from a host of the event, a selection of a sound source whose position is to be changed;
The information processing device according to claim 6. The receiving unit receives a position after the change of the sound source whose position is to be changed,
The generating unit generates the changed sound information corresponding to a case where the position of the sound source selected by the receiving unit is changed to the changed position received by the receiving unit.
The information processing device according to claim 6. The receiving unit receives the position of the sound source after the change within a predetermined range in the specified space.
The information processing device according to claim 9. The generation unit generates the changed sound information indicating a sound collected when an object that changes sound is added or moved to the specified space.
3. The information processing device according to claim 1 or 2. The predetermined space is a virtual space,
the acquisition unit acquires object position information indicating a position of an object that is present in the predetermined space and that generates a sound,
The identification unit identifies positions of one or more sound sources based on the sound information and the object position information acquired by the acquisition unit.
3. The information processing device according to claim 1 or 2. The acquisition unit acquires the sound information collected at a predetermined position in the predetermined space,
The generation unit generates the changed sound information indicating a sound when the sound is collected at the predetermined position.
3. The information processing device according to claim 1 or 2. A reception unit that receives a sound collection position in the predetermined space,
The generation unit generates the changed sound information indicating a sound when the sound is collected at the sound collection position accepted by the acceptance unit.
3. The information processing device according to claim 1 or 2. The computer executes
acquiring sound information indicating sounds collected at an event held in a predetermined space, which is a virtual space or a real space;
Identifying positions of one or more sound sources in the predetermined space based on the acquired sound information;
generating, using the sound information, changed sound information indicating a sound collected when at least one position of the one or more sound sources and at least one orientation of the one or more sound sources are changed in the predetermined space;
outputting the modified sound information generated by
An information processing method comprising the steps of: The computer executes
acquiring sound information indicating sounds collected at an event held in a predetermined space, which is a virtual space or a real space;
Identifying positions of a plurality of sound sources in the predetermined space based on the acquired sound information;
generating, using the sound information, changed sound information indicating a sound collected when a position of at least one of the plurality of sound sources is changed in the predetermined space;
outputting the generated changed sound information to a listening device;
having
In the generating step, the computer identifies a sound source preferred by a user of the listening device from among the identified multiple sound sources, and generates the changed sound information corresponding to a case where a position of the identified sound source is changed.
Information processing methods.

Images