JP6980946B1 - 3D virtual real space providing server, 3D virtual real space providing method, 3D virtual real space providing program, 3D virtual real space reproduction control device, 3D virtual real space reproduction control method, 3D virtual real space reproduction control program , And a 3D virtual reality space providing system - Google Patents

Abstract

According to one embodiment, it is a three-dimensional virtual reality space generation means for generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is a corresponding user. A conversation between a three-dimensional virtual reality space generation means capable of speaking in the three-dimensional virtual reality space by speaking to the microphone, a part of the three-dimensional virtual reality space including characters, and the plurality of avatars. A recording means for recording a portion including two or more avatars and a storage medium for later reproduction, wherein the conversation is composed of remarks of at least one of the plurality of avatars. , The recording means, the search means for searching the storage medium for statements or characters corresponding to the search query from any of the plurality of users, and the three-dimensional virtual reality space recorded in the storage medium. A three-dimensional virtual device including, a reproduction data generation means for generating reproduction data for reproducing at least the portion including the searched remark or character by the three-dimensional virtual reality space reproduction control device used by any one of the users. A real space providing server is provided.

Description

The present invention is a three-dimensional virtual real space providing server, a three-dimensional virtual real space providing method, a three-dimensional virtual real space providing program, a three-dimensional virtual real space reproduction control device, a three-dimensional virtual real space reproduction control method, and a three-dimensional virtual reality. It relates to a space reproduction control program and a three-dimensional virtual reality space providing system.

It is not easy to reproduce the conversations and materials presented in the past later. This is the same in the real world and in the three-dimensional virtual reality space. It should be noted that Patent Documents 1 and 2 only disclose the two-dimensional virtual reality space.

Japanese Unexamined Patent Publication No. 2001-23801 Japanese Unexamined Patent Publication No. 2008-083837

The present invention has been made in view of such problems, and the subject of the present invention is a three-dimensional virtual real space providing server that can easily reproduce statements and / or characters in the three-dimensional virtual real space later. 3D virtual real space provision method, 3D virtual real space provision program, 3D virtual real space reproduction control device, 3D virtual real space reproduction control method, 3D virtual real space reproduction control program, and 3D virtual real space It is to provide a providing system.

According to one embodiment, it is a three-dimensional virtual real space generation means for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is a corresponding user. A conversation between a 3D virtual reality space generation means capable of speaking in the 3D virtual reality space, a part of the 3D virtual reality space including characters, and a plurality of avatars. It is a recording means for recording a portion including two or more avatars and a storage medium for later reproduction, and the conversation is composed of remarks of at least one avatar among the plurality of avatars. , The recording means, the search means for searching the storage medium for statements or characters corresponding to the search query from any of the plurality of users, and the three-dimensional virtual reality space recorded in the storage medium. A three-dimensional virtual device including, a reproduction data generation means for generating reproduction data for reproducing at least the portion including the searched remark or character by the three-dimensional virtual real space reproduction control device used by any one of the users. A real space providing server is provided.

According to one embodiment, it is a three-dimensional virtual reality space generation means for generating a three-dimensional virtual reality space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is a corresponding user. Two or more of the plurality of avatars in the three-dimensional virtual reality space and the three-dimensional virtual reality space generation means that can speak in the three-dimensional virtual reality space by speaking to the microphone. A recording means for recording a portion including the avatar in a storage medium so that the portion including the avatar can be reproduced later, wherein the conversation is composed of the remarks of at least one avatar among the plurality of avatars, and the plurality of recording means. A search means for searching the storage medium for a statement corresponding to a search query from any of the users, and a portion of the three-dimensional virtual reality space recorded in the storage medium, including at least the searched statement. Is provided with a three-dimensional virtual reality space providing server provided with a reproduction data generation means for generating reproduction data for reproduction by the three-dimensional virtual reality space reproduction control device used by any one of the users.

According to one embodiment, a three-dimensional virtual real space generation means for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and a character in the three-dimensional virtual real space are included. A recording means for recording a portion on a storage medium so that the portion can be reproduced later, a search means for searching the storage medium for characters corresponding to a search query from any of the plurality of users, and recording on the storage medium. Reproduction data generation means for generating reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space by the three-dimensional virtual reality space reproduction control device used by any of the users. And, a three-dimensional virtual real space providing server is provided.

The recording means includes a conversation detecting means for detecting that a conversation has started between the two or more avatars, and the recording means records a portion including the two or more avatars in response to the detection of the start of the conversation. You may.

When any of the plurality of avatars speaks, the conversation detection means has another avatar whose distance from the one avatar in the three-dimensional virtual reality space is equal to or less than a predetermined value. It may be determined that the conversation has started between the two or more avatars.

The recording means may record a portion including the two or more avatars in units of the detected conversation.

The search means may search for a unit of conversation including a statement corresponding to the search query.

The reproduction data generation means may generate the reproduction data for reproducing the searched unit of conversation.

The recording means may record the remarks of the at least one avatar in association with the remarked avatar.

The recording means may record text data obtained by performing voice recognition for the remarks of the two or more avatars.

Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and may be provided with a control means for setting the first time point.

Even after the second time point has elapsed, the search means may search the storage medium for remarks corresponding to the search query, and the reproduction data generation means may generate the reproduction data.

The recording means may record characters in the material presented by any avatar in the three-dimensional virtual reality space.

The recording means may record characters written by any of the avatars in the three-dimensional virtual reality space in response to an operation on the controller of the user corresponding to the avatar of the plurality of avatars.

Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and may be provided with a control means for setting the first time point.

Even after the second time point has elapsed, the search means may search the storage medium for characters corresponding to the search query, and the reproduction data generation means may generate the reproduction data.

The search means may perform a keyword search.

The search means may perform a similar search.

The search means may perform a concept search.

The recording means may constantly record the three-dimensional virtual reality space.

According to one embodiment, it is a three-dimensional virtual real space generation step for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is a corresponding user. Two or more of the plurality of avatars in the three-dimensional virtual reality space and the three-dimensional virtual reality space generation step that can speak in the three-dimensional virtual reality space by speaking to the microphone. A recording step of recording a portion including the avatar in a storage medium so that the portion including the avatar can be reproduced later, wherein the conversation is composed of the remarks of at least one avatar among the plurality of avatars, and the plurality of recording steps. A search step for searching the storage medium for a statement corresponding to a search query from any of the users, and a portion of the three-dimensional virtual real space recorded in the storage medium including at least the searched statement. Is provided, a three-dimensional virtual real space providing method including a reproduction data generation step for generating reproduction data for reproduction by the three-dimensional virtual real space reproduction control device used by any one of the users.

According to one embodiment, a three-dimensional virtual real space generation step for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and a character in the three-dimensional virtual real space are included. A recording step of recording a portion on a storage medium for later reproduction, a search step of searching the storage medium for characters corresponding to a search query from any of the plurality of users, and recording on the storage medium. A reproduction data generation step for generating reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space by the three-dimensional virtual reality space reproduction control device used by any of the users. A method for providing a three-dimensional virtual real space is provided.

According to one embodiment, it is a three-dimensional virtual real space generation step for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active on a computer, and each of the plurality of avatars is a step. Have a conversation between the 3D virtual reality space generation step, which can speak in the 3D virtual reality space by speaking to the corresponding user's microphone, and the plurality of avatars in the 3D virtual reality space. A recording step in which a portion including two or more avatars is recorded on a storage medium so that the portion including the two or more avatars can be reproduced later, wherein the conversation is composed of the remarks of at least one avatar among the plurality of avatars. Of the search step of searching the storage medium for a statement corresponding to a search query from any of the plurality of users and the three-dimensional virtual reality space recorded in the storage medium, at least the searched statement. A three-dimensional virtual real space providing program for executing a reproduction data generation step for generating reproduction data for reproducing the portion including the above in the three-dimensional virtual real space reproduction control device used by any of the above users is provided. ..

According to one embodiment, of the three-dimensional virtual real space generation step of generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active on a computer, and the three-dimensional virtual real space. A recording step of recording a portion including characters on a storage medium so that the portion including characters can be reproduced later, a search step of searching the storage medium for characters corresponding to a search query from any of the plurality of users, and the storage medium. Reproduction to generate reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space recorded in the three-dimensional virtual reality space reproduction control device used by any one of the users. A three-dimensional virtual real space providing program including a data generation step is provided.

According to one embodiment, it is a three-dimensional virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual reality space, and is a reproduction device and the three-dimensional virtual reality. Sending a search query for searching for statements and characters in space to a 3D virtual real space providing server that records at least a part of the 3D virtual real space on a storage medium so that it can be played back later. From the three-dimensional virtual reality space providing server, the means and the reproduction data for reproducing at least the portion including the remarks or characters corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium. A three-dimensional virtual real space reproduction control device including a reproduction control means for receiving and reproducing the portion to the reproduction device is provided.

According to one embodiment, it is a three-dimensional virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual reality space, and is a reproduction device and the three-dimensional virtual reality. A search query transmission means for transmitting a search query for searching for a statement in space to a 3D virtual reality space providing server that records at least a part of the 3D virtual reality space on a storage medium so that it can be reproduced later. The reproduction data for reproducing at least the portion including the remark corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the said A three-dimensional virtual real space reproduction control device including a reproduction control means for causing the reproduction device to reproduce a portion is provided.

According to one embodiment, it is a three-dimensional virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual reality space, and is a reproduction device and the three-dimensional virtual reality. A search query transmission means for transmitting a search query for searching for characters in space to a 3D virtual real space providing server that records at least a part of the 3D virtual real space on a storage medium so that it can be reproduced later. The reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the said A three-dimensional virtual real space reproduction control device including a reproduction control means for causing the reproduction device to reproduce a portion is provided.

Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and may be provided with a setting means for accepting the setting of the first time point.

Even after the second time point has passed, the search query transmitting means can transmit the search query, and the reproduction control means may regenerate the portion to the reproduction device.

The three-dimensional virtual reality space reproduction control device may be a glasses-type wearable device.

According to one embodiment, it is a three-dimensional virtual real space reproduction control method in a three-dimensional virtual real space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual real space. A search query for searching for a statement in the three-dimensional virtual real space is transmitted to a three-dimensional virtual real space providing server that records at least a part of the three-dimensional virtual real space on a storage medium so that it can be reproduced later. The search query transmission step and the reproduction data for reproducing at least the portion including the remark corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium are generated by the three-dimensional virtual reality space providing server. Provided is a three-dimensional virtual real space reproduction control method including a reproduction control step of receiving from and causing the reproduction device to reproduce the portion.

According to one embodiment, it is a three-dimensional virtual real space reproduction control method in a three-dimensional virtual real space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual real space. A search query for searching for characters in the three-dimensional virtual real space is transmitted to a three-dimensional virtual real space providing server that records at least a part of the three-dimensional virtual real space on a storage medium so that it can be reproduced later. The search query transmission step and the reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium are generated by the three-dimensional virtual reality space providing server. Provided is a three-dimensional virtual real space reproduction control method including a reproduction control step of receiving from and causing the reproduction device to reproduce the portion.

According to one embodiment, a user uses a three-dimensional virtual real space reproduction control device for activating an avatar corresponding to the user in the three-dimensional virtual real space, and searches for a statement in the three-dimensional virtual real space. A search query transmission step for transmitting a search query for sending to a 3D virtual real space providing server that records at least a part of the 3D virtual real space in a storage medium so that it can be reproduced later, and recording in the storage medium. Reproduction data for reproducing at least the portion including the statement corresponding to the search query is received from the 3D virtual reality space providing server, and the portion is reproduced in the reproduction device. A three-dimensional virtual real space reproduction control program for executing the reproduction control step is provided.

According to one embodiment, a character in the three-dimensional virtual real space is searched by a three-dimensional virtual real space reproduction control device used by the user to activate the avatar corresponding to the user in the three-dimensional virtual real space. A search query transmission step for transmitting a search query for sending to a 3D virtual real space providing server that records at least a part of the 3D virtual real space in a storage medium so that it can be reproduced later, and recording in the storage medium. Reproduction data for reproducing at least the portion including the character corresponding to the search query is received from the 3D virtual reality space providing server, and the portion is reproduced in the reproduction device. A three-dimensional virtual real space reproduction control program for executing the reproduction control step is provided.

According to one embodiment, a three-dimensional virtual reality space providing system including the three-dimensional virtual reality space providing server and the three-dimensional virtual reality space reproduction control device is provided.

The block diagram which shows the schematic structure of the VR space provision system which concerns on one Embodiment. The figure which shows an example of the content of the conversation which is recorded in the storage medium 22 by the recording unit 26 schematically.

Hereinafter, embodiments will be exemplified by way of drawing. In this embodiment, a plurality of avatars corresponding to each of the plurality of users are active in a virtual reality (hereinafter referred to as "VR") space. Activities in VR space include talking with other avatars, presenting materials, writing letters, and so on. Then, the VR space including conversations and materials is recorded. The user can search the recorded VR space and play back the scene hit by the search. As a result, conversations held in the VR space, presented materials, and the like can be easily reproduced later.

In this embodiment, a three-dimensional VR space that expands three-dimensionally is assumed, and unless otherwise specified, the term “VR space” simply refers to a three-dimensional VR space.

FIG. 1 is a block diagram showing a schematic configuration of a VR space providing system according to an embodiment. This VR space providing system includes a VR space reproduction control device (hereinafter, simply referred to as "user device 1") used by the user and a VR space providing server (hereinafter, simply referred to as "server 2"). Although only one user device 1 is drawn in FIG. 1, the VR space providing system may actually include two or more user devices 1.

The user device 1 is used by the user, and is used to activate the avatar corresponding to the user in the VR space and to see and hear the state of the VR space. The user device 1 is a VR device such as goggles, smart glasses (glasses-type wearable device), and a lens, and includes a communication unit 11, a display 12, a speaker 13, a controller 14, and a microphone 15.

The communication unit 11 transmits various data and information to the server 2 and receives various data and information from the server 2. There are no particular restrictions on the means of communication with the server 2.

The display 12 reproduces the VR space as an image. More specifically, the display 12 displays the activities of other avatars in the VR space, various materials used in the VR space, and the like. It is desirable that the display 12 can be displayed in three dimensions. When the user device 1 is a smart glass or the like, the display 12 includes a display for the right eye and a display for the left eye.

The speaker 13 reproduces the VR space as sound. More specifically, the speaker 13 outputs the remarks of other avatars in the VR space.

As will be described later, the display 12 and the speaker 13 of the present embodiment can not only reproduce the current VR space in real time, but also reproduce the past VR space. Further, the display 12 and the speaker 13 can also be called a reproduction device. The reproduction data necessary for the display 12 and the speaker 13 to reproduce the VR space is received from the server 2 via the communication unit 11.

The controller 14 is used to activate the avatar corresponding to the user in the VR space. For example, the avatar can move in the VR space according to a predetermined action on the controller 14 by the user. Further, the avatar can present a desired material (that is, open an electronic file) in the VR space according to a predetermined action on the controller 14 by the user. Further, the avatar can write characters in the VR space in response to the user's operation on the controller 14. Information indicating the user's operation with respect to the controller 14 is transmitted from the communication unit 11 to the server 2.

The microphone 15 is used to make the avatar corresponding to the user speak in the VR space. That is, the user's voice picked up by the microphone 15 is reproduced in the VR space as the avatar's remark corresponding to the user. Information indicating the user's voice picked up by the microphone 15 is transmitted from the communication unit 11 to the server 2.

Further, the user device 1 has a setting unit 16, a search query transmission unit 17, and a reproduction control unit 18. Some or all of these functions may be configured in hardware, or may be realized by the processor of the user device 1 executing a predetermined program.

The VR space in the present embodiment may be usable only for a specific period such as a rental conference room or a rental office. Note that "use" here means that the user activates the avatar in the VR space.

Then, the setting unit 16 makes a reservation for using the VR space. The setting unit 16 receives the reservation information necessary for the reservation of the VR space via the user operation using the controller 14 or the microphone 15. Then, the setting unit 16 reserves the VR space by transmitting the reservation information to the server 2.

Here, the reservation information may include information indicating information (user ID) that identifies the user at the start time and end time of use of the VR space. The user ID may be only the user ID that identifies itself, or may include the user ID of another user who uses the VR space. The reservation information may include information indicating the period of use of the VR space instead of the time when the use of the VR space ends.

The search query transmission unit 17 accepts an arbitrary search query via a user operation using the controller 14 or the microphone 15. The search query may be textual information or voice information. Then, the search query sends the received search query to the server 2. The details of the search will be described later, but the search query is for searching for statements and characters in the VR space.

The reproduction control unit 18 controls the reproduction device to reproduce at least a part of the VR space. More specifically, the reproduction control unit 18 receives the reproduction data (display data) necessary for reproducing the VR space as an image from the server 2 via the communication unit 11, and displays the image based on the reproduction data. Take control. Further, the reproduction control unit 18 receives reproduction data (voice data) necessary for reproducing the VR space by voice from the server 2, and performs voice output control based on the reproduction data.

On the other hand, the server 2 has a communication unit 21 and a storage medium 22. The communication unit 21 transmits various data and information to the server 2 and receives various data and information from the server 2. There are no particular restrictions on the means of communication with the server 2. The storage medium 22 is, for example, a hard disk, and stores various data, information, VR space, and the like. The storage medium 22 may be a device separate from the server 2.

Further, the server 2 has a control unit 23, a VR space generation unit 24, a conversation detection unit 25, a recording unit 26, a search unit 27, and a reproduction data generation unit 28. Some or all of these functions may be configured in hardware, or may be realized by the processor of the server 2 executing a predetermined program.

The control unit 23 reserves the VR space based on the reservation information from the user device 1. That is, the control unit 23 sets a use start time point and a use end time point in which the user can activate the avatar. As a result, the user specified by the user ID included in the reservation information can activate the avatar corresponding to himself / herself in the VR space.

The VR space generation unit 24 generates a VR space in which avatars corresponding to a plurality of users are active. Further, the VR space generation unit 24 receives the user operation on the controller 14 of the user device 1 and the voice picked up by the microphone 15 via the communication unit 21 and reflects them in the VR space.

For example, when a user performs an operation for moving an avatar to the controller 14, the VR space generation unit 24 moves the avatar corresponding to the user in the VR space according to the operation. That is, the avatar can move in the VR space according to the operation on the controller 14 used by the corresponding user.

Further, when a user speaks to the microphone 15, the VR space generation unit 24 causes the avatar corresponding to the user to speak in the VR space according to the utterance. That is, the avatar can speak in the VR space by speaking to the microphone 15 used by the corresponding user.

The conversation detection unit 25 detects that a conversation between avatars has started in the VR space. As an example, the conversation detection unit 25 determines that a conversation has started between these avatars when one or more other avatars are nearby when any avatar speaks in the VR space. Here, the conversation detection unit 25 can determine that the person is "near" when the distance between the speaking avatar and another avatar in the VR space is equal to or less than a predetermined distance. This predetermined distance may be a constant value or may be one according to the loudness of the voice of the avatar who spoke.

Further, the conversation detection unit 25 may detect that the conversation has ended. As an example, the conversation detection unit 25 does not speak for a certain period of time among the avatars having a conversation, or when the distance between the avatars having a conversation in the VR space is equal to or more than a predetermined distance. The conversation detection unit 25 determines that the conversation has ended.

In addition, the "conversation" in the present specification is not only a mode in which two or more avatars speak to each other, but also a mode in which one avatar unilaterally speaks to another avatar (for example, a lecturer speaks to a student at a seminar). The case of giving a lecture) is also included. In any case, the conversation takes place with two or more avatars and consists of the remarks of at least one of the avatars.

The recording unit 26 records video data and audio data on the storage medium 22 so that at least a part of the VR space can be reproduced later. The recording unit 26 may record the entire VR space on the storage medium 22 at all times, or may record by focusing on conversation and / or characters as described below.

The recording unit 26 may record a portion of the VR space including two or more avatars having a conversation as video data and audio data. More specifically, the recording unit 26 records at least a part of the VR space including two or more avatars having a conversation in response to the conversation detection unit 25 detecting the start of the conversation. May be good. Then, the recording unit 26 may stop recording the conversation when the conversation detection unit 25 detects the end of the conversation or when a predetermined time has elapsed from the start of the conversation. In this case, the recording unit 26 records the VR space in units of conversation.

The recording unit 26 may record the conversation only with voice data, but it is desirable to perform voice recognition and record the text data as well. This is because it is easy to search.

FIG. 2 is a diagram schematically showing an example of the contents of a conversation recorded on the storage medium 22 by the recording unit 26. The recording unit 26 assigns an ID (conversation ID) that identifies the conversation for each conversation. Then, the recording unit 26 records the content of the remark in each conversation at the time of remark and in association with the speaker. In the example of FIG. 2, at exactly 10 o'clock on October 15, 2020, Avatar A says, "Well, we will start the regular meeting in October."

By doing so, it becomes easy to identify the avatar who made the statement corresponding to the search query and to specify the time when the statement was made at the time of the search described later.

Returning to FIG. 1, the recording unit 26 may record a portion including characters in the VR space as video data and audio data. The "character" here includes both the characters in the material (electronic file) presented by the avatar and the characters written by the avatar. Letters are also recorded in association with the date and time presented (or written) and the avatar presented (or written).

The search unit 27 searches the storage medium 22 for statements and / or characters corresponding to the search query transmitted from the search query transmission unit 17 of the user device 1. The search unit 27 may perform a keyword search, a similar search, a concept search, or may utilize AI (artificial intelligence) for the search as needed.

The search unit 27 may perform a search in units of remarks or in units of conversations. For example, in FIG. 2, when the search query is "October regular meeting", the search unit 27 starts the October regular meeting in the remark 1 "of avatar A in the conversation ID" 01 "in units of remarks. May be specified. Alternatively, the search unit 27 may specify the conversation ID "01" including the statement corresponding to the search query in units of conversation.

It should be noted that the search query may include information on whether to search only the remarks, only the characters, or both the remarks and the characters.

Returning to FIG. 1, the reproduction data generation unit 28 generates reproduction data for reproducing the portion (scene) including the searched remarks or characters in the VR space recorded in the storage medium 22 on the user device 1. .. The generated reproduction data is transmitted to the user device 1 via the communication unit 21.

For example, when a certain remark is specified by the search unit 27, the replay data generation unit 28 may generate replay data for replaying only the remark, or replay data for replaying a conversation including the remark. May be generated, or reproduction data for reproducing from a predetermined time before to a predetermined time after the time when the statement is made may be generated.

Further, when a certain character is specified by the search unit 27, the reproduction data generation unit 28 may generate reproduction data for reproducing only the time when the character is presented (or written). Reproduction data for reproducing from a predetermined time before to a predetermined time after the time when the character is presented (or written) may be generated.

It is desirable that the reproduced data include both video data for displaying video on the display 12 of the user device 1 and audio data for outputting audio on the speaker 13 of the user device 1. However, the reproduction data generation unit 28 may generate only audio data when reproducing a remark, or may generate only video data when reproducing characters.

As mentioned above, the user can use the VR space only for a specific period of time. In this case, it may not be possible to search after the end of use, but it is desirable that the search is possible even after the end of use. Specifically, even after the expiration date has passed, the search query transmission unit 17 of the user device 1 can send a search query, and the search unit 27 of the server 2 searches for statements and characters corresponding to the search query, and reproduces data. It is desirable that the generation unit 28 generate the reproduction data.

As described above, in the present embodiment, remarks and characters in the VR space can be recorded and searched. Therefore, the remarks and characters in the VR space can be easily reproduced later. For example, creating minutes after a meeting is cumbersome and lacks accuracy, but according to this embodiment, such minutes are not required.

The above-described embodiments have been described for the purpose of allowing a person having ordinary knowledge in the technical field to which the present invention belongs to carry out the present invention. Various modifications of the above embodiment can be naturally made by those skilled in the art, and the technical idea of the present invention can be applied to other embodiments. Accordingly, the invention is not limited to the described embodiments and should be the broadest scope according to the technical ideas defined by the claims.

1 3D VR space reproduction control device (user device)
11 Communication unit 12 Display 13 Speaker 14 Controller 15 Microphone 16 Setting unit 17 Search query transmission unit 18 Playback control unit 2 3D VR space providing server 21 Communication unit 22 Storage medium 23 Control unit 24 VR space generation unit 25 Conversation detection unit 26 Recording Part 27 Search part 28 Playback data generation part

Claims (24)

It is a three-dimensional virtual real space generation means for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual reality space generation means that can speak in the 3D virtual reality space,
When any of the plurality of avatars makes a voice statement, if there is another avatar whose distance from the one avatar in the three-dimensional virtual reality space is equal to or less than a predetermined value, the above two or more. A conversation detecting means for determining that a conversation has started between the avatars of the avatar, and the avatar's remark is a voice remark by speaking to the microphone of the user corresponding to the avatar.
In response to the detection of the start of a conversation, the part of the three-dimensional virtual reality space containing two or more avatars having a conversation among the plurality of avatars is stored in a storage medium so that it can be played back later. Recording means to record and
A search means for searching the storage medium for statements corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. A three-dimensional virtual reality space providing server including a reproduction data generation means for generating. It is a three-dimensional virtual real space generation means for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual reality space generation means that can speak in the 3D virtual reality space,
A recording means for recording a portion of the three-dimensional virtual reality space including two or more avatars having a conversation among the plurality of avatars on a storage medium so that the conversation can be played back later. A recording means and a recording means, which is composed of the remarks of at least one of the avatars of the avatar, and the remarks of the avatar are voice remarks made by speaking to the microphone of the user corresponding to the avatar.
A search means for searching the storage medium for statements corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. Reproduction data generation means to generate and
Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and includes a control means for setting the first time point.
Even after the second time point has passed
The search means searches the storage medium for a statement corresponding to the search query, and then searches for the statement.
The reproduction data generation means is a three-dimensional virtual reality space providing server that generates the reproduction data. The three-dimensional virtual reality space providing server according to claim 1 or 2, wherein the recording means records text data obtained by performing voice recognition for speeches made by the two or more avatars. A 3D virtual reality space generation means that creates a 3D virtual reality space in which multiple avatars corresponding to multiple users are active.
A recording means for recording a portion of an electronic file presented by any avatar containing characters in the three-dimensional virtual reality space on a storage medium so that it can be reproduced later.
A search means for searching the storage medium for characters corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. A three-dimensional virtual reality space providing server including a reproduction data generation means for generating. Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point.
The three-dimensional virtual reality space providing server according to claim 4, further comprising a control means for setting the first time point. Even after the second time point has passed
The search means searches the storage medium for characters corresponding to the search query, and then searches for the characters.
The reproduction data generation means generates the reproduction data.
The three-dimensional virtual reality space providing server according to claim 5. Each of the plurality of avatars can speak in the three-dimensional virtual reality space by speaking to the corresponding user's microphone.
The recording means records in the storage medium the portion of the three-dimensional virtual reality space including two or more avatars having a conversation among the plurality of avatars so that they can be reproduced later.
The conversation is composed of the remarks of at least one of the plurality of avatars. The remarks of the avatars are voice remarks made by speaking to the microphone of the user corresponding to the avatar.
The search means searches the storage medium for the avatar's remark corresponding to the search query from any of the plurality of users.
The reproduction data generation means is a three-dimensional virtual reality space reproduction control device in which at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium is used by any one of the users. The three-dimensional virtual real space providing server according to any one of claims 4 to 6, which generates reproduction data for reproduction. The three-dimensional virtual reality space providing server according to any one of claims 1 to 7, wherein the recording means constantly records the three-dimensional virtual reality space. It is a three-dimensional virtual real space generation means for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual real space generation step that can speak in the 3D virtual real space,
When any of the plurality of avatars makes a voice statement, if there is another avatar whose distance from the one avatar in the three-dimensional virtual reality space is equal to or less than a predetermined value, the above two or more. It is a conversation detection means for determining that a conversation has started between the avatars of the avatar, and the avatar's remark is a voice remark by speaking to the microphone of the user corresponding to the avatar.
In response to the detection of the start of a conversation, the part of the three-dimensional virtual reality space containing two or more avatars having a conversation among the plurality of avatars is stored in a storage medium so that it can be played back later. Recording steps to record and
A search step for searching the storage medium for a statement corresponding to a search query from any of the plurality of users, and a search step.
Reproduction data for reproducing at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. A method for providing a three-dimensional virtual real space, which comprises a reproduction data generation step to be generated. It is a three-dimensional virtual real space generation means for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual real space generation step that can speak in the 3D virtual real space,
A recording means for recording a portion of the three-dimensional virtual reality space including two or more avatars having a conversation among the plurality of avatars on a storage medium so that the conversation can be played back later. The recording step, which is composed of the remarks of at least one of the avatars of the avatar, and the remarks of the avatar are voice remarks made by speaking to the microphone of the user corresponding to the avatar.
A search step for searching the storage medium for a statement corresponding to a search query from any of the plurality of users, and a search step.
Reproduction data for reproducing at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. The playback data generation step to be generated and
Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and includes a control means for setting the first time point.
Even after the second time point has passed
In the search step, the statement corresponding to the search query is searched from the storage medium, and the statement is searched.
Wherein in the re Namade over data generating step, generating the reproduction data, the three-dimensional virtual reality space provided methods. A 3D virtual reality space generation step that creates a 3D virtual reality space in which multiple avatars corresponding to multiple users are active, and
In the three-dimensional virtual reality space, a recording step of recording a part containing characters in an electronic file presented by any avatar on a storage medium so that it can be played back later.
A search step for searching the storage medium for characters corresponding to a search query from any of the plurality of users, and a search step.
Reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. A method for providing a three-dimensional virtual real space, which comprises a reproduction data generation step to be generated. Computer,
It is a three-dimensional virtual real space generation means for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual reality space generation means that can speak in the 3D virtual reality space,
When any of the plurality of avatars makes a voice statement, if there is another avatar whose distance from the one avatar in the three-dimensional virtual reality space is equal to or less than a predetermined value, the above two or more. A conversation detecting means for determining that a conversation has started between the avatars of the avatar, and the avatar's remark is a voice remark by speaking to the microphone of the user corresponding to the avatar.
In response to the detection of the start of a conversation, the part of the three-dimensional virtual reality space containing two or more avatars having a conversation among the plurality of avatars is stored in a storage medium so that it can be played back later. Recording means to record and
A search means for searching the storage medium for statements corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. A three-dimensional virtual real space providing program that functions as a means for generating playback data to be generated. Computer,
It is a three-dimensional virtual real space generation means for generating a three-dimensional virtual real space in which a plurality of avatars corresponding to a plurality of users are active, and each of the plurality of avatars is said to have spoken to a microphone of the corresponding user. A 3D virtual reality space generation means that can speak in the 3D virtual reality space,
A recording means for recording a portion of the three-dimensional virtual reality space including two or more avatars having a conversation among the plurality of avatars on a storage medium so that the conversation can be played back later. A recording means and a recording means, which is composed of the remarks of at least one of the avatars of the avatar, and the remarks of the avatar are voice remarks made by speaking to the microphone of the user corresponding to the avatar.
A search means for searching the storage medium for statements corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched remarks in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. Reproduction data generation means to generate and
Each user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and causes the avatar to function as a control means for setting the first time point. ,
Even after the second time point has passed
The search means searches the storage medium for a statement corresponding to the search query, and then searches for the statement.
The reproduction data generation means is a three-dimensional virtual reality space providing program that generates the reproduction data. Computer,
A 3D virtual reality space generation means that creates a 3D virtual reality space in which multiple avatars corresponding to multiple users are active.
A recording means for recording a portion of an electronic file presented by any avatar containing characters in the three-dimensional virtual reality space on a storage medium so that it can be reproduced later.
A search means for searching the storage medium for characters corresponding to a search query from any of the plurality of users.
Reproduction data for reproducing at least the portion including the searched character in the three-dimensional virtual reality space recorded in the storage medium by the three-dimensional virtual reality space reproduction control device used by any one of the users. A three-dimensional virtual real space providing program that functions as a means for generating playback data to be generated. A three-dimensional virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual reality space.
With a playback device
A microphone for making the avatar speak in the three-dimensional virtual reality space,
A search query for searching for a voice statement made by speaking to a user's microphone corresponding to any of the avatars, which is a statement of any avatar in the three-dimensional virtual reality space, is performed in the three-dimensional virtual reality space. A search query transmission means for transmitting to a 3D virtual reality space providing server that records at least a part of the above on a storage medium so that it can be played back later.
Reproduction data for reproducing at least a portion including a statement corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is concerned. Is provided with a reproduction control means for causing the reproduction device to reproduce the image.
In the storage medium, when one of the plurality of avatars speaks by voice, another avatar whose distance from the one avatar in the three-dimensional virtual reality space is equal to or less than a predetermined value is used. If so, it is determined that a conversation has started between the two or more avatars, and in response to the detection of the start of the conversation, the portion of the three-dimensional virtual reality space including the avatar having the conversation. Is stored in the 3D virtual reality space reproduction control device. A three-dimensional virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual reality space.
With a playback device
A microphone for making the avatar speak in the three-dimensional virtual reality space,
A search query for searching for a voice statement made by speaking to a user's microphone corresponding to any of the avatars, which is a statement of any avatar in the three-dimensional virtual reality space, is performed in the three-dimensional virtual reality space. A search query transmission means for transmitting to a 3D virtual reality space providing server that records at least a part of the above on a storage medium so that it can be played back later.
Reproduction data for reproducing at least a portion including a statement corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is concerned. With a reproduction control means for causing the reproduction device to reproduce
The user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and includes a setting means for setting the first time point. ,
The search query transmitting means is a three-dimensional virtual reality space reproduction control device capable of transmitting the search query to the three-dimensional virtual reality space providing server even after the second time point has passed. A three-dimensional virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the three-dimensional virtual reality space.
With a playback device
A search query for searching for characters in an electronic file presented by any avatar in the 3D virtual reality space is recorded in a storage medium so that at least a part of the 3D virtual reality space can be reproduced later. Search query sending means to send to the 3D virtual reality space providing server,
Reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is received. A three-dimensional virtual real space reproduction control device including a reproduction control means for causing the reproduction device to reproduce. It is a 3D virtual reality space reproduction control method in a 3D virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for a voice statement made by speaking to a user's microphone corresponding to any of the avatars, which is a statement of any avatar in the three-dimensional virtual reality space, is performed in the three-dimensional virtual reality space. A search query transmission step to send to the 3D virtual reality space providing server that records at least a part of the above on the storage medium so that it can be played back later.
Reproduction data for reproducing at least a portion including a statement corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is concerned. With a playback control step to replay the playback device,
In the storage medium, when one of the plurality of avatars speaks by voice, another avatar whose distance from the one avatar in the three-dimensional virtual reality space is equal to or less than a predetermined value is used. If so, it is determined that a conversation has started between the two or more avatars, and in response to the detection of the start of the conversation, the portion of the three-dimensional virtual reality space including the avatar having the conversation. 3D virtual reality space reproduction control method in which is stored. It is a 3D virtual reality space reproduction control method in a 3D virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for a voice statement made by speaking to a user's microphone corresponding to any of the avatars, which is a statement of any avatar in the three-dimensional virtual reality space, is performed in the three-dimensional virtual reality space. A search query transmission step to send to the 3D virtual reality space providing server that records at least a part of the above on the storage medium so that it can be played back later.
Reproduction data for reproducing at least a portion including a statement corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is concerned. And the playback control step to make the playback device play
The user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and includes a setting step for setting the first time point. ,
A three-dimensional virtual reality space reproduction control method capable of transmitting the search query to the three-dimensional virtual reality space providing server even after the second time point has elapsed. It is a 3D virtual reality space reproduction control method in a 3D virtual reality space reproduction control device used by a user to activate an avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for characters in an electronic file presented by any avatar in the 3D virtual reality space is recorded in a storage medium so that at least a part of the 3D virtual reality space can be reproduced later. A search query transmission step to be sent to the 3D virtual reality space providing server,
Reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is received. A three-dimensional virtual real space reproduction control method including a reproduction control step for causing a reproduction device to reproduce. A 3D virtual reality space reproduction control device used by the user to activate the avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for a voice statement made by speaking to a user's microphone corresponding to any of the avatars, which is a statement of any avatar in the three-dimensional virtual reality space, is performed in the three-dimensional virtual reality space. A search query transmission means for transmitting to a 3D virtual reality space providing server that records at least a part of the above on a storage medium so that it can be played back later.
Reproduction data for reproducing at least a portion including a statement corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is concerned. To function as a playback control means that causes the playback device to play
In the storage medium, when one of the plurality of avatars speaks by voice, another avatar whose distance from the one avatar in the three-dimensional virtual reality space is equal to or less than a predetermined value is used. If so, it is determined that a conversation has started between the two or more avatars, and in response to the detection of the start of the conversation, the portion of the three-dimensional virtual reality space including the avatar having the conversation. Is stored in a 3D virtual reality space playback control program. A 3D virtual reality space reproduction control device used by the user to activate the avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for a voice statement made by speaking to a user's microphone corresponding to any of the avatars, which is a statement of any avatar in the three-dimensional virtual reality space, is performed in the three-dimensional virtual reality space. A search query transmission means for transmitting to a 3D virtual reality space providing server that records at least a part of the above on a storage medium so that it can be played back later.
Reproduction data for reproducing at least a portion including a statement corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is concerned. And the reproduction control means to make the reproduction device reproduce
The user can activate the avatar in the three-dimensional virtual reality space only during the period from the first time point to the second time point, and functions as a setting means for setting the first time point. Let me
The search query transmitting means is a three-dimensional virtual reality space reproduction control program capable of transmitting the search query to the three-dimensional virtual reality space providing server even after the second time point has passed. A 3D virtual reality space reproduction control device used by the user to activate the avatar corresponding to the user in the 3D virtual reality space.
A search query for searching for characters in an electronic file presented by any avatar in the 3D virtual reality space is recorded in a storage medium so that at least a part of the 3D virtual reality space can be reproduced later. Search query sending means to send to the 3D virtual reality space providing server,
Reproduction data for reproducing at least the portion including the character corresponding to the search query in the three-dimensional virtual reality space recorded in the storage medium is received from the three-dimensional virtual reality space providing server, and the portion is received. A three-dimensional virtual real space reproduction control program that functions as a reproduction control means for reproducing the image on a reproduction device. The three-dimensional virtual reality space providing server according to any one of claims 1 to 8.
A three-dimensional virtual reality space providing system comprising the three-dimensional virtual reality space reproduction control device according to any one of claims 15 to 17.

Images