KR102506293B1 - Meeting system in virtual reality - Google Patents

Abstract

A meeting system in virtual reality includes a server that displays a plurality of avatars corresponding to each of a plurality of participants of a meeting who have entered the virtual space for the meeting in the virtual space, wherein the server is configured in advance. By using information or setting information input from the terminals of the plurality of participants, audio signals transmitted by the terminals of the plurality of participants and received by the server are adjusted to transmit audio signals among the terminals of the plurality of participants. A corresponding audio signal may be transmitted to a terminal other than one terminal, but the plurality of participants may be classified including a host hosting the meeting and a guest other than the host.

Description

Meeting system in virtual reality {MEETING SYSTEM IN VIRTUAL REALITY}

The present invention relates to a meeting system in virtual reality.

With the spread of the corona virus, various non-face-to-face activities are increasing.

In particular, in the case of non-face-to-face activities in which a large number of participants participate, such as classes and meetings using online, it would be perfect if the activity could be conducted in virtual reality, but more realistic.

In addition, in the case of current remote classes, there are many cases in which students enter text messages and interact with each other through chatting. In this case, the text messages are often buried.

The present invention is an invention aimed at solving the technical problems as described above, and can give more realism to meetings such as remote classes and conferences in virtual reality, Its purpose is to provide a meeting system in virtual reality that can be solved simply by voice conversation without looking for whispers buried in chatting.

A meeting system in virtual reality according to the present invention includes a server displaying a plurality of avatars corresponding to each of a plurality of participants in a virtual space for a corresponding meeting in the virtual space.

Specifically, the server adjusts the size of an audio signal transmitted by the terminals of the plurality of participants and received by the server using preset information or setting information input from the terminals of the plurality of participants. Of the participants' terminals, the audio signal may be transmitted to a terminal other than the terminal that transmitted the audio signal, but the plurality of participants may be classified including a host hosting the meeting and a guest other than the host.

In addition, when the server receives an audio signal from a terminal of a host hosting the meeting among the plurality of participants, it is preferable to transmit the corresponding audio signal to the terminals of the other participants with the same size.

That is, when receiving an audio signal from a terminal of a guest of a corresponding meeting, the server determines the direction of the gaze of the guest's avatar in the virtual space; and the distance between the guest's avatar and the guest's avatar as a listener; The audio signal is transmitted to the terminal of the host and the terminals of the remaining guests by adjusting the size of the corresponding audio signal using at least one of the above.

In addition, when the eyes of two avatars of the plurality of participants meet, the server may transmit audio signals of the two participants only to the terminal of the other party. Preferably, the server is configured to adjust the volume of an audio signal of a conversation partner from a terminal of each of the two participants and an audio signal of a participant who is speaking in public when eyes of two avatars of the plurality of participants meet. When the control request signal is received, the volume of the audio signal of the other party and the audio signal of the participant who is speaking in public can be adjusted and transmitted to the terminal of the corresponding participant.

In addition, when the gazes of two avatars of the plurality of participants meet, the server transmits audio signals of the two participants only to the other party's terminal, notifying other participants that the two participants are in a conversation. It is desirable to generate a signal.

In addition, when the gazes of two avatars of the plurality of participants meet, the server may adjust and transmit audio signals of the two participants to different sizes to the other participant's terminal and the other participant's terminal.

In addition, the server preferably transmits an audio signal of the guest to the terminal of another participant only within a predetermined period of time after the public speech of the guest starts.

According to the meeting system in virtual reality of the present invention, more realism can be given to meetings such as remote classes and conferences in virtual reality, and it is possible to find whispers buried by chatting by numerous text messages during a plurality of remote classes. It can be solved simply by voice chat without having to do it.

1 is a configuration diagram of a meeting system in virtual reality according to a preferred embodiment of the present invention.
2 is an exemplary view of adjusting the size of an audio signal of a host according to the present invention;
3 to 5 are first to third exemplary views of adjusting the size of an audio signal of a guest according to the present invention, respectively.
Fig. 6 is a flow chart of scaling of a guest's audio signal according to the present invention;
7 to 9 are first to third exemplary views of size adjustment of an audio signal in the two-person conversation mode of the present invention, respectively.
Fig. 10 is a flowchart of scaling of an audio signal in a conversation mode of the present invention;

Hereinafter, a meeting system in virtual reality according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

Of course, the following examples of the present invention are only intended to embody the present invention and are not intended to limit or limit the scope of the present invention. What can be easily inferred by an expert in the technical field to which the present invention pertains from the detailed description and examples of the present invention is interpreted as belonging to the scope of the present invention.

First, FIG. 1 shows a configuration diagram of a meeting system 100 in virtual reality according to a preferred embodiment of the present invention.

As can be seen from FIG. 1 , the virtual reality meeting system 100 according to a preferred embodiment of the present invention includes a server 10 and a plurality of participant terminals 20 .

The server 10 may form a virtual space for a meeting of a plurality of participants. In addition, the terminal 20 of the plurality of participants has an application program installed, and accesses the server 10 through the execution of the corresponding application program to enter the virtual space.

The server 10 preferably displays a plurality of avatars corresponding to each of the plurality of participants who have entered the virtual space for the meeting in the virtual space.

For reference, a plurality of participants may be classified by including a host who hosted the meeting and a guest other than the host. For example, in the case of remote classes, the host may be a teacher giving a lecture, and the guests may be students taking a lecture. Classification of hosts and guests may be performed by granting authority by the server 10 .

The server 10 uses preset information or setting information input from the terminals 20 of the plurality of participants, and the size of the audio signal transmitted by the terminals 20 of the plurality of participants and received by the server 10. It is possible to transmit the corresponding audio signal to a participant terminal 20 other than the participant terminal 20 that transmitted the audio signal among the terminals 20 of the plurality of participants by adjusting the .

2 is an exemplary view of adjusting the size of an audio signal of a host according to the present invention.

As can be seen from FIG. 2 , when the server 10 receives an audio signal from the terminal 20 of the host hosting the meeting among a plurality of participants, the server 10 transmits the audio signal to the same size as the rest of the participants, that is, the guest. It is preferable to transmit to the terminal 20.

That is, when the host speaks, all guests can hear the host's voice at the same level.

The speech of the host may be automatically recognized by the server 10 or may be recognized by transmission of a speech request signal from the terminal 20 of the host to the server 10 .

3 to 5 are first to third exemplary views of adjusting the size of a guest's audio signal, respectively, according to the present invention.

Specifically, in FIG. 3, the size of the guest's audio signal is adjusted by the direction, and in FIG. 4, the size of the guest's audio signal is adjusted by the distance.

In addition, in FIG. 5, the audio signal of the guest is adjusted by combining the direction and distance in the virtual space.

Here, the direction may be set using an angle centered on the gaze of the avatar of the corresponding guest.

That is, when the server 10 receives an audio signal from the terminal 20 of the guest according to the speech of the guest of the corresponding meeting, the server 10 determines the direction of the gaze of the guest's avatar in the virtual space; and the distance between the guest's avatar and the guest's avatar as a listener; The corresponding audio signal may be transmitted to the terminal 20 of the host and the terminals 20 of the remaining guests by adjusting the level of the corresponding audio signal using at least one of the above.

The speech of the guest may be automatically recognized by the server 10, or transmission of a speech request signal from the terminal 20 of the corresponding guest to the server 10 or the terminal 20 of the host and the host's terminal ( 20) to the server 10 or the guest's terminal 20.

However, when the server 10 uses the direction of the gaze of the avatar of the corresponding guest and the distance between the avatar of the corresponding guest and the avatar of the guest as a listener, as shown in FIGS. 3 to 5, the server 10 sets a constant value to the direction of the gaze and/or Although it can be set according to the distance, the size of the audio signal can be adjusted by M2=M1-(w1×d+w2+θ).

Here, M2 is the size of the audio signal of the guest, the listener, M1 is the size of the basic audio signal set for the guest, the speaker, d is the distance between the speaker and the listener, θ is the direction angle of the listener's gaze toward the speaker, w1 and w2 represents a weight, respectively.

Fig. 6 shows a flow chart of scaling of a guest's audio signal according to the present invention.

When guest 1 enters the virtual space (S10), guest 1 selects a menu (S11) and adjusts the size of an audio signal using at least one of a direction and a distance (S12, S13, and S14).

However, instead of adjusting the size of the audio signal by guest 1's menu selection, the guest's audio signal size may be adjusted by the setting of the host.

7 to 9 are first to third exemplary diagrams of scaling of an audio signal in a two-person conversation mode according to the present invention, respectively.

The two-person conversation mode can be used when the eyes of two avatars of a plurality of participants meet. A case in which the eyes of two avatars meet means a case in which the avatars' reticle cursors overlap each other's avatar.

Interactive mode is available between guests and between guests, as well as between guests and hosts. For reference, in FIGS. 7 to 9, it is assumed that guest 1 and guest 2 have a conversation mode.

Specifically, FIG. 7 is an exemplary diagram for a whisper mode, and FIG. 8 is an exemplary diagram for a public mode. In addition, FIG. 9 is an exemplary view of a semi-public mode.

The whisper mode is a mode in which only the other party can hear the audio signal of the conversation between the two participants in the conversation mode.

That is, when the eyes of two avatars of the plurality of participants meet, the server 10 may transmit an audio signal between the two participants only to the terminal 20 of the other party. In other words, when the eyes of the avatar of participant 1 and the avatar of participant 2 meet, the server 10 transmits the audio signal of the first participant only to the terminal 20 of the second participant, and the audio signal of the second participant It can be transmitted only to the terminal 20 of the first participant.

In addition, in the whisper mode, the two participants use their respective terminals 20 to send a control request signal to the server 10 to adjust the volume of the received audio signal of the other party and the audio signal of the participant in public speaking. Upon transmission, the server 10 may adjust the size of the audio signal of the other party and the audio signal of the participant during the public speaking and transmit the same to the terminal 20 of the corresponding requestor. A public statement means a statement that all participants can listen to.

However, when the server 10 transmits audio signals of a conversation between the two participants only to the terminal 20 of the conversation partner, that is, in the whisper mode, a notification to inform other participants that the two participants are in a conversation It would be desirable to generate a signal and inform other participants.

The open mode is a mode in which the server 10 transmits an audio signal of a conversation between the two participants in the same size to the terminals 20 of all participants as well as the terminals 20 of the counterpart of the conversation.

In the semi-public mode, the server 10, when the gazes of two avatars of the plurality of participants meet, the size of the audio signal of the conversation between the two participants to the other participant's terminal 20 and the other participant's terminal ( 20) to transmit the corresponding audio signal. That is, when the eyes of two avatars of the plurality of participants meet, the server 10 transmits an audio signal of a conversation between the two participants to the terminal 20 of the other party and the terminal 20 of the other participant, , It is preferable to adjust the size of the audio signal to the other party's terminal 20 to be larger than the size of the audio signal to the other participant terminals 20.

For example, when the eyes of participant 1's avatar and participant 2's avatar meet, the server 10 adjusts and transmits the first participant's audio signal to the terminal 20 of the second participant, and transmits the audio signal to the other terminals ( 20), it is possible to transmit after adjusting the size smaller than the size of the terminal 20 of the second participant.

In addition, in the public mode and semi-public mode, all participants use their respective terminals 20 to adjust the received audio signal of the talking person in the public mode and semi-public mode and the audio signal of the participant in public speaking, respectively. When the control request signal is transmitted to the server 10, the server 10 adjusts the volume of audio signals of the interlocutor in the public mode and semi-public mode and the audio signal of the participant in public speaking accordingly, so that the terminal 20 of the corresponding requestor can be sent to

For example, the server 10 may differently adjust the size of an audio signal transmitted to other participant terminals 20 according to the direction and/or distance from the avatar of the participant in conversation as shown in FIGS. 3 to 5 there is.

In addition, if the gazes of the two people in the conversation do not meet for a first predetermined time or longer, or if the gazes of both of the two people in the conversation do not look at the other person for a second predetermined time or longer, the server 10 terminates the conversation mode. desirable.

Fig. 10 shows a flowchart of scaling of an audio signal in a conversation mode of the present invention.

As can be seen from FIG. 10, when participant 1 and participant 2 enter (S20) and the eyes of participant 1 and participant 2 meet (S21), a conversation mode progress button is transmitted to each participant's terminal 20, (S22), the conversation mode is progressed by pressing the corresponding conversation mode advance button, and the conversation mode can be progressed by one of the whisper mode, public mode, and semi-public mode according to the selection of the menu (S24) (S25 , S26, S27). However, if participant 1 selects the conversation mode first, participant 2 may approve it, and if participant 2 selects the conversation mode first, the conversation mode may proceed in a manner in which participant 1 approves.

However, this interactive mode may also be selected by the setting of the host.

The meeting system 100 in virtual reality according to the present invention by whispering mode can solve the problem of sharing secret contents during remote classes. That is, in the present invention, it is possible to solve the problem simply by voice conversation without searching for whispers buried by chatting by numerous text messages during a plurality of remote classes.

In addition, when the server 10 receives the host's approval signal for the guest's public speaking request signal from the host's terminal 20, the server 10 transmits the guest's audio signal to another participant's terminal ( 20) is preferred. Alternatively, the server 10 may automatically recognize the guest's public remarks and transmit the guest's audio signal to other participants' terminals only within a predetermined period of time.

That is, the server 10 may limit the guest's public speaking time by transmitting the guest's audio signal to other participants' terminals only within a preset period of time after the guest's public speaking starts. .

Due to the time limit for public speaking, 1:1 questions can be easily conducted in the case of multiple classes, and classes can be conducted smoothly under the teacher's control.

In addition, since the right to speak can be granted according to the timer, it is suitable for presentation classes such as group assignments, individual assignments, and discussions. If there is a time limit, an overall fair class can be conducted. Specifically, the server 10 grants the right to speak according to a timer for each team and individual, recognizes only the microphones of participants who have the right to speak, and automatically blocks the microphones of participants who do not have the right to speak.

As described above, according to the meeting system 100 in virtual reality of the present invention, a more realistic feeling can be given to a meeting such as a remote class or conference in virtual reality, and a number of text messages can be sent during a plurality of remote classes. It can be seen that it is possible to solve it simply by voice conversation without looking for whispers buried by chatting.

100: meeting system
10: Server
20: participant terminal

Claims (9)

In the meeting system in virtual reality,
A server displaying a plurality of avatars in a virtual space; including,
Each of the plurality of avatars corresponds to each of a plurality of participants of the meeting who entered the virtual space for the meeting,
The server adjusts the volume of an audio signal transmitted by the terminals of the plurality of participants and received by the server using preset information or setting information input from the terminals of the plurality of participants, thereby controlling the number of participants. Among the terminals, the audio signal may be transmitted to a terminal other than the terminal that transmitted the audio signal,
The plurality of participants may include a host hosting the meeting; and guests other than the host;
The server may, when the eyes of two avatars of the plurality of participants meet, transmit each of the audio signals of the two participants only to the terminal of the other party;
The server generates a notification signal for notifying other participants that the two participants are in a conversation when the eyes of two avatars of the plurality of participants meet and each of the audio signals of the two participants is transmitted only to the terminal of the other party system characterized in that. delete According to claim 1,
The server,
The system characterized in that when receiving an audio signal from a terminal of a host hosting a corresponding meeting among the plurality of participants, the corresponding audio signal is transmitted to the terminals of the other participants with the same size. According to claim 1,
The server,
When an audio signal from a terminal of a guest of the meeting is received, a direction of the gaze of the guest's avatar in the virtual space; and the distance between the guest's avatar and the guest's avatar as a listener; A system characterized in that, by using at least one of the following, the corresponding audio signal is transmitted to the terminal of the host and the terminals of the remaining guests by adjusting the level of the corresponding audio signal. delete According to claim 1,
The server,
When the eyes of two avatars of the plurality of participants meet, a control request signal for adjusting the volume of the audio signal of the other party and the audio signal of the participant in public speaking is received from the respective terminals of the two participants. , The system characterized in that the volume of the audio signal of the other party and the audio signal of the participant who is speaking in public can be adjusted and transmitted to the terminal of the participant. delete According to claim 1,
The server,
The system characterized in that when the eyes of two avatars of the plurality of participants meet, each of the audio signals of the two participants is adjusted to a different size and transmitted to the other participant's terminal and the other participant's terminal. According to claim 1,
The server,
A system characterized in that, after the public speech of the guest starts, the audio signal of the guest is transmitted to the terminal of another participant only within a predetermined period of time.

Images