CN112261337B - Method and equipment for playing voice information in multi-person voice - Google Patents

Abstract

The application aims to provide a method and equipment for playing voice information in multi-person voice, wherein the method comprises the following steps: for a target user in a plurality of users participating in multi-user voice, determining virtual position information of other users in a virtual sound field corresponding to the target user, and generating virtual sound field information corresponding to the target user according to the virtual position information; and sending the virtual sound field information to user equipment corresponding to the target user, so that the user equipment plays the voice information of the user according to the virtual position information of each user in the target virtual sound field. The method and the device can enable each user to clearly and accurately distinguish each person's voice in the multi-person voice, and can intuitively and quickly know which other user is speaking at present, so that great convenience can be provided for the user in the multi-person voice.

Description

A method and device for playing voice information in multi-person voice

technical field

The present application relates to the communication field, and in particular to a technology for playing voice information in multi-person voice.

Background technique

With the development of the times, voice communication has become one of the most popular and common communication methods. In the prior art, multi-person voice communication refers to multiple users using mobile phones, PCs and other terminal devices to communicate in real time Communicating through the network, a common multi-person voice communication scheme is that each client receives real-time voice information from other multiple clients, and then locally mixes the multiple received real-time voice information to obtain a local Mix voice messages and play them.

Contents of the invention

An object of the present application is to provide a method and device for playing voice information in multi-person voice.

According to one aspect of the present application, a method for playing voice information in multi-person voice applied to a network device end is provided, the method comprising:

For a target user among multiple users participating in multi-person voice, determine the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user, and generate the Virtual sound field information corresponding to the target user;

sending the virtual sound field information to the user equipment corresponding to the target user, so that the user equipment plays the voice information of each user in the target virtual sound field according to the virtual position information of each user in the target virtual sound field .

According to one aspect of the present application, a network device for playing voice information in multi-person voice is provided, the device comprising:

A module, configured to determine the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user for the target user among the multiple users participating in the multi-person voice, and according to the virtual location information, generating virtual sound field information corresponding to the target user;

A two-module, configured to send the virtual sound field information to the user equipment corresponding to the target user, so that the user equipment can use the virtual position information of each of the other users in the target virtual sound field Play the user's voice message.

According to one aspect of the present application, a device for playing voice information in multi-person voice is provided, wherein the device includes:

processor; and

memory arranged to store computer-executable instructions that, when executed, cause the processor to:

For a target user among multiple users participating in multi-person voice, determine the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user, and generate the Virtual sound field information corresponding to the target user;

sending the virtual sound field information to the user equipment corresponding to the target user, so that the user equipment plays the voice information of each user in the target virtual sound field according to the virtual position information of each user in the target virtual sound field .

According to one aspect of the present application, there is provided a computer-readable medium storing instructions that, when executed, cause a system to perform the following operations:

For a target user among multiple users participating in multi-person voice, determine the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user, and generate the Virtual sound field information corresponding to the target user;

sending the virtual sound field information to the user equipment corresponding to the target user, so that the user equipment plays the voice information of each user in the target virtual sound field according to the virtual position information of each user in the target virtual sound field .

Compared with the prior art, this application can determine the virtual position information of other users in the virtual sound field corresponding to the user for each of the multiple users participating in the voice, and then according to the virtual sound field information of other users in the virtual sound field corresponding to the user Play the voice information of other users based on the virtual location information in it, so that each user can clearly and accurately distinguish the voices of each person in the multi-person voice, and can intuitively and quickly know which other user is currently speaking, which can provide Provides great convenience to users in multi-person voice.

Description of drawings

Other characteristics, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

FIG. 1 shows a flow chart of a method for playing voice information in multi-person voices applied to a network device according to an embodiment of the present application;

FIG. 2 shows a structural diagram of a network device for playing voice information in multi-person voice according to an embodiment of the present application;

FIG. 3 illustrates an exemplary system that may be used to implement various embodiments described in this application.

The same or similar reference numerals in the drawings represent the same or similar components.

Detailed ways

The application will be described in further detail below in conjunction with the accompanying drawings.

In a typical configuration of the present application, the terminal, the device serving the network, and the trusted party all include one or more processors (for example, a central processing unit (Central Processing Unit, CPU)), an input/output interface, a network interface and Memory.

Memory may include non-permanent memory in computer-readable media, random access memory (Random Access Memory, RAM) and/or non-volatile memory, such as read-only memory (Read Only Memory, ROM) or flash memory (Flash Memory). Memory is an example of computer readable media.

Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. The example of the storage medium of computer includes, but not limited to Phase-Change Memory (Phase-Change Memory, PCM), Programmable Random Access Memory (Programmable Random Access Memory, PRAM), Static Random-Access Memory (Static Random-Access Memory, SRAM), Dynamic Random Access Memory (Dynamic Random Access Memory, DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (Electrically-Erasable Programmable Read- Only Memory, EEPROM), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory, CD-ROM), Digital Versatile Disc (Digital Versatile Disc, DVD) or other optical storage, Magnetic tape cartridge, tape disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

The equipment referred to in this application includes, but is not limited to, user equipment, network equipment, or equipment formed by integrating user equipment and network equipment through a network. The user equipment includes but is not limited to any mobile electronic product that can perform human-computer interaction (such as human-computer interaction through a touch panel) with the user, such as a smart phone, a tablet computer, etc., and the mobile electronic product can use any operation System, such as Android operating system, iOS operating system, etc. Wherein, the network device includes an electronic device that can automatically perform numerical calculation and information processing according to pre-set or stored instructions, and its hardware includes but is not limited to a microprocessor, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC) , Programmable Logic Device (PLD), Field Programmable Gate Array (Field Programmable Gate Array, FPGA), Digital Signal Processor (Digital Signal Processor, DSP), embedded devices, etc. The network equipment includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets or a cloud composed of multiple servers; here, the cloud is composed of a large number of computers or network servers based on Cloud Computing, Among them, cloud computing is a kind of distributed computing, a virtual supercomputer composed of a group of loosely coupled computer sets. The network includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless ad hoc network (Ad Hoc network) and the like. Preferably, the device may also be a program running on the user device, network device, or a device formed by integrating user device and network device, network device, touch terminal or network device and touch terminal through a network.

Of course, those skilled in the art should understand that the above-mentioned equipment is only an example, and other existing or future equipment that may be applicable to this application should also be included in the scope of protection of this application, and it is included in this application by reference. this.

In the description of the present application, "plurality" means two or more, unless otherwise specifically defined.

Fig. 1 shows a flow chart of a method for playing voice in multi-person voice applied to a network device according to an embodiment of the present application, and the method includes step S11 and step S12. In step S11, the network device determines the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user for the target user among the multiple users, and according to the Virtual location information, generating virtual sound field information corresponding to the target user; in step S12, the network device sends the virtual sound field information to the user equipment corresponding to the target user, so that the user equipment The virtual position information of each user in the target virtual sound field is used to play the user's voice information.

In step S11, the network device determines the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user for the target user among the multiple users, and according to the The virtual position information generates virtual sound field information corresponding to the target user. In some embodiments, the target user is each of the plurality of users participating in the multi-person speech. In some embodiments, the virtual sound field is a relative coordinate system. The relative coordinate system can be a two-dimensional plane coordinate system or a three-dimensional space coordinate system. Each user corresponds to a virtual sound field. The virtual position refers to other users For the corresponding coordinate point in the user's virtual sound field, the virtual position information is the coordinate value corresponding to the coordinate point, and the corresponding virtual position of the user in the user's virtual sound field is the coordinate origin. For example, in the virtual sound field of User1, the virtual position information corresponding to User1 is (0,0), the virtual position corresponding to User2 is information (0,1), and in the virtual sound field of User2, the virtual position information corresponding to User1 is ( 0, -1), the virtual location information corresponding to User2 is (0,0). In some embodiments, the coordinate axis unit of the virtual sound field corresponding to a certain user is a predetermined distance interval, for example, 1 cm, 10 cm, 1 meter, etc., and the coordinate axis direction is a predetermined direction relative to the user, For example, the positive direction of the X axis is the right of the user, and the positive direction of the Y axis is the front of the user. In some embodiments, according to the corresponding virtual position information of one user in another user's virtual sound field, and the coordinate axis unit and coordinate axis direction of the virtual sound field, the relative distance information and relative direction information between two users can be obtained . For example, in the virtual sound field of User1, the positive direction of the X-axis is to the right of User1, the positive direction of the Y-axis is in front of User1, the unit of the X-axis and the Y-axis is 1 meter, and the virtual position information corresponding to User1 is (0 ,0), the virtual location information corresponding to User2 is (1,0), it can be concluded that User2 is 1 meter in front of User1. In some embodiments, for each user in multi-person voice, the virtual sound field information corresponding to the user includes but not limited to the coordinate axis direction and coordinate axis unit of the user's virtual sound field, and each other user's Corresponding virtual position information (that is, coordinate values of coordinate points) in the virtual sound field.

In step S12, the network device sends the virtual sound field information to the user equipment corresponding to the target user, so that the user equipment can Information plays the user's voice information. In some embodiments, for each user in the multi-person voice, the voice information of other users may be sent from the user equipment corresponding to the other user to the user equipment corresponding to the user via the network device, or may also be sent from the user equipment corresponding to the other user The corresponding user equipment sends to the user equipment corresponding to the user through the p2p connection established between the two user equipments. In some embodiments, for each user in the multi-person voice, when receiving the voice information sent by some other user, according to the corresponding virtual position information of the other user in the user's virtual sound field, and the user's The coordinate axis direction and the coordinate axis unit of the virtual sound field can obtain the relative distance information and relative direction information of the other user relative to the user, and play the voice information according to the relative distance information and relative direction information. For example, in the virtual sound field of User1, the positive direction of the X-axis is to the right of User1, the positive direction of the Y-axis is in front of User1, the unit of the X-axis and the Y-axis is 1 meter, and the virtual position information corresponding to User1 is (0 ,0), the virtual position information corresponding to User2 is (0,-2), it can be concluded that User2 is 2 meters directly behind User1, and plays the voice information according to the relative distance information and relative direction information . In some embodiments, the way of playing the voice information according to the relative distance information and the relative direction information may be to filter and delay the voice information through a head-related transfer function (HRTF) and then output it to the speaker of the user equipment for playback. Therefore, in multi-person voice, users can clearly and accurately distinguish the voices of each other when multiple other users speak at the same time, and enable users to intuitively and quickly know which other user is currently speaking when each other user is speaking , which can provide great convenience for users in multi-person voice.

In some embodiments, for the target user among the multiple users participating in multi-person voice, determining the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user includes step S13 (not shown), step S14 (not shown) and step S15 (not shown). In step S13, the network device determines the virtual scene information corresponding to the multi-person voice; in step S14, the network device determines the virtual position corresponding to each user in the plurality of users according to the virtual scene information; In step S15, the network device determines virtual position information of the other users in the virtual sound field corresponding to the target user according to the virtual position corresponding to the target user and the virtual positions corresponding to the other users. In some embodiments, the virtual scene may be a virtual two-dimensional scene or a virtual three-dimensional scene, for example, a virtual meeting room, a virtual classroom, and the like. In some embodiments, the virtual scene information includes but not limited to virtual scene visualization information, virtual scene configuration information, etc., and the virtual scene visualization information is used to intuitively present the virtual scene to the user in the form of a 2D scene image or a 3D scene model , so that the user can determine the virtual position of himself or others in the virtual scene, or browse the virtual position of himself or others in the virtual scene, and the configuration information of the virtual scene is used according to the two to obtain the relative distance information and relative direction information between the two users, and determine the virtual position information of the two users in their corresponding virtual sound fields. In some embodiments, the virtual scene may be selected by the voice-initiating user among multiple default virtual scenes, or at least one target virtual scene selected among multiple default virtual scenes by at least one user among the multiple users, Then from at least one target virtual scene, the target virtual scene selected by the user the most times is determined as a virtual scene corresponding to multiple voices, or the virtual scene can also be automatically selected in multiple default virtual scenes according to the voice theme information of multi-person voices. A target default virtual scene determined in the scene that matches the voice topic information. In some embodiments, the virtual position of each user in the virtual scene may be determined for each user by the voice initiating user, or may be determined by each user individually, or may also be determined according to each The user information corresponding to each user determines the corresponding virtual position of each user in the virtual scene in a plurality of predetermined virtual positions, wherein, the label information (such as the label information (such as , "platform") matches the user information corresponding to the user (for example, "language teacher"). In some embodiments, after the network device determines the virtual scene corresponding to the voices of multiple people, it sends the virtual scene information corresponding to the virtual scene to each user in the multiple voices, and then according to the visualization information in the virtual scene information, The virtual scene is visually presented to each user in the form of a 2D scene image or a 3D scene model, and then each user determines their respective positions in the 2D scene image or the 3D scene model through predetermined The virtual position in the virtual scene, or only the virtual scene information corresponding to the virtual scene is sent to the voice initiating user, and the voice initiating user determines the virtual position of each user in the virtual scene in the multi-person voice. In some embodiments, for each user, according to the virtual position corresponding to the user in the virtual scene and the virtual position corresponding to each other user in the virtual scene, and the configuration information corresponding to the virtual scene, the user's relationship with the virtual scene can be obtained. Relative distance information and relative direction information between each other user, and virtual position information of each other user in the virtual sound field corresponding to the user is determined. In some embodiments, the network device will send the virtual position of each user in the virtual scene to each user and present it on the corresponding user equipment, so that each user can know that he is in a virtual position with each other user. A virtual location in the scene. In some embodiments, each user device intuitively presents to each user its virtual position corresponding to each other user in the virtual scene in the 2D scene image or 3D scene model corresponding to the virtual scene information, so that each The user can intuitively and quickly know the relative distance and relative direction of other users relative to himself in the virtual scene. For example, the user device can present the corresponding user identification information (such as , username, userid, etc.).

In some embodiments, the step S13 includes: the network device obtains the identification information corresponding to the target virtual scene information selected by the voice-initiating user among the plurality of default virtual scene information among the multiple users, and sets the target virtual scene The information is determined as the virtual scene information corresponding to the multi-person voice. In some embodiments, the voice initiating user selects a target virtual scene from multiple default virtual scenes, and sends identification information corresponding to the target virtual scene (for example, scene name, scene ID, etc.) to the network device. For example, multiple default virtual scenes include virtual meeting room 1, virtual meeting room 2, virtual classroom 1, and virtual classroom 2, and the voice initiation user selects virtual meeting room 1 as the target virtual scene in the multiple default virtual scenes, and the corresponding The identification information "virtual conference room 1" is sent to the network device.

In some embodiments, the step S13 includes: the network device obtains at least one target virtual scene information selected from a plurality of default virtual scene information by at least one user among the plurality of users, and obtains at least one target virtual scene information from the at least one target virtual scene information The virtual scene information corresponding to the multi-person voice is determined in the information, and the determined virtual scene information is selected most times. In some embodiments, each user can select one or more target virtual scenes from multiple default virtual scenes, and send the identification information corresponding to the one or more target virtual scenes to the network device, and then the network device will obtain the Among the one or more target virtual scenes, the target virtual scene selected by the user the most times is determined as the virtual scene corresponding to multi-person voices. Preferably, each user can only select one target virtual scene among multiple default virtual scenes.

In some embodiments, the step S13 includes: the network device determines the target default virtual scene information matching the voice theme information from a plurality of default virtual scene information according to the voice theme information corresponding to the multi-person voice, And the target default virtual scene information is determined as the virtual scene information corresponding to the multi-person voice. In some embodiments, the voice topic information corresponding to multi-person voices may be input by the voice initiating user and sent to the network device, or the voice initiating user may select the multi-person voice corresponding to a plurality of preset default voice topic information. voice topic information, and send the identification information corresponding to the voice topic information (for example, topic name, topic ID, etc.) Conference", "class meeting", "technology sharing" and so on. In some embodiments, according to the voice topic information corresponding to multi-person voices, among the multiple default virtual scenes, the default virtual scene matching the voice topic information is determined as the virtual scene corresponding to multi-person voices, for example, multiple default The virtual scene includes a virtual meeting room, a virtual classroom, and a virtual coffee shop. According to the voice topic information "meeting" corresponding to the multi-person voice, the default virtual scene matching the voice topic information "meeting" among the multiple default virtual scenes " "Virtual conference room" is determined as a virtual scene corresponding to multi-person voice.

In some embodiments, the step S13 includes a step S16 (not shown). In step S16, according to the user information corresponding to the multiple users, the network device determines the target default virtual scene information matching the user information from the multiple default virtual scene information, and stores the target default virtual scene information Determine the virtual scene information corresponding to the multi-person voice. In some embodiments, according to the user information corresponding to each user among the multiple users, or according to the user information corresponding to the voice-initiating user among the multiple users, each user will be corresponding to each user in the multiple default virtual scene information The default virtual scene that matches the user information of the user information or the user information corresponding to the voice initiator user is determined to be the virtual scene corresponding to the multi-person voice.

In some embodiments, the determining the target default virtual scene information matching the user information from the multiple default virtual scene information according to the user information corresponding to the multiple users includes: the network device according to the multiple default virtual scene information The user information corresponding to the voice-initiating user among the users, and determining the target default virtual scene information matching the user information from a plurality of default virtual scene information. For example, multiple default virtual scenes include virtual conference room, virtual classroom, and virtual coffee shop, and the user information corresponding to the semantic initiator user among multiple users includes "occupation: teacher", then according to the user information "occupation: teacher", Among the plurality of default virtual scenes, the default virtual scene "virtual classroom" matching the user information "occupation: teacher" is determined as the virtual scene corresponding to multi-person voices.

In some embodiments, the determining the target default virtual scene information matching the user information from the multiple default virtual scene information according to the user information corresponding to the multiple users includes: the network device according to the multiple default virtual scene information user information corresponding to each user in the plurality of users, determine at least one default virtual scene information matching the user information corresponding to each user in the plurality of users from the plurality of default virtual scene information, and determine from the plurality of default virtual scene information Target default virtual scene information is determined from at least one piece of default virtual scene information, wherein the number of users matching the target default virtual scene information is the largest. In some embodiments, for each of the multiple users, according to the user information corresponding to the user, a default virtual scene matching the user information is determined from multiple default virtual scenes. In some embodiments, among the at least one default virtual scene matching the user information corresponding to each user, the default virtual scene matching the largest number of users is determined as the virtual scene corresponding to multi-person voices. For example, multiple users corresponding to multi-person voices include User1, User2, and User3, and multiple default virtual scenes include virtual conference rooms, virtual classrooms, and virtual cafes. User1's user information includes "occupation: teacher", and the The default virtual scene is a virtual classroom. The user information of User2 includes "occupation: student", and the default virtual scene matching User2 is also a virtual classroom. The user information of User3 includes "hobby: drinking coffee", and the default virtual scene matching User3 If it is a virtual coffee shop, then in the virtual classroom and the virtual coffee shop, the virtual scene "virtual classroom" matching the largest number of users is determined as the virtual scene corresponding to multi-person voices.

In some embodiments, the virtual scene information includes a plurality of predetermined virtual locations; wherein, the step S14 includes: for each user in the plurality of users, the network device obtains the user's The corresponding target predetermined virtual position in the virtual position is determined as the virtual position of the user in the virtual scene information. In some embodiments, the virtual scene includes a plurality of predetermined virtual positions, and each predetermined virtual position is visually presented to the user in the 2D scene image or 3D scene model corresponding to the virtual scene information, and each user corresponds to the plurality of predetermined virtual positions respectively. One of the virtual positions is a predetermined target virtual position, and the predetermined virtual position corresponding to each user is determined as the virtual position of the user in the virtual scene. Preferably, each user corresponds to a different predetermined virtual position. In some embodiments, the virtual position of the user in the virtual scene can only be one of multiple predetermined virtual positions, rather than any virtual position in the virtual scene. In some embodiments, the target predetermined virtual location may be selected by the voice initiating user for each user among a plurality of predetermined virtual locations, or may also be selected by each user for itself among a plurality of predetermined virtual locations, or , it is also possible to automatically determine for each user a predetermined virtual location that matches the user information of the user from multiple predetermined virtual locations according to the respective user information of each user.

In some embodiments, for each of the plurality of users, obtaining the corresponding target predetermined virtual position of the user in the plurality of predetermined virtual positions includes: for each of the plurality of users a user, and obtain a target predetermined virtual location specified for the user in the plurality of predetermined virtual locations by the voice-initiating user among the plurality of users. In some embodiments, the voice initiating user specifies a target predetermined virtual position corresponding to each user in multiple predetermined virtual positions, and sends the identification information of the target predetermined virtual position corresponding to each user to the network device, preferably, The voice-initiating user needs to select a different target predetermined virtual location for each user, and cannot select the same target predetermined virtual location for multiple users.

In some embodiments, for each of the plurality of users, obtaining the corresponding target predetermined virtual position of the user in the plurality of predetermined virtual positions includes: for each of the plurality of users A user, according to the user information corresponding to the user, determine the target predetermined virtual position in the plurality of predetermined virtual positions, wherein the label information of the target predetermined virtual position in the virtual scene information is the user corresponding to the user The information matches. In some embodiments, for each user, according to the user information corresponding to the user, among the plurality of predetermined virtual positions, the target predetermined virtual position whose corresponding tag information in the virtual scene matches the user information is automatically determined. For example, the user information of User1 includes "occupation: language teacher", the virtual scene is a virtual classroom, and the tag information corresponding to the predetermined virtual position L1 among multiple predetermined virtual positions in the virtual scene is "podium", which is the same as that of User1 The user information "occupation: language teacher" matches the user information, so that the predetermined virtual location L1 can be determined as the corresponding target predetermined virtual location of User1 among the plurality of predetermined virtual locations.

In some embodiments, for each user in the plurality of users, obtaining the corresponding target predetermined virtual position of the user in the plurality of predetermined virtual positions includes step S17 (not shown), step S18 (not shown) and step S19 (not shown). In step S17, the network device generates virtual location request information and sends it to each of the plurality of users, wherein the virtual location request information includes the virtual scene information; in step S18, the network device receives the Feedback information about the virtual location request information sent by at least one of the plurality of users, wherein the feedback information sent by each of the at least one user is used to indicate that the user is in the plurality of predetermined virtual locations The selected target virtual location in the location; in step S19, for each user in the plurality of users, the network device determines the corresponding target reservation of the user in the plurality of predetermined virtual locations according to the feedback information virtual location. In some embodiments, the virtual location request information including the virtual scene information is sent to each user, and each user presents a 2D scene image or a 3D scene model corresponding to the virtual scene information after receiving the virtual location request information, and A plurality of predetermined virtual positions are presented in the 2D scene image or the 3D scene model, and each user selects a target predetermined virtual position among the plurality of predetermined virtual positions, and includes the identification information of the selected target predetermined virtual position in the The feedback information in the network device is sent to the network device. After the network device receives the feedback information sent by a certain user, it can obtain the target predetermined virtual position selected by the user among multiple predetermined virtual positions. Preferably, each user can only select Different target predetermined virtual positions, multiple users cannot select the same target predetermined virtual position. In some embodiments, the virtual location request information corresponds to a feedback time limit. After the feedback time limit is reached, for each user who has not yet given feedback among the plurality of users, the voice-initiating user can make a reservation from at least one currently unselected user. In the virtual position, select a corresponding target predetermined virtual position for each current non-feedback user, or, the network device may also automatically assign each current non-feedback user a respective corresponding target virtual position from at least one predetermined virtual position that is not currently selected. target predetermined virtual location.

In some embodiments, the method further includes: after receiving the feedback information sent by the first user among the multiple users, the network device generates first prompt information corresponding to the feedback information, and sends the first prompt information to the The prompt information is sent to other users who have not given feedback among the plurality of users, so as to prompt that the predetermined virtual position of the first target indicated by the feedback information cannot be selected. In some embodiments, after receiving the feedback information sent by the first user for selecting the first target predetermined virtual position among multiple predetermined virtual positions, the network device generates prompt information corresponding to the feedback information (for example, "first The user has selected the first target predetermined virtual position"), and send it to each of the other users who have not yet given feedback to remind each of the other users who have not yet given feedback that the first predetermined target virtual position cannot be selected. In some embodiments, after receiving the prompt information (for example, "the first user has selected the first target predetermined virtual position"), the user equipment corresponding to each other user may display the 2D scene image or 3D scene image corresponding to the virtual scene information. In the scene model, set the predetermined virtual position of the first target to an unselectable state.

In some embodiments, the method further includes: after receiving the feedback information sent by the first user among the multiple users, the network device generates second prompt information corresponding to the feedback information, and sends the second prompt information to The information is sent to other users among the plurality of users except the first user, to prompt that the predetermined virtual position of the first target indicated by the feedback information has been selected by the first user. In some embodiments, the network device sends a reminder message (for example, "the first user has selected the first target predetermined virtual location") to every other user in the plurality of users except the first user, so as to remind each other The first predetermined virtual position of the user has been selected by the first user, so that each user can know the virtual positions of other users in the virtual scene. In some embodiments, the identification information of the first user (for example, user name, user ID, etc.) is presented at the predetermined virtual position of the first target in the 2D scene image or 3D scene model corresponding to the virtual scene information.

In some embodiments, the method further includes: the network device receiving invitation request information sent by a second user among the at least one user, wherein the second user has selected the first virtual location among the plurality of predetermined virtual locations. 2. The target predetermined virtual position, the invitation request information is used to invite the third user who is not currently giving feedback among the multiple users to select a predetermined virtual position near the second target predetermined virtual position; sending the invitation request information to The third user is configured to prompt the third user to select an unselected predetermined virtual position near the second target predetermined virtual position as the target predetermined virtual position corresponding to the third user. In some embodiments, the second user has selected the second target predetermined virtual position as his own virtual position in the virtual scene among the plurality of predetermined virtual positions, and in response to the invitation performed by the second user for the third user who is currently not giving feedback An operation is triggered to generate invitation request information for inviting the second user to select a predetermined virtual location near the second target predetermined virtual location, and send it to the network device. In some embodiments, it is necessary to detect whether the third user has currently selected the corresponding predetermined virtual location, and if the third user has not currently selected, the invitation trigger operation can be performed for the third user. In some embodiments, after receiving the invitation request information for the third user, the network device forwards the invitation request information to the third user, so as to prompt the third user to select an unselected reservation near the virtual location of the second target reservation. The virtual position is used as a target predetermined virtual position corresponding to the third user. In some embodiments, after receiving the prompt information (for example, "the first user has selected the first target to reserve a virtual position"), the second target can be reserved in the 2D scene image or 3D scene model corresponding to the virtual scene information. At least one predetermined virtual position not selected near the virtual position is set to a special display state (for example, highlighted) to guide the third user to select one of the at least one predetermined virtual position as a target predetermined virtual position.

In some embodiments, the method further includes: after the network device reaches the predetermined feedback period corresponding to the virtual location request information, for each user among the plurality of users who currently does not give feedback, determine that the user is in the A target predetermined virtual position corresponding to at least one predetermined virtual position not currently selected among the plurality of predetermined virtual positions, and determining the target predetermined virtual position as the virtual position of the user in the virtual scene information. In some embodiments, the virtual location request information corresponds to a predetermined feedback period (for example, 5 minutes), which may be defaulted by the network device or set by the voice-initiating user. After reaching the feedback period, for For each user who has not yet given feedback among the multiple users, the voice-initiating user may select a corresponding target predetermined virtual position for each currently unfeedback user from at least one predetermined virtual position that is not currently selected, or may also The network device automatically allocates a corresponding target predetermined virtual position to each current non-feedback user from at least one predetermined virtual position not currently selected. In some embodiments, different predetermined virtual positions will correspond to different priorities in the virtual scene according to their respective label information, and the corresponding targets can be automatically assigned to the current non-feedback users in order of priority from high to low Reserve a virtual location. For example, if the virtual scene is a virtual auditorium, then in the virtual scene, the priorities corresponding to multiple predetermined virtual positions whose tag information is "first row" will be higher than those corresponding to multiple predetermined virtual positions whose tag information is "second row". priority, the currently unselected predetermined virtual positions whose label information is “the first row” will be automatically assigned to the currently unfeedback users as their respective corresponding target predetermined virtual positions.

In some embodiments, for each user among the plurality of users who is not currently giving feedback, determining the target reservation corresponding to the user in at least one predetermined virtual position that is not currently selected among the plurality of predetermined virtual positions The virtual location includes: according to the virtual location of at least one user in the virtual scene information currently fed back by the plurality of users, determining the hotspot location area information in the virtual scene information; for the plurality of users For each user who has not given feedback currently, a predetermined virtual position not selected in the hotspot location area information is determined as the user's virtual position in the virtual scene information. In some embodiments, after the feedback deadline is reached, according to the distribution of the user's virtual position corresponding to each user that has been fed back in the virtual scene, determine the hotspot location area in the virtual scene where the user's virtual position is densely distributed, then Prioritize automatically assigning a predetermined virtual position to each current unfeedback user from one or more predetermined virtual positions not selected in the hotspot location area as the respective corresponding target predetermined virtual positions, if all predetermined virtual positions in the hotspot location area If all the virtual positions have been selected, a predetermined virtual position is automatically assigned to each current non-feedback user from other unselected predetermined virtual positions in the virtual scene as the respective corresponding target predetermined virtual positions.

In some embodiments, for each user among the plurality of users who is not currently giving feedback, determining the target reservation corresponding to the user in at least one predetermined virtual position that is not currently selected among the plurality of predetermined virtual positions The virtual location includes: for each user among the plurality of users who is not currently giving feedback, determining a target predetermined virtual position corresponding to the user in at least one predetermined virtual position that is not currently selected among the plurality of predetermined virtual positions, Wherein, the tag information of the predetermined virtual location of the target in the virtual scene information matches the user information corresponding to the user. In some embodiments, for each user who is currently not giving feedback, according to the user information corresponding to the user, determine the label information corresponding to the user in the virtual scene and the user information from at least one predetermined virtual position that is not currently selected. The predetermined virtual position matched with the information is used as the target predetermined virtual position corresponding to the user. For example, the user information of User1 that is currently not fed back includes "occupation: teacher", the virtual scene is a virtual classroom, and the tag information corresponding to the predetermined virtual position L1 among at least one predetermined virtual position that is not currently selected in the virtual scene is " Lecture", the label information matches User1's user information "occupation: teacher", so that the predetermined virtual location L1 can be automatically assigned to User1 as its corresponding target predetermined virtual location.

FIG. 2 shows a structural diagram of a network device for playing voice in multi-person voice according to an embodiment of the present application. The device includes a one-one module 11 and a one-two module 12 . - a module 11, configured to determine the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user for the target user among the multiple users participating in the multi-person voice, and according to the virtual position information, generating virtual sound field information corresponding to the target user; a two-module 12, configured to send the virtual sound field information to the user equipment corresponding to the target user, so that the user equipment is configured according to the other user's The virtual position information of each user in the target virtual sound field is used to play the user's voice information.

- a module 11, configured to determine the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user for the target user among the multiple users participating in the multi-person voice, and according to the The virtual position information generates virtual sound field information corresponding to the target user. In some embodiments, the target user is each of the plurality of users participating in the multi-person speech. In some embodiments, the virtual sound field is a relative coordinate system. The relative coordinate system can be a two-dimensional plane coordinate system or a three-dimensional space coordinate system. Each user corresponds to a virtual sound field. The virtual position refers to other users For the corresponding coordinate point in the user's virtual sound field, the virtual position information is the coordinate value corresponding to the coordinate point, and the corresponding virtual position of the user in the user's virtual sound field is the coordinate origin. For example, in the virtual sound field of User1, the virtual position information corresponding to User1 is (0,0), the virtual position corresponding to User2 is information (0,1), and in the virtual sound field of User2, the virtual position information corresponding to User1 is ( 0, -1), the virtual location information corresponding to User2 is (0,0). In some embodiments, the coordinate axis unit of the virtual sound field corresponding to a certain user is a predetermined distance interval, for example, 1 cm, 10 cm, 1 meter, etc., and the coordinate axis direction is a predetermined direction relative to the user, For example, the positive direction of the X axis is the right of the user, and the positive direction of the Y axis is the front of the user. In some embodiments, according to the corresponding virtual position information of one user in another user's virtual sound field, and the coordinate axis unit and coordinate axis direction of the virtual sound field, the relative distance information and relative direction information between two users can be obtained . For example, in the virtual sound field of User1, the positive direction of the X-axis is to the right of User1, the positive direction of the Y-axis is in front of User1, the unit of the X-axis and the Y-axis is 1 meter, and the virtual position information corresponding to User1 is (0 ,0), the virtual location information corresponding to User2 is (1,0), it can be concluded that User2 is 1 meter in front of User1. In some embodiments, for each user in multi-person voice, the virtual sound field information corresponding to the user includes but not limited to the coordinate axis direction and coordinate axis unit of the user's virtual sound field, and each other user's Corresponding virtual position information (that is, coordinate values of coordinate points) in the virtual sound field.

A two-module 12, configured to send the virtual sound field information to the user equipment corresponding to the target user, so that the user equipment according to the virtual position of each of the other users in the target virtual sound field Information plays the user's voice information. In some embodiments, for each user in the multi-person voice, the voice information of other users may be sent from the user equipment corresponding to the other user to the user equipment corresponding to the user via the network device, or may also be sent from the user equipment corresponding to the other user The corresponding user equipment sends to the user equipment corresponding to the user through the p2p connection established between the two user equipments. In some embodiments, for each user in the multi-person voice, when receiving the voice information sent by some other user, according to the corresponding virtual position information of the other user in the user's virtual sound field, and the user's The coordinate axis direction and the coordinate axis unit of the virtual sound field can obtain the relative distance information and relative direction information of the other user relative to the user, and play the voice information according to the relative distance information and relative direction information. For example, in the virtual sound field of User1, the positive direction of the X-axis is to the right of User1, the positive direction of the Y-axis is in front of User1, the unit of the X-axis and the Y-axis is 1 meter, and the virtual position information corresponding to User1 is (0 ,0), the virtual position information corresponding to User2 is (0,-2), it can be concluded that User2 is 2 meters directly behind User1, and plays the voice information according to the relative distance information and relative direction information . In some embodiments, the way of playing the voice information according to the relative distance information and the relative direction information may be to filter and delay the voice information through a head-related transfer function (HRTF) and then output it to the speaker of the user equipment for playback. Therefore, in multi-person voice, users can clearly and accurately distinguish the voices of each other when multiple other users speak at the same time, and enable users to intuitively and quickly know which other user is currently speaking when each other user is speaking , which can provide great convenience for users in multi-person voice.

In some embodiments, for the target user among the multiple users participating in multi-person voice, determining the virtual position information of other users among the multiple users in the virtual sound field corresponding to the target user includes one to three A module 13 (not shown), a module 14 (not shown) and a module 15 (not shown). A three-module 13, used to determine the virtual scene information corresponding to the multi-person voice; a four module 14, used to determine the corresponding virtual position of each user in the plurality of users according to the virtual scene information; The fifth module 15 is configured to determine the virtual position information of the other users in the virtual sound field corresponding to the target user according to the virtual positions corresponding to the target user and the virtual positions corresponding to the other users. Here, the specific implementations of the first and third modules 13, the first and fourth modules 14 and the first and fifth modules 15 are the same or similar to the embodiments of the relevant steps S13, S14 and S15 in Fig. 1, so they will not be described in detail here, and are included here by reference. here.

In some embodiments, the first-third module 13 is configured to: obtain the identification information corresponding to the target virtual scene information selected by the voice-initiating user among the plurality of default virtual scene information among the plurality of users, and set the target virtual scene The scene information is determined as the virtual scene information corresponding to the multi-person voice. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, the one-three module 13 is configured to: obtain at least one target virtual scene information selected by at least one user among the multiple users from a plurality of default virtual scene information, and obtain at least one target virtual scene information from the at least one target virtual scene information The virtual scene information corresponding to the multi-person voice is determined in the scene information, wherein the determined virtual scene information is selected most times. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, the one-three module 13 is configured to: determine the target default virtual scene information matching the voice theme information from a plurality of default virtual scene information according to the voice theme information corresponding to the multi-person voice , and determine the target default virtual scene information as the virtual scene information corresponding to the multi-person voice. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, the one-three modules 13 include a six-module 16 (not shown). A six-module 16, configured to determine the target default virtual scene information matching the user information from a plurality of default virtual scene information according to the user information corresponding to the multiple users, and store the target default virtual scene information Determine the virtual scene information corresponding to the multi-person voice. Here, the specific implementation of the -6 module 16 is the same as or similar to the embodiment related to step S16 in FIG. 1 , so it will not be described in detail here, and it is included here by reference.

In some embodiments, the determining the target default virtual scene information matching the user information from the multiple default virtual scene information according to the user information corresponding to the multiple users includes: the network device according to the multiple default virtual scene information The user information corresponding to the voice-initiating user among the users, and determining the target default virtual scene information matching the user information from a plurality of default virtual scene information. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, the determining the target default virtual scene information matching the user information from the multiple default virtual scene information according to the user information corresponding to the multiple users includes: the network device according to the multiple default virtual scene information user information corresponding to each user in the plurality of users, determine at least one default virtual scene information matching the user information corresponding to each user in the plurality of users from the plurality of default virtual scene information, and determine from the plurality of default virtual scene information Target default virtual scene information is determined from at least one piece of default virtual scene information, wherein the number of users matching the target default virtual scene information is the largest. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, the virtual scene information includes a plurality of predetermined virtual locations; wherein, the one-fourth module 14 is used to obtain, for each user in the plurality of users, the user in the plurality of Predetermining a corresponding target predetermined virtual position in the virtual position, and determining the target predetermined virtual position as the virtual position of the user in the virtual scene information. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, for each of the plurality of users, obtaining the corresponding target predetermined virtual position of the user in the plurality of predetermined virtual positions includes: for each of the plurality of users a user, and obtain a target predetermined virtual location specified for the user in the plurality of predetermined virtual locations by the voice-initiating user among the plurality of users. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, for each of the plurality of users, obtaining the corresponding target predetermined virtual position of the user in the plurality of predetermined virtual positions includes: for each of the plurality of users A user, according to the user information corresponding to the user, determine the target predetermined virtual position in the plurality of predetermined virtual positions, wherein the label information of the target predetermined virtual position in the virtual scene information is the user corresponding to the user The information matches. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, for each user in the plurality of users, obtaining the target predetermined virtual position corresponding to the user in the plurality of predetermined virtual positions includes a module 17 (not shown), An eighth module 18 (not shown) and a nineteenth module 19 (not shown). 17. Module 17, used to generate virtual location request information and send it to each user in the plurality of users, wherein the virtual location request information includes the virtual scene information; 18. Module 18, used to receive the Feedback information about the virtual location request information sent by at least one of the plurality of users, wherein the feedback information sent by each of the at least one user is used to indicate that the user is in the plurality of predetermined virtual locations The target predetermined virtual position selected in the position; a nine module 19, for each user in the plurality of users, according to the feedback information, determine the corresponding target reservation of the user in the plurality of predetermined virtual positions virtual location. Here, the specific implementations of module 17, module 18 and module 19 are the same as or similar to the embodiments of steps S17, S18 and S19 in Fig. 1, so they are not described in detail here, and are included by reference here. here.

In some embodiments, the device is further configured to: after receiving the feedback information sent by the first user among the multiple users, generate first prompt information corresponding to the feedback information, and send the first prompt information to The information is sent to other users who have not given feedback among the plurality of users, so as to prompt that the predetermined virtual position of the first target indicated by the feedback information is not selectable. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, the device is further configured to: after receiving the feedback information sent by the first user among the multiple users, generate second prompt information corresponding to the feedback information, and convert the second prompt information to sending to other users among the plurality of users except the first user, to prompt that the predetermined virtual position of the first target indicated by the feedback information has been selected by the first user. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, the device is further configured to: receive invitation request information sent by a second user among the at least one user, wherein the second user has selected the second virtual location among the plurality of predetermined virtual locations. The target predetermined virtual position, the invitation request information is used to invite the third user who has not currently given feedback among the multiple users to select a predetermined virtual position near the second target predetermined virtual position; and the invitation request information is sent to the the third user, so as to prompt the third user to select an unselected predetermined virtual position near the second target predetermined virtual position as the target predetermined virtual position corresponding to the third user. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, the device is further configured to: after the predetermined feedback period corresponding to the virtual location request information is reached, for each user among the plurality of users who currently does not provide feedback, determine that the user is in the plurality of A target predetermined virtual position corresponding to at least one predetermined virtual position not currently selected among the predetermined virtual positions, and determining the target predetermined virtual position as the virtual position of the user in the virtual scene information. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, for each user among the plurality of users who is not currently giving feedback, determining the target reservation corresponding to the user in at least one predetermined virtual position that is not currently selected among the plurality of predetermined virtual positions The virtual location includes: according to the virtual location of at least one user in the virtual scene information currently fed back by the plurality of users, determining the hotspot location area information in the virtual scene information; for the plurality of users For each user who has not given feedback currently, a predetermined virtual position not selected in the hotspot location area information is determined as the user's virtual position in the virtual scene information. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

In some embodiments, for each user among the plurality of users who is not currently giving feedback, determining the target reservation corresponding to the user in at least one predetermined virtual position that is not currently selected among the plurality of predetermined virtual positions The virtual location includes: for each user among the plurality of users who is not currently giving feedback, determining a target predetermined virtual position corresponding to the user in at least one predetermined virtual position that is not currently selected among the plurality of predetermined virtual positions, Wherein, the tag information of the predetermined virtual location of the target in the virtual scene information matches the user information corresponding to the user. Here, the relevant operations are the same as or similar to those in the embodiment shown in FIG. 1 , so they are not repeated here, and are hereby incorporated by reference.

FIG. 3 illustrates an exemplary system that may be used to implement various embodiments described in this application.

As shown in FIG. 3 , in some embodiments, the system 300 can be used as any device in each of the above embodiments. In some embodiments, system 300 may include one or more computer-readable media (e.g., system memory or NVM/storage device 320 ) having instructions and be coupled to and configured to execute The instructions are one or more processors (eg, processor(s) 305 ) that implement a module to perform the actions described in this application.

For one embodiment, system control module 310 may include any suitable interface controller to provide at least one of processor(s) 305 and/or any suitable device or component in communication with system control module 310 Any suitable interface.

The system control module 310 may include a memory controller module 330 to provide an interface to the system memory 315 . The memory controller module 330 may be a hardware module, a software module and/or a firmware module.

System memory 315 may be used, for example, to load and store data and/or instructions for system 300 . For one embodiment, system memory 315 may include any suitable volatile memory, such as suitable DRAM. In some embodiments, system memory 315 may include Double Data Rate Type Quad Synchronous Dynamic Random Access Memory (DDR4 SDRAM).

For one embodiment, system control module 310 may include one or more input/output (I/O) controllers to provide interfaces to NVM/storage devices 320 and communication interface(s) 325 .

For example, NVM/storage 320 may be used to store data and/or instructions. NVM/storage 320 may include any suitable non-volatile memory (e.g., flash memory) and/or may include any suitable non-volatile storage device(s) (e.g., one or more hard drives ( HDD), one or more compact disc (CD) drives, and/or one or more digital versatile disc (DVD) drives).

NVM/storage device 320 may include a storage resource that is physically part of the device on which system 300 is installed, or it may be accessible by the device without necessarily being part of the device. For example, NVM/storage 320 may be accessed over a network via communication interface(s) 325 .

Communication interface(s) 325 may provide an interface for system 300 to communicate over one or more networks and/or with any other suitable device. System 300 may communicate wirelessly with one or more components of a wireless network according to any of one or more wireless network standards and/or protocols.

For one embodiment, at least one of processor(s) 305 may be packaged with logic of one or more controllers of system control module 310 (eg, memory controller module 330 ). For one embodiment, at least one of the processor(s) 305 may be packaged with the logic of one or more controllers of the system control module 310 to form a system-in-package (SiP). For one embodiment, at least one of the processor(s) 305 may be integrated on the same die as the logic of the one or more controllers of the system control module 310 . For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with the logic of the one or more controllers of the system control module 310 to form a system on chip (SoC).

In various embodiments, system 300 may be, but is not limited to, a server, workstation, desktop computing device, or mobile computing device (eg, laptop computing device, handheld computing device, tablet computer, netbook, etc.). In various embodiments, system 300 may have more or fewer components and/or a different architecture. For example, in some embodiments, system 300 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touchscreen display), non-volatile memory ports, multiple antennas, graphics chips, application-specific integrated circuits ( ASIC) and speakers.

The present application also provides a computer-readable storage medium, the computer-readable storage medium stores computer codes, and when the computer codes are executed, the method described in any one of the preceding items is executed.

The present application also provides a computer program product, when the computer program product is executed by a computer device, the method described in any one of the preceding items is executed.

The present application also provides a kind of computer equipment, and described computer equipment comprises:

one or more processors;

memory for storing one or more computer programs;

When the one or more computer programs are executed by the one or more processors, the one or more processors are made to implement the method as described in any one of the preceding items.

It should be noted that the present application can be implemented in software and/or a combination of software and hardware, for example, it can be implemented by using an application specific integrated circuit (ASIC), a general-purpose computer or any other similar hardware devices. In one embodiment, the software program of the present application can be executed by a processor to realize the steps or functions described above. Likewise, the software program (including associated data structures) of the present application can be stored in a computer-readable recording medium such as RAM memory, magnetic or optical drive or floppy disk and the like. In addition, some steps or functions of the present application may be realized by hardware, for example, as a circuit that cooperates with a processor to execute each step or function.

In addition, a part of the present application can be applied as a computer program product, such as a computer program instruction. When it is executed by a computer, the method and/or technical solution according to the present application can be invoked or provided through the operation of the computer. Those skilled in the art should understand that computer program instructions exist in computer-readable media in forms including but not limited to source files, executable files, installation package files, etc. Limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding post-installation program program. Here, a computer readable medium may be any available computer readable storage medium or communication medium that can be accessed by a computer.

Communication media includes the media whereby communication signals embodying, for example, computer readable instructions, data structures, program modules or other data are transmitted from one system to another. Communication media can include guided transmission media such as cables and wires (e.g., fiber optics, coaxial, etc.) and wireless (unguided transmission) media capable of propagating waves of energy, such as acoustic, electromagnetic, RF, microwave, and infrared . Computer readable instructions, data structures, program modules or other data may be embodied, for example, as a modulated data signal in a wireless medium such as a carrier wave or similar mechanism such as embodied as part of spread spectrum technology. The term "modulated data signal" means a signal that has one or more of its characteristics changed or set in such a manner as to encode information in the signal. Modulation can be analog, digital or mixed modulation techniques.

By way of example, and not limitation, computer-readable storage media may include volatile and nonvolatile, volatile, volatile, or Removable and non-removable media. For example, computer-readable storage media include, but are not limited to, volatile memories such as random access memory (RAM, DRAM, SRAM); and nonvolatile memories such as flash memory, various read-only memories (ROM, PROM, EPROM) , EEPROM), magnetic and ferromagnetic/ferroelectric memory (MRAM, FeRAM); and magnetic and optical storage devices (hard disks, magnetic tapes, CDs, DVDs); or other media now known or developed in the future capable of storing data for computer systems Computer readable information/data used.

Here, an embodiment according to the present application includes an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, triggering The operation of the device is based on the foregoing methods and/or technical solutions according to multiple embodiments of the present application.

It will be apparent to those skilled in the art that the present application is not limited to the details of the exemplary embodiments described above, but that the present application can be implemented in other specific forms without departing from the spirit or essential characteristics of the present application. Accordingly, the embodiments should be considered exemplary and non-restrictive in all points of view, and the scope of the application is defined by the appended claims rather than the foregoing description, and it is intended that the scope of the present application be defined by the appended claims rather than by the foregoing description. All changes within the meaning and range of equivalents of the elements are embraced in this application. Any reference sign in a claim should not be construed as limiting the claim concerned. In addition, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means stated in the device claims may also be realized by one unit or device through software or hardware. The words first, second, etc. are used to denote names and do not imply any particular order.

Claims (18)

1. A method for playing voice information in multi-person voice is applied to a network equipment terminal, wherein the method comprises the following steps:

determining virtual scene information corresponding to the multi-person voice; determining a virtual position corresponding to each user in the plurality of users according to the virtual scene information; determining virtual position information of other users in a virtual sound field corresponding to a target user according to virtual positions corresponding to the target user and virtual positions corresponding to other users, and generating virtual sound field information corresponding to the target user according to the virtual position information, wherein the virtual sound field is a relative coordinate system, the virtual position corresponding to the target user in the virtual sound field is a coordinate origin, the virtual position information is a coordinate value of a coordinate point corresponding to the other users in the virtual sound field, and each user corresponds to one virtual sound field;

sending the virtual sound field information to user equipment corresponding to the target user, so that the user equipment plays the voice information of each user in the virtual sound field according to the virtual position information of each user in the other users;

wherein, the determining the virtual scene information corresponding to the multi-person voice comprises:

and determining target default virtual scene information matched with the voice theme information from a plurality of pieces of default virtual scene information according to the voice theme information corresponding to the multi-person voice, and determining the target default virtual scene information as the virtual scene information corresponding to the multi-person voice.

2. The method of claim 1, wherein the determining the virtual scene information corresponding to the multi-person voice comprises:

and obtaining identification information corresponding to target virtual scene information selected by a voice initiating user in a plurality of default virtual scene information, and determining the target virtual scene information as the virtual scene information corresponding to the multi-user voice.

3. The method of claim 1, wherein the determining the virtual scene information corresponding to the multi-person voice comprises:

the method comprises the steps of obtaining at least one piece of target virtual scene information selected by at least one user in a plurality of pieces of default virtual scene information, and determining the virtual scene information corresponding to the multi-person voice from the at least one piece of target virtual scene information, wherein the determined virtual scene information is selected most frequently.

4. The method of claim 1, wherein the determining the virtual scene information corresponding to the multi-person voice comprises:

and determining target default virtual scene information matched with the user information from a plurality of pieces of default virtual scene information according to the user information corresponding to the plurality of users, and determining the target default virtual scene information as the virtual scene information corresponding to the multi-user voice.

5. The method of claim 4, wherein the determining, according to the user information corresponding to the plurality of users, target default virtual scenario information that matches the user information from a plurality of default virtual scenario information comprises:

and determining target default virtual scene information matched with the user information from a plurality of pieces of default virtual scene information according to the user information corresponding to the voice initiating user in the plurality of users.

6. The method of claim 4, wherein the determining, according to the user information corresponding to the plurality of users, target default virtual scenario information that matches the user information from a plurality of default virtual scenario information comprises:

determining at least one piece of default virtual scene information matched with the user information corresponding to each of the multiple users from the multiple pieces of default virtual scene information according to the user information corresponding to each of the multiple users, and determining target default virtual scene information from the at least one piece of default virtual scene information, wherein the number of users matched with the target default virtual scene information is the largest.

7. The method of claim 1, wherein the virtual scene information includes a plurality of predetermined virtual locations;

wherein the determining the virtual position corresponding to each of the plurality of users according to the virtual scene information includes:

and for each user in the plurality of users, obtaining a target preset virtual position corresponding to the user in the plurality of preset virtual positions, and determining the target preset virtual position as the virtual position of the user in the virtual scene information.

8. The method of claim 7, wherein said obtaining, for each of the plurality of users, a corresponding target predetermined virtual location of the user in the plurality of predetermined virtual locations comprises:

for each user in the plurality of users, obtaining a target predetermined virtual position, designated for the user, of the voice-initiating user in the plurality of predetermined virtual positions.

9. The method of claim 7, wherein said obtaining, for each of the plurality of users, a corresponding target predetermined virtual location of the user in the plurality of predetermined virtual locations comprises:

and for each user in the plurality of users, determining a target preset virtual position in the plurality of preset virtual positions according to the user information corresponding to the user, wherein the label information of the target preset virtual position in the virtual scene information is matched with the user information corresponding to the user.

10. The method of claim 7, wherein said obtaining, for each of the plurality of users, a corresponding target predetermined virtual location of the user in the plurality of predetermined virtual locations comprises:

generating virtual position request information and sending the virtual position request information to each user in the plurality of users, wherein the virtual position request information comprises the virtual scene information;

receiving feedback information which is sent by at least one user of the plurality of users and relates to the virtual position request information, wherein the feedback information sent by each user of the at least one user is used for indicating a target preset virtual position selected by the user in the plurality of preset virtual positions;

and for each user in the plurality of users, determining a target preset virtual position corresponding to the user in the plurality of preset virtual positions according to the feedback information.

11. The method of claim 10, wherein the method further comprises:

after receiving feedback information sent by a first user of the multiple users, generating first prompt information corresponding to the feedback information, and sending the first prompt information to other users which have not fed back so as to prompt that a first target preset virtual position indicated by the feedback information is not selectable.

12. The method of claim 10, wherein the method further comprises:

after receiving feedback information sent by a first user of the multiple users, generating second prompt information corresponding to the feedback information, and sending the second prompt information to other users except the first user of the multiple users to prompt that a first target preset virtual position indicated by the feedback information is selected by the first user.

13. The method of claim 10, wherein the method further comprises:

receiving invitation request information sent by a second user of the at least one user, wherein the second user selects a second target predetermined virtual position in the plurality of predetermined virtual positions, and the invitation request information is used for inviting a third user which is not currently fed back in the plurality of users to select a predetermined virtual position near the second target predetermined virtual position;

and sending the invitation request information to the third user to prompt the third user to select the unselected preset virtual position near the second target preset virtual position as the target preset virtual position corresponding to the third user.

14. The method of claim 10, wherein the method further comprises:

after a predetermined feedback period corresponding to the virtual position request information is reached, for each user which does not currently feed back in the plurality of users, determining a target predetermined virtual position corresponding to the user in at least one predetermined virtual position which is not currently selected in the plurality of predetermined virtual positions, and determining the target predetermined virtual position as the virtual position of the user in the virtual scene information.

15. The method of claim 14, wherein said determining, for each user of the plurality of users who is not currently feeding back, a corresponding target predetermined virtual location of the user in at least one predetermined virtual location of the plurality of predetermined virtual locations that is not currently selected comprises:

determining hot spot position area information in the virtual scene information according to the virtual position of at least one user in the virtual scene information which is fed back currently in the plurality of users;

and for each user which is not currently fed back in the plurality of users, determining an unselected predetermined virtual position in the hot spot position area information as the virtual position of the user in the virtual scene information.

16. The method of claim 14, wherein said determining, for each user of the plurality of users who is not currently feeding back, a corresponding target predetermined virtual location of the user in at least one predetermined virtual location of the plurality of predetermined virtual locations that is not currently selected comprises:

and for each user which is not currently fed back in the plurality of users, determining a target scheduled virtual position corresponding to the user in at least one scheduled virtual position which is not currently selected in the plurality of scheduled virtual positions, wherein the tag information of the target scheduled virtual position in the virtual scene information is matched with the user information corresponding to the user.

17. An apparatus for playing voice information in a multi-person voice, the apparatus comprising:

a processor; and

a memory arranged to store computer executable instructions that, when executed, cause the processor to perform the method of any of claims 1 to 16.

18. A computer readable medium storing instructions that, when executed, cause a system to perform the operations of any of claims 1 to 16.

Images