CN109040245A - The shared method and device of a kind of multiple videos, audio - Google Patents

Abstract

The present invention provides a method and device for sharing multiple videos and audios. The method includes: at least two clients receive video information and/or audio information collected in real time from a collection device; the received video information and/or The audio information is uploaded to the cloud server synchronously, and the cloud server processes the video information and/or audio information received from each client at the same time according to the preset rules to obtain the shared video and/or shared audio; receive the shared video sent by the cloud server and/or shared audio, and play shared video and/or shared audio. The acquisition device in the embodiment of the present invention can adopt the existing video and audio acquisition equipment, and multiple users install the client on their respective terminals, so that convenient communication and interaction between multiple users can be realized through the client, for Users provide more open communication and contact methods.

Description

A method and device for sharing multiple videos and audios

technical field

The invention relates to the technical field of computer applications, in particular to a method and device for sharing multiple videos and audios.

Background technique

In the existing technology, hardware products with audio and video attributes often work alone. Although some hardware products can interact with users through specific APP software, it is usually a hardware product and a user through APP software. Interaction, but it is impossible to realize the sharing of audio and video among multiple users and multiple hardware products of the same type. For example, for videos captured by cameras, only video content captured by different cameras can be displayed separately, but videos captured by multiple cameras cannot be fused into one video frame.

Therefore, based on existing hardware products, it is necessary to provide a sharing solution capable of realizing multiple videos and audios among multiple users, so as to facilitate communication and interaction among users.

Contents of the invention

In view of the above problems, the present invention is proposed to provide a method and device for sharing multiple videos and audios to overcome the above problems or at least partially solve the above problems.

According to one aspect of the present invention, a method for sharing multiple videos and audios is provided, which is applied to at least two clients, and the at least two clients realize the sharing of videos and audios by accessing a cloud server, including:

Receive video information and/or audio information collected in real time from the collection device;

Synchronously upload the received video information and/or audio information to the cloud server, and the cloud server processes the video information and/or audio information received from each client at the same time according to the preset rules to obtain the shared video and/or audio information or share audio;

receiving the shared video and/or shared audio sent by the cloud server, and playing the shared video and/or shared audio.

Optionally, the cloud server processes the video information and/or audio information received from each client at the same time according to preset rules, including:

The cloud server extracts the dynamic images of people from the video information received from each client at the same time, and merges and processes the dynamic images of people corresponding to the extracted video information, so that the dynamic images of people exist in the same screen; and/ or

The audio information received from each client at the same time is superimposed and processed by the cloud server.

Optionally, if the client receives video information and audio information collected in real time from the acquisition device, then synchronously uploads the received video information and/or audio information to the cloud server, including:

The client detects the network state of the network it uses, and judges whether the detected network state reaches the preset network state;

If not, obtain the received audio information, and upload the audio information to the cloud server;

If yes, upload the received video information and audio information to the cloud server synchronously.

Optionally, the method further includes: if the network state used by the client does not reach the preset network state, sending a request message for obtaining shared audio to the cloud server, and the cloud server according to preset rules for receiving from The audio information of each client is processed to obtain shared audio;

receiving the shared audio sent by the cloud server, and playing the shared audio.

Optionally, the network status includes at least one of the current network speed and network signal strength of the network used by the client.

Optionally, before receiving the video information and/or audio information collected in real time from the collection device, it also includes:

Any one of the at least two clients sends a sharing request to the cloud server, wherein the sharing request carries identification information of other clients among the at least two clients, and the cloud server sends the sharing request to the cloud server. other clients corresponding to the above identification information;

After the other clients receive the sharing request sent from the cloud server, if it is determined to share video and/or audio, they will return a message of sharing determination to the cloud server, and the video and/or audio sharing will be performed between the at least two clients. and/or audio sharing.

Optionally, the collection device includes at least one of the following: a set-top box, a speaker, and a smart camera.

According to another aspect of the present invention, a method for sharing multiple videos and audios is also provided, which is applied to a cloud server, and at least two clients realize the sharing of videos and audios by accessing the cloud server, including:

Receiving video information and/or audio information synchronously uploaded by the at least two clients, wherein the video information and/or audio information is collected by a collection device in real time;

Process the video information and/or audio information received from each client at the same time according to preset rules to obtain shared video and/or shared audio;

The shared video and/or shared audio are respectively sent to each client, and the shared video and/or shared audio is played by the client.

Optionally, the video information and/or audio information received from each client at the same time are processed according to preset rules, including:

Extract the dynamic images of people from the video information received from each client at the same time, and combine and process the dynamic images of people corresponding to the extracted video information, so that the dynamic images of people exist in the same screen; and/or

The audio information received from each client at the same time is superimposed and processed.

Optionally, the method also includes:

If the network state of the network used by the client does not reach the preset network state, receiving a request message for obtaining shared audio sent by the client;

The shared audio obtained by processing the audio information received from each client at the same time according to preset rules is sent to the client, and the shared audio is played by the client.

Optionally, the network status includes at least one of the current network speed and network signal strength of the network used by the client.

Optionally, before receiving the video information and/or audio information synchronously uploaded by the at least two clients, it also includes:

receiving a sharing request sent by any one of the at least two clients, wherein the sharing request carries identification information of other clients of the at least two clients;

forwarding the received sharing request to other clients corresponding to the identification information, and the other clients determine whether to perform video and/or audio sharing according to the received sharing request;

Provide video and/or audio sharing services for the at least two clients if the sharing confirmation message returned by the other clients is received.

Optionally, the collection device includes at least one of the following: a set-top box, a speaker, and a smart camera.

According to another aspect of the present invention, there is also provided a device for sharing multiple videos and audios, which is applied to at least two clients, and the at least two clients realize the sharing of videos and audios by accessing the cloud server, including :

The first receiving module is adapted to receive video information and/or audio information collected in real time from the collection device;

The upload module is adapted to upload the received video information and/or audio information to the cloud server synchronously, and the cloud server processes the video information and/or audio information received from each client at the same time according to preset rules, Get Shared Video and/or Shared Audio;

The sharing module is adapted to receive the shared video and/or shared audio sent by the cloud server, and play the shared video and/or shared audio.

Optionally, the upload module is further adapted to: the cloud server extracts the moving images of people from the video information received from each client at the same time, merges and processes the moving images of people corresponding to the extracted video information, cause moving images of people to exist in the same frame; and/or

The audio information received from each client at the same time is superimposed and processed by the cloud server.

Optionally, the device further includes: a detection module, adapted for the client to detect the network status of the network it uses, and determine whether the detected network status reaches a preset network status;

If not, obtain the received audio information, and upload the audio information to the cloud server;

If yes, upload the received video information and audio information to the cloud server synchronously.

Optionally, the device also includes:

The first request module is adapted to send a request message for obtaining shared audio to the cloud server if the network state used by the client does not reach the preset network state, and the cloud server will compare the information received from each client at the same time according to the preset rules. Audio information is processed to obtain shared audio;

The sharing module is further adapted to receive the shared audio sent by the cloud server, and play the shared audio.

Optionally, the network status includes at least one of the current network speed and network signal strength of the network used by the client.

Optionally, the device also includes:

The second request module is adapted to send a sharing request to the cloud server from any one of the at least two clients before the first receiving module receives the video information and/or audio information collected in real time from the collection device, wherein , the sharing request carries identification information of other clients among at least two clients, and the cloud server sends the sharing request to other clients corresponding to the identification information;

The determining module is adapted to return a sharing confirmation message to the cloud server if the other client receives the sharing request sent from the cloud server, and the at least two clients video and/or audio sharing between peers.

Optionally, the collection device includes at least one of the following: a set-top box, a speaker, and a smart camera.

According to yet another aspect of the present invention, a device for sharing multiple videos and audios is also provided, which is applied to a cloud server, and at least two clients realize video and audio sharing by accessing the cloud server, including:

The second receiving module is adapted to receive the video information and/or audio information synchronously uploaded by the at least two clients, wherein the video information and/or audio information are collected by the collection device in real time;

The processing module is adapted to process the video information and/or audio information received from each client at the same time according to preset rules to obtain shared video and/or shared audio;

The sending module is adapted to send the shared video and/or shared audio to each client respectively, and the client plays the shared video and/or shared audio.

Optionally, the processing module is further adapted to: extract the dynamic images of people from the video information received from each client at the same time, and combine and process the dynamic images of the people corresponding to the extracted video information, so that the human moving images exist within the same frame; and/or

The audio information received from each client at the same time is superimposed and processed.

Optionally, the second receiving module is further adapted to receive a request message for acquiring shared audio sent by the client if the network status of the network used by the client has not reached the preset network status;

The sending module is further adapted to send the shared audio obtained after processing the audio information received from each client at the same time according to preset rules to the client, and the client performs the shared audio play.

Optionally, the network status includes at least one of the current network speed and network signal strength of the network used by the client.

Optionally, the second receiving module is further adapted to receive a sharing request sent by any one of the at least two clients, wherein the sharing request carries an identifier of the other client in the at least two clients information;

The sending module is further adapted to send the received sharing request to other clients corresponding to the identification information, and the other clients determine whether to perform video and/or audio sharing according to the received sharing request;

The second receiving module is further adapted to provide video and/or audio sharing services for the at least two clients if the sharing determination message returned by the other clients is received.

Optionally, the collection device includes at least one of the following: a set-top box, a speaker, and a smart camera.

According to still another aspect of the present invention, a computer storage medium is also provided, the computer storage medium stores computer program codes, and when the computer program codes are run on a computing device, it causes the computing device to execute any of the above implementations. Multiple video and audio sharing methods described in the example.

According to yet another aspect of the present invention, there is also provided a computing device, including: a processor; a memory storing computer program code; when the computer program code is executed by the processor, the computing device is caused to execute the above-mentioned A method for sharing multiple videos and audios described in any embodiment.

In the embodiment of the present invention, at first, at least two clients are used to receive video information and/or audio information collected in real time from the acquisition device, and the received video information and/or audio information are synchronously uploaded to the cloud server, and the cloud server The video information and/or audio information received from each client at the same time are processed according to preset rules to obtain shared video and/or shared audio. Finally, at least two clients receive the shared video and/or shared audio sent by the cloud server, and play the shared video and/or shared audio, thereby realizing sharing of video and/or audio among multiple clients. The acquisition device in this embodiment can adopt existing video and audio acquisition equipment, and multiple users install the client on their respective terminals, so that convenient communication and interaction through the client can be realized between multiple users, providing users with Provides a more open way of communication and contact. Moreover, the video and audio sharing solution of the solution of the present invention is not only simple and efficient to implement, but also can be widely used in various application occasions such as teleconferencing, user video or voice communication, and the like.

Furthermore, this solution maximizes the functions of the existing video and audio collection equipment, and improves the use value of the video and audio collection equipment.

The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the specific embodiments of the present invention are enumerated below.

Those skilled in the art will be more aware of the above and other objects, advantages and features of the present invention according to the following detailed description of specific embodiments of the present invention in conjunction with the accompanying drawings.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating a preferred embodiment and are not to be considered as limiting the invention. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:

FIG. 1 shows a schematic flow diagram of a method for sharing multiple videos and audios according to an embodiment of the present invention;

FIG. 2 shows a schematic flow diagram of a method for sharing multiple videos and audios according to another embodiment of the present invention;

FIG. 3 shows a schematic structural diagram of multiple video and audio sharing devices according to an embodiment of the present invention;

FIG. 4 shows a schematic structural diagram of multiple video and audio sharing devices according to another embodiment of the present invention;

Figure 5 shows a schematic structural diagram of multiple video and audio sharing devices according to another embodiment of the present invention; and

Fig. 6 shows a schematic structural diagram of a system for sharing multiple videos and audios according to an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

In order to solve the above technical problems, the embodiment of the present invention provides a method for sharing multiple videos and audios, which is applied to at least two clients, and at least two clients realize the sharing of videos and audios by accessing the cloud server, wherein, The client can be installed on any terminal, and the terminal includes mobile terminals, such as mobile phones, notebook computers, etc., and also includes terminals such as desktop computers. Fig. 1 shows a schematic flowchart of a method for sharing multiple videos and audios according to an embodiment of the present invention. Referring to Fig. 1, the method at least includes step S102 to step S106.

Step S102, receiving video information and/or audio information collected in real time from the collection device.

In this step, the collection device may include at least one of a set-top box, a sound box, a smart camera and other devices. For example, when the acquisition device uses a speaker, the client may receive audio information collected by the speaker device in real time. For another example, when the collection device uses a smart camera, the client can receive both the video information collected by the smart camera and the audio information collected by the smart camera, or by setting the smart camera, you can choose to receive only the video collected by the smart camera message or video message. Here, the embodiment of the present invention does not specifically limit the type of the collection device.

Step S104, synchronously uploading the received video information and/or audio information to the cloud server, and the cloud server processes the video information and/or audio information received from each client at the same time according to the preset rules to obtain the shared video and/or audio information. /or share audio.

Step S106, receiving the shared video and/or shared audio sent by the cloud server, and playing the shared video and/or shared audio.

The acquisition device in the embodiment of the present invention can adopt the existing video and audio acquisition equipment, and multiple users install the client on their respective terminals, so that convenient communication and interaction between multiple users can be realized through the client, for Users provide more open communication and contact methods. Moreover, the video and audio sharing solution of the solution of the present invention is not only simple and efficient to implement, but also can be widely used in various application occasions such as teleconferencing, user video or voice communication, and the like. Furthermore, this solution maximizes the functions of the existing video and audio collection equipment, and improves the use value of the video and audio collection equipment.

Referring to step S104 above, in an embodiment of the present invention, the above preset rules are preconfigured in the cloud server, and specifically may include preset rules for video information and preset rules for audio information.

Among them, the preset rule for video information is that the cloud server extracts the dynamic images of people from the video information received from each client at the same time, and merges and processes the dynamic images of the people corresponding to the extracted video information, so that the human Moving images exist on the same screen. As a result, images of multiple users can be simultaneously displayed on the video playing screen of the client, and each user can select to see the images of all users participating in the video sharing.

For example, three clients (assumed to be client 1, client 2, and client 3) realize video sharing by accessing the cloud server, among which, user A uses client 1, user B uses client 2, and user C uses Client 3, when three users share videos through their respective clients, the images of the three users can all be displayed in the video playback interface of their respective clients, so that each user can easily know the video of the other two users. state.

The preset rule for audio information is that the cloud server can superimpose the audio information received from each client at the same time to obtain the superimposed audio information. Usually in the process of audio sharing or audio and video sharing, in order to achieve good sharing quality, there is usually an acquisition device corresponding to one client to collect important and effective audio information (such as people talking), while other acquisition devices collect to audio information where the audio information is not that important (such as the song being played). When each client sends audio information to the cloud server, the cloud server can also identify which audio information is important and which audio information is secondary, and then superimpose and process various audio information.

For example, two clients (assumed to be client 1 and client 2) realize audio sharing by accessing the cloud server. The cloud server receives the audio information from client 1 with a relatively loud volume and a clear human voice, and receives the audio information from client 2 with a low volume and is the sound of a song. Then, the cloud server performs superimposition processing on the audio information, and during the superimposition processing, priority is given to ensuring that the audio information from the client 1 is not distorted.

In an embodiment of the present invention, when a large number of clients perform audio sharing, in order to ensure the shared audio quality, the cloud server may also perform noise removal processing on multiple received audio information. For example, when using shared audio to hold a meeting, there is usually only one person speaking at the same time, that is, the audio information received by the cloud server only comes from one client (that is, the voice of the speaker) that all audio sharing users want to hear clearly , and other audio information (such as the sound of flipping through paper, the sound of things falling on the ground) is not important, at this time, the cloud server can identify the audio information and remove unimportant sounds, so as to effectively ensure the quality of the meeting . In this embodiment, the client may also directly perform noise removal processing locally on the audio information collected by its corresponding collection device.

In the embodiment of the present invention, if at least two clients upload video information and audio information to the cloud server at the same time, the cloud server can simultaneously use the preset rules for video information and the preset rules for audio information introduced above Process the received video information and audio information.

In one embodiment of the present invention, if video and audio sharing are performed simultaneously between at least two clients, in order to avoid the problem that the video and audio sharing process is not smooth due to poor network conditions, video and audio sharing can also be performed simultaneously. During sharing, switch between audio-only sharing and audio and video sharing at any time. Specifically, when the client simultaneously receives video information and audio information collected in real time from the acquisition device, it can first detect the network status of the network used by itself, and determine whether the detected network status has reached the preset network status. If not, the audio information is acquired from the received video information and audio information, and the acquired audio information is uploaded to the cloud server. If so, the received video information and audio information are synchronously and directly uploaded to the cloud server.

In this embodiment, if the network state used by the client does not reach the preset network state, it can also send a request message for obtaining shared audio to the cloud server, and the cloud server will analyze the audio information received from each client at the same time according to the preset rules. Processing is performed to obtain the shared audio, and the shared audio is returned to the client. The client receives the shared audio sent by the cloud server, and plays the shared audio. Wherein, the network status may include at least one of the current network speed and network signal strength of the network used by the client.

Further, in the embodiment of the present invention, if video and audio sharing are performed simultaneously between at least two clients, in order to avoid the problem that the video and audio sharing process is not smooth due to poor network conditions, it is also possible to perform video and audio sharing, switch between video-only sharing and audio-video sharing at any time. Specifically, when the client simultaneously receives video information and audio information collected in real time from the acquisition device, it can first detect the network status of the network used by itself, and determine whether the detected network status has reached the preset network status. If not, the video information is acquired from the received video information and audio information, and the acquired video information is uploaded to the cloud server. If so, the received video information and audio information are synchronously and directly uploaded to the cloud server.

In this embodiment, if the network state used by the client does not reach the preset network state, it can also send a request message to the cloud server to obtain the shared video, and the cloud server will compare the video information received from each client at the same time according to the preset rules. Processing is performed to obtain the shared video, and the shared video is returned to the client. The client receives the shared video sent by the cloud server, and plays the shared video.

In an embodiment of the present invention, when at least two clients realize the sharing of video and audio by accessing the cloud server, any client sends a sharing request to the cloud server, and the sharing request carries other clients in the at least two clients. terminal identification information. Furthermore, the cloud server sends the sharing request to other clients corresponding to the identification information. When other clients receive the sharing request sent from the cloud server, if they determine to share video and/or audio, they return a sharing confirmation message to the cloud server, and video and/or audio sharing is performed between at least two clients. If other clients determine not to share the video and/or audio, they will return a sharing rejection message to the cloud server. Here, other clients refer to at least two clients except any client that issues a sharing request.

Referring to step S106, in this embodiment, in order to further ensure real-time sharing of video and audio between clients and avoid the problem of sharing delay, the cloud server can synchronously send the obtained shared video and/or shared audio to In each client, in this way, the video and audio heard by the users of each client are the same video and audio.

The embodiment of the present invention also provides another method for sharing multiple videos and audios, which is applied to a cloud server, and at least two clients realize video and audio sharing by accessing the cloud server. Fig. 2 shows a schematic flowchart of a method for sharing multiple videos and audios according to another embodiment of the present invention. Referring to Fig. 2, the method at least includes step S202 to step S206.

Step S202, receiving video information and/or audio information synchronously uploaded by at least two clients, wherein the video information and/or audio information are collected by the collection device in real time.

In this step, the collection device may include at least one of a set-top box, a sound box, a smart camera and other devices.

Step S204, process the video information and/or audio information received from each client at the same time according to preset rules to obtain shared video and/or shared audio.

In step S206, the shared video and/or shared audio are respectively sent to each client, and the shared video and/or shared audio are played by the client.

In this step, the cloud server can synchronously send the obtained shared video and/or shared audio to each client. In this way, the video and audio heard by the users of each client are the same video and audio, so that the problem of shared delay can be effectively avoided.

Referring to step S204 above, in an embodiment of the present invention, the process of processing the video information and/or audio information received from each client at the same time according to preset rules may be that the video information and/or audio information received from each client at the same time Extract the moving image of the person from the video information of the terminal, combine the moving images of the people corresponding to the extracted video information, so that the moving image of the person exists in the same screen, and/or, combine the images received from each client at the same time Audio information overlay processing. For the specific processing process, reference may be made to the foregoing embodiments, and details are not described here.

In an embodiment of the present invention, if the client finds that the network status of the network it uses has not reached the preset network status through inspection and judgment, it sends a request message for obtaining shared audio to the cloud server. After the cloud server receives the request message from the client to obtain the shared audio, it will send the shared audio obtained by processing the audio information received from each client at the same time according to the preset rules to the client, and the client will analyze the shared audio. to play.

In this embodiment, the network status may include at least one of the current network speed of the network used by the client, network signal strength and the like.

In an embodiment of the present invention, before receiving the video information and/or audio information synchronously uploaded by at least two clients in step S202, the cloud server first receives a sharing request sent by any one of the at least two clients, wherein , the sharing request carries identification information of other clients among the at least two clients. Then the cloud server forwards the received sharing request to other clients corresponding to the identification information, and the other clients determine whether to perform video and/or audio sharing according to the received sharing request. Provide video and/or audio sharing services for at least two clients if receiving sharing determination messages returned by other clients. Here, other clients refer to at least two clients except any client that issues a sharing request.

In an embodiment of the present invention, in order to ensure the security of multiple videos and/or audios during the sharing process, after the cloud server processes the received video information and/or audio information, it can also obtain the shared video and/or audio information. / or shared audio is encrypted, when a newly added client wants to obtain shared video and/or shared audio, it needs to decrypt shared audio and video, so as to obtain shared video and/or shared audio, and can enter Currently sharing video and/or sharing audio.

Based on the same inventive concept, the embodiment of the present invention also provides a device for sharing multiple videos and audios, which is applied to at least two clients, and at least two clients realize the sharing of videos and audios by accessing the cloud server. Fig. 3 shows a schematic structural diagram of multiple video and audio sharing devices according to an embodiment of the present invention. Referring to FIG. 3 , an apparatus 300 for sharing multiple videos and audios includes at least a first receiving module 310 , an uploading module 320 and a sharing module 330 .

The function of each component or device and the connection relationship between each part of the device 300 based on multiple video and audio sharing in the embodiment of the present invention are now introduced:

The first receiving module 310 is adapted to receive video information and/or audio information collected in real time from a collection device; wherein the collection device includes at least one of a set-top box, a sound box, a smart camera, and the like.

The upload module 320 is coupled with the first receiving module 310, and is suitable for synchronously uploading the received video information and/or audio information to the cloud server, and the cloud server analyzes the video information and audio information received from each client at the same time according to preset rules. /or audio information is processed to obtain shared video and/or shared audio;

The sharing module 330 and the uploading module 320 are adapted to receive the shared video and/or shared audio sent by the cloud server, and play the shared video and/or shared audio.

In an embodiment of the present invention, the uploading module 320 is also suitable for extracting dynamic images of people from the video information received from each client at the same time by the cloud server, and merging the dynamic images of people corresponding to the extracted video information. Processing, so that the dynamic images of people exist in the same screen, and/or the cloud server superimposes the audio information received from each client at the same time.

In the embodiment of the present invention, referring to FIG. 4 , multiple video and audio sharing devices 300 include a detection module 340 , a first request module 350 , a second request module 360 and a determination module 370 in addition to the above modules.

The detection module 340 is coupled with the first receiving module 310 and the uploading module 320 respectively, and is suitable for the client to detect the network status of the network it uses, and judge whether the detected network status reaches the preset network status. If not, obtain the received audio information, and upload the audio information to the cloud server. If yes, upload the received video information and audio information to the cloud server synchronously. Wherein, the network status includes at least one of the current network speed and network signal strength of the network used by the client.

The first request module 350, coupled with the detection module 340, is suitable for sending a request message for obtaining shared audio to the cloud server if the network state used by the client does not reach the preset network state, and the cloud server receives it at the same time according to preset rules The audio information from each client is processed to obtain shared audio. In this embodiment, the sharing module 330 is further adapted to receive the shared audio sent by the cloud server, and play the shared audio.

The second request module 360, coupled with the first receiving module 310, is adapted to send any client in at least two clients to the cloud before the first receiving module 310 receives the video information and/or audio information collected in real time from the acquisition device. The server sends a sharing request, wherein the sharing request carries identification information of other clients among at least two clients, and the cloud server sends the sharing request to other clients corresponding to the identification information;

The determining module 370, coupled with the second requesting module 360, is adapted to return a shared confirmation message to the cloud server if other clients receive the sharing request from the cloud server and determine to perform video and/or audio sharing, at least Video and/or audio sharing between two clients.

The embodiment of the present invention also provides another device for sharing multiple videos and audios, which is applied to a cloud server, and at least two clients realize video and audio sharing by accessing the cloud server. Fig. 5 shows a schematic structural diagram of multiple video and audio sharing devices according to another embodiment of the present invention. Referring to FIG. 5 , an apparatus 500 for sharing multiple videos and audios includes at least a second receiving module 510 , a processing module 520 and a sending module 530 .

The function of each component or device and the connection relationship between the various parts of the device 500 based on multiple video and audio sharing in the embodiment of the present invention are now introduced:

The second receiving module 510 is adapted to receive video information and/or audio information synchronously uploaded by at least two clients, wherein the video information and/or audio information are collected in real time by a collection device; wherein the collection device includes a set-top box, a sound box, At least one of smart cameras and more.

The processing module 520, coupled with the second receiving module 510, is adapted to process the video information and/or audio information received from each client at the same time according to preset rules to obtain shared video and/or shared audio;

The sending module 530, coupled with the processing module 520, is adapted to send the shared video and/or shared audio to each client respectively, and the client plays the shared video and/or shared audio.

In an embodiment of the present invention, the processing module 520 is also adapted to extract the dynamic images of people from the video information received from each client at the same time, and combine and process the dynamic images of the people corresponding to the extracted video information, so that The dynamic images of people exist in the same screen, and/or the audio information received from each client at the same time is superimposed and processed.

In an embodiment of the present invention, the second receiving module 510 is further adapted to, if the network state of the network used by the client does not reach the preset network state, receive a request message for obtaining shared audio sent by the client. Wherein, the network status includes at least one of the current network speed and network signal strength of the network used by the client. The sending module 530 is also adapted to send the shared audio obtained by processing the audio information received from each client at the same time according to preset rules to the client, and the client plays the shared audio.

In an embodiment of the present invention, the second receiving module 510 is further adapted to receive a sharing request sent by any one of the at least two clients, wherein the sharing request carries identification information of other clients among the at least two clients . The sending module 530 is further adapted to send the received sharing request to other clients corresponding to the identification information, and the other clients determine whether to perform video and/or audio sharing according to the received sharing request. The second receiving module 510 is further adapted to provide video and/or audio sharing services for at least two clients if a sharing confirmation message returned by other clients is received.

The present invention also provides a system for sharing multiple videos and audios. Referring to FIG. 6, the system 600 for sharing multiple videos and audios may include the above-mentioned multiple video and audio sharing system applied to at least two clients. The device 300 and the device 500 applied to multiple video and audio sharing in the cloud server.

According to still another aspect of the present invention, a computer storage medium is also provided. The computer storage medium stores computer program codes. When the computer program codes are run on the computing device, the computing device is caused to execute multiple video recordings in any of the above-mentioned embodiments. , Audio sharing method.

According to yet another aspect of the present invention, a computing device is also provided, including a processor; a memory storing computer program code; when the computer program code is run by the processor, the computing device is caused to execute multiple functions in any of the above-mentioned embodiments. How to share video and audio.

According to any one of the above preferred embodiments or a combination of multiple preferred embodiments, the embodiments of the present invention can achieve the following beneficial effects:

In the embodiment of the present invention, at first, at least two clients are used to receive video information and/or audio information collected in real time from the acquisition device, and the received video information and/or audio information are synchronously uploaded to the cloud server, and the cloud server The video information and/or audio information received from each client at the same time are processed according to preset rules to obtain shared video and/or shared audio. Finally, at least two clients receive the shared video and/or shared audio sent by the cloud server, and play the shared video and/or shared audio, thereby realizing sharing of video and/or audio among multiple clients. The acquisition device in this embodiment can adopt existing video and audio acquisition equipment, and multiple users install the client on their respective terminals, so that convenient communication and interaction through the client can be realized between multiple users, providing users with Provides a more open way of communication and contact. Moreover, the video and audio sharing solution of the solution of the present invention is not only simple and efficient to implement, but also can be widely used in various application occasions such as teleconferencing, user video or voice communication, and the like.

Furthermore, this solution maximizes the functions of the existing video and audio collection equipment, and improves the use value of the video and audio collection equipment.

Those skilled in the art can clearly understand that for the specific working processes of the above-described systems, devices, and units, reference can be made to the corresponding processes in the foregoing method embodiments, and for the sake of brevity, details are not described here.

In addition, each functional unit in each embodiment of the present invention may be physically independent of each other, or two or more functional units may be integrated together, or all functional units may be integrated into one processing unit. The above-mentioned integrated functional units can be implemented not only in the form of hardware, but also in the form of software or firmware.

Those skilled in the art can understand that: if the integrated functional units are realized in the form of software and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or all or part of the technical solution can be embodied in the form of software products, the computer software products are stored in a storage medium, which includes a number of instructions to make a A computing device (such as a personal computer, a server, or a network device, etc.) executes all or part of the steps of the methods of the embodiments of the present invention when executing instructions. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and various media capable of storing program codes.

Alternatively, all or part of the steps for realizing the foregoing method embodiments may be implemented by program instruction-related hardware (such as a personal computer, server, or computing device such as a network device), and the program instructions may be stored in a computer-readable storage medium , when the program instructions are executed by the processor of the computing device, the computing device executes all or part of the steps of the method in each embodiment of the present invention.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: Within the spirit and principles of the present invention, it is still possible to modify the technical solutions described in the foregoing embodiments, or to perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the corresponding technical solutions deviate from protection scope of the present invention.

The embodiment of the present invention also provides A1, a method for sharing multiple videos and audios, which is applied to at least two clients, and the at least two clients realize the sharing of videos and audios by accessing the cloud server, including:

Receive video information and/or audio information collected in real time from the collection device;

Synchronously upload the received video information and/or audio information to the cloud server, and the cloud server processes the video information and/or audio information received from each client at the same time according to the preset rules to obtain the shared video and/or audio information or share audio;

receiving the shared video and/or shared audio sent by the cloud server, and playing the shared video and/or shared audio.

A2. The method according to A1, wherein the video information and/or audio information received from each client at the same time are processed by the cloud server according to preset rules, including:

The cloud server extracts the dynamic images of people from the video information received from each client at the same time, and merges and processes the dynamic images of people corresponding to the extracted video information, so that the dynamic images of people exist in the same screen; and/ or

The audio information received from each client at the same time is superimposed and processed by the cloud server.

A3, according to the method described in A1 or A2, wherein, if the client receives the video information and audio information collected in real time from the acquisition device, then upload the received video information and/or audio information to the cloud server synchronously, including :

The client detects the network state of the network it uses, and judges whether the detected network state reaches the preset network state;

If not, obtain the received audio information, and upload the audio information to the cloud server;

If yes, upload the received video information and audio information to the cloud server synchronously.

A4. The method according to A3, which also includes:

If the network state used by the client does not reach the preset network state, send a request message for obtaining shared audio to the cloud server, and the cloud server processes the audio information received from each client at the same time according to the preset rules to obtain the shared audio ;

receiving the shared audio sent by the cloud server, and playing the shared audio.

A5. The method according to A3, wherein the network status includes at least one of the current network speed and network signal strength of the network used by the client.

A6, according to the method described in A1 or A2, wherein, before receiving the video information and/or audio information collected in real time from the acquisition device, it also includes:

Any one of the at least two clients sends a sharing request to the cloud server, wherein the sharing request carries identification information of other clients among the at least two clients, and the cloud server sends the sharing request to the cloud server. other clients corresponding to the above identification information;

After the other clients receive the sharing request sent from the cloud server, if it is determined to share video and/or audio, they will return a message of sharing determination to the cloud server, and the video and/or audio sharing will be performed between the at least two clients. and/or audio sharing.

A7. The method according to A1 or A2, wherein the collection device includes at least one of the following: a set-top box, a speaker, and a smart camera.

B8. A method for sharing multiple videos and audios, applied to a cloud server, at least two clients realize sharing of videos and audios by accessing the cloud server, including:

Receiving video information and/or audio information synchronously uploaded by the at least two clients, wherein the video information and/or audio information is collected by a collection device in real time;

Process the video information and/or audio information received from each client at the same time according to preset rules to obtain shared video and/or shared audio;

The shared video and/or shared audio are respectively sent to each client, and the shared video and/or shared audio is played by the client.

B9. The method according to B8, wherein the video information and/or audio information received from each client at the same time are processed according to preset rules, including:

Extract the dynamic images of people from the video information received from each client at the same time, and combine and process the dynamic images of people corresponding to the extracted video information, so that the dynamic images of people exist in the same screen; and/or

The audio information received from each client at the same time is superimposed and processed.

B10. The method according to B8 or B9, further comprising:

If the network state of the network used by the client does not reach the preset network state, receiving a request message for obtaining shared audio sent by the client;

The shared audio obtained by processing the audio information received from each client at the same time according to preset rules is sent to the client, and the shared audio is played by the client.

B11. The method according to B10, wherein the network status includes at least one of the current network speed and network signal strength of the network used by the client.

B12. The method according to B8 or B9, wherein, before receiving the video information and/or audio information uploaded synchronously by the at least two clients, it also includes:

receiving a sharing request sent by any one of the at least two clients, wherein the sharing request carries identification information of other clients of the at least two clients;

forwarding the received sharing request to other clients corresponding to the identification information, and the other clients determine whether to perform video and/or audio sharing according to the received sharing request;

Provide video and/or audio sharing services for the at least two clients if the sharing confirmation message returned by the other clients is received.

B13. The method according to B8 or B9, wherein the collection device includes at least one of the following: a set-top box, a sound box, and a smart camera.

C14. A device for sharing multiple videos and audios, which is applied to at least two clients, and the at least two clients realize sharing of videos and audios by accessing a cloud server, including:

The first receiving module is adapted to receive video information and/or audio information collected in real time from the collection device;

The upload module is adapted to upload the received video information and/or audio information to the cloud server synchronously, and the cloud server processes the video information and/or audio information received from each client at the same time according to preset rules, Get Shared Video and/or Shared Audio;

The sharing module is adapted to receive the shared video and/or shared audio sent by the cloud server, and play the shared video and/or shared audio.

C15. The device according to C14, wherein the upload module is further adapted to:

The cloud server extracts the dynamic images of people from the video information received from each client at the same time, and merges and processes the dynamic images of people corresponding to the extracted video information, so that the dynamic images of people exist in the same screen; and/ or

The audio information received from each client at the same time is superimposed and processed by the cloud server.

C16. The device according to C14 or C15, further comprising:

The detection module is suitable for the client to detect the network state of the network it uses, and judge whether the detected network state reaches the preset network state;

If not, obtain the received audio information, and upload the audio information to the cloud server;

If yes, upload the received video information and audio information to the cloud server synchronously.

C17. The device according to C16, further comprising:

The first request module is adapted to send a request message for obtaining shared audio to the cloud server if the network state used by the client does not reach the preset network state, and the cloud server will compare the information received from each client at the same time according to the preset rules. Audio information is processed to obtain shared audio;

The sharing module is further adapted to receive the shared audio sent by the cloud server, and play the shared audio.

C18. The device according to C16, wherein the network status includes at least one of the current network speed and network signal strength of the network used by the client.

C19. The device according to C14 or C15, further comprising:

The second request module is adapted to send a sharing request to the cloud server from any one of the at least two clients before the first receiving module receives the video information and/or audio information collected in real time from the collection device, wherein , the sharing request carries identification information of other clients among at least two clients, and the cloud server sends the sharing request to other clients corresponding to the identification information;

The determining module is adapted to return a sharing confirmation message to the cloud server if the other client receives the sharing request sent from the cloud server, and the at least two clients video and/or audio sharing between peers.

C20. The device according to C14 or C15, wherein the acquisition device includes at least one of the following: a set-top box, a speaker, and a smart camera.

D21. A device for sharing multiple videos and audios, which is applied to a cloud server, and at least two clients realize the sharing of videos and audios by accessing the cloud server, including:

The second receiving module is adapted to receive the video information and/or audio information synchronously uploaded by the at least two clients, wherein the video information and/or audio information are collected by the collection device in real time;

The processing module is adapted to process the video information and/or audio information received from each client at the same time according to preset rules to obtain shared video and/or shared audio;

The sending module is adapted to send the shared video and/or shared audio to each client respectively, and the client plays the shared video and/or shared audio.

D22. The device according to D21, wherein the processing module is further adapted to:

Extract the dynamic images of people from the video information received from each client at the same time, and combine and process the dynamic images of people corresponding to the extracted video information, so that the dynamic images of people exist in the same screen; and/or

The audio information received from each client at the same time is superimposed and processed.

D23. The device according to D21 or D22, wherein,

The second receiving module is further adapted to receive a request message for acquiring shared audio sent by the client if the network status of the network used by the client has not reached the preset network status;

The sending module is further adapted to send the shared audio obtained after processing the audio information received from each client at the same time according to preset rules to the client, and the client performs the shared audio play.

D24. The device according to D23, wherein the network status includes at least one of the current network speed and network signal strength of the network used by the client.

25. The device according to D21 or D22, wherein,

The second receiving module is further adapted to receive a sharing request sent by any one of the at least two clients, wherein the sharing request carries identification information of other clients of the at least two clients;

The sending module is further adapted to send the received sharing request to other clients corresponding to the identification information, and the other clients determine whether to perform video and/or audio sharing according to the received sharing request;

The second receiving module is further adapted to provide video and/or audio sharing services for the at least two clients if the sharing determination message returned by the other clients is received.

D26. The device according to D21 or D22, wherein the collection device includes at least one of the following: a set-top box, a speaker, and a smart camera.

E27. A computer storage medium, the computer storage medium stores computer program code, and when the computer program code is run on a computing device, it causes the computing device to execute the multiple steps described in any one of A1-A13. How to share video and audio.

F28. A computing device, comprising: a processor; a memory storing computer program code; when the computer program code is executed by the processor, the computing device is caused to execute any one of A1-A13 Multiple video and audio sharing methods.

Claims (10)

1. a kind of shared method of multiple videos, audio, is applied at least two clients, at least two client passes through Access cloud server realize video, audio it is shared, comprising:

Receive the video information acquired in real time from acquisition equipment and/or audio-frequency information；

By the video information received and/or audio-frequency information synchronized upload to the cloud server, by cloud server according to The presetting rule video information and/or audio-frequency information from each client received to synchronization is handled, and is shared Video and/or shared audio；

The shared video and/or shared audio that the cloud server is sent are received, to the shared video and/or shared audio It plays out.

2. according to the method described in claim 1, wherein, by cloud server according to presetting rule it is received to synchronization Lai It is handled from the video information and/or audio-frequency information of each client, comprising:

The dynamic image of people is extracted from the video information from each client that synchronization receives by cloud server, it will The dynamic image merging treatment of the corresponding people of each video information extracted, is present in the dynamic image of people in same picture；With/ Or

The audio-frequency information superposition processing from each client for being received synchronization by cloud server.

3. method according to claim 1 or 2, wherein if client receives the video acquired in real time from acquisition equipment Information and audio-frequency information then wrap the video information received and/or audio-frequency information synchronized upload to the cloud server It includes:

The client detect its use network network state, judge the network state detected whether reach preset it is network-like State；

If it is not, obtaining the audio-frequency information received, the audio-frequency information is uploaded to cloud server；

If so, by the video information received and audio-frequency information synchronized upload to cloud server.

4. according to the method described in claim 3, wherein, further includes:

If the not up to default network state of the network state that client uses, sends to the cloud server and obtains shared audio Request message, carried out by cloud server according to presetting rule audio-frequency information from each client received to synchronization Processing obtains shared audio；

The shared audio that the cloud server is sent is received, the shared audio is played out.

5. according to the method described in claim 3, wherein, the network state includes the current net that the client uses network At least one of speed, network signal intensity.

6. a kind of shared method of multiple videos, audio, is applied to cloud server, at least two clients pass through described in access Cloud server realize video, audio it is shared, comprising:

Receive the video information and/or audio-frequency information that at least two client synchronization uploads, wherein the video information And/or audio-frequency information is collected in real time by acquisition equipment；

It is handled according to the presetting rule video information and/or audio-frequency information from each client received to synchronization, Obtain shared video and/or shared audio；

The shared video and/or shared audio are respectively sent in each client, by the client to the shared view Frequency and/or shared audio play out.

7. the shared device of a kind of multiple videos, audio, is applied at least two clients, at least two client passes through Access cloud server realize video, audio it is shared, comprising:

First receiving module, suitable for receiving the video information acquired in real time from acquisition equipment and/or audio-frequency information；

Uploading module, suitable for by the video information received and/or audio-frequency information synchronized upload to the cloud server, by cloud Hold server according to the presetting rule video information and/or audio-frequency information from each client received to synchronization at Reason obtains shared video and/or shared audio；

Sharing module, suitable for receiving the shared video and/or shared audio that the cloud server is sent, to the shared video And/or shared audio plays out.

8. the shared device of a kind of multiple videos, audio, is applied to cloud server, at least two clients pass through described in access Cloud server realize video, audio it is shared, comprising:

Second receiving module, suitable for receiving the video information and/or audio-frequency information that at least two client synchronization uploads, In, the video information and/or audio-frequency information are collected in real time by acquisition equipment；

Processing module, suitable for according to the presetting rule video information and/or audio from each client received to synchronization Information is handled, and shared video and/or shared audio are obtained；

Sending module, suitable for the shared video and/or shared audio to be respectively sent in each client, by the client The shared video and/or shared audio are played out.

9. a kind of computer storage medium, the computer storage medium is stored with computer program code, when the computer When program code is run on the computing device, the calculating equipment perform claim is caused to require multiple described in any one of 1-5 The shared method of video, audio.

10. a kind of calculating equipment, comprising: processor；It is stored with the memory of computer program code；When the computer program When code is run by the processor, cause the calculating equipment perform claim require multiple videos described in any one of 1-5, The shared method of audio.