CN100421469C - System and method for realizing real-time video information sharing - Google Patents

Abstract

The invention discloses two systems and methods for realizing real-time video information sharing. A video resource index server is set in the system, which is connected to each streaming media server generating real-time video information, and receives and stores the real-time video resources sent by the streaming media server. Information, each client terminal obtains real-time video resource information by accessing the real-time video resource index server, and downloads and plays real-time video information to the corresponding streaming media server according to the real-time video resource information; or each client terminal sends real-time video resource index The server requests the real-time video, and the video resource index server obtains the real-time video from the streaming media server according to the real-time video resource information and forwards it to each client terminal. The two systems and methods for sharing real-time video information of the present invention realize the centralized sharing of various real-time video information, can be applied in various environments, and satisfy users' needs for various real-time video information.

Description

System and method for realizing real-time video information sharing

technical field

The invention relates to the technology of real-time transmission of video information on the network, in particular to a system and method for realizing sharing of real-time video information.

Background technique

At present, the network as the fourth media is bringing people a variety of information, no longer just text, images and simple sound files, but multimedia technologies including audio and video, including radio and television, news clips, etc. Radio, movies, surveillance video, etc. If you want to use these multimedia information, you must realize the transmission of video and audio information on the network. However, with the increasing number of Internet users and the limitations of network hardware devices, the size of media files becomes a problem that cannot be ignored in network transmission. parameter. On the one hand, people hope to see vivid, clear, lively and exciting media presentations on the Internet; on the other hand, people have to face the large amount of time required for media file transmission.

In order to solve this contradiction, a new media technology emerges at the historic moment, and this is the streaming media (StreamMedia) technology, streaming media is also called streaming media. The so-called streaming media refers to the media format played in the IP network by means of streaming, such as audio, video or multimedia files. Streaming media does not download the entire file before playing, but only stores the beginning part of the content in the memory, and caches the data packets in the computer or mobile phone to output the media data correctly. The data stream of streaming media is transmitted at any time and played at any time, but there is some delay at the beginning.

The key technology for the realization of streaming media is streaming transmission. Streaming transmission mainly refers to parsing the entire audio and video and other multimedia files into compressed packets through a specific compression method, and sequentially transmitting them from the streaming media server to the user's computer.

In a system that uses streaming transmission, users don't have to wait until the entire file is downloaded as in the download method, but only need a few seconds or tens of seconds of startup delay to use hardware or software on the user's computer. The decompression device decompresses the compressed audio and video and other multimedia files to play and watch. At this point, the remaining part of the multimedia file will continue to download in the background.

Compared with the simple download method, this streaming transmission method of downloading and playing multimedia files not only greatly shortens the start-up delay, but also greatly reduces the demand for system cache capacity, greatly reducing the waiting time of users .

Real-time transmission of video information can be realized by using streaming media technology, which is currently mainly used in video surveillance systems, see FIG. 1 , which is a schematic structural diagram of a video surveillance system in the prior art. Among them, the streaming media server 102 is connected with a plurality of cameras 101, and video information is obtained through the cameras to generate real-time video streaming data. Streaming media server 102 can be realized by computer, and it can access Internet 110 by modes such as asymmetrical digital subscriber line (Asymmetrical Digital Subscriber Line, ADSL) 103, and remote monitoring terminal 105 is according to the address of streaming media server 102, visits via Internet 110 The streaming media server 102 acquires video information in real time to realize video monitoring.

Although video surveillance has been widely used, all kinds of real-time video resources are basically closed and closed at present. Of course, this is also because the current video surveillance system is mainly used in safe and private places, and it is not allowed to make public decisions. However, with the trend of network entertainment and life, real-time video will not only be mainly used for security monitoring, but also meet people's entertainment and life needs, such as shops, supermarkets, park attractions, and even individuals can share the installed cameras , and anyone can watch the real-time video sent by the shared camera in various places through the network. In this way, enough various real-time video resources can be shared together, so that users can see any shared camera without leaving home. Live video of the location. However, there is no unified and open system and method for centralized sharing of various available real-time video resources to meet the above new requirements.

Contents of the invention

A main purpose of the present invention is to provide a method for sharing real-time video information, so that more users can receive real-time video information.

In order to achieve the above object, the present invention provides a method for sharing real-time video information. The streaming server stores the address information of the streaming server in the real-time video resource information in advance in the video resource index server, and stores the real-time video information in the real-time video resource information. The resource status information is updated to the video resource index server in real time; the process for the client terminal to obtain real-time video information includes the following steps:

A. The client terminal sends a video resource request to the video resource index server;

B. The video resource indexing server receives the video resource request, obtains the real-time video resource information including the address information of the streaming media server and the real-time video resource status information, and returns the real-time video resource information to the client terminal;

C. The client terminal sends a real-time video request to the streaming media server according to the address information and status information in the real-time video resource information;

D. The streaming media server generates real-time video streaming media data from the video information received from the camera device and plays it to the client terminal according to the real-time video request.

Wherein, in the step A, the client terminal can send a video resource request to the video resource index server through the Internet or a local area network;

In the step B, the video resource index server returns the real-time video resource information including the address of the streaming media server to the client terminal through the Internet or local area network;

In the step C, the client terminal sends a real-time video request to the streaming media server through the Internet or a local area network;

In the step D, the streaming media server plays the real-time video streaming media data to the client terminal through the Internet or the local area network.

The video resource index server can run WWW service to display real-time video resource information with a web page; the client terminal uses a WEB browser to access the video resource index server through the Internet;

The video resource index server communicates with the streaming media server through TCP/IP protocol or SIP protocol.

The real-time video resource information may further include: one or more of real-time video resource location information, real-time video resource category information, and real-time video resource manipulation information.

When the real-time video resource information includes the real-time video resource location information: the video resource index server indexes the real-time video resource location information, and according to the location information, the real-time video resource is associated with the location on the map, and will The map with real-time video resources marked corresponding to the location is included in the real-time video resource information and sent to the client terminal;

When the real-time video resource information includes real-time video resource category information: the video resource index server performs indexing according to the real-time video resource category information, generates a real-time video resource index directory, and includes the directory in the real-time video resource information and sends it to the client terminal;

When the real-time video resource information includes real-time video resource control information: in the step B, the video resource index server sends a video control interface to the client terminal for the real-time video resource in a controllable state, receives a control command input by the user, and The manipulation instruction is transmitted to the streaming media server, and the streaming media server performs corresponding manipulation on the camera device corresponding to the real-time video resource according to the manipulation instruction.

The method that the streaming media server stores the status information of the real-time video resource to the video resource index server can be:

The streaming media server receives the status information request sent by the video resource index server at a preset time interval, and returns the status information to the video resource index server according to the request; the video resource index server uses the received status information to update;

Or when the status information of the real-time video resource changes, the streaming media server updates the latest real-time video resource status information to the video resource index server.

The real-time video resource status information may include whether the resource is available, the current number of visitors or load information of the real-time video resource, and the real-time summary picture of the real-time video resource;

In the step B, when the video resource indexing server receives the request of the real-time video resource, it first detects the number of visitors or the load of the real-time video resource; Request a real-time summary picture from the streaming media server; and after receiving the real-time summary picture returned by the streaming media server, add it to the real-time video resource status information and send it to the user terminal;

When detecting that the number of visitors or the load falls below the preset upper limit, the video resource index server notifies the client terminal to obtain real-time video streaming data from the streaming server.

In the step B, before the video resource index server requests the real-time summary picture from the streaming media server at a certain time interval, the video resource index server can correspond to the latest one or more pictures and display pictures of the real-time video resource currently stored. The time is sent to the user terminal.

The real-time video resource status information may also include whether the resource is available and the current number of visitors or load information of the real-time video resource;

When the streaming media server detects that the number of visitors or the load reaches a preset upper limit, or after playing the streaming media data for a certain period of time, it will instead send real-time pictures to the client terminal at a certain time interval.

The client terminal may include an instant state client unit;

Described instant state client unit records the instant state service identification information of each real-time video resource state, and subscribes the state information of the real-time video resource corresponding to the identification information on the video resource index server; The media server sends a real-time video request;

The video resource index server further receives the subscription request of the instant state client unit of the client terminal, and according to the request, returns the state information of the real-time video resource subscribed by the client terminal to the instant state client unit in the client terminal;

In said step D, the streaming media server plays real-time video streaming media data to the instant state client unit in the client terminal.

The system can further include an instant status server; the video resource index server and the client terminal respectively include an instant status client unit;

The instant state client unit in the video resource index server registers and stores each real-time video resource information on the instant state server in advance, and accepts the instant state service identification information distributed by the instant state server, and the video resource index server constantly updates each The status information of the real-time video resource is updated to the instant status server;

The instant state client unit in the client terminal pre-records the instant state service identification information of each real-time video resource state, and subscribes to the instant state server the state information of the real-time video resource corresponding to the identification information;

After the instant state server receives the subscription request of the instant state client unit in the client terminal, according to the request, the state information of the real-time video resources subscribed by the client terminal is returned to the instant state client unit in the client terminal;

In said step D, the streaming media server plays real-time video streaming media data to the instant state client unit in the client terminal.

The method may further include: when a real-time video resource is being manipulated, the video resource index server sets the manipulation information of the real-time video resource to a locked state, and rejects manipulation instructions sent by other client terminals.

The camera device may include a track and a camera that can run on the track, and the manipulation instruction also includes a manipulation command to run on the track;

The streaming media server performs on-orbit operation control on the camera of the camera device corresponding to the real-time video resource according to the control instruction.

The video resource index server can further store one or more video advertisement data;

In the step B, when the real-time video resource index server returns the real-time video resource information to the client terminal, it notifies the client terminal to first download a video advertisement data from the real-time video resource index server;

In the step C, the client terminal downloads the video advertisement data to the real-time video resource index server according to the notification, and sends a real-time video request to the streaming media server according to the real-time video resource information while or after playing the video advertisement data.

The real-time video resource information may also include real-time video resource type information, and each stored video advertisement data is related to at least one of the types;

In the step B, the real-time video resource index server selects one of the video advertisement data related to the type of real-time video resources requested by the client terminal, and notifies the client terminal to download the video advertisement data.

One or more advertising video servers that store video advertising data can be further set in the system; each advertising video server is connected to the video resource index server, and the video resource index server stores the address information of each advertising video server;

In the step B, after receiving the video resource request sent by the client terminal, the video resource index server forwards the request and real-time video resource information to an advertising video server, and sends the address information of the advertising video server to the client terminal;

The step B also includes: the client terminal downloads the video advertisement data to the advertisement video server according to the address information of the advertisement video server, and receives the real-time video resource information sent by the advertisement video server after the video advertisement data is downloaded;

In the step C, the client terminal sends a real-time video request to the streaming media server according to the real-time video resource information received from the advertising video server.

Can further include in the system: a mobile communication terminal with a camera;

The mobile communication terminal with the camera and the streaming media server establish a streaming media data transmission channel via the WAP gateway in the mobile communication network, and upload the real-time video data captured by the camera to the streaming media server through the data transmission channel.

The real-time video request sent by the client terminal may include address information of the client terminal;

The step D is: the streaming media server compresses and encodes the video information received from the camera device into a streaming media format according to the address information in the real-time video request, and if the camera device includes a pickup, the streaming media server also compresses and encodes the audio together , generate real-time video streaming data to play to the client terminal.

Said step D may comprise:

D1, the streaming media server acquires video information from the camera device;

D2, the streaming media server establishes a signaling channel with the client terminal, and sends the playback address and port number to the client terminal;

D3. The client terminal establishes a data channel with the streaming media server;

D4. After the streaming media server generates video streaming media data from the video information, it is sent to the client terminal through the data channel;

D5. The client terminal receives the streaming media data for display and playback.

In the step D2, the streaming media server can send the multicast address and the port number to the client terminal;

In described step D4, stream media server sends real-time video stream media data to the router in Internet or local area network; send.

In the step A, before the client terminal sends a video resource request to the real-time video resource index server, the authentication step can be performed first. After the authentication is passed, the account number is recorded, and the real-time video resource index server starts to charge the account, and generates CDR bill record.

CDR bills can be generated according to different billing strategies; if billing by time and flow is adopted, the streaming media server will report the client to the video resource index server when it finishes sending real-time video streaming data to the client terminal. Real-time video time and traffic information, based on which the video resource index server generates CDR bill records.

It can be seen from the above technical solutions that the first system and method for realizing real-time video information sharing of the present invention is to set a video resource index server in the system, which is connected to each streaming server that generates real-time video information, receives and stores the stream For the real-time video resource information sent by the media server, each client terminal obtains the real-time video resource information by accessing the real-time video resource index server, and downloads and plays the real-time video information to the corresponding streaming media server according to the real-time video resource information, realizing various Centralized sharing of real-time video information.

Description of drawings

Fig. 1 is the structural representation of prior art video monitoring system;

Fig. 2 is the structural representation of the real-time video sharing system of the first preferred embodiment of the present invention;

Fig. 3 is in the embodiment shown in Fig. 2, does not include the processing flow that realizes real-time video sharing under the situation of advertising video server;

Fig. 4 is in the embodiment shown in Fig. 2, comprises the processing flow that realizes real-time video sharing under the situation of advertising video server;

Fig. 5 is in the embodiment shown in Fig. 2, the concrete processing procedure that client terminal downloads real-time video data to stream media server;

6 is a schematic structural diagram of a real-time video sharing system in a second preferred embodiment of the present invention;

Fig. 7 is in the embodiment shown in Fig. 6, the processing flow of client terminal subscribing to real-time video status information;

8 is a schematic structural diagram of a real-time video sharing system according to a third preferred embodiment of the present invention;

9 is a schematic structural diagram of a real-time video sharing system according to a fourth preferred embodiment of the present invention;

FIG. 10 is a processing flow for realizing real-time video sharing in the embodiment shown in FIG. 9 .

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and examples. "Real-time" in the real-time video mentioned in the present invention is broad, not only absolutely real-time, but also includes quasi-real-time, and real-time video has a certain delay in application, but within a certain range, such as a few seconds Or a delay of several minutes is acceptable. The two systems and methods for realizing real-time video information sharing provided by the present invention will be described respectively below.

In the first system and method for realizing real-time video information sharing of the present invention, a video resource index server is set in the system to receive and store the real-time video resource information sent by the streaming media server, and each client terminal accesses the real-time video resource index server, To obtain real-time video resource information, and according to the real-time video resource information to the corresponding streaming media server to download and play the real-time video information, realizing the centralized sharing of various real-time video information.

The second system and method for realizing real-time video information sharing of the present invention also sets a video resource index server in the system to receive and store the real-time video resource information sent by the streaming media server, and each client terminal requests the real-time video resource index server For real-time video, the video resource index server obtains real-time video from the streaming media server according to the real-time video resource information and forwards it to each client terminal, realizing the centralized sharing of various real-time video information.

Firstly, three preferred embodiments are given to describe the first system and method for realizing real-time video information sharing in detail.

Referring to FIG. 2 , FIG. 2 is a schematic structural diagram of a real-time video sharing system according to a first preferred embodiment of the present invention. The system includes: a camera 201 , a streaming media server 202 , a video resource index server 203 , a client terminal 204 and an optional advertising video server 205 .

The streaming media server 202 is connected with one or more camera devices 202, stores the real-time video resource information containing the address of the streaming media server to the video resource index server 203; The video information generates real-time video streaming data, and plays the real-time video streaming data to the client terminal 204 through the Internet 210 .

The video resource index server 203 is connected with one or more streaming media servers 202 respectively, stores the real-time video resource information received from each streaming media server; receives the video resource request sent by the client terminal 204 through the Internet 210, and according to user needs, will include The real-time video resource information of the streaming media server address is returned to the client terminal 204 through the Internet 210 .

The client terminal 204 sends a video resource request to the video resource index server 203 through the Internet 210 according to user needs, receives the real-time video resource information returned by the video resource index server 203, and sends real-time video resource information to the streaming media server 202 according to the address information in the real-time video resource information. video request, and receive the real-time video streaming data played by the streaming server 202.

The advertising video server 205 in this embodiment is an optional device, which may or may not exist in the system, and may have one or more. When the system includes advertising video servers 205, each advertising video server 205 is connected to the video resource index server 203, and the video resource index server 203 stores the address information of each advertising video server. In this situation:

After receiving the video resource request sent by the client terminal 204 , the video resource index server 203 forwards the request and real-time video resource information to an advertising video server 205 , and sends the address information of the advertising video server to the client terminal 204 .

Client terminal 204 downloads video advertisement data to described advertisement video server 205 earlier by Internet 210, and receives the real-time video resource information that advertisement video server 205 sends after video advertisement data downloads by Internet 210; Server 202 sends a real-time video request.

In this embodiment, the client terminal 204 communicates with the video resource index server 203 and the streaming media server 202 through the Internet 210. In practical applications, it can also communicate through a local area network or other networks. In this embodiment, the streaming media server 202, the video resource index server 203, and the advertisement video server 205 can all communicate through network communication protocols such as TCP/IP protocol or SIP protocol.

Referring to FIG. 3 , FIG. 3 is a processing flow for realizing real-time video sharing in the embodiment shown in FIG. 2 without an advertising video server. The process includes the following steps:

Step 301, the client terminal sends a video resource request to the video resource index server.

In step 302, the video resource index server receives the video resource request, obtains real-time video resource information including the address information of the streaming media server, and returns the real-time video resource information to the client terminal.

Step 303, the client terminal sends a real-time video request to the streaming media server according to the address information in the real-time video resource information.

Step 304, the streaming media server collects video information from the camera device according to the real-time video request, and generates real-time video streaming data from the video information.

In this step, the streaming media server can compress and encode the video information received from the camera device into a streaming media format. If the camera device includes a pickup, the streaming media server will also compress and encode the audio together to generate real-time video streaming data.

Step 305, the streaming media server plays the real-time video streaming data to the client terminal.

In this embodiment, the real-time video request sent by the client terminal may include the address information of the client terminal. This step may be: the streaming media server plays real-time video streaming data to the client terminal according to the address information in the real-time video request.

In this embodiment, the real-time video resource information stored and sent by the video resource index server to the client terminal may include, in addition to the address information of the streaming media server, real-time video resource status information, real-time video resource location information, real-time video One or more of resource category information and real-time video resource manipulation information.

When the real-time video resource information includes the status information of the real-time video resource: the streaming media server further updates the status information of the real-time video resource to the video resource index server in real time; The address information and status information of the streaming media server sends a real-time video request.

Wherein, the method for the streaming media server to store the status information of the real-time video resources in the video resource index server may be as follows: the streaming media server receives the status information request sent by the video resource index server at a preset time interval, and sends a request to the video resource according to the request The index server returns status information; the video resource index server updates with the received status information. Or, when the state information of the real-time video resource changes, the streaming media server updates the latest real-time video resource state information to the video resource index server.

In this embodiment, the real-time video resource status information may include whether the resource is available, the current number of visitors or load information of the real-time video resource, and the real-time summary picture of the real-time video resource. In the above step 302, the video resource index server receives the real-time When requesting a video resource, first detect the number of visitors or the load of the real-time video resource; when it is detected that the number of visitors or the load reaches the preset upper limit, request a real-time summary picture from the streaming media server at a certain time interval; and when receiving After the real-time summary picture returned by the streaming media server, add it to the real-time video resource status information and send it to the user terminal; when the number of visitors or the load drops below the preset upper limit, the video resource index server notifies the client terminal to the streaming media server Get real-time video streaming data.

In practical applications, before the video resource index server requests real-time summary pictures from the streaming media server at a certain time interval, the video resource index server can store the latest one or more pictures of the real-time video resource currently stored, and display the pictures corresponding to The time is sent to the user terminal.

In this embodiment, the real-time video resource status information may only include whether the resource is available and the current number of visitors or load information of the real-time video resource; when the streaming media server detects that the number of visitors or the load reaches a preset upper limit, or After playing streaming media data for a certain period of time, real-time pictures are sent to the client terminal at certain intervals instead.

When the real-time video resource information includes the location information of the real-time video resource: the video resource indexing server performs indexing according to the location information of the real-time video resource, and according to the location information, associates the real-time video resource with the location on the map, and in the above step 302 , the map with the real-time video resource marked at the corresponding position is included in the real-time video resource information and sent to the client terminal;

When the real-time video resource information includes real-time video resource category information: the video resource indexing server performs indexing according to the real-time video resource category information, generates a real-time video resource index directory, and in the above step 302, includes the directory in the real-time video resource information sent to the client terminal;

When the real-time video resource information includes real-time video resource control information: in the above step 302, the video resource index server also sends the video control interface to the client terminal for the real-time video resource in the controllable state, receives the control command input by the user, and The instruction is sent to the streaming media server, and the streaming media server performs corresponding manipulation on the camera device corresponding to the real-time video resource according to the manipulation instruction.

For example: the camera device includes a track and a camera that can run on the track, then the control instruction includes a control command that runs on the track, and the streaming media server performs a track on the camera of the camera device corresponding to the real-time video resource according to the control command. Run the controls.

In addition, when a real-time video resource is being manipulated, the video resource index server can set the manipulation information of the real-time video resource to a locked state, and reject manipulation instructions sent by other client terminals.

In this embodiment, if the advertisement video server is not included, the video resource server may first play the video advertisement data, and then request the real-time video.

Specifically, one or more video advertisement data may be stored in the video resource index server. In the above step 302, when the real-time video resource index server returns the real-time video resource information to the client terminal, it notifies the client terminal to first download a video advertisement data from the real-time video resource index server. After step 302 and before step 303, the client terminal first downloads the video advertisement data to the real-time video resource index server according to the notification, and executes step 303 while playing the video advertisement data or after playing the video advertisement data.

If the real-time video resource information also includes the type information of the real-time video resource, each stored video advertisement data can be related to at least one type, so that in the above step 302, the real-time video resource index server can request from the client terminal Select one of the video advertisement data related to the type of real-time video resources, and notify the client terminal to download the video advertisement data.

Furthermore, in this embodiment, billing can also be implemented for users who use the video sharing service. The specific method is:

In the above step 301, before the client terminal sends the video resource request to the real-time video resource index server, the authentication step can be performed first: the client terminal first sends the account password to the video resource index server, and the video resource index server compares it with the saved account number The password information is checked and authenticated. After the authentication is passed, the account number is recorded, the account is billed, and a CDR record is generated. In this embodiment, CDR bills can be generated according to different charging policies. There are many charging policies, such as monthly charging, or per-use charging, or time-based traffic charging. If the time-based flow billing method is adopted, the streaming media server will send real-time video streaming data to the client terminal at the end, that is, when the client terminal closes the real-time video connection, it will report to the video resource index server that the client is playing real-time video The time and flow information of the video resource index server generates a CDR bill record based on this. Of course, different charging policies can also be set for different real-time video resources.

Referring to FIG. 4 , FIG. 4 is a processing flow for realizing real-time video sharing in the case of an advertising video server in the embodiment shown in FIG. 2 . The process includes the following steps:

Step 401, the client terminal sends a video resource request to the video resource index server.

Step 402, the video resource index server receives the video resource request, obtains real-time video resource information including the address information of the streaming media server, and forwards the request and the real-time video resource information to an advertising video server.

Step 403, the video resource index server sends the address information of the advertising video server to the client terminal.

Step 404, the client terminal downloads the video advertisement data from the advertisement video server according to the address information of the advertisement video server, and receives the real-time video resource information sent by the advertisement video server after the video advertisement data is downloaded.

Step 405, the client terminal sends a real-time video request to the streaming server according to the address information of the streaming server in the real-time video resource information received from the advertising video server.

Step 406, the streaming media server collects video information from the camera device according to the real-time video request, and generates real-time video streaming data from the video information.

Step 407, the streaming media server plays the real-time video streaming data to the client terminal.

In this embodiment, streaming media is played in a multicast manner, and routers in the network can copy data packets to multiple channels at one time, so that a single server can simultaneously and continuously send data streams to multiple client terminals. The streaming server only needs to send one information packet, not multiple, and all requesting client terminals share the same information packet. Streaming media data can be sent to client terminals at any address, which can reduce the total amount of information packets transmitted on the network. Therefore, the network utilization efficiency can be greatly improved, and the cost can be greatly reduced. Moreover, multiple client terminals request real-time video. Even if the client terminals do not access the streaming server at the same time, the streaming server can play the same content to each client terminal. This feature makes the real-time video service very suitable for multicasting.

Refer to FIG. 5 for the specific method. FIG. 5 is a specific processing flow of downloading real-time video data from the client terminal to the streaming media server in the embodiment shown in FIG. 2 . The process includes the following steps:

Step 501, the streaming media server starts a video thread to collect video information.

In this embodiment, the streaming media server can simultaneously start two threads of video and audio to collect the video and audio respectively, and put them into the video (audio) buffer.

Step 502, the streaming media server receives the connection request sent by the client terminal, and establishes a TCP connection signaling channel.

Step 503, the streaming media server sends the multicast address and port number to the client terminal through the signaling channel.

In this embodiment, if there is both video and audio, two sets of multicast addresses and port numbers are sent, corresponding to the two threads of video and audio respectively.

Step 504, after receiving the multicast address and port number, the client terminal starts a video receiving thread.

If there is both video and audio, start two receiving threads for video and audio.

Step 505, the client terminal establishes a UDP data channel with the streaming media server.

In step 506, the streaming media server compresses and codes the video (audio) and sends it to the client terminal through multicasting through the established UDP data channel.

Step 507, the client terminal receives the compressed video package and decodes it for display and playback.

Of course, in practical applications, streaming media data can also be played in a unicast manner. The specific process is basically the same as that shown in FIG.

This embodiment can be implemented in the form of Internet WEB. The video resource index server runs WWW service to display real-time video resource information on the webpage, and the user uses a WEB browser on the client terminal to access the video resource index server through the Internet. In addition, each real-time video resource can also correspond to a BBS forum. When the video resource index server displays the real-time video resource information, it also displays the information corresponding to the real-time video resource on the BBS forum, such as user message records.

The first system and method for realizing real-time video information sharing of the present invention can also be realized by means of instant status business integration, which can be realized in two specific ways. For the first realization method, refer to FIG. 6 , which is a diagram of the present invention A schematic structural diagram of the real-time video sharing system of the second preferred embodiment. This embodiment is improved on the basis of the first preferred embodiment shown in FIG. 2 . This system structure is basically the same as the system structure and function described in Fig. 2, the difference is: the instant status server 606 connected with the video resource index server 203 is set in the system, and the instant status client unit is set at the video resource index server 203 607, setting up the instant status client unit 600 in each client terminal 204.

The streaming media server 202 in the present embodiment, except having the function in the first embodiment, also further updates the status information of the real-time video resource to the video resource index server 203 in real time; The presence client unit 600 plays real-time video streaming data.

The video resource index server 203 in the present embodiment, except having the function in the first embodiment, wherein the real-time status client unit 607 registers and stores the name, geographic location, etc. of each real-time video resource on the real-time status server 606 information, and accept the real-time status service identification information assigned by the real-time status server 606, and the video resource index server 203 constantly updates the status information of each real-time video resource to the real-time status server 606 through the real-time status client unit 607. The instant presence service identification information here may be an instant presence service number or a uniform resource identifier URI, for example: SIP: video8@abcd.com.

The instant status client unit 600 in the client terminal 204 records the instant status service identification information of each real-time video resource state, for example: the instant status service number or the uniform resource identification URI of the corresponding real-time video resource is added to the contact list, and the instant status The server 606 subscribes to the status information of the real-time video resource corresponding to the identification information, and the client terminal 204 requests the video resource according to the service identification information.

The instant status server 606 receives the subscription request of the instant status client unit 600 in the client terminal 204, and returns the status information of the real-time video resource subscribed by the client terminal 600 to the instant status client unit 600 in the client terminal 204 according to the request.

The working principles and implementation methods of other devices in this embodiment are exactly the same as those in the embodiment shown in FIG. 2 , and will not be repeated here. The following only describes the method for the client terminal to subscribe to real-time video status information:

Referring to FIG. 7 , FIG. 7 is a processing flow of a client terminal subscribing to real-time video status information in the embodiment shown in FIG. 6 . The process includes the following steps:

Step 700, the video resource index server obtains video resource status information from the streaming media server in real time.

Step 701, the video resource index server sends the obtained video resource status information to the instant status server in real time.

Step 702, the instant status server updates and stores the status information of each real-time video resource.

Step 703, the instant status client unit in the client terminal sends a request to subscribe to real-time video status information to the instant status server.

Step 704, the instant status server returns real-time video status information to the instant status client unit in the client terminal in a subscription manner. For example: it can be returned at regular intervals, or it can be returned when the status information changes.

Refer to FIG. 6 for the second implementation mode using instant status service integration. The difference between this mode and that shown in FIG. Specifically:

The instant status client unit 600 in the client terminal 204 records the instant status service identification information of each real-time video resource state, and subscribes the status information of the real-time video resource corresponding to the identification information on the video resource index server 203; The status information sends a real-time video request to the streaming media server 202 .

The video resource index server 203 further receives the subscription request of the instant state client unit 600 of the client terminal 204, and according to the request, the state information of the real-time video resource subscribed by the client terminal 204 is returned to the instant state client unit 600 in the client terminal 204 .

The streaming server 202 plays real-time video streaming data to the instant presence client unit 600 in the client terminal 204 .

Referring to FIG. 8, FIG. 8 is a schematic structural diagram of a real-time video sharing system according to a third preferred embodiment of the present invention. This embodiment is also improved on the basis of the first preferred embodiment shown in FIG. 2 . The structure and function of the system are basically the same as those described in FIG. 2 , except that the system also includes a mobile communication terminal 802 with a camera 801 .

The mobile communication terminal 802 with the camera 801 and the streaming media server 202 set up a streaming media data transmission channel through the WAP gateway 803 in the mobile communication network, and the mobile communication terminal 802 passes the real-time video data taken by the camera 801 through the data transmission channel , upload to the streaming media server 202.

When the mobile communication terminal 802 sends streaming media to the streaming media server 202 and starts, it sends information such as the title and description of the real-time video, and the streaming media server 202 will receive the streaming media and mobile communication terminal number and the title and description of the above-mentioned real-time video. The information is associated and saved, and the above information such as the mobile communication terminal number is stored in the video resource index server 203 as real-time video resource information.

The working principles and implementation methods of other devices in this embodiment are exactly the same as those in the embodiment shown in FIG. 2 , and will not be repeated here.

Then, a preferred embodiment is given to describe the second system and method for realizing real-time video information sharing in detail.

This embodiment provides real-time video services through multimedia messaging (MMS). Referring to FIG. 9, FIG. 9 is a schematic structural diagram of a real-time video sharing system according to a fourth preferred embodiment of the present invention. The system comprises camera 201, streaming media server 202, video resource index server 203, client terminal 204 and optional advertisement video server 205, streaming media server 202 is connected with one or more camera devices 201, and video resource index server 203 passes The short message center 901 and the multimedia message center 902 in the mobile communication network are connected with the mobile communication terminal 204 .

Wherein, the streaming server 202 stores the real-time video resource information including the address of the streaming server into the video resource index server 203; and after receiving the real-time video request, generates real-time video streaming data from the video information received by the camera 201 , and send the real-time video stream media data to the multimedia message center 902 in the mobile communication network through the video resource server 203,

The video resource index server 203 is connected with one or more streaming media servers 202 respectively, stores the real-time video resource information received from each streaming media server 202; receives the real-time video request forwarded by the short message center 901, and obtains the real-time video resource information according to user needs , and forward to the corresponding streaming server 202 according to the address information in the real-time video resource information, and receive real-time video streaming data from the streaming server 202 and forward it to the multimedia message center 902 in the mobile communication network;

The short message center 901 receives the real-time video request short message sent by the mobile communication terminal 204 , converts the short message into data that the video resource index server 203 can receive, and forwards it to the video resource index server 203 .

The multimedia message center 902 receives the real-time video streaming data sent by the streaming server 202 , converts it into a multimedia message, and sends it to the mobile communication terminal 204 .

The mobile communication terminal 204 directly sends a real-time video request to the video resource index server 203 through the short message center 901 according to user needs, and receives real-time video stream media data forwarded by the video resource index server 203 through the multimedia message center 902 .

Same as the above-mentioned embodiments shown in FIG. 2 , FIG. 6 , and FIG. 8 , the advertising video server 205 in this embodiment is also an optional device, which may or may not exist in the system, and may have one or more. When the system includes advertising video servers 205, each advertising video server 205 is connected to the video resource index server 203, and the video resource index server 203 stores the address information of each advertising video server. In this situation:

After the video resource index server 203 receives the real-time video request sent by the mobile communication terminal 204 through the short message center 901, the request is forwarded to an advertisement video server 205; and after receiving the notification that the advertisement video server 205 has sent the advertisement data, The real-time video resource information is obtained according to the needs of the user, and the real-time video request is forwarded to the corresponding streaming media server 202 according to the address information in the real-time video resource information.

The advertisement video server 205 sends the video advertisement data to the mobile communication terminal 204 through the video resource index server 203 and the multimedia message center 902, and notifies the video resource index server 203 after the video advertisement data is sent.

After the mobile communication terminal 204 receives the video advertisement data sent by the advertisement video server 205 through the multimedia message center 902 , it receives the real-time video streaming data played by the streaming media server 202 through the multimedia message center 902 .

In this embodiment, the client terminal 204 communicates with the video resource index server 203 and the streaming media server 202 through a mobile communication network. In practical applications, it can also communicate through other networks. In this embodiment, the streaming media server 202, the video resource index server 203 and the advertising video server 205 can also communicate through network communication protocols such as TCP/IP protocol or SIP protocol.

Likewise, the system of this embodiment may also include a mobile communication terminal with a camera (not shown in FIG. 9 ). The method for the mobile communication terminal to upload real-time video data to the streaming media server is exactly the same as the embodiment shown in FIG. 8 , and will not be repeated here.

Referring to FIG. 10 , FIG. 10 is a processing flow for realizing real-time video sharing in the embodiment shown in FIG. 9 . This process is the processing process when the system does not contain an advertising video server, and specifically includes the following steps:

Step 10, the mobile communication terminal sends a real-time video request short message to the short message center in the mobile communication network.

Step 11: The short message center converts the real-time video request short message into data that can be received by the video resource index server, and forwards it to the video resource index server.

Step 12, the video resource index server obtains the real-time video resource information including the address information of the streaming media server, and sends a real-time video request to the streaming media server according to the real-time video resource information.

Step 13, the streaming server The streaming server generates real-time video streaming data from the video information received from the camera device and returns it to the video resource index server according to the real-time video request.

Step 14, the video resource index server returns real-time video stream media data to the multimedia message center through the MM7 interface.

Step 15, the multimedia message center converts the real-time video streaming data into a multimedia message and sends it to the mobile communication terminal.

Similarly, in this embodiment, in the case that the system does not include an advertisement video server, the video resource index server can also realize playing video advertisements. The specific method is:

One or more pieces of video advertisement data are further stored by the video resource index server. In the above step 12, the real-time video resource indexing server first returns a video advertisement data to the mobile communication terminal through the multimedia message center, and forwards the real-time video request to the streaming media server according to the real-time video resource information while playing the video advertisement data or after playing.

In this case, the type information of the real-time video resource can also be included in the real-time video resource information, and each video advertisement data stored is related to at least one type; Select one of the video advertisement data related to the type of the requested real-time video resource and send it to the client terminal.

It can be seen from the above embodiments that the two systems and methods for realizing real-time video information sharing of the present invention realize the centralized sharing of various real-time video information, can be applied in various environments, and satisfy users' requirements for various real-time video information. demand.

Claims (22)

1. method that realizes the real-time video information sharing, it is characterized in that: streaming media server has stored the streaming media server address information in the real-time video resource information into the video resource index server in advance, and the real-time video resource state information real-time update in the real-time video resource information is arrived the video resource index server; The process that client terminal obtains real-time video information may further comprise the steps:

A, client terminal send the video resource request to the video resource index server;

B, video resource index server receive the video resource request, obtain to comprise the real-time video resource information of streaming media server address information and real-time video resource state information, and this real-time video resource information is returned to client terminal;

C, client terminal send the real-time video request according to address information in this real-time video resource information and state information to streaming media server;

D, streaming media server will generate the real-time video stream medium data and play to client terminal according to the real-time video request from the video information that camera head receives.

2. the method for claim 1 is characterized in that:

In the described steps A, client terminal sends the video resource request by internet or local area network (LAN) to the video resource index server;

Among the described step B, the video resource index server returns to client terminal by the real-time video resource information that described internet or local area network (LAN) will comprise the streaming media server address;

Among the described step C, the real-time video request that client terminal sends to streaming media server by internet or local area network (LAN);

Among the described step D, streaming media server plays to client terminal by described internet or local area network (LAN) with the real-time video stream medium data.

3. method as claimed in claim 2 is characterized in that: described video resource index server operation WWW service is with web displaying real-time video resource information; Described client terminal uses the WEB browser by access to the Internet video resource index server;

The video resource index server is communicated by letter with streaming media server by ICP/IP protocol or Session Initiation Protocol.

4. the method for claim 1 is characterized in that, described real-time video resource information further comprises: real-time video resource location information, real-time video resource class information, real-time video resource are controlled one or more in the information.

5. method as claimed in claim 4 is characterized in that:

When described real-time video resource information comprised real-time video resource location information: the video resource index server carried out index by real-time video resource location information, and by described positional information, position on real-time video resource and the map is mapped, and will be included in the real-time video resource information at the map that correspondence position has marked the real-time video resource and sends to client terminal;

When described real-time video resource information comprised real-time video resource class information: the video resource index server carried out index by real-time video resource class information, generate real-time video resource index catalogue, this catalogue is included in the real-time video resource information sends to client terminal;

Described real-time video resource information comprises when the real-time video resource is controlled information: among the described step B, the video resource index server is to controlling the real-time video resource of state, send the video operation and control interface to client terminal, receive the instruction of controlling of user's input, and will control the instruction send streaming media server to, streaming media server is controlled instruction according to this camera head of real-time video resource correspondence is controlled accordingly.

6. the method for claim 1 is characterized in that, described streaming media server with real-time video state of resources information stores to the method for video resource index server is:

The state information request that described streaming media server receiver, video resource index server sends by pre-set time interval is asked to video resource index server return state information according to this; The video resource index server upgrades with the state information that receives;

Or when real-time video state of resources information changed, described streaming media server upgraded up-to-date real-time video resource state information to the video resource index server.

7. method as claimed in claim 6 is characterized in that: described real-time video resource state information comprises whether resource is available, the real-time summary picture of this real-time video resource current accessed number or information on load and this real-time video resource;

Among the described step B, when the video resource index server receives the request of real-time video resource, detect the number of visiting people or the load of this real-time video resource earlier; Reach predefined and go up in limited time when detecting the number of visiting people or load, by certain hour at interval to the streaming media server request picture of making a summary in real time; And after receiving the real-time summary picture that streaming media server returns, it is added real-time video resource state information send to user terminal;

Drop to and be lower than predefined going up in limited time when detecting the number of visiting people or load, video resource index server notice client terminal obtains the real-time video stream medium data to streaming media server.

8. method as claimed in claim 7, it is characterized in that: among the described step B, the video resource index server by certain hour at interval before picture is made a summary in the streaming media server request in real time, the video resource index server sends to user terminal with up-to-date one or more picture, the time corresponding that Shows Picture of this real-time video resource of current storage.

9. method as claimed in claim 6 is characterized in that: described real-time video resource state information comprises resource whether available and this real-time video resource current accessed number or information on load;

Reach predefined and go up in limited time when described streaming media server detects the number of visiting people or load, or behind the play stream media data certain hour, change into by certain hour and send real time picture to client terminal at interval.

10. the method for claim 1, it is characterized in that: described client terminal comprises the immediate status client unit;

Described immediate status client unit writes down the immediate state service identification information of each real-time video resource status, and subscribes to the real-time video state of resources information of this identification information correspondence to the video resource index server; Send the real-time video request according to real-time video state of resources information to streaming media server;

Described video resource index server further receives the subscribe request of the immediate status client unit of client terminal, and according to this request, the real-time video state of resources information that client terminal is subscribed to returns to the immediate status client unit in the client terminal;

Among the described step D, the immediate status client unit of streaming media server in client terminal play the real-time video stream medium data.

11. the method for claim 1 is characterized in that, this system further comprises the immediate status server; Described video resource index server and client terminal comprise the immediate status client unit respectively;

Immediate status client unit in the described video resource index server is each real-time video resource information of registration storage on instant state server in advance, and accept the immediate state service identification information of immediate status server-assignment, and the video resource index server constantly with each real-time video state of resources information updating to the immediate status server;

Immediate status client unit in the described client terminal writes down the immediate state service identification information of each real-time video resource status in advance, subscribes to the real-time video state of resources information of this identification information correspondence to the immediate status server;

After the subscribe request of described immediate status server immediate status client unit in receiving client terminal, according to this request, the real-time video state of resources information that client terminal is subscribed to returns to the immediate status client unit in the client terminal;

Among the described step D, the immediate status client unit of streaming media server in client terminal play the real-time video stream medium data.

12. method as claimed in claim 5, it is characterized in that, this method further comprises: when a real-time video resource was being controlled, the video resource index server was a lock-out state with the information setting of controlling of this real-time video resource, refused the instruction of controlling of other client terminals transmissions.

13. method as claimed in claim 12 is characterized in that: the camera that described camera head comprises track and can orbit, describedly control instruction and also comprise the instruction of controlling that orbits;

Described streaming media server is controlled instruction according to this and camera of the camera head of real-time video resource correspondence is carried out on the track operation is controlled.

14. as claim 1,2,10 or 11 described methods, it is characterized in that: described video resource index server is the one or more video ads data of storage further;

Among the described step B, real-time video resource index server is when returning the real-time video resource information to client terminal, and the notice client terminal arrives first real-time video resource index server and downloads video ads data;

Among the described step C, client terminal to real-time video resource index server download video advertisements data, in the playing video advertisement data while or after playing, sends the real-time video request according to the real-time video resource information to streaming media server according to notice.

15. method as claimed in claim 14 is characterized in that: also comprise the type information of real-time video resource in the described real-time video resource information, each video ads data of described storage are relevant with at least one described type;

Among the described step B, real-time video resource index server is chosen one from the relevant video ads data of the type of the real-time video resource of client terminal request, and the notice client terminal is downloaded this video ads data.

16. as claim 1,2,10 or 11 described methods, it is characterized in that: the advertisement video server that one or more store video ad datas further are set in system; Each advertisement video server links to each other with described video resource index server, and the video resource index server is stored the address information of each advertisement video server;

Among the described step B, after the video resource index server receives the video resource request of client terminal transmission, should ask and the real-time video resource information is transmitted to an advertisement video server, and the address information of advertisement video server was sent to client terminal;

Described step B also comprises: client terminal arrives described advertisement video server download video advertisements data according to the address information of advertisement video server, and receives the advertisement video server is downloaded the back transmission in the video ads data real-time video resource information;

Among the described step C, client terminal sends the real-time video request according to the real-time video resource information that receives from the advertisement video server to streaming media server.

17., it is characterized in that: further in system, comprise: the mobile communication terminal of band camera as claim 1,2,10 or 11 described methods;

The mobile communication terminal of described band camera and streaming media server are set up the transmission of flow media data passage via the WAP gateway in the mobile communications network, and the real time video data that camera is taken is passed through this data transmission channel, upload to streaming media server.

18. method as claimed in claim 2 is characterized in that: the address information that comprises client terminal in the real-time video request that described client terminal sends;

Described step D is: streaming media server is according to the address information in the real-time video request, to be encoded to stream media format from the video information compression that camera head receives, if camera head comprises pick-up, then streaming media server also carries out compressed encoding together with audio frequency, generates the real-time video stream medium data and plays to client terminal.

19. method as claimed in claim 18 is characterized in that, described step D comprises:

D1, streaming media server obtain video information from camera head;

D2, streaming media server and client terminal are set up signalling path, and broadcast address and port numbers are sent to client terminal;

D3, client terminal and streaming media server are set up data channel;

D4, streaming media server send to client terminal with it by this data channel after video information is generated the video stream media data;

D5, client terminal receiving stream media data display the play.

20. method as claimed in claim 19 is characterized in that: among the described step D2, streaming media server sends to client terminal with multicast address and port numbers;

Among the described step D4, streaming media server sends to router in internet or the local area network (LAN) with the real-time video stream medium data; Router will send to a plurality of clients continuously from the real-time video stream medium data that the separate unit streaming media server receives in the multicast mode simultaneously.

21. the method for claim 1 is characterized in that:

In the described steps A, client terminal is carried out the step of authentication earlier before real-time video resource index server sends the video resource request, after authentication is passed through, the record number of the account, real-time video resource index server begins to charge to this number of the account, generates the CDR ticket writing.

22. method as claimed in claim 21 is characterized in that: generate the CDR ticket according to different charging policy; If adopt mode by the time charge on traffic, then finishing when the client sends the real-time video stream medium data eventually by streaming media server, report the time and the flow information of this client terminal playing real-time video to the video resource index server, the video resource index server generates the CDR ticket writing in view of the above.

Images