CN102271122B - A kind of rubbish contents applied to P2P networks determine method and its system - Google Patents

Abstract

The invention discloses a garbage content determining method and system applied to a P2P network to determine the garbage content in the P2P network. The method includes: the filtering server performs streaming operation on the received video and audio files to obtain streaming media data, and outputs the streaming media data; the filtering client performs framing on the streaming media data output by the filtering server to obtain video frames /audio frame; decoding the video frame/audio frame to obtain video data/audio data; analyzing the video data/audio data, and determining whether the video/audio file is a garbage file according to the analysis result. By adopting the technical scheme of the invention, the spam content in the P2P can be effectively determined, thereby ensuring the health and safety of the content in the P2P network.

Description

A method and system for determining spam content applied to P2P network

technical field

The invention relates to the technical field of streaming media, in particular to a method and system for determining garbage content applied to a P2P network.

Background technique

At present, P2P technology (Peer to Peer Computing, computing technology) has been highly concerned by operators. With the development and perfection of video and audio coding technology and IP network transmission technology, digital media services have developed rapidly and have become the core of broadband application.

At this stage, operators' digital media services adopt a centralized service model, such as providing services for users based on C/S (Client/Server, client/server) or C/S+CDN (Content Delivery Network, content distribution network) architecture. To provide services, along with the growing business needs, the system investment under this framework has increased sharply, and the problem of low output efficiency has become increasingly significant. In contrast, the idea of P2P has changed the original C/S computing (Client/Server Computing) of the Internet ) or B/S Computing (Brower/Server Computing) such an asymmetrical computing model, each node has an equal status and can simultaneously become a service user and provider, which provides a great foundation for large-scale information sharing, direct communication and collaboration Work provides a flexible, scalable computing platform.

The P2P-based business platform has the advantages of low cost, high scalability, high service quality, and high security, and can solve the problems of high platform investment, low return, and hotspot effects faced by the existing digital media business development.

However, the P2P network is not yet mature and perfect, and there are many problems that need to be solved urgently. Among them, the security of the transmission content of the P2P network has become a more critical problem in the current P2P network. Since the content source of the P2P network mainly comes from the content uploaded by the provider and the user terminal; since the P2P network contains a large number of user nodes, there are many content uploaded by the user terminal, especially video content, how to ensure the health and safety of the content , has become an urgent problem to be solved. If a manual review method is used to detect whether the video content is spam content, the workload is large and time-consuming; if the video content is judged to be spam content through manual random inspection, some spam content may be missed. Therefore, how to efficiently filter junk content has become a more concerned issue in the current P2P network.

Contents of the invention

The invention provides a method and system for determining garbage content applied to a P2P network, so as to realize filtering of garbage content in the P2P network.

A garbage content determination system applied to P2P network, comprising:

The filtering server is used to stream the received video and audio files, obtain streaming media data, and output the streaming media data;

The filtering client is configured to frame the streaming media data output by the filtering server to obtain video frames or/and audio frames; to decode the video frames or/and audio frames to obtain video data or/and audio data ; Analyzing the video data or/and audio data, and determining whether the video and audio files are junk files according to the analysis results.

A method for determining spam content in a P2P network by using the above system, comprising:

The filtering server performs a streaming operation on the received video and audio files, obtains streaming media data, and outputs the streaming media data;

The filtering client performs framing of the streaming media data output by the filtering server to obtain video frames or/and audio frames; decodes the video frames or/and audio frames to obtain video data or/and audio data; Analyze the video data or/and audio data, and determine whether the video and audio files are junk files according to the analysis results.

In the embodiment of the present invention, the filtering server performs a streaming operation on the received video and audio files to obtain streaming media data, and outputs the streaming media data; the filtering client performs framing of the streaming media data output by the filtering server to obtain video frames or/and audio frames; decoding the video frames or/and audio frames to obtain video data or/and audio frames; analyzing the video data or/and audio frames, and determining the Whether the video and audio files are junk files. By adopting the technical scheme of the invention, the spam content filtering operation is realized on the content in the P2P network, and the spam content is determined, thereby ensuring the health and safety of the content in the P2P network.

Description of drawings

FIG. 1A is one of the structural schematic diagrams of the garbage content determination system in the embodiment of the present invention;

FIG. 1B is the second structural schematic diagram of the garbage content determination system in the embodiment of the present invention;

Fig. 1C is the third structural schematic diagram of the garbage content determining system in the embodiment of the present invention;

FIG. 2A1 and FIG. 2A2 are flowcharts of determining spam content in a P2P network by using the system shown in FIG. 1A in an embodiment of the present invention;

FIG. 2B is a flowchart of determining spam content in a P2P network by using the system shown in FIG. 1B in an embodiment of the present invention;

FIG. 2C is a flowchart of determining spam content in a P2P network by using the system shown in FIG. 1C in an embodiment of the present invention.

Detailed ways

In order to solve the above-mentioned technical problems existing in the P2P network, the embodiment of the present invention provides a method and system for determining spam content applied to the P2P network. Filtering client: the filtering client analyzes the video data or/audio data of the video and audio file, and determines whether the video and audio file is a garbage file according to the analysis result. The technical scheme of the present invention is implemented through the server and the client to filter and judge the content sent by the content provider or user terminal to the P2P network, and determine the garbage content, thereby realizing the filtering of the garbage content to ensure the P2P network health and safety of content.

The technical solutions of the present invention will be described in detail below in conjunction with the accompanying drawings.

Referring to Fig. 1A, it is one of the schematic structural diagrams of the garbage content determination system in the embodiment of the present invention, the system includes: a video library 1, a filtering server 2 and a filtering client 3, wherein:

The video library 1 is used to store the content provided by the content provider or the content uploaded by the user terminal.

In the embodiment of the present invention, the content provided by the content provider or the content uploaded by the user terminal can include video and audio files, picture files, audio files, etc.; the file format of the video and audio files can be MP4 format files, and can also be AVI, ASF, RM, RMV, OGG, OGM and other format files.

Filtering server 2 is used to stream the video and audio file to obtain streaming media data when it detects that a new video and audio file appears in the video library 1; and, send a file filtering request to the filtering client 3, and stream The video and audio file is sent to the filtering client 3 in the form of media.

The filtering client 3 is used to frame the received streaming media data to obtain multiple video frames, decode the multiple video frames to obtain multiple sets of video data, and analyze the multiple sets of video data according to The analysis result determines whether the new video and audio file is a junk file; and, it is used to frame the received streaming media data to obtain multiple audio frames, decode the multiple audio frames to obtain multiple groups of audio data, and The multiple sets of audio data are analyzed, and it is determined whether the new video and audio files are garbage files according to the analysis results.

According to the functional division, the above filtering server 2 can be divided into transcoding module 21, streaming module 22 and streaming media service module 23, wherein:

The transcoding module 21, optionally, is used to perform a transcoding operation on a new video and audio file when the file format of the received video and audio file is a file format not supported by the filtering server 2, and encode the video and audio file The format is converted into any one supported by the filtering server 2 or a set file format, and the streaming module 22 is started.

The streaming module 22 is configured to perform a streaming operation on the new video and audio file to obtain streaming media data, and output the streaming media data.

The streaming media service module 23 is configured to send the streaming media data output by the streaming module 22 to the filtering client 3 in the form of streaming media.

According to the functional division, the filtering client 3 can be divided into: data receiving module 31, video data framing module 32, video decoding module 33, image analysis module 34, audio data framing module 35, audio decoding module 36 and audio analysis module 37. In the embodiment of the present invention, the image analysis module 34 restarts the audio data framing module 35, the audio decoding module 36 and the audio analysis module 37 when determining that the video and audio file is a non-junk file according to the analysis results, so as to further determine whether the video and audio file Or, audio analysis module 37 restarts video data framing module 32, video decoding module 33 and image analysis module 34 when determining that video and audio files are non-junk files according to the analysis results, to further determine video and audio files Whether it is a junk file.

The data receiving module 31 is configured to receive streaming media data sent by the filtering server 2 .

The video data framing module 32 is configured to perform a framing operation on the video data in the streaming media data received by the data receiving module 31 to obtain video frames.

The video decoding module 33 is configured to perform decoding operations on the video frames obtained by the video data framing module 32 to obtain decoded video data.

The image analysis module 34 is configured to perform image analysis on part or all of the video data obtained by the video decoding module 33, and determine whether the video and audio files are junk files according to the analysis results.

The audio data framing module 35 is configured to perform a framing operation on the audio data in the streaming media data received by the data receiving module 31 to obtain audio frames.

The audio decoding module 36 is configured to decode the audio frames obtained by the audio data framing module 35 to obtain decoded audio data.

The audio analysis module 37 is configured to perform audio analysis on the audio data obtained by the audio decoding module 36, and determine whether the video and audio file is a junk file according to the analysis result.

Preferably, the streaming media service module 23 in the embodiment of the present invention sends video and audio files to the data receiving module 31 of the filtering client 3 in the form of RTP (Real-time Transport Protocol, real-time transport protocol) stream.

The image analysis module 34 in the embodiment of the present invention is specifically applied as follows: Mode 1, the image analysis module 34 uses image recognition technology to identify multiple groups of video data, and for each group of video data, uses skin color detection technology to detect the group of video data The proportion of skin color in the data and the position of the non-skinned part in the human body, and according to the proportion of skin color and the position of the non-skinned part in the human body to determine whether the group of video data is a garbage image; when the number of groups determined to be garbage video data exceeds the set When the number threshold of the video and audio file is determined to be a junk file. Mode 2, a large amount of feature values shared by garbage images are pre-stored in the database, and the image analysis module 34 extracts the feature values of the group of video data for each group of video data, and compares the feature values with those of the garbage images stored in the database. The feature value is matched, and when the matching is successful, it is determined that the group of video data is garbage video data; when the number of groups determined to be garbage video data exceeds a set threshold value, it is determined that the video and audio file is a garbage file.

The audio analysis module 37 in the embodiment of the present invention carries out audio analysis to the audio data, and determines whether the video and audio file is a garbage file according to the analysis result, specifically: a large amount of garbage audio data is pre-stored in the database, for each group Audio data, match this group of audio data with the garbage audio data stored in the database, if the matching degree is greater than or equal to the set threshold, then determine that this group of audio data is garbage video data; when the group of garbage audio data is determined When the number is greater than or equal to the set number threshold, it is determined that the video and audio file is a junk file.

In the embodiment of the present invention, the filtering client 3 can only analyze the video data of the video and audio file to determine whether the video and audio file is a garbage file. The structure of the filtering client 3 is as shown in Figure 1B, including a data receiving module 31 , a video data framing module 32, a video decoding module 33, and an image analysis module 34. Filter client 3 also can be to only analyze audio data, to determine whether video and audio files are rubbish files, the structure of this filter client 3 is as shown in Figure 1C, comprises data receiving module 31, audio data framing module 35, An audio decoding module 36 and an audio analysis module 37 .

In order to describe the technical solution of the present invention in more detail and clearly, the following describes the technical solution of the present invention in detail by taking the signaling flow chart of filtering the content of the P2P network as an example.

Referring to Fig. 2A1 and Fig. 2A2, it is a flow chart of using the system shown in Fig. 1A in the embodiment of the present invention to determine the garbage content in the P2P network. Step 1, as shown in Figure 2A1; if the process needs to analyze the audio data of the video and audio file first, then execute the steps of Solution 2, as shown in Figure 2A2.

Scheme 1 includes the following steps in timing:

Step 201 , the video library 1 sends the received video and audio files to the transcoding module 21 of the filtering server 2 .

Step 202, transcoding module 21 judges the video and audio file received, if the format of the video and audio file is the format supported by the filter server 2, such as MP4 format, then do not process, and send the video and audio file to the stream Transformation module 22; If the format of this video and audio file is the file format that filtering server 2 does not support, then this video and audio file is carried out transcoding format, is converted into the file format that filtering server 2 supports, as MP4 format, and sends to the fluidization module 22.

Step 203 , the streaming module 22 streams the received video and audio files to obtain media stream data, and sends the media stream data to the streaming media module 23 .

Step 204 , the streaming media module 23 sends a file filtering request to the data receiving module 31 of the filtering client 3 .

Step 205 , RTSP (Real Time Streaming Protocol, Real Time Streaming Protocol) interaction is performed between the data receiving module 31 and the streaming media module 23 .

Step 206, the streaming media module 23 sends the streaming media data to the data receiving module 31 in the form of RTP stream.

Step 207 , the data receiving module 31 sends the received RTP stream to the video data framing module 32 .

Step 208 , the video data framing module 32 frames the video data in the RTP stream to obtain multiple video frames, and sends the multiple video frames to the video decoding module 33 .

Step 209 , the video decoding module 33 performs a decoding operation on the multiple received video frames to obtain multiple sets of decoded video data, and sends the multiple sets of video data to the image analysis module 34 .

Step 210, the image analysis module 34 analyzes the multiple groups of video data received, and when determining that the video and audio file is a garbage file according to the analysis result, the process ends; if it is determined that the video and audio file is a non-junk file according to the analysis result, Execute steps 211-214.

Step 211 , the data receiving module 31 sends the received RTP stream to the audio data framing module 35 .

Step 212 , the audio data framing module 35 performs a framing operation on the audio stream in the RTP stream to obtain multiple audio frames, and sends the multiple audio frames to the audio decoding module 36 .

Step 213 , the audio decoding module 36 decodes the multiple received audio frames to obtain multiple sets of decoded audio data, and sends the multiple sets of audio data to the audio analysis module 37 .

Step 214, the audio analysis module 37 analyzes the multiple sets of audio data received, and determines whether the video and audio file is a junk file according to the analysis result.

Scheme 2 includes the following steps in timing:

Steps 201'~206' correspond to steps 201~206 in scheme 1 one by one.

Steps 207'-209' correspond to steps 211-213 in scheme 1 one by one.

Step 210', the audio analysis module 37 analyzes the multiple groups of audio data received, and when determining that the video and audio file is a junk file according to the analysis result, the process ends; when determining that the video and audio file is a non-junk file according to the analysis result, Then execute steps 211'-213'.

Steps 211' to 213' correspond to steps 201 to 209 respectively.

Step 214', the image analysis module 34 analyzes the multiple groups of video data received, and determines whether the video and audio files are junk files according to the analysis results.

Referring to FIG. 2B , it is a flow chart of determining spam content in a P2P network by using the system shown in FIG. 1B in an embodiment of the present invention. The process includes steps 201-209 shown in FIG. 2A1 and step 214' shown in FIG. 2A2 .

Referring to FIG. 2C , it is a flowchart of determining spam content in a P2P network by using the system shown in FIG. 1C in an embodiment of the present invention. The process includes steps 201-206 and steps 211-214 as shown in FIG. 2A1 .

In the above method flow, how the image analysis module 34 analyzes the video data and how the audio analysis module 37 analyzes the audio data is as described above, and will not be repeated here.

In the embodiment of the present invention, when the filtering server receives the video and audio file, it streams the video and audio file into streaming media data and sends it to the filtering client; the filtering client performs framing of the streaming media data to obtain multiple video frames Or/and multiple groups of audio frames; and analyze the multiple video frames or audio frames, and determine whether the video and audio files are junk files according to the analysis results. By adopting the technical scheme of the present invention, the filtering operation is implemented on the content provided by the content provider to the P2P network or the content uploaded by the user terminal to the P2P network, and the garbage content is determined, thereby ensuring the health and safety of the content in the P2P network; in addition , the filtering client can only judge the video data of the video and audio files to determine whether the video and audio files are junk files, or only judge the audio data of the video and audio files to determine whether the video and audio files are junk files, or Whether the video and audio files are garbage files is judged by the video data and audio data of the video and audio files. There are various implementation methods, and the flexibility of judging the video and audio files is improved.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims (6)

1. A garbage content determination system applied to a P2P network, characterized in that it comprises: The filtering server is used to stream the received video and audio files, obtain streaming media data, and output the streaming media data; The filtering client is used to frame the streaming media data output by the filtering server to obtain audio frames; decode the audio frames to obtain audio data; analyze the audio data, and determine the audio data according to the analysis results Whether the above video and audio files are junk files; or It is used to frame the streaming media data output by the filtering server to obtain video frames and audio frames; to decode the video frames and audio frames to obtain video data and audio data; to obtain video data and audio data; Analyze, and determine whether the video and audio files are junk files according to the analysis results; Wherein, the filtering server includes: a transcoding module, configured to transcode the video and audio file when the file format of the video and audio file is not supported by the filtering server, and convert it into the filtered The format supported by the server; the streaming module is used to stream the video and audio files to obtain streaming data; the streaming module is used to output the streaming data in the form of a real-time transport protocol RTP stream; The filtering client includes: a data receiving module for receiving the streaming media data output by the streaming media module; an audio data framing module for determining that the video and audio file is not a junk file when the image analysis module determines The streaming media data received by the data receiving module is framed to obtain multiple audio frames and output; the audio decoding module is used to decode the multiple audio frames output by the audio data framing module to obtain multiple groups of audio data and output; audio analysis module, for analyzing the multiple groups of audio data output by the audio decoding module, and determine whether the video and audio file is a garbage file according to the analysis result; Wherein, the filtering client also includes: A video data framing module, configured to frame the streaming media data received by the data receiving module to obtain multiple video frames; A video decoding module, configured to decode the plurality of video frames to obtain multiple sets of video data; The image analysis module is used to perform image analysis on the multiple sets of video data, and determine whether the video and audio files are junk files according to the analysis results. 2. The system according to claim 1, wherein the image analysis module is further used to start the audio data framing module when determining that the video and audio file is a non-junk file; Or, the audio analysis module is further configured to start the video data framing module when it is determined that the video and audio file is not a junk file. 3. The system according to claim 1 or 2, wherein the specific application of the image analysis module is: For each group of video data, the feature value of the group of video data is extracted, and the feature value is matched with the feature value of the garbage image stored in the database. When the matching is successful, it is determined that the group of video data is garbage video data; When it is determined that the number of groups of junk video data is greater than the set first quantity threshold, it is determined that the video and audio file is a junk file. 4. The system according to claim 1 or 2, wherein the audio analysis module is specifically applied as: For each group of audio data, match the group of audio data with the garbage audio data stored in the database, and when the matching degree is greater than the set matching degree threshold, determine that the group of audio data is garbage audio data; When it is determined that the number of groups of junk audio data is greater than the set second number threshold, it is determined that the video and audio file is a junk file. 5. A method for determining spam content in a P2P network by using the system according to claim 1, characterized in that it comprises: The filtering server performs a streaming operation on the received video and audio files, obtains streaming media data, and outputs the streaming media data; The filtering client performs framing of the streaming media data output by the filtering server to obtain audio frames; decodes the audio frames to obtain audio data; analyzes the audio data, and determines the video and audio according to the analysis results whether the file is junk; or The filtering client carries out framing of the streaming media data output by the filtering server to obtain video frames and audio frames; the video frames and audio frames are decoded to obtain video data and audio data; the video data and audio data are Analyze, and determine whether the video and audio files are garbage files according to the analysis results. 6. The method according to claim 5, wherein the filtering client determines whether the video and audio file is a junk file, specifically: Framing the streaming media data output by the filtering server to obtain multiple video frames; decoding the multiple video frames to obtain multiple sets of video data; analyzing the multiple sets of video data, and according to the analysis results When determining that the video and audio file is a non-junk file: frame the streaming media data output by the filtering server to obtain multiple audio frames; decode the multiple audio frames to obtain multiple groups of audio data; Analyze the multiple sets of audio data, and determine whether the video and audio files are junk files according to the analysis results; or, Framing the streaming media data output by the filtering server to obtain multiple audio frames; decoding the multiple audio frames to obtain multiple sets of audio data; analyzing the multiple sets of audio data, and according to the analysis results When determining that the video and audio file is a non-junk file: frame the streaming media data output by the filtering server to obtain a plurality of video frames; decode the plurality of video frames to obtain multiple groups of video data; Analyze the multiple sets of video data, and determine whether the video and audio files are junk files according to the analysis results.