Network media video data analysis and supervision system
Technical Field
The invention relates to the field of video big data supervision, in particular to a network media video data analysis and supervision system.
Background
CN110740290B discloses a method and device for previewing a surveillance video, which solve the problem that in the video surveillance field, when a user queries a surveillance video of an interest event in the surveillance video, the query process is time-consuming when the specific time of the interest event is not known. And then, the video storage device searches the corresponding monitoring video and a plurality of key frames of the monitoring video according to the monitoring video preview request and sends the key frames to the user terminal. And then, the user terminal plays the monitoring video, and decodes a plurality of key frames in the playing process to obtain a plurality of corresponding preview pictures. And finally, displaying the plurality of preview pictures on the current playing node of the monitoring video in a preview shaft mode. Therefore, through presenting a plurality of preview pictures in the form of a preview shaft, more preview information is provided, a user is helped to preview the monitoring video rapidly, interest events are found more rapidly, and in addition, the method and the device have less consumption on calculation performance and can be suitable for different terminal platforms.
CN103455550B discloses a method and device for obtaining a search result of a picture with a comparison effect, which solves the problems that when a user has multiple search requirements, a keyword is input, a picture containing the keyword in a text around the searched picture is returned to the user as a search result, if the picture reflected by the keyword cannot be judged by the search engine or the returned result only reflects one search requirement, and the search requirement does not meet the intention of the user, the user can obtain a satisfactory picture by searching for multiple times, the effective extraction and comparison of the keyword and the picture are realized, and the user can obtain multiple pictures which the user wants to search for comparison as soon as possible.
CN103530656B discloses an image abstract generating method based on hidden structure learning, and the method has higher information coverage rate and lower redundancy, can implicitly learn different preferences of picture sets related to different topics on feature selection, and achieves better effect than the traditional method. CN103617261B discloses a method and a system for identifying the content attribute of a picture, which can identify similar pictures of collected pictures and aggregate the pictures into a plurality of homologous picture clusters; calculating the relative reloading number of a plurality of homologous picture clusters to a specific resource site; identifying the picture content attribute in the corresponding homologous picture cluster according to the relative reloading number is particularly effective for judging whether the picture is an advertisement picture.
CN111414842B discloses a video comparison method, apparatus, computer device and storage medium, which can obtain a first video (i.e. source video of the present invention) and a second video (i.e. video to be compared successfully in preliminary matching of the present invention); then, a first image sequence is acquired from the first video, and a second image sequence is acquired from the second video; extracting a first definition characteristic vector from the first image sequence through a first characteristic extraction module of the video comparison model; the second feature extraction module of the video comparison model is used for extracting a second definition feature vector of the second image sequence, the definition feature vectors of the two image sequences can reflect the relative conditions of the definition of the two videos more accurately, after the feature vectors are extracted, the definition difference analysis module of the video comparison model can be used for determining the definition difference of the first video and the second video based on the first definition feature vector and the second definition feature vector, so that the quantification of the definition difference of the two videos is realized, and the analysis accuracy of the definition difference of the videos is improved.
By combining the above, the application level of the prior art is low, and the prior art cannot be used for the transmission monitoring and control of specific video content, has no timely risk on video with good popular or criminal transmission on the internet, has fast early warning, control and management functions, and cannot prevent the online illegal infringement of the behavior of stealing original video intellectual property, so that a network media video data analysis and supervision system is researched.
Disclosure of Invention
The invention aims to overcome the problems in the prior art and provide a network media video data analysis and supervision system, which adopts a technical means of combining local terminal installation business special software, cloud platform and cloud computing, greatly reduces hardware investment and calculation cost investment and complex video processing software development cost, can quickly and efficiently search various varieties of source videos in a network, can effectively monitor the spreading and spreading range of the source videos and the varieties thereof, is beneficial to users to accurately manage, monitor and control the network dynamics of the source videos, and reduces the behaviors of intellectual property infringement, illegal application, crime and the like by using the network videos by illegal people.
In order to achieve the technical purpose and the technical effect, the invention is realized by the following technical scheme:
the network media video data analysis and supervision system comprises a local system, a cloud platform system and a cloud computing system, wherein the local system is provided with video processing software and office software and is used for editing and key description remarks of source videos to be analyzed and supervised; the cloud platform system comprises a data uploading module, a data downloading module and an analysis data cloud access module; the cloud computing system comprises a cloud operation rule program and a data cloud access module;
the cloud platform system: the system also comprises a sample rapid preview generating module, a rapid preview key frame generating module, a key clip calibrating module and a network cloud video retrieving module;
the cloud computing rule program of the cloud computing system comprises a sample target importing program, a video search result importing program, a video quick preview generating program, a video quick preview key frame generating program, a key frame comparing program, a quick preview comparing program, a comparison result data analyzing program and an analysis result statistics output program;
the system also comprises the following operation steps:
1) Local processing of source video: including editing, description, and uploading; the video user obtains the source video, uses the video processing software installed by the local system to carry out necessary editing, then describes the source video by using keywords, uploads the source video to the cloud platform system after the description is finished,
2) The cloud platform system starts a cloud computing system: the method comprises video retrieval, video importing, rapid preview generation, preview key frame comparison, rapid preview comparison and comparison analysis data summarization generation; the cloud platform system generates a video quick preview (i.e. a source video preview) for the source video (i.e. the source video preview), extracts a key frame (i.e. the source video key frame) of the source video quick preview, searches videos to be compared (i.e. network videos) meeting the constraint condition of the key words in the network according to the key words, sequentially imports the videos to be compared, sequentially generates the video quick preview (i.e. the network video preview) for the videos to be compared, further extracts the key frame (i.e. the network video key frame) of the videos to be compared, firstly compares the difference between the key frame (i.e. the source video key frame) of the quick preview of the source video to be compared and the key frame (i.e. the network video key frame) of the videos to be compared, eliminates the videos to be compared with different key frame comparison details, the rest videos to be compared enter a video quick preview comparison mode, eliminates the difference between the quick preview of the source video to be compared and the videos to be compared, eliminates the video to be compared, and the videos to be compared;
3) Supervision analysis data application: the cloud computing system generates downloadable supervision and analysis data, and a user can check the downloadable supervision and analysis data after checking or downloading the downloadable supervision and analysis data to the local system through the cloud platform and take supervision measures according to the data comparison result.
Preferably, the key clip calibration module is configured to: the user circles the area on the key frame of the rapid previewing of the source video, the area selected by the circle is used as the supplement of the sample target key frame (namely the source video), and after the sample target key frame is amplified, reduced, mirrored and overturned, the sample target key frame is compared with the key frame of the rapid previewing of the video to be compared, the video to be compared which does not meet the comparison condition is directly removed, and the key frame comparison program is started for the video to be compared which meets the comparison condition.
Preferably, the network cloud video retrieval module is characterized in that a cloud platform system automatically collects the description content of a user on a source video, extracts keywords, and combines the keywords to retrieve the video on a network.
Preferably, the video search result importing program: the cloud platform system retrieves videos related to keywords according to the keyword combinations, collects video websites and transmits the videos to the cloud computing system, the cloud computing system sequentially collects related videos, generates corresponding quick previewing of videos to be compared and quick previewing key frames to be compared for the videos, and guides the quick previewing key frames to be compared to a key frame comparison program of the cloud computing system.
Preferably, the key frame comparison procedure; the cloud computing system firstly guides the supplement of the sample target key frame of the user circle or the key frame of the source video quick preview, if the supplement of the sample target key frame of the user circle exists, the key frame of the source video quick preview is not guided; secondly, importing a quick preview key frame to be compared, and comparing the key frames imported twice; if the sample target key frame can be found in the quick preview key frame to be compared, the video quick preview corresponding to the quick preview key frame to be compared is imported into the cloud computing system, and if the sample target key frame cannot be found in the quick preview key frame to be compared, the video quick preview corresponding to the quick preview key frame to be compared and related videos are excluded.
Preferably, in the rapid preview comparison program, the cloud computing system firstly guides rapid previews of source videos, secondly guides rapid previews of videos to be compared, and starts comparison on the two-time guided rapid previews of the videos according to key frames as joint points; if a part continuously synchronous with the quick preview of the source video (i.e. the network video preview) can be found in the quick preview of the video to be compared (i.e. the network video preview), recording a synchronization time node, a synchronization duration, and key frame screenshots of the beginning and the end of synchronization, calculating a reference amplitude and an adaptation degree according to the accumulated synchronization times and the synchronization duration and the ratio of the source video to the comparison video, and if the continuously synchronous part cannot be found in the quick preview of the video to be compared, excluding the relevant video of the quick preview of the corresponding video.
Preferably, the comparison result data analysis program: the method comprises the steps of analyzing data results of single videos and analyzing data results of batch videos, and obtaining integral quotation reference amplitude, adaptation degree and viewing diffusion fission indexes according to secondary analysis of related data of the single videos.
Preferably, the user sets a threshold value referencing the reference amplitude and the adaptation degree in the local system or the cloud platform system, sets a supervision treatment measure in each threshold value range interval for the threshold value, and obtains suggestion feedback of the supervision measure according to the supervision treatment measure.
Preferably, the analysis result statistics output program is used for the cloud computing system to compare and calculate the data to generate an image-text report, and the image-text report is stored in the cloud platform system for a user to check after the cloud platform system checks or downloads the image-text report to the local system.
Preferably, the recommended feedback of the supervision measure includes: neglect, dynamic tracking, focus on fission tracking, reference learning, limiting or promoting propagation.
The beneficial effects of the invention are as follows:
(1) The technical means of combining the local terminal with the business special software, the cloud platform and the cloud computing is adopted, so that the hardware investment, the computing cost investment, the complex video processing software development cost and the manpower resource investment are greatly reduced;
(2) The method has the advantages that the method is simple to operate, users can quickly and accurately acquire the playing condition and the fission dynamics of the source video with low cost only by providing videos to be compared and performing keyword description on the videos, and the method obtains suggestions for high-efficiency supervision and limitation or promotion of propagation, and has obvious technical progress significance for preventing harmful video propagation, preventing original intellectual property infringement of the videos and accurately putting advertisements and promoting beneficial video propagation and fission.
(3) The method can quickly and efficiently search various varieties of the source video in the network, can effectively monitor the spreading range of the source video and the varieties thereof, is beneficial to users to accurately manage, monitor and control the network dynamics of the source video, and reduces the behaviors of intellectual property infringement, illegal application, crime and the like by illegal molecules by utilizing the network video.
The foregoing description is only an overview of the technical solution of the present invention, and in order to make the technical means of the present invention more clearly understood, it can be implemented according to the content of the specification, and the following detailed description of the preferred embodiments of the present invention will be given with reference to the accompanying drawings. Specific embodiments of the present invention are given in detail by the following examples and the accompanying drawings.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiments of the invention and together with the description serve to explain the invention and do not constitute a limitation on the invention. In the drawings:
FIG. 1 is a schematic diagram of a technical module structure according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an operation flow of a network video system according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a video contrast logic and analysis flow according to an embodiment of the present invention.
Detailed Description
The invention is further described below with reference to the accompanying drawings:
referring to fig. 1 to 3, a user installs video picture processing software (such as AE, PR, DW, PS, etc.) and office software (such as office, WPS, etc.) by using a local system (such as a desktop, a notebook, a server, etc.) and then uses the local system to edit, modify, clip, weld, etc. source videos (i.e., source videos) to be analyzed and supervised, and performs detailed modification description (i.e., keywords) on the source videos by using popular terms and technical terms, thereby accurately describing attribute properties of the videos; after processing, the source video and keywords are imported into a cloud computing system by utilizing a data uploading module of the cloud platform system, a source video quick preview and video retrieval keyword combination is calculated and generated, a source video quick preview key frame combination is further generated, the source video quick preview and source video quick preview key frame combination is used as a reference object for comparison, at the moment, a user can check the source video quick preview key frame combination (namely, the source video preview key frame), and can circle key comparison contents (such as face features, cartoon figures, clothes, vehicles, marks and the like) by using lines, figures (boxes, circles, cursor track hand-painted figures) and the like, after the circle is defined, the defined contents are additionally saved into a source video supplementary key frame combination (namely, source video supplementary key frame) for preferential comparison, the comparison order priority is that the source video supplement key frame > the source video preview key frame > the source video fast preview, if the source video supplement key frame is not added by the user, the source video fast preview key frame combination and the source video fast preview are compared, namely 2-layer comparison, if the source video supplement key frame is added by the user, the source video supplement key frame is compared firstly, then the source video fast preview key frame combination is the source video fast preview, and finally the source video fast preview is 3-layer comparison, of course, the user can also select to cancel the comparison of the source video fast preview key frame combination, namely only the source video supplement key frame and the source video fast preview are compared, namely 2-layer comparison, the cloud computing platform searches in the internet video search engine by using the video search key word combination in the background to obtain the video to be compared (namely the network video) which accords with the key word label, generating a quick preview (namely a network video quick preview) of the to-be-compared video according to the search sequence, further generating a key frame combination (namely a network video preview key frame) for the quick preview, starting a comparison mode after completing the quick preview and the key frame of the current network video, firstly taking a source video supplementary key frame outlined by a user as a comparison target, adopting algorithms such as translation, amplification, reduction, mirroring, turning over, changing pixel resolution and the like, searching for identical or similar blocks in the network video preview key frame, and if the blocks meeting the requirements cannot be found in all the key frame combinations, eliminating the network video and not carrying out the comparison of the next step; if more than one identical or similar block can be found, recording video playing time corresponding to each matched block key frame as synchronous starting time for rapid preview comparison; under the default condition, after the source video supplementary key frame and the network video preview key frame are compared, the network video preview key frame with the same or similar thunder is compared, the situation that the thunder is the same or similar is confirmed and positioned again, the non-conforming network video is eliminated, the related data of the network video key frame with the same or similar is recorded more accurately, if the source video supplementary key frame is not limited by a user, the comparison between the source video supplementary key frame and the network video preview key frame is ignored, the comparison between the source video preview key frame and the network video preview key frame is directly carried out, after the key frame comparison is completed, the rapid preview comparison is carried out on the network video which is not eliminated is started, the rapid preview of the source video is taken as a reference, the method comprises the steps of adopting algorithms such as translation, amplification, reduction, mirror image, turning, changing pixel resolution and the like to quickly preview a source video, searching a block which is identical or similar to the source video in the quick preview of the network video, eliminating misjudgment which is not continuous with the video or similar to the video, eliminating irrelevant network videos, recording synchronous moments of initiation and termination of the identical or similar video of the network videos which are not eliminated again, synchronizing duration, changing differences of translation, amplification, reduction, mirror image, turning and changing pixel resolution, generating relevant basic data report, extracting the synchronous moments, synchronizing duration and changing differences of the network videos in the basic data report by a cloud computing system, analyzing and calculating the correlation degree, the synchronous degree, the appearance time, the play quantity and the like of the network videos, further analyzing the track and trend of network propagation and fission of the source video, and locking key transmission nodes of video fission, giving video transmission constraint or promoted supervision suggestions, outputting the video transmission constraint or promoted supervision suggestions to the cloud platform system, and preprocessing the video transmission suggestions after a user directly views or downloads the video transmission suggestions to the local system by the cloud platform system.
The method is simple to use, the terminal user only needs to provide the source video, describe the source video and upload the source video to the cloud platform, can manually circle some key frame comparison key points, can quickly and accurately acquire the play condition and the fission dynamics of the source video with low cost without circle, and obtains suggestions for high-efficiency supervision and limitation or promotion of propagation, thereby having obvious technical progress significance for preventing harmful video propagation, refusing the infringement of original intellectual property rights of the video and accurately putting advertisements and promoting beneficial video propagation and fission.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.