CN117255222A - Digital television monitoring method, system and application - Google Patents
Digital television monitoring method, system and application Download PDFInfo
- Publication number
- CN117255222A CN117255222A CN202311546690.6A CN202311546690A CN117255222A CN 117255222 A CN117255222 A CN 117255222A CN 202311546690 A CN202311546690 A CN 202311546690A CN 117255222 A CN117255222 A CN 117255222A
- Authority
- CN
- China
- Prior art keywords
- monitoring
- video
- digital television
- decoding
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 100
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000012545 processing Methods 0.000 claims abstract description 3
- 230000003068 static effect Effects 0.000 claims description 34
- 238000005516 engineering process Methods 0.000 claims description 26
- 230000011218 segmentation Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 7
- 230000002159 abnormal effect Effects 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 3
- 238000011161 development Methods 0.000 description 7
- 230000018109 developmental process Effects 0.000 description 7
- 238000009434 installation Methods 0.000 description 2
- 230000003340 mental effect Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/4425—Monitoring of client processing errors or hardware failure
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention provides a digital television monitoring system. The invention also provides an application of the digital television monitoring system in multi-channel digital television monitoring. The invention further provides a digital television monitoring method. The invention can efficiently encode and decode video data, monitors the digital television, and builds a set of more practical, more targeted and advanced digital monitoring system under the requirements of reducing the resource cost and improving the safe broadcasting level. Meanwhile, the invention utilizes the performance characteristic that the processing chip can encode and decode multiple paths of video data, monitors multiple channels of programs simultaneously, and transcodes the multiple paths of video data, thereby greatly reducing the cost.
Description
Technical Field
The invention relates to a digital television monitoring method, a digital television monitoring system and application thereof in multipath digital television monitoring, belonging to the field of information processing.
Background
Along with the improvement of the social and economic level, people increasingly move to higher mental culture life, and the progress of scientific technology plays a great role in promoting the development of cultural careers in China. In the broadcast television industry, the traditional analog television technology cannot meet the mental culture requirements of people, and the digital television technology is rapidly developed as a novel technology. The popularity of networking and digitizing has also led to unprecedented changes in digital television technology, such as a tremendous increase in the number of channels, quality of programming, and improved video definition. The rapid popularization of digital television technology, the continuous development of the business and the safe broadcasting of the digital television technology are also more concerned. The method for guaranteeing the safe broadcasting of the broadcast television is an important task of a nationwide broadcasting and television technology system.
The rapid development of digital television technology, the broadcasting monitoring system for manual monitoring can not meet the development requirement, and the fault is difficult to find out for an operator on duty, and defects can exist on specific post records, so that in daily operation, the broadcasting hidden danger is more and more complex, the false alarm rate and the fault rate can be obviously increased, and continuous monitoring for 24 hours can not be carried out. The digital television technology has been developed to date, the service is very abundant, the coverage area is very wide, the data transmission mode is diversified, and higher requirements are also put forward for monitoring work.
Disclosure of Invention
The purpose of the invention is that: under the requirements of reducing the resource cost and improving the safe broadcasting level, a set of digital monitoring system which is more practical, stronger in pertinence and more advanced is constructed.
In order to achieve the above object, the present invention provides a digital television monitoring system, which is characterized in that the digital television monitoring system includes a hardware platform and a software system running on the hardware platform further includes the following modules:
TS (Transport Stream) flow acquisition module for acquiring N paths of TS clear flow in real time, wherein N is more than or equal to 1;
the decoding module is used for decoding the acquired N-channel TS clear stream, wherein the decoding module acquires a video code stream from a buffer of upper software by utilizing a video decoder of a decoding chip, analyzes the video code stream, and outputs decoded data into a buffer pool;
the monitoring module is used for carrying out N-way monitoring on the video data decoded by the decoding module, wherein the monitoring module monitors the video data decoded by the decoding module by utilizing an image recognition technology, comprises abnormal monitoring of a video black field and a static frame, and when a black field or static frame fault occurs, the monitoring module transmits the start-stop time and duration time of the fault to the PC monitoring terminal in a word mode in a network manner, and the PC monitoring terminal stores word information to the local so as to complete monitoring of the static frame and the black field fault and display and recording of alarm information;
the coding module is used for carrying out N paths of coding on the video stream data after the monitoring is completed according to an H.265 protocol;
video stream output module: and pushing the N paths of code streams coded by the coding module to a network port where a PC streaming media server is located by adopting a network streaming media technology, and playing the video streams after transcoding by a VLC (Video Lan Client) player.
Preferably, the TS stream acquisition module uses network streaming media technology to realize Real-time transmission of video streams in a local area network by using communication protocols including RTSP (Real Time Streaming Protocol), RTP (Real-time Transport Protocol) or RTCP (Real-time Transport Control Protocol).
The invention further provides an application of the digital television monitoring system to multi-channel digital television monitoring, which is characterized in that the system is used for realizing at least two channels 1080p@30fps digital television monitoring video output.
The invention also provides a digital television monitoring method, which is realized based on the digital television monitoring system and is characterized by comprising the following steps:
step 1, a TS stream acquisition module acquires N TS clear streams in real time, wherein N is more than or equal to 1;
step 2, decoding the obtained N-path TS clear stream by a decoding module;
step 3, monitoring the decoded video data by utilizing an image recognition technology, wherein the monitoring comprises abnormal monitoring of a video black field and a static frame; when black field and static frame faults occur, the start-stop time and duration time of the faults are transmitted to the PC monitoring terminal in a word mode, and the PC monitoring terminal stores word information locally, so that the monitoring of the static frame and black field faults and the display and recording of alarm information are completed;
step 4, coding the video stream data after monitoring according to the H.265 protocol;
and step 5, pushing the coded code stream to a network port where a PC streaming media server is located by adopting a network streaming media technology, and playing the transcoded video stream by a VLC player.
Preferably, the step 2 further comprises the steps of:
step 201, initializing a system and a video cache pool VB;
step 202, creating N paths of decoding channels and binding a video cache pool VB;
step 203, the obtained N paths of code streams are sent to N paths of decoding channels, and decoding is carried out by using a decoder;
step 204, create the output of the N thread processing decoders, and after decoding is completed, unbind the N decoding channels from the video cache pool VB (Video Buffer), and then destroy the N decoding channels.
Preferably, in step 3, the method for judging a black field fault includes the following steps:
step 3101, performing feature segmentation on each video image, and segmenting the image into a plurality of small areas;
step 3102, taking the gray value sum of the pixel points in each small area as the characteristic value of the current area, and comparing the gray value sum with the characteristic value of other small areas in sequence by taking the characteristic value of a certain small area as a reference standard, and judging that a black field fault occurs currently if the difference between the characteristic value of the other small areas and the characteristic value of the reference standard is smaller than a preset threshold value; if the difference between the characteristic value of the other small region and the reference standard characteristic value is larger than a preset threshold value, the black field fault is considered not to occur.
Preferably, in step 3, the method for judging the static frame fault includes the following steps:
step 3201, performing feature segmentation on each video image, and segmenting the image into a plurality of segmentation areas;
step 3202, two eigenvalues are taken and respectively defined as an eigenvalue A and an eigenvalue B for judgment, wherein the eigenvalue A is the sum of gray value differences of all points of corresponding divided areas of two adjacent frames of images, so that the integral change of the divided areas is expressed, and the eigenvalue B is the sum of absolute values of gray value differences of all points of corresponding divided areas of two adjacent frames of images, so that the change of a single point is reflected;
step 3203, if the obtained characteristic value A of the images of the adjacent two frames is lower than a preset threshold value A, the characteristic value A of the images of the adjacent two frames is considered to be matched, and step 3204 is performed, otherwise, the characteristic value A of the images of the adjacent two frames is considered to be not matched, and the static frame fault is judged not to occur;
step 3204, if the obtained feature value B of the images of the two adjacent frames is lower than a preset threshold value B, the feature values B of the images of the two adjacent frames are considered to be matched, and the occurrence of a static frame fault is determined, otherwise, the feature values B of the images of the two adjacent frames are considered to be not matched, and the occurrence of no static frame fault is determined.
Preferably, the step 4 includes the steps of:
step 401, creating N coding channels and initializing;
step 402, binding the coding channel with a VPSS (Video Process Sub-System) module;
step 403, after the N coding channels respectively receive the image data, starting H.265 coding;
step 404, creating N threads to process the encoded output, and after encoding is completed, unbinding N encoding channels with the VPSS module, and then destroying the encoding channels.
The invention also provides an application of the digital television monitoring method in multi-channel digital television monitoring, which is characterized in that the method is used for realizing at least two channels 1080p@30fps digital television monitoring video output.
The invention utilizes the performance characteristics of the decoding chip for encoding and decoding video data efficiently to monitor the digital television, replaces the traditional manual monitoring mode to lighten the burden of first-line staff, and constructs a set of more practical, stronger and more advanced digital monitoring system under the requirements of reducing the resource cost and improving the safe broadcasting level. Meanwhile, aiming at the rapid development of digital television service and the great increase of channels compared with the prior art, the invention utilizes the performance characteristics of the decoding chip for encoding and decoding the multipath video data, monitors the programs of a plurality of channels simultaneously, transcodes the multipath video data, greatly reduces the cost, and adopts the H.265 encoding technology to realize high-efficiency encoding.
Drawings
Fig. 1 illustrates a multi-channel digital television monitoring system disclosed in this embodiment;
fig. 2 illustrates a program flow of acquiring a TS video stream;
fig. 3 illustrates a program flow of decoding the obtained N-way TS clear stream;
FIG. 4 illustrates a method of judging a black field fault;
FIG. 5 illustrates a method of determining a static frame failure;
FIG. 6 illustrates the encoded program flow;
fig. 7 illustrates the output process of the video stream.
Detailed Description
The invention will be further illustrated with reference to specific examples. It is to be understood that these examples are illustrative of the present invention and are not intended to limit the scope of the present invention. Further, it is understood that various changes and modifications may be made by those skilled in the art after reading the teachings of the present invention, and such equivalents are intended to fall within the scope of the claims appended hereto.
An aspect of this embodiment is to provide a digital television monitoring system, where a hardware platform is implemented by using a development board based on a decoding chip (the decoding chip in the present invention may be a Hi3531DV200 chip of huashi), and a software system running on the hardware platform further includes the following modules:
and the TS stream acquisition module is used for acquiring N paths of TS clear streams in real time, wherein N is more than or equal to 1. The TS stream acquisition module adopts a network streaming media technology to realize real-time transmission of video streams in a local area network by using RTSP/RTP/RTCP and other communication protocols, and in the embodiment, the TS stream acquisition module acquires the video streams of N paths of digital televisions through RTSP, and the system disclosed by the invention realizes real-time monitoring of the transmission code streams.
And the decoding module is used for decoding the acquired N-path TS clear stream. The decoding module acquires a video code stream from a buffer of upper software by utilizing a video decoder of the decoding chip, analyzes the video code stream, and outputs decoded data to a buffer pool.
And the monitoring module is used for carrying out N paths of monitoring on the video data decoded by the decoding module. The monitoring module monitors the decoded video data by utilizing an image recognition technology, and mainly comprises abnormal monitoring of a video black field and a static frame. When black field and static frame faults occur, the monitoring module transmits the start-stop time and duration time of the faults to the PC monitoring terminal in a word mode, and the PC monitoring terminal can store word information locally, so that the monitoring of the static frame and black field faults and the display and recording of alarm information are completed.
And the coding module is used for carrying out N paths of coding on the video stream data after the monitoring is completed according to the H.265 protocol.
Video stream output module: and pushing the N paths of code streams coded by the coding module to a network port where a PC streaming media server is located by adopting a network streaming media technology, and playing the video streams after transcoding by a VLC player.
Another aspect of this embodiment provides an application of the above digital television monitoring system in multi-channel digital television monitoring, for implementing at least two channels 1080p@30fps digital television monitoring video output. In this embodiment, when n=16, 16 paths of digital television monitor video output of 1080p@30fps may be implemented. The multi-channel digital television monitoring system realized based on the digital television monitoring system is shown in fig. 1.
Another aspect of the present embodiment provides a digital television monitoring method, including the following steps:
and step 1, a TS stream acquisition module acquires N TS clear streams in real time, wherein N is more than or equal to 1. In this embodiment, the TS stream obtaining module obtains the video stream of the N paths of digital televisions through RTSP, and step 1 includes the following steps:
FFmpeg pushes N RTSP streams of digital television video stored by a local PC to an Nginx server, and then a development board based on a decoding chip receives real-time video streams by connecting with the Nginx server. FFmpeg and nglnx can be obtained from the local network and configured for installation, and after successful installation, FFmpeg commands can be used: the TS video stream data is pushed to the Nginx server in real time by the ffmpeg-re-i d: \Hi3531DV200\dv200video\test.ts mpeg-2-vcodec copy-f rtsp:// 192.168.3.173:554. In this embodiment, a program flow of the TS stream acquisition module for acquiring the TS video stream is shown in fig. 2.
And step 2, decoding the obtained N-path TS clear stream by a decoding module. As shown in fig. 3, step 2 further includes the steps of:
step 201, initializing a system and a video cache pool VB, including initializing the number of decoding channels, the size of the video cache pool, decoding protocols and the like;
step 202, creating N paths of decoding channels and binding a video buffer pool VB, and carrying out parameter configuration on the N paths of decoding channels, such as configuration buffer area size and the like;
step 203, the obtained N paths of code streams are sent to N paths of decoding channels, and decoding is carried out by using a decoder;
step 204, if decoding is completed, unbinding the N paths of decoding channels with the video cache pool VB, and destroying the N paths of decoding channels;
if decoding is not complete, N threads are created to process the output of the decoder.
And 3, monitoring the decoded video data by utilizing an image recognition technology, wherein the monitoring comprises abnormal monitoring of a video black field and a static frame. When black field and static frame faults occur, the start-stop time and duration time of the faults are transmitted to the PC monitoring terminal in a word mode, and the PC monitoring terminal can store word information locally, so that the static frame and black field faults are monitored, and alarm information is displayed and recorded.
In this embodiment, the method for judging the black field fault is shown in fig. 4, and includes the following steps:
step 3101, performing feature segmentation on the image, and segmenting the image into a plurality of small areas;
step 3102, taking the sum of the gray values of the pixel points in each small area as a characteristic value, and sequentially comparing the gray value with the characteristic value of other small areas by taking the characteristic value of a certain small area (the first small area in the embodiment) as a reference standard:
judging a comparison standard by a method of setting a threshold value, and judging that a black field fault occurs currently if the difference between the characteristic values of other small areas and the characteristic values of the reference standard is smaller than a preset threshold value; if the difference between the characteristic value of the other small region and the reference standard characteristic value is larger than a preset threshold value, the black field fault is considered not to occur.
The static frame fault judging method is shown in fig. 5, and comprises the following steps:
step 3201, performing feature segmentation on an image, and segmenting the image into a plurality of small areas;
step 3202, two eigenvalues are taken and respectively defined as an eigenvalue a and an eigenvalue B for judgment, wherein the eigenvalue a is the sum of gray value differences of all points in a corresponding divided area of two adjacent frames of images, so as to express the integral change on the divided area, and the eigenvalue B is the sum of absolute values of gray value differences of all points, so as to reflect the change of a single point:
if the characteristic values A of the images of the two adjacent frames are not matched, the images of the two adjacent frames are considered to have larger change, namely, the images of the two adjacent frames are judged to be not static frame faults; otherwise, judging the characteristic value B, if the characteristic value B comparison values of the images of the two adjacent frames are different, indicating that certain pixel point values of the images of the two adjacent frames are different in the corresponding dividing regions, and not generating a static frame fault, otherwise, judging that the static frame fault is generated, wherein whether the static frame is a static frame or not adopts a threshold value method, and if the characteristic value A and the characteristic value B of each region are lower than the corresponding threshold value, judging that the images are matched, namely, generating the static frame fault.
And 4, encoding the video stream data after monitoring according to an H.265 protocol. As shown in fig. 6, the method comprises the following steps:
step 401, creating N coding channels and initializing;
step 402, binding the coding channel with the VPSS module;
step 403, after the N coding channels respectively receive the image data, starting H.265 coding;
step 404, if the encoding is completed, unbinding the N encoding channels with the VPSS module, and destroying the encoding channels;
if the encoding is not complete, N threads are created to process the encoded output.
Step 5: and pushing the coded code stream to a network port where a PC streaming media server is located by adopting a network streaming media technology, and playing the transcoded video stream by a VLC player. The output process of the video stream is shown in fig. 7.
Another aspect of this embodiment is to provide an application of the above digital television monitoring method in multi-channel digital television monitoring, so as to implement at least two channels 1080p@30fps digital television monitoring video output. In this embodiment, when n=16, 16 paths of digital television monitor video output of 1080p@30fps may be implemented.
Claims (9)
1. The digital television monitoring system is characterized by comprising a hardware platform and a software system running on the hardware platform, and further comprising the following modules:
the TS stream acquisition module is used for acquiring N paths of TS clear streams in real time, wherein N is more than or equal to 1;
the decoding module is used for decoding the acquired N-channel TS clear stream, wherein the decoding module acquires a video code stream from a buffer of upper software by utilizing a video decoder of a decoding chip, analyzes the video code stream, and outputs decoded data into a buffer pool;
the monitoring module is used for carrying out N-way monitoring on the video data decoded by the decoding module, wherein the monitoring module monitors the video data decoded by the decoding module by utilizing an image recognition technology, comprises abnormal monitoring of a video black field and a static frame, and when a black field or static frame fault occurs, the monitoring module transmits the start-stop time and duration time of the fault to the PC monitoring terminal in a word mode in a network manner, and the PC monitoring terminal stores word information to the local so as to complete monitoring of the static frame and the black field fault and display and recording of alarm information;
the coding module is used for carrying out N paths of coding on the video stream data after the monitoring is completed according to an H.265 protocol;
video stream output module: and pushing the N paths of code streams coded by the coding module to a network port where a PC streaming media server is located by adopting a network streaming media technology, and playing the video streams after transcoding by a VLC player.
2. The digital television monitoring system of claim 1, wherein the TS stream acquisition module uses network streaming media technology to implement real-time transmission of video streams within a local area network using communication protocols including RTSP, RTP, or RTCP.
3. Use of a digital television monitoring system according to claim 1 for multi-channel digital television monitoring for implementing at least two channels 1080p@30fps digital television monitoring video output.
4. A digital television monitoring method implemented based on the digital television monitoring system of claim 1, comprising the steps of:
step 1, a TS stream acquisition module acquires N TS clear streams in real time, wherein N is more than or equal to 1;
step 2, decoding the obtained N-path TS clear stream by a decoding module;
step 3, monitoring the decoded video data by utilizing an image recognition technology, wherein the monitoring comprises abnormal monitoring of a video black field and a static frame; when black field and static frame faults occur, the start-stop time and duration time of the faults are transmitted to the PC monitoring terminal in a word mode, and the PC monitoring terminal stores word information locally, so that the monitoring of the static frame and black field faults and the display and recording of alarm information are completed;
step 4, coding the video stream data after monitoring according to the H.265 protocol;
and step 5, pushing the coded code stream to a network port where a PC streaming media server is located by adopting a network streaming media technology, and playing the transcoded video stream by a VLC player.
5. The digital television monitoring method according to claim 4, wherein the step 2 further comprises the steps of:
step 201, initializing a system and a video cache pool VB;
step 202, creating N paths of decoding channels and binding a video cache pool VB;
step 203, the obtained N paths of code streams are sent to N paths of decoding channels, and decoding is carried out by using a decoder;
and 204, creating the output of the N thread processing decoders, unbinding the N decoding channels with the video cache pool VB after decoding is completed, and then destroying the N decoding channels.
6. The digital television monitoring method according to claim 4, wherein in step 3, the black field fault judging method comprises the steps of:
step 3101, performing feature segmentation on each video image, and segmenting the image into a plurality of small areas;
step 3102, taking the gray value sum of the pixel points in each small area as the characteristic value of the current area, and comparing the gray value sum with the characteristic value of other small areas in sequence by taking the characteristic value of a certain small area as a reference standard, and judging that a black field fault occurs currently if the difference between the characteristic value of the other small areas and the characteristic value of the reference standard is smaller than a preset threshold value; if the difference between the characteristic value of the other small region and the reference standard characteristic value is larger than a preset threshold value, the black field fault is considered not to occur.
7. The digital television monitoring method according to claim 4, wherein in step 3, the method for judging the static frame fault comprises the steps of:
step 3201, performing feature segmentation on each video image, and segmenting the image into a plurality of segmentation areas;
step 3202, two eigenvalues are taken and respectively defined as an eigenvalue A and an eigenvalue B for judgment, wherein the eigenvalue A is the sum of gray value differences of all points of corresponding divided areas of two adjacent frames of images, so that the integral change of the divided areas is expressed, and the eigenvalue B is the sum of absolute values of gray value differences of all points of corresponding divided areas of two adjacent frames of images, so that the change of a single point is reflected;
step 3203, if the obtained characteristic value A of the images of the adjacent two frames is lower than a preset threshold value A, the characteristic value A of the images of the adjacent two frames is considered to be matched, and step 3204 is performed, otherwise, the characteristic value A of the images of the adjacent two frames is considered to be not matched, and the static frame fault is judged not to occur;
step 3204, if the obtained feature value B of the images of the two adjacent frames is lower than a preset threshold value B, the feature values B of the images of the two adjacent frames are considered to be matched, and the occurrence of a static frame fault is determined, otherwise, the feature values B of the images of the two adjacent frames are considered to be not matched, and the occurrence of no static frame fault is determined.
8. The digital television monitoring method according to claim 4, wherein the step 4 comprises the steps of:
step 401, creating N coding channels and initializing;
step 402, binding the coding channel with the VPSS module;
step 403, after the N coding channels respectively receive the image data, starting H.265 coding;
step 404, creating N threads to process the encoded output, and after encoding is completed, unbinding N encoding channels with the VPSS module, and then destroying the encoding channels.
9. A digital television monitoring method for multi-channel digital television monitoring as set forth in claim 4 for implementing at least two channels 1080p@30fps digital television monitoring video output.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311546690.6A CN117255222A (en) | 2023-11-20 | 2023-11-20 | Digital television monitoring method, system and application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311546690.6A CN117255222A (en) | 2023-11-20 | 2023-11-20 | Digital television monitoring method, system and application |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117255222A true CN117255222A (en) | 2023-12-19 |
Family
ID=89131804
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311546690.6A Pending CN117255222A (en) | 2023-11-20 | 2023-11-20 | Digital television monitoring method, system and application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117255222A (en) |
Citations (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002262272A (en) * | 2001-02-28 | 2002-09-13 | Hitachi Ltd | Digital supervisory camera system and controller |
| JP2006203342A (en) * | 2005-01-18 | 2006-08-03 | Mitsubishi Electric Corp | System for monitoring video image |
| JP2006345169A (en) * | 2005-06-08 | 2006-12-21 | Matsushita Electric Ind Co Ltd | Digital television receiving terminal device |
| CN101072370A (en) * | 2006-05-09 | 2007-11-14 | 罗燕海 | Control device for preventing unlicensed signal from getting to broadcasting television play device |
| US20080106544A1 (en) * | 2006-11-03 | 2008-05-08 | Chi Mei Optoelectronics Corp. | Motion detection apparatus and method applied to liquid crystal display device |
| JP2009010823A (en) * | 2007-06-29 | 2009-01-15 | Sony Corp | Image processing device and image processing method, recording medium, and program |
| US20090244290A1 (en) * | 2008-03-31 | 2009-10-01 | Verizon Services Corp. | Systems and methods for monitoring, troubleshooting and/or controlling a digital television |
| CN102055736A (en) * | 2009-10-29 | 2011-05-11 | 北京金石智博科技发展有限公司 | Mobile phone audio/video monitoring software |
| CN102752667A (en) * | 2012-07-17 | 2012-10-24 | 王加俊 | Multi-stream media live broadcast interaction system and live broadcast interaction method |
| JP2013197927A (en) * | 2012-03-21 | 2013-09-30 | Mitsubishi Electric Corp | Video monitoring device and video monitoring system |
| CN103442266A (en) * | 2013-08-16 | 2013-12-11 | 北京视博数字电视科技有限公司 | Method and device for obtaining image source data |
| CN103873852A (en) * | 2012-12-11 | 2014-06-18 | 上海文广互动电视有限公司 | Multi-mode parallel video quality fault detection method and device |
| KR20150084236A (en) * | 2014-01-13 | 2015-07-22 | 한화테크윈 주식회사 | Apparatus and method for decoding |
| CN104980803A (en) * | 2015-07-29 | 2015-10-14 | 深圳市芯智科技有限公司 | Autonomic middleware intelligent DVBS2 set-top-box system and processing method thereof |
| CN105025228A (en) * | 2015-07-22 | 2015-11-04 | 深圳市万姓宗祠网络科技股份有限公司 | Method for recording video and images continuously based on picture states |
| CN105578177A (en) * | 2015-12-15 | 2016-05-11 | 浙江广播电视集团 | Video static frame detection system based on CRC check and method thereof |
| CN106412626A (en) * | 2016-10-31 | 2017-02-15 | 武汉斗鱼网络科技有限公司 | Live video processing method and device |
| WO2017113474A1 (en) * | 2015-12-30 | 2017-07-06 | 邦彦技术股份有限公司 | Multichannel video stream control system and method based on dsp |
| WO2017181389A1 (en) * | 2016-04-21 | 2017-10-26 | 深圳市樊溪电子有限公司 | Fault monitoring system for multi-channel audio and video signals |
| US20180091847A1 (en) * | 2015-03-20 | 2018-03-29 | Liuzhou Guitong Technology Co., Ltd. | Method and System for Synchronously Reproducing Multimedia Multi-Information |
| WO2019177906A1 (en) * | 2018-03-11 | 2019-09-19 | Google Llc | Static video recognition |
| CN110324665A (en) * | 2019-07-25 | 2019-10-11 | 深圳创维－Rgb电子有限公司 | A kind of method, terminal and the storage medium of the automatic review of a film by the censor |
| CN111839444A (en) * | 2019-04-25 | 2020-10-30 | 天津御锦人工智能医疗科技有限公司 | A stationary detection method of colonoscopy lens based on image recognition and matching |
| CN113645490A (en) * | 2021-06-23 | 2021-11-12 | 天津津航计算技术研究所 | Soft and hard combined multi-channel video synchronous decoding method |
| CN113727114A (en) * | 2021-07-21 | 2021-11-30 | 天津津航计算技术研究所 | Transcoding video decoding method |
| CN113946526A (en) * | 2021-10-29 | 2022-01-18 | 西安微电子技术研究所 | Multi-channel data binding system and method of high-speed serial bus |
| CN115695811A (en) * | 2022-10-27 | 2023-02-03 | 天津津航计算技术研究所 | Multi-channel PAL system video transmission display device and transmission display method |
| CN115834952A (en) * | 2021-09-16 | 2023-03-21 | 北京字跳网络技术有限公司 | Video frame rate detection method and device based on visual perception |
| CN115955568A (en) * | 2023-03-14 | 2023-04-11 | 中国电子科技集团公司第五十四研究所 | Low-delay video compression and intelligent target identification method based on Haesi chip |
-
2023
- 2023-11-20 CN CN202311546690.6A patent/CN117255222A/en active Pending
Patent Citations (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002262272A (en) * | 2001-02-28 | 2002-09-13 | Hitachi Ltd | Digital supervisory camera system and controller |
| JP2006203342A (en) * | 2005-01-18 | 2006-08-03 | Mitsubishi Electric Corp | System for monitoring video image |
| JP2006345169A (en) * | 2005-06-08 | 2006-12-21 | Matsushita Electric Ind Co Ltd | Digital television receiving terminal device |
| CN101072370A (en) * | 2006-05-09 | 2007-11-14 | 罗燕海 | Control device for preventing unlicensed signal from getting to broadcasting television play device |
| US20080106544A1 (en) * | 2006-11-03 | 2008-05-08 | Chi Mei Optoelectronics Corp. | Motion detection apparatus and method applied to liquid crystal display device |
| JP2009010823A (en) * | 2007-06-29 | 2009-01-15 | Sony Corp | Image processing device and image processing method, recording medium, and program |
| US20090244290A1 (en) * | 2008-03-31 | 2009-10-01 | Verizon Services Corp. | Systems and methods for monitoring, troubleshooting and/or controlling a digital television |
| CN102055736A (en) * | 2009-10-29 | 2011-05-11 | 北京金石智博科技发展有限公司 | Mobile phone audio/video monitoring software |
| JP2013197927A (en) * | 2012-03-21 | 2013-09-30 | Mitsubishi Electric Corp | Video monitoring device and video monitoring system |
| CN102752667A (en) * | 2012-07-17 | 2012-10-24 | 王加俊 | Multi-stream media live broadcast interaction system and live broadcast interaction method |
| CN103873852A (en) * | 2012-12-11 | 2014-06-18 | 上海文广互动电视有限公司 | Multi-mode parallel video quality fault detection method and device |
| CN103442266A (en) * | 2013-08-16 | 2013-12-11 | 北京视博数字电视科技有限公司 | Method and device for obtaining image source data |
| KR20150084236A (en) * | 2014-01-13 | 2015-07-22 | 한화테크윈 주식회사 | Apparatus and method for decoding |
| US20180091847A1 (en) * | 2015-03-20 | 2018-03-29 | Liuzhou Guitong Technology Co., Ltd. | Method and System for Synchronously Reproducing Multimedia Multi-Information |
| CN105025228A (en) * | 2015-07-22 | 2015-11-04 | 深圳市万姓宗祠网络科技股份有限公司 | Method for recording video and images continuously based on picture states |
| CN104980803A (en) * | 2015-07-29 | 2015-10-14 | 深圳市芯智科技有限公司 | Autonomic middleware intelligent DVBS2 set-top-box system and processing method thereof |
| CN105578177A (en) * | 2015-12-15 | 2016-05-11 | 浙江广播电视集团 | Video static frame detection system based on CRC check and method thereof |
| WO2017113474A1 (en) * | 2015-12-30 | 2017-07-06 | 邦彦技术股份有限公司 | Multichannel video stream control system and method based on dsp |
| WO2017181389A1 (en) * | 2016-04-21 | 2017-10-26 | 深圳市樊溪电子有限公司 | Fault monitoring system for multi-channel audio and video signals |
| CN106412626A (en) * | 2016-10-31 | 2017-02-15 | 武汉斗鱼网络科技有限公司 | Live video processing method and device |
| WO2019177906A1 (en) * | 2018-03-11 | 2019-09-19 | Google Llc | Static video recognition |
| CN111839444A (en) * | 2019-04-25 | 2020-10-30 | 天津御锦人工智能医疗科技有限公司 | A stationary detection method of colonoscopy lens based on image recognition and matching |
| CN110324665A (en) * | 2019-07-25 | 2019-10-11 | 深圳创维－Rgb电子有限公司 | A kind of method, terminal and the storage medium of the automatic review of a film by the censor |
| CN113645490A (en) * | 2021-06-23 | 2021-11-12 | 天津津航计算技术研究所 | Soft and hard combined multi-channel video synchronous decoding method |
| CN113727114A (en) * | 2021-07-21 | 2021-11-30 | 天津津航计算技术研究所 | Transcoding video decoding method |
| CN115834952A (en) * | 2021-09-16 | 2023-03-21 | 北京字跳网络技术有限公司 | Video frame rate detection method and device based on visual perception |
| CN113946526A (en) * | 2021-10-29 | 2022-01-18 | 西安微电子技术研究所 | Multi-channel data binding system and method of high-speed serial bus |
| CN115695811A (en) * | 2022-10-27 | 2023-02-03 | 天津津航计算技术研究所 | Multi-channel PAL system video transmission display device and transmission display method |
| CN115955568A (en) * | 2023-03-14 | 2023-04-11 | 中国电子科技集团公司第五十四研究所 | Low-delay video compression and intelligent target identification method based on Haesi chip |
Non-Patent Citations (7)
| Title |
|---|
| 司文丽: "图像识别技术在数字电视视频监测中应用的研究", 《中国优秀硕士学位论文全文数据库（电子期刊）信息科技辑》, pages 9 - 68 * |
| 吴彤云;李朝晖;李冬梅;: "一种基于视频分析的值班人员睡眠检测算法", 电视技术, no. 07 * |
| 周锋, 魏蛟龙, 郑金福, 郭忠武: "电视信号中黑场与静帧的监测", 有线电视技术, no. 16 * |
| 李欣时;仲影;: "数字电视多画面显示及监控系统的实现", 有线电视技术, no. 08, pages 108 - 110 * |
| 郭学亮;: "数字有线电视监测系统的应用", 西部广播电视, no. 23, 5 December 2014 (2014-12-05) * |
| 陆永忠;谭晶;: "数字电视网络前端监视系统的开发", 中国有线电视, no. 13, 15 July 2006 (2006-07-15) * |
| 韩正强;施旭东;: "云南省广播电视村村通直播卫星接收信号监测平台系统设计与实现", 通讯世界, no. 18, 25 September 2016 (2016-09-25) * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102006475B (en) | Video coding and decoding device and method | |
| US6989868B2 (en) | Method of converting format of encoded video data and apparatus therefor | |
| US11265599B2 (en) | Re-encoding predicted picture frames in live video stream applications | |
| CN102006473B (en) | Video encoder and encoding method, and video decoder and decoding method | |
| CN103002353B (en) | The method that multimedia file is encapsulated and device | |
| US20100027679A1 (en) | Information processing device and method | |
| RU2283543C2 (en) | Method for processing error code of compressed image during transmission | |
| CN101917612A (en) | Streaming media video coding method and device | |
| CA2529889A1 (en) | Stream switching based on gradual decoder refresh | |
| CN106454186A (en) | Multi-channel video recording and platform interaction method and device based on Android system | |
| US8223270B2 (en) | Transmitter, receiver, transmission method, reception method, transmission program, reception program, and video content data structure | |
| CN1685368A (en) | Method and apparatus for encoding image and or audio data | |
| Wieckowski et al. | A complete end to end open source toolchain for the versatile video coding (VVC) standard | |
| CN1643608A (en) | Editing of encoded A/V sequences | |
| CN117255222A (en) | Digital television monitoring method, system and application | |
| CN104902281B (en) | A kind of information concealing method of the HEVC videos based on Hamming code+1 | |
| US8750384B2 (en) | Method and apparatus for avoiding quality deterioration of transmitted media content | |
| CN102427531A (en) | Cross-layer Interactive Image Quality Continuously Adjustable Real-time Video Coding and Decoding Method | |
| CN100548048C (en) | A method and device for testing and analyzing AVS video elementary streams | |
| CN1338235A (en) | Method and device for video compress encoding based on division | |
| CN113852825A (en) | Video classification and identification method based on AVS interframe predictive coding | |
| CN102271122B (en) | A kind of rubbish contents applied to P2P networks determine method and its system | |
| Fautier | Next-generation video compression techniques | |
| CN104469399A (en) | Method for macro block SKIP type selection in spatial resolution video transcoding | |
| CN110677664B (en) | Low-jitter code rate control method for 4K/8K ultra-high-definition video coding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |