[go: up one dir, main page]

CN111866584A - Automatic video content replacement system - Google Patents

Automatic video content replacement system Download PDF

Info

Publication number
CN111866584A
CN111866584A CN201910947634.0A CN201910947634A CN111866584A CN 111866584 A CN111866584 A CN 111866584A CN 201910947634 A CN201910947634 A CN 201910947634A CN 111866584 A CN111866584 A CN 111866584A
Authority
CN
China
Prior art keywords
image
video
content
processed
video frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910947634.0A
Other languages
Chinese (zh)
Inventor
高新华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201910947634.0A priority Critical patent/CN111866584A/en
Publication of CN111866584A publication Critical patent/CN111866584A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to a video content automatic replacement system, which comprises: the content grabbing equipment is arranged in the playing terminal and used for grabbing each frame of video frame of the currently played film from a video buffer area of the video player to serve as a video frame to be processed for output; the template setting equipment is used for setting a default background template according to the operation of a user, wherein the background template is a picture with a single color; and the targeted processing equipment is used for executing contrast identification operation on the video frame to be processed to obtain corresponding field contrast and executing image segmentation on the video frame to be processed based on the field contrast to obtain a plurality of image blocks. The automatic video content replacement system is simple and convenient to operate and convenient to control. Since the scene area in each frame of video image replaces the default background template to highlight the non-background content, the viewing effect is improved and the attention of the viewer is attracted.

Description

Automatic video content replacement system
Technical Field
The invention relates to the field of video players, in particular to an automatic video content replacement system.
Background
Video generally refers to various techniques for capturing, recording, processing, storing, transmitting, and reproducing a series of still images as electrical signals. When the continuous image changes more than 24 frames (frames) of pictures per second, human eyes cannot distinguish a single static picture according to the persistence of vision principle; it appears as a smooth continuous visual effect, so that the continuous picture is called a video.
Video technology was originally developed for television systems, but has now evolved into a variety of different formats to facilitate consumer recording of video. Advances in networking technology have also enabled recorded segments of video to be streamed over the internet and received and played by computers. Video and movies are different technologies that take advantage of photography to capture dynamic images as a series of still photographs.
Disclosure of Invention
The invention needs to have the following two key points:
(1) the selection of the image blocks is executed in a rhombus with higher traversal capability, and the analysis of the parameters is executed based on the selected image blocks, so that the reliability of the analyzed parameters is ensured while the data volume of the image analysis is reduced;
(2) and replacing the scene area in each frame of video image with the default background template to highlight the non-background content, thereby improving the viewing effect and attracting the attention of the audience.
According to an aspect of the present invention, there is provided a video content automatic replacement system, the system including:
the content grabbing equipment is arranged in the playing terminal and used for grabbing each frame of video frame of the currently played film from a video buffer area of the video player to serve as a video frame to be processed for output;
The template setting equipment is used for setting a default background template according to the operation of a user, wherein the background template is a picture with a single color;
the targeted processing equipment is arranged in the playing terminal, is connected with the content grabbing equipment, and is used for receiving the video frame to be processed, executing contrast identification operation on the video frame to be processed to obtain corresponding field contrast, and executing image segmentation on the video frame to be processed based on the field contrast to obtain a plurality of image blocks;
the data selection equipment is used for performing diamond drawing on the midpoint of the top pixel row, the midpoint of the bottom pixel row, the midpoint of the leftmost pixel row and the midpoint of the rightmost pixel row of the video frame to be processed in the video frame to be processed, and outputting an image block with contents overlapped with the drawn diamond as a reference image block;
the content correction device is connected with the data selection device and used for carrying out arithmetic mean calculation on each saturation value of each received reference image block so as to obtain and output a corresponding representative saturation value and further carrying out saturation processing on the video frame to be processed based on the representative saturation value so as to obtain and output a corresponding content correction image;
The background recognition device is connected with the content correction device and used for recognizing a background area in the received content correction image based on a preset background brightness range;
the data replacement device is respectively connected with the template setting device and the background recognition device and is used for replacing the background area in the content correction image with the default background template so as to play the content correction image with the background area replaced as a replacement image;
and the power line communication device is connected with the content correction device and used for receiving the content correction image and transmitting the content correction image through a power line communication link.
The automatic video content replacement system is simple and convenient to operate and convenient to control. Since the scene area in each frame of video image replaces the default background template to highlight the non-background content, the viewing effect is improved and the attention of the viewer is attracted.
Detailed Description
An embodiment of the automatic video content replacement system of the present invention will be described in detail below.
The image is the basis of human vision, is the objective reflection of natural scenes, and is an important source for human to know the world and human. The "picture" is the distribution of reflected or transmitted light from an object, the "image" is the impression or knowledge of the image in the human brain that the human visual system accepts, and photographs, paintings, clip art, maps, calligraphic works, handwritten chinese characters, faxes, satellite clouds, movie pictures, X-rays, electroencephalograms, electrocardiograms, and the like are images.
Images are a kind of similarity, vivid description or portrayal of objective objects, and are the most commonly used information carriers in human social activities. Or image, is a representation of an objective object that contains information about the object being described. It is the most important source of information for people. Statistically, about 75% of the information one obtains comes from vision.
At present, in the video playing process, some video pictures are too complex, so that the audience cannot find the watching key point immediately when watching, and then the video pictures are past, and the audience can only continue to follow the video process to find the next key point.
In order to overcome the defects, the invention builds an automatic video content replacement system, and can effectively solve the corresponding technical problem.
The automatic video content replacement system shown according to the embodiment of the present invention includes:
the content grabbing equipment is arranged in the playing terminal and used for grabbing each frame of video frame of the currently played film from a video buffer area of the video player to serve as a video frame to be processed for output;
The template setting equipment is used for setting a default background template according to the operation of a user, wherein the background template is a picture with a single color;
the targeted processing equipment is arranged in the playing terminal, is connected with the content grabbing equipment, and is used for receiving the video frame to be processed, executing contrast identification operation on the video frame to be processed to obtain corresponding field contrast, and executing image segmentation on the video frame to be processed based on the field contrast to obtain a plurality of image blocks;
the data selection equipment is used for performing diamond drawing on the midpoint of the top pixel row, the midpoint of the bottom pixel row, the midpoint of the leftmost pixel row and the midpoint of the rightmost pixel row of the video frame to be processed in the video frame to be processed, and outputting an image block with contents overlapped with the drawn diamond as a reference image block;
the content correction device is connected with the data selection device and used for carrying out arithmetic mean calculation on each saturation value of each received reference image block so as to obtain and output a corresponding representative saturation value and further carrying out saturation processing on the video frame to be processed based on the representative saturation value so as to obtain and output a corresponding content correction image;
The background recognition device is connected with the content correction device and used for recognizing a background area in the received content correction image based on a preset background brightness range;
the data replacement device is respectively connected with the template setting device and the background recognition device and is used for replacing the background area in the content correction image with the default background template so as to play the content correction image with the background area replaced as a replacement image;
a power line communication device connected to the content correction device for receiving the content correction image and transmitting the content correction image through a power line communication link;
a clock generating circuit connected to the data selecting device, the content modifying device and the power line communication device, respectively, for providing different clock signals to the data selecting device, the content modifying device and the power line communication device, respectively;
wherein, the targeted processing device is internally provided with a storage unit for receiving and storing the on-site contrast;
wherein, in the targeted processing device, the smaller the on-site contrast, the smaller the number of the obtained plurality of segmentation regions.
Next, the detailed structure of the video content automatic replacement system of the present invention will be further described.
The video content automatic replacement system can further comprise:
and the field enhancement equipment is arranged in the playing terminal, is connected with the content grabbing equipment and is used for performing image enhancement processing based on exponential transformation on the received video frame to be processed so as to obtain and output a corresponding exponential enhancement image.
The video content automatic replacement system can further comprise:
the gradient comparison equipment is connected with the field enhancement equipment and used for receiving the index enhancement image, acquiring the brightness value of each pixel point in the index enhancement image and executing the following actions aiming at each pixel point: and judging each gradient from the brightness value to each pixel point around, judging the gradient as an edge pixel point when each gradient is greater than or equal to a preset gradient threshold, and judging the pixel point as a non-edge pixel point when each gradient is less than the preset gradient threshold.
In the video content automatic replacement system:
the gradient comparison device is further configured to connect all edge pixel points in the exponentially enhanced image to obtain one or more closed curves, and divide one or more image regions from the exponentially enhanced image based on the one or more closed curves.
The video content automatic replacement system can further comprise:
the parameter identification device is connected with the gradient comparison device and is used for executing the following actions for each image area: the redundancy is determined based on the respective pixel values of the respective pixel points thereof.
The video content automatic replacement system can further comprise:
and the dynamic sharpening device is respectively connected with the gradient comparison device and the parameter identification device and is used for performing dynamic sharpening action on each image area in the index enhanced image only, and not performing dynamic sharpening action on areas outside one or more image areas in the index enhanced image.
In the video content automatic replacement system:
in the dynamic sharpening device, performing a dynamic sharpening action on each image region includes: and when the redundancy of the image area is greater than or equal to the preset redundancy, performing Kirsch operator sharpening on the image area, and when the redundancy of the image area is less than the preset redundancy, not performing the Kirsch operator sharpening on the image area.
In the video content automatic replacement system:
the dynamic sharpening device is further connected with the targeted processing device, and is configured to output the index enhanced image after each image area has performed the dynamic sharpening action to the targeted processing device as a dynamic sharpening image in place of the to-be-processed video frame.
The video content automatic replacement system can further comprise:
and the dynamic random access memory is connected with the dynamic sharpening equipment and is used for receiving the dynamic sharpened image and temporarily storing the dynamic sharpened image.
In addition, Power Line Carrier-PLC communication is a special communication method for voice or data transmission using a Power Line as an information transmission medium. The power lines are generally classified into high, medium and low 3 types in the field of power carrier, generally, a high-voltage power line refers to a voltage class of 35kV or more, a medium-voltage power line refers to a voltage class of 10kV, and a low-voltage distribution line refers to 380/220V subscriber lines.
Power Line Carrier (PLC) is a communication method specific to a Power system, and Power Line Carrier communication is a technology for transmitting analog or digital signals at high speed by a Carrier method using an existing Power Line. The method has the greatest characteristic that data transmission can be carried out only by wires without erecting a network again.
The power line carrier technology breaks through the limitation of being limited to the application of a single chip microcomputer, has entered the digital era, and with the continuous development of the power line carrier technology and the social needs, the technical development and application of medium/low voltage power line carrier communication are still emerging. The power line carrier communication is a popular specialty in the field of power communication, which is seen by foreign media and is gradually becoming unearthed Jinshan.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.

Claims (9)

1. An automatic video content replacement system, comprising:
the content grabbing equipment is arranged in the playing terminal and used for grabbing each frame of video frame of the currently played film from a video buffer area of the video player to serve as a video frame to be processed for output;
the template setting equipment is used for setting a default background template according to the operation of a user, wherein the background template is a picture with a single color;
the targeted processing equipment is arranged in the playing terminal, is connected with the content grabbing equipment, and is used for receiving the video frame to be processed, executing contrast identification operation on the video frame to be processed to obtain corresponding field contrast, and executing image segmentation on the video frame to be processed based on the field contrast to obtain a plurality of image blocks;
the data selection equipment is used for performing diamond drawing on the midpoint of the top pixel row, the midpoint of the bottom pixel row, the midpoint of the leftmost pixel row and the midpoint of the rightmost pixel row of the video frame to be processed in the video frame to be processed, and outputting an image block with contents overlapped with the drawn diamond as a reference image block;
the content correction device is connected with the data selection device and used for carrying out arithmetic mean calculation on each saturation value of each received reference image block so as to obtain and output a corresponding representative saturation value and further carrying out saturation processing on the video frame to be processed based on the representative saturation value so as to obtain and output a corresponding content correction image;
The background recognition device is connected with the content correction device and used for recognizing a background area in the received content correction image based on a preset background brightness range;
the data replacement device is respectively connected with the template setting device and the background recognition device and is used for replacing the background area in the content correction image with the default background template so as to play the content correction image with the background area replaced as a replacement image;
a power line communication device connected to the content correction device for receiving the content correction image and transmitting the content correction image through a power line communication link;
a clock generating circuit connected to the data selecting device, the content modifying device and the power line communication device, respectively, for providing different clock signals to the data selecting device, the content modifying device and the power line communication device, respectively;
wherein, the targeted processing device is internally provided with a storage unit for receiving and storing the on-site contrast;
wherein, in the targeted processing device, the smaller the on-site contrast, the smaller the number of the obtained plurality of segmentation regions.
2. The video content automatic replacement system according to claim 1, wherein the system further comprises:
and the field enhancement equipment is arranged in the playing terminal, is connected with the content grabbing equipment and is used for performing image enhancement processing based on exponential transformation on the received video frame to be processed so as to obtain and output a corresponding exponential enhancement image.
3. The video content automatic replacement system according to claim 2, wherein the system further comprises:
the gradient comparison equipment is connected with the field enhancement equipment and used for receiving the index enhancement image, acquiring the brightness value of each pixel point in the index enhancement image and executing the following actions aiming at each pixel point: and judging each gradient from the brightness value to each pixel point around, judging the gradient as an edge pixel point when each gradient is greater than or equal to a preset gradient threshold, and judging the pixel point as a non-edge pixel point when each gradient is less than the preset gradient threshold.
4. The video content automatic replacement system according to claim 3, wherein:
the gradient comparison device is further configured to connect all edge pixel points in the exponentially enhanced image to obtain one or more closed curves, and divide one or more image regions from the exponentially enhanced image based on the one or more closed curves.
5. The video content automatic replacement system according to claim 4, wherein the system further comprises:
the parameter identification device is connected with the gradient comparison device and is used for executing the following actions for each image area: the redundancy is determined based on the respective pixel values of the respective pixel points thereof.
6. The video content automatic replacement system according to claim 5, wherein the system further comprises:
and the dynamic sharpening device is respectively connected with the gradient comparison device and the parameter identification device and is used for performing dynamic sharpening action on each image area in the index enhanced image only, and not performing dynamic sharpening action on areas outside one or more image areas in the index enhanced image.
7. The video content automatic replacement system according to claim 6, wherein:
in the dynamic sharpening device, performing a dynamic sharpening action on each image region includes: and when the redundancy of the image area is greater than or equal to the preset redundancy, performing Kirsch operator sharpening on the image area, and when the redundancy of the image area is less than the preset redundancy, not performing the Kirsch operator sharpening on the image area.
8. The video content automatic replacement system according to claim 7, wherein:
the dynamic sharpening device is further connected with the targeted processing device, and is configured to output the index enhanced image after each image area has performed the dynamic sharpening action to the targeted processing device as a dynamic sharpening image in place of the to-be-processed video frame.
9. The video content automatic replacement system according to claim 8, wherein the system further comprises:
and the dynamic random access memory is connected with the dynamic sharpening equipment and is used for receiving the dynamic sharpened image and temporarily storing the dynamic sharpened image.
CN201910947634.0A 2019-10-08 2019-10-08 Automatic video content replacement system Pending CN111866584A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910947634.0A CN111866584A (en) 2019-10-08 2019-10-08 Automatic video content replacement system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910947634.0A CN111866584A (en) 2019-10-08 2019-10-08 Automatic video content replacement system

Publications (1)

Publication Number Publication Date
CN111866584A true CN111866584A (en) 2020-10-30

Family

ID=72970645

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910947634.0A Pending CN111866584A (en) 2019-10-08 2019-10-08 Automatic video content replacement system

Country Status (1)

Country Link
CN (1) CN111866584A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113099127A (en) * 2021-02-24 2021-07-09 影石创新科技股份有限公司 Video processing method, filter, device and medium for making stealth special effect
CN118803356A (en) * 2022-11-22 2024-10-18 荣耀终端有限公司 Method and electronic device for enhancing video quality

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102970529A (en) * 2012-10-22 2013-03-13 北京航空航天大学 Multi-viewpoint video fractal coding compressing and uncompressing method based on objects
CN109377502A (en) * 2018-10-15 2019-02-22 深圳市中科明望通信软件有限公司 A kind of image processing method, image processing apparatus and terminal device
CN110009638A (en) * 2019-04-12 2019-07-12 重庆交通大学 Appearance defect detection method of bridge cable image based on local statistical features
CN110298811A (en) * 2018-03-21 2019-10-01 北京大学 Preprocess method, device, terminal and the computer readable storage medium of image

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102970529A (en) * 2012-10-22 2013-03-13 北京航空航天大学 Multi-viewpoint video fractal coding compressing and uncompressing method based on objects
CN110298811A (en) * 2018-03-21 2019-10-01 北京大学 Preprocess method, device, terminal and the computer readable storage medium of image
CN109377502A (en) * 2018-10-15 2019-02-22 深圳市中科明望通信软件有限公司 A kind of image processing method, image processing apparatus and terminal device
CN110009638A (en) * 2019-04-12 2019-07-12 重庆交通大学 Appearance defect detection method of bridge cable image based on local statistical features

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113099127A (en) * 2021-02-24 2021-07-09 影石创新科技股份有限公司 Video processing method, filter, device and medium for making stealth special effect
CN113099127B (en) * 2021-02-24 2024-02-02 影石创新科技股份有限公司 Video processing method, device, equipment and medium for making stealth special effects
CN118803356A (en) * 2022-11-22 2024-10-18 荣耀终端有限公司 Method and electronic device for enhancing video quality

Similar Documents

Publication Publication Date Title
US9756283B1 (en) Systems and methods for identifying a black/non-black frame attribute
CN113518185B (en) Video conversion processing method and device, computer readable medium and electronic equipment
CN104469179A (en) Method for combining dynamic pictures into mobile phone video
EP1044432A1 (en) Improved image conversion and encoding techniques
CN113141512B (en) Video anchor picture detection system
US12243561B2 (en) Method and apparatus for generating video with 3D effect, method and apparatus for playing video with 3D effect, and device
CN111277910A (en) Bullet screen display method, device, electronic device and storage medium
CN112749696B (en) Text detection method and device
CN113784171A (en) Video data processing method, device, computer system and readable storage medium
WO2022087826A1 (en) Video processing method and apparatus, mobile device, and readable storage medium
CN111866584A (en) Automatic video content replacement system
EP4322115A1 (en) Finding the semantic region of interest in images
US8824778B2 (en) Systems and methods for depth map generation
CN115396705B (en) Screen operation verification method, platform and system
CN116188296A (en) Image optimization method and device, equipment, medium and product thereof
CN108470362A (en) A kind of method and apparatus for realizing video toning
US20200396440A1 (en) Method for video quality detection and image processing circuit using the same
US20230343017A1 (en) Virtual viewport generation method and apparatus, rendering and decoding methods and apparatuses, device and storage medium
CN113962964B (en) Specified object erasing method and device based on time sequence image data
CN114584832B (en) Video self-adaptive multi-size dynamic playing method and device
CN111510767B (en) Video watermark identification method and identification device thereof
CN117474786A (en) Video noise reduction method, video playing method, video noise reduction device and electronic equipment
US11908340B2 (en) Magnification enhancement of video for visually impaired viewers
CN113613024A (en) Video preprocessing method and device
CN117221504B (en) Video matting method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201030