CN100556136C - Video watermark process based on the location, moving region - Google Patents
Video watermark process based on the location, moving region Download PDFInfo
- Publication number
- CN100556136C CN100556136C CNB2008100155806A CN200810015580A CN100556136C CN 100556136 C CN100556136 C CN 100556136C CN B2008100155806 A CNB2008100155806 A CN B2008100155806A CN 200810015580 A CN200810015580 A CN 200810015580A CN 100556136 C CN100556136 C CN 100556136C
- Authority
- CN
- China
- Prior art keywords
- watermark
- frame
- video
- motion
- moving region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 230000008569 process Effects 0.000 title description 9
- 230000033001 locomotion Effects 0.000 claims abstract description 42
- 238000001514 detection method Methods 0.000 claims abstract description 9
- 238000007619 statistical method Methods 0.000 claims abstract description 5
- 239000000284 extract Substances 0.000 claims description 12
- 238000000605 extraction Methods 0.000 claims description 10
- 238000005303 weighing Methods 0.000 claims description 5
- 238000012880 independent component analysis Methods 0.000 description 7
- 230000006835 compression Effects 0.000 description 5
- 238000007906 compression Methods 0.000 description 5
- 238000012217 deletion Methods 0.000 description 5
- 230000037430 deletion Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000013139 quantization Methods 0.000 description 4
- 238000011160 research Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000009432 framing Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000011002 quantification Methods 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241001147416 Ursus maritimus Species 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
- Editing Of Facsimile Originals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明提供一种基于运动区域定位的视频水印方法。这个方法将水印嵌入至视频各帧中通过定位得到的运动区域中，首先将视频分解成帧，提取相邻两帧的运动分量帧，即包含相邻两帧相对运动信息的帧图像，然后根据此运动分量帧定位原视频帧中相对运动最剧烈的区域，即实现运动区域的定位；在前帧的运动区域中嵌入水印，对视频中的每帧进行相同的操作，重建得到嵌入水印的视频；检测水印时，根据上述相同的方法，定位视频每帧的运动区域以提取水印，为提高水印检测的正确率，对各帧提取的水印进行统计分析，得到最后的检测结果。本发明对水印的鲁棒性及不可见性有极大的改善与提高。
The invention provides a video watermarking method based on motion region positioning. This method embeds the watermark into the motion area obtained by positioning in each frame of the video. First, the video is decomposed into frames, and the motion component frames of two adjacent frames are extracted, that is, the frame images containing the relative motion information of two adjacent frames. Then, according to This motion component frame locates the area with the most intense relative motion in the original video frame, that is, realizes the positioning of the motion area; embeds the watermark in the motion area of the previous frame, performs the same operation on each frame in the video, and reconstructs the video embedded with the watermark ; When detecting the watermark, according to the above-mentioned same method, locate the moving area of each frame of the video to extract the watermark, in order to improve the accuracy of watermark detection, statistical analysis is carried out on the watermark extracted by each frame, and the final detection result is obtained. The invention greatly improves and enhances the robustness and invisibility of the watermark.
Description
Technical field
The present invention relates to a kind of Techniques on Digital Video Watermarking, belong to video, multimedia signal processing technique field based on the location, moving region.
It has taken into full account the human eye visual characteristic relatively low to the variation sensitiveness of moving region and adjacent domain thereof, location by the moving region, watermark is embedded in the moving region of frame of video, and adopt QIM algorithm based on vision mode, guaranteeing to make watermark have higher robustness under the sightless prerequisite of watermark.
Background technology
Along with network technology and development of multimedia technology, daily life more and more trends towards digitlization and networking with work, and multi-medium data becomes the important source that people obtain information gradually.People not only can obtain and the identical duplicate of initial data by network, and can have no restrictedly to edit, revise, copy and scatter these multimedia messagess, the information security issue that causes thus, problem of piracy and dispute over copyright problem become the factor that influences social stability.Under this background, copyright protection, the issue that digital watermark technology is widely used in digital product as the important means of information protection follow the trail of and research topics such as authentication in go.
Digital watermark technology has been obtained very big development in recent years, but research mainly concentrates on the rest image digital watermark.Aspect video watermark research, because comprising the more accurate human vision model of characteristics such as spatial concealment effect does not set up as yet fully, the appearance of some special attack forms (as frame exchange, frame cutting, frame deletion etc.) at video watermark, and characteristics such as the real-time of video watermark algorithm and blind Detecting make the video watermark research and development relatively lag behind.The video watermark algorithm mainly is divided three classes at present: watermarked in original video, and watermarked in compressed video, and watermarked when encoding compression.The algorithm that the original video watermark embeds is fairly simple, complexity is relatively low, the method that watermark embeds is also many, can make full use of the digital watermark of rest image, and the algorithm comparative maturity still, needs decoding earlier to the video that has compressed, recompile again after watermarked tends to influence the quality of video and the robustness and the invisibility of watermark.The process that the algorithm that the compressed video watermark embeds does not have decoding and encodes, thereby can not cause the decline of video quality, but define the size of watermarked data volume owing to the restriction of compression bit rate, watermarked intensity is subjected to the constraint of video decode error, and perceptible variation may appear in the effect after the embedding.Watermarked when encoding compression, general consideration combines with certain dynamic image expert group (MPEG) coding standard, as common MPEG-1, MPEG-2 or MPEG-4, the embedding of its algorithm and extraction are handled can be fairly simple, can realize the real-time processing that watermark embeds and extracts, but it need revise encoder, and has the accumulation of error of picture group (GOP), causes the reduction of video quality.
Summary of the invention
The present invention is directed to the deficiency that present original video watermarking algorithm exists, a kind of video watermark process based on the location, moving region is provided, the method has great improvement and raising to the robustness and the invisibility of watermark.
The video watermark process based on the location, moving region that the present invention proposes may further comprise the steps:
(1) location, moving region, the component motion frame of adjacent two frames promptly comprises the two field picture of adjacent two frame relative motion information, and realizes the location of moving region in the original video frame in view of the above in the extraction video;
(2) watermarked, according to location, the moving region in the step (1), watermark is embedded the moving region of each frame of video;
(3) detect watermark, each frame of video is carried out watermark extracting, and the further watermark of each frame extraction of statistical analysis, to detect in the video whether contain watermark information.
Every frame in the video all passes through the location of the moving region of frame realization thereafter, and every frame is all watermarked according to step (2), but except the last frame.Can resist frame deletion like this attacks.
The specific implementation step of described step (1) is:
A extracts the component motion frame of adjacent two frames in the video, promptly comprises the two field picture of adjacent two frame relative motion information;
B resolves into the fritter that is easy to encode of non-overlapping copies with the component motion frame, and calculates the variance of each piece;
Square that comprises at least four fritters of c definition is a macro block, with this macro block scanning motion component frame, with the variance of each fritter in the macro block with as weighing the whether violent standard of motion, with variance and maximum macro block is that a square region is determined at the center, this zone corresponds in the former frame of video, is the moving region that will locate.
The length of neglecting watermark greatly of square region is determined among the above-mentioned steps c, should satisfy the requirement of each fritter embedding one bit watermark information in the square region.
Extract in the described step (1) method that the component motion frame of adjacent two frames in the video adopted be based on method of wavelet, based on the method for two-dimentional principal component analysis (2DPCA), the method that the front and back frame subtracts each other, independent component analysis (ICA) algorithm.When adopting independent component analysis (ICA) algorithm can be quick independent component analysis (FastICA) algorithm.
The watermarking algorithm of watermarked employing is the watermarking algorithm that is applicable to rest image in the described step (2), particularly based on quantization index modulation (QIM) algorithm of vision mode.
The specific implementation step of described step (3) is:
The watermark that a extracts each frame according to the extraction step of the watermarking algorithm that adopts in the step (2);
B utilizes voting method that statistical analysis is carried out in the watermark that each frame extracts, i.e. certain bit of watermark extracts that this bit is 1 in the watermark that obtains if surpass half frame of sum, and then this bit is judged to 1, otherwise is judged to 0.
The present invention considers the visual characteristic that human eye is relatively low to the variation sensitiveness of moving region and adjacent domain thereof, makes full use of the interframe relation of video sequence, and the setting movement zone is with watermarked.The method has great improvement and raising to the robustness and the invisibility of watermark.
Description of drawings
Fig. 1 is the frame diagram of the inventive method.
Fig. 2 is the key diagram of moving region position fixing process, and the little square frame in the frame of the left side is represented macro block, and big square frame is represented corresponding moving region in the frame of video.
Prior image frame in Fig. 3 video in adjacent two frames.
Fig. 4 is the back two field picture in adjacent two frames in the video.
Fig. 5 is the component motion frame that the FastICA algorithm extracts, and promptly comprises the two field picture of adjacent two frame relative motion information.
Fig. 6 is the static component frame that the FastICA algorithm extracts, and promptly comprises the two field picture of adjacent two frame background informations.
Fig. 7 is a QIM watermarking algorithm flow chart, and its flow chart is made up of watermark embedding, Channel Transmission and watermark detection three parts.
Fig. 8 is Y-PSNR (PSNR) curve chart of each frame in the watermark video.
Embodiment
Adopt quick independent component analysis (FastICA) algorithm to extract the dynamic component frame, promptly extract the two field picture that comprises adjacent two frame relative motion information, and adopt that quantization index modulation (QIM) algorithm in the existing watermarking algorithm is watermarked to be specifically described for example.Those skilled in the art also can adopt other algorithms to carry out the extraction of dynamic component according to explanation, the method for subtracting each other as adjacent two frames, utilize method of wavelet and other ICA algorithm etc.In addition, in watermarked, also can utilize other existing watermarking algorithm, as spread spectrum (SS) watermarking algorithm, based on the watermarking algorithm of small echo, based on watermarking algorithm of singular value decomposition etc.
Fig. 1 has provided the frame diagram of the inventive method, and flow process shown in pressing comprises following concrete steps:
1. locate the moving region, promptly determines the embedded location of watermark
Original video is decomposed framing, utilize the FastICA algorithm to extract the component motion frame of adjacent two frames, described component motion frame is meant the two field picture that comprises adjacent two frame relative motion information.The fritter that this component motion frame is resolved into non-overlapping copies and be easy to encode (size is 8*8 usually), and calculate the variance of each piece.With the macro block that is equivalent to four block sizes (size is 16*16 usually) scanning motion component frame, with the variance of each fritter in the macro block with as weighing the whether violent standard of motion, with variance and maximum macro block is that the center determines that a size is the square region of N*N, this zone corresponds to former frame of video, promptly obtains the moving region that will locate.Wherein, the size of moving region satisfies relational expression L=N * N by the decision of the length L of watermark, promptly embeds the watermark information of a bit in fritter.As shown in Figure 2.The result of FastICA algorithm extraction component motion such as Fig. 3, Fig. 4, Fig. 5, shown in Figure 6.
Why Fig. 3, Fig. 4, Fig. 5, Fig. 6 can interpretation scheme adopt variance as weighing the whether violent foundation of motion.As seen from Figure 5, only have texture at the moving region image, these textures have identified relative motion.And the violent motion of significant texture reflection, fuzzy texture represents its motion small, does not have the i.e. not motion generation of texture.Can draw from mathematical computations, the significant regional variance of texture is big in the component motion frame, so scheme utilizes variance as weighing the location that the whether violent standard of motion realizes the moving region.
2. watermark embeds
In watermark embed process, scheme has adopted a kind of QIM algorithm based on vision mode, and Fig. 7 has provided the frame diagram of this algorithm.The Watson vision mode that uses in the algorithm is made up of a sensitivity function, two masked portion and assembling sections of sheltering based on the brightness and contrast.Each element t in the responsive kilsyth basalt of Watson vision mode (i, j) with the DCT coefficient (i, j) corresponding one by one, representative under situation without any masking noise, calculate the DCT coefficient (i, j) the critical visible error of maximum magnitude of modification, i wherein, j=0,1 ..., 7.c
o(i, j, k) be k piece among the former figure the DCT coefficient (i, j), c
w(i, j are that (i, j), watermark W is for only comprising 0,1 binary pseudo-random sequence for the DCT coefficient of watermarked back k piece k).
According to the watermark embedded part among Fig. 7, its idiographic flow is as follows:
(1) the piece dct transform is carried out in the moving region,, set c by the Waston model
o(i, j, k) watermarked quantization step be step (i, j)=(i, j), wherein beta is used for controlling watermarked intensity to beta * t.Quantification obtains
m
e(i, j, k)=round (q
e(i, j, k)), δ=m
e(i, j, k)-q
e(i, j, k), wherein
And watermarked by following rule:
(a) if mod (m
e(i, j, k), 2)=W, then | c
w(i, j, k) |=m
e(i, j, k) * step (i, j);
(b) if mod (m
e(i, j, k), 2) ≠ W, then
When δ 〉=0, | c
w(i, j, k) |=(m
e(i, j, k)+1) * step (i, j);
When δ＜0, | c
w(i, j, k) |=(m
e(i, j, k)-1) * step (i, j).
(2) after all bits embed and finish, carry out anti-piece dct transform, obtain the image after watermarked.
In the video every two field picture through moving region location watermarked after, rebuild and obtain watermarked video.
3. watermark detection
The video that receives is decomposed framing, each frame is carried out motion positions according to the detailed process of step 1, obtain carrying out watermark extracting behind the moving region.According to the watermark detection part among Fig. 7, its idiographic flow is as follows:
(1) the piece dct transform is carried out in moving region to be detected, obtain k piece (i, j) the DCT coefficient c of position
w(i, j, k), calculate its quantization step that detects watermark and be step (i, j)=beta * t (i, j).Quantification obtains
m
d(i, j, k)=round (q
d(i, j, k)), and by following Rule Extraction watermark: W '
n=mod (m
d(i, j, k), 2).
Obtain watermark W '
n, subscript n is represented watermark W '
nBe to extract by the n frame in the video to obtain;
(2) the watermark W ' that each frame is extracted with voting method
nCarrying out the comprehensive statistics analysis, is example with the wherein bit of watermark, if surpass
Watermark in this bit be 1, then this bit is for being judged to 1, otherwise is judged to 0, that is:
Wherein, W ' is final detection watermark, and L is the length of watermark.
(3) the normalizated correlation coefficient NC between the watermark W of the watermark W ' of calculating extraction and embedding, to judge whether there is watermark in the video:
As NC during, judge in the video to have watermark, otherwise do not have watermark in the video greater than threshold value threshold.Wherein, the value of threshold can be carried out different settings according to different situations.
L-G simulation test has intercepted one section polar bear video as the carrier video, comprises 51 two field pictures altogether, and every two field picture size is 272*352, and frame per second is 25fps.The watermark of using is the binary pseudo-random sequence of forming by 0,1, and length is 100.Fig. 8 has provided the PSNR curve chart of watermark video each frame of the present invention under noiseless condition, and each frame of watermark video has higher PSNR value as seen from Figure 8, and promptly each two field picture has higher fidelity.
Robustness for watermark among proof the present invention, adopt some common information processing manners that watermark video is handled, comprise that various averages are that the different white Gaussian noise of 0 variance Var is attacked, under the prerequisite that keeps video duration or frame number, adopt the MPEG-2 compression of different frame per second, and frame deletion and frame are cut out attack.Wherein, delete in the video about 10% frame in the frame deletion at random, i.e. 5 frames, frame are cut out attack and have been comprised again and cut out and cut out at random dual mode in proper order.Following table has provided under the various attack, the detected value NC of watermark.
The detected value NC of watermark under the various attack
To sum up, simulation result has proved the feasibility and the reliability of this programme.It is guaranteeing under the sightless prerequisite of watermark, white Gaussian noise, MPEG-2 compression, frame deletion and frame is being cut out attack have higher robustness.
Claims (1)
1. the video watermark treatment method based on the location, moving region is characterized in that, may further comprise the steps:
(1) location, moving region, the component motion frame of adjacent two frames promptly comprises the two field picture of adjacent two frame relative motion information, and realizes the location of moving region in the original video frame in view of the above in the extraction video; The specific implementation step is:
A extracts the component motion frame of adjacent two frames in the video, promptly comprises the two field picture of adjacent two frame relative motion information;
B resolves into the fritter that is easy to encode of non-overlapping copies with the component motion frame, and calculates the variance of each piece;
Square that comprises at least four fritters of c definition is a macro block, with this macro block scanning motion component frame, with the variance of each fritter in the macro block with as weighing the whether violent standard of motion, with variance and maximum macro block is that a square region is determined at the center, this zone corresponds in the former frame of video, is the moving region that will locate; The length of neglecting watermark greatly of square region is determined, should satisfy the requirement of each fritter embedding one bit watermark information in the square region;
(2) watermarked, according to location, the moving region in the step (1), watermark is embedded the moving region of each frame of video;
(3) detect watermark, each frame of video is carried out watermark extracting, and the further watermark of each frame extraction of statistical analysis, to detect in the video whether contain watermark information, utilize voting method that the watermark that each frame extracts is carried out statistical analysis to determine final detection watermark, promptly when determining each bit of above-mentioned final detection watermark, extract that this bit is 1 in the watermark that obtains if surpass half frame of sum, this bit of then determining this final detection watermark is judged to 1, otherwise is judged to 0.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2008100155806A CN100556136C (en) | 2008-04-23 | 2008-04-23 | Video watermark process based on the location, moving region |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2008100155806A CN100556136C (en) | 2008-04-23 | 2008-04-23 | Video watermark process based on the location, moving region |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101277438A CN101277438A (en) | 2008-10-01 |
| CN100556136C true CN100556136C (en) | 2009-10-28 |
Family
ID=39996384
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2008100155806A Expired - Fee Related CN100556136C (en) | 2008-04-23 | 2008-04-23 | Video watermark process based on the location, moving region |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100556136C (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102801977B (en) * | 2012-08-07 | 2015-03-11 | 合肥极光科技股份有限公司 | Method for embedding robust digital watermark in H.264 based on video complexity analysis |
| US9208534B2 (en) * | 2014-05-07 | 2015-12-08 | Cisco Technology Inc. | System and method for embedding data |
| US10607312B2 (en) | 2014-12-18 | 2020-03-31 | Nokia Technologies Oy | Method and apparatus for publishing locational copyrighted watermarking video |
| CN105741844B (en) * | 2016-03-30 | 2019-03-22 | 杭州电子科技大学 | A kind of digital audio watermarking algorithm based on DWT-SVD-ICA |
| US10678929B2 (en) | 2018-03-09 | 2020-06-09 | Citrix Systems, Inc. | Systems and methods for embedding data in remote session displays |
| CN110136166B (en) * | 2019-04-09 | 2021-04-30 | 深圳锐取信息技术股份有限公司 | Automatic tracking method for multi-channel pictures |
| CN113179407B (en) * | 2021-04-23 | 2022-08-12 | 山东大学 | Video watermark embedding and extraction method and system based on inter-frame DCT coefficient correlation |
-
2008
- 2008-04-23 CN CNB2008100155806A patent/CN100556136C/en not_active Expired - Fee Related
Non-Patent Citations (2)
| Title |
|---|
| 基于独立分量分析的盲视频水印方案. 孙建德，刘琚.电子学报，第32卷第9期. 2004 |
| 基于独立分量分析的盲视频水印方案. 孙建德，刘琚.电子学报，第32卷第9期. 2004 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101277438A (en) | 2008-10-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100556136C (en) | Video watermark process based on the location, moving region | |
| Kankanhalli et al. | Content based watermarking of images | |
| US8032754B2 (en) | Systems and methods for embedding media forensic identification markings | |
| Meghanathan et al. | Steganalysis algorithms for detecting the hidden information in image, audio and video cover media | |
| Sherly et al. | A compressed video steganography using TPVD | |
| KR100948381B1 (en) | Imaging Watermarking Method Using Human Visual System | |
| Kong et al. | Object watermarks for digital images and video | |
| CN101271568B (en) | Iteration self-adapting quantizing index modulation watermark method based on vision model | |
| CN102065286B (en) | Video Watermark Embedding and Extraction Method Based on Motion Vector | |
| Maity et al. | An image watermarking scheme using HVS characteristics and spread transform | |
| Winne et al. | Spatial digital watermark for MPEG-2 video authentication and tamper detection | |
| Rawat et al. | DCT and SVD based new watermarking scheme | |
| CN106303696A (en) | H.264 video content authenticating water-mark method based on pivot information distribution ratio stability | |
| Huang et al. | A video watermarking algorithm based on pseudo 3D DCT | |
| Namazi et al. | Block-based adaptive image watermarking scheme using visual perception Model in DCT Domain | |
| Seo et al. | Robust Image Watermarking Method Using Discrete Cosine Decomposition and Just Noticeable Distortion | |
| Yu-min et al. | Adaptive video watermarking algorithm based on MPEG-4 streams | |
| Hernandez et al. | DCT-domain image watermarking and generalized Gaussian models | |
| Weiwei et al. | JPEG Quantization-Distribution Steganalytic Method Attacking JSteg | |
| Sun et al. | An improved adaptive QIM watermark iterative algorithm | |
| Tsang et al. | Robust and high-quality video watermarking with the use of temporal redundancy | |
| Zhang et al. | Image watermarking capacity and reliability analysis in wavelet domain | |
| Du et al. | DCT-Based Video Watermarking Transcoding Technique | |
| Liu et al. | An improved spatial spread-spectrum video watermarking | |
| Zou et al. | Real-time video watermarking based on extended m-sequences |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20091028 Termination date: 20100423 |