CN102223539A - Processing method for splash screen caused by picture coding frame loss - Google Patents
Processing method for splash screen caused by picture coding frame loss Download PDFInfo
- Publication number
- CN102223539A CN102223539A CN 201110172869 CN201110172869A CN102223539A CN 102223539 A CN102223539 A CN 102223539A CN 201110172869 CN201110172869 CN 201110172869 CN 201110172869 A CN201110172869 A CN 201110172869A CN 102223539 A CN102223539 A CN 102223539A
- Authority
- CN
- China
- Prior art keywords
- frame
- framing
- current
- normal
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 238000000034 method Methods 0.000 claims abstract description 9
- 238000009432 framing Methods 0.000 claims description 26
- 230000003139 buffering effect Effects 0.000 claims description 17
- 241000208340 Araliaceae Species 0.000 claims description 8
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims description 8
- 235000003140 Panax quinquefolius Nutrition 0.000 claims description 8
- 235000008434 ginseng Nutrition 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 4
- 238000012795 verification Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 abstract description 7
- 241000023320 Luma <angiosperm> Species 0.000 abstract 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 abstract 1
- 230000005540 biological transmission Effects 0.000 description 6
- 238000012937 correction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a processing method for splash screen caused by picture coding frame loss, mainly comprising the following steps: firstly, keeping the nearest normal frame I as a frame P coding reference to correct the frame loss and the splash screen of a picture, and secondly, In the first method, if the normal frame I is kept for too long, the frame I is reconstructed by utilizing the newest YUV (luma and chroma) data in a buffer memory, and the newest frame I is used as a frame P coding reference frame. In the invention, the generated splash screen, the frame loss and time delay are controlled in an acceptable range, so as to ensure the normal working and working efficiency of real-time video monitoring.
Description
Technical field
The present invention relates to a kind of is the processing method of image encoding frame losing flower screen of the H.264 video encoder of display terminal with video (television set), the processing when particularly relating to multiplexer channel CIF format-pattern coding frame losing flower screen.
Background technology
Along with the fast development of Internet and multimedia technology, the network real-time Transmission of video becomes one of research focus of network application.H.264 standard becomes the main form and the standard of multimedia transmission on present and the next generation network with its high compression rate, high-quality, low code check.The time delay of the real-time Transmission requirement transmission of video is little, packet loss is low.As based on H.264 video server, show to the terminal coding by network transmitted image packet in front end hardware coding back.When encoder is accepted data and is encoded, can be because a variety of causes, the data that encoder is received have buffer memory and overflow and causing that time-delay produces, perhaps because coding rate is slow, will cause this moment image inevitably to produce the problem of frame losing and Hua Ping, and this image problem is expendable, the quality of influence monitoring in when coding, lost the original intention and the effect of video monitoring, made real-time monitoring become an empty verbiage.
Characteristics such as video (television set) is extensive, the most the most frequently used solution as the monitor terminal of output, and it is low to have a cost, and effect is directly perceived, and is easy to operate.Because the more uncertainty that the network real-time Transmission of video faces, the fluctuation ratio of Network Transmission quality is more common.So, when with video (television set) being the terminal demonstration, must consider to guarantee that just few as far as possible generation flower shields and the frame losing problem when leading portion carries out coded image data.Video encoder in the case has very urgent requirement for the delay process of image data packets.Therefore, along with further developing of streaming media service, this class processing method just is being subjected to increasing attention.
Summary of the invention
Technical problem to be solved by this invention is: the processing method that a kind of image encoding frame losing flower screen is provided, adopt processing method of the present invention can come the correction image time-delay, the time-delay that is produced is controlled within the acceptable scope, guarantees the normal and operating efficiency of real-time video monitoring.
The technical solution adopted in the present invention is: a kind of processing method of image encoding frame losing flower screen may further comprise the steps:
100) in encoder-side a buffering area is set and receives view data, and high some mark and low spot mark are set in buffering area;
200) when from buffering area, receiving image data packets,, suspend the reception of video data ground when buffer data bag quantity checks that network connects during less than low spot; When buffer data bag quantity during more than or equal to low spot, current framing object is judged, if present frame is the I frame, then directly carry out framing, then next framing object is judged; If present frame is the P frame, then enter next step;
300) when data packet number in the buffering area is put greater than height, enter next step; When buffer data bag quantity is between spikes/low-points, go to 500);
400) the P frame with previous normally framing replaces current P frame or carries out the frame-skipping processing, goes to 200 then);
500) judge according to the absolute value of the difference of the timestamp of timestamp in the I frame image data bag of a last normal framing of energy and the current P frame of organizing, when the absolute value of this time difference less than predetermined normal packet receiving during the time, to the normal framing of current P frame, go to 200 then); During the time, reformulate the I frame with yuv data up-to-date in the buffer area, and utilize this up-to-date I frame more than or equal to predetermined normal packet receiving when the absolute value of this time difference, current P frame is carried out framing, go to 200 then) as reference coding frame.
Described method, the normal packet receiving time T of step 500=| T
Ginseng 1-T
Ginseng 2|+Δ T, T herein
Ginseng 1, T
Ginseng 2Be respectively the timestamp in the I frame image data bag of a normal framing of energy, the timestamp of the current P frame of organizing, the scope of Δ T is 0.5~2s.
Described method after the current I frame is carried out framing, is also carried out CRC check, and verification is by then continuing coding; Not by then abandoning, reformulate the I frame then.
Advantage of the present invention: be used as P frame reference coding frame according to up-to-date I frame.The frame losing and the Hua Ping problem that are produced when control is encoded flexibly adopt processing method of the present invention can come the correction image quality, guarantee the normal and operating efficiency of real-time video monitoring.
Description of drawings
Fig. 1 is that buffering area is provided with schematic diagram.
Fig. 2 is the processing method of H.264 video encoder multiway images coding frame losing flower screen provided by the invention.
Embodiment
The invention provides a kind of processing method, the particularly situation of multiplexer channel CIF form encoding time delay of delaying time at the image encoding frame losing flower screen that with video (television set) is the H.264 video encoder of display terminal.
Adopt method of the present invention then can pass through: 1, to keep nearest normal I frame as P frame coded reference, come the frame losing and the Hua Ping of correction image.If in 2 first methods, the time of the recently normal I frame that keeps is of a specified duration excessively, then reformulate the I frame with yuv data up-to-date in the buffer memory, and utilize this up-to-date I frame to be used as P frame reference coding frame, the colored screen, frame losing and the time-delay that are produced are controlled within the acceptable scope, guarantee the normal and operating efficiency of real-time video monitoring.
Embodiment of the present invention is:
Step 1, in encoder-side a buffering area is set and receives view data.
Step 2, one high some mark (highwater) and low spot mark (lowwater) are set in buffering area.The height point mark (highwater) of buffering area and low spot mark (lowwater) are empirical values big or small according to hardware buffer and that the framing time (time of each frame all writes down, and dynamic change) is decided.When packet in the buffering area during greater than highwater, abandon unnecessary packet, if the I frame then carries out framing, carry out CRC check according to the framing result after finishing, verification is by then continuing coding by normal flow, not by then abandoning.If P frame, then replace the normally wrong P frame of framing with previous normal P frame, or carry out frame-skipping within a certain period of time and handle, such as: P frames such as reservation 1,3,5,7, P frames such as jumping 2,4,6,8 stop such frame-skipping processing again and change normal encoding into after data return to normal level in the buffering area.When wrapping between highwater and the lowwater, buffer data carries out normal framing, when the buffer data bag checks that video line connects during less than lowwater.
Step 3, when from buffering area, receiving image data packets, judge according to the absolute value of the difference of the timestamp of timestamp in the I frame image data bag of a last energy framing and the current P frame of organizing.When the absolute value of this time difference during less than predetermined normal time, we think that flow process is normal, if when the absolute value of this time difference during greater than predetermined normal time, we think occur unusual, think that this I frame holding time is of a specified duration excessively, may cause flower screen or frame losing.Then reformulate the I frame with yuv data up-to-date in the buffer memory this moment.And utilize this up-to-date I frame to be used as P frame reference coding frame.The colored screen, frame losing and the time-delay that are produced are controlled within the acceptable scope.
Comprise following steps in the step 3:
Step 3.1: the timestamp of establishing the I frame of the last energy framing of T1=;
The timestamp of the P frame that T2=is current group;
T0=|T1-T2| (absolute value of the difference of T1 and T2);
Upper limit memory time of the normal I frame that T3=preserves recently, this value can be set at fixedly empirical value, also can be set at the dynamic change value.
Step 3.2: when T0>T3, think that this I frame holding time is of a specified duration excessively, may cause flower screen or frame losing.Then reformulate the I frame with yuv data up-to-date in the buffer memory this moment.And utilize this up-to-date I frame to be used as P frame reference coding frame.The colored screen, frame losing and the time-delay that are produced are controlled within the acceptable scope.
When T0<T3, think that coding is normal, no matter be I frame or the equal normal encoding of P frame.
Wherein step 3.1 occurs in and receives the vedio data bag, carries out putting into buffering area after the judgement of timestamp; Step 3.2 occurs in when getting the package frame from buffering area, decides according to the judgement of step 3.1 and continues framing or abandon, or adopt nearest frame to replace erroneous frame.
Claims (3)
1. the processing method of shielding is spent in an image encoding frame losing, it is characterized in that may further comprise the steps:
100) in encoder-side a buffering area is set and receives view data, and high some mark and low spot mark are set in buffering area;
200) when from buffering area, receiving image data packets,, suspend the reception of video data ground when buffer data bag quantity checks that network connects during less than low spot; When buffer data bag quantity during more than or equal to low spot, current framing object is judged, if present frame is the I frame, then directly carry out framing, then next framing object is judged; If present frame is the P frame, then enter next step;
300) when data packet number in the buffering area is put greater than height, enter next step; When buffer data bag quantity is between spikes/low-points, go to 500);
400) the P frame with previous normally framing replaces current P frame or carries out the frame-skipping processing, goes to 200 then);
500) judge according to the absolute value of the difference of the timestamp of timestamp in the I frame image data bag of a last normal framing of energy and the current P frame of organizing, when the absolute value of this time difference less than predetermined normal packet receiving during the time, to the normal framing of current P frame, go to 200 then); During the time, reformulate the I frame with yuv data up-to-date in the buffer area, and utilize this up-to-date I frame more than or equal to predetermined normal packet receiving when the absolute value of this time difference, current P frame is carried out framing, go to 200 then) as reference coding frame.
2. the method for claim 1 is characterized in that: the normal packet receiving time T of step 500=| T
Ginseng 1-T
Ginseng 2|+Δ T, T herein
Ginseng 1, T
Ginseng 2Be respectively the timestamp in the I frame image data bag of a normal framing of energy, the timestamp of the current P frame of organizing, the scope of Δ T is 0.5~2s.
3. method according to claim 1 is characterized in that: after the current I frame is carried out framing, also carry out CRC check, verification is by then continuing coding; Not by then abandoning, reformulate the I frame then.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 201110172869 CN102223539A (en) | 2011-06-24 | 2011-06-24 | Processing method for splash screen caused by picture coding frame loss |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 201110172869 CN102223539A (en) | 2011-06-24 | 2011-06-24 | Processing method for splash screen caused by picture coding frame loss |
Publications (1)
Publication Number | Publication Date |
---|---|
CN102223539A true CN102223539A (en) | 2011-10-19 |
Family
ID=44779946
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 201110172869 Pending CN102223539A (en) | 2011-06-24 | 2011-06-24 | Processing method for splash screen caused by picture coding frame loss |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102223539A (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107657591A (en) * | 2017-09-05 | 2018-02-02 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal |
CN107801049A (en) * | 2016-09-05 | 2018-03-13 | 杭州海康威视数字技术股份有限公司 | A kind of real-time video transmission, player method and device |
CN107896136A (en) * | 2017-10-27 | 2018-04-10 | 中国电子科技集团公司第二十八研究所 | A kind of radar track message encoding method |
CN107911196A (en) * | 2017-10-27 | 2018-04-13 | 中国电子科技集团公司第二十八研究所 | A kind of radar track message transmitting method |
CN108881775A (en) * | 2018-05-30 | 2018-11-23 | 维沃移动通信有限公司 | A video communication method and mobile terminal |
CN109302574A (en) * | 2017-07-25 | 2019-02-01 | 华为技术有限公司 | A method and apparatus for processing video stream |
CN110636333A (en) * | 2019-08-19 | 2019-12-31 | 西安万像电子科技有限公司 | Frame loss processing method and device |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020071662A1 (en) * | 1996-10-15 | 2002-06-13 | Matsushita Electric Industrial Co., Ltd. | Video and audio coding method, coding apparatus, and coding program recording medium |
CN101060633A (en) * | 2006-04-17 | 2007-10-24 | 株式会社日立制作所 | Image display apparatus |
CN101316357A (en) * | 2008-06-30 | 2008-12-03 | 华为技术有限公司 | A channel switching method, terminal and media server |
CN101557512A (en) * | 2009-05-19 | 2009-10-14 | 武汉长江通信产业集团股份有限公司 | Method for processing time delay when video terminal receives video data |
EP2247111A1 (en) * | 2004-12-30 | 2010-11-03 | Microsoft Corporation | Use of frame caching to improve packet loss recovery |
-
2011
- 2011-06-24 CN CN 201110172869 patent/CN102223539A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020071662A1 (en) * | 1996-10-15 | 2002-06-13 | Matsushita Electric Industrial Co., Ltd. | Video and audio coding method, coding apparatus, and coding program recording medium |
EP2247111A1 (en) * | 2004-12-30 | 2010-11-03 | Microsoft Corporation | Use of frame caching to improve packet loss recovery |
CN101060633A (en) * | 2006-04-17 | 2007-10-24 | 株式会社日立制作所 | Image display apparatus |
CN101316357A (en) * | 2008-06-30 | 2008-12-03 | 华为技术有限公司 | A channel switching method, terminal and media server |
CN101557512A (en) * | 2009-05-19 | 2009-10-14 | 武汉长江通信产业集团股份有限公司 | Method for processing time delay when video terminal receives video data |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107801049A (en) * | 2016-09-05 | 2018-03-13 | 杭州海康威视数字技术股份有限公司 | A kind of real-time video transmission, player method and device |
CN107801049B (en) * | 2016-09-05 | 2020-01-17 | 杭州海康威视数字技术股份有限公司 | Real-time video transmission and playing method and device |
CN109302574A (en) * | 2017-07-25 | 2019-02-01 | 华为技术有限公司 | A method and apparatus for processing video stream |
CN107657591A (en) * | 2017-09-05 | 2018-02-02 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal |
CN107896136A (en) * | 2017-10-27 | 2018-04-10 | 中国电子科技集团公司第二十八研究所 | A kind of radar track message encoding method |
CN107911196A (en) * | 2017-10-27 | 2018-04-13 | 中国电子科技集团公司第二十八研究所 | A kind of radar track message transmitting method |
CN107911196B (en) * | 2017-10-27 | 2020-07-14 | 南京莱斯电子设备有限公司 | Radar track message transmission method |
CN107896136B (en) * | 2017-10-27 | 2020-09-08 | 南京莱斯电子设备有限公司 | Radar track message encoding method |
CN108881775A (en) * | 2018-05-30 | 2018-11-23 | 维沃移动通信有限公司 | A video communication method and mobile terminal |
CN110636333A (en) * | 2019-08-19 | 2019-12-31 | 西安万像电子科技有限公司 | Frame loss processing method and device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101557512B (en) | Method for processing time delay when video terminal receives video data | |
CN102223539A (en) | Processing method for splash screen caused by picture coding frame loss | |
CN102959976B (en) | The method and apparatus of assessment video flow quality | |
KR101465927B1 (en) | Video data quality assessment method and device | |
US8411569B2 (en) | Method of splicing encoded multimedia data streams | |
CN104780422B (en) | Flow media playing method and DST PLAYER | |
CA2828843C (en) | Video encoding apparatus, video decoding apparatus, video encoding method, and video decoding method | |
CA2819674C (en) | Video encoding apparatus, video decoding apparatus, video encoding method, and video decoding method | |
JP2002507375A (en) | Apparatus and method for splicing a digital video stream | |
CN108259964B (en) | Video playing rate adjusting method and system | |
CN101951387A (en) | Method and device for transmitting stream media | |
US8804771B2 (en) | Method for managing a data transmission from a sender device, corresponding computer-readable storage medium and sender device | |
TWI423674B (en) | System and method for reducing the zapping time | |
US11622135B2 (en) | Bandwidth allocation for low latency content and buffered content | |
US8904426B2 (en) | Preconditioning ad content for digital program insertion | |
US8279945B2 (en) | Method for compensating timing mismatch in A/V data stream | |
CN106470291A (en) | Recover in the interruption in time synchronized from audio/video decoder | |
US8842740B2 (en) | Method and system for fast channel change | |
WO2010021665A1 (en) | Hypothetical reference decoder | |
CN115665485B (en) | Video picture optimization method and device, storage medium and video terminal | |
JP3299185B2 (en) | Encoding device | |
CN102231828B (en) | Delay processing method for decoding, synchronizing and outputting image | |
CN101483757B (en) | Skipping method, system and server for network interactive play-on-demand | |
EP3026907B1 (en) | Encoding device, encoding method, and encoding program | |
CN117478958B (en) | Video playing method, device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C12 | Rejection of a patent application after its publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20111019 |