CN114424552A - A low-delay source-channel joint coding method and related equipment - Google Patents
A low-delay source-channel joint coding method and related equipment Download PDFInfo
- Publication number
- CN114424552A CN114424552A CN201980100614.8A CN201980100614A CN114424552A CN 114424552 A CN114424552 A CN 114424552A CN 201980100614 A CN201980100614 A CN 201980100614A CN 114424552 A CN114424552 A CN 114424552A
- Authority
- CN
- China
- Prior art keywords
- reference frame
- code stream
- frame image
- image
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/40—Network security protocols
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
本申请实施例公开了一种低延迟信源信道联合编码方法及相关设备，其中，一种低延迟信源信道联合编码方法包括：首先对目标图像进行下采样，得到基准帧图像与非基准帧图像；对基准帧图像和非基准帧图像分别进行图像编码，获得基准帧图像编码后的第一码流，和非基准帧图像编码后的第二码流；基于当前无线信道的信道环境，利用第一信道资源发送第一码流以及利用第二信道资源发送第二码流，其中，第一信道资源优于第二信道资源。实施本申请实施例可以在信道容量降低时，降低视频信息出现马赛克，卡顿、模糊等现象，提升用户的观感体验。
Embodiments of the present application disclose a low-latency source-channel joint coding method and related equipment, wherein a low-latency source-channel joint coding method includes: first, down-sampling a target image to obtain a reference frame image and a non-reference frame image; image encoding is performed on the reference frame image and the non-reference frame image respectively to obtain the first code stream after the reference frame image encoding and the second code stream after the non-reference frame image encoding; based on the channel environment of the current wireless channel, use The first channel resource is used to send the first code stream and the second channel resource is used to send the second code stream, wherein the first channel resource is superior to the second channel resource. By implementing the embodiments of the present application, when the channel capacity is reduced, phenomena such as mosaics, freezes, and blurring of video information can be reduced, and the user's viewing experience can be improved.
Description
PCT国内申请，说明书已公开。PCT domestic application, the description has been published.
Claims (22)
- A low-delay source-channel joint coding method, comprising:down-sampling the target image to obtain a reference frame image and a non-reference frame image;respectively carrying out image coding on the reference frame image and the non-reference frame image to obtain a first code stream after the reference frame image is coded and a second code stream after the non-reference frame image is coded;determining a first channel resource and a second channel resource based on a channel environment of a current wireless channel, and respectively transmitting the first code stream by using the first channel resource and transmitting the second code stream by using the second channel resource, wherein the first channel resource is superior to the second channel resource.
- The method according to claim 1, wherein said performing image coding on the reference frame image and the non-reference frame image respectively to obtain a first code stream after the reference frame image is coded and a second code stream after the non-reference frame image is coded comprises:performing intra-frame compression on each reference frame image included in the reference frame images to obtain the first code stream;and carrying out intra-frame compression on the residual errors of the non-reference frame image and the reference frame image to obtain the corresponding second code stream.
- The method according to claim 1 or 2, wherein the channel environment further comprises a channel capacity; before the step of performing image coding on the reference frame image and the non-reference frame image respectively to obtain the first code stream after the reference frame image is coded and the second code stream after the non-reference frame image is coded, the method further includes:and determining coding parameters corresponding to the reference frame image and the non-reference frame image based on the channel capacity, wherein the coding parameters are used for controlling the corresponding images to generate corresponding code streams according to target code rates during image coding, and the target code rates respectively corresponding to the first code stream and the second code stream are both less than or equal to the channel capacity.
- The method of claim 3, wherein the channel environment comprises one or more of a bandwidth of a channel, a signal-to-interference-plus-noise ratio, a signal-to-noise ratio, a received signal strength indication, a duty cycle, a bit rate;the determining a first channel resource and a second channel resource based on the current channel environment, and respectively transmitting the first code stream by using the first channel resource and the second code stream by using the second channel resource, includes:determining sending parameters respectively corresponding to the first code stream and/or the second code stream based on the current channel environment, wherein the sending parameters are used for sending the code streams according to target modulation and coding strategy information and/or target transmitting power, and the sending parameters of the first code stream are superior to the sending parameters of the second code stream;and sending the first code stream according to the sending parameters corresponding to the first code stream, and sending the second code stream according to the sending parameters corresponding to the second code stream.
- The method of any of claims 1-4, wherein the wireless channel comprises a first wireless channel and a second wireless channel; the determining a first channel resource and a second channel resource based on the current channel environment, and respectively transmitting the first code stream by using the first channel resource and the second code stream by using the second channel resource, includes:and determining the first wireless channel and the second wireless channel based on the current channel environment, sending the first code stream through the first wireless channel, and sending the second code stream through the second wireless channel, wherein the service quality guarantee mechanism of the first wireless channel is higher than that of the second wireless channel.
- The method according to claim 5, wherein the target image is any one of a plurality of frames of target images included in the target video; the method further comprises the following steps:acquiring a code stream of each frame of target image corresponding to the reference frame image in a plurality of frames of target images included in the target video;acquiring audio information in the target video;and transmitting the code stream and the audio information of each frame image in the multi-frame images included in the target video corresponding to the reference frame image through the first wireless channel.
- The method according to claim 5, wherein the target image is any one of a plurality of frames of target images included in the target video; the method further comprises the following steps:acquiring a code stream of each frame of target image corresponding to the non-reference frame image in a plurality of frames of target images included in the target video;and transmitting a code stream of each frame image in the multi-frame images included in the target video corresponding to the non-reference frame image through the second wireless channel.
- A low-delay source-channel joint coding method, comprising:down-sampling the target image to obtain a reference frame image and a non-reference frame image;determining coding parameters corresponding to the reference frame image and the non-reference frame image according to the channel environment of the current wireless channel;respectively carrying out image coding on the reference frame image and the non-reference frame image according to the coding parameters to obtain a first code stream after the reference frame image is coded and a second code stream after the non-reference frame image is coded;and respectively transmitting the first code stream and the second code stream.
- The method of claim 8, wherein the coding parameters are used to control the corresponding image to generate a corresponding code stream according to a target code rate when the image is coded;the image coding is respectively carried out on the reference frame image and the non-reference frame image according to the coding parameters to obtain a first code stream after the reference frame image is coded and a second code stream after the non-reference frame image is coded, and the method comprises the following steps:performing intraframe compression on each reference frame image included in the reference frame images according to the target code rate to obtain the first code stream;and carrying out intra-frame compression on the residual errors of the non-reference frame image and the reference frame image according to the target code rate to obtain the corresponding second code stream.
- The method according to claim 8 or 9, wherein the channel environment comprises one or more of a bandwidth, a signal-to-interference-plus-noise ratio, a signal-to-noise ratio, a received signal strength indication, a duty cycle, a bit rate of a channel;before the sending the first code stream and the second code stream respectively, the method further includes:and determining sending parameters respectively corresponding to the first code stream and/or the second code stream according to the channel environment, wherein the sending parameters are used for sending the code streams according to target modulation and coding strategy information and/or target transmitting power, and the sending parameters of the first code stream are superior to the sending parameters of the second code stream.
- The method according to any of claims 8-10, wherein the wireless channel comprises a first wireless channel and a second wireless channel; the respectively sending the first code stream and the second code stream includes:and sending the first code stream through a first wireless channel, and sending the second code stream through a second wireless channel, wherein the service quality guarantee mechanism of the first wireless channel is higher than that of the second wireless channel.
- The method according to claim 11, wherein the target image is any one of a plurality of frames of target images included in the target video; the method further comprises the following steps:acquiring a code stream of each frame of target image corresponding to the reference frame image in a plurality of frames of target images included in the target video;acquiring audio information in the target video;and transmitting the code stream and the audio information of each frame image in the multi-frame images included in the target video corresponding to the reference frame image through the first wireless channel.
- The method according to claim 11, wherein the target image is any one of a plurality of frames of target images included in the target video; the method further comprises the following steps:acquiring a code stream of each frame of target image corresponding to the non-reference frame image in a plurality of frames of target images included in the target video;and transmitting a code stream of each frame image in the multi-frame images included in the target video corresponding to the non-reference frame image through the second wireless channel.
- A low-latency source-channel joint decoding method, comprising:receiving a first code stream sent by an encoding end, wherein the first code stream is obtained after image encoding is carried out on a reference frame image, and the reference frame image comprises one or more images obtained after down-sampling is carried out on a target image;performing image decoding on the first code stream to obtain the reference frame image corresponding to the first code stream;and reconstructing the target image according to the reference frame image.
- The method according to claim 14, wherein the target image is any one of a plurality of frames of target images included in the target video;reconstructing the target image according to the reference frame image includes:and reconstructing the target image through an interpolation algorithm according to at least one of a reference frame image and a non-reference frame image corresponding to one frame of target image adjacent to the target image in the reference frame image.
- The method of claim 14, further comprising:receiving a second code stream sent by the encoding end within a preset time period after receiving the first code stream, wherein the second code stream is a code stream obtained after image encoding is carried out on a non-reference frame image, and the non-reference frame image comprises a residual image except the reference frame image, which is obtained after down-sampling is carried out on the target image;if the second code stream is incomplete, performing image decoding on the second code stream to obtain a corresponding incomplete non-reference frame image;determining peripheral pixels of the incomplete non-reference frame image according to the incomplete non-reference frame image;reconstructing the target image according to the reference frame image includes:and reconstructing the target image through an interpolation algorithm according to the reference frame image and the peripheral pixels.
- The method of claim 16, further comprising:if the second code stream is complete, performing image decoding on the second code stream to obtain the corresponding non-reference frame image;reconstructing the target image according to the reference frame image includes:and splicing the reference frame image and the non-reference frame image to reconstruct the target image.
- A low-delay source-channel joint coding apparatus, comprising: an encoder and a transmitter, wherein,the encoder is configured to:down-sampling the target image to obtain a reference frame image and a non-reference frame image;respectively carrying out image coding on the reference frame image and the non-reference frame image to obtain a first code stream after the reference frame image is coded and a second code stream after the non-reference frame image is coded;the transmitter is configured to:determining a first channel resource and a second channel resource based on a channel environment of a current wireless channel, and respectively transmitting the first code stream by using the first channel resource and transmitting the second code stream by using the second channel resource, wherein the first channel resource is superior to the second channel resource.
- A low-delay source-channel joint coding apparatus, comprising: an encoder and a transmitter, wherein,the encoder is configured to:down-sampling the target image to obtain a reference frame image and a non-reference frame image;determining coding parameters corresponding to the reference frame image and the non-reference frame image according to the channel environment of the current wireless channel;respectively carrying out image coding on the reference frame image and the non-reference frame image according to the coding parameters to obtain a first code stream after the reference frame image is coded and a second code stream after the non-reference frame image is coded;the transmitter is configured to: and respectively transmitting the first code stream and the second code stream.
- A computer storage medium, characterized in that it stores a computer program which, when executed by a processor, implements the method of any of the preceding claims 1-7 or 8-13.
- A computer program, characterized in that the computer program comprises instructions which, when executed by a computer, cause the computer to carry out the method according to any one of claims 1-7 or 8-13.
- A low-delay source-channel joint coding system, comprising an encoding side and a decoding side, wherein the encoding side is configured to perform the method according to claims 1-7 or 8-13, and the decoding side is configured to perform the method according to claims 14-17.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/109220 WO2021056575A1 (en) | 2019-09-29 | 2019-09-29 | Low-delay joint source-channel coding method, and related device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114424552A true CN114424552A (en) | 2022-04-29 |
Family
ID=75165457
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980100614.8A Pending CN114424552A (en) | 2019-09-29 | 2019-09-29 | A low-delay source-channel joint coding method and related equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114424552A (en) |
| WO (1) | WO2021056575A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116456094A (en) * | 2023-06-15 | 2023-07-18 | 中南大学 | A distributed video hybrid digital-analog transmission method and related equipment |
| CN119555104A (en) * | 2025-01-24 | 2025-03-04 | 深圳市小镜科技有限公司 | A method for realizing mobile phone enhanced high-precision navigation using a recorder |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115550669B (en) * | 2022-11-30 | 2023-03-24 | 摩尔线程智能科技(北京)有限责任公司 | A video transcoding method and device, electronic equipment and storage medium |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1764280A (en) * | 2004-10-21 | 2006-04-26 | 三星电子株式会社 | Method and device for efficiently compressing motion vectors in video encoder based on multiple layers |
| WO2006080655A1 (en) * | 2004-10-18 | 2006-08-03 | Samsung Electronics Co., Ltd. | Apparatus and method for adjusting bitrate of coded scalable bitsteam based on multi-layer |
| WO2008014707A1 (en) * | 2006-07-27 | 2008-02-07 | Tencent Technology (Shenzhen) Company Limited | Method, system and terminal of adjusting video quality |
| CN101212678A (en) * | 2006-12-31 | 2008-07-02 | 联想(北京)有限公司 | Video communication method based on P2P network |
| CN101404759A (en) * | 2008-10-30 | 2009-04-08 | 中山大学 | Network self-adaptive system used for digital video monitoring system |
| CN101448157A (en) * | 2008-12-30 | 2009-06-03 | 杭州华三通信技术有限公司 | Video encoding method and video encoder |
| CN102281436A (en) * | 2011-03-15 | 2011-12-14 | 福建星网锐捷网络有限公司 | Wireless video transmission method and device, and network equipment |
| CN102769747A (en) * | 2012-06-29 | 2012-11-07 | 中山大学 | A hierarchical distributed video encoding and decoding method and system based on parallel iteration |
| GB2499865A (en) * | 2012-03-02 | 2013-09-04 | Canon Kk | Method and Devices for Encoding/Decoding an Enhancement Layer Intra Image in a Scalable Video Bit-stream |
| CN103716630A (en) * | 2012-09-29 | 2014-04-09 | 华为技术有限公司 | Upsampling filter generation method and device |
| CN104247423A (en) * | 2012-03-21 | 2014-12-24 | 联发科技（新加坡）私人有限公司 | Method and apparatus for intra mode derivation and coding in scalable video coding |
| CN105049862A (en) * | 2014-04-25 | 2015-11-11 | 统一有限责任两合公司 | Method and device for transmission of encoded media data |
| CN108496369A (en) * | 2017-03-30 | 2018-09-04 | 深圳市大疆创新科技有限公司 | Transmission of video, method of reseptance, system, equipment and unmanned vehicle |
| CN109618188A (en) * | 2018-12-19 | 2019-04-12 | 北京东土科技股份有限公司 | Coding, retransmission method, device, equipment and the storage medium of video data |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6973128B2 (en) * | 2003-02-21 | 2005-12-06 | Mitsubishi Electric Research Labs, Inc. | Multi-path transmission of fine-granular scalability video streams |
| US8750207B2 (en) * | 2010-10-15 | 2014-06-10 | Apple Inc. | Adapting transmission to improve QoS in a mobile wireless device |
| CN103580773A (en) * | 2012-07-18 | 2014-02-12 | 中兴通讯股份有限公司 | Method and device for transmitting data frame |
| CN107809662B (en) * | 2017-11-06 | 2019-08-16 | 陕西师范大学 | A kind of scalable video transmission method and device based on heterogeneous wireless ad hoc network |
-
2019
- 2019-09-29 WO PCT/CN2019/109220 patent/WO2021056575A1/en active Application Filing
- 2019-09-29 CN CN201980100614.8A patent/CN114424552A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006080655A1 (en) * | 2004-10-18 | 2006-08-03 | Samsung Electronics Co., Ltd. | Apparatus and method for adjusting bitrate of coded scalable bitsteam based on multi-layer |
| CN1764280A (en) * | 2004-10-21 | 2006-04-26 | 三星电子株式会社 | Method and device for efficiently compressing motion vectors in video encoder based on multiple layers |
| WO2008014707A1 (en) * | 2006-07-27 | 2008-02-07 | Tencent Technology (Shenzhen) Company Limited | Method, system and terminal of adjusting video quality |
| CN101212678A (en) * | 2006-12-31 | 2008-07-02 | 联想(北京)有限公司 | Video communication method based on P2P network |
| CN101404759A (en) * | 2008-10-30 | 2009-04-08 | 中山大学 | Network self-adaptive system used for digital video monitoring system |
| CN101448157A (en) * | 2008-12-30 | 2009-06-03 | 杭州华三通信技术有限公司 | Video encoding method and video encoder |
| CN102281436A (en) * | 2011-03-15 | 2011-12-14 | 福建星网锐捷网络有限公司 | Wireless video transmission method and device, and network equipment |
| GB2499865A (en) * | 2012-03-02 | 2013-09-04 | Canon Kk | Method and Devices for Encoding/Decoding an Enhancement Layer Intra Image in a Scalable Video Bit-stream |
| CN104247423A (en) * | 2012-03-21 | 2014-12-24 | 联发科技（新加坡）私人有限公司 | Method and apparatus for intra mode derivation and coding in scalable video coding |
| CN102769747A (en) * | 2012-06-29 | 2012-11-07 | 中山大学 | A hierarchical distributed video encoding and decoding method and system based on parallel iteration |
| CN103716630A (en) * | 2012-09-29 | 2014-04-09 | 华为技术有限公司 | Upsampling filter generation method and device |
| CN105049862A (en) * | 2014-04-25 | 2015-11-11 | 统一有限责任两合公司 | Method and device for transmission of encoded media data |
| CN108496369A (en) * | 2017-03-30 | 2018-09-04 | 深圳市大疆创新科技有限公司 | Transmission of video, method of reseptance, system, equipment and unmanned vehicle |
| CN109618188A (en) * | 2018-12-19 | 2019-04-12 | 北京东土科技股份有限公司 | Coding, retransmission method, device, equipment and the storage medium of video data |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116456094A (en) * | 2023-06-15 | 2023-07-18 | 中南大学 | A distributed video hybrid digital-analog transmission method and related equipment |
| CN116456094B (en) * | 2023-06-15 | 2023-09-05 | 中南大学 | Distributed video hybrid digital-analog transmission method and related equipment |
| CN119555104A (en) * | 2025-01-24 | 2025-03-04 | 深圳市小镜科技有限公司 | A method for realizing mobile phone enhanced high-precision navigation using a recorder |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021056575A1 (en) | 2021-04-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102036061B (en) | Video data transmission and sending processing method, device and network system | |
| US20060188025A1 (en) | Error concealment | |
| CN114424552A (en) | A low-delay source-channel joint coding method and related equipment | |
| CN102823251B (en) | Moving image encoding device, moving picture encoding method and motion video coded program and moving image decoding device, moving picture decoding method and moving image decoding program | |
| US20120294355A1 (en) | Video transcoding with dynamically modifiable spatial resolution | |
| CN101335892A (en) | Hybrid Distributed Video Coding Method Based on Intra Mode Decision | |
| CN101677400B (en) | Coding and decoding method, coder, decoder and encoder/decoder system | |
| CN104219539B (en) | A method of the Video coding based on TD-LTE Channel Detections and transmission | |
| JP2015501098A5 (en) | ||
| CN102647591B (en) | Fault-tolerance rate distortion optimization video coding method based on structure similarity (SSIM) evaluation | |
| TW201028014A (en) | Switching between DCT coefficient coding modes | |
| JP2003510911A (en) | Video communication using multiple streams | |
| KR100612691B1 (en) | Video quality evaluation system and method | |
| MX2022008502A (en) | Video decoding method and apparatus for obtaining quantization parameter, and video encoding method and apparatus for transmitting quantization parameter. | |
| WO2012000263A1 (en) | Method and apparatus for coding and decoding quantization parameters in slice header information | |
| KR20200044667A (en) | AI encoding apparatus and operating method for the same, and AI decoding apparatus and operating method for the same | |
| US10469824B2 (en) | Hybrid digital-analog coding of stereo video | |
| CN102333223A (en) | Video data coding method, decoding method, coding system and decoding system | |
| KR20090103675A (en) | Method for coding/decoding a intra prediction mode of video and apparatus for the same | |
| JP5004877B2 (en) | Image encoder, image decoder, image encoding method, image decoding method, and program | |
| CN101127900A (en) | Coding/decoding method and device for image signals at basic layer | |
| KR101703133B1 (en) | Method and Apparatus for Real-time Joint Source-Channel Coding | |
| CN206283618U (en) | Spatial scalable coding device based on area-of-interest | |
| JP2009510934A (en) | Interpolation techniques in wavelet transform multimedia coding. | |
| CN101765008A (en) | Method for encoding and decoding video as well as device and system therefor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220429 |
|
| RJ01 | Rejection of invention patent application after publication |