[go: up one dir, main page]

WO2000074385A3 - 3d wavelet based video codec with human perceptual model - Google Patents

3d wavelet based video codec with human perceptual model Download PDF

Info

Publication number
WO2000074385A3
WO2000074385A3 PCT/US2000/014552 US0014552W WO0074385A3 WO 2000074385 A3 WO2000074385 A3 WO 2000074385A3 US 0014552 W US0014552 W US 0014552W WO 0074385 A3 WO0074385 A3 WO 0074385A3
Authority
WO
WIPO (PCT)
Prior art keywords
video
jnd
perceptual model
video codec
human perceptual
Prior art date
Application number
PCT/US2000/014552
Other languages
French (fr)
Other versions
WO2000074385A2 (en
Inventor
Junfeng Gu
Yimin Jiang
John S Baras
Original Assignee
Univ Maryland
Junfeng Gu
Yimin Jiang
John S Baras
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Maryland, Junfeng Gu, Yimin Jiang, John S Baras filed Critical Univ Maryland
Priority to US09/979,930 priority Critical patent/US7006568B1/en
Priority to AU52942/00A priority patent/AU5294200A/en
Publication of WO2000074385A2 publication Critical patent/WO2000074385A2/en
Publication of WO2000074385A3 publication Critical patent/WO2000074385A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • H04N19/126Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/14Coding unit complexity, e.g. amount of activity or edge presence estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/154Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/1883Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit relating to sub-band structure, e.g. hierarchical level, directional tree, e.g. low-high [LH], high-low [HL], high-high [HH]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/62Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding by frequency transforming in three dimensions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/63Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • H04N19/895Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2347Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4405Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream decryption
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/167Systems rendering the television signal unintelligible and subsequently intelligible
    • H04N7/1675Providing digital key or authorisation information for generation or regeneration of the scrambling sequence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/65Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

A video encoding/decoding system based on 3D wavelet decomposition and the human perceptual model is implemented. JND is applied in quantizer design to improve the subjective quality of compressed video. The 3D wavelet decomposition helps to remove spatial and temporal redundancy and provides scalability of video quality. In order to conceal the errors that may occur under bad wireless channel conditions, a slicing method and a joint source channel coding scenario, that combines RCPC with CRC and utilises the distortion information to allocate convolutional coding rates are proposed. A new subjective quality index based on JND is presented and used to evaluate the overall system performance at different signal to noise rations (SNR) and at different compression ratios. Due to the wide use of arithmetic coding (AC) in data compression, it is considered as a readily available unit in the video codec system for broadcasting. A new scheme for conditional access (CA) sub-system is designed based on the cryptographic property of arithmetic coding. Its performance is analyzed along with its application in a multi-resolution video compression system. This scheme simplifies the conditional access sub-system and provides satisfactory system reliability.
PCT/US2000/014552 1999-05-27 2000-05-26 3d wavelet based video codec with human perceptual model WO2000074385A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US09/979,930 US7006568B1 (en) 1999-05-27 2000-05-26 3D wavelet based video codec with human perceptual model
AU52942/00A AU5294200A (en) 1999-05-27 2000-05-26 3d wavelet based video codec with human perceptual model

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13663399P 1999-05-27 1999-05-27
US60/136,633 1999-05-27

Publications (2)

Publication Number Publication Date
WO2000074385A2 WO2000074385A2 (en) 2000-12-07
WO2000074385A3 true WO2000074385A3 (en) 2001-05-31

Family

ID=22473683

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/014552 WO2000074385A2 (en) 1999-05-27 2000-05-26 3d wavelet based video codec with human perceptual model

Country Status (2)

Country Link
AU (1) AU5294200A (en)
WO (1) WO2000074385A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8953673B2 (en) 2008-02-29 2015-02-10 Microsoft Corporation Scalable video coding and decoding with sample bit depth and chroma high-pass residual layers
US8964854B2 (en) 2008-03-21 2015-02-24 Microsoft Corporation Motion-compensated prediction of inter-layer residuals
US9319729B2 (en) 2006-01-06 2016-04-19 Microsoft Technology Licensing, Llc Resampling and picture resizing operations for multi-resolution video coding and decoding
US9571856B2 (en) 2008-08-25 2017-02-14 Microsoft Technology Licensing, Llc Conversion operations in scalable video encoding and decoding

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AUPR222500A0 (en) * 2000-12-21 2001-01-25 Unisearch Limited Method for efficient scalable compression of video
AUPS291002A0 (en) * 2002-06-12 2002-07-04 Unisearch Limited Method and apparatus for scalable compression of video
FR2862449B1 (en) * 2003-11-17 2006-04-21 Canon Kk CODING AND DECODING DIGITAL SIGNAL
EP2654294A4 (en) * 2010-12-16 2015-11-11 Univ Beihang METHOD FOR QUANTIFYING WAVELET WITH APPLICATION OF A VISUAL MODEL OF THE HUMAN IN IMAGE COMPRESSION
CN110955730B (en) * 2019-12-03 2023-10-13 湖南国奥电力设备有限公司 Blockchain-based three-dimensional modeling method and device for underground cables
US20240290297A1 (en) * 2021-05-11 2024-08-29 Interdigital Ce Patent Holdings, Sas Pixel modification to reduce energy consumption of a display device
CN115604489A (en) * 2021-07-09 2023-01-13 南开大学(Cn) Image compression method based on human visual quality and display resolution
WO2024054467A1 (en) * 2022-09-07 2024-03-14 Op Solutions, Llc Image and video coding with adaptive quantization for machine-based applications

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0614308A1 (en) * 1993-03-05 1994-09-07 Eastman Kodak Company Method and apparatus for controlling access to selected image components in an image storage and retrieval system
GB2306833A (en) * 1995-10-30 1997-05-07 Sony Uk Ltd Video data compression
EP0858222A1 (en) * 1994-04-22 1998-08-12 Thomson Consumer Electronics, Inc. Apparatus and method for processing packets of program component data
EP0892557A1 (en) * 1997-07-18 1999-01-20 Texas Instruments Inc. Image compression
JPH1118070A (en) * 1997-06-26 1999-01-22 Matsushita Electric Ind Co Ltd Image compression device, image decompression device, and transmission device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0614308A1 (en) * 1993-03-05 1994-09-07 Eastman Kodak Company Method and apparatus for controlling access to selected image components in an image storage and retrieval system
EP0858222A1 (en) * 1994-04-22 1998-08-12 Thomson Consumer Electronics, Inc. Apparatus and method for processing packets of program component data
GB2306833A (en) * 1995-10-30 1997-05-07 Sony Uk Ltd Video data compression
JPH1118070A (en) * 1997-06-26 1999-01-22 Matsushita Electric Ind Co Ltd Image compression device, image decompression device, and transmission device
EP0892557A1 (en) * 1997-07-18 1999-01-20 Texas Instruments Inc. Image compression

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
NGAN K N ET AL: "VERY LOW BIT RATE VIDEO CODING USING 3D SUBBAND APPROACH", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,US,IEEE INC. NEW YORK, vol. 4, no. 3, 1 June 1994 (1994-06-01), pages 309 - 316, XP000460762, ISSN: 1051-8215 *
OHM J R: "THREE-DIMENSIONAL SBC-VQ WITH MOTION COMPENSATION", PROCEEDINGS OF THE PICTURE CODING SYMPOSIUM (PCS),CH,LAUSANNE, SFIT, vol. -, 17 March 1993 (1993-03-17), pages 115 - A-115-B, XP000346436 *
PATENT ABSTRACTS OF JAPAN vol. 1999, no. 04 30 April 1999 (1999-04-30) *
RUF M J ET AL: "OPERATIONAL RATE-DISTORTION PERFORMANCE FOR JOINT SOURCE AND CHANNEL CODING OF IMAGES", IEEE TRANSACTIONS ON IMAGE PROCESSING,US,IEEE INC. NEW YORK, vol. 8, no. 3, March 1999 (1999-03-01), pages 305 - 320, XP000832622, ISSN: 1057-7149 *
SAFRANEK R J ET AL: "PERCEPTUAL CODING OF IMAGE SIGNALS", PROCEEDINGS OF THE ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS,US,NEW YORK, IEEE, vol. CONF. 24, 5 November 1990 (1990-11-05), pages 346 - 350, XP000280043 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9319729B2 (en) 2006-01-06 2016-04-19 Microsoft Technology Licensing, Llc Resampling and picture resizing operations for multi-resolution video coding and decoding
US8953673B2 (en) 2008-02-29 2015-02-10 Microsoft Corporation Scalable video coding and decoding with sample bit depth and chroma high-pass residual layers
US8964854B2 (en) 2008-03-21 2015-02-24 Microsoft Corporation Motion-compensated prediction of inter-layer residuals
US9571856B2 (en) 2008-08-25 2017-02-14 Microsoft Technology Licensing, Llc Conversion operations in scalable video encoding and decoding

Also Published As

Publication number Publication date
AU5294200A (en) 2000-12-18
WO2000074385A2 (en) 2000-12-07

Similar Documents

Publication Publication Date Title
US7006568B1 (en) 3D wavelet based video codec with human perceptual model
Cosman et al. Combined forward error control and packetized zerotree wavelet encoding for transmission of images over varying channels
WO2000074385A3 (en) 3d wavelet based video codec with human perceptual model
US8379716B2 (en) Method, apparatus, and system for enhancing robustness of predictive video codecs using a side-channel based on distributed source coding techniques
Vass et al. Efficient three-dimensional wavelet codecs for networked video communications
KR101119965B1 (en) Systems and methods for scalably encoding and decoding data
WO2002071736A8 (en) Systems and methods of error resilience in a video decoder
WO2004086631A3 (en) Method, apparatus and system for encoding and decoding side information for multimedia transmission
WO2002037859A3 (en) Video data compression system
CA2295281A1 (en) Multiple program decoding for digital audio broadcasting and other applications
EP0396368A3 (en) Perceptually-adapted image coding system
Verma et al. A 6kbps to 85kbps scalable audio coder
CA2296138A1 (en) Joint multiple program error concealment for digital audio broadcasting and other applications
KR20010052710A (en) Method and aparatus in transmission of images
PL1697927T3 (en) Improved frequency-domain error concealment
US6498809B1 (en) Video bitstream error resilient transcoder, method, video-phone, video-communicator and device
US20070150784A1 (en) Method and system for data and video coding
TW200612755A (en) System for enhancing compression ratio of scalable video coding and method thereof
Bae et al. Design and Implementation of the Ensemble Remultiplexer for DMB Service Based on Eureka‐147
Adsumilli et al. Adaptive wireless video communications: Challenges and approaches
Cosman et al. Image transmission over channels with bit errors and packet erasures
Sahu et al. Joint steganography-source-channel coding for wireless physiological signal transmission
Crump et al. Intraframe low bit rate video coding robust to packet erasure
KR100540174B1 (en) Apparatus and method for inserting multimedia stream for providing multimedia broadcasting service in digital audio broadcasting transmission system
Gu 3D wavelet-based video codec with human perceptual model

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 09979930

Country of ref document: US

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP