Abstract
A growing and important class of traffic in the Internet is so-called “streaming media,” in which a server transmits a packetized multimedia signal to a receiver that buffers the packets for playback. This playback buffer, if adequately sized, counteracts the adverse impact of delay jitter and reordering suffered by packets as they traverse the network, and if large enough also allows lost packets to be retransmitted before their playback deadline expires. We call this framework for retransmitting lost streaming-media packets “soft ARQ” since it represents a relaxed form of Automatic Repeat reQuest (ARQ). While state-of-the-art media servers employ such strategies, no work to date has proposed an optimal strategy for delay-constrained retransmissions of streaming media—specifically, one which determines what is the optimal packet to transmit at any given point in time. In this paper, we address this issue and present a framework for streaming media retransmission based on layered media representations, in which a signal is decomposed into a discrete number of layers and each successive layer provides enhanced quality. In our approach, the source chooses between transmitting (1) newer but critical coarse information (e.g., a first approximation of the media signal) and (2) older but less important refinement information (e.g., added details) using a decision process that minimizes the expected signal distortion at the receiver. To arrive at the proper mix of these two extreme strategies, we derive an optimal strategy for transmitting layered data over a binary erasure channel with instantaneous feedback. To provide a quantitative performance comparison of different transmission policies, we conduct a Markov-chain analysis, which shows that the best transmission policy is time-invariant and thus does not change as the frames' layers approach their expiration times.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
P. Brady, “Effects of Transmission Delay on Conversational Behavior on Echo-Free Telephone Circuits, ” Bell Syst.Tech. J., vol. 50, no. 1, 1971, pp. 115–134.
X. Xu, A. Myers, H. Zhang, and R. Yavatkar, “Resilient Mul-ticast Support for Continuous-Media Applications, ” in Proc. NOSSDAV, St. Louis, MO, May 1997, pp. 183–194.
M. Lucas, B. Dempsey, and A. Weaver, “MESH: Distributed Error Recovery for Multimedia Streams in Wide-Area Multicast Networks, ” in Proc. IEEE Int.Conf.on Commun., Montreal, Quebec, June 1997, vol. 2pp. 1127–1132.
V. Vaishampayan, “Design of Multiple Description Scalar Quantizers, ” IEEE-Trans.Info.Theory, vol. 39, no. 3, 1993, pp. 821–834.
S. McCanne, V. Jacobson, and M. Vetterli, “Receiver-Driven Layered Multicast, ” in Proc.ACM SIGCOMM, Stanford, CA, Aug. 1996, pp. 26–30.
R. Rejaie, M. Handley, and D. Estrin, “RAP: An End-to-End Rate-Based Congestion Control Mechanism for Realtime Streams in the Internet, ” in Proc.IEEE INFOCOM, New York, NY, March 1999.
T. Cover and J. Thomas, Elements of Information Theory,New York: John Wiley and Sons, 1991.
P. Bhattacharya and A. Ephremides, “Optimal Scheduling with Strict Deadlines, ” IEEE Trans.Automat.Control, vol. 34, no. 7, 1989, pp. 721–728.
P. Bhattacharya and A. Ephremides, “Optimal Allocation of a Server Between Two Queues with Due Times, ” IEEE Trans. Automat.Control, vol. 36, no. 12, 1991, pp. 1417–1423.
D. Saparilla and K. Ross, “Optimal Streaming of Layered Video, ” in Proc.IEEE INFOCOM, Tel Aviv, Israel, March 2000.
M. Lara-Barron and G. Lockhard, “Speech Encoding and Re-construction for Packet-Based Networks, ” in IEE Colloqium on Coding for Packet Video and Speech Transmission, 1992, vol. 199, pp. 1–4.
D. Clark, S. Shenker, and L. Zhang, “Supporting Realtime Appli-cations in an Integrated Services Packet Network: Architecture and Mechanism, ” in Proceedings of SIGCOMM '92, Baltimore, Maryland: ACM, Aug. 1992, pp. 14–26.
R. Ramjee, J. Kurose, D. Towsley, and H. Schulzrinne, “Adaptive Playout Mechanisms for Packetized Audio Applications in Wide-Area Networks, ” in Proc.IEEE INFOCOM, Toronto, Ontario, June 1994, pp. 680–688.
V. Jacobson, SIGCOMM '94 Tutorial: Multimedia Conferencing on the Internet, Aug, 1994.
S. Moon, J. Kurose, and D. Towsley, “Packet Audio Playout Delay Adjustment: Performance Bounds and Algorithms, ” Mul-timedia Systems, vol. 6, no. 1, 1998, pp. 17–28.
M. Wada, “Selective Recovery of Video Packet Loss Using Error Concealment, ” IEEE Journal on Selected Areas in Communications, vol. 7, no. 5, 1989, pp. 807–814.
O. Wasem, D. Goodman, C. Dvorak, and H. Page. “The Effect of Waveform Substitution on the Quality of PCM Packet Communications, ” IEEE Trans.Acoust.Speech Signal Proc., vol. 26, no. 3, 1998, pp. 342–348.
V. Hardman, M.A. Sasse, M. Handley, and A. Watson, “Reliable Audio for Use Over the Internet, ” in Proc.INET, 1995.
N. Shacham and P. McKenney, “Packet Recovery in High-Speed Networks Using Coding and Buffer Management, ” in Proc. IEEE INFOCOM, San Francisco, CA, June 1990, vol. 1, pp. 124–131.
E.W. Biersack, “ASimulation Study of Forward Error Correction in ATM Networks, ” Computer Communication Review, vol. 22, no. 1, 1992, pp. 36–47.
I. Cidon, A. Khamisy, and M. Sidi, “Analysis of Packet Loss Processes in High-Speed Networks, ” IEEE-Trans-Info.Theory, vol. 39, no. 1, 1993, pp. 98–108.
J.-C. Bolot and A.V. Garcia, “The Case for FEC-Based Error Control for Packet Audio in the Internet, ” To appear in ACM Multimedia System.
M. Podolsky, C. Romer, and S. McCanne, “Simulation of FEC-Based Error Control for Packet Audio on the Internet, ” in Proc. IEEE INFOCOM, San Francisco, CA, March 1998, vol. 2, pp. 505–515.
C. Papadopoulos and G. Parulkar, “Retransmission-Based Error Control for Continuous Media Applications, ” in Proc.NOSS-DAV, April 1996, pp. 5–12.
B. Dempsey, J. Liebeherr, and A. Weaver, “On Retransmission-Based Error Control for Continuous Media Traffic in Packet-Switching Networks, ” Computer Networks and ISDN System Journal, vol. 28, no. 5, 1996, pp. 719–36.
S. Pejhan, M. Schwartz, and D. Anastassiou, “Error Control Using Retransmission Schemes in Multicast Transport Protocols for Real-Time Media, ” IEEE/ACM Trans.Networking., vol. 4, no. 3, 1996, pp. 413–427.
L. Xue, S. Paul, P. Pancha, and M. Ammar, “Layered Video Multicast with Retransmission (LVMR): Evaluation of Error Recovery Schemes, ” in Proc.nossdav, St. Louis, MO,May1997, pp. 161–172.
J. Danskin, G. Davis, and X. Song, “Fast Lossy Internet Image Transmission, ” in Proc.ACM Multimedia, San Francisco, CA, Nov. 1995. pp. 321–331.
M. Podolsky, S. McCanne, and M. Vetterli, “Soft ARQ for Streaming Layered Multimedia, ” Technical Report, UC-Berkeley/ ERL, Nov. 1998.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Podolsky, M.G., McCanne, S. & Vetterli, M. Soft ARQ for Layered Streaming Media. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology 27, 81–97 (2001). https://doi.org/10.1023/A:1008123631453
Published:
Issue Date:
DOI: https://doi.org/10.1023/A:1008123631453