KR101921083B1 - Techniques for network-based audio source broadcasting of selective quality - Google Patents

Abstract

A technique for network based sound source broadcasting is disclosed. A transmitting-side apparatus for network-based sound source broadcasting, comprising: means for identifying N subsequences from an uncompressed sequence of audio samples, generating network streams from N subsequences, transmitting at least one network stream over a source broadcast network Lt; RTI ID = 0.0 > packet stream. ≪ / RTI > A receiving-side apparatus for network-based sound source broadcasting includes: a network packet stream of audio data for a network-based sound source broadcast on a sound source broadcast network; a network packet stream depacketizing the network packet stream into a network stream; To determine which particular set of streams from a plurality of sets of streams associated with the network stream is to be used for generating an output analog audio signal from the determined particular set of streams.

Description

TECHNICAL FIELD [0001] The present invention relates to a network-based selective quality broadcast technique,

This disclosure relates to a technique for network-based audio source broadcasting.

Network-based sound source broadcasting is a technique of transmitting sound source data such as digital audio data through a network. Such a system for network-based sound source broadcasting can be implemented in various forms. For example, a conventional Public Address (PA) system is an analog-based system that is typically constructed on a building basis, or a network-based system that is implemented in a manner that provides integrated digital sound source broadcasts across multiple buildings or complexes within a network environment PA systems are becoming increasingly popular.

However, in general, a network-based sound source broadcasting system may experience bad conditions such as limited network bandwidth, broadcast delay, packet loss, and the like. In recent years, there has been an increase in the demand for selective quality sound source broadcasting to meet various broadcast situations ranging from human voice (low-band signal) to high-quality backgound music (BGM) . Furthermore, in an environment where the network situation changes instantaneously, variability of data characteristics (for example, bitrate) for transmission and reproduction is very important.

Although some conventional related techniques may be somewhat useful in addressing this problem, there is a limit to being applied to network based sound source broadcasting. For example, several existing transmission techniques, such as the technique disclosed in Korean Patent No. 10-1355975, entail compression of data to be transmitted, which may degrade the required bandwidth, but result in deterioration in terms of quality and delay do. Further, in transmission of compressed data, generating a stream having a plurality of bit rates for various quality levels increases the complexity of a codec related to compression. In contrast, the technique of transmitting original digital data may be better in terms of quality and delay than compressed data transmission. However, when one analog-to-digital converter (ADC) is used per source data channel It is only possible to provide a continuous broadcast service of a single quality, so it is necessary to temporarily stop the broadcast in order to change the service quality. In addition, when a plurality of ADCs are used per channel to provide various quality broadcast services in addition to transmission of a digital original, a hardware configuration such as various parts or memory requires more cost and requires a wider network bandwidth .

Therefore, there is a need for an improved network-based sound source broadcasting system.

An improved technique for network-based tone source broadcasting is disclosed in this document.

According to at least one embodiment, a transmitting-side apparatus for network-based tone generator broadcasting is provided. Wherein the transmitting device comprises: a downsampling unit configured to identify N subsequences of audio samples from an uncompressed sequence of audio samples having a first sampling frequency; and generating a network stream from the N subsequences And a network interface configured to packetize at least one of the network streams.

The audio samples of each of the N subsequences may have the same second sampling frequency. The first sampling frequency may be the second sampling frequency multiplied by a positive integer greater than or equal to N. Wherein the positive integer is N, wherein identifying the N subsequences may comprise distinguishing the uncompressed sequence by the N subsequences.

The network streams may include a Base-Layer (BL) stream and one or more enhancement-layer (EL) streams. The BL stream may include audio samples of only one subsequence of the N subsequences. Each of the one or the plurality of EL streams may comprise audio samples of at least one other subsequence of the N subsequences.

The network interface unit may also be configured to packetize the BL stream either alone or with at least one of the one or the plurality of EL streams into at least one network packet stream for transmission on the source broadcast network .

The network interface unit may also be configured to selectively transmit the packetized BL stream on the source broadcast network or to transmit the packetized BL stream with the one or the at least one packetized EL stream have.

The network interface unit may also be configured to perform the transmission on the source broadcast network. The transmission on the source broadcast network may include transmitting the at least one network packet stream on the source broadcast network to the destination device in a unicast manner in accordance with the priority of the destination device. The transmission on the source broadcast network may include transmitting the at least one network packet stream on the source broadcast network in a multicast manner in accordance with the bandwidth of the source broadcast network. Wherein the transmission on the source broadcast network comprises transmitting the packetized BL stream on the source broadcast network in a unicast manner and transmitting the one or the at least one packetized EL stream in a multi- Lt; / RTI > Wherein the transmission on the source broadcast network comprises transmitting the packetized BL stream on the source broadcast network in accordance with a Voice-over-Internet-Protocol (VoIP) protocol, transmitting the one or the at least one packetized EL stream May be transmitted on the source broadcast network in at least one of a unicast mode and a multicast mode.

According to at least one embodiment, a receiving-side device for network-based sound source broadcasting is provided. Wherein the receiving-side device is configured to receive at least one network packet stream of audio data for the network-based sound source broadcast on a source broadcast network, and to de-packetize the at least one network packet stream into at least one network stream Wherein the at least one network stream comprises at least one of a base-layer (BL) stream and one or more enhancement-layer (EL) streams, A stream configuration section configured to determine which particular set of streams from the plurality of stream sets including one or at least one full or partial stream selected from the plurality of EL streams is to be used for generation of an output analog audio signal for playback; , The output analog And a stream processing unit configured to generate the audio signal from the determined specific stream set.

The audio data may comprise an uncompressed sequence of audio samples having a first sampling frequency. The uncompressed sequence may comprise N subsequences of audio samples. The audio samples of each of the N subsequences may have the same second sampling frequency. The first sampling frequency may be an integer multiple of the second sampling frequency and may be at least N times the second sampling frequency. The first sampling frequency may be N multiplied by the second sampling frequency. Wherein the BL stream may comprise audio samples of only one of the N subsequences and wherein each of the one or the plurality of EL streams includes audio of at least one other subsequence of the N subsequences ≪ / RTI >

Each of the plurality of stream sets may correspond to a particular sampling frequency of the plurality of sampling frequencies. Each of the plurality of sampling frequencies may be one in which the second sampling frequency is multiplied by a positive integer up to N. [

Wherein the stream processing unit is operable to generate a scaled sequence of audio samples having a particular sampling frequency corresponding to the determined specific stream set from the determined specific stream set and to convert the output analog audio signal to a scaled The output analog audio signal may be generated from the determined particular stream set by generating from the audio samples of the sequence.

Generating the scaled sequence may include extracting audio samples for use as the audio samples of the scaled sequence from the determined particular stream set.

Wherein the plurality of stream sets comprises a first type stream set comprising the BL stream without any combination of the one or the plurality of EL streams and wherein at least one of the BL stream and the one or the plurality of EL streams And at least one second type stream set that includes one. Wherein the plurality of stream sets comprises at least one third type stream set comprising only one of the one or the plurality of EL streams without a combination with the BL stream, only a portion of one EL stream of the plurality of EL streams At least one second type stream set, or both.

Wherein the determination as to which particular set of streams in the plurality of sets of streams is to be used for generation of an output analog audio signal for playback comprises determining which of the plurality of sampling frequencies is to be used for generation of the output analog audio signal And determining the set of streams corresponding to the determined sampling frequency from the plurality of stream sets as the particular stream set.

Wherein the determination as to whether a particular set of streams in the plurality of stream sets is to be used for generation of an output analog audio signal for playback may include determining a state of the sound source broadcast network during reception of the network packet streams, And may be based on at least one of the customized services. Wherein the determination is based on at least one of a possible reproduction quality under the situation and a reproduction quality required for the user-specified service, which sampling frequency of the plurality of sampling frequencies is to be used for generation of the output analog audio signal And determining a set of streams corresponding to the determined sampling frequency from the plurality of stream sets as the specific stream set.

The stream processing unit may include a primary path module, a secondary path module, and an analog multiplexer. The primary path module may be configured to generate a first analog audio signal. The secondary path module may be configured to generate a second analog audio signal. The analog multiplexer may be configured to output either the first analog audio signal or the second analog audio signal as the output analog audio signal.

Wherein a first determination is made that a first set of streams in the plurality of stream sets will be used for generation of the output analog audio signal and the receiving device enters a first mode of operation, The receiving device continues to operate in the first mode of operation until a subsequent determination is made that another predetermined stream set of the plurality of stream sets is to be used, 1 analog audio signal and the analog multiplexer can output the first analog audio signal as the output analog audio signal. Wherein the subsequent determination is based on the determination that other sampling frequencies of the plurality of sampling frequencies will be used for generation of the output analog audio signal instead of the particular sampling frequency corresponding to the first stream set, It may comprise a determination that it corresponds to the different sampling frequency.

During the first mode of operation, in response to making a second determination that a second set of streams of the plurality of stream sets will be used for generation of the output analog audio signal, the receiving device enters a second mode of operation Wherein the primary path module still generates the first analog audio signal from the first stream set and the secondary path module generates the second analog audio signal from the second stream set, And outputting the first analog audio signal as the output analog audio signal, and then the primary path module generates the first analog audio signal from the second stream set, and the secondary path module still outputs the second stream And outputting the second analog audio signal Wherein the analog multiplexer outputs the second analog audio signal as the output analog audio signal and then the primary path module still generates the first analog audio signal from the second stream set, And the receiver outputs the first analog audio signal as the output analog audio signal, and the receiving-side apparatus can enter the first operation mode on the road. Wherein the second determination is based on the determination that other sampling frequencies of the plurality of sampling frequencies will be used for generation of the output analog audio signal instead of the particular sampling frequency corresponding to the first stream set, It may comprise a determination that it corresponds to the different sampling frequency.

Each of the primary path module and the secondary path module may include a scaling unit, a filter, and a digital-to-analog converter. Wherein the scaling unit is operable to calculate, from the determined specific set of streams in each of the plurality of stream sets, a scaled sequence of each of the audio samples having the respective specific sampling frequency corresponding to a particular sampling frequency of each of the plurality of sampling frequencies Lt; / RTI > The filter may be configured to apply low pass filtering to the respective scaled sequence to produce a respective filtered digital audio signal. The digital-to-analog converter may be configured to convert the respective filtered digital audio signals into respective ones of the first analog audio signal and the second analog audio signal.

According to the embodiment of the present invention, it is possible to provide a broadcasting service of a quality level suitable for a network situation and / or a user's demand without increasing the complexity in implementation of a network-based sound source broadcasting system.

The network-based sound source broadcasting system according to an embodiment of the present invention can support sound source broadcasting of network-based selective quality by applying temporal scalability to audio data of a high sampling frequency.

The network-based sound source broadcasting system according to the embodiment of the present invention carries out uncompressed transmission streaming of uncompressed audio data efficiently without using an audio codec for compression, so that it is possible to reduce the hardware cost in a network environment having a limited bandwidth It is possible to enable high-quality, low-delay sound source broadcasting.

The network-based sound source broadcasting system according to the embodiment of the present invention can provide a broadcast having a proper quality in a flexible and stable manner even when an error occurs in a packet stream received in an error-prone environment .

According to the embodiment of the present invention, scalability, stability and quality diversity of network-based sound source broadcasting can be ensured at a sufficient level at the same time.

FIG. 1 schematically illustrates a network-based selective quality source distribution system according to an embodiment of the present invention.
2 schematically illustrates an exemplary configuration of a transmitting-side device for network-based tone generator broadcasting according to an embodiment of the present invention.
3 schematically illustrates an exemplary configuration of a receiving-side device for network-based tone generator broadcasting according to an embodiment of the present invention.
4 schematically shows an exemplary configuration of an audio sequence processing unit of a receiving-side apparatus for network-based sound source broadcasting, according to an embodiment of the present invention.
5 is a diagram for explaining an exemplary operation of a stream processing unit of a receiving-side apparatus for network-based sound source broadcasting according to an embodiment of the present invention.
6 is a diagram for explaining an exemplary scenario in which an exemplary system for network-based tone generator broadcasting operates according to an embodiment of the present invention.
7 is a diagram for explaining performance of an exemplary system for network-based sound source broadcasting according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The present invention may have several embodiments, some of which are disclosed herein. It should be understood, however, that the invention is not limited to the disclosed embodiments, but is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Certain details are provided in the following detailed description in order to provide a comprehensive understanding of the method, apparatus and / or system according to the disclosed embodiments, although some embodiments may be practiced without some or all of these details. In addition, a detailed description of known technology may be omitted so as not to unnecessarily obscure the various aspects of the present invention.

The following terms are used only to describe certain embodiments and are not intended to be considered in a limiting sense. The singular forms of the phrases include plural forms unless the context clearly dictates otherwise. Also, in this document, terms such as " comprise " or " have " are intended to indicate that there is a certain feature, number, step, operation, component, But do not preclude the presence or possibility of any number, step, operation, component, information, or combination thereof.

FIG. 1 schematically illustrates a system 100 for network-based selective quality sound source broadcasting, in accordance with an embodiment of the present invention. As shown, the exemplary sound source broadcasting system 100 includes a transmitting side device 120 for network-based sound source broadcasting and at least one receiving side device 140-1, 140-2, ..., for network-based sound source broadcasting. ., 140-n (which may be denoted by reference numeral 140 individually). For example, the sound source broadcasting system 100 may be a public address (PA) system.

As shown, the transmitting device 120 and the receiving device 140 may be communicatively coupled through the network 130. [ The network 130 may be configured as a wired network, a wireless network, or a combination thereof using a transmission medium such as a wired transmission medium, a wireless transmission medium, or a combination thereof. For example, the network 130 may include the Internet, a unicast network, a multicast network, a Voice over Internet Protocol (VoIP) network, and / or other types of networks. Each of the receiving apparatuses 140-1, 140-2, ..., and 140-n is connected to at least one sound source broadcast output apparatus (for example, Lt; RTI ID = 0.0 > speaker) < / RTI >

For example, the transmitting-side apparatus 120 may be a server apparatus for transmitting audio data, and the receiving-side apparatus 140 may be remotely located from such transmitting-side apparatus 120 and may be a client apparatus for receiving audio data have.

In the embodiment, the source-based broadcasting system 100 can realize uncompressed transmission, and the transmitting-side apparatus 120 and the receiving-side apparatus 140 can be implemented as audio encoders for compressing / decompressing, It is possible to perform communication of the uncompressed audio data without using the codec of the audio codec.

A system 100 for network-based sound source broadcasting Transmitting side  The device 120,

The exemplary transmitting device 120 is configured to send audio data to a receiving device 140 via a source broadcast network (e.g., network 130). Such audio data may be transmitted from a receiving device 140 to a remote microphone (also referred to as a "Remote Microphone" hereinafter), a compact disc player (CDP), a text-to- Speech synthesizer and the like. As an example, the transmitting-side apparatus 120 may transmit audio data to the receiving-side apparatus 140 in a streaming manner.

2 schematically illustrates an exemplary configuration of a transmitting device 120 for network based tone source broadcasting, in accordance with an embodiment of the present invention. In an embodiment, the transmitting device 120 is configured as shown and may stream audio data over a source broadcast network (e.g., network 130). 2, the transmitting-side apparatus 120 includes a down-sampling unit 220, a scalable stream generator 240, and a network interface unit 260. The down- As shown in FIG.

The downsampling unit 220 receives an uncompressed sequence of audio samples having a first sampling frequency and generates a downsampled sequence of N (where N> 1) Version. ≪ / RTI > In an embodiment, downsampling section 220 may identify N subsequences of audio samples from such an uncompressed sequence. The audio samples of each of the N subsequences may have the same second sampling frequency. The first sampling frequency may be equal to the second sampling frequency multiplied by a positive integer not less than N. [ For example, the first sampling frequency may be N times the second sampling frequency, and the downsampling unit 220 may identify the N subsequences by distinguishing the uncompressed sequence into N subsequences.

The scalable stream generator 240 may be configured to generate network streams from the N subsequences. In an embodiment, such network streams may include a Base-Layer (BL) stream and one or more Enhancement-Layer (EL) streams. For example, the BL stream may comprise audio samples of only one of the N subsequences, and each of the one or more EL streams may include audio samples of at least one other subsequence of the N subsequences have.

The network interface unit 260 may transmit at least one of the network streams for transmission on the source broadcast network, for example, a BL stream alone or with at least one of the one or more EL streams, As shown in FIG. In an embodiment, the network interface 260 selects whether to transmit the BL stream solely on the source broadcast network or the BL stream with at least one of the one or more EL streams, and transmits at least one Packetized stream of network packets into at least one network packet stream and transmits at least one network packet stream (e.g., including a packetized BL stream singly or with at least one packetized EL stream) Lt; / RTI > For example, as described above, such transmissions may be uncompressed transmissions.

In an embodiment, the network interface 260 may transmit transmissions on the source broadcast network in various manners, for example, in a unicast manner, in a multicast manner, in a combination of a unicast scheme and a multicast scheme, And / or multicast manner, using the VoIP protocol, or in other possible ways. For example, the network interface unit 260 may transmit at least one network packet stream on the source broadcast network to the receiving-side apparatus 140 in a unicast manner according to the priority of the receiving-side apparatus 140. In another example, the network interface unit 260 may transmit at least one network packet stream on the source broadcast network in a multicast manner according to the bandwidth of the source broadcast network. In another example, the network interface unit 260 may transmit the packetized BL stream on the source broadcast network in a unicast manner, and may transmit the packaged EL stream in a multicast manner on the source broadcast network. Further, in another example, the network interface unit 260 transmits the packetized BL stream according to the VoIP protocol on the source broadcast network, and if there is a packetized EL stream, transmits the packetized EL stream to the source broadcast network through the unicast method and the multicast method At least one can be transmitted.

In some embodiments, the sending device 120 may be any suitable type of computing device, which may include one or more processors, a computer-readable storage medium readable by a processor, and various peripherals. For example, the processor may be a digital signal processor (DSP), a central processing unit (CPU), a graphics processing unit (GPU), a processor core, a microprocessor, (FPGAs), application specific integrated circuits (ASICs), radio frequency integrated circuits (RFICs), other hardware and logic circuits, or any of its Suitable combinations may be included. The computer readable storage medium may store computer executable instructions that, when executed by a processor, cause the transmitting device 120 to perform some operations in accordance with an embodiment of the present invention. For example, the computer-readable storage medium can be a read-only memory (ROM), a random-access memory (RAM), a volatile memory, a non-volatile memory, Removable memory, non-removable memory, hard disk, flash memory, magnetic disk storage media, optical disk storage media, other storage devices and storage media, or any suitable combination thereof can do. For example, peripherals may include various input / output (I / O) devices, such as pointing devices such as a mouse, keyboard, keypad, microphone, CD / DVD player, hardware TTS synthesizer, liquid crystal display A touch-sensitive display, a speaker, a printer, a communication interface card, a sound card, and the like.

A system 100 for network-based sound source broadcasting Receiving side  The device 140,

The exemplary receiving device 140 processes (e. G., Provides to the sound source broadcast output device) the audio data in the sound source data received from the transmitting device 120 via the sound source broadcast network (e.g., network 130) . By way of example, the receiving device 140 may provide audio signals having varying levels of quality from the audio data delivered in the form of various scalable streams.

FIG. 3 schematically illustrates an exemplary configuration of a receiving-side device 140 for network-based sound source broadcasting, in accordance with an embodiment of the present invention. In an embodiment, the receiving device 140 is configured as shown and may receive packetized audio data on a source broadcast network (e.g., network 130). 3, the receiving-side apparatus 140 is illustrated as including a network interface unit 320, a stream composition unit 340, and a stream processing unit 360.

The network interface unit 320 receives at least one network packet stream of audio data for network-based sound source broadcast on a source broadcast network (e.g., network 130) (e.g., from the source device 120) Lt; RTI ID = 0.0 > network packet < / RTI > stream to at least one network stream. In an embodiment, when the BL stream and one or more EL streams are packetized and transmitted into the network packet streams (e.g., by the network interface 260 of the transmitting device 120), the receiving device 140 May receive such network packet streams and may depacketize them into a BL stream and one or more EL streams. The network packet stream carries audio data for network-based sound source broadcasting, for example, a packet stream for uncompressed transmission in a network-based sound source broadcast. Thus, the audio data carried by the network packet stream may comprise an uncompressed sequence of audio samples having a first sampling frequency, as described above. The uncompressed sequence may include N subsequences of audio samples, with each audio sample of the N subsequences having the same second sampling frequency. The first sampling frequency may be an integer multiple of the second sampling frequency and may not be less than N times the second sampling frequency. For example, the first sampling frequency may be equal to N multiplied by the second sampling frequency. In an embodiment, the BL stream may comprise audio samples of only one subsequence of N subsequences (i.e., N downsampled versions of the uncompressed sequence), and each of the one or more EL streams may include N And may include audio samples of at least one other subsequence of the subsequences.

Stream composition section 340 may be configured to determine which particular set of streams of the plurality of stream sets is to be used for generation of an output analog audio signal for playback. In an embodiment, each of the plurality of stream sets may comprise at least one full or partial stream selected from a BL stream and one or more EL streams. For example, the plurality of stream sets may comprise a first type stream set including a BL stream without any combination of one or a plurality of EL streams. The plurality of stream sets may further include at least one second type stream set including at least one of a BL stream and one or more EL streams. In addition, the plurality of stream sets may include at least one third type stream set that includes only one of the one or more EL streams and / or only a portion of one EL stream of the plurality of EL streams, And at least one fourth type stream set. Each of the plurality of stream sets may correspond to a particular sampling frequency in a plurality of sampling frequencies, each of the plurality of sampling frequencies being equal to a second sampling frequency multiplied by a positive integer up to N. [

In an embodiment, determining which particular set of streams from a plurality of sets of streams is to be used for generation of an output analog audio signal for playback means that any of the plurality of sampling frequencies is to be used for the generation of the output analog audio signal And determining a set of streams in the plurality of stream sets corresponding to the determined sampling frequency as a specific set of streams for generation of the output analog audio signal. In addition, in an embodiment, the stream creator 340 may receive status information indicating the status of the source broadcast network and / or status information including information indicative of a user-specified service of the network-based source broadcast. Accordingly, the stream composition 340 may determine which particular set of streams in a plurality of sets of streams is to be used for the generation of the output analog audio signal for playback based on the state of the source broadcast network during reception of the network packet stream, Based on at least one of the broadcasted customized services. For example, the determination of a particular set of streams to be used for the generation of an output analog audio signal may include determining which sampling frequency of the plurality of sampling frequencies is to be used for generation of the output analog audio signal, Or based on a playback quality required for a user-specified service of a network-based source broadcast, determining a stream set corresponding to the determined sampling frequency from among the plurality of stream sets to a particular stream to be used for generation of the output analog audio signal As a set.

The stream processing section 360 may be configured to generate an output analog audio signal for reproduction using at least some of the BL stream and one or more EL streams. In an embodiment, the stream processing unit 360 may determine a scaled sequence of audio samples (i.e., a scaled version of the uncompressed sequence) having a specific sampling frequency (corresponding to the determined specific stream set) Generating an output analog audio signal from a set of determined streams, and generating an output analog audio signal from a scaled sequence of audio samples. For example, generating a scaled sequence from a particular set of determined streams may include extracting audio samples for use as audio samples of the scaled sequence from the determined specific set of streams and aggregating the extracted audio samples into a scaled sequence . In addition, generating an output analog audio signal from the audio samples of the scaled sequence may include filtering the audio samples of the scaled sequence and converting the filtered audio samples to an output analog audio signal.

In an embodiment, the determination of a particular stream set to be used for the generation of the output analog audio signal may be repeatedly performed by the stream composition section 340. [ Thus, for example, if another service of a network-based sound source broadcast is designated by a user and / or the situation of a sound source broadcast network is changed, a stream set to be used for the generation of the output analog audio signal (E.g., from a particular stream set to any other particular set of streams), and further that the set of streams to be used for the generation of the output analog audio signal may change from a corresponding sampling frequency (To other specific sampling frequencies). According to the embodiment, the stream processing section 360 may have a configuration that allows smooth reproduction of the output analog audio signal despite such changes. 4 and 5, an exemplary configuration of the stream processing section 360 is described in more detail below.

4 schematically shows an exemplary configuration of a stream processing unit 360 of the receiving-side apparatus 140 according to an embodiment of the present invention. 4, the stream processing unit 360 includes a primary path module 420, a secondary path module 440, and an analog multiplexer 460 .

4, the primary path module 420 may be configured to generate a first analog audio signal, the secondary path module 440 may be configured to generate a second analog audio signal, The combiner 460 may be configured to output either the first analog audio signal or the second analog audio signal as an output analog audio signal.

In an embodiment, the receiving device 140 may have at least two modes of operation, for example, a first mode of operation and a second mode of operation. For example, assume that a first determination that a first set of streams in a plurality of stream sets will be used for the generation of an output analog audio signal is made by the stream composition section 340 and that the receiving device 140 enters a first mode of operation lets do it. In this case, any other set of streams in the plurality of stream sets (which may be, for example, a stream set corresponding to a sampling frequency different from the particular sampling frequency corresponding to the first stream set) The primary path module 420 generates the first analog audio signal from the first stream set and the analog multiplexer 460 outputs the first analog audio signal as the output analog audio signal , The receiving-side apparatus 140 can continue to operate in the first operation mode.

Suppose now that during the first mode of operation, a second decision is made by the stream composition 340 that subsequent decisions, for example a second set of streams in the plurality of stream sets, will be used for the generation of the output analog audio signal. By way of example, such subsequent determination may include determining, instead of the particular sampling frequency corresponding to the first stream set, that another of the plurality of sampling frequencies is to be used for generation of the output analog audio signal, (E.g., the second stream set) of the plurality of stream sets corresponds to such other sampling frequency determined to be used for the second set of streams. In another example, such subsequent determination may include, in place of the first stream set, a determination that any other stream set in the plurality of stream sets (e.g., the second stream set) corresponds.

As an example, in response to the second determination being made during the first mode of operation, the receiving device 140 may operate in a second mode of operation, wherein in the second mode of operation, And the analog multiplexer 460 can output the second analog audio signal as the output analog audio signal. Then, during the second mode of operation, any stream set other than the second stream set of the plurality of stream sets (e. G., A stream set that corresponds to a sampling frequency that is different from the corresponding particular sampling frequency, Is determined by the stream composition section 340 as a particular stream set to be used for the generation of the output analog audio signal, the operating mode of the receiving-side device 140 is switched from the second operating mode to the first operating mode in a similar manner Can be switched.

In another example, in response to the second determination being made during the first mode of operation, the stream processing section 360 may operate in a different manner, which is discussed in more detail below with reference to FIG.

First, a first set of streams (e.g., corresponding to a first sampling frequency f _s1 in a plurality of sampling frequencies, as shown in FIG. 5) in a plurality of stream sets is selected as a particular stream to be used for generation of the output analog audio signal And when the receiving-side apparatus 140 enters the first operation mode, a predetermined set of streams among a plurality of stream sets (which is, for example, a first sampling frequency f as _s1) which may be a non-stream set corresponding to a different sampling frequency) is shown in (e. g., Figure 5 until it is determined as a particular stream sets to be used for the production of an output analog audio signal, a first point in time (t ₁₎ up), the primary path module 420 first generates a first analog audio signal from a first set of streams and the analog multiplexer 460 outputs the first analog audio signal O And a log output audio signal, the receiving device 140 may continue to operate in a first mode of operation.

While the receiving side device 140 is thus operating in the first operating mode, a second set of streams (e.g., a second set of streams other than the first sampling frequency f _s1 , as shown in FIG. 5) ( _{Corresponding to the} sampling frequency f _s2 ) is determined as a specific set of streams to be used for the generation of the output analog audio signal, the receiving device 140 ₁ ), the primary path module 420 may still generate a first analog audio signal from the first stream set, and the secondary path module 440 may generate a second analog audio signal from the second stream set And the analog multiplexer 460 may still output the first analog audio signal as the output analog audio signal.

Then, the receiving device 140, the first after entering the second mode of operation (as shown in e.g., FIG. 5, the second time point (t ₂₎ from) At one point, the primary path module 420 of the second The secondary path module 440 may still generate a second analog audio signal from the second stream set and the analog multiplexer 460 may generate a second analog audio signal from the second analog audio signal As an output analog audio signal.

Subsequently, the primary path module 420 may still generate a first analog audio signal from the second stream set from any subsequent point (e.g., from the third point of time t ₃ , as shown in Figure 5) , The analog multiplexer 460 may output the first analog audio signal as the output analog audio signal, and the receiving device 140 may enter the road first operation mode.

The stream processing unit 360 may operate as described above and after a previous determination made at a decision point that some stream set will be used for the generation of the output analog audio signal, The playback of the output analog audio signal may be smoother if a subsequent determination that it is to be used for the generation of the output analog audio signal is made at the subsequent decision point. In particular, in some embodiments, it is determined that, as exemplified above, another set of streams corresponding to a sampling frequency that is different from the corresponding sampling frequency of the stream set determined at the immediately preceding determination time will be used for generation of the output analog audio signal The stream processing section 360 can be configured to operate as described above. This arrangement of the stream processing section 360 may be advantageous because otherwise such sampling frequency changes may cause a tingling sound during reproduction of the output analog audio signal.

Further, in an embodiment, each of the primary path module 420 and the secondary path module 440 of the stream processing unit 360 includes respective scaling units 422 and 442 and a respective filter 424 And 444 and digital-to-analog converters (DACs) 426 and 446, respectively. Each of the scaling units 422 and 442 extracts from each determined set of specific streams in a plurality of sets of streams corresponding to a particular sampling frequency of each of the plurality of sampling frequencies a respective scaled sequence Lt; / RTI > of the audio samples). For example, each scaling unit 422, 442 may extract audio samples from their respective determined specific stream sets and aggregate the extracted audio samples into their respective scaled sequences. Each of the filters 424 and 444 may be configured to filter their respective scaled sequences to produce their respective filtered digital audio signals. For example, each of the filters 424,444 may apply low-pass filtering (e.g., for anti-aliasing) to their respective scaled sequences to produce their respective filtered digital And may be configured to generate an audio signal. Each of the DACs 426 and 446 may be configured to convert their filtered digital audio signal into their respective analog audio signals of the first analog audio signal and the second analog audio signal.

4, primary path module 420 may include one or more streams (e.g., at least some of the BL stream and one or more EL streams, e.g., streams determined to be used for the generation of output audio signals, At least one complete or partial stream in the set) and a first control signal indicating a particular sampling frequency to which the determined stream set corresponds. In particular, a first control signal may be provided to each of these for operation of the scaling section 422, the filter 424 and the DAC 426 of the primary path module 420.

4, secondary path module 440 may include one or more streams (e.g., at least some of the BL stream and one or more EL streams, such as any other stream determined to be used to generate the output audio signal, At least one complete or partial stream in the set), and a second control signal indicating a particular sampling frequency to which that other stream set corresponds. In particular, a second control signal may be provided to each of these for operation of the scaling section 442, the filter 444 and the DAC 446 of the secondary path module 440.

4, the analog multiplexer 460 receives the first analog audio signal and the second analog audio signal as inputs and outputs either the first analog audio signal or the second analog audio signal to the output analog audio signal As an analog signal selector. A third control signal may be provided from stream composition 340 to analog multiplexer 460 so that analog multiplexer 460 can output a first analog audio signal or a second analog audio signal have.

In some embodiments, each element of the receiving-side device 140 may be implemented in hardware. Such hardware may include at least one processor (e.g., a DSP, CPU, GPU, processor core, microprocessor, microcontroller, FPGA, ASIC, RFIC, and / or other hardware and logic circuitry) A removable memory, a removable memory, a hard disk, a flash memory, a magnetic disk storage medium, an optical disk storage medium, and / or other storage device and storage medium), an I / O devices (e.g., communication interface cards, DACs, etc.). The computer-readable storage medium includes computer-executable instructions or program code, program data, and / or other suitable forms of execution that, when executed by a processor, cause the receiving device 140 to perform some operations in accordance with an embodiment of the invention. May be stored in a form accessible by the processor.

Exemplary operations of system 100 for network-based sound source broadcasting

FIG. 6 is a diagram illustrating an exemplary scenario in which an exemplary system 100 for network based tone generator broadcasting operates in accordance with an embodiment of the present invention. In the description that follows, characteristics such as the sampling frequency, the number of bits per sample, the number of channels, the number of subsequences, the bandwidth, the number of streams, etc., and the format and type of data, It should be noted that the exemplary embodiments are not limitative, but exemplary.

을 획득할 수 있다. 실시예에서, 송신측 장치(120)는 사용자 상호작용을 위한 사용자 인터페이스를 제공할 수 있다. 예로서, CDP에 삽입된 CD에 기록된 어떤 오디오 트랙을 선택하는 사용자 입력을 사용자 인터페이스가 수신하는 것에 응답하여, 송신측 장치(120)는 그 오디오 트랙의 디지털 오디오 데이터

를 획득할 수 있다. 다른 예에서, RM 상에서의 발화(speech)를 위한 사용자 입력을 사용자 인터페이스가 수신하는 것에 응답하여, 송신측 장치(120)는 RM에 입력된 소리

로부터 아날로그-디지털 변환기(Analog-to-Digital Converter: ADC)에 의해 생성된 디지털 오디오 데이터

를 획득할 수 있다. 또 다른 예에서, TTS 합성기에 문구를 입력하는 사용자 입력을 사용자 인터페이스가 수신하는 것에 응답하여, 송신측 장치(120)는 TTS 합성기에 의해 그 문구로부터 생성된 오디오 데이터

를 획득할 수 있다. 또 다른 예에서, 멀티미디어 소스로부터의 SDI(Serial Digital Interface)/HDMI(High Definition Multimedia Interface) 규격에 따른 디지털 비디오/오디오 전송 신호를 선택하는 사용자 입력을 사용자 인터페이스가 수신하는 것에 응답하여, 송신측 장치(120)는 그러한 전송 신호에 의해 전달되는 디지털 오디오 데이터

를 획득할 수 있다. 이와 같이 획득된 디지털 오디오 데이터는 송신측 장치(120)로부터 네트워크(130)를 통해 수신측 장치(140)로 스트리밍될 수 있다.As shown in Fig. 6, the transmitting-side apparatus 120 transmits the uncompressed digital audio data

Can be obtained. In an embodiment, the transmitting device 120 may provide a user interface for user interaction. As an example, in response to the user interface receiving a user input selecting an audio track recorded on a CD inserted in the CDP, the transmitting device 120 transmits the digital audio data

Can be obtained. In another example, in response to the user interface receiving a user input for speech on the RM, the transmitting device 120 transmits a sound

The digital audio data generated by the analog-to-digital converter (ADC)

Can be obtained. In another example, in response to a user interface receiving a user input for entering a phrase in a TTS synthesizer, the transmitting device 120 may generate audio data

Can be obtained. In another example, in response to a user interface receiving user input selecting a digital video / audio transmission signal in accordance with a Serial Digital Interface (SDI) / High Definition Multimedia Interface (SDI) standard from a multimedia source, (120) receives digital audio data < RTI ID = 0.0 >

Can be obtained. The digital audio data thus obtained can be streamed from the transmitting-side apparatus 120 to the receiving-side apparatus 140 via the network 130. [

는 192 kHz의 높은 샘플링 주파수를 갖는 오디오 샘플들의 펄스 부호 변조(Pulse Code Modulation: PCM) 시퀀스일 수 있다. 예컨대, 디지털 오디오 데이터

는 HDMI 규격에 의해 지원되는 24 비트 192 kHz 비압축 오디오 데이터일 수 있다. 송신측 장치(120)의 다운샘플링부(220)는 압축되지 않은 원본 버전인 디지털 오디오 데이터

의 8 kHz 다운샘플링된 버전들, 예를 들어, 도 6에 도시된 바와 같이, 24개의 8 kHz의 샘플링 주파수를 갖는 오디오 샘플들의 서브시퀀스

,

, ...,

을 획득할 수 있는데, 여기서

이고, 위의 24개의 8 kHz 다운샘플링된 버전들은 다음과 같이 주어진다:In the exemplary scenario, as can be seen in Figure 6,

May be a Pulse Code Modulation (PCM) sequence of audio samples having a high sampling frequency of 192 kHz. For example,

May be 24 bit 192 kHz uncompressed audio data supported by the HDMI standard. The down-sampling unit 220 of the transmission-side apparatus 120 receives the digital audio data

8 < / RTI > kHz down-sampled versions of the audio samples, e. G., As shown in FIG. 6,

,

, ...,

Can be obtained, where

, And the 24 24 kHz down sampled versions above are given as:

과 5개의 EL 스트림

,

, ...,

로 그룹화할(group) 수 있는데, 여기서 이 스트림들 및 디지털 오디오 데이터

의 다운샘플링된 버전들

,

, ...,

의 관계는 다음과 같을 수 있다:In an exemplary scenario, the scalable stream generator 240 of the transmitting device 120 scans 24 subsequences for temporal scalability into network streams, for example, as shown in FIG. 6, One BL stream

And five EL streams

,

, ...,

, Where these streams and digital audio data < RTI ID = 0.0 >

Down-sampled versions of

,

, ...,

Can be as follows:

In an exemplary scenario, the network interface portion 260 of the transmitting device 120 may packet at least one of such network streams into at least one network packet stream and transmit it over the network 130, As can be seen in the table, a network stream to be transmitted may be selected from among a plurality of predefined network streams for appropriate quality audio playback in view of stream characteristics, required bandwidth, and the like.

,

,

, ...,

중 적어도 하나를 획득할 수 있다.In an exemplary scenario, the network interface portion 320 of the receiving-side device 140 receives at least one network packet stream of audio data for source broadcast on the network 130 and depacketizes it to generate at least one network stream For example, a stream that can be transmitted from the transmission-side apparatus 120

,

,

, ...,

At least one of them can be obtained.

In an exemplary scenario, the stream composition 340 of the receiving device 140 may determine a particular set of streams from the received stream, as shown in the following table, in the generation of an output analog audio signal for playback A plurality of predefined stream sets (each defined to include at least one intact or partial stream of transmittable streams from the transmitting device 120), each of the available sampling frequencies (E.g., a complete EL0 stream, a complete EL1 stream, a full EL1 stream, a full EL1 stream, a full EL1 stream, and a full EL1 stream) to a reception situation on the network 130 and / or a service designated by the user, whole stream, such as the stream and so on, or x ₆ x _18, or the partial EL1 A partial stream), such as a stream, x ₄ + x ₁₆ + x ₂₀ or ₈ x of the partial stream EL2 etc. can be selectively applied. Even if a significant error occurs in a certain network stream transmitted from the transmitting-end device 120 due to frequent errors in the network 130, the network interface 320 of the receiving- (I. E., This portion is less likely to be error-prone and may be included in the stream set) of at least one other complete or partial network stream received with the network stream and / or a network stream experiencing such significant error It is possible to cope with the error generated in the network packet stream in that it can determine a specific set of such streams, including. Particularly, in an environment where frequent errors occur in the network 130, a partial stream may be employed in the stream set, so that even if not a high quality source broadcast, it is possible to provide a suitable level of quality (e.g. corresponding to an 8 kHz or 16 kHz sampling frequency The quality of the sound source broadcast) can be provided.

In the exemplary scenario, once the determined set of streams is delivered, the stream processing portion 360 of the receiving device 140 receives a scaled sequence of audio samples having a particular sampling frequency (corresponding to that stream set) from that stream set And perform appropriate low-pass filtering in accordance with the set of streams to remove aliasing that may occur in the scaled sequence, and generate an output analog audio signal by performing a digital-to-analog conversion. The first analog audio signal generated from the primary path module 420 of the stream processing unit 360 may be selected by the analog multiplexer 460 and output as an output analog audio signal. In addition, in the exemplary scenario, the secondary path module 440 of the stream processing section 360 may operate temporarily in the second mode of operation referred to above if the sampling frequency for use in the generation of the output analog audio signal is changed As a result, it is possible to mitigate or prevent unexpected sound interruption in audio reproduction. The output of the analog multiplexer 460 of the stream processing unit 360 is first converted to a first analog signal by the first path module 420 generated by the primary path module 420, After being retained as an audio signal, a new stream set is applied to the secondary path module 440, and then the output of the analog multiplexer 460 is changed to a second analog audio signal generated by the secondary path module 440, The primary path module 420 now applies the new stream set and then the output of the analog multiplexer 460 is changed to the first analog audio signal generated by the primary path module 420, May operate.

7 is a diagram for explaining performance of an exemplary sound source broadcasting system according to an embodiment of the present invention. With reference to FIG. 7, it is assumed that the original digital audio data in the exemplary sound source broadcasting system 100 has a 16-bit quantization bit number and a stereo channel.

In the exemplary scenario of Figure 6, a source broadcast server, such as source device 120, can send a network packet stream to a source broadcast client, such as destination device 140, over network 130 in the following manner: have.

First, the network packet stream transmission can be performed in a unicast environment. For example, it is advantageous in terms of stability of the network-based sound source broadcasting that a sound source broadcast server such as the transmitting apparatus 120 transmits a network packet stream in a unicast manner. However, the number of clients such as the receiving apparatus 140 As the bandwidth increases, the required bandwidth increases proportionally, which can cause problems. In order to overcome this, in the exemplary scenario, the network interface unit 260 transmits a plurality of network packet streams to important ones among a plurality of clients according to the network conditions, and a basic stream such as a BL stream is transmitted to relatively- The mobile station can perform a balancing operation in a manner of transmitting a signal. In Fig. 7, an improvement according to this operation can be seen. Graph 720 in FIG. 7 shows the bandwidth required in some cases for transmitting digital audio data of audio samples with a sampling frequency of 192 kHz in a unicast environment in the manner described above. On the other hand, the graph 710 of FIG. 7 shows the bandwidth required when the digital audio data is transmitted unicastly as it is. The larger the number of connected clients, the larger the amount of transmission data Lt; / RTI >

In addition, network packet stream transmission may be performed in a multicast environment. For example, a source broadcast server, such as the source device 120, may send a network packet stream in a multicast manner to support a plurality of source broadcast clients, such as the destination device 140, over a network having a limited bandwidth It is also possible to enable various quality source broadcasts with limited bandwidth, and the client can obtain the required network packet stream in a quality-selective manner. However, the multicast environment is a poor environment in which transmission packets are likely to be lost. In an exemplary scenario, the problem of the occurrence of packet loss in such unreliable communications is that the receiving device 140 uses a variable sampling frequency in the generation of the output analog audio signal, as described above in connection with some embodiments. Can be overcome. In addition, when the bandwidth of the network 130 is insufficient, the transmitting-side apparatus 120 can transmit only a basic stream such as a BL stream in a multicast manner adaptively (e.g., in real time). In Fig. 7, an improvement according to this operation can be seen. Graph 740 of FIG. 7 shows the bandwidth required when transmitting digital audio data of audio samples with a sampling frequency of 192 kHz in a multicast environment in the manner described above. On the other hand, the graph 730 of FIG. 7 shows the bandwidth required when transmitting such digital audio data in a multicast manner by constructing the subsequences according to the sampling frequency of Table 2, Of the transmission data.

Further, network packet stream transmission may be performed in a unicast and multicast environment. In an exemplary scenario, a sound source broadcast server, such as the sending device 120, may provide a BL stream in a unicast format And the EL stream can be transmitted in a multicast manner. As a result, it is possible to reproduce audio of a rich quality in an EL stream to be multicast-transmitted while ensuring basic service quality as a BL stream to be a unicast transmission. Graph 750 of FIG. 7 shows the bandwidth required when transmitting digital audio data of audio samples having a sampling frequency of 192 kHz in the unicast and multicast environment in the manner described above. The amount of transmission data shown by graph 750 is the sum of the first expected bandwidth required for a unicast transmission and the second expected bandwidth required for a multicast transmission. The first expected bandwidth is (number of channels) x (number of quantization bits) x (possible sampling frequency of audio samples included in the BL stream) x (number of clients) = 2 x 16 x 8 k x N _c = 256 x N _C kbps (Number of channels) 占 (number of quantization bits) 占 (possible sampling frequency of audio samples included in the EL0 stream to EL4 stream) = 2 x 16 (where N _C is the number of source broadcast clients) (8k + 16k + 32k + 32k + 96k) = 5888 kbps, so the sum of these is 5888 + 256 x N _C kbps. As can be seen in graph 750 of FIG. 7, the increase in bandwidth required as the number of source broadcast clients, such as receiver 140, increases, but such bandwidth increase is only a small amount associated with a basic 8 kHz. Accordingly, the sound source broadcasting system 100 can have a sufficient diversity of the expansion, the service stability, and the reproduction quality.

Furthermore, when bi-directional communication and / or broadcast without delay is required, network packet stream transmission can be performed utilizing the VoIP protocol. In an exemplary scenario, a source broadcast server, such as transmitting device 120, may transmit the BL stream according to the VoIP protocol and transmit the EL stream in a unicast and / or multicast manner. Accordingly, low-delay sound source broadcasting with a basic service quality can be enabled to a BL stream transmitted on the VoIP network. This may be useful in PA systems that need to perform emergency broadcasts or emergency announcements of emergency situations. For example, the exemplary sound source broadcasting system 100 may buffer the received BL stream according to the VoIP protocol during BGM broadcasting, combine the received EL stream with the BL stream with a slight delay, Can be used for high-quality broadcast. When urgent broadcasting such as announcement broadcasting or emergency broadcasting is required during such broadcasting, the exemplary sound source broadcasting system 100 transmits an important message (for example, a human speech or a TTS synthesizer) to the TTS synthesizer by using only the BL stream received through the VoIP network The inputted phrase) can be reproduced in a short time.

The illustrative embodiments may be implemented as a computer-readable storage medium including computer programs embodying the acts, techniques, processes, or any aspects or portions thereof described herein. Such computer-readable storage media may include program instructions, local data files, local data structures, etc., alone or in combination. A program that can implement or utilize the disclosed acts, techniques, processes, or any aspects or portions thereof may be implemented in any type of (e.g., compiled or interpreted) programming language that can be executed by a computer, Assembly language, machine language, procedural language, object-oriented language, and the like, and may be combined with a hardware implementation. The term " computer-readable storage medium " refers to a computer-readable storage medium having stored thereon instructions for execution by a computing device (which, in execution, cause the computing device to perform the disclosed technique) And the like. Examples of computer-readable storage media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, magnetic-optical media such as floppy disks, But are not limited to, memory devices such as solid-state memory.

While certain embodiments of the invention have been described in detail, it should be regarded as illustrative and not restrictive. It will be understood by those skilled in the art that various changes may be made in the details of the disclosed embodiments without departing from the scope of the invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the following claims and their equivalents.

100: Network-based sound source broadcasting system
120: transmitting side device
130: Network
140: Receiving device
220: Downsampling unit
240: scalable stream generator
260: Network interface unit
320: Network interface unit
340:
360:

Claims (18)

An apparatus for streaming audio data on a source broadcast network,
A downsampling unit configured to identify N subsequences of audio samples from an uncompressed sequence of audio samples having a first sampling frequency, the audio samples of each of the N subsequences having the same second sampling frequency Wherein the first sampling frequency is obtained by multiplying the second sampling frequency by a positive integer greater than or equal to N,
A scalable stream generator configured to generate network streams from the N subsequences, the network streams including a base-layer (BL) stream and one or more enhancement-layer (EL) streams, Wherein the BL stream comprises audio samples of only one of the N subsequences and wherein each of the one or the plurality of EL streams comprises an audio sample of at least one other subsequence of the N subsequences, And -
And a network interface configured to packetize the BL stream either alone or with at least one of the one or the plurality of EL streams into at least one network packet stream for transmission on the source broadcast network,
Wherein the network interface is further configured to perform the transmission, wherein the transmission comprises transmitting the packetized BL stream on the source broadcast network in a unicast manner, and transmitting the one or the at least one packetized EL stream to the multi And transmitting on the source broadcast network in a casting manner.
Device. The method according to claim 1,
Wherein identifying the N subsequences comprises distinguishing the uncompressed sequence by the N subsequences, wherein the positive integer is N,
Device. The method according to claim 1,
Wherein the network interface unit is further configured to select whether to transmit the packetized BL stream alone on the source broadcast network or the packetized BL stream with the one or the at least one packetized EL stream,
Device. delete delete delete delete A receiving-side apparatus for network-based sound source broadcasting,
A network interface configured to receive at least one network packet stream of audio data for the network based sound source broadcast on a source network and to depacketize the at least one network packet stream into at least one network stream, Wherein the network stream of at least one of the audio samples includes at least one of a Base-Layer (BL) stream and one or more enhancement-layer (EL) streams, Wherein the uncompressed sequence comprises N subsequences of audio samples, and wherein the audio samples of each of the N subsequences have the same second sampling frequency, wherein the first sampling frequency comprises the second Sampling frequency and the second sampling Wherein the BL stream comprises audio samples of only one of the N subsequences and wherein each of the one or the plurality of EL streams comprises at least one of the N subsequences Comprising audio samples of different subsequences,
A stream composition section configured to determine which particular set of streams in the plurality of stream sets to use for generation of an output analog audio signal for playback, each of the plurality of stream sets comprising one of the BL stream and the one or more EL streams Wherein each of the plurality of sampling frequencies corresponds to a specific sampling frequency among a plurality of sampling frequencies, wherein the sampling frequency includes at least one full or partial stream selected by multiplying the second sampling frequency by a positive integer at most N,
Generating a scaled sequence of audio samples having a particular sampling frequency corresponding to the determined specific stream set from the determined specific stream set and outputting the output analog audio signal to the audio sample of the scaled sequence A stream processor configured to generate the output analog audio signal from the determined specific stream set
Receiving device. 9. The method of claim 8,
Wherein the first sampling frequency is the second sampling frequency multiplied by N,
Receiving device. 9. The method of claim 8,
Wherein generating the scaled sequence comprises extracting audio samples for use as the audio samples of the scaled sequence from the determined particular stream set,
Receiving device. 9. The method of claim 8,
Wherein the plurality of stream sets comprises a first type stream set comprising the BL stream without any combination of the one or the plurality of EL streams and wherein at least one of the BL stream and the one or the plurality of EL streams Further comprising at least one second type stream set,
Receiving device. 12. The method of claim 11,
Wherein the plurality of stream sets comprises at least one third type stream set comprising only one of the one or the plurality of EL streams without a combination with the BL stream, only a portion of one EL stream of the plurality of EL streams At least one fourth type stream set including at least one fourth type stream set,
Receiving device. 9. The method of claim 8,
Wherein the determination is made based on at least one of a situation of the source broadcast network during reception of the network packet streams and a user-specified service of the network-
Receiving device. 14. The method of claim 13,
Wherein the determination is based on at least one of a possible reproduction quality under the situation and a reproduction quality required for the user-specified service, which sampling frequency of the plurality of sampling frequencies is to be used for generation of the output analog audio signal And determining the set of streams corresponding to the determined sampling frequency from the plurality of stream sets as the specific stream set.
Receiving device. 9. The method of claim 8,
Wherein the stream processing unit comprises a primary path module, a secondary path module and an analog multiplexer, the primary path module being configured to generate a first analog audio signal, the secondary path module being configured to generate a second analog audio signal, Wherein the analog multiplexer is configured to output either the first analog audio signal or the second analog audio signal as the output analog audio signal,
Wherein a first determination is made that a first set of streams in the plurality of stream sets will be used for generation of the output analog audio signal and the receiving device enters a first mode of operation, The receiving device continues to operate in the first mode of operation until a subsequent determination is made that another predetermined stream set of the plurality of stream sets is to be used, 1 analog audio signal and the analog multiplexer outputs the first analog audio signal as the output analog audio signal,
Receiving device. 16. The method of claim 15,
Wherein the subsequent determination is based on the determination that other sampling frequencies of the plurality of sampling frequencies will be used for generation of the output analog audio signal instead of the particular sampling frequency corresponding to the first stream set, And a determination that said sampling frequency corresponds to said different sampling frequency.
Receiving device. 16. The method of claim 15,
In response to the second determination being made that during the first mode of operation a second stream set of the plurality of stream sets will be used for generation of the output analog audio signal, the receiving device enters a second mode of operation ,
The primary path module still generating the first analog audio signal from the first stream set,
The secondary path module generating the second analog audio signal from the second stream set,
The analog multiplexer still outputs the first analog audio signal as the output analog audio signal,
The primary path module generating the first analog audio signal from the second stream set,
The secondary path module still generating the second analog audio signal from the second stream set,
Wherein the analog multiplexer outputs the second analog audio signal as the output analog audio signal,
The primary path module still generating the first analog audio signal from the second stream set,
The analog multiplexer outputs the first analog audio signal as the output analog audio signal,
Wherein the receiving-side apparatus enters the first operation mode of the road,
Receiving device. 16. The method of claim 15,
Wherein each of the primary path module and the secondary path module includes a scaling unit, a filter, and a digital-to-analog converter, and wherein the scaling unit scales each of the plurality of stream sets corresponding to a particular sampling frequency of each of the plurality of sampling frequencies Wherein the filter is configured to generate a respective scaled sequence of audio samples having their respective specific sampling frequency from their respective determined set of streams, the filter applying low-pass filtering to each of the scaled sequences, Wherein the digital-to-analog converter is configured to generate a filtered digital audio signal, the digital-to-analog converter being configured to convert the respective filtered digital audio signal into its respective one of the first analog audio signal and the second analog audio signal
Receiving device.

Images