CN115834811A - Multimedia video and audio system and protocol converter thereof - Google Patents

Abstract

The manual proposes a multimedia audio-visual system and its protocol converter. The multimedia audio-visual system includes a storage device, such as a TV, and various audio-visual equipment connected to the back end. It also has a protocol converter. The protocol converter is connected to the storage device. In addition to processing the audio and video signals traditionally input from a specific audio-visual source and outputting them to the storage device for playback, the converter can also directly output the converted audio to the audio output device connected to the protocol converter for playback. Moreover, the protocol converter can process the audio signal received from the storage device through the audio acquisition and processing device, and can return the audio to the audio acquisition and processing device through the audio return channel or the enhanced audio return channel, and finally convert it into the protocol converter itself Support various audio output interface output.

Description

Multimedia audio-visual system and its protocol converter

technical field

The specification proposes an audio-visual system, which particularly refers to a multimedia audio-visual system using a protocol converter supporting an audio return channel.

Background technique

With the vigorous development of the multimedia industry, people's requirements for audio-visual quality are increasing day by day. Most audio-visual devices support multiple transmission interfaces for transmitting audio-visual signals, such as DisplayPort (DP), HDMI, and WiFi, and support various high-quality video specifications. , like the increasingly widely used 4K, 5K and 8K resolutions, enables users to experience a higher level of viewing quality. As for audio, the popularization of more audio formats and audio coding technologies also allows users to have a better listening experience.

Taking the high-definition multimedia interface (hereinafter referred to as HDMI) protocol as an example, the schematic diagram of the HDMI audio-visual system architecture can refer to Figure 1, which shows the functional block diagram of the HDMI protocol. The HDMI protocol defines a source terminal (source) 11 and the sink 13 respectively realize the HDMI source device and the HDMI sink device in the audio-visual equipment. Among them, the source device is a device in the audio-visual system that receives external audio-visual signals, such as a set-top box, DVD audio-visual player or game console, etc., and the storage device is a device that broadcasts after receiving audio-visual signals in the audio-visual system, such as a TV and audio equipment. wait.

At the source end 11, the transmitter (TX) 103 receives the video 101 and audio 102 signals from the video source, and converts them into video and video signals under the HDMI protocol, and then transmits them to the The receiver (RX) 107 of the storage terminal 13, which also realizes the display data channel (display data channel, DDC) and the consumer electronics control protocol (consumer electronics control, CEC) signal for transmitting various information under the HDMI protocol, Afterwards, the video and audio signals are converted and decoded to form broadcast digital content, such as the video 105 and audio 106 shown in the figure.

However, increasingly complex multimedia applications will mix various audio-visual transmission protocols, so a known technology proposes a product called a protocol converter (protocol converter, referred to as PCON), which can be conveniently used in the audio-visual environment of various audio-visual interfaces. The purpose of the converter is to convert the input audio-visual transmission format before outputting, so that the source-storage of different transmission interfaces can be compatible, and the user can flexibly connect various types of audio and video on the terminal storage (such as TV). The transmitter of the transmission interface has successfully extended the scope and functions of multimedia applications.

In addition, for the improvement and improvement of audio application scenarios, under the high-definition multimedia interface (HDMI) protocol, HDMI-supported devices can also use its defined audio return channel (audio return channel, ARC) or enhanced audio return channel The enhanced audio return channel (eARC) technology transmits the audio signal from the storage end to the supply end in reverse, making the audio transmission on the multimedia audio-visual platform more flexible.

The purpose of today's protocol converter products is to enable the source end and the storage end of different audio-visual signal transmission interfaces to transmit audio-visual signals and communicate with each other. For example, a DP-to-HDMI protocol converter is to receive the DP signal transmitted by the DP/Type-C source, convert the signal into an HDMI transmission format, and then transmit it through the HDMI transmitter (TX) Audio and video signals are sent to the storage terminal.

However, in addition to the video and audio transmission format conversion, the concept of communication between DP and HDMI devices is also different. CEC mechanism, which uses the CEC pin of the HDMI port to transmit a single-wire bidirectional control signal, and the user can control all connected HDMI devices through a remote control, so that each HDMI device can interact, and then achieve the effect of linkage control . However, the DP transmission interface does not have a similar concept. Therefore, the protocol converter also needs to pass a CEC signal on the auxiliary line (CEC over aux) technology. The principle is to transfer the CEC control information received by the HDMI receiver (RX) Transfer to the DPCD (DisplayPort configuration data, display port configuration data) under the DP protocol, and transfer to the DP/Type-C supply source through the DP auxiliary line (aux) signal, so that the DP/Type-C The C source device is added to the entire HDMI multimedia platform architecture.

For an example of the known architecture, please refer to FIG. 2, which schematically shows that the DP/Type-C power supply device 21 is connected to the HDMI multimedia platform 25 through the protocol converter 23. The HDMI multimedia platform 25 is shown as the storage terminal in the system architecture. The solid line in the figure Connected lines represent video signals, and dashed lines represent audio signals. The HDMI multimedia platform 25 is provided with a storage device 251 (such as a television set), which receives video signals and audio signals converted into the HDMI protocol from the protocol converter 23. On the other hand, it can also receive audio-visual content from other devices in the platform, such as from The HDMI source 1 255 receives audio signals through the audio acquisition processing device 253 , and can return the audio to the audio acquisition processing device 253 through the audio return channel (ARC/eARC), and can also directly receive audio-visual content from the HDMI source 2 259 . The storage device 251 can additionally output an audio signal to an external audio device 257 for playback.

However, in view of the functions of the known protocol converter (PCON) related products proposed above, there are still some limitations. For example, the HDMI transmitter (TX) of the known protocol converter can only output video and audio signals, and does not Supports the audio return channel/enhanced audio return channel (ARC/eARC) function of the HDMI protocol, and its HDMI storage terminal can pass through the utility pin and hot-plug detection pin of the HDMI port detect(HPD)Pin) returns the audio signal to the HDMI transmitter, so it cannot receive the audio signal input from the HDMI storage terminal, which is equivalent to sacrificing the audio signal input source of the protocol converter itself.

In addition, because the protocol converter focuses on the conversion of different video and audio transmission interfaces, as shown in Figure 2, the protocol converter 23 first parses out the audio signal in the DP signal, and converts it into an audio data packet under the HDMI transmission protocol, and then proceeds further Pass to the HDMI storage terminal (storage device 251), so there is no additional encoding format conversion or processing for the audio in the audio data packet, and the audio data parsed from the DP signal can only go to the HDMI storage terminal in one direction Pass-through, with no other audio output options. In this way, if the user wants a higher-quality listening experience, unless the connected HDMI storage terminal can support it, another audio processing device needs to be connected to achieve it.

Based on the above two reasons, although the DP/Type-C power supply device 21 shown in Figure 2 can integrate the image part into the HDMI multimedia platform architecture, it cannot effectively integrate it in audio transmission, which increases the user's ability to use multimedia audio and video. The burden on the erection of the platform reduces the convenience of use.

Contents of the invention

In view of the defect that the protocol converter (PCON) proposed by the known technology cannot handle the audio input returned from the HDMI storage terminal, and can only be transmitted to the HDMI storage terminal in one direction, and has no other audio output options, the present disclosure A multimedia audio-visual system and its protocol converter are proposed, in which the protocol converter can not only process the audio signal input from a specific audio-visual source, but also process the audio signal returned from the storage terminal in the multimedia audio-visual system, and then convert it into various Audio transmission interface output.

According to one embodiment, the main components of the proposed multimedia audio-visual system are a storage device and a protocol converter. The protocol converter is connected to the storage device, which includes an audio-visual receiver to receive audio-visual data, and the video part is sent to the video processing The device is used to perform codec processing for the video format, and output the processed video and audio to the storage device through the audio-visual transmitter, and also includes an audio protocol processing unit, which can receive the audio part of the audio-visual data from the audio-visual receiver and perform audio processing. processed, converted into an audio format, and then output to a corresponding playback device, or output to an audio output device connected to a protocol converter. In addition, the audio protocol processing unit also receives the returned audio signal from the storage device through the audio transceiver circuit, and then outputs the audio signal to the audio output device after audio processing.

The protocol converter receives the audio signal from the storage device through an audio return channel (ARC) or an enhanced audio return channel (eARC). And in the multimedia audio-visual system, the storage device is also connected to one or more audio-visual equipment, and these audio-visual equipment can become the audio-visual data source of the storage device, and also form the audio signal output from the storage device to the protocol converter.

Preferably, the audio part of the audio-visual data received by the protocol converter through the audio-visual receiver is audio in the first format, which is converted into audio in the second format and output to the storage device, and the audio received by the protocol converter is also from the storage device signal, which is the second format audio.

Further, the protocol converter is provided with at least one audio output interface, the output line is switched through the audio output multiplexer circuit, and one of the audio output interfaces is determined, and the audio output interface can be one of an analog interface, a digital interface, and a radio frequency interface. one or more.

In order to further understand the features and technical contents of the present invention, please refer to the following detailed description and drawings related to the present invention. However, the provided drawings are only for reference and description, and are not intended to limit the present invention.

Description of drawings

Figure 1 shows a functional block diagram of the HDMI protocol;

Figure 2 shows a schematic diagram of a known architecture integrating a DP/Type-C power supply device into an HDMI multimedia platform;

FIG. 3 shows a schematic diagram of the situation of a multimedia audio-visual system applying the protocol converter proposed by the present disclosure;

FIG. 4 shows a schematic diagram of an embodiment of a multimedia audio-visual system architecture proposed by the present disclosure;

Figure 5 shows a block diagram of an embodiment of a protocol converter; and

FIG. 6 shows a block diagram of an embodiment of an audio protocol conversion circuit in a protocol converter.

Detailed ways

The implementation of the present invention is described below through specific specific examples, and those skilled in the art can understand the advantages and effects of the present invention from the content disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and various modifications and changes can be made to the details in this specification based on different viewpoints and applications without departing from the concept of the present invention. In addition, the drawings of the present invention are only for simple illustration, and are not drawn according to the actual size, which is stated in advance. The following embodiments will further describe the relevant technical content of the present invention in detail, but the disclosed content is not intended to limit the protection scope of the present invention.

It should be understood that although terms such as "first", "second", and "third" may be used herein to describe various elements or signals, these elements or signals should not be limited by these terms. These terms are mainly used to distinguish one element from another element, or one signal from another signal. In addition, the term "or" used herein may include any one or a combination of more of the associated listed items depending on the actual situation.

In order to improve the known protocol converter (PCON) can only output audio and video signals, does not support the audio return channel/enhanced audio return channel (ARC/eARC) function of the HDMI protocol, and cannot handle the output from the HDMI storage terminal (such as a TV set) The audio input returned can only be transmitted in one direction to the HDMI storage end and the inconvenience caused. This disclosure proposes a multimedia audio-visual system and its protocol converter. One of its main technical purposes is to enable The proposed protocol converter has an audio signal processing function. Through the technical improvement of the transmission interface, the original protocol converter with relatively simple functions can fully cooperate with the storage device in the audio-visual system in terms of video or audio signals. In addition, an external audio processing device is used to process this part of the audio. This novel protocol converter can be integrated into a multimedia audio-visual system based on storage devices (such as TVs, audio-visual playback devices), for example, based on high-definition multimedia interface (HDMI) multimedia audio-visual system.

FIG. 3 shows a schematic diagram of a situation of a multimedia audio-visual system applying the protocol converter proposed by the present disclosure.

The multimedia audio-visual system shown in the figure includes an audio-visual playback device 32, such as a TV, as a storage device in the multimedia audio-visual system, and receives audio-visual data transmitted by an audio-visual source 31 through a protocol converter 30, wherein the audio-visual source 31 can be from a specific format The transmission interface (such as DP/Type-C), the audio-visual data transmitted through this transmission interface can be converted by the protocol converter 30 into the transmission format supported in the storage terminal (such as HDMI). The audio-visual playback device 32 at the storage end can be connected to one or more audio-visual devices at the same time. The first audio-visual device 301 and the second audio-visual device 302 are shown in the figure. The illustration uses audio-visual devices at home as examples, such as video game consoles and DVD players. etc., the first audio-visual device 301 and the second audio-visual device 302 are various audio-visual sources in this multimedia audio-visual system, and are also sources of audio-visual data of the storage device.

According to one embodiment, the audio-visual playback device 32 at the storage end, as well as the first audio-visual device 301 and the second audio-visual device 302, can support a Consumer Electronics Control (CEC) that is added to the HDMI standard by the High-Definition Multimedia Interface (HDMI) specification. )Function. The audio-visual system conforming to the HDMI-CEC specification can be connected to various audio-visual equipment supporting HDMI through a connection line under a specific specification (such as a cable with two-way communication). In this way, the audio-visual system can be controlled by only one remote control 305 Various devices that support HDMI-CEC in the storage terminal.

Taking FIG. 3 as an example, under the HDMI-CEC standard, the user can operate the remote control 305 to operate towards the audio-visual playback device 32, and the generated control signal can be transmitted (such as a remote control pass through command (Remote Control Pass Through)) to all connected devices. The equipment of the audio-visual playing device 32 , such as the first audio-visual device 301 and the second audio-visual device 302 shown in the figure, can be transmitted to the protocol converter 30 under the multimedia audio-visual system proposed in this disclosure.

According to the embodiment shown in the figure, in addition to converting the audio-visual data input from the audio-visual source 31 and transmitting it to the audio-visual playback device 32, the protocol converter 30 can also process the audio-visual playback device 32 through the audio return channel/enhanced audio return channel. (ARC/eARC) is passed back to the audio signal of the protocol converter 30, and the audio-visual equipment connected to the storage device (i.e. the audio-visual playback device 32) also forms the audio signal that the storage device outputs to the protocol converter 30, and is input to After the audio signal of the protocol converter 30 is converted, it is output to the sound system 33 for playback through a specific output interface.

FIG. 4 shows a schematic diagram of an embodiment of a multimedia audio-visual system architecture proposed in the present disclosure. The main components of the illustrated multimedia audio-visual system include a protocol converter 403, a storage device 405, and various audio-visual devices connected to the storage device 405 in the system, as shown in the figure, a second-format audio-visual source 409, an audio output device (such as External speakers and related equipment, earphones, etc.) 411 and a second format video and audio source 413 . In addition, the improved protocol converter 403 can support the audio return channel/enhanced audio return channel (ARC/eARC) function of the HDMI protocol, and the protocol converter 403 can process the audio signal returned from the storage device 405, so In the multimedia audio-visual system, the protocol converter 403 can directly output audio to various audio output devices, which is different from the above-mentioned audio output device 411 connected to the storage device 405, the audio output device connected to the protocol converter 403 is as shown in the figure audio/video receiver (AVR) 431 , wireless receiver 433 , earphone 435 and speaker system 437 .

According to the illustrated embodiment, the multimedia audio-visual system receives the first-format audio-visual content from the first-format audio-visual source 401, such as the data under the DP/Type-C transmission format described in the above example, including audio and video in a specific format, The audio-visual data received by the protocol converter 403 is converted into an audio-visual format, such as converted into HDMI-format audio-visual data, that is, transmitted to the storage device 405, and the audio-visual content is played by related audio-visual equipment.

On the other hand, in the multimedia audio-visual system, different audio-visual sources can be provided inside, such as the second-format audio-visual source one 409 in the figure, in addition to connecting the storage device 405 through an HDMI cable (or wirelessly), the related audio The signal can be input to the storage device 405 through the audio acquisition and processing device 407 , or the storage device 405 itself is used as an audio signal source, and then input to the audio acquisition and processing device 407 through the audio return channel 415 . On the other hand, as shown in the second format video and audio source 2 413 , the storage device 405 can be directly connected to the storage device 405 through an HDMI cable (or wirelessly), and the video and audio content can be directly input to the storage device 405 . As far as the storage device 405 is concerned, the audio can be output to an additional audio output device 411 for playback.

In particular, the protocol converter 403 proposed in this disclosure utilizes a circuit supporting audio return channel/enhanced audio return channel (ARC/eARC) function to process the audio signal returned from the storage device 405 . That is to say, the protocol converter 403 receives audio and video signals in the first format from the source 401 of the first-format video and audio and then converts them into the second format supported by the multimedia audio-visual system based on the storage device 405. The protocol converter 403 A return audio signal can also be received from the storage device 405 through the audio return channel 417 . In this way, the protocol converter 403 can encode and decode the audio signal transmitted by the audio-visual source 401 in the first format or the audio signal returned from the storage device 405, convert it into a format supported by various audio transmission interfaces, and then pass the protocol converter One or more audio playback devices connected to 403 output, as shown in this illustration, the wired or wireless output devices supported by protocol converter 403, such as audio-visual receiver 431 and wireless receiver 433, can also include digitally converted analog signals from earphones 435 and speaker system 437 output.

与无线网络

等，因此使用者将可以在此多媒体影音系统中通过协议转换器403更自由地将接收到的各种音频格式传递给对应的音频播放装置来播放。According to the implementation example, the output formats such as I ² S (Inter-IC Sound), S/PDIF (Sony/Philips Digital Interface), and Line-Out analog audio signals are output in the audio playback device supported by the protocol converter 403; output formats such as bluetooth

with wifi

etc., so the user can more freely pass the various audio formats received to the corresponding audio playback device through the protocol converter 403 in the multimedia audio-visual system for playback.

What's more, the protocol converter 403 can also perform various post-processing on the audio signal, such as volume adjustment, noise reduction, equalization, etc., or codec the received audio data, for example, the received audio signal is Compressed and encoded audio formats, such as AC3 (Audio Coding version 3), DTS (Digital Theater Systems) and MPEG (Moving Pictures Experts Group) audio encoding formats, in addition, multi-channel (Multi-Channel) or multi-source (Multi- stream) category belongs to it, all of which can be directly decoded and restored or converted into any audio format for subsequent applications through the protocol converter 403 proposed in the present disclosure.

Also because of this, the proposed protocol converter 403 can directly process the received audio signal without connecting other audio processing devices or processing it through a specific device in the system, and can directly transmit it to various audio signals docked with the protocol converter 403. The audio playback device plays the audio, which can reduce the sound delay as much as possible and give the user the most direct listening experience.

Regarding the circuit system implementing the protocol converter, reference may be made to the block diagram of the embodiment shown in FIG. 5 .

The figure shows the protocol converter 50 connected to the storage device 53 in the multimedia audio-visual system. After receiving audio-visual data from the first-format audio-visual signal 51 , the format is converted and output to the storage device 53 . A video and audio receiver 501 is provided in the protocol converter 50 to separate the audio and video data, and the video part is sent to the video processor 503 to perform codec processing for the video format, such as converting the input video and audio in the first format to the HDMI format supported by the multimedia audio and video system , and then output to the storage device 53 via the audio-visual transmitter 505 . Propose an audio protocol processing unit 500, the audio part in the audio-visual data received from the audio-visual receiver 501 will be sent to the audio protocol processing unit 500, the codec of the audio signal is carried out, after being converted into a specific audio format, it can be directly from the protocol converter 50 Output to the audio output device connected to the protocol converter 50 , such as the audio system 55 shown in the figure, or output to the storage device 53 through the video and audio transmitter 505 . The video-audio transmitter 505 is a connection interface between the protocol converter 50 and the storage device 53 , such as an HDMI transmission interface.

In particular, however, the protocol converter 50 may receive audio signals from the storage device 53 via a supported audio return channel 511 (which may be an audio return channel (ARC) or an enhanced audio return channel (eARC)) via The audio return receiving circuit 507 sends it to the audio protocol processing unit 500, and then converts it into a specific audio format and then directly outputs it to the sound system 55. It can also send multiple channels to different speakers to achieve the effect of depth of field and surround.

Wherein the protocol converter 50 processes the audio signal to and from the protocol converter 50 by the audio protocol processing unit 500, an embodiment block diagram of the audio protocol processing unit 500 can be shown with reference to FIG. 6, wherein the audio protocol processing unit 500 can be implemented in the protocol converter The firmware or software in the circuit in 50, or an audio protocol conversion circuit, the embodiment shows that the audio protocol processing unit 500 is provided with an audio processing circuit 61, which is used to process the audio signal input to the protocol converter and form an output Audio, especially processing the first-format audio 601 input from the first-format audio-video source, or the second-format audio 602 returned from the storage device in the multimedia audio-visual system. As far as the circuit and its functions are concerned, there are mainly four parts, and the embodiments are as follows.

The first part is the audio receiving and transmitting module, such as the audio receiving module 63 and the audio transmitting module 69 shown in the figure, and the audio receiving module 63 in the audio protocol processing unit 500 processes the audio of these two formats respectively, as shown in the figure The first audio receiver 631 and the second audio receiver 632 that receive audio signals in different formats mainly work to receive the first format audio 601 (such as DP/Type-C transmission format audio) and the second format audio 602 (such as product HDMIeARC/ARC audio data packets sent back from the storage device). Wherein, the audio receiving module 63 can respectively decode the audio data packets of the first format audio 601 received by the first audio receiver 631 and the second format audio 602 received by the second audio receiver 632, and obtain the audio sampling data therein and The audio information, such as the sampling rate, the number of audio channels, and the encoding format, etc., are then converted to the audio transmission interface and output audio signals through the audio transmission module 69 .

On the other hand, the second audio receiver 632 in the audio receiving module 63 receives the second format audio 602 returned by the audio return channel or the enhanced audio return channel from the storage device in the multimedia audio-visual system. During processing, the discovery and disconnection process is initially performed. According to one embodiment, the audio receiving module 63 finds that the connected storage device (HDMI Sink) supports the enhanced audio return channel (eARC), and the circuit will switch to the enhanced audio return channel (eARC). Channel receiving mode, wherein the second audio receiver 632 can receive uncompressed sound data with a maximum bandwidth of 36.864Mbps under the Enhanced Audio Return Channel (eARC) (for example, 8-channel 24bit L-PCM with a sampling rate of 192KHz ( linear pulse-codemodulation) audio signal); if the audio receiving module 63 finds that it does not support the enhanced audio return channel (eARC), it will automatically degrade to the general audio return channel mode, and simultaneously switch the circuit to the audio return channel mode In this mode, the second audio receiver 632 can only receive uncompressed audio data with a maximum bandwidth of 9.216 Mbps (for example, a 2-channel 24bit L-PCM audio signal with a sampling rate of 192KHz). Regardless of the general audio return channel or the enhanced audio return channel mode, the same as the first format audio 601 is processed, the audio receiving module 63 also obtains the sound sampling data and related audio information for subsequent audio transmission modules 69 used.

According to the illustrated embodiment, the audio transmission module 69 is provided with an I2S signal generator 691 for outputting the I2S signal 603 for various output formats, and an SPDIF signal generator 692 is provided for outputting the SPDIF signal 604. A digital-to-analog converter 693 is used to convert digital signals into analog signals to output analog signals 605, and a wireless transmitter 694 is also provided to output radio frequency signals 606. Various output signals will correspond to one audio output device.

The second part is the audio input and output multiplexer module, such as the audio input multiplexer circuit 65 and the audio output multiplexer circuit 67 shown in the figure, through the operation of the multiplexers 651 and 671, the protocol can be converted The converter can freely switch between different audio signal input sources and output various audio transmission interfaces, and, in addition to switching the audio signal transmission route, the embodiment can include functions such as power switch and clock frequency switching of the protocol converter.

According to this embodiment, the audio input multiplexing circuit 65 can automatically or manually switch the input line according to the source of the audio signal, including the control signal generated by automatic judgment, or the signal generated by the manual switching switch, and decides to switch to receive the first audio receiver. 631 or the first format audio 601 or the second format audio 602 output by the second audio receiver 632 , so that audio in different formats is input to the audio processing circuit 61 through the multiplexer 651 in the audio input multiplexing circuit 65 . The protocol converter is provided with at least one audio output interface. When the audio processing circuit 61 encodes and decodes the first or second format audio according to the output requirements, it can be multiplexed according to the control signal received by the audio output multiplexing circuit 67. The output circuit is switched by the device 671 to determine one of the audio output interfaces. In this example, the audio output multiplexer circuit 67 is electrically connected to various signal generators in the audio transmission module 69, corresponding to various audio output interfaces. This example shows The audio output interface is a digital interface of various audio formats (such as I2S, SPDIF, etc.), or an analog interface converted from digital to analog signal, such as a headphone or speaker system output interface, which can also be converted into Bluetooth communication and wireless network and other wireless radio frequency interfaces. It should be mentioned here that the transmission interfaces for input and output audio supported in the protocol converter proposed in this disclosure are not limited to the specifications listed in the above embodiments, and can switch arbitrarily or simultaneously output audio signals to various audio formats The signal generator achieves the purpose of flexibly converting the audio transmission interface.

The third part is the audio processing circuit 61, which can be realized by software, firmware or hardware. It is the core of the audio protocol processing unit 500, and its purpose is to perform codec or various post-processing on the audio signal. According to an embodiment, the audio processing circuit 61 can L-PCM encoding format audio signal is compressed into formats such as AC3, MPEG, DTS or Dolby, or reversely decompressed back to L-PCM format; audio processing circuit 61 can also perform various digital audio signal processing, such as noise reduction and volume control , popping suppression, or adjust the timbre through an equalizer, etc., and then re-sample and package the audio signal into the target transmission interface format, and send the audio signal through the transmission circuit of each transmission interface, or transmit it to the picture through the audio-visual transmitter 505 5 shows the accumulator 53. What's more, in a multimedia audio-visual system supporting HDMI CEC and DP Aux-to-CEC technology, the audio processing circuit 61 also processes control signals under the Consumer Electronics Control Protocol (CEC), such as in HDMI CEC and DP Aux-to-CEC. Control signal under CEC technology.

The fourth part is the software and firmware for system behavior integration, which can control the circuits and modules in the audio protocol processing unit 500 according to various multimedia application scenarios (such as theater, sports or human voice modes) to integrate and manage protocols The software, firmware and circuit operation of the converter, including decision-making, arbitration, interrupt processing and other behaviors, enable the protocol converter to realize a complete and comprehensive video and audio multimedia interface conversion device.

According to one embodiment, the software and firmware of the protocol converter are implemented by memory and processor (such as audio processing circuit 61) blocks, the program is stored in the memory, and the system is driven by the processor to execute the program to drive the protocol converter. The control logic, parameter setting, arbitration judgment, power management, interrupt processing, time scheduling, etc. are realized by each unit module in the protocol converter described in the above embodiments.

In summary, according to the multimedia audio-visual system described in the above embodiments, the protocol converter can enhance the freedom of audio conversion and achieve better audio processing capabilities through the protocol converter. The protocol converter can be integrated into the HDMI-CEC function of the multimedia audio-visual system. And in the DP AUX-to-CEC technology, the protocol converter can connect all devices through the CEC function of the HDMI multimedia audio-visual platform, and it is also compatible with the original protocol conversion system behavior, so that the multimedia audio-visual system can increase the multimedia processing of the protocol converter While maintaining capability and application flexibility, it can also maintain compatibility, and finally integrate the entire protocol converter into a complete multimedia solution.

The content disclosed above is only a preferred feasible embodiment of the present invention, and does not therefore limit the scope of the patent application of the present invention. Therefore, all equivalent technical changes made by using the description and drawings of the present invention are included in the application of the present invention. within the scope of the patent.

Explanation of reference signs

11: Source end

101: Video

102: Audio

103: Teleporter

13: storage end

105: Video

106: Audio

107: Receiver

21:DP/Type-C power supply device

23: Protocol Converter

25: HDMI multimedia platform

251: storage device

253: Audio acquisition and processing device

255:HDMI source one

259: HDMI source two

257:Audio device

31: Video source

30:Protocol Converter

32: Audio-visual playback device

33: Audio system

301: The first audio-visual installation

302: Second audio-visual device

305: remote control

401: First format audio and video source

403: Protocol Converter

405: storage device

407: audio acquisition processing device

409:Second format audio and video source 1

411: Audio output device

413:Second format audio and video source 2

431: Audio-visual receiver

433: wireless receiver

435: Headphones

437: Horn system

415,417: audio return channel

50:Protocol Converter

51: First format audio and video signal

53: storage device

501: AV receiver

503: Video processor

505: Audio and video transmitter

507: Audio return receiving circuit

500: audio protocol processing unit

55: Audio system

511: audio return channel

61: Audio processing circuit

63: Audio receiving module

601: First format audio

602: second format audio

631: the first audio receiver

632: second audio receiver

65: Audio input multiplexer circuit

651: multiplexer

67: Audio output multiplexer circuit

671: multiplexer

69:Audio transmission module

691: I2S signal generator

692: SPDIF signal generator

693: Digital to Analog Converter

694:Wireless Transmitter

603: I2S signal

604: SPDIF signal

605: Analog signal

606:RF signal

Claims (10)

1. A protocol converter, comprising: The audio-visual receiver receives audio-visual data, in which the video part is sent to the video processor, and codec processing is performed for the video format; The audio protocol processing unit receives the audio part of the video data from the video receiver, performs audio processing, and converts it into an audio format, or receives the audio signal from the storage device through the audio return receiving circuit, and then performs audio processing output to an audio output device connected to the protocol converter; and The audio-video transmitter outputs the processed video and audio to the storage device. 2. The protocol converter of claim 1, wherein the protocol converter receives the audio signal from the storage device through an audio return channel or an enhanced audio return channel. 3. The protocol converter as claimed in claim 1, wherein the protocol converter switches the input line through an audio input multiplexing circuit to determine whether to receive the audio in the first format or the audio in the second format. 4. The protocol converter as claimed in claim 3, wherein the audio part of the audio-visual data received by the protocol converter through the audio-visual receiver is the first format audio, which is output to the storage device after conversion, and, The audio signal received by the protocol converter from the storage device is the second format audio. 5. The protocol converter as claimed in claim 4, wherein the audio protocol processing unit is provided with an audio receiving module and an audio transmission module, wherein the audio receiving module includes a first audio receiver and a second audio receiver, Processing the audio in the first format and the audio in the second format respectively. 6. The protocol converter as claimed in claim 5, wherein the first format audio received by the first audio receiver and the second format audio received by the second audio receiver are respectively subjected to audio packet decoding to obtain Wherein the audio sampling data, the audio sampling data includes the sampling rate, the number of sound channels and the encoding format, after being converted by the audio transmission interface, the audio signal is output through the audio transmission module. 7. The protocol converter as claimed in claim 5, wherein the second audio receiver receives the audio in the second format returned by the storage device through an audio return channel or an enhanced audio return channel, and performs discovery and The process is disconnected to find that the storage device supports the enhanced audio return channel or does not support the enhanced audio return channel. 8. The protocol converter as claimed in claim 1, wherein the protocol converter is provided with at least an audio output interface, and an output line is switched by an audio output multiplexing circuit to determine one of the audio output interfaces. 9. The protocol converter as claimed in any one of claims 1 to 8, wherein the audio protocol processing unit is provided with an audio processing circuit for performing codec of audio signals, and processing control under the consumer electronics control protocol Signal. 10. A multimedia audio-visual system, comprising: storage devices; and A protocol converter connected to the storage device, wherein the protocol converter includes: The audio-visual receiver receives audio-visual data, in which the video part is sent to the video processor, and codec processing is performed for the video format; The audio protocol processing unit receives the audio part of the video data from the video receiver, performs audio processing, and converts it into an audio format, or receives the audio signal from the storage device through the audio return receiving circuit, and then performs audio processing output to the audio output device connected to the protocol converter; and The audio-video transmitter outputs the processed video and audio to the storage device.

Images