[go: up one dir, main page]

CN113709558A - Multimedia processing method and multimedia interaction system - Google Patents

Multimedia processing method and multimedia interaction system Download PDF

Info

Publication number
CN113709558A
CN113709558A CN202111175338.7A CN202111175338A CN113709558A CN 113709558 A CN113709558 A CN 113709558A CN 202111175338 A CN202111175338 A CN 202111175338A CN 113709558 A CN113709558 A CN 113709558A
Authority
CN
China
Prior art keywords
terminal device
information
wireless broadcasting
video
continuously
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111175338.7A
Other languages
Chinese (zh)
Other versions
CN113709558B (en
Inventor
余青松
张志中
孔德华
刘瑞宝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Luxshare Electronic Technology Kunshan Ltd
Original Assignee
Luxshare Electronic Technology Kunshan Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Luxshare Electronic Technology Kunshan Ltd filed Critical Luxshare Electronic Technology Kunshan Ltd
Priority to CN202111175338.7A priority Critical patent/CN113709558B/en
Publication of CN113709558A publication Critical patent/CN113709558A/en
Application granted granted Critical
Publication of CN113709558B publication Critical patent/CN113709558B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4856End-user interface for client configuration for language selection, e.g. for the menu or subtitles

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

本申请公开了一种多媒体处理方法及多媒体交互系统。所述多媒体处理方法包括:终端设备和无线播音装置建立连接,且传送转写指令给无线播音装置;终端设备播放视频的过程中,与终端设备连接的无线播音装置持续接收并压缩视频的语音信息,以持续回传压缩信息给终端设备;终端设备将实时接收到的压缩信息解压缩,以获取待翻译信息;终端设备将待翻译信息传送至云端服务器进行翻译,以获取具有目标语种的文字信息;以及终端设备将文字信息显示在其播放的视频的画面上。因此,解决终端设备播放的视频没有字幕或者字幕不是用户所熟悉的语言的问题,提高用户观看视频的体验。

Figure 202111175338

The present application discloses a multimedia processing method and a multimedia interaction system. The multimedia processing method includes: establishing a connection between the terminal device and the wireless broadcasting device, and transmitting a transcription instruction to the wireless broadcasting device; during the process of playing the video by the terminal device, the wireless broadcasting device connected with the terminal device continuously receives and compresses the voice information of the video. , to continuously return the compressed information to the terminal device; the terminal device decompresses the compressed information received in real time to obtain the information to be translated; the terminal device transmits the to-be-translated information to the cloud server for translation to obtain text information in the target language ; and the terminal device displays text information on the screen of the video it plays. Therefore, the problem that the video played by the terminal device has no subtitles or the subtitles are not in a language familiar to the user is solved, and the user's experience of watching the video is improved.

Figure 202111175338

Description

Multimedia processing method and multimedia interaction system
Technical Field
The present application relates to the field of multimedia technologies, and in particular, to a multimedia processing method and a multimedia interaction system.
Background
With the continuous development of computer technology and communication technology, people increasingly use terminal equipment to watch videos and play audio through a wireless connection wireless broadcast device to acquire clearer or high-quality sound. However, foreign videos (e.g., movies) viewed by the user may have no subtitles, or subtitles are not in a language familiar to the user, such that the user has a poor experience in viewing foreign videos.
Therefore, a need exists in the art for a multimedia processing method and a multimedia interactive system that can improve the viewing experience of a user viewing a foreign video using a terminal device in conjunction with a wireless broadcasting device.
Disclosure of Invention
The embodiment of the application provides a multimedia processing method and a multimedia interaction system, which can solve the problem that in the prior art, a user watching a foreign video by using a terminal device and a wireless broadcasting device has poor watching experience because the watched video does not have subtitles or the subtitles are not familiar languages.
In order to solve the technical problem, the present application is implemented as follows:
the application provides a multimedia processing method, which comprises the following steps: the terminal equipment establishes connection with the wireless broadcasting device and transmits a transcription instruction to the wireless broadcasting device; in the process of playing the video by the terminal equipment, the wireless broadcasting device connected with the terminal equipment continuously receives and compresses the voice information of the video so as to continuously return the compressed information to the terminal equipment; the terminal equipment decompresses the compressed information received in real time to acquire the information to be translated; the terminal equipment transmits the information to be translated to a cloud server for translation so as to obtain the character information with the target language; and the terminal equipment displays the text information on the picture of the video played by the terminal equipment.
The application provides a multimedia interaction system, which comprises: the system comprises a wireless broadcast device, terminal equipment and a cloud server. The terminal equipment is used for establishing connection with the wireless broadcasting device and transmitting the transcription instruction to the wireless broadcasting device. The cloud server is connected with the terminal equipment through a network. During the process of playing the video by the terminal equipment, the wireless broadcasting device which is connected with the terminal equipment and receives the transcription instruction continuously receives and compresses the voice information of the video so as to continuously return the compressed information to the terminal equipment; the terminal equipment decompresses the compressed information received in real time to acquire the information to be translated; the terminal equipment transmits the information to be translated to a cloud server for translation so as to obtain the character information with the target language; and the terminal equipment displays the text information on the picture of the video played by the terminal equipment.
In this embodiment of the application, the wireless broadcast device obtains the voice information of the video played by the terminal device in real time, and returns the compressed information corresponding to the voice information to the terminal device, so that the terminal device decompresses the compressed information and translates the decompressed compressed information through the cloud server, obtains the text information (i.e., the text information of the language familiar to the user) corresponding to the played video and having the target language, and further displays the text information on the picture of the played video, thereby improving the experience of the user in watching the video. In addition, because the voice information of the video played by the terminal device in real time is acquired through the wireless broadcast device, the multimedia processing method and the multimedia interaction system in the embodiment of the application are suitable for being applied to the situation that the terminal device playing the video cannot directly acquire the voice information of the video watched by the user (for example, the terminal device cannot directly acquire the voice information of the video watched by the user based on the authority problem).
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a block diagram of an embodiment of a multimedia interaction system according to the present application; and
fig. 2 is a flowchart illustrating an embodiment of a multimedia processing method according to the present application.
Detailed Description
Embodiments of the present invention will be described below with reference to the accompanying drawings. In the drawings, the same reference numerals indicate the same or similar components or process flows.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, values, method steps, operations, components, and/or components, but do not preclude the presence or addition of further features, values, method steps, operations, components, and/or groups thereof.
It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. In contrast, when an element is described as being "directly connected" or "directly coupled" to another element, there are no intervening elements present.
Please refer to fig. 1, which is a block diagram illustrating an exemplary embodiment of a multimedia interactive system according to the present application. As shown in fig. 1, the multimedia interaction system 1 includes: the wireless broadcast device 11, the terminal equipment 12 and the cloud server 13. The terminal device 12 may be selectively connected to the wireless broadcasting device 11 wirelessly, and the cloud server 13 is connected to the terminal device 12 through a network (shown in fig. 1 as a cloud shape).
In practical implementations, the wireless broadcasting device 11 may be, but is not limited to, a wireless headset or a wireless electronic device with broadcasting function, such as: intelligent glasses or wireless sound equipment capable of broadcasting; terminal device 12 may be, but is not limited to, a mobile terminal, a tablet computer, a desktop computer, a laptop/notebook computer, or a smart television; the wireless communication protocol between the wireless broadcaster 11 and the terminal equipment 12 may include, but is not limited to, WiFi, bluetooth or ZigBee; the network of the terminal device 12 connected to the cloud server 13 may include, but is not limited to, the internet, a wide area network, a metropolitan area network, a local area network, a VPN network, or a wireless Ad Hoc network (Ad Hoc network).
In this embodiment, the terminal device 12 is configured to establish a connection with the radio broadcasting apparatus 11 and transmit a transcription instruction to the radio broadcasting apparatus 11.
In one embodiment, terminal equipment 12 cannot directly transmit instructions to the wireless broadcaster 11 to which it is wirelessly connected, and therefore, terminal equipment 12 may download and install an application program for controlling wireless broadcaster 11 to transmit the transcription instructions to wireless broadcaster 11 to which it is connected via the application program.
In this embodiment, in the process of playing the video by the terminal device 12, the wireless broadcast device 11, which is connected to the terminal device 12 and receives the transcription instruction, continuously receives and compresses the voice information of the video, so as to continuously return the compressed information to the terminal device 12; the terminal device 12 decompresses the compressed information received in real time to obtain the information to be translated; the terminal device 12 transmits the information to be translated to the cloud server 13 for translation to obtain the text information with the target language; the terminal device 12 displays the text information on the screen of the video played by it. Therefore, the multimedia interactive system 1 can perform the translation function by using the wireless broadcast device 11 as a medium for capturing and transmitting the voice information of the video and the cloud server 13, so that the terminal device 12 can provide the subtitles in the familiar language corresponding to the video watched by the user, thereby improving the experience of the user in watching the video.
In one embodiment, the wireless communication protocol between the wireless broadcasting device 11 and the terminal device 12 may be bluetooth, and therefore, the terminal device 12 may establish a bluetooth Audio Distribution Profile (A2DP) connection with the wireless broadcasting device 11, so that the terminal device 12 may transmit the voice information of the video it is playing to the wireless broadcasting device 11 based on the A2DP connection.
In one embodiment, since the wireless broadcast device 11 needs to return the compressed information to the terminal device 12 while receiving the voice information of the video from the terminal device 12, in order to prevent the wireless broadcast device 11 from returning the compressed information to the terminal device 12, which occupies too much communication bandwidth between the wireless broadcast device 11 and the terminal device 12, and jam the transmission of the voice information transmitted to the wireless broadcast device 11 by the terminal device 12, the transmission of the compressed information from the wireless broadcast device 11 to the terminal device 12 needs to be performed in the time interval of the voice information transmitted to the wireless broadcast device 11 by the terminal device 12. Specifically, the terminal device 12 encapsulates the data of the voice information into individual data packets, and then sequentially transmits the data packets of the voice information to the radio broadcasting device 11 using a communication protocol between the terminal device 12 and the radio broadcasting device 11, since the transmission of the data packet of the voice message has a time gap (that is, the terminal device 12 does not transmit the data packet of the voice message uninterruptedly), the wireless broadcasting device 11 may decapsulate the received data packet of the voice message and compress the information, then encapsulate the compressed information into individual data packets, then, in the time gap of the transmission of the data packet of the voice information, the data packet of the compressed information is sequentially transmitted back to the terminal device 12 by using the communication protocol between the terminal device 12 and the wireless broadcasting device 11 (i.e. the transmission of the data packet of the compressed information is interspersed between the transmission of the data packet of the voice information). That is, the wireless broadcasting device 11 continuously transmits back the packet of the compressed information to the terminal device 12 during the interval of continuously receiving the packet of the voice information.
In one embodiment, the wireless broadcaster 11 may be configured to continuously receive the voice message and compress the voice message with a default compression ratio through a voice compression algorithm. The speech compression algorithm may be any algorithm that can meet the hearing requirement (user satisfaction), such as: g.711a, g.711u, g.729, 324M, etc., the default compression ratio may be, but is not limited to, 16: 1, the actual speech compression algorithm and the default compression ratio can be adjusted according to actual requirements.
In an embodiment, each packet of the compressed information may include a CRC16 check code, and the terminal device 12 is further configured to continuously determine whether the CRC16 check code included in each packet of the compressed information received in real time passes the check, to decompress the packet of the compressed information received in real time that passes the check, and to notify the wireless broadcasting device 11 of retransmission of the packet of the compressed information that fails the check. Therefore, it is possible to prevent the occurrence of a situation in which a subsequent decompression failure occurs due to a transmission error of the compressed information.
In one embodiment, the wireless communication protocol between the wireless broadcasting apparatus 11 and the terminal device 12 may be bluetooth, so that the wireless broadcasting apparatus 11 may also continuously transmit the compressed information back to the terminal device 12 based on Serial Port Profile (SPP) protocol.
In an embodiment, when the terminal device 12 transmits the information to be translated to the cloud server 13 for translation, a language instruction (that is, the language instruction is used to specify the target language) is also transmitted to the cloud server 13, so that the cloud server 13 translates the received information to be translated into the text information in the target language based on the language instruction. Wherein, the target language may be, but not limited to, chinese. In an example, the process of the cloud server 13 translating the received information to be translated into the text information in the target language may include: converting the received information to be translated into character information in the same language as the voice information by a voice to Text (Speech to Text) technology; and translating the text information in the same language as the voice information into the text information in the target language by a text translation technology.
In another embodiment, the target language may be a default language, and therefore, the terminal device 12 only needs to transmit the information to be translated to the cloud server 13 (i.e., does not need to transmit the language instruction to the cloud server 13), and can obtain the text information with the target language returned by the cloud server 13.
In one embodiment, terminal device 12 may display the text message in the form of a floating window on the screen of the video played by the terminal device. In another embodiment, terminal device 12 may directly superimpose the text information onto the picture of the played video in a manner similar to Augmented Reality (Augmented Reality) technology.
Please refer to fig. 2, which is a flowchart illustrating a multimedia processing method according to an embodiment of the present application. As shown in fig. 2, the multimedia processing method 2 can be applied to the multimedia interaction system 1 of fig. 1, and the multimedia processing method 2: the terminal device 12 establishes a connection with the radio broadcasting apparatus 11 and transmits a transcription instruction to the radio broadcasting apparatus 11 (step 21); in the process of playing the video by the terminal device 12, the wireless broadcasting device 11 connected to the terminal device 12 continuously receives and compresses the voice information of the video, so as to continuously return the compressed information to the terminal device 12 (step 22); the terminal device 12 decompresses the compressed information received in real time to obtain the information to be translated (step 23); the terminal device 12 transmits the information to be translated to the cloud server 13 for translation to obtain the text information with the target language (step 24); and terminal device 12 displays the text information on the screen of the video it plays (step 25). That is, the multimedia interactive system 1 can use the wireless broadcast device 11 as a medium for capturing and transmitting the voice information of the video, and further use the cloud server 13 to perform the translation function, so that the terminal device 12 can provide the user with the subtitles in the familiar language corresponding to the video he watches.
In one embodiment, step 21, the terminal device 12 transmitting the transcription instruction to the radio broadcasting apparatus 11 may include: the terminal device 12 downloads and installs an application program for controlling the radio broadcasting device 11 to transmit the transcription instruction to the radio broadcasting device 11 connected thereto through the application program. The detailed description is already described in the above paragraphs, and will not be repeated herein.
In one embodiment, the step 21 of establishing a connection between the terminal device 12 and the wireless broadcasting apparatus 11 may include: the terminal device 12 and the wireless broadcasting apparatus 11 establish a bluetooth audio transmission model (A2DP) agreement connection. The detailed description is already described in the above paragraphs, and will not be repeated herein.
In one embodiment, step 22 may comprise: the wireless broadcasting device 11 continuously transmits back the data packet of the compressed information to the terminal equipment 12 during the interval of continuously receiving the data packet of the voice information. The detailed description is already described in the above paragraphs, and will not be repeated herein.
In one embodiment, step 22 may comprise: the wireless broadcaster 11 continuously transmits the compressed information back to the terminal device 12 based on the serial port Specification (SPP) protocol. The detailed description is already described in the above paragraphs, and will not be repeated herein.
In one embodiment, step 22 may comprise: the wireless broadcasting device 11 continuously receives the voice information and compresses the voice information by a voice compression algorithm according to a default compression ratio. The detailed description is already described in the above paragraphs, and will not be repeated herein.
In an embodiment, each data packet of the compressed information may include a CRC16 check code, and step 23, the terminal device 12 decompresses the compressed information received in real time, which may include: the terminal device 12 continuously determines whether the CRC16 check code included in each packet of the compressed information received in real time passes the check, so as to decompress the packet of the compressed information received in real time that passes the check, and notifies the wireless broadcasting apparatus 11 of retransmitting the packet of the compressed information that fails the check. The detailed description is already described in the above paragraphs, and will not be repeated herein.
In one embodiment, step 24 may comprise: when the terminal device 12 transmits the information to be translated to the cloud server 13 for translation, the language instruction is also transmitted to the cloud server 13, so that the cloud server 13 translates the received information to be translated into the text information with the target language based on the language instruction. The detailed description is already described in the above paragraphs, and will not be repeated herein.
In one embodiment, step 25 may comprise: the terminal device 12 displays the text information on the picture of the video played by the terminal device in the form of a floating window.
In another embodiment, step 25 may comprise: the terminal device 12 directly superimposes the text information on the picture of the played video in a manner similar to the augmented reality technology.
To sum up, in this application embodiment, the wireless broadcast device obtains the video speech information of terminal equipment real-time broadcast to the compressed information that corresponds speech information of passback gives terminal equipment, makes terminal equipment translate through the high in the clouds server after decompressing compressed information, and obtains the text information that has the target language that the video of broadcast corresponds (namely the text information of the language that the user is familiar with), and then shows on the video picture of broadcast text information, in order to improve the user and watch the video experience. In addition, because the voice information of the video played by the terminal device in real time is acquired through the wireless broadcast device, the multimedia processing method and the multimedia interaction system in the embodiment of the application are suitable for being applied to the situation that the terminal device playing the video cannot directly acquire the voice information of the video watched by the user (for example, the terminal device cannot directly acquire the voice information of the video watched by the user based on the authority problem).
Although the above-described elements are included in the drawings of the present application, it is not excluded that more additional elements may be used to achieve better technical results without departing from the spirit of the invention.
While the invention has been described using the above embodiments, it should be noted that these descriptions are not intended to limit the invention. Rather, this invention encompasses modifications and similar arrangements as would be apparent to one skilled in the art. The scope of the claims is, therefore, to be construed in the broadest manner to include all such obvious modifications and similar arrangements.

Claims (14)

1.一种多媒体处理方法,其特征在于,包括:1. a multimedia processing method, is characterized in that, comprises: 终端设备和无线播音装置建立连接,且传送转写指令给所述无线播音装置;The terminal device establishes a connection with the wireless broadcasting device, and transmits a transcription instruction to the wireless broadcasting device; 所述终端设备播放视频的过程中,与所述终端设备连接的所述无线播音装置持续接收并压缩所述视频的语音信息,以持续回传压缩信息给所述终端设备;During the process of playing the video by the terminal device, the wireless broadcasting device connected to the terminal device continuously receives and compresses the voice information of the video, so as to continuously return the compressed information to the terminal device; 所述终端设备将实时接收到的所述压缩信息解压缩,以获取待翻译信息;The terminal device decompresses the compressed information received in real time to obtain the information to be translated; 所述终端设备将所述待翻译信息传送至云端服务器进行翻译,以获取具有目标语种的文字信息;以及The terminal device transmits the information to be translated to the cloud server for translation, so as to obtain text information in the target language; and 所述终端设备将所述文字信息显示在其播放的所述视频的画面上。The terminal device displays the text information on the screen of the video played by the terminal device. 2.根据权利要求1所述的多媒体处理方法,其特征在于,所述与所述终端设备连接的所述无线播音装置持续接收并压缩所述视频的语音信息,以持续回传压缩信息给所述终端设备的步骤,包括:2 . The multimedia processing method according to claim 1 , wherein the wireless broadcasting device connected to the terminal device continuously receives and compresses the voice information of the video, so as to continuously return the compressed information to the receiver. 3 . The steps of the terminal equipment, including: 所述无线播音装置在持续接收所述语音信息的数据包的间隙期间持续回传所述压缩信息的数据包给所述终端设备。The wireless broadcasting apparatus continues to send back the data packets of the compressed information to the terminal device during the interval of continuously receiving the data packets of the voice information. 3.根据权利要求1所述的多媒体处理方法,其特征在于,所述压缩信息的每一个数据包包括CRC16校验码,所述终端设备将实时接收到的所述压缩信息解压缩的步骤,包括:3. The multimedia processing method according to claim 1, wherein each data packet of the compressed information comprises a CRC16 check code, and the terminal device decompresses the compressed information received in real time, include: 所述终端设备持续判断实时接收到的所述压缩信息的每一个数据包所包括的所述CRC16校验码是否通过校验,以将实时接收到的通过校验的所述压缩信息的数据包进行解压缩,以及通知所述无线播音装置重新传输校验失败的所述压缩信息的数据包。The terminal device continuously judges whether the CRC16 check code included in each data packet of the compressed information received in real time passes the verification, so that the data packets of the compressed information received in real time that pass the verification pass the verification. Decompression is performed, and the wireless broadcasting apparatus is notified to retransmit the data packets of the compressed information that have failed verification. 4.根据权利要求1所述的多媒体处理方法,其特征在于,所述终端设备和无线播音装置建立连接,且传送转写指令给所述无线播音装置的步骤,包括:4. The multimedia processing method according to claim 1, wherein the terminal device and the wireless broadcasting device establish a connection, and the step of transmitting a transcription instruction to the wireless broadcasting device comprises: 所述终端设备下载并安装用以控制所述无线播音装置的应用程序,以通过所述应用程序传输所述转写指令给与其连接的所述无线播音装置。The terminal device downloads and installs an application program for controlling the wireless broadcasting device, so as to transmit the transcription instruction to the wireless broadcasting device connected thereto through the application program. 5.根据权利要求1所述的多媒体处理方法,其特征在于,所述终端设备和无线播音装置建立连接的步骤,包括:5. The multimedia processing method according to claim 1, wherein the step of establishing a connection between the terminal device and the wireless broadcasting device comprises: 所述终端设备和所述无线播音装置建立蓝牙音频传输模型协定连线。The terminal device and the wireless broadcasting device establish a connection of the Bluetooth audio transmission model protocol. 6.根据权利要求1所述的多媒体处理方法,其特征在于,所述与所述终端设备连接的所述无线播音装置持续接收并压缩所述视频的语音信息,以持续回传压缩信息给所述终端设备的步骤,包括:6 . The multimedia processing method according to claim 1 , wherein the wireless broadcasting device connected to the terminal device continuously receives and compresses the voice information of the video, so as to continuously return the compressed information to the receiver. 7 . The steps of the terminal equipment, including: 所述无线播音装置基于串行端口规范协议持续回传所述压缩信息给所述终端设备。The wireless broadcasting apparatus continuously returns the compressed information to the terminal device based on the serial port specification protocol. 7.根据权利要求1所述的多媒体处理方法,其特征在于,所述与所述终端设备连接的所述无线播音装置持续接收并压缩所述视频的语音信息的步骤,包括:7. The multimedia processing method according to claim 1, wherein the step of continuously receiving and compressing the voice information of the video by the wireless broadcasting device connected to the terminal device comprises: 所述无线播音装置持续接收所述语音信息,并通过语音压缩算法以默认压缩比例进行所述语音信息的压缩。The wireless broadcasting device continuously receives the voice information, and compresses the voice information at a default compression ratio through a voice compression algorithm. 8.一种多媒体交互系统,其特征在于,包括:8. A multimedia interactive system, comprising: 无线播音装置;wireless broadcasting device; 终端设备,用于和所述无线播音装置建立连接,且传送转写指令给所述无线播音装置;以及a terminal device, configured to establish a connection with the wireless broadcasting device, and transmit a transcription instruction to the wireless broadcasting device; and 云端服务器,通过网络连接所述终端设备;a cloud server, connecting the terminal device through a network; 其中,在所述终端设备播放视频的过程中,与所述终端设备连接且接收所述转写指令的所述无线播音装置持续接收并压缩所述视频的语音信息,以持续回传压缩信息给所述终端设备;所述终端设备将实时接收到的所述压缩信息解压缩,以获取待翻译信息;所述终端设备将所述待翻译信息传送至所述云端服务器进行翻译,以获取具有目标语种的文字信息;以及所述终端设备将所述文字信息显示在其播放的所述视频的画面上。Wherein, during the process of playing the video by the terminal device, the wireless broadcasting device connected to the terminal device and receiving the transcription instruction continuously receives and compresses the voice information of the video, so as to continuously return the compressed information to the The terminal device; the terminal device decompresses the compressed information received in real time to obtain the information to be translated; the terminal device transmits the to-be-translated information to the cloud server for translation to obtain the target language text information; and the terminal device displays the text information on the screen of the video played by the terminal device. 9.根据权利要求8所述的多媒体交互系统,其特征在于,所述无线播音装置在持续接收所述语音信息的数据包的间隙期间持续回传所述压缩信息的数据包给所述终端设备。9 . The multimedia interactive system according to claim 8 , wherein the wireless broadcasting device continues to send back the data packets of the compressed information to the terminal equipment during a gap in which the data packets of the voice information are continuously received. 10 . . 10.根据权利要求8所述的多媒体交互系统,其特征在于,所述压缩信息的每一个数据包包括CRC16校验码,所述终端设备还用于持续判断实时接收到的所述压缩信息的每一个数据包所包括的所述CRC16校验码是否通过校验,以将实时接收到的通过校验的所述压缩信息的数据包进行解压缩,以及通知所述无线播音装置重新传输校验失败的所述压缩信息的数据包。10. The multimedia interactive system according to claim 8, wherein each data packet of the compressed information includes a CRC16 check code, and the terminal device is also used to continuously judge the real-time received compressed information. Whether the CRC16 check code included in each data packet passes the check, so as to decompress the data packet of the compressed information received in real time and pass the check, and notify the wireless broadcasting device to retransmit the check Failed to compress the information packet. 11.根据权利要求8所述的多媒体交互系统,其特征在于,所述终端设备还用于下载并安装用以控制所述无线播音装置的应用程序,以通过所述应用程序传输所述转写指令给与其连接的所述无线播音装置。11. The multimedia interactive system according to claim 8, wherein the terminal device is further used to download and install an application program for controlling the wireless broadcasting device, so as to transmit the transcription through the application program The command is given to the wireless broadcasting device connected thereto. 12.根据权利要求8所述的多媒体交互系统,其特征在于,所述终端设备还用于和所述无线播音装置建立蓝牙音频传输模型协定连线。12 . The multimedia interaction system according to claim 8 , wherein the terminal device is further configured to establish a Bluetooth audio transmission model protocol connection with the wireless broadcasting device. 13 . 13.根据权利要求8所述的多媒体交互系统,其特征在于,所述无线播音装置还用于基于串行端口规范协议持续回传所述压缩信息给所述终端设备。13 . The multimedia interactive system according to claim 8 , wherein the wireless broadcasting device is further configured to continuously return the compressed information to the terminal device based on a serial port specification protocol. 14 . 14.根据权利要求8所述的多媒体交互系统,其特征在于,所述无线播音装置用于持续接收所述语音信息,并通过语音压缩算法以默认压缩比例进行所述语音信息的压缩。14 . The multimedia interactive system according to claim 8 , wherein the wireless broadcasting device is configured to continuously receive the voice information, and compress the voice information at a default compression ratio through a voice compression algorithm. 15 .
CN202111175338.7A 2021-10-09 2021-10-09 Multimedia processing method and multimedia interactive system Active CN113709558B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111175338.7A CN113709558B (en) 2021-10-09 2021-10-09 Multimedia processing method and multimedia interactive system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111175338.7A CN113709558B (en) 2021-10-09 2021-10-09 Multimedia processing method and multimedia interactive system

Publications (2)

Publication Number Publication Date
CN113709558A true CN113709558A (en) 2021-11-26
CN113709558B CN113709558B (en) 2025-02-28

Family

ID=78662625

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111175338.7A Active CN113709558B (en) 2021-10-09 2021-10-09 Multimedia processing method and multimedia interactive system

Country Status (1)

Country Link
CN (1) CN113709558B (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7809549B1 (en) * 2006-06-15 2010-10-05 At&T Intellectual Property Ii, L.P. On-demand language translation for television programs
CN202310099U (en) * 2011-09-05 2012-07-04 青岛海信电器股份有限公司 Wireless sounder and system for playing audio through same
US20180115747A1 (en) * 2016-10-20 2018-04-26 Plantronics, Inc. Video Headset
CN107979686A (en) * 2016-10-25 2018-05-01 北京分音塔科技有限公司 A kind of system for realizing real-time voice intertranslation
CN109348306A (en) * 2018-11-05 2019-02-15 努比亚技术有限公司 Video broadcasting method, terminal and computer readable storage medium
CN110769265A (en) * 2019-10-08 2020-02-07 深圳创维-Rgb电子有限公司 Simultaneous caption translation method, smart television and storage medium
WO2020082710A1 (en) * 2018-10-22 2020-04-30 深圳市冠旭电子股份有限公司 Voice interaction control method, apparatus and system for bluetooth speaker
CN111107284A (en) * 2019-12-31 2020-05-05 洛阳乐往网络科技有限公司 Real-time generation system and generation method for video subtitles
CN111783481A (en) * 2020-06-30 2020-10-16 歌尔科技有限公司 Earphone control method, translation method, earphone and cloud server
CN111862940A (en) * 2020-07-15 2020-10-30 百度在线网络技术(北京)有限公司 Earphone-based translation method, device, system, equipment and storage medium
CN112825561A (en) * 2019-11-21 2021-05-21 上海幻电信息科技有限公司 Subtitle display method, system, computer device and readable storage medium

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7809549B1 (en) * 2006-06-15 2010-10-05 At&T Intellectual Property Ii, L.P. On-demand language translation for television programs
CN202310099U (en) * 2011-09-05 2012-07-04 青岛海信电器股份有限公司 Wireless sounder and system for playing audio through same
US20180115747A1 (en) * 2016-10-20 2018-04-26 Plantronics, Inc. Video Headset
CN107979686A (en) * 2016-10-25 2018-05-01 北京分音塔科技有限公司 A kind of system for realizing real-time voice intertranslation
WO2020082710A1 (en) * 2018-10-22 2020-04-30 深圳市冠旭电子股份有限公司 Voice interaction control method, apparatus and system for bluetooth speaker
CN109348306A (en) * 2018-11-05 2019-02-15 努比亚技术有限公司 Video broadcasting method, terminal and computer readable storage medium
CN110769265A (en) * 2019-10-08 2020-02-07 深圳创维-Rgb电子有限公司 Simultaneous caption translation method, smart television and storage medium
CN112825561A (en) * 2019-11-21 2021-05-21 上海幻电信息科技有限公司 Subtitle display method, system, computer device and readable storage medium
CN111107284A (en) * 2019-12-31 2020-05-05 洛阳乐往网络科技有限公司 Real-time generation system and generation method for video subtitles
CN111783481A (en) * 2020-06-30 2020-10-16 歌尔科技有限公司 Earphone control method, translation method, earphone and cloud server
CN111862940A (en) * 2020-07-15 2020-10-30 百度在线网络技术(北京)有限公司 Earphone-based translation method, device, system, equipment and storage medium

Also Published As

Publication number Publication date
CN113709558B (en) 2025-02-28

Similar Documents

Publication Publication Date Title
CN109327728B (en) One-to-many same-screen method, device and system, same-screen equipment and storage medium
EP3562163B1 (en) Audio-video synthesis method and system
US9634880B2 (en) Method for displaying user interface and display device thereof
CN100546264C (en) By network and display device method for communicating
US20110096844A1 (en) Method for implementing rich video on mobile terminals
CN101778285B (en) A kind of audio-video signal wireless transmitting system and method thereof
CN102695094B (en) Method for carrying out software and hardware integrated audio/video redirection in VDI (Virtual Device Interface) environment
EP1696594A2 (en) System and method for providing a personal broadcasting service using a mobile communication terminal
US20110035462A1 (en) Systems and methods for event programming via a remote media player
US8704868B2 (en) Video conferencing system, video conferencing apparatus, video conferencing control method, and video conferencing control program
US20110285863A1 (en) Live television broadcasting system for the internet
JP2008507898A (en) High-speed channel switching in digital media systems
US20130135179A1 (en) Control method and device thereof
JP7100052B2 (en) Electronic device and its control method
CN104185070B (en) The switching method of TV difference display window
WO2017084309A1 (en) Device for wirelessly transmitting video, video playing device, method, and system
CN102387187A (en) Server, client as well as method and system for remotely playing video file by using client
CN106303559A (en) A kind of method controlling live video stream and direct broadcast server
CN110062268A (en) A kind of audio-video sends and receives processing method and processing device with what screen played
US20160164938A1 (en) Devices and methods for transmitting adaptively adjusted documents
CN105959786A (en) Audio and video playing method and device
EP3070951A1 (en) Video code stream obtaining method and apparatus
US20130291011A1 (en) Transcoding server and method for overlaying image with additional information therein
EP3316546B1 (en) Multimedia information live method and system, collecting device and standardization server
CN113014950A (en) Live broadcast synchronization method and system and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant