TWI419563B - Multimedia transferring system and method thereof - Google Patents

Description

Multimedia transmission system and method thereof

The present invention relates to a multimedia transmission system and method thereof, and more particularly to a multimedia transmission system for a near-end network and a method thereof.

At present, instant messaging (IM) is a very common Internet application, such as Windows Live Messenger and Skype. Internet users who install IM can establish video between each other through IM. At the meeting, each user must individually set the camera, microphone and speaker required for the video conferencing function before establishing the video conference. However, after the video conference is established, it is no longer possible to dynamically select other cameras or voice input and output devices.

The handheld bluetooth voice device can be set up to establish a Bluetooth connection between the personal computer and the handheld Bluetooth voice device, and the special sound card of the handheld Bluetooth voice device can be used to broadcast the personal computer via the speaker. The sound is directed to the handheld Bluetooth voice device, which is then played by the handheld Bluetooth voice device. Therefore, after the voice conference is established, the user can first establish a Bluetooth connection between the personal computer and the handheld Bluetooth voice device, and then ask the application to direct the voice to the handheld Bluetooth voice device, so that the user can keep the voice. In the case of the meeting, hold the handheld Bluetooth device to continue talking to other places. However, the above system can only be used in voice conferences and cannot be used in video conferencing, and the system requires a special handheld Bluetooth voice device and a special sound card.

Therefore, the present invention provides a multimedia transmission system and method thereof, which can enable a user to dynamically transfer a video conference in progress of an electronic device to another electronic device without re-establishing video, and the present invention is not limited to a special one. The electronic device, for example, the original user uses the desk machine to establish a video conference with the remote end, and the system of the present invention can dynamically guide the video conference to a notebook computer or various handheld multimedia devices.

In view of the above problems of the prior art, the object of the present invention is to provide a multimedia transmission system and a method thereof for solving the problem that a user needs to re-establish a video when a video conference in a certain electronic device is dynamically transferred to another electronic device. inconvenient.

According to the purpose of the present invention, a multimedia transmission system includes a first device and a second device. The first device and the second device are connected by a network and a first communication protocol. The first device includes a first display. The module and a storage module, after receiving the at least one first multimedia material of the remote end, encoding and transmitting the first multimedia data, forming and transmitting at least one second multimedia data, and receiving the first multimedia data After the third multimedia data is transmitted by the second device, the third multimedia data is encoded and a fourth multimedia data is formed and sent to the remote end. The first multimedia data includes at least one first image data and at least one first audio data, and the first device captures the first audio data through a dynamic link library stored in the storage device. After the display module displays the first image data, the first image data displayed on the first display module is captured.

According to the purpose of the present invention, a multimedia transmission method is further provided, comprising the steps of: receiving and providing at least one remotely transmitted at least one first multimedia material by a first device, wherein the first device comprises a first The multimedia output module, a storage module and a first display module, and the first multimedia material includes at least one first image data and at least one first audio material. The first multimedia output module captures and encodes the first audio data by using a dynamic link library stored in the first storage module to form a second audio data, and simultaneously the first multimedia output module And capturing and encoding the first image data displayed on the first display module to form a second image data, and then the first device transmits the second multimedia data including the second audio data and the second image data to a second device, wherein the second device is coupled to the first device by a network and a first communication protocol; while the first device performs the above steps, the second device transmits the third multimedia by using the first communication protocol The data is sent to the first device, and after receiving the third multimedia data, the first device sends the second multimedia protocol to the remote end to complete the transmission of the two-way multimedia.

As described above, the multimedia transmission system and method thereof according to the present invention may have one or more of the following advantages:

(1) The multimedia transmission system and method thereof allow a user to dynamically transfer a video conference in progress of an electronic device to another electronic device without re-establishing video.

(2) The multimedia transmission system and method thereof can be applied to video conferences including images and sounds, and are not limited to use in special electronic devices.

Please refer to Figures 1(A) and 1(B), which are block diagrams of the first and second devices of the multimedia transmission system of the present invention. As shown, the system includes a first device 1 and a second device 2. The first device 1 can be a desktop computer and a notebook computer, and the second device 2 can be a notebook computer or a personal digital device. Assistants and mobile phones. The first device 1 includes a first display module 10, a storage module 11, a first multimedia output module 12, a first multimedia input module 13, a first network module 14, and The first control module 15 includes a second display module 20, a second multimedia output module 21, a second multimedia input module 22, and a second network module 23. And the second control module 24; wherein the first device 1 and the second device 2 are connected by a network and transmit data by using a first communication protocol, where the network can be a regional network, a regional wireless network, or Bluetooth network, etc.

The user first establishes a video conference on the first device 1, such as using an IM software such as MSN or Skype. At this time, the control module 15 of the first device 1 provides a first interface 150 for the user to select which second device 2 to use. As a device for transmitting video conferencing. After the first interface 1500 is selected and issued by the first interface 150, the control module 15 is connected to the second device 2 by the first network module 14 to make the second control mode of the second device 2. The group 24 is prepared to simultaneously receive the multimedia data of the video conference and capture and transmit the video and audio data of the second device 2 end. After the first device 1 starts to receive at least one first multimedia material 40 of the at least one remote end 3 of an IM software by using a second transmission protocol, the first multimedia data 40 is encoded and formed and transmitted. a second multimedia material 41 to the second device 2, and the first device 1 also receives a third multimedia data 42 transmitted by the second device 2 (the image of the local user at the second device and The audio data is transmitted to the remote end 3 by decoding the third multimedia data 42 and then transmitted to the remote end 3 by using the second communication protocol, so that the user of the remote end 3 can receive the local user. The image and audio at the second device 2 are for the purpose of transmitting the video conference.

The process of capturing, decoding, and transmitting the image and audio of the present invention will be explained in detail below.

<first device>

The first multimedia data 40 includes at least one first image data 400 and at least one first audio material 401. The second multimedia data 41 includes at least one second image data 410 and at least one second audio material 411. The three multimedia materials 42 include a third image data 420 and a third audio material 421.

The first multimedia output module 12 is configured to capture and encode the first multimedia material 40 to form the second multimedia data 41, and then transmit the second multimedia data 41 to the first network module 14 It is sent to the second device 2 in the first communication protocol. The first multimedia output module 12 includes a first image encoding component 120 and a first audio encoding component 121. The first image encoding component 120 captures the first image data 400 received and displayed by the first display module 10, and encodes the first image data 400 to form a second image data 410, that is, transmitted by the remote end 3 to After the image data of the first device 1 is first displayed on the display, the first multimedia output module 12 captures the image on the display. In addition, the first audio encoding component 121 is configured to capture and encode the first audio material 401 through a dynamic link library 110 (DLL) stored in the storage module 11 to form the second audio data 411. The dynamic link library 110 (DLL) is hooked to obtain the audio data transmitted by the remote end 3 to the first device 1.

The first multimedia input module 13 receives and decodes the third multimedia material 42 to form a fourth multimedia material 43 and transmits the fourth multimedia data 43 to the remote end by using a second communication protocol. 3. Since the third multimedia material 42 (the third image data 420 and the third audio material 421) is the image and audio data of the user at the local device 2, the remote video conference participant You can receive user messages and then video conferencing. The first multimedia input module 13 includes a first image input unit 130 and a first audio input unit 131.

The first image input unit 130 receives the third image data 420 and includes a first image capturing component 1300 and a first image decoding component 1301. The first image capturing component 1300 is configured to capture a fourth image data 430 before the first control module 11 receives the first command 1500. The fourth image data 430 is the image data of the user at the first device 1. That is, when the user establishes a video conference in the first device 1, the image first captured by the IM software is transmitted to the remote end 3, and after the first control module 11 accepts the first command 1500, the capture and transmission are stopped. The first image decoding component 1301 receives and decodes the third image data 420 after the first control module 11 receives the first instruction, and transmits the third image data 420 to the remote end 3. Thus, the image of the user at the second device 2 can be seen by the video conference participants of the far end 3.

In addition, the first audio input unit 131 receives the third audio data 421, and includes a first audio capturing component 1310 and a first audio decoding component 1311. The first audio capture component 1310 is configured to capture a fourth audio material 431 before the first control module 11 receives the first command 1500. The fourth audio data 431 is the audio data of the user at the first device 1. That is, when the user establishes a video conference in the first device 1, the audio first captured by the IM software is transmitted to the remote end 3, and after the first control module 11 accepts the first command 1500, the capture and transmission are stopped. The first audio decoding component 1311 receives and decodes the third audio material 421 after the first control module 11 accepts the first command 1500, and transmits the third audio data 421 to the remote end 3. Thus, the voice of the user at the second device 2 can be heard by the video conference participant of the far end 3.

The first network module 14 receives the second multimedia data 41 and sends the second multimedia data 41 to the second device 2 in the first communication protocol, and at the same time receives the second device 2 in the first communication protocol. After the third multimedia material 42 is sent, it is transmitted to the first multimedia input module 13. In addition, the first control module 15 is connected to the first display module 10, the first multimedia input module 13, the first multimedia output module 12, the storage module 11, and the first network module 14. The first control module 15 provides the first user interface 150, and controls the first multimedia data 40, the second multimedia data 41, the third multimedia data 42 and the fourth after receiving the first instruction 1500. Transmission of multimedia material 43.

<second device>

After receiving the second multimedia material 41, the second multimedia output module 21 decodes the second multimedia data 41 to form a sixth multimedia data 45, and provides a sixth multimedia data 45. The second display module 20 includes a second image decoder 210 and a second audio decoder 211. The second video decoder 210 receives and decodes the second image data 410, and the second audio decoder 211 receives and decodes the second audio data 411. The second display module 20 receives the sixth multimedia material (the second image data 410 and the second audio data 411) and displays the sixth multimedia data 45, so that the user can be in the second device 2 Watch the images and sounds of the participants of the far-end video conference.

The second multimedia input module 22 captures and encodes a fifth multimedia material 44 to form a third multimedia material 42 and transmits the third multimedia data 42 to the second network module 23 The second network module 23 sends the third multimedia data 42 to the first network module 14 of the first device 1 by using the first communication protocol. The fifth multimedia data 44 is the image and sound data of the user at the second device, and includes a fifth image data 440 and a fifth audio material 441. The second multimedia input module 22 includes a second image input unit 220 and a second audio input unit 221; wherein the second image input unit 220 captures and provides a fifth image data 440, which includes a The second image capture device 2200 and a second image encoder 2201. The second image capture device 2200 can be a webcam, and the fifth image data 440 is captured and provided by the second image encoder 2201 to encode the fifth image data 440 to form a third image data 420. The second audio input unit 221 captures the fifth audio data 441, and includes a second audio capture device 2210 and a second audio encoder 2211. The second audio capture device 2210 is a microphone for capturing the fifth audio data 441 for the second audio encoder 2211 to encode the fifth audio data 441 to form the third audio data 421.

The second network module 23 is connected to the first network module 14 by using the network, and receives the second multimedia data 41 by using the first communication protocol, and then transmits the second multimedia data to the second multimedia output module 21, and simultaneously After receiving the third multimedia material 41, the third multimedia data 41 is sent to the first network module 14 in the first communication protocol. The second control module 24 is connected to the second network module 23, the second multimedia output module 21, the second display module 20, and the second multimedia input module 22 to provide a second use. The user interface 240 controls the transmission of the second multimedia material 41, the third multimedia material 43, the fifth multimedia material 42, and the sixth multimedia material 45 after receiving a second command 2400. The second command 2400 is an instruction that the first control module 15 controls the second control module 24 to perform multimedia transmission.

Please refer to FIG. 2, which is a flowchart of the multimedia transmission method of the present invention. As shown in the figure, the multimedia transmission method of the present invention comprises the following steps: (S1) receiving and providing at least one remotely transmitted at least one first multimedia material by a first device, the first device comprising a first multimedia a first output module, a storage module and a first display module, and the at least one first multimedia material includes at least one first image data and at least one first audio material; (S2) the first multimedia output The module captures and encodes at least one first audio material to form a second audio data by using a dynamic link library stored in the first storage module; (S3) capturing and encoding the first multimedia output module The at least one first image data displayed on the first display module forms a second image data; (S4) the first device transmits the second audio data and the second image data in a first communication protocol. Media data to a second device, the second device is connected to the first device by a network; (S5) the second device transmits the third multimedia material to the first device by using the first communication protocol; and (S6) The first device sends the third multimedia resource in a second communication protocol At least a distal end. The detailed description of each device and module is the same as that described above, and will not be described herein.

With the multimedia transmission system and the method of the present invention, the local user can perform the video conference without being fixed in front of the desktop computer or the notebook computer, and can be performed by various local networks such as a wired network and wireless. The network or the Bluetooth network connects the mobile multimedia device to the desktop computer or the notebook computer, and transmits the multimedia data of the video conference in two directions for the mobile video conference, and the multimedia transmission method of the present invention can be applied to multiple applications. Video conferencing, its performance and flexibility are much better than the known methods.

The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.

1. . . First device

10. . . First display module

11. . . Storage module

110. . . Dynamic link library

12. . . First multimedia output module

120. . . First image coding element

121. . . First audio coding element

13. . . First multimedia input module

130. . . First image input unit

1300. . . First image capture component

1301. . . First image decoding component

131. . . First audio input unit

1310. . . First audio capture component

1311. . . First audio decoding component

14. . . First network module

15. . . First control module

150. . . First interface

1500. . . First instruction

2. . . Second device

20. . . Second display module

twenty one. . . Second multimedia output module

210. . . Second image decoder

211. . . Second audio decoder

twenty two. . . Second multimedia input module

220. . . Second image input unit

2200. . . Second image capture device

2201. . . Second image encoder

221. . . Second audio input unit

2210. . . Second audio capture device

2211. . . Second audio encoder

twenty three. . . Second network module

twenty four. . . Second control module

240. . . Second interface

2400. . . Second instruction

3. . . remote

40. . . First multimedia material

400. . . First image data

401. . . First audio material

41. . . Second multimedia material

410. . . Second image data

411. . . Second audio material

42. . . Third multimedia material

420. . . Third image data

421. . . Third audio material

43. . . Fourth multimedia material

430. . . Fourth image data

431. . . Fourth audio material

44. . . Fifth multimedia material

440. . . Fifth image data

441. . . Fifth audio material

45. . . Sixth multimedia material

as well as

S1 ~ S6. . . step

1(A) is a block diagram of a first device of the multimedia transmission system of the present invention;

1(B) is a block diagram of a second device of the multimedia transmission system of the present invention;

Figure 2 is a flow chart of the multimedia transmission method of the present invention.

S1 ~ S6. . . step

Claims (16)

A multimedia transmission system includes: a first device, after receiving at least one first multimedia material of at least one remote end, encoding the at least one first multimedia data to form and provide at least one second multimedia The at least one first multimedia data is transmitted to the at least one remote end, and the at least one first multimedia data includes at least one first image data and at least one first audio material, the at least one The second multimedia data includes at least one second image data and at least one second audio data, comprising: a first display module for displaying the at least one first image data; and a storage module for storing a dynamic link library, wherein the first device captures the at least one first audio data through the dynamic link library, and encodes the at least one first audio data to form the at least one second audio data; After the first display module displays the at least one first image data, the first device captures the at least one first image data displayed on the first display module, and compiles the at least one first image data. Forming the at least one second image data; and a second device, connecting to the first device by using a network and a first communication protocol, receiving the second multimedia material, and transmitting a third multimedia Data to the first device. The multimedia transmission system of claim 1, wherein the first device further comprises: a first multimedia output module, wherein the at least one first multimedia material is captured and encoded to form the at least one a second multimedia material and providing the second multimedia data; a first multimedia input module receiving and decoding the third multimedia material to form a fourth multimedia material, and a second communication protocol sends the fourth multimedia data to the at least one remote end; a first network module receives the at least one second multimedia data, and sends the second communication protocol by using the first communication protocol And transmitting the third multimedia data to the first multimedia input module by using the first communication protocol; and a first control module connecting the first display module The first multimedia input module, the first multimedia output module, the storage module, and the first network module provide a first interface, and after receiving a first command, control the At least one first multimedia material, the at least one second multimedia material, the third multimedia Information and transmission of the fourth multimedia material. The multimedia transmission system of claim 2, wherein the second device comprises: a second multimedia input module that captures and encodes a fifth multimedia material to form the third multimedia medium And the fifth multimedia data is a fifth image data and a fifth audio material; the fifth multimedia data is a video and audio data of the user at the second device; a second network module, connected to the first network module by the network, and receiving and providing the at least one second multimedia material by using the first communication protocol, and receiving the third After the multimedia data, the third multimedia data is sent to the first network module by using the first communication protocol; and the second multimedia output module is configured to receive the at least one second multimedia Decoding to form a sixth multimedia material and providing the sixth multimedia data; a second display module for receiving and displaying the sixth multimedia data; and a second control module Connecting the second network module, the second multimedia output module, and the second display The display module and the second multimedia input module provide a second user interface, and after receiving a second command, control the at least one second multimedia material, the third multimedia data, The fifth multimedia material and the transmission of the sixth multimedia material. The multimedia transmission system of claim 2, wherein the first multimedia input module comprises: a first image input unit that receives a portion of the third multimedia material, the third multimedia The data includes a third image data and a third audio material, which includes: a first image capturing component is configured to capture a fourth image data before the first control module receives the first command, wherein the fourth image data is image data of the user at the first device, and Transmitting to the at least one remote end, and after the first control module receives the first instruction, stopping capturing and transmitting; and a first image decoding component, the first control module accepting the first instruction Receiving and decoding the third image data, and transmitting the data to the at least one remote end; and a first audio input unit, receiving a portion of the third multimedia material, comprising: a first audio capturing component, Before the first control module receives the first command, capturing a fourth audio data, the fourth audio data is the audio data of the user at the first device, and is transmitted to the at least one remote end. And after the first control module receives the first instruction, stopping the capture transmission; and a first audio decoding component, after the first control module receives the first instruction, receiving and decoding the third audio Information and transfer to the Less a distal end. The multimedia transmission system of claim 4, wherein the first multimedia output module comprises: a first image coding component, configured to receive and encode the first image data to form a second image data; And the first audio encoding component receives and encodes the first audio data to form a second audio data; wherein the second multimedia data comprises the second image data and the second audio data. The multimedia transmission system of claim 3, wherein the second multimedia input module comprises: a second image input unit, which captures and provides a portion of the fifth multimedia material, comprising: a second image capture device that captures and provides the fifth image data; and a second image encoder that encodes the fifth image data to form the third image data; and a second audio input unit And capturing a portion of the fifth multimedia material, comprising: a second audio capture device for capturing the fifth audio data; and a second audio encoder for encoding the fifth audio data Forming the third audio material. The multimedia transmission system of claim 6, wherein the second image output module receives the second multimedia data, comprising: a second image decoder, receiving and decoding the second image And a second audio decoder that receives and decodes the second audio material. The multimedia transmission system of claim 3, wherein the network comprises a wired network, a wireless network, and a Bluetooth network. A multimedia transmission method includes the following steps: a first device receives and provides at least one remotely transmitted at least one first multimedia material, and the first device includes a first multimedia output module and a storage module And a first display module, wherein the at least one first multimedia material includes at least one first image data and at least one first audio material; the first multimedia output module is stored in the first storage A dynamic link library captures and encodes the at least one first audio data to form a second audio data; the first multimedia output module captures and encodes the displayed on the first display module The at least one first image data forms a second image data; the first device transmits a second multimedia material to a second device, wherein the second multimedia material includes the second audio material and the second Image data, the second device is coupled to the first device by a network and a first communication protocol; the second device transmits the third multimedia material to the first device by using the first communication protocol; The first device The third protocol to send multimedia data to the at least one distal. The multimedia transmission method of claim 9, wherein the first device further comprises: a first multimedia output module, wherein the at least one first multimedia material is captured and encoded to form the at least one a second multimedia material and providing the second multimedia data; a first multimedia input module receiving and decoding the third multimedia material to form a fourth multimedia material, and a second communication protocol sends the fourth multimedia data to the at least one remote end; a first network module receives the at least one second multimedia data, and sends the second communication protocol by using the first communication protocol The multimedia data is further received by the first communication protocol and transmitted to the first multimedia input module; and a first control module is coupled to the first display module The first multimedia input module, the first multimedia output module, the storage module, and the first network module provide a first user interface, and after receiving a first command Controlling the at least one first multimedia material, the at least one second multimedia material, and the third The transmission of multimedia materials and the fourth multimedia material. The multimedia transmission method of claim 10, wherein the second device comprises: a second multimedia input module that captures and encodes a fifth multimedia material to form the third multimedia medium And the fifth multimedia data is a fifth image data and a fifth audio material; the fifth multimedia data is a video and audio data of the user at the second device; a second network module, connected to the first network module by the network, and receiving and providing the at least one second multimedia material by using the first communication protocol, and receiving the third After the multimedia data, the third multimedia data is sent to the first network module by using the first communication protocol; and the second multimedia output module is configured to receive the at least one second multimedia Decoding to form a sixth multimedia material and providing the sixth multimedia data; a second display module for receiving and displaying the sixth multimedia data; and a second control module Connecting the second network module, the second multimedia output module, and the second The display module and the second multimedia input module provide a second user interface, and after receiving a second command, control the at least one second multimedia material, the third multimedia data, The fifth multimedia material and the transmission of the sixth multimedia material. The multimedia transmission method of claim 10, wherein the first multimedia input module comprises: a first image input unit that receives a portion of the third multimedia material, the third multimedia The data includes a third image data and a third audio data, comprising: a first image capturing component, before the first control module receives the first command, capturing a fourth image data, the first The image data is the image data of the user at the first device, and is transmitted to the at least one remote end, and after the first control module accepts the first instruction, stops capturing and transmitting; and a first The image decoding component receives and decodes the third image data after the first control module receives the first instruction, and transmits the third image data to the at least one remote end; and a first audio input unit receives the portion The third multimedia data includes: a first audio capturing component, wherein the first audio component captures a fourth audio data before the first control module receives the first command, and the fourth audio data is used by the user First device Transmitting the data to the at least one remote end, and after the first control module receives the first instruction, stopping the capture transmission; and a first audio decoding component, the first control module accepting the data After the first instruction, the third audio data is received and decoded and transmitted to the at least one remote end. The multimedia transmission method of claim 10, wherein the first multimedia output module comprises: a first image coding component, which receives and encodes the first image data to form a second image data; And the first audio encoding component receives and encodes the first audio data to form a second audio data; wherein the second multimedia data comprises the second image data and the second audio data. The multimedia transmission method of claim 11, wherein the second multimedia input module comprises: a second image input unit, which captures and provides a portion of the fifth multimedia material, comprising: a second image capture device that captures and provides the fifth image data; and a second image encoder that encodes the fifth image data to form the third image data; and a second audio input unit And capturing a portion of the fifth multimedia material, comprising: a second audio capture device for capturing the fifth audio data; and a second audio encoder for encoding the fifth audio data Forming the third audio material. The multimedia transmission method of claim 11, wherein the second image output module receives the second multimedia data, comprising: a second image decoder, receiving and decoding the second image And a second audio decoder that receives and decodes the second audio material. The multimedia transmission method of claim 9, wherein the network comprises a wired network, a wireless network, and a Bluetooth network.