CN112433689B - Data transmission method and device for same screen device, same screen device and medium - Google Patents
Data transmission method and device for same screen device, same screen device and medium Download PDFInfo
- Publication number
- CN112433689B CN112433689B CN202011257303.3A CN202011257303A CN112433689B CN 112433689 B CN112433689 B CN 112433689B CN 202011257303 A CN202011257303 A CN 202011257303A CN 112433689 B CN112433689 B CN 112433689B
- Authority
- CN
- China
- Prior art keywords
- screen
- usb
- audio
- terminal
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/382—Information transfer, e.g. on bus using universal interface adapter
- G06F13/385—Information transfer, e.g. on bus using universal interface adapter for adaptation of a particular data processing system to different peripheral devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/40—Bus structure
- G06F13/4063—Device-to-bus coupling
- G06F13/4068—Electrical coupling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
- G06F13/4282—Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F2213/0042—Universal serial bus [USB]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention is suitable for the technical field of on-screen devices, and provides a data transmission method, a device, an on-screen device and a medium for the on-screen device, wherein the method can be called MIFA (Mirror AND MEDIA INTERFACE for Android), and specifically comprises the following steps: detecting whether a terminal access event is triggered; if the terminal access event is triggered, switching the USB mode of the same screen device to a slave mode; generating a plurality of preset USB equipment transmission interfaces; and in the slave mode, audio and video data of the access terminal are respectively transmitted to the display device through a plurality of USB device transmission interfaces, so that the display device synchronously outputs audio and video pictures of the access terminal based on the audio and video data. The invention realizes that the audio data of the access terminal is synchronously transmitted to the display equipment through the same-screen device, so that the audio data can be reserved at one side of the large-screen display terminal with better tone quality and sound effect while the screen content of the small-screen terminal is transmitted to the large-screen display, the screen throwing experience of a user is improved, and the practicability of the USB same-screen device is greatly enhanced.
Description
Technical Field
The invention belongs to the technical field of co-screen devices, and particularly relates to a data transmission method and device for a co-screen device, the co-screen device and a computer readable storage medium.
Background
In the current society, the work and life of many people are not separated from the smart phone. Such as online payment, map navigation, social communications, file transfer, etc., all need to be accomplished using a cell phone. In order to facilitate viewing and handling, the current mobile phone screen is larger and larger, and even is a full screen mobile phone. However, for some specific scenes, such as video viewing, game entertainment, file browsing, etc., it is still difficult for a full-screen mobile phone to meet the user requirements, which reduces the user operation experience and also easily affects the eyesight. In order to solve the problem, in the prior art, by using a USB co-screen device, contents (conference contents, multimedia files, game pictures, movies, video pictures) on a mobile phone or a tablet, etc. can be synchronously presented to any other products on any display screen device through a USB interface. The transmission stability and the interface universality of the USB on-screen device provide more convenience and enjoyment for the life, work and entertainment of common people of the common people.
However, although the USB on-screen device has been improved and developed for many times, the difficulty that the mobile phone sound cannot be synchronously transmitted to the display device through the USB has not been overcome. When the screen content of the mobile phone is transmitted to a large screen for display, the sound can only be reserved at one end of the mobile phone with poor tone quality, sound effect and sound volume, so that the practicability of the USB same-screen device is greatly reduced.
Disclosure of Invention
In view of the above, the embodiments of the present invention provide a data transmission method, a configuration terminal, an intelligent terminal and a computer readable storage medium for a co-screen device, so as to solve the problem that the co-screen device in the prior art cannot synchronously transmit audio to a display device through USB.
A first aspect of an embodiment of the present invention provides a data transmission method for an on-screen device, where the on-screen device is connected to a display device, the data transmission method including:
Detecting whether a terminal access event is triggered;
if the terminal access event is triggered, switching the USB mode of the same screen device to a slave mode;
Generating a plurality of preset USB equipment transmission interfaces;
And in the slave mode, audio and video data of the access terminal are respectively transmitted to the display equipment through the plurality of USB equipment transmission interfaces, so that the display equipment synchronously outputs the audio and video pictures of the access terminal based on the audio and video data.
A second aspect of an embodiment of the present invention provides a data transmission apparatus for a co-screen device, where the co-screen device is connected to a display device, the data transmission apparatus including:
the detection unit is used for detecting whether a terminal access event is triggered or not;
The switching unit is used for switching the USB mode of the same screen device to a slave mode if the terminal access event is triggered;
the generating unit is used for generating a plurality of preset USB equipment transmission interfaces;
And the transmission unit is used for respectively transmitting the audio and video data of the access terminal to the display equipment through the plurality of USB equipment transmission interfaces in the slave mode so that the display equipment synchronously outputs the audio and video pictures of the access terminal based on the audio and video data.
A third aspect of the embodiments of the present invention provides an on-screen device, including a memory and a processor, where the memory stores a computer program executable on the processor, and the processor implements the steps of the data transmission method applied to the on-screen device when the processor executes the computer program.
A fourth aspect of the embodiments of the present invention provides a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of a data transmission method as described above for a co-screen device.
In the embodiment of the invention, when the terminal access event is triggered, the USB mode of the same-screen device is switched to the slave mode, and a plurality of preset USB device transmission interfaces are generated, so that the USB connection mode of the same-screen device as a host and the USB connection mode of the access terminal as a slave under the normal condition are changed, the synchronous transmission of the audio data of the access terminal to the display device through the same-screen device is realized, the audio data can be reserved on the side of the large-screen display terminal with better tone quality and sound effect while the screen content of the small-screen terminal is transmitted to the large-screen display device for displaying, the screen throwing experience of a user is improved, and the practicability of the USB same-screen device is greatly enhanced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a data transmission system including an on-screen display according to an embodiment of the present invention;
fig. 2 is an application scenario diagram of a data transmission method for an on-screen device according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of an implementation of a data transmission method for an on-screen device according to a first embodiment of the present invention;
Fig. 4 is a schematic flowchart of a specific implementation of a data transmission method S104 for an on-screen device according to a second embodiment of the present application;
FIG. 5 is a block diagram of a data transmission device for an on-screen display according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a co-screen device according to an embodiment of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In order to illustrate the technical scheme of the application, the following description is made by specific examples.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
As used in this specification and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".
In addition, in the description of the present application, the terms "first," "second," "third," etc. are used merely to distinguish between descriptions and should not be construed as indicating or implying relative importance.
As shown in fig. 1, an application scenario diagram of a data transmission method for an on-screen device according to an embodiment of the present invention is shown, where the data transmission method according to an embodiment of the present invention is applied to a data transmission system including an on-screen device, and the data transmission system includes an on-screen device 1, an access terminal 2, and a display device 3. The On-screen device 1 and The access terminal 2 are in communication connection through an OTG (On-The-Go) data line, and The On-screen device 1 and The display device 3 are connected through a high definition multimedia interface (High Definition Multimedia Interface, HDMI) line. The same screen device is also provided with a power interface which is used for being connected with an external power supply to maintain the use of the functions of each internal chip module, and the power interface can be a USB interface for example.
Preferably, a quick-charging chip is also arranged in the same screen device. When the access terminal 1 executes the same-screen operation, the quick charging chip is used for quick charging of the access terminal, the electric quantity of the access terminal is kept sufficient, the same-screen interruption is avoided, and the practicability is greatly improved.
In the embodiment of the invention, the access terminal can be a mobile phone, a tablet, a Personal Digital Assistant (PDA) or other intelligent terminal equipment with a visual man-machine interaction interface and an OTG function. The display device can be a display terminal capable of outputting images, such as a television screen or a computer display, and can be matched with the audio output device and/or the computer input device through a connected host or a mainboard. Preferably, the display device and the on-screen device can be integrally produced, i.e. the on-screen device can be provided with a large-screen display for realizing man-machine interaction.
The access terminal is usually a portable terminal device, and the screen size of the man-machine interaction interface is far smaller than that of the display device in the embodiment of the invention. Illustratively, the screen size of the access terminal does not exceed 10 inches.
In the embodiment of the invention, the same screen device pushes the data such as pictures, videos, music and the like on the access terminal to the display equipment for playing, thereby realizing the transmission of digital multimedia (high-definition video, audio and pictures) content, synchronizing the display content of the multi-terminal screen and enlarging the small screen. Compatible stride operations are implemented between different operating systems (IOS, ANDROID, WIN, WINDOWS XP, VISTA, etc.) and different devices.
For example, in one application scenario, as shown in fig. 2, the access terminal 2 is a mobile phone, and the display device 3 is a television screen. When the on-screen device 3 detects that the mobile phone 2 is accessed through the OTG data line, the USB mode of the on-screen device is switched to be a slave mode. Then, in the slave mode of the same-screen device, the picture data displayed on the display screen of the mobile phone 2 and the audio data played by the mobile phone 2 are respectively transmitted to the television screen 3 by generating a plurality of designated USB device transmission interfaces, so that the television screen 3 synchronously displays the picture displayed on the mobile phone 2 based on the received data, and the audio is output through an audio module (such as a loudspeaker) associated with the television screen.
In order to illustrate the technical scheme of the invention, the following description is made by specific examples.
Fig. 3 shows an implementation flow of the data transmission method for the on-screen device according to the first embodiment of the present invention, where the method flow includes steps S101 to S104. The specific implementation principle of each step is as follows:
s101: it is detected whether a terminal access event is triggered.
The data line connection interface provided on the same screen device comprises a TYPE-C interface. The CC-line transmission signal is encoded with a two-phase symbol code (Biphase Mark Coding, BMC), the phase change representing 0 once and the phase change representing 1 twice. Therefore, in the embodiment of the invention, the level change of CC (Configuration Channel) lines of the TYPE-C pins is detected. And judging whether a terminal is accessed according to the level change of the CC line of the TYPE-C pin. If the terminal access is judged to be in the current moment, determining that a terminal access event is triggered.
In another possible implementation, the trigger terminal access event is implemented in a hardware jumper by pulling down a resistor on the CC pin, including that of the microssb is a hardware trigger with the ID pin directly grounded.
S102: and if the terminal access event is triggered, switching the USB mode of the same-screen device to a slave mode.
When the access of the terminal is detected, the USB mode of the same screen at the current moment is switched to the slave mode, so that the USB mode of the access terminal is set to be the master mode. Specifically, the USB OTG data line interface has 5 lines, 2 of which are used for transmitting data (d+, D-), 1 is a power line (VBUS), 1 is a ground line (GND), and 1 is an ID line. The ID line can be used to identify different cable end points, the ID pin in the mini-A plug is grounded, and the ID pin in the mini-B plug is floating. When the grounded ID pin is detected, the USB mode of the device corresponding to the ID pin is indicated to be a master mode at the current moment, and the USB mode of the device with the floating ID pin is detected to be a slave mode. Therefore, in the embodiment of the invention, when the access of the terminal is detected, the USB mode of the access terminal is switched to the host mode, and the USB mode of the same screen is switched to the slave mode.
In one possible implementation, when the access terminal accesses a data line provided by the same screen device, the access terminal is triggered to switch to a USB host mode through an interface wiring; or switching the USB mode of the access terminal to the host mode through the Type-C protocol. The on-screen device will always be in USB slave mode during the whole on-screen operation. When the switching of the USB mode is completed, the access terminal automatically calls the pre-installed on-screen application to the foreground to run so as to receive an operation instruction sent by a terminal user in the on-screen application and determine the data content of the required screen.
In another possible implementation manner, the step S102 specifically further includes:
S1021: and if the terminal access event is triggered, acquiring the USB identification code of the access terminal.
S1022: determining the terminal type of the access terminal according to the USB identification code; the terminal type comprises an android terminal and an apple operating system iOS terminal.
S1023: and if the terminal type of the access terminal is an android terminal, switching the USB mode of the same screen device to a slave mode.
In the embodiment of the invention, the USB identification code includes a Vendor ID (VID) and a Product ID (PID). The VID is applied by the terminal provider to the application forum (IMPLEMENTERS FORUM, USB-IF). The VID of each provider is unique and the PID is predetermined by the provider. Therefore, by detecting that the terminal access event is triggered and reading the PID and/or VID information of the access terminal, the terminal type of the access terminal can be determined according to the preset USB identification code and the corresponding relation table of the terminal type.
In the embodiment of the invention, the USB mode of the same screen device is switched to the slave mode only when the terminal type of the access terminal is android terminal, and the data transmission method of the steps S103-S104 is executed.
If the terminal type of the access terminal is detected to be an apple operating system (iPhone Operation System, iOS) terminal, the application of the apple on-screen protocol is switched to control the access terminal to execute transmission of screen-throwing data under the apple on-screen protocol.
S103: generating a plurality of preset USB device transmission interfaces.
After switching the USB mode of the same screen device, determining the USB equipment to be enumerated according to the terminal type of the current access terminal. The enumeration process is prior art in the art and is not described in detail herein. Through the enumeration process of the USB equipment, various descriptor information and communication modes of the USB equipment and the access terminal are determined, so that the access terminal can load a proper driver according to the enumeration result.
In the embodiment of the invention, the USB devices enumerated by the same screen device comprise standard USB Audio (Audio) devices, USB-Human interaction devices (Human INTERFACE DEVICE, HID) and Bulk data communication devices. By enumerating the above USB devices, 3 communication interfaces are described to the access terminal using the same USB interface: standard USB Audio interface, USB-HID interface, bulk data communication interface.
In one possible implementation, the type of USB device transmission interface currently required to be generated is determined according to the data content required to be transmitted by the access terminal. The step S103 specifically includes: judging whether an audio synchronization instruction sent by an access terminal is received or not; if an Audio synchronization instruction sent by an access terminal is received, a standard USB Audio interface and a Bulk data communication interface are generated; and if the audio synchronization instruction sent by the access terminal is not received, generating a Bulk data communication interface.
In the embodiment of the invention, after the terminal user selects the data content of the screen to be projected in the same-screen application, whether the local audio needs to be synchronized in the screen projection process can be determined based on the selection of the audio switch control. According to whether an audio synchronization instruction sent by the access terminal is received or not, the number of USB device transmission interfaces to be generated is determined, time consumption for enumerating all USB devices and generating all USB device transmission interfaces can be reduced, and screen projection response efficiency to appointed screen projection content is improved.
In another possible implementation, the end user may also determine whether to allow reverse control of the external input device based on selection of the reverse control switch control in the on-screen application, i.e., whether to allow the user to control the application interface of the access terminal to perform a synchronized operation while manipulating the interface on the on-screen display device. If a reverse control permission instruction sent by the access terminal is received, a USB-HID interface is generated in addition to the USB equipment transmission interface.
S104: and in the slave mode, audio and video data of the access terminal are respectively transmitted to the display equipment through the plurality of USB equipment transmission interfaces, so that the display equipment synchronously outputs the audio and video pictures of the access terminal based on the audio and video data.
In the embodiment of the invention, each USB communication interface corresponds to different application functions. In the slave mode, the standard USB Audio interface comprises an uplink channel and a downlink channel, and is used for realizing the Audio input/output function. And transmitting the audio data of the access terminal to the display device so that the display device can output audio based on the audio data.
And the Bulk data communication interface is used for receiving the compressed screen data sent by the access terminal. The same-screen device decodes the screen data and transmits the decoded screen data to the display device so that the display device displays a video picture corresponding to the screen data. Specifically, the same screen application APK of the access terminal obtains screen data to be screen-projected through a standard screen capturing function, and transmits the screen data to the same screen device through a Bulk data communication interface after H264 compression is executed. The same screen device decodes and displays the compressed screen data through a preset hardware decoder, and after the decoded screen data is transmitted to the display equipment, the picture display effect from a small screen to a large screen is realized.
And the USB-HID interface is used for returning the control data received by the display device to the access terminal so as to enable the access terminal to execute synchronous operation corresponding to the control data. For example, if the display device receives an operation instruction for displaying content on the screen through an external input device (such as a USB keyboard, a mouse, a touch screen, etc.), control data corresponding to the operation instruction is returned to the on-screen device. And transmitting control data comprising control objects and control modes to the access terminal through the USB-HID interface. At this time, the access terminal will execute the response operation corresponding to the control data, so that the content controlled on the display device is also controlled at the same time at the access terminal, thereby achieving the effect of reverse control, solving the problem that the same screen device in the prior art must be actively controlled by the access terminal, but the released display device cannot be controlled, thereby avoiding the need of operating at the bright screen state at any time at the access terminal, and reducing the electric quantity consumption of the access terminal.
In the embodiment of the invention, when the terminal access event is triggered, the USB mode of the same-screen device is switched to the slave mode, and a plurality of preset USB device transmission interfaces are generated, so that the USB connection mode of the same-screen device as a host and the USB connection mode of the access terminal as a slave under the normal condition are changed, the synchronous transmission of the audio data of the access terminal to the display device through the same-screen device is realized, the audio data can be reserved on the side of the large-screen display terminal with better tone quality and sound effect while the screen content of the small-screen terminal is transmitted to the large-screen display device for displaying, the screen throwing experience of a user is improved, and the practicability of the USB same-screen device is greatly enhanced.
As shown in fig. 4, based on the first embodiment, in the data transmission method for a co-screen device according to the second embodiment of the present application, step S104 further includes:
s1041: and in the slave mode, receiving the audio and video data input by the access terminal through the plurality of USB equipment transmission interfaces.
S1042: and detecting the application identifier corresponding to the audio and video data.
S1043: if the application identifier is matched with any application identifier in a pre-stored application identifier list, transmitting the audio and video data to the display equipment; and if the application identifier is not matched with each application identifier in the pre-stored application identifier list, discarding the audio and video data.
In the embodiment of the invention, the on-screen device is connected with the remote control terminal in a wireless way through the built-in wireless module, so that a management user can execute the on-screen authority management operation in a management interface of the remote control terminal.
In an application scenario, a management user of a display device may only want to allow a file browsing application or a video application to perform screen-casting operation, so that when a terminal user performs screen-casting in work, a game interface or a chat interface of personal communication application software is prevented from being screen-cast due to misoperation, and therefore, each application allowing screen-casting is preset in the management interface of a remote control terminal, and a same screen device stores corresponding application identifiers in an application identifier list. After the USB mode of the same screen device is switched to the slave mode, if the audio and video data input by the access terminal are received through the USB device transmission interfaces, the application identifier corresponding to the source application of the audio and video data is analyzed, and whether the application identifier is stored in the application identifier list is judged. If not, the current audio and video data is illegal screen throwing data, the audio and video data is discarded, and permission prohibition prompt information is returned to the access terminal. The data transmission method provided by the embodiment of the invention reduces the possibility of misoperation of the user and improves the data transmission safety.
It should be noted that, the implementation principle of the steps not mentioned in the embodiment of the present invention is the same as that of the steps in the above embodiment, and is not described in detail herein.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present invention.
Corresponding to the data transmission method for the on-screen device described in the above embodiments, fig. 5 shows a block diagram of a data transmission device for the on-screen device according to an embodiment of the present invention, and for convenience of explanation, only the portions related to the embodiments of the present invention are shown.
As shown in fig. 5, the data transmission device 5 for the on-screen device includes:
a detecting unit 51, configured to detect whether a terminal access event is triggered;
a switching unit 52, configured to switch the USB mode of the on-screen device to a slave mode if the terminal access event is triggered;
A generating unit 53, configured to generate a plurality of preset USB device transmission interfaces;
And the transmission unit 54 is configured to transmit, in the slave mode, audio and video data of the access terminal to the display device through the plurality of USB device transmission interfaces, so that the display device synchronously outputs audio and video pictures of the access terminal based on the audio and video data.
In one possible implementation manner, the USB device transmission interface includes a standard USB audio interface and a Bulk data communication interface, and the transmission unit 54 is specifically configured to:
Transmitting audio data of the access terminal to the display device through the standard USB audio interface in the slave mode so that the display device performs audio output based on the audio data;
And receiving the compressed screen data of the access terminal through the Bulk data communication interface, decoding the screen data, and transmitting the decoded screen data to the display equipment so that the display equipment displays a video picture corresponding to the screen data.
In one possible implementation, the switching unit 52 is specifically configured to:
If the terminal access event is triggered, acquiring a USB identification code of the access terminal;
Determining the terminal type of the access terminal according to the USB identification code; the terminal type comprises an android terminal and an apple operating system iOS terminal;
If the terminal type of the access terminal is an android terminal, switching the USB mode of the same screen device to a slave mode; when the on-screen device is in the slave mode, the USB mode of the access terminal is the master mode.
In a possible implementation, the generating unit 53 is specifically further configured to:
generating a USB-human interface;
and in the slave mode, the control data received by the display device is returned to the access terminal through the USB-HID interface so that the access terminal executes synchronous operation corresponding to the control data.
In one possible implementation manner, the data transmission device further includes a fast charging chip, and is specifically configured to perform fast charging for the access terminal through the fast charging chip.
In a possible implementation, the generating unit 53 is specifically further configured to:
judging whether an audio synchronization instruction sent by the access terminal is received or not;
If an audio synchronization instruction sent by the access terminal is received, a standard USB audio interface and a Bulk data communication interface are generated;
And if the audio synchronization instruction sent by the access terminal is not received, generating a Bulk data communication interface.
In a possible implementation, the transmission unit 54 is specifically further configured to:
in the slave mode, receiving audio and video data input by the access terminal through the plurality of USB equipment transmission interfaces;
Detecting an application identifier corresponding to the audio and video data;
If the application identifier is matched with any application identifier in a pre-stored application identifier list, transmitting the audio and video data to the display equipment; and if the application identifier is not matched with each application identifier in the pre-stored application identifier list, discarding the audio and video data.
In the embodiment of the invention, when the terminal access event is triggered, the USB mode of the same-screen device is switched to the slave mode, and a plurality of preset USB device transmission interfaces are generated, so that the USB connection mode of the same-screen device as a host and the USB connection mode of the access terminal as a slave under the normal condition are changed, the synchronous transmission of the audio data of the access terminal to the display device through the same-screen device is realized, the audio data can be reserved on the side of the large-screen display terminal with better tone quality and sound effect while the screen content of the small-screen terminal is transmitted to the large-screen display device for displaying, the screen throwing experience of a user is improved, and the practicability of the USB same-screen device is greatly enhanced.
Fig. 6 is a schematic diagram of an on-screen display according to an embodiment of the present invention. As shown in fig. 6, the on-screen device 6 of this embodiment includes: a processor 60, a memory 61 and a computer program 62 stored in said memory 61 and executable on said processor 60, for example a data transmission program for an on-screen display. The processor 60, when executing the computer program 62, implements the steps described above in various embodiments of the data transmission method for an on-screen display, such as steps 101 through 104 shown in fig. 1. Or the processor 60, when executing the computer program 62, performs the functions of the modules/units of the device embodiments described above, such as the functions of the units 51 to 54 shown in fig. 5.
Illustratively, the computer program 62 may be partitioned into one or more modules/units that are stored in the memory 61 and executed by the processor 60 to complete the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing a specific function describing the execution of the computer program 62 in the on-screen monitor 6.
The screen sharing device 6 may be a micro-chip microcomputer system, a microcomputer, a desktop computer, a notebook computer, a palm computer, a cloud server, and other computing devices. The terminal device may include, but is not limited to, a processor 60, a memory 61. It will be appreciated by those skilled in the art that fig. 6 is merely an example of the on-screen device 6 and is not meant to be limiting as to the on-screen device 6, and may include more or fewer components than shown, or may combine certain components, or different components, e.g., the terminal device may also include an input-output device, a network access device, a bus, etc.
The Processor 60 may be a central processing unit (Central Processing Unit, CPU), other general purpose Processor, digital signal Processor (DIGITAL SIGNAL Processor, DSP), application SPECIFIC INTEGRATED Circuit (ASIC), off-the-shelf Programmable gate array (Field-Programmable GATE ARRAY, FPGA) or other Programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 61 may be an internal storage unit of the configuration terminal/first intelligent terminal, for example, a hard disk or a memory of the configuration terminal/first intelligent terminal. The memory 61 may also be an external storage device of the configuration terminal/the first intelligent terminal, such as a plug-in hard disk, a smart memory card (SMART MEDIA CARD, SMC), a Secure Digital (SD) card, a flash memory card (FLASH CARD) or the like, which are provided on the configuration terminal/the first intelligent terminal. Further, the memory 61 may also include both an internal storage unit and an external storage device of the configuration terminal/first intelligent terminal. The memory 61 is used for storing the computer program and other programs and data required by the configuration terminal/first intelligent terminal. The memory 61 may also be used for temporarily storing data that has been output or is to be output.
It should be noted that, because the content of information interaction and execution process between the above devices/units is based on the same concept as the method embodiment of the present application, specific functions and technical effects thereof may be referred to in the method embodiment section, and will not be described herein.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical function division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth.
Claims (10)
1. A data transmission method for an on-screen device, wherein the on-screen device is connected to a display device through an OTG data line, the data transmission method comprising:
Detecting whether a terminal access event is triggered;
If the terminal access event is triggered, switching the USB mode of the same screen device to a slave mode; the OTG data line interface comprises an ID line, wherein the ID line is used for identifying different cable endpoints, when an grounded ID pin is detected, a USB mode of equipment corresponding to the ID pin at the current moment is set as a host mode, and a USB mode of equipment with the detected ID pin floating is set as a slave mode;
Generating a plurality of preset USB equipment transmission interfaces;
In the slave mode, audio and video data of an access terminal are respectively transmitted to the display equipment through the plurality of USB equipment transmission interfaces, so that the display equipment synchronously outputs audio and video pictures of the access terminal based on the audio and video data; when the USB mode switching is completed, the access terminal calls a pre-installed on-screen application to a foreground to run so as to receive an operation instruction sent by a terminal user in the on-screen application and determine the data content of a required screen.
2. The method for data transmission of a co-screen device according to claim 1, wherein the USB device transmission interface includes a standard USB audio interface and a Bulk data communication interface, and in the slave mode, audio and video data of an access terminal are respectively transmitted to the display device through the plurality of USB device transmission interfaces, so that the display device synchronously outputs audio and video pictures of the access terminal based on the audio and video data, including:
Transmitting audio data of the access terminal to the display device through the standard USB audio interface in the slave mode so that the display device performs audio output based on the audio data;
And receiving the compressed screen data of the access terminal through the Bulk data communication interface, decoding the screen data, and transmitting the decoded screen data to the display equipment so that the display equipment displays a video picture corresponding to the screen data.
3. The method for data transmission of an on-screen device according to claim 1, wherein switching the USB mode of the on-screen device to the slave mode if the terminal access event is triggered, comprises:
If the terminal access event is triggered, acquiring a USB identification code of the access terminal;
Determining the terminal type of the access terminal according to the USB identification code; the terminal type comprises an android terminal and an apple operating system iOS terminal;
If the terminal type of the access terminal is an android terminal, switching the USB mode of the same screen device to a slave mode; when the on-screen device is in the slave mode, the USB mode of the access terminal is the master mode.
4. The method for data transmission on a same screen as in claim 1, wherein generating a plurality of preset USB device transmission interfaces further comprises:
generating a USB-human interface;
and in the slave mode, the control data received by the display device is returned to the access terminal through the USB-HID interface so that the access terminal executes synchronous operation corresponding to the control data.
5. The data transmission method for an on-screen device according to any one of claims 1 to 4, wherein a fast charge chip is disposed in the on-screen device, the data transmission method further comprising:
And carrying out quick charge on the access terminal through the quick charge chip.
6. The method for data transmission of on-screen device according to claim 1, wherein generating a plurality of preset USB device transmission interfaces comprises:
judging whether an audio synchronization instruction sent by the access terminal is received or not;
If an audio synchronization instruction sent by the access terminal is received, a standard USB audio interface and a Bulk data communication interface are generated;
And if the audio synchronization instruction sent by the access terminal is not received, generating a Bulk data communication interface.
7. The data transmission method for a co-screen device according to claim 1, wherein in the slave mode, audio and video data of an access terminal are respectively transmitted to the display device through the plurality of USB device transmission interfaces, comprising:
in the slave mode, receiving audio and video data input by the access terminal through the plurality of USB equipment transmission interfaces;
Detecting an application identifier corresponding to the audio and video data;
If the application identifier is matched with any application identifier in a pre-stored application identifier list, transmitting the audio and video data to the display equipment; and if the application identifier is not matched with each application identifier in the pre-stored application identifier list, discarding the audio and video data.
8. A data transmission device for an on-screen device, wherein the on-screen device is connected to a display apparatus through an OTG data line, the data transmission device comprising:
the detection unit is used for detecting whether a terminal access event is triggered or not;
The switching unit is used for switching the USB mode of the same screen device to a slave mode if the terminal access event is triggered; the OTG data line interface comprises an ID line, wherein the ID line is used for identifying different cable endpoints, when an grounded ID pin is detected, a USB mode of equipment corresponding to the ID pin at the current moment is set as a host mode, and a USB mode of equipment with the detected ID pin floating is set as a slave mode;
the generating unit is used for generating a plurality of preset USB equipment transmission interfaces;
The transmission unit is used for respectively transmitting the audio and video data of the access terminal to the display equipment through the plurality of USB equipment transmission interfaces in the slave mode so that the display equipment synchronously outputs the audio and video pictures of the access terminal based on the audio and video data; when the USB mode switching is completed, the access terminal calls a pre-installed on-screen application to a foreground to run so as to receive an operation instruction sent by a terminal user in the on-screen application and determine the data content of a required screen.
9. An on-screen device comprising a memory and a processor, the memory storing a computer program executable on the processor, wherein the processor implements the steps of the method of any one of claims 1 to 7 when the computer program is executed.
10. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011257303.3A CN112433689B (en) | 2020-11-11 | 2020-11-11 | Data transmission method and device for same screen device, same screen device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011257303.3A CN112433689B (en) | 2020-11-11 | 2020-11-11 | Data transmission method and device for same screen device, same screen device and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112433689A CN112433689A (en) | 2021-03-02 |
| CN112433689B true CN112433689B (en) | 2024-05-28 |
Family
ID=74699822
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011257303.3A Active CN112433689B (en) | 2020-11-11 | 2020-11-11 | Data transmission method and device for same screen device, same screen device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112433689B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113099309A (en) * | 2021-03-30 | 2021-07-09 | 上海哔哩哔哩科技有限公司 | Video processing method and device |
| CN114978215B (en) * | 2022-04-13 | 2024-10-18 | 深圳市旭联信息技术有限公司 | Portable wireless same-screen device and control method thereof |
| CN115278348B (en) * | 2022-07-05 | 2023-11-17 | 深圳乐播科技有限公司 | Screen projection method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106253931A (en) * | 2016-08-12 | 2016-12-21 | 深圳市保千里电子有限公司 | A kind of Vehicular video transfer control method and system |
| KR20170045528A (en) * | 2015-10-19 | 2017-04-27 | (주)멀티미디어링크 | Monitor system with multimedia mirroring |
| CN107682541A (en) * | 2017-09-27 | 2018-02-09 | 努比亚技术有限公司 | Audio control method, mobile terminal and the storage medium of screen prjection |
| CN107948567A (en) * | 2016-10-12 | 2018-04-20 | 广州视源电子科技股份有限公司 | USB wired screen transmission method and device |
| CN109246435A (en) * | 2017-07-10 | 2019-01-18 | 中兴通讯股份有限公司 | A kind of USB device redirects data transmission method, data transmission device, local device and remote server |
| CN109361945A (en) * | 2018-10-18 | 2019-02-19 | 广州市保伦电子有限公司 | A fast transmission and synchronization conference audio-visual system and its control method |
-
2020
- 2020-11-11 CN CN202011257303.3A patent/CN112433689B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20170045528A (en) * | 2015-10-19 | 2017-04-27 | (주)멀티미디어링크 | Monitor system with multimedia mirroring |
| CN106253931A (en) * | 2016-08-12 | 2016-12-21 | 深圳市保千里电子有限公司 | A kind of Vehicular video transfer control method and system |
| CN107948567A (en) * | 2016-10-12 | 2018-04-20 | 广州视源电子科技股份有限公司 | USB wired screen transmission method and device |
| CN109246435A (en) * | 2017-07-10 | 2019-01-18 | 中兴通讯股份有限公司 | A kind of USB device redirects data transmission method, data transmission device, local device and remote server |
| CN107682541A (en) * | 2017-09-27 | 2018-02-09 | 努比亚技术有限公司 | Audio control method, mobile terminal and the storage medium of screen prjection |
| CN109361945A (en) * | 2018-10-18 | 2019-02-19 | 广州市保伦电子有限公司 | A fast transmission and synchronization conference audio-visual system and its control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112433689A (en) | 2021-03-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112433689B (en) | Data transmission method and device for same screen device, same screen device and medium | |
| US9696958B2 (en) | Method and system for presenting content | |
| US10045061B2 (en) | Electronic device, adapter device, and video data processing method thereof | |
| EP3040841A1 (en) | Electronic device and resource display method | |
| KR101887883B1 (en) | Integrated mobile desktop | |
| EP2214380A1 (en) | Networked-enabled mass storage dongle with networked media content aggregation | |
| KR101590820B1 (en) | Multi-touch interface schemes | |
| US20240111849A1 (en) | Media docking device and media transfer method | |
| EP3011716B1 (en) | Method, apparatus and computer-readable medium for media content streaming device setup | |
| CN103546741A (en) | Hot plugging detection method and device | |
| US20120281022A1 (en) | Electronic apparatus and image display method | |
| CN105573930A (en) | Electronic apparatus and controlling method thereof | |
| CN105678688B (en) | Picture processing method and device | |
| US20190107929A1 (en) | Method and device for loading content of page, and electronic device | |
| CN103399649A (en) | Data processing method based on K virtual machine (KVM) and KVM transmitting device | |
| CN105511961A (en) | Data sending method and terminal | |
| CN113259603B (en) | Video multifunctional integrated control method, device, equipment and storage medium | |
| CN113031895A (en) | Screen projection control method and device and electronic equipment | |
| US20120229511A1 (en) | Electronic apparatus and method of displaying object | |
| WO2024078172A1 (en) | Screen display method and apparatus, device, and readable storage medium | |
| CN115802096A (en) | Multi-path HDMI cooperative control method and system | |
| CN103902395B (en) | The control method and electric terminal of information input | |
| CN113873158A (en) | Electronic equipment and control method thereof | |
| CN112188177A (en) | Screen-splash prevention method, terminal device and storage medium | |
| CN218830077U (en) | Video processor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |