CN107040498B - Same-screen method and terminal - Google Patents

Abstract

The embodiment of the present invention discloses a method and terminal for the same screen. The same-screen method includes: establishing a same-screen connection between a first terminal and a second terminal; selecting at least one original data stream, and sending it to the second terminal using the same-screen connection; wherein the original data stream is used for the second terminal output, so as to achieve the same screen with the first terminal.

Description

Same screen method and terminal

technical field

The present invention relates to the same-screen technology in the field of wireless communication, and in particular, to a same-screen method and terminal.

Background technique

Wireless co-screening between terminals is an emerging application on mobile terminals at present. The multimedia content on the mobile terminal is pushed to a remote device for display by means of a wireless network. The process of realizing the same screen of the video call of the intelligent terminal in the local area network includes three steps:

1) The terminal periodically intercepts the content of the current screen;

2) The terminal encodes the captured screen content;

3) The encoded content is transmitted to the receiving end device in the local area network through the wireless same-screen protocol.

Although the above method realizes the wireless same screen between terminals, it has the following problems:

First, screenshot the sender's screen. There may be some information that the user does not want to capture and send to the receiver.

Secondly, the resolution of the screen content transmitted to the sender depends on the screen resolution of the sender, which obviously may lead to poor playback at the receiver;

Third, the sender needs to take screenshots and encode the screen content, which will consume the resources of the sender, which may lead to the resource shortage of the sender and the slow system operation, which may lead to the phenomenon of freezing on the same screen.

SUMMARY OF THE INVENTION

In view of this, the embodiments of the present invention are expected to provide a method and terminal for sharing a screen, which at least partially solve one of the above problems.

In order to achieve the above object, the technical scheme of the present invention is achieved in this way:

A first aspect of the embodiments of the present invention provides a method for sharing a screen, and the method includes:

establishing a same-screen connection between the first terminal and the second terminal;

Selecting at least one original data stream, and using the same-screen connection to send to the second terminal;

Wherein, the original data stream is used for output by the second terminal, so as to realize the same screen with the first terminal.

Based on the above solution, the selecting at least one original data stream and sending it to the second terminal using the same-screen connection includes:

Select the local data stream of the first terminal and/or receive the remote data stream sent by the remote device and send it to the second terminal.

Based on the above scheme, the method further includes:

The first terminal sends a query to determine whether the second terminal supports N-channel data stream transmission; wherein, the N is an integer not less than 2;

receiving feedback information sent by the second terminal based on the inquiry;

The selecting at least one original data stream and sending it to the second terminal by using the same-screen connection, including:

When the feedback information indicates that the second terminal supports transmission of N channels of data streams, M channels of original data streams are selected and sent to the second terminal; wherein, the M is a positive integer not greater than the N.

Based on the above solution, the feedback information includes port parameters for the second terminal to receive N data stream transmissions;

The selecting, when the feedback information indicates that the second terminal supports transmission of N data streams, selects M channels of original data streams to send to the second terminal, including:

According to the port parameter, the M channels of original data streams are sent to the second terminal.

Based on the above scheme, the method further includes:

Based on the port parameter, perform session negotiation and establish a transmission session for M-channel original data stream transmission;

The selecting, when the feedback information indicates that the second terminal supports transmission of N data streams, selects M channels of original data streams to send to the second terminal, including:

Based on the transmission session, the M channels of original data streams are sent to the second terminal.

A second aspect of the embodiments of the present invention provides a method for sharing a screen, and the method includes:

The second terminal establishes a same-screen connection with the first terminal;

receiving at least one original data stream sent by the first terminal through the same-screen connection;

The raw data stream is displayed.

Based on the above scheme, the method further includes:

Receive a query from the first terminal to determine whether the second terminal supports transmission of N data streams; the N is an integer not less than 2;

based on the inquiry, forming feedback information according to the capability parameter of the second terminal;

Send the feedback information to the first terminal.

Based on the above solution, when the second terminal supports N-channel data stream transmission, the feedback information includes port parameters supporting N-channel data stream transmission.

Based on the above scheme, the method further includes:

Perform session negotiation with the first terminal and establish a transmission session for M-channel original data stream transmission; wherein, M is a positive integer not greater than N;

The receiving at least one original data stream sent by the first terminal through the same-screen connection includes:

Based on the transmission session, the original data stream sent by the first terminal is received.

A third aspect of the embodiments of the present invention provides a terminal, where the terminal is a first terminal; the first terminal includes:

a first connection unit for establishing a same-screen connection with the second terminal;

a first sending unit, configured to select at least one original data stream and send it to the second terminal by using the same-screen connection;

Wherein, the original data stream is used for output by the second terminal, so as to realize the same screen with the first terminal.

Based on the above solution, the first sending unit is configured to select a local data stream of the first terminal and/or receive a remote data stream sent by a remote device and send it to the second terminal.

Based on the above solution, the first sending unit is configured to send a query to determine whether the second terminal supports N-channel data stream transmission; wherein, N is an integer not less than 2;

The terminal also includes:

a first receiving unit, configured to receive feedback information sent by the second terminal based on the inquiry;

The first sending unit is further configured to select M channels of original data streams to send to the second terminal when the feedback information indicates that the second terminal supports transmission of N channels of data streams; wherein, the M is not A positive integer greater than said N.

Based on the above solution, the feedback information includes port parameters for the second terminal to receive N data stream transmissions;

The first sending unit is configured to send the M channels of original data streams to the second terminal according to the port parameter.

Based on the above solution, the terminal further includes:

a negotiation unit, configured to perform session negotiation and establish a transmission session for M-channel original data stream transmission based on the port parameter;

The first sending unit is configured to send the M channels of original data streams to the second terminal based on the transmission session.

A fourth aspect of the embodiments of the present invention provides a terminal, where the terminal is a second terminal; the second terminal includes:

a second connection unit, configured to establish a same-screen connection with the first terminal;

a second receiving unit, configured to receive at least one original data stream sent by the first terminal through the same-screen connection;

a display unit for displaying the original data stream.

Based on the above solution, the second receiving unit is configured to receive a query from the first terminal to determine whether the second terminal supports transmission of N data streams; the N is an integer not less than 2;

The second terminal also includes:

a forming unit, configured to form feedback information according to the capability parameter of the second terminal based on the query;

A second sending unit, configured to send the feedback information to the first terminal.

Based on the above solution, when the second terminal supports N-channel data stream transmission, the feedback information includes port parameters supporting N-channel data stream transmission.

Based on the above solution, the second terminal further includes:

a session unit, configured to perform session negotiation with the first terminal and establish a transmission session for M-channel original data stream transmission; wherein, M is a positive integer not greater than N;

The second receiving unit is specifically configured to receive the original data stream sent by the first terminal based on the transmission session.

In the same screen method and terminal provided by the embodiments of the present invention, the video sent by the first terminal to the second terminal is the original data stream, not the data stream formed by the screenshot encoding of the first terminal; Consume system resources and cause busyness, so as to avoid undesired phenomena such as the same screen freeze caused by system resource shortage of the first terminal; secondly, since the original data stream is transmitted, the video resolution of the data stream is not limited to the first terminal the display resolution of the terminal, so that the second terminal can obtain a better display effect; again, this allows the first terminal to transmit part of the displayed data stream to the second terminal, so as to realize the part between the first terminal and the second terminal. The same screen is used, thereby meeting the user requirement that the user only uses the same screen part on the second terminal, and improving the intelligence of the terminal and the user satisfaction.

Description of drawings

1 is a schematic flowchart of a first method for co-screening provided by an embodiment of the present invention;

FIG. 2 is a schematic flowchart of a second same-screen method according to an embodiment of the present invention;

3 is a schematic flowchart of a third method for co-screening provided by an embodiment of the present invention;

FIG. 4 is a schematic flowchart of capability negotiation between a first terminal and a second terminal according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a first terminal according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a second terminal according to an embodiment of the present invention.

Detailed ways

The technical solutions of the present invention will be further elaborated below with reference to the accompanying drawings and specific embodiments of the description.

Example 1:

As shown in FIG. 1 , this embodiment provides a method for sharing a screen, and the method includes:

Step S110: the first terminal establishes a same-screen connection with the second terminal;

Step S120: Select at least one original data stream, and send it to the second terminal by using the same-screen connection;

Wherein, the original data stream is used for output by the second terminal, so as to realize the same screen with the first terminal.

Both the first terminal and the second terminal in this embodiment can be wired terminals or mobile terminals; both the first terminal and the second terminal can be mobile phones, tablet computers, or wearable devices, etc. . In this embodiment, the same-screen method may be a wireless same-screen method, that is, the first terminal and the second terminal are both wireless devices, and the transmitted data stream is transmitted by wireless transmission.

The same-screen connection established between the first terminal and the second terminal may include a same-screen connection established based on the wireless network development WFD protocol. The first terminal may be a terminal supporting WiFi direct connection; the second terminal may be a terminal supporting WiFi display. In this embodiment, the first terminal may be a sending end that performs the same screen; the second terminal may be a receiving end that performs the same screen.

The original data stream may include information such as an original video stream. The original data stream includes a partial display data stream currently displayed by the first terminal. In step S120, the original data stream transmitted by the first terminal to the second terminal is not a data stream formed by performing screenshot encoding on the first terminal. In this way, the first terminal does not need to take a screenshot of the display screen of the first terminal, nor does it need to encode the screenshot, thereby reducing the system resources consumed by the first terminal due to the screenshot and encoding, thereby reducing the resource consumption of the first terminal. It reduces the failure phenomenon of the first terminal that causes the same screen to freeze due to resource consumption.

At the same time, at this time, the second terminal receives the original data stream, not the screen-encoded data, so it is not limited to the display resolution of the first terminal, so that the second terminal can provide better video output effects.

In addition, since the first terminal in this embodiment sends the original data stream to the second terminal, the information displayed on the first terminal that was originally not intended to be sent to the second terminal will not be sent to the second terminal, thereby reducing the number of The interference of other information is avoided, and the information displayed on the first terminal is avoided from being leaked. For example, when the first terminal and the third terminal are in a video call, in addition to the video displayed by the video call, the first terminal also displays various files on the desktop of the first terminal. If a data stream is formed and sent to the second terminal by means of screenshot encoding, the second terminal can not only see the information of the video call, but also see the file information on the desktop of the first terminal. In addition, if the user only wants to send the video sent by the third video to the second terminal at this time, it is obviously difficult to achieve this by using the existing screen-shot encoding method. In this embodiment, only the third terminal needs to be sent. The original data stream sent to the first terminal is forwarded to the first terminal, so that the user's requirement can be easily fulfilled, and the user satisfaction is improved.

The method also includes:

Receive user instructions:

The first terminal selects at least one original data stream to send to the second terminal, including:

Based on the user instruction, at least one of the original data streams is selected and sent to the second terminal.

The user indication may include detecting which raw data stream or streams are selected by the user input. This is convenient for users to control the video on the same screen. The step S120 may include: selecting a local data stream of the first terminal and/or receiving a remote data stream sent by a remote device and sending it to the second terminal.

For example, the first terminal is in a video call with the third terminal. At this time, the first terminal will collect and form a local video by itself, and at the same time, the first terminal will also receive the remote video collected and sent by the third terminal. The original data stream sent to the first terminal in step S120 may be the local video collected by the first terminal itself, or may be the remote video received from the third terminal.

If the method for sharing video on the screen described in this embodiment is applied to the process of a video call, it is possible to use a mobile phone to make a video call to obtain a video on the same screen and transfer it to a large-screen device such as a tablet computer or a notebook computer with a larger screen to obtain a video on the same screen. A better experience for calls.

As shown in FIG. 2, before step S120, the method further includes:

Step S111: the first terminal sends a query to determine whether the second terminal supports N-channel data stream transmission; wherein, the N is an integer not less than 2;

Step S112: Receive feedback information sent by the second terminal based on the query;

The step S120 may include:

When the feedback information indicates that the second terminal supports transmission of N channels of data streams, M channels of original data streams are selected and sent to the second terminal; wherein, the M is a positive integer not greater than the N.

In this embodiment, the first terminal will perform capability negotiation with the second terminal. In the process of capability negotiation, if the first terminal needs to send two or more data streams to the second terminal, it needs to Confirm whether the second terminal can receive two or more data streams at the same time.

The feedback information includes port parameters for receiving, by the second terminal, N data stream transmissions;

The step S120 may include: sending the M channels of original data streams to the second terminal according to the port parameter.

The port parameters may include port information of the real-time transmission port. For example, the N is equal to 2, and the port parameters may include port parameters of rtp-port0 and rtp-port1. The rtp-port0 is the real-time transmission port 0, and the rtp-port1 is the real-time transmission port 1.

In this real-time example, when N is an integer not less than 2, it means that the second terminal is capable of supporting real-time simultaneous transmission of multiple data streams. In this case, the second terminal may be capable of simultaneously receiving multiple original data streams and outputting the output of multiple original data streams.

The method also includes:

Based on the port parameter, perform session negotiation and establish a transmission session for M-channel original data stream transmission;

The step S120 specifically includes: based on the transmission session, sending the M channels of original data streams to the second terminal.

In this embodiment, in order to facilitate the transmission of data streams, a transmission session needs to be established in this embodiment. In this real-time example, the transmission of multiple original data streams may be involved, and a transmission session needs to be established. Since multiple original data streams are involved, multiple transmission sessions will be established.

In a word, the same-screen method described in this embodiment changes the same-screen method in the prior art in which the display screen of the screen-capture encoding sender is sent to the receiver, reduces the system consumption of the sender of the same-screen, improves the same-screen effect, and can achieve Part of the same screen, to meet the needs of users on the same screen in the process of the same screen.

Embodiment 2:

As shown in FIG. 3 , this embodiment provides a method for sharing a screen, and the method includes:

Step S210: establishing a same-screen connection between the second terminal and the first terminal;

Step S220: receiving at least one original data stream sent by the first terminal through the same-screen connection;

Step S230: Display the original data stream.

The method of the same screen method described in this embodiment may be the aforementioned wireless same screen method, and in this embodiment, it may be a method applied to the receiving end of the same screen method. The first terminal is the sending end of the data stream in the process of the same screen, and the second terminal is the receiving end that receives the data stream.

In this embodiment, the first terminal and the second terminal establish a same-screen connection, for example, a same-screen connection established based on the WFD protocol.

In the step S220, the data stream received by the second terminal from the first terminal is the original data stream, not the data stream after screen capture and encoding by the first terminal, so that what the second terminal displays in step S230 is the original data stream. The video resolution of the data stream viewed by the second terminal is not limited to the screen resolution of the first terminal, which can improve the display effect of the second terminal; at the same time, since the second terminal receives the original data stream, The system of the terminal is busy, and the same screen freezes and other undesirable phenomena.

As shown in Figure 4, the method further includes:

Step S211: Receive an inquiry from the first terminal to determine whether the second terminal supports transmission of N data streams; the N is an integer not less than 2;

Step S212: Based on the inquiry, form feedback information according to the capability parameter of the second terminal;

Step S213: Send the feedback information to the first terminal.

In this embodiment, the first terminal and the second terminal will perform capability negotiation. At this time, the first terminal will send an inquiry to the second terminal to inquire whether the second terminal supports the transmission of two or more data streams. In step S212, the second terminal will respond to the inquiry, form feedback information in response to the inquiry according to the capability parameter of the second terminal itself, and in step S213, the first terminal will send the feedback information.

Through the inquiry, it is convenient for the first terminal to determine whether two or more original data streams can be sent to the second terminal at the same time, so as to perform the same screen of multiple data streams.

When the second terminal supports N-channel data stream transmission, the feedback information includes port parameters supporting N-channel data stream transmission.

These port parameters may be the destination address of the port for sending the original data stream, in this case, it is convenient for the first terminal to send the original data stream.

The method further includes: conducting session negotiation with the first terminal and establishing a transmission session for transmitting M channels of original data streams; wherein, M is a positive integer not greater than N;

The step S220 may include:

Based on the transmission session, the original data stream sent by the first terminal is received.

In this embodiment, the second terminal also conducts a session with the first terminal, and receives the original data stream sent by the first terminal based on the transmission session, which can ensure smoother transmission of the original data stream.

Embodiment three:

As shown in FIG. 5 , this embodiment provides a terminal, where the terminal is a first terminal; the first terminal includes:

a first connection unit 110, configured to establish a same-screen connection with the second terminal;

a first sending unit 120, configured to select at least one original data stream, and send it to the second terminal by using the same-screen connection;

Wherein, the original data stream is used for output by the second terminal, so as to realize the same screen with the first terminal.

The first connection unit 110 included in the first terminal in this embodiment may include a communication interface, and the communication interface may include a wired interface or a wireless interface; the wireless interface may include a transceiver antenna and the like.

The hardware structure of the first sending unit 120 may also include a communication interface, a sending interface that can be used to send a data stream to the second terminal, such as a sending antenna, and the sending antenna may specifically be a WiFi antenna or the like.

The first terminal described in this embodiment may be an electronic device such as a mobile phone, a tablet computer, or a wearable device, which can directly send the original data stream for the same screen to the second terminal, instead of the screen shot encoding after the first terminal is displayed. The first terminal has the characteristics of less operation on the same screen, less consumption of system resources, and good effect on the same screen.

As a further improvement of this embodiment, the first sending unit 120 is configured to select a local data stream of the first terminal and/or receive a remote data stream sent by a remote device and send it to the second terminal.

In this embodiment, the original data stream sent by the first sending unit 120 may be a local data stream of the first terminal, or a remote data stream received by the first terminal from a remote device, or the like. For example, the first terminal and the third terminal are in a video call, and the data stream formed during the video call may include a local data stream collected locally, and also include a remote data stream received from the third terminal. At this time, the first sending unit 120 may send at least one of the local data stream and the remote data stream to the second terminal to perform the same screen.

The first sending unit 120 is configured to send a query to determine whether the second terminal supports N-channel data stream transmission; wherein, the N is an integer not less than 2;

The first terminal also includes:

a first receiving unit, configured to receive feedback information sent by the second terminal based on the inquiry;

The first sending unit 120 is further configured to select M channels of original data streams to send to the second terminal when the feedback information indicates that the second terminal supports transmission of N channels of data streams; wherein, the M is A positive integer not greater than said N.

In this embodiment, the first terminal further includes a first receiving unit, and the first receiving unit may include a receiving interface capable of receiving feedback information sent by the second terminal. The first sending unit 120 is also used to send a query for determining that the second terminal can simultaneously support N-channel data stream transmission to the second terminal, and at the same time, the first sending unit 120 and the feedback formed by the second terminal's reply to the query information to complete the capability notification with the second terminal, so as to determine whether or not two or more original data streams can be sent to the second terminal at the same time.

The feedback information includes port parameters for receiving, by the second terminal, N data stream transmissions;

The first sending unit 120 is configured to send the M channels of original data streams to the second terminal according to the port parameter.

In this embodiment, the feedback information further includes a port parameter. In this case, it is convenient for the first sending unit 120 to determine through which ports to send the original data stream to the second terminal.

In addition, the first terminal further includes:

a negotiation unit, configured to perform session negotiation and establish a transmission session for M-channel original data stream transmission based on the port parameter;

The first sending unit 120 is configured to send the M channels of original data streams to the second terminal based on the transmission session.

In this embodiment, the first terminal further includes a negotiation unit, and the negotiation unit may include a communication interface, and performs a transmission session of original data stream transmission through information interaction with the second terminal.

After the negotiation unit and the second terminal complete the session establishment, the first sending unit 120 transmits the M channels of original data streams based on the transmission session, thereby simply realizing the transmission of the original data streams.

In a word, the first terminal in this embodiment may be a hardware structure for implementing the same screen method described in the first embodiment, and has the characteristics of good screen effect, simple operation of the first terminal, and low consumption of system resources.

Embodiment 4:

As shown in FIG. 6 , this embodiment provides another terminal, and the terminal is a second terminal; the second terminal includes:

The second connection unit 210 is configured to establish a same-screen connection with the first terminal;

The second receiving unit 220 is configured to receive at least one original data stream sent by the first terminal through the same-screen connection;

The display unit 230 is configured to display the original data stream.

The structure of the second connection unit 210 in this embodiment is similar to that of the first connection unit in the aforementioned first terminal, and may also include a communication interface, which can be used for the first terminal to establish a connection, and the connection is used for connecting the first terminal and the second terminal. The same screen between them can be called the same screen connection.

The second receiving unit 220 may include a receiving interface, such as a receiving antenna, capable of receiving one or more original data streams sent by the first terminal.

The display unit 230 may include various display screens; the display screens may include a liquid crystal display screen, an electronic ink display screen, a projection display screen, an organic light emitting diode OLED display screen, and the like. The display screen can be used to display the data stream, so as to realize the display of the same picture as that of the first terminal and realize the same screen.

In this embodiment, the second terminal may be a hardware structure for implementing the same-screen method described in Embodiment 2, which can reduce bad displays such as stuck on the same screen and provide the same-screen effect.

Further, the second receiving unit 220 is configured to receive a query from the first terminal to determine whether the second terminal supports N-channel data stream transmission; the N is an integer not less than 2;

The second terminal also includes:

a forming unit, configured to form feedback information according to the capability parameter of the second terminal based on the query;

A second sending unit, configured to send the feedback information to the first terminal.

In this embodiment, the second terminal further includes a forming unit, and the forming unit may include a processor or a processing circuit. The processor may include a central processing unit, a microprocessor, a digital signal processor, an application processor, a programmable array, or the like. The processing circuit may include an application specific integrated circuit or the like.

In this embodiment, the forming unit inquires about the capability of the second terminal according to the inquiry, and forms corresponding feedback information. Finally, the second sending unit of the second terminal sends the feedback information to the first terminal, so as to inform the first terminal of the capability of the second terminal, and it is convenient for the first terminal to decide to transmit one or more channels of original data to the second terminal. flow.

The second transmitting unit may include a transmitting interface, which may be a wired interface or a wireless interface, and the wireless interface may include a transmitting antenna. The transmitting antenna may include a WiFi antenna or the like.

In this embodiment, when the second terminal supports N-channel data stream transmission, the feedback information includes port parameters supporting N-channel data stream transmission.

The port parameter is carried in the feedback information, which is convenient for the first terminal to send the original data stream and the like according to the port parameter.

In addition, the second terminal further includes:

a session unit, configured to perform session negotiation with the first terminal and establish a transmission session for M-channel original data stream transmission; wherein, M is a positive integer not greater than N;

The second receiving unit 220 is specifically configured to receive the original data stream sent by the first terminal based on the transmission session.

In this embodiment, the conversation unit may include a communication interface and a processor or a processing circuit, the communication interface is used for the first terminal to perform information interaction, and the processor or processing circuit may be used to form interactive information and parse the received information to complete establishment of the transport session. The second receiving unit 220 is based on the original data stream that can be easily and quickly processed by the transmission session, so that the same screen can be well realized.

In a word, the second terminal provided in this embodiment can be a hardware structure for implementing the same-screen method described in Embodiment 2, and can improve the same-screen effect and user satisfaction.

Several specific examples are provided below in conjunction with any of the foregoing embodiments.

Example one:

The working scenario of this example may be that, during a video call, the specific content of the video call, including the local data stream and the remote data stream, is displayed on the large screen through the same-screen protocol.

The same screen method described in this example includes:

Step 1: Search for devices in the current local area network on the first terminal for video calling, and find a receiving end device that supports the same screen; the receiving end device is the aforementioned second terminal.

Step 2: Based on the user's instruction, choose to establish a same-screen connection between the first terminal of the video call and one of the receiving end devices.

Step 3: After establishing the same-screen connection, select a video call data stream on the first terminal to send to the receiving end device for output.

Step 4: Based on the user's instruction, you can choose to switch the data stream and select different data streams, including the local data stream or the remote data stream; you can also choose to send the two data streams to the receiving end device at the same time based on the user's instruction. , after receiving the two data streams, the receiving end device needs to output the two data streams at the same time.

Step 5: Based on the user's instruction, terminate the video call or the same screen, and end the transmission of the data stream.

In the above steps, if the current data stream on the same screen is a single data stream, such as a local data stream or a remote data stream, the existing on-screen protocol can be used, and the terminal only needs to obtain the real-time transmission (Real Time Protocol) from the video call. , RTP) data stream is transmitted to the receiving end through the same screen protocol.

Example two:

In this example, a method of simultaneously transmitting two data streams and performing the same screen of the two data streams is provided. At this time, when the first terminal and the second terminal perform the same screen, the following improvements can be made on the basis of the existing same screen protocol. Taking the wireless display Miracast protocol as an example, it includes two scenarios: in the first scenario, two data streams are output on the same receiver; in the second scenario, the two data streams are output on different receiver devices.

In the first scenario, the process of modifying the Miracast protocol is as follows: After the sender and receiver complete the M1 or M2 message, when the terminal sends an M3 message to the sender, a method parameter is added to ask whether the current receiver supports two data streams. The parameter for query can be: wfd_supported_second_video. The transmitting end here is the aforementioned first terminal, and the receiving end is the aforementioned second terminal.

If the receiving end does not reply to this field, it means that the receiving end does not support simultaneous transmission and display of two channels of data.

If the receiving end supports the decoding and display of two channels of data at the same time, this field is carried in the returned M3, and the content of the rtp-port0 and rtp-port1 parameters of wfd-client-rtp-ports is given in the returned M3 message. . The rtp-port0 represents the real-time transmission port 0; the rtp-port1 represents the real-time transmission port 1.

As shown in the table below:

In the next M4 message, the wfd-url0 and wfd-url1 in the wfd-presentation-url parameter need to be extended, as shown in the following table

The first receiving end in the above table is the main receiving end, and the second receiving end is the auxiliary receiving end.

After the M3 or M4 message negotiation process is completed, the first terminal and the sender send the second data stream to the receiver simultaneously in the M6 message according to the WFD session establishment process. The second data stream here may be one of the aforementioned multiple original data streams. The parsing and presentation of the specific two-way data is the responsibility of the receiving end. The packaged RTP stream needs to contain the sequence parameter sets (Sequence Parameter Sets, SPS) and picture parameter sets (Picture Parameter Sets, PPS) of the data source, which is convenient for the receiving end. Parse out the data stream according to the SPS and PPS and output the corresponding video.

Scenario 2 is to transmit two channels of data to different receivers.

After receiving the M3 reply message that does not support two-way data from the receiving end, the sending end broadcasts to discover other receiving end devices again. After the user selects the second receiving end device, a WFD connection is established with the current sending end. In this way, the first The second channel of data uses WFD to transmit the data source to the second receiving end in the same way as the first channel of data. This process is equivalent to performing the same screen twice, that is, establishing a WFD connection between the sending end and two different receiving ends, respectively, and does not need to modify the protocol, and the specific process will not be repeated.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms. of.

The unit described above as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may all be integrated into one processing module, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integration The unit can be implemented either in the form of hardware or in the form of hardware plus software functional units.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by program instructions related to hardware, the aforementioned program can be stored in a computer-readable storage medium, and when the program is executed, execute Including the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: a mobile storage device, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk and other various A medium on which program code can be stored.

The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention. should be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (12)

1. a same screen method, is characterized in that, described method comprises: acquiring the local video data stream and the remote video data stream generated by the first terminal and the remote device during the video call; establishing a same-screen connection between the first terminal and the second terminal; sending an inquiry to the second terminal, where the inquiry is used to determine whether the second terminal supports at least two video data stream transmission; receiving feedback information sent by the second terminal based on the inquiry; When the feedback information indicates that the second terminal supports transmission of at least two video data streams, select at least one video data stream from the local video data stream and the remote video data stream and send it to the second terminal , for the output of the second terminal; When the feedback information indicates that the second terminal does not support the transmission of at least two video data streams, sending one of the local video data stream and the remote video data stream to the second terminal, for output by the second terminal; establishing a same-screen connection between the first terminal and the third terminal; Sending the other one of the remote video data stream and the local video data stream to the third terminal for output by the third terminal. 2. The method according to claim 1, wherein the feedback information comprises port parameters for the second terminal to receive at least two video data stream transmissions; When the feedback information indicates that the second terminal supports transmission of at least two video data streams, select at least one video data stream from the local video data stream and the remote video data stream and send it to the first terminal. Two terminals, including: According to the port parameter, the at least one video data stream is sent to the second terminal. 3. The method according to claim 2, wherein the method further comprises: Based on the port parameter, perform session negotiation and establish a transmission session for at least one video data stream transmission; When the feedback information indicates that the second terminal supports transmission of at least two video data streams, select at least one video data stream from the local video data stream and the remote video data stream and send it to the first terminal. Two terminals, including: Based on the transmission session, the at least one video data stream is sent to the second terminal. 4. a same screen method, is characterized in that, described method comprises: establishing a same-screen connection between the second terminal and the first terminal; receiving an inquiry sent by the first terminal, where the inquiry is used to determine whether the second terminal supports transmission of at least two video data streams; based on the inquiry, forming feedback information according to the capability parameter of the second terminal; sending the feedback information to the first terminal; When the feedback information indicates that the second terminal supports transmission of at least two video data streams, at least one video data stream sent by the first terminal is received; wherein the at least one video data stream is from the first terminal The video data stream selected from the local video data stream and the remote video data stream generated by the terminal and the remote device during the video call; displaying the at least one video data stream on the second terminal; When the feedback information indicates that the second terminal does not support transmission of at least two video data streams, receiving one of the local video data stream and the remote video data stream sent by the first terminal; One of the local video data stream and the remote video data stream is displayed on the second terminal. 5 . The method according to claim 4 , wherein when the second terminal supports transmission of at least two video data streams, the feedback information includes port parameters supporting the transmission of at least two video data streams. 6 . 6. The method according to claim 4, wherein the method further comprises: Perform session negotiation with the first terminal and establish a transmission session for at least one video data stream transmission; The receiving at least one video data stream sent by the first terminal when the feedback information indicates that the second terminal supports transmission of at least two video data streams includes: Based on the transmission session, at least one video data stream sent by the first terminal is received. 7. A terminal, wherein the terminal is a first terminal; and the first terminal comprises: an acquisition unit for acquiring the local video data stream and the remote video data stream generated by the first terminal and the remote device during the video call; a first connection unit for establishing a same-screen connection with the second terminal; a first sending unit, configured to send an inquiry to the second terminal, where the inquiry is used to determine whether the second terminal supports transmission of at least two video data streams; a first receiving unit, configured to receive feedback information sent by the second terminal based on the inquiry; The first sending unit is further configured to select at least one channel of video data from the local video data stream and the remote video data stream when the feedback information indicates that the second terminal supports transmission of at least two video data streams sending the stream to the second terminal for the second terminal to output; when the feedback information indicates that the second terminal does not support the transmission of at least two video data streams, the local video data stream and the sending one of the remote video data streams to the second terminal for output by the second terminal; a first connection unit, further configured to establish a same-screen connection between the first terminal and the third terminal; The first sending unit is configured to send the other one of the remote video data stream and the local video data stream to the third terminal for output by the third terminal. 8. The terminal according to claim 7, wherein the feedback information comprises port parameters for the second terminal to receive at least two video data stream transmissions; The first sending unit is further configured to send the at least one video data stream to the second terminal according to the port parameter. 9. The terminal according to claim 8, wherein the first terminal further comprises: a negotiation unit, configured to perform session negotiation and establish a transmission session for at least one video data stream transmission based on the port parameter; The first sending unit is configured to send the at least one video data stream to the second terminal based on the transmission session. 10. A terminal, wherein the terminal is a second terminal; the second terminal comprises: a second connection unit, configured to establish a same-screen connection with the first terminal; a second receiving unit, configured to receive an inquiry sent by the first terminal, where the inquiry is used to determine whether the second terminal supports transmission of at least two video data streams; a forming unit, configured to form feedback information according to the capability parameter of the second terminal based on the query; a second sending unit, configured to send the feedback information to the first terminal; The second receiving unit is further configured to receive at least one video data stream sent by the first terminal when the feedback information indicates that the second terminal supports transmission of at least two video data streams; wherein the at least one video data stream is The data stream is a video data stream selected from the local video data stream and the remote video data stream generated during the video call by the first terminal and the remote device; a display unit, configured to display the at least one video data stream on the second terminal; The second receiving unit is further configured to receive the local video data stream and the remote video sent by the first terminal when the feedback information indicates that the second terminal does not support the transmission of at least two video data streams one of the data streams; The display unit is further configured to display one of the local video data stream and the remote video data stream on the second terminal. 11 . The terminal according to claim 10 , wherein, when the second terminal supports transmission of at least two video data streams, the feedback information includes port parameters supporting the transmission of at least two video data streams. 12 . 12. The terminal according to claim 10, wherein the second terminal further comprises: a session unit, configured to perform session negotiation with the first terminal and establish a transmission session for transmitting at least one video data stream; The second receiving unit is specifically configured to receive at least one video data stream sent by the first terminal based on the transmission session.

Images