CN112738575A

CN112738575A - Screen projection implementation method, device and system

Info

Publication number: CN112738575A
Application number: CN201911033056.6A
Authority: CN
Inventors: 胡飞阳; 苑颖; 董金威; 何利明; 杨航; 吴成浩; 李伟
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2019-10-28
Filing date: 2019-10-28
Publication date: 2021-04-30

Abstract

The embodiment of the application provides a screen projection implementation method, device and system. The receiving end obtains a screen projection notification sent by the server end; the screen-casting notification is sent by the server side in response to a screen-casting request of the screen-casting side; outputting and receiving prompt information; responding to a receiving confirmation operation, sending a confirmation request to the server, so that the server sends screen projection content of the screen projection end to the receiving end in response to the confirmation request; and acquiring the screen projection content sent by the server, and rendering and displaying the screen projection content. The technical scheme provided by the embodiment of the application realizes the purpose of screen projection in different places and improves the screen projection safety.

Description

Screen projection implementation method, device and system

Technical Field

The embodiment of the application relates to the technical field of computer application, in particular to a screen projection implementation method, device and system.

Background

With the development of internet technology, screen projection technology is widely applied. The screen projection means that the content in one terminal is projected to other equipment for display. For example, the mobile phone screen is released to the smart television for display, so that the user can browse the mobile phone screen on the smart television.

The current screen projection implementation mode is that a screen projection end and a receiving end are connected into the same local area network, a point-to-point connection channel is established between the screen projection end and the receiving end, the screen projection end directly sends screen projection content to the receiving end based on the point-to-point connection channel, and then the receiving end performs rendering display.

Then, the screen projection end of the screen projection implementation mode can only carry out screen projection content sharing to the receiving end located in the same local area network, and the receiving end can only passively accept screen projection.

Disclosure of Invention

The embodiment of the application provides a screen projection implementation method, device and system.

In a first aspect, an embodiment of the present application provides a screen projection implementation method, including:

the receiving end obtains a screen projection notification sent by the server end; the screen-casting notification is sent by the server side in response to a screen-casting request of the screen-casting side;

outputting and receiving prompt information;

responding to a receiving confirmation operation, sending a confirmation request to the server, so that the server sends screen projection content of the screen projection end to the receiving end in response to the confirmation request;

and acquiring the screen projection content sent by the server, and rendering and displaying the screen projection content.

In a second aspect, an embodiment of the present application provides a screen projection implementation method, including:

the method comprises the steps that a server side receives a screen throwing request sent by a screen throwing side and determines at least one receiving side;

sending a screen projection notification to the at least one receiving end so that the at least one receiving end can output and receive prompt information;

acquiring screen projection contents generated by the screen projection end;

and responding to a confirmation request sent by any receiving terminal, and forwarding the screen projection content to the receiving terminal.

In a third aspect, an embodiment of the present application provides a screen projection implementation method, including:

the screen projection end sends a screen projection request to the server end, so that the server end determines at least one receiving end and sends a screen projection notification to the at least one receiving end;

generating screen projection content;

and sending the screen projection content to the server side so that the server side can forward the screen projection content to a receiving end corresponding to the received confirmation request.

In a fourth aspect, an embodiment of the present application provides a screen projection implementation system, which includes a screen projection end, a receiving end, and a server end;

the screen projection end is used for sending a screen projection request to the server end, generating screen projection content and sending the screen projection content to the server end; the server is used for determining at least one receiving end based on the screen projection request; respectively sending screen projection notification to the at least one receiving end; responding to a confirmation request of any receiving terminal, and respectively forwarding the screen projection contents to the any receiving terminal;

the receiving end is used for receiving the screen projection notification sent by the server end and outputting receiving prompt information; responding to the receiving confirmation operation, and sending a confirmation request to the server; and receiving screen projection content sent by the server, and rendering and displaying the screen projection content.

In a fifth aspect, an embodiment of the present application provides a screen projection implementation apparatus, including:

the notification acquisition module is used for acquiring a screen projection notification sent by the server; the screen-casting notification is sent by the server side in response to a screen-casting request of the screen-casting side;

the information prompt module is used for outputting and receiving prompt information;

the confirmation triggering module is used for responding to a confirmation receiving operation and sending a confirmation request to the server, so that the server responds to the confirmation request and sends the screen projection content of the screen projection end to the receiving end;

and the content rendering module is used for acquiring the screen-projecting content sent by the server and rendering and displaying the screen-projecting content.

In a sixth aspect, an embodiment of the present application provides a screen projection implementation apparatus, including:

the request receiving module is used for receiving a screen projection request sent by a screen projection end and determining at least one receiving end;

the notification sending module is used for sending a screen projection notification to the at least one receiving end so that the at least one receiving end can output and receive prompt information;

the content acquisition module is used for acquiring the screen projection content generated by the screen projection end;

and the content forwarding module is used for responding to a confirmation request sent by any receiving terminal and forwarding the screen projection content to the receiving terminal.

In a seventh aspect, an embodiment of the present application provides a screen projection implementation apparatus, including:

the request sending module is used for sending a screen projection request to the server so that the server can determine at least one receiving terminal and send a screen projection notification to the at least one receiving terminal;

the content generation module is used for generating screen projection content;

and the content sending module is used for sending the screen projection content to the server so that the server can forward the screen projection content to a receiving end corresponding to the received confirmation request.

In an eighth aspect, an embodiment of the present application provides an electronic device, including a processing component, a display component, and a storage component;

the storage component stores one or more computer program instructions; the one or more computer program instructions for invocation and execution by the processing component;

the processing component is to:

outputting and receiving prompt information;

and acquiring the screen projection content sent by the server, and rendering and displaying the screen projection content through the display component.

In a ninth aspect, embodiments of the present application provide a computing device, comprising a processing component and a storage component;

the storage component stores one or more computer instructions; the one or more computer instructions to be invoked for execution by the processing component;

the processing component is to:

receiving a screen projection request sent by a screen projection end, and determining at least one receiving end;

acquiring screen projection contents generated by the screen projection end;

In a tenth aspect, an embodiment of the present application provides an electronic device, including a processing component and a storage component;

the processing component is to:

sending a screen projection request to a server side, so that the server side can determine at least one receiving terminal and send a screen projection notification to the at least one receiving terminal;

generating screen projection content;

In the embodiment of the application, a screen projection end sends a screen projection request to a server end; the server side determines at least one receiving end based on the screen projection request; respectively sending screen projection notification to the at least one receiving end; the receiving end receives the screen projection notification sent by the server end, outputs the receiving prompt information, and responds to the receiving confirmation operation and sends a confirmation request to the server end; the server responds to the confirmation request of any receiving terminal, and then forwards the screen projection contents generated by the screen projection terminal to any receiving terminal respectively.

These and other aspects of the present application will be more readily apparent from the following description of the embodiments.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1 is a schematic structural diagram illustrating an embodiment of a screen projection implementation system provided by the present application;

FIG. 2 is a schematic structural diagram illustrating a further embodiment of a screen projection implementation system provided by the present application;

FIG. 3 is a schematic structural diagram illustrating a further embodiment of a screen projection implementation system provided by the present application;

FIG. 4 is a diagram illustrating a screen projection implementation of the embodiment of the present application in a practical application;

FIG. 5a is a schematic diagram illustrating a screen projection implementation of the embodiment of the present application in yet another practical application;

FIG. 5b is a schematic diagram illustrating a screen projection implementation of the embodiment of the present application in yet another practical application;

FIG. 6a is a schematic diagram of a screen projection interface in a practical application according to an embodiment of the present application;

FIG. 6b is a schematic diagram of a screen projection interface of the embodiment of the present application in still another practical application;

FIG. 6c is a schematic diagram of a screen projection interface of the embodiment of the present application in still another practical application;

FIG. 7 is a flow chart illustrating one embodiment of a screen projection implementation method provided herein;

FIG. 8 is a flow chart illustrating a further embodiment of a method for implementing screen projection provided by the present application;

FIG. 9 is a flow chart illustrating a further embodiment of a method for implementing screen projection provided by the present application;

FIG. 10 is a schematic structural diagram illustrating an embodiment of a screen projection implementation apparatus provided in the present application;

FIG. 11 is a schematic diagram illustrating an embodiment of an electronic device provided herein;

FIG. 12 is a schematic structural diagram illustrating a further embodiment of a screen projection implementation apparatus provided by the present application;

FIG. 13 is a block diagram illustrating one embodiment of a computing device provided herein;

FIG. 14 is a schematic structural diagram illustrating a further embodiment of a screen projection implementation apparatus provided by the present application;

fig. 15 is a schematic structural diagram of another embodiment of an electronic device provided in the present application.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

In some of the flows described in the specification and claims of this application and in the above-described figures, a number of operations are included that occur in a particular order, but it should be clearly understood that these operations may be performed out of order or in parallel as they occur herein, the number of operations, e.g., 101, 102, etc., merely being used to distinguish between various operations, and the number itself does not represent any order of performance. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.

The technical scheme of the embodiment of the application is suitable for various screen projection scenes, and can be applied to screen projection scenes in meeting scenes. In the embodiment of the present application, a Party may refer to aggregating a plurality of participants to perform a collective activity, such as a meeting, a course, a wedding, Party (social gathering), a concert, a sports game, and the like.

Due to the screen projection implementation mode in the prior art, the screen projection end and the receiving end are required to be in the same local area network, and the receiving end can only passively accept screen projection. Taking a meeting as an example, at present, only a screen-throwing end can throw screen-throwing content into a meeting terminal at a meeting place, such as an intelligent television, and the screen-throwing end and the intelligent television need to be connected to the same local area network, and then, the inventor finds out in research that in practical application, a different-place meeting requirement often exists, and a different-place user cannot see the intelligent television displaying the screen-throwing content; and the conference place may be relatively large, the display screen of the smart television is limited, and the rear row of users may not see the display screen clearly, so the current screen projection implementation mode cannot meet the requirement for screen projection content sharing.

Therefore, the invention provides the technical scheme of the application through a series of researches, a remote connection channel can be established between the screen projecting end and the receiving end through the server end, namely the screen projecting content can be sent to the receiving end to be displayed, and the screen projecting end and the receiving end are not limited to the same local area network, so that the requirements of remote screen projection are met. By sending the screen projection notification to the receiving end, the receiving end user is notified in a mode that the receiving end outputs and receives prompt information, the screen projection timeliness is guaranteed, the receiving end user can actively select whether to accept screen projection, screen projection safety is improved, and the receiving end can be a personal terminal, such as a mobile phone and other portable terminals, and the screen projection requirement anytime and anywhere is met.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The technical solution of the embodiment of the present application may be applied to a screen projection implementation system as shown in fig. 1, where the screen projection implementation system may include a screen projection end 101, a receiving end 102, and a server end 103, where the receiving end 102 may include one or more than one.

The screen projection terminal 101 is configured to send a screen projection request to the server terminal 103, generate screen projection content, and send the screen projection content to the server terminal;

the server 103 is configured to determine at least one receiving end based on the screen projection request; sending a screen projection notification to the at least one receiving end; responding to a confirmation request of any receiving terminal, and respectively forwarding the screen projection contents to the any receiving terminal;

the receiving end 102 is configured to receive a screen-casting notification sent by the server end 103 and output a receiving prompt message; in response to the acknowledgement receipt operation, sending an acknowledgement request to the server 103; and receiving the screen-casting content sent by the server 103, and rendering and displaying the screen-casting content.

In the embodiment of the application, the remote connection can be established between the screen projecting end and the receiving end through the server end, so that the screen projecting end can send screen projecting contents to the receiving end through the server end respectively without being limited to the screen projecting end and the receiving and searching section in the same local area network, the purpose of projecting screens in different places is achieved, a user at the receiving end can actively select whether to accept screen projection or not instead of passive acceptance, the screen projecting safety is improved, and the user experience is improved.

The receiving prompt information is used for prompting whether a receiving end user allows screen projection or not.

Wherein the receive alert information may include one or more of content alert information, vibration alert information, and ring alert information.

The vibration prompt message can be realized by starting a motor component of the equipment where the receiving end is located, and the ringing prompt message can be realized by a loudspeaker component of the equipment where the receiving end is located. The content prompt message may include screen projection related information, such as a screen projection user name.

The receiving end user may execute corresponding trigger operations based on receiving the prompt information, for example, the content prompt information may include a confirmation control and a rejection control, the confirmation request may be generated by triggering the confirmation control, the rejection request may be triggered by triggering the rejection control, and the like.

Therefore, in some embodiments, the receiving end is further configured to send a rejection request to the service end in response to the rejection of the receiving operation;

the server is also used for responding to the rejection request, and the server cancels the screen projection content to be forwarded to the receiving end.

The server side responds to the confirmation request of any receiving end and can send a confirmation instruction to the screen projection end;

therefore, the screen projection end can specifically respond to the confirmation instruction and then send the screen projection content to the server end.

The receiving end may include a first receiving end installed in the first terminal or a second receiving end installed in the second terminal; the first receiving end and the second receiving end may refer to clients of different versions, where the first terminal is generally fixedly deployed in a fixed location, such as an intelligent projector, an intelligent television box, and in a meeting scene, the fixed location may refer to a meeting place, such as a certain meeting room, for example, and the second terminal may refer to a Personal terminal, such as a PC (Personal Computer), a tablet Computer, a mobile phone, or a wearable device; in one possible implementation, the receiving end may refer to only the receiving end installed in the personal terminal.

The screen projection end may refer to a client installed in a third terminal, and the third terminal may refer to a personal terminal, for example, a PC, a mobile phone, a tablet computer, a wearable device, and the like; therefore, the technical scheme of the embodiment of the application can achieve the purpose of screen projection in the personal terminal, and is not limited to the intelligent display terminal such as an intelligent television box and the like.

The server may include one or more servers, which may refer to remote web (web) servers, cloud servers, computer networking devices, chipsets, desktop computers, notebook computers, workstations, or any other processing device or equipment, and so forth.

Fig. 2 shows a schematic structural diagram of a screen projection implementation system provided in the present application in a practical application, where a screen projection end 101 may be a client installed in a personal terminal, such as a personal computer, and a receiving end 102 may refer to a client installed in a personal terminal, such as a mobile phone, a tablet computer, and the like, and of course, may also refer to a client installed in an intelligent display terminal deployed in a fixed location, such as an intelligent television, and is not exhaustive in fig. 2. The server 103 may be a cloud server or the like.

In an optional implementation manner, for a first receiving end configured in a first terminal, the first terminal is generally a public device, so that the requirement on security is reduced, and convenience of screen projection is provided; the server sending the screen projection notification to the at least one receiving end may include:

for a second receiving end of the at least one receiving end, sending a screen projection notification to the second receiving end;

for a first receiver of the at least one receiver, the screen shot content may be directly forwarded to the first receiver.

Network connections, such as websocket connections and the like, can be established between the screen projection end and the server end and between the receiving end and the server end.

The receiving end responds to the receiving confirmation operation and can start a websocket channel with the service end, and therefore the screen projection content can be transmitted to the receiving end by the service end based on the websocket channel.

The screen projection content may refer to display content in a display screen of a personal terminal where the screen projection end is located, for example, the screen projection content may include an operation process of an Office document, an editing process of an image, an operation process of any application program of the personal terminal, and the like, which are demonstrated on the personal terminal by a user. The screen projection end can record the display screen of the personal terminal, namely continuously intercept the display screen in a certain screen capturing period, and encode the display screen into video data which is then used as screen projection content. The screen capture period may be in milliseconds.

In some embodiments, the generating of the screen-shot content may include:

and recording the display screen of the terminal where the screen projection end is located to obtain screen projection content.

The content captured in different screen capturing periods can be encoded and compressed in video encoding formats such as H264 (a video compression format) or H265 (a video compression format), and the compressed video data can be used as screen projection content.

It is known that the screen-shot content is continuously updated.

After the receiving end obtains the screen projection content, rendering display can be carried out, and the purpose of sharing the screen projection content between the screen projection end and at least one receiving end is achieved.

The screen projection end may send the screen projection content to the server end by using a User Data Protocol (UDP), and the screen projection content may be formed by packaging compressed video data in a UDP format.

In order to improve transmission security, the screen projection end can encrypt screen projection content and then send the encrypted screen projection content to the server end. For example, it may be encrypted using the srtp (Secure Real-time Transport Protocol) algorithm.

The server side can decrypt the screen projection contents, encrypt the screen projection contents based on different receiving ends respectively, and then forward the encrypted screen projection contents to at least one receiving end respectively. The encryption modes of different receiving ends can be different, so as to further ensure safety and the like.

Optionally, the receiving end may decrypt the screen-projected content, repackage the decrypted UDP data into h264 or h265 video data, decode the video data with the corresponding decoder, and perform rendering display, thereby completing the purpose of video-projecting multiple screens.

The screen projection end can respond to the screen projection triggering operation and send a screen projection request to the server end.

In some embodiments, the screen projection end is further configured to obtain at least one receiving end identifier provided by a user of the screen projection end, and generate the screen projection request based on the at least one receiving end identifier; that is, the screen-casting request includes at least one receiving end identifier.

The server side determines at least one corresponding receiving terminal specifically based on at least one receiving terminal identification in the screen projection request.

In one possible implementation manner, the server is further configured to send a first screen projection prompt message to the screen projection end;

the screen projection end can also provide a first screen projection interface; displaying first screen projection prompt information in the first screen projection interface; the first screen projection prompt message is used for prompting a user to provide at least one receiving end identification.

Wherein, the first screen projection prompt message may include an identifier input control, and the acquiring at least one receiving end identifier provided by the screen projection end user may include: and acquiring at least one receiving end identification input in the identification input control by the user.

In addition, the first screen projection prompt message may further include an identifier selection control, and a receiving end identifier list may be displayed in the first screen projection interface in response to a trigger operation for the identifier selection control;

the acquiring, by the screen projection end, at least one receiving end identifier provided by the screen projection end user may include: and acquiring at least one receiving end identification selected by the user in the receiving end identification list.

In addition, the first screen projection prompt message may further include an identification selection list of one or more receiving terminal identifications matched with the screen projection terminal user; the obtaining of at least one receiver id provided by the user may include: and acquiring at least one receiving end identification selected by the user in the identification list.

The receiving end identification selected by the user from the receiving end identification list or the identification selection list can be displayed in the identification input control so as to be convenient for the user to check. Of course, for the receiving end identifier displayed in the identifier input control, the user may also modify, delete, or add the receiving end identifier.

The first screen-projecting display interface may further display a screen-projecting trigger control, where the screen-projecting trigger operation may be triggered by the user with respect to the screen-projecting trigger control, and may refer to, for example, a click operation with respect to the screen-projecting trigger control.

In some embodiments, the receiving end is further configured to output a receiving end screen projection code; and the screen projection code of the receiving end is used as the identification of the receiving end to inform a screen projection end user, and the screen projection end user inputs the screen projection code into the screen projection end.

The receiving end screen projection code refers to a preset identification for uniquely marking the receiving end and the like.

Optionally, the receiving end specifically provides a second screen projection interface, and the receiving end projects a screen code in the second screen projection interface.

The receiving end may render and display the screen-projected content in the second screen-projected interface after obtaining the screen-projected content.

Optionally, the method may further include:

displaying a screen projection code on the second screen projection interface to obtain prompt information;

the displaying of the receiving end screen projection code in the second screen projection interface includes:

and responding to the trigger operation of acquiring the prompt information aiming at the screen projection code, and displaying the screen projection code of the receiving end.

The screen-projecting code acquisition prompt message is used for prompting a user to acquire a receiving end screen-projecting code of the local computer.

Optionally, the receiving-end screen projection code may be acquired from the server and displayed in the second screen projection interface.

As described above, the receiving end may include a first receiving end or a second receiving end;

the receiving end identifier of the first receiving end can comprise a place name or a screen projection code of the first receiving end; for example, when the first terminal is a smart television or the like deployed at a meeting location, the location name is also referred to as the meeting location name.

The receiving end identification of the second receiving end comprises a user identification or a screen projection code of the second receiving end. The user identifier may refer to a user account, or a user name or an address book name bound to the user account, and when the second receiving end is a client having social attributes, the user identifier may also refer to a nickname of a friend having a friend relationship with the screen-casting end user, and the like.

The first receiving end screen projection code and the second receiving end screen projection code can be pre-configured to uniquely mark different first receiving ends or different second receiving ends and the like.

Of course, the place name and the screen-projecting code of the first receiving terminal and other information capable of identifying the first receiving terminal can establish a binding relationship, and the user identifier and the screen-projecting code of the second receiving terminal and other information capable of identifying the second receiving terminal can establish a binding relationship, so that a user of the screen-projecting terminal can input any form of receiving terminal identifier, and can determine the corresponding receiving terminal.

In some embodiments, the screen projection end is further configured to display a second screen projection prompt message in the first screen projection interface; the second screen projection prompt message is used for prompting a screen projection user to provide a single receiving end identification; acquiring any receiving end identification provided by a user, and determining a receiving end corresponding to any receiving end identification of the same local area network as the screen projection end in response to the screen projection triggering operation aiming at any receiving end identification; establishing a point-to-point connection channel with the receiving end; and sending the screen projection content to the receiving end through the point-to-point connecting channel.

The screen projection end can also realize the purpose of projecting the screen of the receiving end positioned in the same local area network content, and for the receiving end positioned in the same local area network, a point-to-point connecting channel with the target receiving end can be established only by providing a receiving end mark; therefore, the screen projection content can be sent to the receiving end through the point-to-point connecting channel, and the screen projection efficiency of the receiving ends positioned in the same local area network is ensured.

For a different-place receiving end which is not in the same local area network as the screen projection end, the screen projection can be performed according to the method in the above embodiment.

And in the screen projecting process of the screen projecting end, a screen projecting end user can add or delete a receiving end and the like.

Therefore, in some embodiments, the screen projection end is further configured to send a screen projection termination request for any one of the at least one receiving end to the server end;

the server is further used for responding to the screen projection termination request and terminating the screen projection content to be forwarded to any receiving end.

Optionally, the screen-casting termination request may include a receiver identifier of any one of the receivers, so that the server determines the corresponding receiver.

The screen projection end may send a screen projection termination request for any one of the at least one receiving end to the server end in response to a screen projection termination operation of a user of the screen projection end for the any one of the at least one receiving end.

In the screen projection process, the screen projection end can also display cancellation prompt messages corresponding to the at least one receiving end in the first screen projection interface, and the cancellation operation for any receiving end can be a trigger operation for the cancellation prompt messages of any receiving end.

In some embodiments, the screen-throwing end is further configured to send a screen-throwing addition request for at least one additional receiving end to the server end;

and the server is also used for responding to the screen-throwing newly-increased request and forwarding the screen-throwing content to the at least one newly-increased receiving end mark.

The new screen-casting request may include a receiving end identifier of at least one new receiving end provided by the user, so that the server end can determine the at least one new receiving end conveniently.

The screen projection end can also display newly added prompt information in the first screen projection interface, and is used for prompting a user to provide at least one receiving end mark so as to add at least one receiving end into the screen projection and the like.

The newly added prompt message may include a corresponding identifier input control or an identifier selection control, etc. for the user to input or select at least one receiving end identifier.

In addition, since the receiving end may be in a certain working state, for example, receiving screen projection or performing audio-video communication, in some embodiments, the server end is further configured to detect whether the at least one receiving end is in a target working state; for the receiving end in the target working state, sending preemption prompt information to a screen projection end;

the server respectively forwarding the screen projection contents to the at least one receiving end comprises the following steps: detecting a preemption confirmation request of the screen projection end aiming at any receiving end, and forwarding the screen projection content to the receiving end; and detecting a preemption refusing request of the screen projection end aiming at any receiving end, and canceling the forwarding of the screen projection content to the receiving end.

The screen projection end is further used for outputting the preemption prompt information, responding to a preemption confirmation operation, sending the preemption confirmation request to the server end, responding to a preemption cancellation operation, and sending the preemption cancellation request to the server end.

The target operating state may refer to receiving a screen shot or performing audio-video communication.

After the server side responds to the screen projection request and determines at least one receiving terminal, whether the at least one receiving terminal is in a target working state or not can be detected firstly, for the receiving terminal which is not in the target working state, screen projection content can be forwarded to the receiving terminal, and for the receiving terminal which is in the target working state, the screen projection terminal can be notified firstly. The preemption prompting information output by the screen projection end can be used for prompting whether a user of the screen projection end continuously performs screen projection operation on a receiving end in a target working state or not. The preemption prompting information may include a preemption confirmation control and a preemption cancellation control, and the preemption confirmation control may initiate a preemption confirmation operation, and the preemption cancellation control may initiate a preemption cancellation operation, etc.

In some embodiments, in order to improve the transmission performance, as shown in fig. 3, the difference from that shown in fig. 1 is that the server may include a first server 201 and a second server 202;

specifically, the screen projection terminal 101 sends a screen projection request to the first server 201;

the first server 201 is configured to determine at least one receiving end 102 based on the screen-casting request, and send a screen-casting notification to the at least one receiving end 102 respectively;

the receiving end 102 is further configured to establish a connection channel with the second server in response to the confirmation receiving operation;

the screen projection end 101 is specifically configured to send screen projection content to the second server;

the second server 102 is configured to forward the screen shot content to the receiving end.

Namely, the second server is responsible for receiving and forwarding the screen projection content. The first server is responsible for carrying out negotiation with the screen projection end and the receiving end.

In some embodiments, the server may further include a third server;

the first server sends a first screen projection notification to the at least one receiving end through the third server;

the receiving end sends a confirmation request to the third server in response to the confirmation receiving operation; in response to a rejection to receive operation, sending a rejection request to the third server;

the third server is used for receiving the confirmation request fed back by the receiving end and sending a screen projection confirmation instruction to the second server; receiving a rejection request fed back by the receiving end, and sending a screen projection termination instruction to the second server;

the second server is specifically configured to forward the screen projection content to a receiving end having a screen projection confirmation indication.

And the receiving end can establish connection with the server end when in need, so that the first server can firstly send the screen-throwing notice to the third server aiming at the receiving end, and the third server firstly establishes network connection with the receiving end and then sends the first screen-throwing notice to the receiving end.

As can be seen from the above description, the receiving end may accept screen projection or refuse screen projection, and therefore, in some embodiments, the server is further configured to detect a receiving state of the at least one receiving end with respect to the screen projection content, and send a receiving state prompt message of the at least one receiving end to the screen projection end;

the screen projection end is further used for displaying receiving state prompt information of the at least one receiving end on the first screen projection interface respectively.

The receiving status may include, for example, waiting for screen projection, refusing to project screen, projecting screen or not projecting screen, etc., so as to facilitate which receiving terminals of the screen projection end user are sharing the projected screen content, etc. The screen projection waiting state can be a state within a second preset time after the screen projection notification is sent to the receiving end; the screen non-projection state may be a state in which the confirmation request is not received or the request is rejected after a second predetermined time elapses after the screen projection notification is sent to the receiving end; the rejection of the screen-casting may be a state in which a rejection request is received within a second predetermined time after the reception end transmits the screen-casting notification. The screen projection may refer to a state of receiving a confirmation request from the receiving end, forwarding the screen projection content to the receiving end, and the like.

And for the receiving end which rejects screen projection or does not receive the screen projection, based on the request of the user at the screen projection end, the screen projection request and the like for the receiving end can be sent to the server end again.

Under the condition that the screen projection end and the receiving end are in different places, a screen projection end user and a receiving end user can have voice communication requirements, so that as an optional mode, the screen projection end is also used for acquiring first audio data played by equipment where the screen projection end is located and/or second audio data acquired by the screen projection end; respectively sending the first audio data and/or the second audio data to the server;

the server is further configured to forward the first audio data and/or the second audio data to the at least one receiving end respectively;

the receiving end is further configured to play the first audio data and/or the second audio data.

The first audio data is also data played by the speaker, and the second audio data is also data collected by the microphone.

Optionally, when the service end includes a first server, a second server, and a third server, the screen projection end may specifically send the first audio data and/or the second audio data to the third server, and the third server forwards the first audio data and/or the second audio data to the at least one receiving end.

Therefore, the screen projection end user can share screen projection content, and can also transmit voice data to the receiving end user, so that the voice communication requirement is met.

In addition, in order to realize mutual communication, as another optional mode, the screen projection end is further used for sending a communication request to the server end;

the server is further used for determining at least one target receiving end in the at least one receiving end; establishing a communication channel between a first communication terminal corresponding to the first communication number and a second communication terminal corresponding to at least one second communication code on the basis of a first communication number corresponding to the screen projection end and a second communication number corresponding to the at least one target receiving end; the communication channel is used for voice communication between a screen projection end user and a target receiving end user. Optionally, the call channel may be specifically a multi-party call channel.

Therefore, the screen projection implementation system can further comprise a first communication terminal and a second communication terminal, the first communication terminal corresponds to the screen projection end, and the second communication terminal can comprise a plurality of receiving ends respectively corresponding to the receiving ends. The service end may establish a communication channel through a Public Switched Telephone Network (PSTN) system based on the first communication number corresponding to the screen projecting end and the second communication number corresponding to the at least one destination receiving end. The PSTN system may respectively initiate a call request to a first communication terminal corresponding to the first communication number and a second communication terminal corresponding to at least one second communication number, and a communication channel may be established between the communication terminals that are successfully connected.

Therefore, the PSTN system can be also included in the screen projection implementation system.

The communication number may specifically refer to a telephone number, such as a landline number or a mobile phone number.

When the receiving end is a first receiving end installed in the first terminal, since the first terminal is fixedly deployed in a fixed location, the communication number may be a fixed-line number in the fixed location, such as a fixed-line number in a conference room, and when the receiving end is a second receiving end installed in a personal terminal, the communication number may refer to a personal communication number, such as a mobile phone number, and when the personal terminal is a mobile communication terminal, the communication number may also refer to a communication number of the personal terminal.

In the embodiment, the screen projection content can be realized through the receiving end, and the voice communication can be realized through the communication channel, so that the voice communication requirement is met. And the voice communication is carried out through the communication channel, so that the network flow cannot be occupied, the transmitted tone quality is better, and the voice communication quality can be improved.

Optionally, the sending of the communication request to the server by the screen projection end may be obtaining at least one target receiving end identifier selected by the screen projection end user from the at least one receiving end identifier; sending a communication request to a server based on the at least one target receiving end identifier;

the server may determine at least one target receiving end corresponding to the at least one target receiving end identifier in response to the communication request sent by the screen projection end.

The screen projection end can display a first screen projection interface, and can also display communication prompt information in the first screen projection interface; the communication prompt information is used for prompting the screen projection end user to select at least one target receiving end identification from at least one receiving end identification provided by the screen projection end user.

The first communication number corresponding to the screen projection end identifier and the second communication number corresponding to different receiving end identifiers can be configured in advance. The establishing, by the server side, a communication channel between the first communication terminal corresponding to the first communication number and the second communication terminal corresponding to the at least one second communication number based on the first communication number corresponding to the screen projection end and the second communication number corresponding to the at least one target receiving end, may be: searching a first communication number corresponding to the screen projection end identification and a second communication number corresponding to the at least one target receiving end identification respectively; and establishing a communication channel between the first communication terminal corresponding to the first communication number and the second communication terminal corresponding to the at least one second communication code based on the first communication number and the at least one second communication code.

In some embodiments, the screen-casting request and the communication request can be synchronously sent to the server.

The screen projection end can display a synchronous trigger control on the first screen projection interface;

the sending of the communication request to the server by the screen projection terminal may specifically be sending the communication request to the server while sending the screen projection request to the server based on the selection operation for the synchronous trigger control.

After receiving the communication request, the server initiates a call request to a first communication terminal corresponding to the first communication number and a second communication terminal corresponding to at least one second communication number sub-packet. After receiving the response requests of the first communication terminal and the second communication terminal, the server may establish a communication channel between the first communication terminal and the second communication terminal corresponding to the first communication number and the at least one second communication number respectively.

In some embodiments, the server respectively forwarding the screen-shot content to the at least one receiving end may include: and responding to a response request of any second communication terminal, establishing the communication channel, and forwarding the screen projection content to a receiving end corresponding to any second communication terminal.

When the second communication terminal and the receiving terminal are the same device, the purposes of answering the call and receiving screen projection by one key can be realized.

In addition, the server can also detect the communication state of the communication number corresponding to the at least one target receiving end, and feed back the communication state prompt information of the communication number corresponding to the at least one target receiving end to the screen projection end.

The communication status may include, for example, waiting to answer, talking, rejecting to answer, not answering, etc. Waiting for answering can mean that the PSTN is in a state within first preset time after sending a call request to a communication terminal corresponding to a communication number, not answering can mean that the PSTN does not receive an agreement request or a rejection request after first preset time after sending the call request to the communication terminal corresponding to the communication number, and talking can mean that a user agrees to the call request within first preset time after the PSTN sends the call request to the communication terminal corresponding to the communication number, namely receives the agreement request of the communication terminal, so that the communication terminal is added into a talking channel; the rejecting answering may be that the user rejects the call request within a first predetermined time after the PSTN sends the call request to the pass terminal corresponding to the communication number, that is, receives a rejection request of the communication terminal.

It should be noted that the first and second communication numbers in the first and second communication codes are only for distinguishing the communication numbers corresponding to the screen projection end and the receiving end, respectively, and the first and second communication terminals are only for distinguishing the first communication terminal corresponding to the first communication number and the second communication terminal corresponding to the second communication code, and do not indicate other meanings such as progressive and causal meanings.

The screen projection end can display the communication state prompt information of the at least one target receiving end on the first screen projection interface.

For the receiving end corresponding to the communication number which is not answered or refuses to answer, based on the user request, a call request can be initiated to the communication number corresponding to the receiving end again.

In addition, in some embodiments, the screen projection end is further configured to send a communication cancellation request to the server end in response to a communication cancellation operation of a screen projection end user for any receiving end;

the server is further configured to respond to the communication cancellation request, and disconnect a second communication terminal corresponding to a second communication code from the communication channel based on the second communication code corresponding to any one of the receiving ends.

The first screen projection interface can also display communication cancellation prompt information and the like corresponding to each receiving end, and communication cancellation operation can be triggered aiming at the communication cancellation prompt information.

In some embodiments, the screen projection end is further configured to send a new communication request to the server end in response to a new communication operation sent by a screen projection end user for any one of the at least one receiving end;

and the server is also used for responding to the newly added communication request, and adding a second communication terminal corresponding to the second communication code into the communication channel based on the second communication code corresponding to any receiving end.

In addition, the access request to the call channel may be actively requested based on the communication number, and therefore, in some embodiments, the server may further receive an access request initiated by the communication number corresponding to any one of the at least one receiving end; and adding the communication terminal corresponding to the second communication code into the communication channel based on the second communication code corresponding to any receiving end.

The server can also judge whether the server is positioned in the at least one receiving end or not based on the receiving end identification of any receiving end, so that only the receiving end initiating the screen projection request is allowed to access the communication channel corresponding to the second communication terminal.

In some embodiments, the screen-casting terminal is further configured to send a screen-casting reservation request to the server terminal; the screen-casting reservation request comprises at least one receiving end identification;

the server is further used for sending screen-casting reservation notifications to the receiving ends corresponding to the at least one receiving end identification respectively based on the screen-casting reservation requests;

and the receiving end is also used for responding to the screen-throwing appointment notice and outputting screen-throwing appointment prompt information.

Wherein, the screen-casting appointment prompting information can be output in the forms of content and/or sound, etc.

In a conference scene, the screen-casting reservation request may include, for example, contents such as a conference start time, a conference end time, and a conference theme, and the screen-casting reservation prompting information may prompt a receiving-end user to accept screen casting at an appointed time, so as to implement screen-casting content sharing.

In some embodiments, the server is further configured to receive a session request sent by a screen projection end, and establish a session connection between the screen projection end and the at least one receiving end; sending third screen projection prompt information to the screen projection end; wherein, the session request may include at least one receiving end identifier; therefore, the at least one receiving end identifier may refer to a communication identifier, such as an instant messaging identifier, and the session connection may refer to an instant messaging connection, and may be one or more of audio, video, and text session modes;

the screen projection end is also used for displaying the third screen projection prompt message in a session interface; the screen projection request is sent by the screen projection end in response to the screen projection triggering operation aiming at the third screen projection prompt message.

The third screen projection prompt message may further include a screen projection control, and the screen projection request may be triggered by triggering the screen projection control.

In practical application, users may communicate with each other by establishing a session connection, for example, a network conference is realized by establishing a multi-party session connection, and the screen-casting request may be initiated in a session scene by the technical solution of the present application.

In some embodiments, the server is further configured to receive a first session message sent by a screen projection end, and forward the first session message to a receiving end corresponding to the at least one receiving end identifier respectively;

the receiving end is also used for displaying the first session message;

in addition, the server is also used for receiving a second session message sent by any receiving end and respectively sending the second session message to the rest receiving ends and the screen projection end;

the screen projection end is also used for displaying the second conversation message;

the receiving end is further configured to display the second session message.

The receiving end may also provide a conversation interface, and the first conversation message or the second conversation message may be displayed in the conversation interface, or may be displayed in the screen-shot content, for example, the first conversation message or the second conversation message may be displayed in the screen-shot content in a pop-up form.

In some embodiments, since the screen projection end can provide the first screen projection interface, in some embodiments, the server end is further configured to send the first session prompt message to the screen projection end;

the screen projection end is also used for displaying the first conversation prompt information on the first screen projection interface, receiving a third conversation message input by a screen projection end user, and sending the third conversation message to the server end;

the server is further configured to forward the third session message to the receiving ends corresponding to the at least one receiving end identifier respectively;

the receiving end is used for displaying the third conversation message in the screen projection content.

A dialog input box or the like may be included in the first session prompt message to receive a third session message input by the user.

Wherein the third conversation message may be displayed in a bullet screen form or in a specific area in the screen-cast content.

In addition, the server is further configured to send second session prompt messages to at least one receiving end corresponding to the at least one receiving end identifier respectively; receiving a fourth session message sent by any receiving terminal, and respectively forwarding the fourth session message to the screen projection terminal and the rest receiving terminals;

the screen projection end is also used for displaying the fourth conversation message;

the receiving end is also used for displaying the second conversation prompt message, receiving a fourth conversation message input by a receiving end user and sending the fourth conversation message to the server end; and displaying the fourth session message of any receiving end sent by the server.

Wherein, the second conversation prompting message may include a dialog input box or the like to receive a fourth conversation message input by the user.

Through the session message, the purpose of user communication or comment can be achieved in the screen projection process, and user experience is improved.

In some embodiments, the server is further configured to generate a screen-projection acquisition identifier in response to the screen-projection request; sending the screen projection acquisition identifier to the screen projection end;

the screen projection end is also used for outputting the screen projection acquisition identifier; the screen-projecting acquisition mark is used for informing a receiving end user;

the receiving end is also used for sending an acquisition request to the server end based on the screen-throwing acquisition identifier input by the receiving end user;

the server respectively forwards the screen-shot contents to the at least one receiving terminal, specifically, forwards the screen-shot contents to the receiving terminal providing the screen-shot acquisition identifier.

The screen-projecting end outputs a screen-projecting obtaining mark, a user at the screen-projecting end can inform a receiving end user of the screen-projecting end, the screen-projecting obtaining mark can be used as a screen-projecting password, and screen-projecting contents can be displayed only by the receiving end which provides the screen-projecting password, so that the screen-projecting safety is improved.

In some embodiments, as can be seen from the above description, the screen-casting terminal may request to cast a single screen, cast multiple screens, and cast the screens to initiate a communication request at the same time, because multiple screen-casting modes may be preset, and different screen-casting modes correspond to different screen-casting permissions.

For example, the screen projection mode may include a single screen mode, and the screen projection authority of the screen projection end may be that only a single screen is allowed to be projected;

the screen projection mode can comprise a multi-screen mode, and the screen projection permission of the screen projection end can be to allow single screen projection and multi-screen projection;

the screen projection mode can comprise a communication mode, and the screen projection authority of the screen projection end can be a screen projection request and can simultaneously initiate a communication request.

These screen projection modes can be used as commodities for users to choose and purchase.

Therefore, in some embodiments, the server is further configured to send transaction prompt information of a plurality of screen projection modes to the screen projection terminal; different screen projection modes correspond to different screen projection authorities; receiving a transaction request of the screen projection end aiming at a target screen projection mode, and determining a target screen projection authority corresponding to the screen projection end;

the screen projection end is also used for displaying transaction prompt information of the screen projection modes and sending the transaction request to the server end based on the screen projection mode of the template selected by the screen projection end user;

after receiving a screen throwing request sent by a screen throwing end, the server is also used for detecting whether the screen throwing request meets the target screen throwing permission; if so, sending a screen projection instruction to the screen projection end;

and the screen projection end particularly responds to the screen projection instruction to generate screen projection content.

As shown in fig. 4, which shows an interaction diagram of screen projection implementation in an actual application, after the screen projection end 41 sends a screen projection request to the server end 42, the server end 42 may send a screen projection notification to the receiving end 43, and the receiving end 43 outputs a receiving prompt message to prompt a user whether to accept screen projection.

The receiving end 43 may send an acknowledgement request to the service end 42 in response to the acknowledgement operation of the user.

The server 42 may only need to detect that there is a confirmation request from any receiving end, and may feed back a confirmation instruction to the screen projection end 41;

therefore, after the screen projection terminal 41 responds to the confirmation instruction and can send the screen projection content to the server 42, if the server 42 detects that there is a confirmation request, the screen projection content is forwarded to the receiving terminal 43.

In a practical application, the technical scheme of the embodiment of the application can be applied to a conference scene. In practical application, users who are located between different meeting places hold meetings and need to share data such as files, but the screen projection implementation mode in the prior art cannot achieve screen projection in different places, and in addition, under the condition that a meeting room is very large, when the content is projected into meeting terminals such as a smart television in the meeting room according to the prior art, the users sitting at the rear cannot see clearly, so meeting requirements cannot be met.

According to the technical scheme of the embodiment of the application, the purpose of screen projection at least one receiving end can be achieved, screen projection at different places can be achieved, the screen projection end and the receiving end are not limited to be in the same local area network, and various screen projection requirements are met.

As shown in fig. 5a, a screen projection implementation diagram in a conference scenario is shown, and fig. 4 includes 4 conference sites: a point a, a point B, a point C, and a point D; where a point a is a conference room in which a conference terminal 51 is disposed, a point B is a conference room, and a point B is also disposed a conference terminal 52. The user at location C corresponds to a personal terminal 53, such as a cell phone, and the user at location D corresponds to a personal terminal 54, such as a laptop computer.

The screen projection end 55 of the user at the location a and the conference terminal 51 are in the same local area network, and a point-to-point connection channel can be established with the conference terminal 51, so that the screen projection content is projected to the conference terminal 51.

The screen projection terminal 55 can establish remote connection channels with the conference terminal 52, the personal terminal 53 and the personal terminal 54 through the service terminal 56, wherein for a user at the site a far away from the conference terminal 51, a remote connection can also be established with the corresponding personal terminal 57. After the screen projection end 55 sends a screen projection request to the server 56, the server 56 may send a screen projection notification to each receiving end. The screen-casting terminal 55 sends the screen-casting content to the server terminal 56, and the server terminal 56 can forward the screen-casting content to the conference terminal 52, the personal terminal 53, the personal terminal 54 and the personal terminal 57 which have confirmation requests, so as to achieve the purpose of screen-casting in different places.

In addition, under the condition of off-site screen projection, a voice communication requirement may also exist between a screen projection end user and a receiving end user, the screen projection end user may select a target receiving end with the voice communication requirement, and send a call request to the server 56 through the screen projection end 55, where the call request and the screen projection request may be sent simultaneously, as shown in fig. 5b, the server 56 may establish a call channel between a first communication terminal corresponding to a first telephone number and a second communication terminal corresponding to at least one second telephone number through the PSTN system 58 based on the first telephone number corresponding to the screen projection end and the second telephone number corresponding to the receiving end. The PSTN system may initiate a call request with the first communication terminal and the at least one second communication terminal, respectively. The first communication terminal and the second communication terminal may refer to, for example, a fixed communication terminal such as a landline telephone, or a mobile communication terminal such as a mobile phone. As shown in fig. 5b, the first communication terminal may refer to a base station 501 of a conference room where the screen projection terminal 51 is located, the second communication terminal may include a base station 502 of a conference room where the conference terminal 52 is located, a personal terminal 53, a mobile communication terminal 503 of a user corresponding to the personal terminal 54, and the like.

Fig. 6a shows a display schematic diagram of a first screen-projecting interface at a screen-projecting end in an actual application, it can be known that the first screen-projecting interface may include a first screen-projecting switching control 61 and a second screen-projecting switching control 62, and for a trigger operation of the first screen-projecting switching control 61, first screen-projecting prompt information 63 may be displayed in the first screen-projecting interface, for example, the first screen-projecting prompt information 63 may include an identifier input control, and may further include one or more receiving-end identifiers matched with a user, so that the user may quickly select the receiving-end identifiers from the first screen-projecting interface. The one or more receiving end identifications can be recommended in combination with historical usage records of the screen-casting end user, an organization where the screen-casting end user is located, and the like.

A screen-casting trigger control 64 may also be displayed in the first screen-casting interface, for example, a screen-casting terminal may be triggered to initiate a screen-casting request to the server terminal according to a click operation of the screen-casting trigger control.

As shown in fig. 6b, the difference from fig. 6a is that a call synchronization control 65 may be further displayed in the first screen-projecting interface, and for the selection operation of the call synchronization control 65, after the screen-projecting end detects the screen-projecting trigger operation, a communication request for the communication number corresponding to the at least one receiving end identifier may be sent to the server end at the same time.

Of course, the call synchronization control may also be used for the user to select at least one target receiving end identifier from the provided at least one receiving end identifier, so that the communication request may only be addressed to the at least one target receiving end identifier.

Fig. 6c is a schematic display diagram of a first screen-projection interface after a screen-projection request is initiated, in which the at least one receiving-end identifier and receiving-state prompt information corresponding to each receiving-end identifier may be displayed, and as can be seen in fig. 6c, the receiving-state prompt information may include: screen-in, waiting to screen, refusing to screen, and not screen, etc. Different receiving end marks can be grouped to display the lamps according to different receiving states.

In addition, because the communication request can be initiated at the same time, communication state prompt information and the like of the communication numbers corresponding to different receiving end identifications can be displayed in the first screen projection interface. The communication status prompt message may include, for example, waiting to answer, on-going, refusing to answer, not answering, etc.

In addition, a screen projection termination control for each receiving terminal identification can be displayed in the first screen projection interface, so that a screen projection termination request can be sent to the server by triggering the screen projection termination control, the server does not forward screen projection content to the corresponding receiving terminal any more, a communication cancellation control corresponding to each receiving terminal identification can be displayed, a communication cancellation request can be sent to the server by triggering the communication cancellation control, and the communication number corresponding to the corresponding receiving terminal is disconnected from the call channel by the server.

For the receiving end identification which does not cast the screen or refuses to cast the screen, a re-casting control can be displayed on the first screen casting interface so as to request to cast the screen from the corresponding receiving end again.

And for the communication number which is not answered or refused to answer, corresponding to the receiving end identification, displaying a re-communication control on the first screen projection interface so as to initiate a call request to the communication terminal corresponding to the corresponding communication number again, and the like.

The technical solution of the embodiment of the present application is described in detail below from the perspective of executing the methods at the screen projection end, the server end, and the receiving end, respectively.

Fig. 7 is a flowchart of an embodiment of a screen projection implementation method provided in an embodiment of the present application, where the method is executed by a receiving end, and may include the following steps:

701: acquiring a screen-casting notification sent by a server; the screen-casting notification is sent by the server side in response to a screen-casting request of the screen-casting side;

702: outputting and receiving prompt information;

703: and responding to the receiving confirmation operation, and sending a confirmation request to the server, so that the server responds to the confirmation request and sends the screen projection content of the screen projection end to the receiving end.

704: and acquiring the screen projection content sent by the server, and rendering and displaying the screen projection content.

In certain embodiments, further comprising:

and responding to the rejection receiving operation, and sending a rejection request to the server so that the server cancels the screen projection content to be forwarded to the receiving end.

In some embodiments, the received alert information includes content alert information and at least one of vibration alert information and ring alert information.

In some embodiments, before the obtaining of the screen-projection notification sent by the server, the method further includes:

outputting a screen projection code of a receiving end; the receiving terminal screen-throwing code is used for informing a screen-throwing end user, the screen-throwing end is used for acquiring the receiving terminal screen-throwing code provided by the screen-throwing end user and informing the server, and the server sends screen-throwing content on the basis of the receiving terminal screen-throwing code.

In some embodiments, the outputting the receive-end screen projection code comprises:

providing a second screen projection interface;

and displaying a screen projection code of a receiving end in the second screen projection interface.

In some embodiments, the rendering the display of the screen-shot content comprises:

rendering and displaying the screen-projected content in the second screen-projection interface.

It should be noted that, in the screen projection implementation method shown in fig. 7, the relevant execution operation of the receiving end has been described in detail in the relevant embodiment of the screen projection implementation system, and will not be described in detail here.

Fig. 8 is a flowchart of another embodiment of a screen projection implementation method provided in an embodiment of the present application, where the method is executed by a server and may include the following steps:

801: and receiving a screen projection request sent by a screen projection end, and determining at least one receiving end.

802: and sending a screen projection notification to the at least one receiving end so that the at least one receiving end can output and receive prompt information.

803: and acquiring screen projection contents generated by the screen projection end.

804: and responding to a confirmation request sent by any receiving terminal, and forwarding the screen projection content to the receiving terminal.

In certain embodiments, further comprising:

responding to a confirmation request sent by any receiving end, and sending a confirmation instruction to the screen projection end; and the screen projection end responds to the confirmation instruction and sends the generated screen projection content to the server end.

In some embodiments, the screen-casting request includes at least one receiving end identifier provided by a screen-casting end user;

the determining at least one receiving end comprises:

and determining the receiving ends corresponding to the at least one receiving end identification respectively.

In certain embodiments, further comprising:

sending first screen projection prompt information to the screen projection end so that the screen projection end can display the first screen projection prompt information; the first screen projection prompt message is used for prompting a user to provide at least one receiving end identification.

In certain embodiments, further comprising:

sending second screen projection prompt information to the screen projection end, wherein the second screen projection prompt information is used for prompting a screen projection user to provide a single receiving end identification so that the screen projection end can acquire any receiving end identification provided by the user, and determining a receiving end corresponding to the receiving identification of the same local area network as the screen projection end in response to screen projection trigger operation aiming at the receiving end identification; establishing a point-to-point connection channel with the receiving end; and sending the screen projection content to the receiving end through the point-to-point connecting channel.

In certain embodiments, further comprising:

receiving a screen projection termination request sent by a screen projection end aiming at any receiving end;

and stopping forwarding the screen projection content to the receiving end.

In certain embodiments, further comprising:

receiving a screen-casting newly-increased request sent by a screen-casting end, and determining at least one newly-increased receiving end;

and forwarding the screen projection content to the at least one newly added receiving end.

In certain embodiments, further comprising:

responding to the screen projection request, and detecting whether the at least one receiving end is in a target working state;

sending preemption prompt information to a screen projection end for any receiving end in the target working state;

the forwarding the screen-shot content to the at least one receiving end respectively comprises:

if detecting that the screen projection end aims at a preemption confirmation request sent by any receiving end, forwarding the screen projection content to the receiving end;

and if detecting that the screen projection end performs the preemption refusing request aiming at any receiving end, cancelling the screen projection content from being forwarded to the receiving end.

In certain embodiments, further comprising:

acquiring first audio data and/or second audio data sent by the screen projection end; the first audio data is audio data played by the screen projection end, and the second audio data is audio data collected by the screen projection end;

and forwarding the first audio data and/or the second audio data to the at least one receiving end respectively.

In certain embodiments, further comprising:

receiving a communication request sent by the screen projection end, and determining at least one target receiving end in the at least one receiving end;

establishing a communication channel between a first communication terminal corresponding to the first communication number and a second communication terminal corresponding to at least one second communication code on the basis of a first communication number corresponding to the screen projection end and second communication codes respectively corresponding to the at least one target receiving end; the communication channel is used for voice communication between a screen projection end user and a target receiving end user.

It should be noted that, in the screen projection implementation method shown in fig. 8, the relevant execution operation of the receiving end has been described in detail in the relevant embodiment of the screen projection implementation system, and will not be described in detail here.

Fig. 9 is a flowchart of another embodiment of a method for implementing screen projection provided by an embodiment of the present application, where the method is executed by a screen projection terminal and may include the following steps:

901: sending a screen projection request to a server side, so that the server side can determine at least one receiving terminal and send a screen projection notification to the at least one receiving terminal;

902: and generating screen projection content.

903: and sending the screen projection content to the server side so that the server side can forward the screen projection content to a receiving end corresponding to the received confirmation request.

In some embodiments, the sending the screen-shot content to the server includes:

receiving a confirmation instruction sent by the server, and sending the screen projection content to the server; the acknowledgement instruction is sent by the server side in response to an acknowledgement request of any receiving side.

In certain embodiments, further comprising:

acquiring at least one receiving end identification provided by a screen projection end user; wherein, the screen-casting request comprises the at least one receiving end identification.

In certain embodiments, further comprising:

providing a first screen projection interface;

displaying first screen projection prompt information in the first screen projection interface; the first screen projection prompt message is used for prompting a user to provide at least one receiving end identification.

In certain embodiments, further comprising:

displaying a first screen projection control in the first screen projection interface;

the sending of the screen projection request to the server comprises:

and responding to the triggering operation aiming at the first screen projection control, and sending a screen projection request to a server based on the at least one receiving end identification.

In certain embodiments, further comprising:

displaying second screen projection prompt information in the first screen projection interface; the second screen projection prompt message is used for prompting a screen projection user to provide a single receiving end identification;

acquiring any receiving end identification provided by a user, and determining a receiving end corresponding to any receiving end identification of the screen projection end in the same local area network;

responding to screen projection operation aiming at the receiving end, and establishing a point-to-point connection channel with the receiving end;

and sending the screen projection content to the receiving end through the point-to-point connecting channel.

In certain embodiments, further comprising:

acquiring receiving state prompt information, fed back by the server, of the at least one receiving end aiming at the screen projection content;

and displaying the receiving state prompt information of the at least one receiving terminal on the first screen projection interface.

In certain embodiments, further comprising:

and sending a screen projection termination request to a server based on screen projection termination operation of a screen projection end user for any receiving end, so that the server terminates and forwards the screen projection content to any receiving end.

In some embodiments, after sending the screen-shot content to the server, the method further includes:

and sending a screen-casting new request to the server side based on at least one new receiving end identification provided by the screen-casting user, so that the server side can send the screen-casting content to at least one new receiving end corresponding to the at least one receiving end identification.

In certain embodiments, further comprising:

receiving preemption prompt information sent by the server aiming at any receiving end; the preemption prompting information is sent when the server detects that the receiving end is in a target working state;

responding to a preemption confirmation operation, sending a preemption confirmation request to the server, so that the server sends the screen projection content to the receiving end based on the preemption confirmation request;

and responding to the preemption refusing operation, and sending a preemption refusing request to the server so that the server cancels the screen projection content from being sent to the receiving end on the basis of the preemption refusing request.

In some embodiments, the generating the screen-shot content comprises:

In certain embodiments, further comprising:

acquiring first audio data played by a terminal where the screen projection end is located and/or second audio data acquired by the screen projection end;

and respectively sending the first audio data and/or the second audio data to the server, so that the server respectively forwards the first audio data and/or the second audio data to the at least one receiving end.

In certain embodiments, further comprising:

sending a communication request to a server side so that the server side can determine at least one target receiving end in the at least one receiving end;

It should be noted that, in the screen projection implementation method shown in fig. 9, the relevant execution operation of the receiving end has been described in detail in the relevant embodiment of the screen projection implementation system, and will not be described in detail here.

Fig. 10 is a schematic structural diagram of an embodiment of a screen projection implementation apparatus provided in the present application, including:

a notification obtaining module 1001, configured to obtain a screen-casting notification sent by a server; the screen-casting notification is sent by the server side in response to a screen-casting request of the screen-casting side;

an information prompt module 1002, configured to output a reception prompt message;

a confirmation triggering module 1003, configured to send a confirmation request to the server in response to a confirmation receiving operation, so that the server sends, in response to the confirmation request, the screen projection content of the screen projection end to the receiving end;

and a content rendering module 1004, configured to obtain the screen-casting content sent by the server, and render and display the screen-casting content.

In one possible design, the screen projection implementation apparatus of the embodiment shown in fig. 10 may be implemented as an electronic device, which may refer to a mobile phone, a tablet computer, a notebook computer, and the like, and as shown in fig. 11, the computing device may include a storage component 1101, a display component 1102, and a processing component 1103;

the storage component 1101 stores one or more computer instructions for execution invoked by the processing component 1103.

The processing component 1103 is configured to:

outputting and receiving prompt information;

and acquiring the screen-casting content sent by the server, and rendering and displaying the screen-casting content through the display component 1102.

Of course, the electronic device may of course also comprise other components, such as input/output interfaces, communication components, etc.

The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a computer, the screen projection implementation method of the embodiment shown in fig. 7 can be implemented.

Fig. 12 is a schematic structural diagram of an embodiment of a screen projection implementation apparatus provided in the present application, including:

a request receiving module 1201, configured to receive a screen-casting request sent by a screen-casting terminal, and determine at least one receiving terminal;

a notification sending module 1202, configured to send a screen-casting notification to the at least one receiving end, so that the at least one receiving end outputs a receiving prompt message;

a content obtaining module 1203, configured to obtain the screen-projecting content generated by the screen-projecting end;

a content forwarding module 1204, configured to forward the screen-shot content to any receiving end in response to a confirmation request sent by the receiving end.

In one possible design, the screen-projection implementation of the embodiment shown in fig. 12 may be implemented as a computing device, which may include a storage component 1301 and a processing component 1302 as shown in fig. 13;

the storage component 1301 stores one or more computer instructions for the processing component 1302 to invoke for execution.

The processing component 1302 is configured to:

acquiring screen projection contents generated by the screen projection end;

Of course, the computing device may also include other components as necessary, such as a display component, input/output interfaces, communication components, and so forth.

The computing device may be a remote web server, a cloud server, a computer networking device, a chipset, a desktop computer, a notebook computer, a workstation, or any other processing device or equipment.

When the computing device is a cloud server, the processing components, storage components, and the like may be basic server resources rented or purchased from a cloud computing platform.

The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a computer, the screen projection implementation method of the embodiment shown in fig. 8 may be implemented.

Fig. 14 is a schematic structural diagram of an embodiment of a screen projection implementation apparatus provided in the present application, including:

a request sending module 1401, configured to send a screen-casting request to a server, so that the server determines at least one receiving end, and sends a screen-casting notification to the at least one receiving end;

a content generation module 1402, configured to generate screen projection content;

a content sending module 1403, configured to send the screen-projected content to the server, so that the server forwards the screen-projected content to a receiving end corresponding to the received confirmation request.

In one possible design, the screen projection implementation apparatus of the embodiment shown in fig. 14 may be implemented as an electronic device, which may refer to a mobile phone, a tablet computer, a notebook computer, and the like, and as shown in fig. 15, the electronic device may include a storage component 1501 and a processing component 1502;

the storage component 1501 stores one or more computer instructions for the processing component 1502 to invoke for execution.

The processing component 1502 is configured to:

generating screen projection content;

The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a computer, the screen projection implementation method of the embodiment shown in fig. 9 may be implemented.

The processing components referred to above may include one or more processors executing computer instructions to perform all or part of the steps of the methods described above. Of course, the processing elements may also be implemented as one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components configured to perform the above-described methods.

The storage component is configured to store various types of data to support operations in the device. The memory components may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The display element may be an Electroluminescent (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a retina-directable display or similar laser scanning type display.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A screen projection implementation method is characterized by comprising the following steps:

outputting and receiving prompt information;

2. The method of claim 1, further comprising:

3. The method of claim 1, wherein the receiving alert information comprises content alert information and at least one of vibration alert information and ring alert information.

4. The method according to claim 1, wherein before acquiring the screen-projection notification sent by the server, the method further comprises:

5. The method of claim 4, wherein outputting the receive-side screen projection code comprises:

providing a second screen projection interface;

6. The method of claim 5, further comprising:

7. A screen projection implementation method is characterized by comprising the following steps:

acquiring screen projection contents generated by the screen projection end;

8. The method of claim 7, further comprising:

9. The method of claim 7, wherein the screen-casting request includes at least one recipient identification provided by a screen-casting user;

the determining at least one receiving end comprises:

10. The method of claim 9, further comprising:

11. The method of claim 10, further comprising:

12. The method of claim 7, further comprising:

and stopping forwarding the screen projection content to the receiving end.

13. The method of claim 7, further comprising:

14. The method of claim 7, further comprising:

15. The method of claim 7, further comprising:

16. The method of claim 7, further comprising:

17. A screen projection implementation method is characterized by comprising the following steps:

generating screen projection content;

18. The method of claim 17, wherein the sending the screen shot content to the server comprises:

19. The method of claim 17, further comprising:

20. The method of claim 19, further comprising:

providing a first screen projection interface;

21. The method of claim 20, further comprising:

the sending of the screen projection request to the server comprises:

22. The method of claim 20, further comprising:

23. The method of claim 20, further comprising:

24. The method of claim 17, further comprising:

25. The method of claim 19, wherein after sending the screen-shot content to the server, the method further comprises:

26. The method of claim 17, further comprising:

27. The method of claim 17, wherein the generating the screen-shot content comprises:

28. The method of claim 17, further comprising:

29. The method of claim 17, further comprising:

30. A screen projection implementation system is characterized by comprising a screen projection end, a receiving end and a server end;

31. The system of claim 30, wherein the server is further configured to send a confirmation instruction to the screen projection terminal in response to a confirmation request from any one of the receiving terminals;

and the screen projection end particularly responds to the confirmation instruction and sends the screen projection content to the server end.

32. The system of claim 30, wherein the receiving end is further configured to send a rejection request to the server end in response to a rejection receipt operation;

33. The system of claim 30, wherein the screen projection end is further configured to obtain at least one receiving end identifier provided by a user of the screen projection end, and generate the screen projection request based on the at least one receiving end identifier;

34. The system of claim 32, wherein the receiver is further configured to output a receiver screen projection code; and the receiving end screen projection code is used as a receiving end identification to inform a screen projection end user.

35. The system of claim 34, wherein the receiving end specifically provides a second screen projection interface, and the receiving end screen projection code is displayed in the second screen projection interface.

36. The system of claim 32, wherein the server is further configured to send a first screen projection prompt message to the screen projection end;

the screen projection end is further used for providing a first screen projection interface, and first screen projection prompt information is displayed in the first screen projection interface.

37. The system of claim 36, wherein the screen-projection end is further configured to display a second screen-projection prompt message in the first screen-projection interface; the second screen projection prompt message is used for prompting a screen projection user to provide a single receiving end identification; acquiring any receiving end identification provided by a user, and determining a receiving end corresponding to any receiving end identification of the same local area network as the screen projection end in response to the screen projection triggering operation aiming at any receiving end identification; establishing a point-to-point connection channel with the receiving end; and sending the screen projection content to the receiving end through the point-to-point connecting channel.

38. The system of claim 36, wherein the server is further configured to detect a receiving status of the at least one receiving end with respect to the screen-shot content, and send a receiving status prompt message of the at least one receiving end to the screen-shot end;

39. The system of claim 30, wherein the screen projection terminal is further configured to send a screen projection termination request for any of the at least one receiving terminal to the server terminal;

40. The system of claim 30, wherein the screen-casting terminal is further configured to send a screen-casting addition request to the server terminal for at least one addition receiver terminal;

41. The system according to claim 30, wherein said server is further configured to detect whether said at least one receiver is in a target operating state; for the receiving end in the target working state, sending preemption prompt information to a screen projection end;

the server respectively forwarding the screen projection contents to the at least one receiving end comprises the following steps: detecting a preemption confirmation request of the screen projection end aiming at any receiving end, and forwarding the screen projection content to the receiving end; detecting a request for refusing to seize any receiving terminal by the screen projection terminal, and canceling forwarding the screen projection content to the receiving terminal;

42. The system of claim 30, wherein the screen projection end is further configured to obtain first audio data played by a device where the screen projection end is located, and/or second audio data collected by the screen projection end; respectively sending the first audio data and/or the second audio data to the server;

43. The system of claim 30, wherein the screen projection end is further configured to send a communication request to the server end;

the server is further used for determining at least one target receiving end in the at least one receiving end; establishing a communication channel based on the communication number corresponding to the screen projection end and the communication number corresponding to the at least one target receiving end; the communication channel is used for voice communication between a screen projection end user and a target receiving end user.

44. The system of claim 32, wherein the receiving end is a user end installed in a personal terminal; the personal terminal comprises a personal computer, a tablet computer or a wearable device; the receiving end identification comprises a user identification or a user side screen projection code.

45. The system of claim 30, wherein the server comprises a first server and a second server;

the first server is used for determining at least one receiving terminal based on the screen projection request and respectively sending a first screen projection notification to the at least one receiving terminal;

the receiving end is also used for responding to the receiving confirmation operation and establishing a connection channel with the second server;

the screen projection end is specifically used for sending screen projection content to the second server;

the second server is used for forwarding the screen projection content to the receiving end.

46. The system of claim 45, wherein the server further comprises a third server;

the third server is used for receiving a confirmation request fed back by the user side and sending a screen projection confirmation instruction to the second server; receiving a rejection request fed back by the user side, and sending a screen projection termination instruction to the second server;

the second server is specifically configured to forward the screen projection content to the user side having the screen projection confirmation indication.

47. The system of claim 33, wherein the receiving end comprises a first receiving end installed in a first terminal or a second receiving end installed in a second terminal; the first terminal is fixedly deployed in a fixed site; the second terminal comprises a personal terminal;

the at least one receiving end identification provided by the screen projection end user is obtained according to one or more of the following modes:

acquiring at least one receiving end screen projection code input by the screen projection end user;

selecting at least one user identifier from a user list corresponding to a business organization to which the screen projection end user belongs; and acquiring at least one place name input by the screen projection end user.

48. The system of claim 33, wherein the screen-casting terminal is further configured to send a screen-casting reservation request to the server terminal; the screen-casting reservation request comprises at least one receiving end identification;

the server is further used for sending screen-casting reservation notifications to at least one receiving terminal corresponding to the at least one receiving terminal identification respectively based on the screen-casting reservation requests;

49. The system of claim 30, wherein the server is further configured to receive a session request sent by a screen-casting end, and establish a session connection between the screen-casting end and the at least one receiving end; sending third screen projection prompt information to the screen projection end;

50. The system according to claim 49, wherein the server is further configured to receive a first session message sent by a screen-casting terminal, and forward the first session message to the at least one receiving terminal respectively; receiving a second session message sent by any receiving terminal, and respectively sending the second session message to the rest receiving terminals and the screen projection terminal;

the receiving end is also used for displaying the first conversation message and the second conversation message.

51. The system of claim 36, wherein the server is further configured to send a first session prompt message to the screen-casting terminal;

the server is further configured to forward the third session messages to the at least one receiving end respectively;

52. The system according to claim 51, wherein said server is further configured to send second session prompt messages to said at least one receiver respectively; receiving a fourth session message sent by any receiving terminal, and respectively forwarding the fourth session message to the screen projection terminal and the remaining receiving terminals;

53. The system of claim 30, wherein the server is further configured to generate a screen-projection acquisition identifier in response to the screen-projection request; sending the screen projection acquisition identifier to the screen projection end;

54. The system of claim 30, wherein the server is further configured to send transaction prompting messages of a plurality of screen projection modes to the screen projection terminal; different screen projection modes correspond to different screen projection authorities; receiving a transaction request of the screen projection end aiming at a target screen projection mode, and determining a target screen projection authority corresponding to the screen projection end;

55. A screen projection implementation device is characterized by comprising:

56. A screen projection implementation device is characterized by comprising:

57. A screen projection implementation device is characterized by comprising:

the content generation module is used for generating screen projection content;

58. An electronic device comprising a processing component, a display component, and a storage component;

the processing component is to:

outputting and receiving prompt information;

59. A computing device comprising a processing component and a storage component;

the processing component is to:

acquiring screen projection contents generated by the screen projection end;

60. An electronic device comprising a processing component and a storage component;

the processing component is to:

generating screen projection content;