CN110515573B

CN110515573B - Screen projection method, device and system and computer equipment

Info

Publication number: CN110515573B
Application number: CN201810487375.3A
Authority: CN
Inventors: 林经纬; 林叶辉; 王新新; 张旭舟; 陈汉聪; 严琼
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2018-05-21
Filing date: 2018-05-21
Publication date: 2022-07-22
Anticipated expiration: 2038-05-21
Also published as: CN110515573A

Abstract

The invention relates to a screen projection method, a device, a system and computer equipment, wherein the method comprises the following steps: acquiring a screen projection code and a local terminal identifier; sending the screen projection code and the terminal identification to a server; the screen projection code and the terminal identification are sent and used for indicating the server to establish screen projection connection between the terminal corresponding to the terminal identification and the screen projection equipment corresponding to the screen projection equipment identification after the screen projection equipment identification associated with the screen projection code is found out; after the screen projection connection is successful, local screen data are obtained; uploading the screen data to the server; and the uploaded screen data is used for instructing the server to forward the screen data to the screen projection equipment according to the screen projection connection. The scheme provided by the application greatly widens the application range of screen projection.

Description

Screen projection method, device and system and computer equipment

Technical Field

The invention relates to the technical field of computers, in particular to a screen projection method, a screen projection device, a screen projection system and computer equipment.

Background

With the development of computer technology, computer devices such as mobile phones, tablet computers and notebook computers become an indispensable part of people in daily life and work. At present, in many scenes, such as teaching or multi-person meeting, related content needs to be displayed through a display screen with a large size, so that all participants can conveniently view the content intended to be viewed.

In the conventional technology, the screen is usually projected in a wired screen projection manner, the limited screen projection manner enables the user terminal and the screen projection device to be limited within a smaller distance, and whether the user terminal and the screen projection device can be effectively connected is also limited by the interface specifications of the user terminal and the screen projection device. This results in a limited range of applicability of the conventional wired screen projection method.

Disclosure of Invention

Based on this, it is necessary to provide a screen projection method, apparatus, system and computer device to solve the problem that the traditional wired screen projection method has a very limited application range.

A screen projection method, comprising:

acquiring a screen projection code and a local terminal identifier;

sending the screen projection code and the terminal identification to a server; the screen projection code and the terminal identification are sent and used for indicating the server to establish screen projection connection between the terminal corresponding to the terminal identification and the screen projection equipment corresponding to the screen projection equipment identification after the screen projection equipment identification associated with the screen projection code is found out;

after the screen projection connection is successful, local screen data are obtained;

uploading the screen data to the server; and the uploaded screen data is used for indicating the server to forward the screen data to the screen projection equipment according to the screen projection connection.

A screen projection apparatus comprising:

the first acquisition module is used for acquiring the screen projection code and a local terminal identifier;

the first sending module is used for sending the screen projection code and the terminal identification to a server; the screen projection code and the terminal identification are sent and used for indicating the server to establish screen projection connection between the terminal corresponding to the terminal identification and the screen projection equipment corresponding to the screen projection equipment identification after the screen projection equipment identification associated with the screen projection code is found out;

the second acquisition module is used for acquiring local screen data after the screen projection connection is successful;

the second sending module is used for uploading the screen data to the server; and the uploaded screen data is used for indicating the server to forward the screen data to the screen projection equipment according to the screen projection connection.

A computer-readable storage medium having stored thereon a computer program which, when executed by a processor, causes the processor to perform the steps of:

acquiring a screen projection code and a local terminal identifier;

sending the screen projection code and the terminal identification to a server; the screen-projecting code and the terminal identifier are sent and used for indicating the server to establish screen-projecting connection between the terminal corresponding to the terminal identifier and the screen-projecting equipment corresponding to the screen-projecting equipment identifier after finding the screen-projecting equipment identifier associated with the screen-projecting code;

A computer device comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of:

acquiring a screen projection code and a local terminal identifier;

uploading the screen data to the server; and the uploaded screen data is used for instructing the server to forward the screen data to the screen projection equipment according to the screen projection connection.

According to the screen projection method, the screen projection device, the storage medium and the computer equipment, after the screen projection code and the local terminal identification are obtained, the screen projection code and the terminal identification are sent to the server, and the server can establish screen projection connection between the local screen projection equipment and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code. Therefore, local screen data can be acquired and sent to the server after the screen projection connection is successful, and then the screen data is forwarded to the screen projection equipment by the server for display, so that the screen projection from the local to the screen projection equipment is completed. Therefore, the screen can be projected without being connected with the screen projecting equipment in a wired mode or being connected to the same wireless local area network with the screen projecting equipment, and the screen projecting application range is greatly widened.

A method of screen projection, comprising:

displaying screen projection codes; the screen projection code is used for indicating the terminal to send the screen projection code and the terminal identification of the terminal to a server after the screen projection code is obtained; the screen-projecting code and the terminal identifier are used for indicating the server to establish screen-projecting connection between the terminal and the screen-projecting equipment corresponding to the screen-projecting equipment identifier after finding the screen-projecting equipment identifier associated with the screen-projecting code;

receiving screen data which is forwarded by the server according to the screen projection connection and is transmitted by the terminal;

and displaying the screen data.

A screen projection apparatus comprising:

the first display module is used for displaying the screen projection code; the screen projection code is used for indicating a terminal to correspondingly send the screen projection code and a terminal identifier of the terminal to a server after the terminal acquires the screen projection code; the screen-projecting code and the terminal identifier are used for indicating the server to establish screen-projecting connection between the terminal and the screen-projecting equipment corresponding to the screen-projecting equipment identifier after finding the screen-projecting equipment identifier associated with the screen-projecting code;

the receiving module is used for receiving screen data which is forwarded by the server according to the screen projection connection and is initiated to be transmitted by the terminal;

and the second display module is used for displaying the screen data.

displaying the screen projection code; the screen projection code is used for indicating a terminal to send the screen projection code and a terminal identifier of the terminal to a server after the terminal acquires the screen projection code; the screen-projecting code and the terminal identifier are used for indicating the server to establish screen-projecting connection between the terminal and the screen-projecting equipment corresponding to the screen-projecting equipment identifier after finding the screen-projecting equipment identifier associated with the screen-projecting code;

receiving screen data which is forwarded by the server according to the screen projection connection and is initiated to be transmitted by the terminal;

and displaying the screen data.

According to the screen projection method, the screen projection device, the storage medium and the computer equipment, the screen projection code is displayed locally, so that the terminal can send the screen projection code and the terminal identification of the terminal to the server after acquiring the screen projection code, and the server establishes screen projection connection between the terminal and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code. Therefore, the terminal can transmit the screen data to the server and then the server transmits the screen data to the local for displaying, and therefore screen projection from the terminal to the local is completed. Therefore, the screen can be projected without being connected with the terminal in a wired mode or being connected to the same wireless local area network with the terminal, and the application range of the screen projection is greatly widened.

A screen projection method, comprising:

acquiring a screen projection code and a terminal identifier;

inquiring screen projection equipment identification associated with the screen projection code;

establishing a screen projection connection between a terminal corresponding to the terminal identifier and screen projection equipment corresponding to the screen projection equipment identifier;

receiving screen data uploaded by the terminal;

and forwarding the screen data to the screen projection equipment according to the screen projection connection.

A screen projection apparatus comprising:

the acquisition module is used for acquiring the screen projection code and the terminal identification;

the query module is used for querying the screen projection equipment identification associated with the screen projection code;

the establishing module is used for establishing a screen projection connection between the terminal corresponding to the terminal identifier and the screen projection equipment corresponding to the screen projection equipment identifier;

the receiving module is used for receiving the screen data uploaded by the terminal;

and the forwarding module is used for forwarding the screen data to the screen projection equipment according to the screen projection connection.

acquiring a screen projection code and a terminal identifier;

establishing a terminal corresponding to the terminal identifier and screen projection connection between the terminal and screen projection equipment corresponding to the screen projection equipment identifier;

receiving screen data uploaded by the terminal;

acquiring a screen projection code and a terminal identifier;

receiving screen data uploaded by the terminal;

After the screen projection code and the terminal identifier are obtained, the screen projection equipment identifier associated with the screen projection code is automatically inquired so as to establish screen projection connection between the terminal corresponding to the terminal identifier and the screen projection equipment corresponding to the screen projection equipment identifier. Therefore, the screen data uploaded by the terminal can be transferred to the screen projection equipment through the screen projection connection, the terminal is not required to be in wired connection with the screen projection equipment, the screen projection can be completed without being connected to the same wireless local area network with the screen projection equipment, and the screen projection application range is greatly widened.

A screen projection system comprises a terminal, a server and screen projection equipment; wherein,

the screen projection equipment is used for displaying a screen projection code;

the terminal is used for acquiring a screen projection code displayed by the screen projection equipment and a local terminal identifier; sending the screen projection code and the terminal identification to a server;

the server is used for acquiring a screen projection code and a terminal identifier sent by the terminal; inquiring screen projection equipment identification associated with the screen projection code; establishing a screen projection connection between a terminal corresponding to the terminal identifier and screen projection equipment corresponding to the screen projection equipment identifier;

the terminal is also used for acquiring local screen data after the screen projection connection is successful; uploading the screen data to the server;

the server is also used for receiving screen data uploaded by the terminal; forwarding the screen data to the screen projection equipment according to the screen projection connection;

the screen projection equipment is also used for receiving screen data which is forwarded by the server according to the screen projection connection and is transmitted by the terminal; and displaying the screen data.

In the screen projecting system, after the screen projecting equipment displays the screen projecting code, the terminal can acquire the screen projecting code, and after the screen projecting code is acquired, the screen projecting code and the terminal identifier of the terminal are sent to the server, so that the server can establish screen projecting connection between the terminal and the screen projecting equipment corresponding to the screen projecting equipment identifier after finding the screen projecting equipment identifier associated with the screen projecting code, and the terminal can further transmit screen data to the server and then forward the screen data to the screen projecting equipment by the server for display, thereby completing screen projecting from the terminal to the screen projecting equipment. Therefore, the screen projection equipment can complete screen projection without being in wired connection with the terminal or being connected to the same wireless local area network with the terminal, and the screen projection application range is greatly widened.

Drawings

FIG. 1 is a diagram of an application environment of a screen projection method in one embodiment;

FIG. 2 is a schematic flow chart diagram illustrating a screen projection method in one embodiment;

FIG. 3 is a schematic interface diagram of a terminal in one embodiment;

FIG. 4 is an interface diagram illustrating a terminal acquiring a screen-cast code through a screen-cast application in one embodiment;

FIG. 5 is a schematic interface diagram of a terminal in another embodiment;

fig. 6 is a schematic interface diagram illustrating that a terminal acquires a screen projection code through a screen projection application in another embodiment;

FIG. 7 is a schematic representation of interface data and input indicator data in one embodiment;

FIG. 8 is a diagram illustrating registration of screen data acquisition permissions for a screen projection application in one embodiment;

FIG. 9 is a diagram of an interface for displaying a screen projection notification, according to an embodiment;

FIG. 10 is a schematic diagram of an interface for adding a screen projection device in one embodiment;

FIG. 11 is a flowchart illustrating a screen projection method according to another embodiment;

FIG. 12 is a diagram illustrating an interface for displaying screen projection codes, according to one embodiment;

FIG. 13 is a diagram illustrating display screen data in one embodiment;

FIG. 14 is a flowchart illustrating a screen projection method according to another embodiment;

FIG. 15 is a sequence diagram illustrating interactions between a terminal, a server, and a screen projection device in one embodiment;

FIG. 16 is a block diagram of a projection device in accordance with one embodiment;

FIG. 17 is a block diagram of a screen projection apparatus according to another embodiment;

FIG. 18 is a block diagram of a projection device in accordance with another embodiment;

FIG. 19 is a block diagram of a projection device in accordance with another embodiment;

FIG. 20 is a diagram of the internal structure of a computer device in one embodiment;

fig. 21 is an internal structural view of a computer device in another embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the invention.

FIG. 1 is a diagram of an application environment of the screen projection method in one embodiment. Referring to fig. 1, the screen projection method is applied to a screen projection system. The screen projection system includes a terminal 110, a server 120, a screen projection device 130, and a display 140. The terminal 110 and the screen projection device 130 are respectively connected to the server 120, and the display 140 is connected to the screen projection device 130. The terminal 110 may be a desktop terminal or a mobile terminal, and the mobile terminal may be at least one of a mobile phone, a tablet computer, a notebook computer, and the like. The server 120 may be an independent server, or a server cluster composed of a plurality of independent servers. The projection device 130 may be an electronic device such as a projection box or a projector. It is understood that the hardware devices shown in fig. 1 are only some of the hardware devices associated with the application environment of the present application, and do not constitute a limitation on the application environment of the present application, and that a specific hardware device may include more or less hardware devices than those shown in the drawings, for example, when the projection device 130 is a projection box, the application environment may include the display 140, and when the projection device 130 is a projector, the application environment may not include the display 140.

FIG. 2 is a flowchart illustrating a screen projection method according to an embodiment. The present embodiment is mainly illustrated by applying the screen projection method to the terminal 110 in fig. 1. Referring to fig. 2, the screen projection method specifically includes the following steps:

s202, screen projection codes and local terminal identifications are obtained.

The screen-casting code is a certificate for casting a screen, and can be a character string including at least one character of numbers, letters or symbols. Screen-casting codes such as "123456" or "abg 12 d", etc. The terminal identifier is used for uniquely identifying a terminal, and may be a character string including at least one character of a number, a letter, or a symbol. The terminal identifier may specifically be a terminal serial number or a currently logged-in user identifier. The user identifier of the current login can be a terminal system account of the current login or an application account of the current login.

Specifically, the terminal can receive a screen projection code input by a user on a terminal interface, or receive a screen projection code sent by other terminals or screen projection equipment, so as to obtain the screen projection code. In this embodiment, a screen projection code may be integrated in a terminal code of the terminal, so that the terminal has a screen projection function. The screen-casting code is computer readable instructions for performing a screen-casting operation after the terminal is run. The terminal or the screen projection equipment can transmit the screen projection code through sound waves.

In one embodiment, the terminal can also be provided with a screen projection application or a non-screen projection application integrated with screen projection codes. The screen projection application is an application program special for screen projection, and the non-screen projection application integrated with the screen projection code is not an application program special for screen projection but with a screen projection function, such as a WeChat application and the like.

Specifically, the terminal can start the screen-projecting application or the non-screen-projecting application integrated with the screen-projecting code according to a user instruction, and continue to acquire the screen-projecting code input by the user in the screen-projecting application or the non-screen-projecting application integrated with the screen-projecting code. And after receiving the screen projection instruction, the terminal can continuously acquire the local terminal identification.

For example, fig. 3 shows a schematic interface diagram of a terminal in one embodiment. The terminal may specifically be a mobile phone. Referring to fig. 3, the interface includes a screen projection application 310. Fig. 4 is a diagram illustrating an interface of a terminal for acquiring a screen projection code through a screen projection application in one embodiment. Referring to fig. 4, the interface includes a screen-cast code input box 410 and a screen-cast determination control 420. When the user intends to perform screen projection, the screen projection code can be input in the screen projection code input box 410, and after the screen projection code is input, the screen projection determining control 420 is clicked to trigger a screen projection instruction, so that the terminal can acquire the screen projection code input by the user and the local terminal identifier to continue to perform subsequent operations.

For example, fig. 5 shows a schematic interface diagram of a terminal in one embodiment. The terminal may be a notebook computer or a desktop terminal. Referring to fig. 5, the interface includes a screen-casting application 510. FIG. 6 is a diagram illustrating an interface through which a terminal obtains a screen-cast code via a screen-cast application in one embodiment. Referring to fig. 6, the interface includes a screen cast code input box 610 and a screen cast determination control 620. When the user intends to perform screen projection, the screen projection code can be input in the screen projection code input box 610, and the screen projection determining control 620 is clicked after the screen projection code is input so as to trigger the screen projection instruction, so that the terminal can acquire the screen projection code input by the user and the local terminal identifier to continue to perform subsequent operations.

In one embodiment, the terminal can custom install or uninstall the screen projection application or the non-screen projection application integrated with the screen projection code according to the user instruction.

In one embodiment, the screen projection code or the screen projection application on the terminal is developed by adapting to an operating system of the terminal, and the adapted screen projection code or the adapted screen projection application is developed for different operating systems respectively.

S204, sending the screen projection code and the terminal identification to a server; and the screen projection code and the terminal identifier are used for indicating the server to establish screen projection connection between the terminal corresponding to the terminal identifier and the screen projection equipment corresponding to the screen projection equipment identifier after finding the screen projection equipment identifier associated with the screen projection code.

Wherein, the screen-casting device identification associated with the screen-casting code can be one or more. When the screen projection device identification associated with the screen projection code is one, the screen projection device identification can be one-to-one screen projection, such as teaching scenes and the like. When the screen projecting device identifications associated with the screen projecting codes are multiple, the screen projecting device identifications can be one-to-many screen projecting, such as a multi-party conference scene and the like.

Specifically, after acquiring the screen projection code and the local terminal identifier, the terminal uploads the screen projection code and the terminal identifier to the server correspondingly. After receiving the screen projection code and the terminal identification, the server searches the screen projection equipment identification associated with the screen projection code, judges the terminal intention and the screen projection equipment corresponding to the searched screen projection equipment identification to perform screen projection, and establishes screen projection connection between the terminal and the screen projection equipment corresponding to the screen projection equipment identification.

The screen projection connection reflects the corresponding relationship between the terminal and the device for performing screen projection. It can be understood in a popular way that the server creates a screen projection room, the terminals and the screen projection devices are respectively added into the room according to respective terminal identifiers or screen projection device identifiers, and screen projection connection is established between the terminals and the screen projection devices. The data of the terminal and the screen projection equipment in one screen projection connection can be multiple.

In one embodiment, after the screen projection connection between the terminal and the screen projection device corresponding to the screen projection device identifier is established, the server can feed back a notification of the success of the screen projection connection to the terminal, so that the terminal can execute subsequent operations. When the screen projection equipment identification associated with the screen projection code is not found by the server, a notification that the screen projection equipment identification associated with the screen projection code is not inquired can be fed back to the terminal, and the terminal displays prompt information of screen projection code errors according to the notification so as to remind a user of inputting the screen projection code again.

In one embodiment, the terminal can start timing after sending the screen projection code and the terminal identifier to the server, and when the timing duration reaches the waiting duration and does not receive the notification fed back by the server, disconnection with the server can be judged, and prompt information of network abnormity is displayed to remind a user to replace the network or try again later.

And S206, acquiring local screen data after the screen projection connection is successful.

The screen data is data to be displayed on a screen. The screen projection, as the name implies, is to display data displayed on the screen of one device on another device or devices so that the data displayed on the screens of these devices are consistent. Therefore, after the screen projection connection is successful, the terminal can obtain local screen data so as to transmit the screen data and then realize screen projection.

In one embodiment, after the screen projection connection is successful, the terminal can exit the screen projection application or the non-screen projection application integrated with the screen projection code, open an application or a file intended to be projected, and the like, so as to display data intended to be projected on the screen. Therefore, the terminal can acquire the data intended to be projected by acquiring the local screen data, so that the screen projection is performed.

Specifically, the terminal performs screen recording to acquire screen data. For example, the terminal may call a screenshot interface to capture a screen image to obtain screen data. Or, the terminal may obtain data used by the terminal interface process to perform interface rendering, to obtain screen data.

S208, uploading the screen data to a server; and the uploaded screen data is used for indicating the server to forward the screen data to the screen projection equipment through screen projection connection.

Specifically, after the terminal acquires the screen data, the screen data can be directly uploaded to the server, and the server forwards the screen data to the screen projection equipment which establishes screen projection connection with the terminal so as to project the screen.

According to the screen projection method, after the screen projection code and the local terminal identification are obtained, the screen projection code and the terminal identification are sent to the server, and the server can establish screen projection connection between the local screen projection equipment and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code. Therefore, local screen data can be acquired and sent to the server after the screen projection connection is successful, and then the screen data is forwarded to the screen projection equipment by the server for display, so that the screen projection from the local to the screen projection equipment is completed. Therefore, the screen can be projected without being connected with the screen projecting equipment in a wired mode or being connected to the same wireless local area network with the screen projecting equipment, and the screen projecting application range is greatly widened.

In one embodiment, the screen projection method further comprises: acquiring a first network address and a local second network address of the screen projection equipment; when the first network address and the second network address belong to the same wireless local area network, when new screen data are obtained, the new screen data are directly sent to the screen projection equipment according to the first network address.

Wherein the network address is a logical address that a node on the internet has in the network. The first network address of the screen-casting device is a logical address that the screen-casting device has in the network. The local second network address is a logical address that is locally present in the network. The network Address may specifically be an IP Address (Internet Protocol Address).

Specifically, when the server notifies the terminal that the screen-projecting connection is successful, the server can actively issue screen-projecting device identifiers and network addresses of screen-projecting devices establishing the screen-projecting connection with the terminal to the terminal. The terminal can also request the server for screen projection equipment identifications and network addresses of all screen projection equipment which establish screen projection connection with the terminal when the server informs the terminal that the screen projection connection is successful.

Therefore, after the terminal acquires the first network address of the screen projection equipment, the terminal checks whether the first network address and the local second network address belong to the same wireless local area network. If the two are in the same wireless local area network, the terminal directly sends the new screen data to the screen projection equipment according to the first network address when acquiring the new screen data, so that the data are transmitted through the wireless local area network, and the data transmission efficiency is improved. And if the two do not belong to the same wireless local area network, the terminal continuously forwards the acquired new screen data through the server so as to ensure the normal operation of screen projection.

It can be understood that the terminal is connected with the server through a public network, and the server establishes the screen projection connection between the terminal and the screen projection device. In order to ensure the timeliness of screen projection after the screen projection connection is successful, the terminal can continue to send screen data through the public network, namely, the screen data is forwarded to the screen projection equipment through the server for screen projection. In the screen projection process, the terminal acquires the screen data continuously, so that the terminal can transmit the screen data acquired in real time through a public network on one hand and check whether the screen projection equipment and the local equipment are accessed to the same wireless local area network on the other hand. Therefore, when the screen projection equipment and the local access are in the same wireless local area network, the screen projection equipment is switched to the mode of sending new screen data acquired in real time through the wireless local area network.

In the embodiment, when the local screen projection equipment and the screen projection equipment are connected to the same wireless local area network, the screen data are transmitted through the wireless local area network, so that the data transmission efficiency is improved; when the local screen projection equipment and the screen projection equipment are not connected to the same wireless local area network, screen data are transmitted through a public network, and normal screen projection can be guaranteed.

In one embodiment, the screen data includes layer data for a plurality of layers. S206 includes: and respectively acquiring the layer data of the plurality of layers according to different frame rates after the screen projection connection is successful. Uploading screen data to a server, comprising: respectively uploading the layer data of the plurality of layers to a server according to the layers; and the layer data of the plurality of layers are respectively uploaded and are used for indicating the server to respectively forward the layer data of the plurality of layers to the screen projection equipment according to the layers according to the screen projection connection.

Wherein, the layer is a container for bearing screen data. When the screen is rendered, the screen data to be displayed can be rendered in the same layer, and the layer is displayed to finish the screen rendering; and rendering the screen data to be displayed on different layers respectively, and displaying the layers after superposition to finish screen rendering. The layer data is screen data displayed in the layer.

It can be understood that the data amount of the screen data is large. The updating frequencies of the data are different, and the terminal can render the screen data with the same or similar updating frequencies in the same layer according to the updating frequencies of the screen data. Therefore, when screen data need to be updated, the terminal does not need to re-render all the screen data, and only re-render the layer where the updated screen data are located.

Then, when the terminal acquires the screen data, the layer data may be acquired according to the layers, and the frame rates of acquiring the image data of each layer are different. The obtaining frame rate of each layer data is positively correlated with the updating frequency of the layer data, and the higher the updating frequency of the layer data is, the higher the obtaining frame rate of the layer data is. The acquisition of the layer data of each layer is not influenced mutually, and the uploading of the layer data of each layer is also not influenced mutually. In this way, after the terminal respectively uploads the layer data of the plurality of layers to the server according to the layers, the server respectively forwards the layer data of the plurality of layers to the screen projection equipment connected with the terminal for screen projection according to the layers. It can be understood that when the terminal uploads the layer data, the uploading frame rate is consistent with the obtaining frame rate of the layer data.

Further, after receiving the layer data of the plurality of layers uploaded respectively, the server also forwards the layer data of the plurality of layers uploaded respectively to screen projection equipment connected with the terminal. Therefore, the screen projection equipment can conveniently and separately render the layer data of the plurality of layers, so that only the layer where the layer data is located is replaced when new layer data is received.

In one embodiment, the layer data for the plurality of layers includes interface data for the interface layer and input indicator data for the input indicator layer. After the screen projection connection is successful, the layer data of a plurality of layers are respectively obtained according to different frame rates, and the method comprises the following steps: and after the screen projection connection is successful, acquiring interface data according to a first frame rate, and acquiring input indicator data according to a second frame rate which is greater than the first frame rate. Uploading layer data of a plurality of layers to a server according to the layers respectively, and the method comprises the following steps: uploading the interface data and the input indicator data to a server respectively; and the interface data and the input indicator data which are respectively uploaded are used for indicating the server to respectively forward the interface data and the input indicator data to the screen projection equipment according to the screen projection connection.

The interface layer is a layer for bearing interface data. And displaying the interface data on the interface. The input indicator layer is a layer that carries input indicator data. The input indicator data is data for identifying an input display. An input display such as a mouse, a laser pen, or a joystick, etc.

For example, FIG. 7 shows a schematic representation of interface data and input indicator data in one embodiment. The scene is particularly a scene needing to show a presentation (such as PPT) to an audience through screen projection. Referring to fig. 7, the interface includes interface data 710 and input indicator data 720. The interface data 710 is presentation image data displayed on the display screen. The input pointer data 720 is a mouse marker.

Specifically, after the screen projection connection is successful, the terminal can acquire interface data according to a first frame rate and acquire input indicator data according to a second frame rate which is greater than the first frame rate; and independently uploading the acquired interface data and the input indicator data. That is, the acquisition of the interface data and the input indicator data are not affected, and the uploading of the interface data and the input indicator data are also not affected. And uploading the interface data after the terminal acquires the interface data, and uploading the input indicator data after the terminal acquires the input indicator data. It can be understood that the terminal acquires the interface data according to the first frame rate, that is, uploads the interface data according to the first frame rate; the terminal acquires the input indicator data according to the second frame rate, namely, the input indicator data is uploaded according to the second frame rate. The first frame rate may be specifically 20 frames per second, and the second frame rate may be specifically 60 frames per second.

Further, after receiving the interface data and the input indicator data, the server also respectively forwards the respectively uploaded interface data and input indicator data to screen projection equipment connected with the terminal for screen projection. In this way, the screen projection device can conveniently separate the rendering interface data and the input indicator data, so that only the interface data is re-rendered when new interface data is received, and only the input indicator data is re-rendered when new input indicator data is received.

It can be understood that the update frequency of the input indicator data is obviously greater than the update frequency of the interface data, so that the input indicator data is acquired by selecting a relatively high frame rate, and the interface data is acquired by selecting a relatively low frame rate, so that the requirement of screen projection smoothness can be met, and the user experience is improved. Moreover, the interface data has a large data volume relative to the input indicator data, and the interface data is transmitted at a lower frame rate, so that the transmitted data volume can be reduced, the data transmission efficiency is improved, and the network resources can be saved.

In one embodiment, when the terminal and the screen projection device directly transmit data through the wireless local area network, the terminal directly sends the layer data of the plurality of layers to the screen projection device according to the layers, or sends the interface data and the input indicator data to the screen projection device respectively.

In the embodiment, the layer data of different layers are acquired and uploaded according to different frame rates, so that the screen projection terminal can conveniently display the received layer data, and the screen projection equipment can only update the layer data replaced by the layer data when new layer data are transmitted without re-rendering all the data, thereby greatly reducing the workload of the screen projection equipment and ensuring higher screen projection fluency.

In one embodiment, the screen projection method further comprises: starting a screen projection main process; executing the steps of acquiring a screen projection code and a local terminal identifier through a screen projection main process, and sending the screen projection code and the terminal identifier to a server; after the screen projection connection is successful and when the screen data acquisition right exists corresponding to the screen projection main process, starting a screen data acquisition sub-process corresponding to the screen projection main process; executing the step of acquiring local screen data through the screen data acquisition subprocess, and transmitting the acquired screen data to the screen projection main process through the screen data acquisition subprocess; and uploading the screen data to a server through the screen projection main process.

Wherein, the screen projection main process is a process for running the screen projection code. When the screen projection code is directly integrated into the terminal system, the screen projection main process is the system process for running the screen projection code. For a special screen projection application, the screen projection main process is an application process of the screen projection application; for the non-screen-projection application integrated with the screen projection codes, the screen projection main process is a sub-process of the application, and the sub-process runs the screen projection codes integrated in the non-screen-projection application.

It will be appreciated that different operating systems initially give the application or code integrated into the terminal different rights. Some operating systems initially grant the rights to the application or code integrated into the terminal, while other operating systems do not initially grant the rights to the application or code integrated into the terminal. For example, iOS (apple mobile terminal operating system) does not initially give an application or a code integrated into the terminal the right to acquire screen data (i.e., screen recording). The Android operating system initially gives an application or a code integrated in the terminal an authority to acquire screen data (i.e., screen recording).

Then, for a terminal to which an application is initially given to an operating system or a code integrated into the terminal obtains authority of screen data (namely screen recording), after a screen projection main process is started, the terminal executes a step of obtaining a screen projection code and a local terminal identifier through the screen projection main process, and sends the screen projection code and the terminal identifier to a server; the method comprises the steps of obtaining local screen data after screen projection connection is successful, and uploading the screen data to a server. Namely, the steps of the screen projection method are executed through the screen projection main process.

And for a terminal of which the operating system does not initially give an application or a code integrated into the terminal permission to acquire screen data (namely screen recording), after the terminal starts a screen projection main process, executing a step of acquiring a screen projection code and a local terminal identifier through the screen projection main process, and sending the screen projection code and the terminal identifier to a server. And then, after the screen projection connection is successful, detecting whether the operating system gives screen data acquisition permission to the screen projection main process according to the user instruction. If so, starting a screen data acquisition sub-process corresponding to the screen projection main process, executing a step of acquiring local screen data through the screen data acquisition sub-process, and transmitting the acquired screen data to the screen projection main process through the screen data acquisition sub-process; and through the screen projection main process, the step of uploading the screen data to the server is executed.

If the operating system does not endow the screen data acquisition permission to the screen projection main process according to the user instruction, registering the screen projection main process (screen projection application), and endowing the screen data acquisition permission to the screen projection main process through the operating system. The process of registering the screen projection main process (screen projection application) can be performed before the screen projection main process is started. The main body for starting the screen data acquisition subprocess can be a screen projection main process or an operating system.

It can be understood that the screen data acquisition sub-process is a process which is dedicated to calling an operating system screen data acquisition interface to acquire screen data according to the authority after the authority of the screen-casting main process is successfully registered.

FIG. 8 illustrates a diagram that registers screen data acquisition rights for a screen cast application in one embodiment. Referring to fig. 8, the interface includes a list of applications to be registered. And after the screen projection application in the application list is selected, the registration of the screen projection application is completed.

In this embodiment, for the case that a part of the operating systems limits the authority of the application or the code, when a screen is dropped, the authority of the application or the code is registered, so that a screen data acquisition authority exists correspondingly in the screen dropping main process, and a screen data acquisition sub-process corresponding to the screen dropping main process is started to acquire the screen data, thereby overcoming the problem that the screen dropping main process cannot acquire the screen data, and ensuring normal screen dropping.

In one embodiment, the screen projection method further comprises: when the screen projection main process is switched from foreground operation to background operation, the silent audio is played through the screen projection main process; and when the screen projection main process is switched from background operation to foreground operation, stopping playing the soundless audio through the screen projection main process.

It can be understood that, after a process is switched from foreground running to background running, the priority of the process will be reduced, and for a process with a lower priority, the operating system will actively end the running of the process. The terminal plays audio through the music player, the priority of the process where the music player is located is high, and the operating system does not actively end the running of the process under normal conditions.

Therefore, in order to prevent the screen projection main process from being automatically finished by the operating system when the screen projection main process runs in the background, silent audio is played through the screen projection main process when the screen projection main process is switched from foreground running to background running, so that the screen projection main process can acquire the priority of the process where the music player is located, the process cannot be finished to run by the operating system, the process activity is improved, and the normal screen projection is ensured. Moreover, as the played audio is silent, the user cannot perceive the audio, namely, no difference exists for the user, and the user experience is guaranteed.

In one embodiment, the screen projection method further comprises: acquiring screen projection codes different from the screen projection codes; sending the different screen projection codes and the terminal identification to a server; and the sent different screen projection codes and the terminal identifiers are used for indicating the server to add the screen projection equipment corresponding to the inquired screen projection equipment identifiers into screen projection connection after inquiring the screen projection equipment identifiers related to the different screen projection codes.

Specifically, the terminal may display the screen-cast notification in the notification bar, or may display the screen-cast notification through the floating window. And the screen projection notification comprises the number of screen projection devices connected with the screen projection, screen projection device identification of the screen projection devices, a screen projection starting entry or a screen projection ending entry and the like. The terminal can detect the triggering operation of the user on the screen-casting notification, and enters a screen-casting detail page after the triggering operation of the screen-casting notification is detected. The screen projection method comprises the steps that a screen projection code acquisition page is entered through an adding entry of a screen projection detail page, screen projection codes different from the screen projection codes acquired in the previous step are acquired, the different screen projection codes and terminal identifications are sent to a server, and therefore after screen projection equipment identifications associated with the different screen projection codes are inquired by the server, screen projection equipment corresponding to the inquired screen projection equipment identifications are added into screen projection connection, and therefore local screen projection is achieved to multiple screen projection equipment.

For example, FIG. 9 shows a schematic diagram of an interface for displaying a screen-shot notification in one embodiment. Referring to the left panel of fig. 9, the interface includes displaying a screen-cast notification 901 in the notification bar. Referring to the right hand side of fig. 9, the interface includes displaying a screen-cast notification 902 in a top-positioned floating window. After detecting the click operation on the screen-casting notification 901 or the screen-casting notification 902, the terminal will enter a screen-casting detail page as shown in the left diagram of fig. 10. The screen projection detail page includes a screen projection device identifier 1001 of a screen projection device to which the screen is currently projected, and a screen projection device addition entry 1002. The terminal can continue to detect the click operation of the user on the screen projection device adding inlet 1002, and enter a screen projection code acquisition page as shown in the right diagram of fig. 10, and the user can continue to input screen projection codes on the page to project screens to more screen projection devices.

In the embodiment, an implementation mode that the screen is continuously projected to other screen projection equipment in the screen projection process is provided, so that the application range of the screen projection method is widened, and the effect is obvious particularly in the scenes such as a conference of the opposite party and the like.

In one embodiment, after the screen projection connection is successful, the terminal can directly display the screen projection detail page. The terminal can quit the screen-casting detail page for screen casting according to the user instruction, and no new screen-casting equipment is added. The terminal can also enter a screen projection code acquisition page through an adding entry of the screen projection detail page according to a user instruction, and screen projection codes different from the previously acquired screen projection codes are acquired so as to add new screen projection equipment.

FIG. 11 is a flowchart illustrating a method for screen projection in one embodiment. The present embodiment is mainly illustrated by applying the screen projection method to the screen projection device 130 in fig. 1. Referring to fig. 11, the screen projection method specifically includes the following steps:

s1102, displaying screen projection codes; the screen projection code is used for indicating the terminal to send the screen projection code and the terminal identification of the terminal to the server after the screen projection code is obtained; and the screen projection code and the terminal identification are used for indicating the server to establish screen projection connection between the terminal and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code.

Specifically, the screen projecting device can send a screen projecting code acquisition request carrying a local screen projecting device identifier to the server, the server randomly generates a screen projecting code after acquiring the screen projecting code acquisition request, stores the screen projecting code and the screen projecting device identifier in an associated manner on the server, and sends the screen projecting code to the screen projecting device for display.

Therefore, after the terminal acquires the screen projection code displayed by the screen projection equipment, the screen projection code and the terminal identification of the terminal are sent to the server. The server searches the screen-projecting equipment identification stored in association with the screen-projecting code, and after the screen-projecting equipment identification is found, screen-projecting connection between the terminal and the screen-projecting equipment corresponding to the screen-projecting equipment identification is established.

In one embodiment, the terminal can also establish a binding relationship among a plurality of screen projection device identifications in advance according to a user instruction, and upload the binding relationship to the server for storage so as to bind the plurality of screen projection devices. In this way, the screen projection device identifier searched by the server may include not only the screen projection device identifier stored in association with the screen projection code, but also the screen projection device identifier having a binding relationship with the screen projection device identifier. Whether the screen projection device identification which has a binding relationship with the screen projection device identification is included can be determined according to user selection.

Taking the example of a multi-party conference scenario, screen projection devices in conference rooms in different geographic locations (Guangzhou, Shenzhen, and Beijing) in the same business department can be bound in advance. Therefore, when three parties carry out a conference, the screen projection connection can be completed at the same time in three places according to one screen projection operation selected by a user. And when the meeting is not carried out by three parties, only screen projection equipment for displaying screen projection codes is connected with the screen projection equipment for screen projection according to the selection of the user.

For example, fig. 12 shows a schematic diagram of an interface for displaying screen-cast codes in one embodiment, and referring to fig. 12, the interface includes screen-cast codes 1201.

In one embodiment, the screen projection device may be a screen projection-specific electronic device, such as a conference box or the like, that only integrates a screen projection application. After the screen projection equipment is started, the screen projection application is automatically operated, and the screen projection code is obtained from the server to be displayed. Therefore, screen projection convenience and efficiency are provided through the specificity of the equipment. Of course, the screen projection device may be an electronic device integrated with multiple applications, and after the screen projection device is started, the screen projection application or other applications integrated with screen projection codes are run according to a user instruction.

And S1104, receiving screen data which is forwarded by the server according to the screen projection connection and is initiated to be transmitted by the terminal.

In one embodiment, when the screen projection device and the terminal access the same wireless local area network, the screen projection device can also receive screen data sent by the terminal directly through the wireless local area network.

S1106, screen data is displayed.

Specifically, the screen projection device may render a displayable picture according to the screen data by the image processor, and transmit the displayable picture to the display for displaying. The screen projection equipment can also be used for rendering an image which can be displayed according to the screen data and then forming optical projection in a physical optical mode.

For example, FIG. 13 shows a schematic diagram of display screen data in one embodiment. Referring to the left diagram of fig. 13, the screen projection effect of the mobile phone in the vertical screen display is shown. Referring to the right diagram of fig. 13, the screen projection effect of the mobile phone in the horizontal screen display is shown.

According to the screen projection method, the screen projection code is displayed locally, so that the terminal can send the screen projection code and the terminal identification of the terminal to the server after acquiring the screen projection code, and the server establishes screen projection connection between the terminal and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code. Therefore, the terminal can transmit the screen data to the server and then the server transmits the screen data to the local for displaying, and therefore screen projection from the terminal to the local is completed. Therefore, the screen can be projected without being locally connected with the terminal in a wired mode or being connected to the same wireless local area network with the terminal, and the application range of the screen projection is greatly widened.

In one embodiment, the screen data includes layer data for a plurality of layers. Receiving screen data which is forwarded by a server according to screen projection connection and is transmitted by a terminal, wherein the screen data comprises: and receiving the layer data of the plurality of layers, which are respectively forwarded according to the layers by the screen projection connection and are respectively initiated and transmitted by the terminal, by the server. Display screen data, comprising: and displaying the layer data of the plurality of layers on different viewing layers according to the layers.

Specifically, when receiving the layer data, the screen projection device displays or updates and displays the layer data on the corresponding viewing layer. The number of the layers is the same as that of the viewing layers, and one layer of layer corresponds to one viewing layer. The positional relationship between the layers of the drawing is the same as the positional relationship between the corresponding layers of the view.

When the terminal sends the layer data, the terminal can mark the layer identifier for the layer data, so that when the layer data is forwarded to the screen projection device, the screen projection device can determine the view layer to be displayed by the layer data according to the layer identifier, and the layer data is displayed or updated and displayed on the view layer.

In this embodiment, layer data of different layers are transmitted respectively, so that local display can be performed conveniently when each layer data is received, when new layer data is transmitted, only the layer data replaced by the layer data is updated, and re-rendering of all data is not needed, which greatly reduces workload and enables screen projection fluency to be higher.

In one embodiment, the layer data for the plurality of layers includes interface data for the interface layer and input indicator data for the input indicator layer. Receiving layer data of a plurality of layers, which are respectively forwarded according to layers and transmitted by a terminal respectively according to screen projection connection by a server, wherein the receiving step comprises the following steps: and receiving interface data and input indicator data which are respectively forwarded by the server according to the screen projection connection and are respectively transmitted by the terminal. Displaying the layer data of a plurality of layers on different viewing layers according to the layers, comprising: and displaying interface data on a first viewing layer, and displaying input indicator data on a second viewing layer positioned above the first viewing layer.

Wherein, the view layer is a layer for drawing screen data. It will be appreciated that the input indicator is an indicator of the vertical and horizontal coordinate positioning on the display interface of the display. Then the viewing layer in which the input indicator data is located should be located above the viewing layer in which the interface data is located.

For the specific implementation process of each step executed by the terminal in the screen projection method, reference may be made to the above description of the specific implementation process of each step executed by the server, and details are not described here again.

In one embodiment, the screen projection method further comprises: when a screen projection code updating condition is met, acquiring a local screen projection equipment identifier; sending a screen projection code acquisition request carrying a local screen projection equipment identifier to a server; receiving a new screen projection code returned by the server in response to the screen projection code acquisition request; and updating and displaying the new screen projection code.

And the screen-projecting code updating condition is a constraint condition which needs to be met by updating the screen-projecting code. That is, the screen-casting code is updated only when the constraint condition of the screen-casting code updating condition is satisfied. The screen-projecting code updating condition may be a constraint condition of a time node, a constraint condition of a user instruction, a constraint condition of a network environment, or the like.

In one embodiment, the screen projection method further comprises: starting timing when a new screen projection code is displayed; and when the timing duration reaches the effective duration of the displayed screen projecting codes, or the timing duration does not reach the effective duration of the displayed screen projecting codes and network environment switching occurs, judging that the screen projecting code updating conditions are met currently.

Wherein, the effective duration is the effective time length of the screen projection code. The effective duration of the screen-projecting code can be issued together when the screen-projecting code is issued by the server, or a fixed effective duration stipulated in advance, such as 5 minutes.

Specifically, the screen projection terminal starts timing when a new screen projection code is displayed, judges that a screen projection code updating condition is met currently when the timing duration reaches the effective duration of the displayed screen projection code, sends a screen projection code acquisition request carrying a local screen projection equipment identifier to the server, receives the new screen projection code returned by the server in response to the screen projection code acquisition request, and updates and displays the new screen projection code. Wherein the new screen projection code comprises a screen projection code displayed for the first time and a new screen projection code displayed later.

In one embodiment, the terminal may also determine that the screen-casting code update condition is currently satisfied when the timing duration does not reach the effective duration of the displayed screen-casting code but network environment switching occurs. The network environment switching refers to the change of a network accessed by the screen projection equipment.

In one embodiment, the terminal may further determine that the screen-casting code updating condition is currently met when a screen-casting code updating instruction triggered by a user is received or the current screen casting is finished.

In the embodiment, a screen projection code updating way is provided, the problem of malicious screen projection caused by fixed and invariable screen projection codes is avoided, and the normal screen projection is ensured to be smoothly carried out.

In one embodiment, when the screen projection device displays the screen projection code, the screen projection device can also switch to display a screen projection operation guide for guiding a user to perform screen projection operation.

In one embodiment, the screen projection device starts timing after sending a screen projection code acquisition request carrying a local screen projection device identifier to the server, and when the timing duration reaches the waiting duration and does not receive the screen projection code fed back by the server, disconnection with the server can be judged, and prompt information of network abnormity is displayed to remind a user to replace the network or try again later.

FIG. 14 is a flowchart illustrating a method for screen projection in one embodiment. The present embodiment is mainly illustrated by applying the screen projection method to the server 120 in fig. 1. Referring to fig. 14, the screen projection method specifically includes the following steps:

s1402, screen projection codes and terminal identifications are obtained.

And S1404, inquiring the screen projection equipment identification associated with the screen projection code.

And S1406, establishing a screen projection connection between the terminal corresponding to the terminal identifier and the screen projection equipment corresponding to the screen projection equipment identifier.

Specifically, after inquiring the screen projection equipment identifier associated with the screen projection code, the server checks whether the screen projection equipment identifier is correspondingly marked as a screen projection state. If the screen projection equipment identifier is correspondingly marked as a screen projection state, judging that the screen projection equipment corresponding to the screen projection equipment identifier establishes screen projection connection with other terminals, and then not establishing the terminal corresponding to the terminal identifier, and feeding back a screen projection failure notice to the terminal corresponding to the terminal identifier.

If the screen projection equipment identifier is not correspondingly marked to be in a screen projection state, judging that the screen projection equipment corresponding to the screen projection equipment identifier is not in screen projection connection with other terminals, establishing a terminal corresponding to the terminal identifier, performing screen projection connection with the screen projection equipment corresponding to the screen projection equipment identifier, and feeding back a notification of screen projection success to the terminal corresponding to the terminal identifier. And the server marks the corresponding mark of the screen projection equipment identifier as a screen projection state.

In this embodiment, one screen projection device establishes a screen projection connection with only one terminal. In this way, the screen projection device can be used only for displaying the screen data of the terminal.

In one embodiment, after querying the screen projection device identifier associated with the screen projection code, the server checks whether the number of the terminal identifiers recorded corresponding to the screen projection device identifier reaches a preset number threshold. If the number of the terminal identifications recorded corresponding to the screen projection equipment identification reaches a preset number threshold, judging that the terminal establishing screen projection connection with the screen projection equipment corresponding to the screen projection equipment identification reaches an upper limit, then not establishing the terminal corresponding to the terminal identification, and feeding back a screen projection failure notice to the terminal corresponding to the terminal identification.

If the number of the terminal identifications recorded corresponding to the screen projection equipment identification does not reach a preset number threshold value, judging that the terminal establishing screen projection connection with the screen projection equipment corresponding to the screen projection equipment identification does not reach an upper limit, establishing the terminal corresponding to the terminal identification, establishing screen projection connection between the terminal establishing screen projection connection and the screen projection equipment corresponding to the screen projection equipment identification, and feeding back a screen projection failure notice to the terminal corresponding to the terminal identification. And the server correspondingly records the terminal identification to the screen projection equipment identification.

In this embodiment, one screen projection device can establish screen projection connection with multiple terminals. Therefore, the screen projection equipment can be used for displaying the screen data of the plurality of terminals in a split screen mode.

And S1408, receiving the screen data uploaded by the terminal.

And S1410, forwarding the screen data to the screen projection equipment according to the screen projection connection.

Specifically, after receiving screen data uploaded by the terminal, the server checks screen projection equipment which establishes screen projection connection with the terminal, and forwards the screen data to the screen projection equipment.

According to the screen projection method, after the screen projection code and the terminal identification are obtained, the screen projection equipment identification associated with the screen projection code is automatically inquired, so that screen projection connection between the terminal corresponding to the terminal identification and the screen projection equipment corresponding to the screen projection equipment identification is established. Therefore, the screen data uploaded by the terminal can be transferred to the screen projection equipment through the screen projection connection, the terminal is not required to be in wired connection with the screen projection equipment, the screen projection can be completed without being connected to the same wireless local area network with the screen projection equipment, and the screen projection application range is greatly widened.

For the specific implementation process of each step executed by the server in the screen projection method, reference may be made to the description of the specific implementation process of each step executed by the server, and details are not described herein again.

Fig. 15 shows a sequence diagram of the interaction of the terminal, the server and the screen projection device in one embodiment. Referring to fig. 15, after the screen projection device is started, the screen projection code is pulled to the server and displayed, and when the screen projection code update condition is satisfied, the local screen projection device identifier is obtained; and sending a screen projection code acquisition request carrying the local screen projection equipment identifier to a server. And the server returns a new screen projection code after receiving the screen projection code acquisition request, so that the screen projection equipment updates and displays the new screen projection code.

The terminal acquires a screen projection code and a local terminal identification which are input by a user and displayed by screen projection equipment, and sends the screen projection code and the terminal identification to the server. After receiving the screen projection code and the terminal identification, the server searches for a screen projection equipment identification associated with the screen projection code, establishes screen projection connection between the terminal corresponding to the terminal identification and the screen projection equipment corresponding to the screen projection equipment identification, feeds back a notification of screen projection success to the terminal, and sends a screen projection notification to the screen projection equipment.

And after the screen projection connection is successful, the terminal acquires local screen data and uploads the screen data to the server. And after receiving the screen data, the server forwards the screen data to the screen projection equipment for display.

The terminal can acquire screen projection codes different from the screen projection codes acquired before again, and sends the different screen projection codes and the terminal identification to the server. After receiving the different screen projection codes and the terminal identifications, the server inquires screen projection equipment identifications associated with the different screen projection codes, and then adds screen projection equipment corresponding to the inquired screen projection equipment identifications into the screen projection connection so as to project the screen of the terminal to the plurality of screen projection equipment.

The terminal can also receive a first network address of the screen projection equipment issued by the server and acquire a local second network address. When the first network address and the second network address belong to the same wireless local area network, when new screen data are obtained, the new screen data are directly sent to the screen projection equipment according to the first network address.

Specifically, the example is in a multi-party conferencing scenario. And conference participants participate in the same conference in conference rooms with different geographic positions (Guangzhou, Shenzhen and Beijing). The conference host can start the screen projection application installed on the terminal, and the screen projection code displayed by the screen projection equipment in the Guangzhou conference room is input in the screen projection application, so that the terminal can send the screen projection code and the local terminal identification to the server, and the server further establishes screen projection connection between the terminal and the screen projection equipment in the Guangzhou conference room. The conference moderator can continue to input the screen casting code displayed by the screen casting equipment in the Shenzhen conference room after the screen casting connection is successful, so that the terminal can send the screen casting code and the local terminal identifier to the server, and the server then adds the screen casting equipment in the Shenzhen conference room into the screen casting connection. The conference host can continue to input the screen-casting code displayed by the screen-casting equipment in the Beijing conference room in the screen-casting application, so that the terminal can send the screen-casting code and the local terminal identifier to the server, and the server can add the screen-casting equipment in the Beijing conference room into the screen-casting connection. Therefore, the screen data of the terminal can be projected to the projection equipment of the three conference rooms of Guangzhou, Shenzhen and Beijing, and the participants in the three conference rooms can watch the same content.

It should be understood that, although the steps in the flowcharts of the above embodiments are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not limited to being performed in the exact order illustrated and, unless explicitly stated herein, may be performed in other orders. Moreover, at least a part of the steps in the above embodiments may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or the stages is not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a part of the sub-steps or the stages of other steps.

In one embodiment, as shown in fig. 16, a screen projecting device 1600 is provided. Referring to fig. 16, the screen projection apparatus 1600 includes: a first obtaining module 1601, a first sending module 1602, a second obtaining module 1603, and a second sending module 1604.

The first obtaining module 1601 is configured to obtain a screen-projecting code and a local terminal identifier.

A first sending module 1602, configured to send the screen projection code and the terminal identifier to the server; and the screen projection code and the terminal identification are used for indicating the server to establish screen projection connection between the terminal corresponding to the terminal identification and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code.

A second obtaining module 1603, configured to obtain local screen data after the screen projection connection is successful.

A second sending module 1604, configured to upload the screen data to the server; and the uploaded screen data is used for instructing the server to forward the screen data to the screen projection equipment according to the screen projection connection.

In one embodiment, the second sending module 1604 is further configured to obtain a first network address of the screen projection device and a local second network address; when the first network address and the second network address belong to the same wireless local area network, when new screen data are obtained, the new screen data are directly sent to the screen projection equipment according to the first network address.

In one embodiment, the screen data includes layer data for a plurality of layers. The second obtaining module 1603 is further configured to obtain layer data of a plurality of layers according to different frame rates after the screen projection connection is successful. The second sending module 1604 is further configured to upload the layer data of the multiple layers to a server according to the layers; and the layer data of the plurality of layers are respectively uploaded and used for indicating the server to respectively forward the layer data of the plurality of layers to the screen projection equipment according to the layers according to the screen projection connection.

In one embodiment, the layer data for the plurality of layers includes interface data for the interface layers and input indicator data for the input indicator layers. The second obtaining module 1603 is further configured to obtain the interface data at the first frame rate after the screen-on connection is successful, and obtain the input indicator data at a second frame rate which is greater than the first frame rate. The second sending module 1604 is further configured to upload the interface data and the input indicator data to the server, respectively; and the interface data and the input indicator data which are respectively uploaded are used for indicating the server to respectively forward the interface data and the input indicator data to the screen projection equipment according to the screen projection connection.

In one embodiment, the first obtaining module 1601 is further configured to start a screen projection host process; and acquiring the screen projection code and the local terminal identification through the screen projection main process. The first sending module 1602 is further configured to send the screen projection code and the terminal identifier to the server through the screen projection host process. The second obtaining module 1603 is further configured to start a screen data obtaining sub-process corresponding to the screen casting main process after the screen casting connection is successful and when the screen data obtaining right exists corresponding to the screen casting main process; and acquiring local screen data through the screen data acquisition subprocess and transmitting the acquired screen data to the screen projection main process. The second sending module 1604 is further configured to perform the step of uploading the screen data to the server by the screen-casting host process.

As shown in fig. 17, in an embodiment, the screen projecting apparatus 1600 further includes a processing module 1605, configured to play the silent audio through the screen projecting main process when the screen projecting main process is switched from the foreground operation to the background operation; and when the screen projection main process is switched from the background operation to the foreground operation, the silent audio is stopped being played through the screen projection main process.

In one embodiment, the first obtaining module 1601 is further configured to obtain a screen-casting code different from the screen-casting code. The first sending module 1602 is further configured to send the different screen projection codes and the terminal identifiers to the server; and the sent different screen projection codes and the terminal identifiers are used for indicating the server to add the screen projection equipment corresponding to the inquired screen projection equipment identifiers into screen projection connection after inquiring the screen projection equipment identifiers related to the different screen projection codes.

As shown in fig. 18, in one embodiment, a screen projection device 1800 is provided. Referring to fig. 18, the screen projection apparatus 1800 includes: a first display module 1801, a receiving module 1802, and a second display module 1803.

A first display module 1801, configured to display a screen projection code; the screen projection code is used for indicating the terminal to correspondingly send the screen projection code and the terminal identification of the terminal to the server after the screen projection code is obtained; and the screen projection code and the terminal identification are used for indicating the server to establish screen projection connection between the terminal and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code.

A receiving module 1802, configured to receive screen data that is forwarded by the server according to the screen projection connection and is initiated by the terminal for transmission.

A second display module 1803, configured to display screen data.

In one embodiment, the screen data includes layer data for a plurality of layers. The receiving module 1802 is further configured to receive layer data of a plurality of layers, which are respectively forwarded by the server according to the layer according to the screen-casting connection and are respectively initiated by the terminal for transmission. The second display module 1803 is further configured to display layer data of multiple layers on different viewing layers according to the layers.

In one embodiment, the layer data for the plurality of layers includes interface data for the interface layer and input indicator data for the input indicator layer. The receiving module 1802 is further configured to receive interface data and input indicator data that are respectively forwarded by the server according to the screen-casting connection and that are respectively initiated to be transmitted by the terminal. The second display module 1803 is further configured to display the interface data on the first view layer, and display the input indicator data on a second view layer located above the first view layer.

In one embodiment, the first display module 1801 is further configured to obtain a local screen projection device identifier when a screen projection code update condition is met; sending a screen projection code acquisition request carrying a local screen projection equipment identifier to a server; receiving a new screen projection code returned by the server in response to the screen projection code acquisition request; and updating and displaying the new screen projection code.

In one embodiment, the first display module 1801 is further configured to start timing each time a new screen shot code is displayed; and when the timing duration reaches the effective duration of the displayed screen projecting codes, or the timing duration does not reach the effective duration of the displayed screen projecting codes and network environment switching occurs, judging that the screen projecting code updating conditions are met currently.

In one embodiment, as shown in fig. 19, a screen projection device 1900 is provided. Referring to fig. 19, the screen projection device 1900 includes: an obtaining module 1901, a querying module 1902, an establishing module 1903, a receiving module 1904, and a forwarding module 1905.

An obtaining module 1901, configured to obtain a screen projection code and a terminal identifier.

The query module 1902 is configured to query the screen projection device identifier associated with the screen projection code.

The establishing module 1903 is configured to establish a screen-projecting connection between a terminal corresponding to the terminal identifier and a screen-projecting device corresponding to the screen-projecting device identifier.

A receiving module 1904, configured to receive screen data uploaded by a terminal.

And a forwarding module 1905, configured to forward the screen data to the screen projection device according to the screen projection connection.

FIG. 20 is a diagram illustrating an internal structure of a computer device in one embodiment. The computer device may specifically be the terminal 110 in fig. 1. As shown in fig. 20, the computer device includes a processor, a memory, a network interface, an input device, and a display screen connected through a system bus. The memory comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program that, when executed by the processor, causes the processor to implement a screen projection method. The internal memory may also have a computer program stored therein, which when executed by the processor, causes the processor to perform a screen projection method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, or an external keyboard, a touch pad or a mouse, and the like. Those skilled in the art will appreciate that the architecture shown in fig. 20 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

FIG. 21 is a diagram that illustrates an internal structure of the computer device in one embodiment. The computer device may be specifically the server 110 or the screen projection device 130 in fig. 1. As shown in fig. 21, the computer apparatus includes a processor, a memory, and a network interface connected by a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program that, when executed by the processor, causes the processor to implement a screen projection method. The internal memory may also have a computer program stored therein, which when executed by the processor, causes the processor to perform a screen projection method. It will be appreciated by those skilled in the art that the configuration shown in fig. 21 is a block diagram of only a portion of the configuration associated with the present application, and is not intended to limit the computing device to which the present application may be applied, and that a particular computing device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, the screen projection apparatus provided in the present application may be implemented in the form of a computer program, where the computer program may be executed on a computer device shown in fig. 20 or fig. 21, and a nonvolatile storage medium of the computer device may store various program modules that constitute the screen projection apparatus, for example, a first obtaining module 1601, a first sending module 1602, a second obtaining module 1603, a second sending module 1604, and the like shown in fig. 16. The computer program comprised of the respective program modules causes the processor to execute the steps in the screen projection method of the various embodiments of the present application described in the present specification.

For example, the computer device shown in fig. 20 may obtain the screen-casting code and the local terminal identifier through the first obtaining module 1601 in the screen-casting apparatus 1600 shown in fig. 16. Sending the screen-casting code and the terminal identifier to a server through a first sending module 1602; and the screen projection code and the terminal identification are used for indicating the server to establish screen projection connection between the terminal corresponding to the terminal identification and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code. After the screen-on connection is successfully performed, the second obtaining module 1603 obtains local screen data. Uploading the screen data to the server through the second sending module 1604; and the uploaded screen data is used for instructing the server to forward the screen data to the screen projection equipment according to the screen projection connection.

For another example, the computer device shown in fig. 21 can display the screen projection code through the first display module 1801 in the screen projection apparatus 1800 shown in fig. 18; the screen projection code is used for indicating the terminal to correspondingly send the screen projection code and the terminal identification of the terminal to the server after the screen projection code is obtained; and the screen projection code and the terminal identifier are used for indicating the server to establish screen projection connection between the terminal and the screen projection equipment corresponding to the screen projection equipment identifier after finding the screen projection equipment identifier associated with the screen projection code. The screen data forwarded by the server according to the screen projection connection and initiated by the terminal for transmission is received through the receiving module 1802. The screen data is displayed through the second display module 1803.

For another example, the computer device shown in fig. 21 may obtain the screen projection code and the terminal identifier through the obtaining module 1901 in the screen projection apparatus 1900 shown in fig. 19. The screen-casting device identification associated with the screen-casting code is queried by the query module 1902. The terminal corresponding to the terminal identifier is established through the establishing module 1903, and the screen projection connection between the terminal and the screen projection device corresponding to the screen projection device identifier is established. The screen data uploaded by the terminal is received through the receiving module 1904. The screen data is forwarded to the screen projection device according to the screen projection connection through the forwarding module 1905.

In one embodiment, a screen projection system is provided and comprises a terminal, a server and a screen projection device. The screen projection equipment is used for displaying screen projection codes; the terminal is used for acquiring a screen projection code displayed by the screen projection equipment and a local terminal identifier; sending the screen projection code and the terminal identification to a server; the server is used for acquiring screen projection codes and terminal identifications sent by the terminals; inquiring a screen projection equipment identifier associated with the screen projection code; establishing a terminal corresponding to the terminal identifier, and performing screen projection connection between the terminal and screen projection equipment corresponding to the screen projection equipment identifier; the terminal is also used for acquiring local screen data after screen projection connection is successful; uploading screen data to a server; the server is also used for receiving screen data uploaded by the terminal; forwarding the screen data to the screen projection equipment according to the screen projection connection; the screen projection equipment is also used for receiving screen data which is forwarded by the server according to the screen projection connection and is initiated by the terminal to be transmitted; and displaying the screen data.

In one embodiment, the terminal is further configured to obtain a first network address of the screen projection device and a local second network address; when the first network address and the second network address belong to the same wireless local area network, when new screen data are obtained, the new screen data are directly sent to the screen projection equipment according to the first network address.

In one embodiment, the screen data includes layer data for a plurality of layers. The terminal is also used for respectively acquiring the layer data of a plurality of layers according to different frame rates after the screen projection connection is successful; and uploading the layer data of the plurality of layers to a server according to the layers. The server is further used for forwarding the layer data of the plurality of layers to the screen projection device according to the layers according to the screen projection connection. The screen projection equipment is also used for receiving the layer data of the plurality of layers which are respectively forwarded by the server according to the screen projection connection according to the layers and are respectively transmitted by the terminal; and displaying the layer data of the plurality of layers on different viewing layers according to the layers.

In one embodiment, the layer data for the plurality of layers includes interface data for the interface layers and input indicator data for the input indicator layers. The terminal is also used for acquiring interface data according to a first frame rate after screen projection connection is successful, and acquiring input indicator data according to a second frame rate which is greater than the first frame rate; and uploading the interface data and the input indicator data to a server respectively. The server is also used for screen projection connection to respectively forward the interface data and the input indicator data to the screen projection equipment. The screen projection equipment is also used for receiving interface data and input indicator data which are respectively forwarded by the server according to the screen projection connection and are respectively transmitted by the terminal; and displaying interface data on the first viewing layer, and displaying input indicator data on a second viewing layer positioned above the first viewing layer.

In one embodiment, the terminal is further configured to start a screen projection main process; executing the steps of acquiring a screen projection code and a local terminal identifier through a screen projection main process, and sending the screen projection code and the terminal identifier to a server; after the screen projection connection is successful and when the screen data acquisition right exists corresponding to the screen projection main process, starting a screen data acquisition sub-process corresponding to the screen projection main process; executing the step of acquiring local screen data through the screen data acquisition subprocess, and transmitting the acquired screen data to the screen projection main process through the screen data acquisition subprocess; and through the screen projection main process, the step of uploading the screen data to the server is executed.

In one embodiment, the terminal is further configured to play the soundless audio through the screen casting main process when the screen casting main process is switched from foreground operation to background operation; and when the screen projection main process is switched from background operation to foreground operation, stopping playing the soundless audio through the screen projection main process.

In one embodiment, the terminal is further configured to obtain a screen projection code different from the screen projection code; and sending the different screen projection codes and the terminal identification to a server. The server is also used for adding the screen projection equipment corresponding to the inquired screen projection equipment identification into the screen projection connection after inquiring the screen projection equipment identification associated with the different screen projection codes.

In one embodiment, the screen projection device is further configured to obtain a local screen projection device identifier when a screen projection code update condition is met; sending a screen projection code acquisition request carrying a local screen projection equipment identifier to a server; receiving a new screen projection code returned by the server in response to the screen projection code acquisition request; and updating and displaying the new screen projection code.

In one embodiment, the screen projection device is further configured to start timing each time a new screen projection code is displayed; and when the timing duration reaches the effective duration of the displayed screen projecting codes, or the timing duration does not reach the effective duration of the displayed screen projecting codes and network environment switching occurs, judging that the screen projecting code updating conditions are met currently.

In one embodiment, a computer-readable storage medium is provided, having stored thereon a computer program which, when executed by a processor, causes the processor to perform the steps of: acquiring a screen projection code and a local terminal identifier; sending the screen projection code and the terminal identification to a server; the screen-projecting code and the terminal identification are sent and used for indicating the server to establish screen-projecting connection between the terminal corresponding to the terminal identification and the screen-projecting equipment corresponding to the screen-projecting equipment identification after the screen-projecting equipment identification related to the screen-projecting code is found out; after screen projection connection is successful, local screen data are obtained; uploading screen data to a server; and the uploaded screen data is used for instructing the server to forward the screen data to the screen projection equipment according to the screen projection connection.

In one embodiment, the computer program further causes the processor to perform the steps of: acquiring a first network address and a local second network address of the screen projection equipment; when the first network address and the second network address belong to the same wireless local area network, when new screen data are obtained, the new screen data are directly sent to the screen projection equipment according to the first network address.

In one embodiment, the screen data includes layer data for a plurality of layers. After the screen projection connection is successful, local screen data are acquired, and the method comprises the following steps: and respectively acquiring the layer data of the plurality of layers according to different frame rates after the screen projection connection is successful. Uploading screen data to a server, comprising: respectively uploading the layer data of the plurality of layers to a server according to the layers; and the layer data of the plurality of layers are respectively uploaded and are used for indicating the server to respectively forward the layer data of the plurality of layers to the screen projection equipment according to the layers according to the screen projection connection.

In one embodiment, the layer data for the plurality of layers includes interface data for the interface layer and input indicator data for the input indicator layer. After the screen projection connection is successful, the layer data of a plurality of layers are respectively obtained according to different frame rates, and the method comprises the following steps: and after the screen projection connection is successful, acquiring interface data according to a first frame rate, and acquiring input indicator data according to a second frame rate which is greater than the first frame rate. Uploading layer data of a plurality of layers to a server according to the layers respectively, comprising: uploading the interface data and the input indicator data to a server respectively; and the interface data and the input indicator data which are respectively uploaded are used for indicating the server to respectively forward the interface data and the input indicator data to the screen projection equipment according to the screen projection connection.

In one embodiment, the computer program further causes the processor to perform the steps of: starting a screen projection main process; executing the steps of acquiring a screen projection code and a local terminal identifier through a screen projection main process, and sending the screen projection code and the terminal identifier to a server; after the screen projection connection is successful and when the screen data acquisition right exists corresponding to the screen projection main process, starting a screen data acquisition sub-process corresponding to the screen projection main process; executing the step of acquiring local screen data through the screen data acquisition subprocess, and transmitting the acquired screen data to the screen projection main process through the screen data acquisition subprocess; and uploading the screen data to a server through the screen projection main process.

In one embodiment, the computer program further causes the processor to perform the steps of: when the screen projection main process is switched from foreground operation to background operation, playing the soundless audio through the screen projection main process; and when the screen projection main process is switched from background operation to foreground operation, stopping playing the soundless audio through the screen projection main process.

In one embodiment, the computer program further causes the processor to perform the steps of: acquiring a screen projection code different from the screen projection code; sending the different screen projection codes and the terminal identification to a server; and the transmitted different screen projection codes and the terminal identification are used for indicating the server to add the screen projection equipment corresponding to the inquired screen projection equipment identification into screen projection connection after inquiring the screen projection equipment identification associated with the different screen projection codes.

In one embodiment, a computer-readable storage medium is provided, having stored thereon a computer program which, when executed by a processor, causes the processor to perform the steps of: displaying the screen projection code; the screen projection code is used for indicating the terminal to send the screen projection code and the terminal identification of the terminal to the server after the screen projection code is obtained; the screen projection code and the terminal identification are used for indicating the server to establish screen projection connection between the terminal and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code; receiving screen data which is forwarded by the server according to the screen projection connection and is initiated to be transmitted by the terminal; and displaying the screen data.

In one embodiment, the screen data includes layer data for a plurality of layers. Receiving screen data which is forwarded by a server according to the screen projection connection and is transmitted by a terminal, wherein the screen data comprises the following steps: and receiving the layer data of the plurality of layers, which are respectively forwarded according to the layers by the screen projection connection and are respectively initiated and transmitted by the terminal, by the server. Display screen data, comprising: and displaying the layer data of the plurality of layers on different viewing layers according to the layers.

In one embodiment, the layer data for the plurality of layers includes interface data for the interface layers and input indicator data for the input indicator layers. Receiving layer data of a plurality of layers, which are respectively forwarded according to layers and transmitted by a terminal respectively according to screen projection connection by a server, wherein the receiving step comprises the following steps: and receiving interface data and input indicator data which are respectively forwarded by the server according to the screen projection connection and are respectively transmitted by the terminal. Displaying the layer data of a plurality of layers on different viewing layers according to the layers, comprising: and displaying interface data on a first viewing layer, and displaying input indicator data on a second viewing layer positioned above the first viewing layer.

In one embodiment, the computer program further causes the processor to perform the steps of: when the screen projection code updating condition is met, acquiring a local screen projection equipment identifier; sending a screen projection code acquisition request carrying a local screen projection equipment identifier to a server; receiving a new screen projection code returned by the server in response to the screen projection code acquisition request; and updating and displaying the new screen projection code.

In one embodiment, the computer program further causes the processor to perform the steps of: starting timing when a new screen projection code is displayed; and when the timing duration reaches the effective duration of the displayed screen projecting code, or the timing duration does not reach the effective duration of the displayed screen projecting code and network environment switching occurs, judging that the screen projecting code updating condition is met currently.

In one embodiment, a computer-readable storage medium is provided, having stored thereon a computer program which, when executed by a processor, causes the processor to perform the steps of: acquiring a screen projection code and a terminal identifier; inquiring screen projection equipment identification associated with the screen projection code; establishing a terminal corresponding to the terminal identifier and screen projection connection between the terminal and screen projection equipment corresponding to the screen projection equipment identifier; receiving screen data uploaded by a terminal; and forwarding the screen data to the screen projection equipment according to the screen projection connection.

In one embodiment, there is provided a computer device comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of: acquiring a screen projection code and a local terminal identifier; sending the screen projection code and the terminal identification to a server; the screen-projecting code and the terminal identification are sent and used for indicating the server to establish screen-projecting connection between the terminal corresponding to the terminal identification and the screen-projecting equipment corresponding to the screen-projecting equipment identification after the screen-projecting equipment identification related to the screen-projecting code is found out; after the screen projection connection is successful, local screen data are obtained; uploading screen data to a server; and the uploaded screen data is used for instructing the server to forward the screen data to the screen projection equipment according to the screen projection connection.

In one embodiment, the screen data includes layer data for a plurality of layers. After the screen projection connection is successful, acquiring local screen data, including: and respectively acquiring the layer data of the plurality of layers according to different frame rates after the screen projection connection is successful. Uploading screen data to a server, comprising: respectively uploading the layer data of the plurality of layers to a server according to the layers; and the layer data of the plurality of layers are respectively uploaded and are used for indicating the server to respectively forward the layer data of the plurality of layers to the screen projection equipment according to the layers according to the screen projection connection.

In one embodiment, the layer data for the plurality of layers includes interface data for the interface layer and input indicator data for the input indicator layer. After the screen projection connection is successful, layer data of a plurality of layers are respectively acquired according to different frame rates, and the method comprises the following steps: and after the screen projection connection is successful, acquiring interface data according to a first frame rate, and acquiring input indicator data according to a second frame rate which is greater than the first frame rate. Uploading layer data of a plurality of layers to a server according to the layers respectively, and the method comprises the following steps: uploading the interface data and the input indicator data to a server respectively; and the interface data and the input indicator data which are respectively uploaded are used for indicating the server to respectively forward the interface data and the input indicator data to the screen projection equipment according to the screen projection connection.

In one embodiment, the computer program further causes the processor to perform the steps of: starting a screen projection main process; executing the steps of acquiring a screen projection code and a local terminal identifier through a screen projection main process, and sending the screen projection code and the terminal identifier to a server; after the screen projection connection is successful and when the screen data acquisition right exists corresponding to the screen projection main process, starting a screen data acquisition sub-process corresponding to the screen projection main process; executing the step of acquiring local screen data through the screen data acquisition subprocess, and transmitting the acquired screen data to the screen projection main process through the screen data acquisition subprocess; and through the screen projection main process, the step of uploading the screen data to the server is executed.

In one embodiment, the computer program further causes the processor to perform the steps of: when the screen projection main process is switched from foreground operation to background operation, the silent audio is played through the screen projection main process; and when the screen projection main process is switched from background operation to foreground operation, stopping playing the soundless audio through the screen projection main process.

In one embodiment, there is provided a computer device comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of: displaying the screen projection code; the screen projection code is used for indicating the terminal to send the screen projection code and the terminal identification of the terminal to the server after the screen projection code is obtained; the screen projection code and terminal identification are used for indicating the server to establish screen projection connection between the terminal and the screen projection equipment corresponding to the screen projection equipment identification after finding the screen projection equipment identification associated with the screen projection code; receiving screen data which is forwarded by the server according to the screen projection connection and is initiated to be transmitted by the terminal; and displaying the screen data.

In one embodiment, the screen data includes layer data for a plurality of layers. Receiving screen data which is forwarded by a server according to the screen projection connection and is transmitted by a terminal, wherein the screen data comprises the following steps: and receiving the layer data of the plurality of layers, which are respectively forwarded by the server according to the screen projection connection according to the layers and are respectively initiated and transmitted by the terminal. Display screen data, comprising: and displaying the layer data of the plurality of layers on different viewing layers according to the layers.

In one embodiment, the layer data for the plurality of layers includes interface data for the interface layers and input indicator data for the input indicator layers. Receiving layer data of a plurality of layers, which are respectively forwarded according to layers according to screen projection connection and are respectively transmitted by a terminal, by a server, wherein the receiving step comprises the following steps: and receiving interface data and input indicator data which are respectively forwarded by the server according to the screen projection connection and respectively transmitted by the terminal. Displaying the layer data of a plurality of layers on different viewing layers according to the layers, comprising: and displaying interface data on the first viewing layer, and displaying input indicator data on a second viewing layer positioned above the first viewing layer.

In one embodiment, the computer program further causes the processor to perform the steps of: starting timing when a new screen projection code is displayed; and when the timing duration reaches the effective duration of the displayed screen projecting codes, or the timing duration does not reach the effective duration of the displayed screen projecting codes and network environment switching occurs, judging that the screen projecting code updating conditions are met currently.

In one embodiment, there is provided a computer device comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of: acquiring a screen projection code and a terminal identifier; inquiring a screen projection equipment identifier associated with the screen projection code; establishing a terminal corresponding to the terminal identifier and screen projection connection between the terminal and screen projection equipment corresponding to the screen projection equipment identifier; receiving screen data uploaded by a terminal; and forwarding the screen data to the screen projection equipment according to the screen projection connection.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus (Rambus) direct RAM (RDRAM), direct bused dynamic RAM (DRDRAM), and bused dynamic RAM (RDRAM).

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above examples only show some embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A screen projection method, comprising:

acquiring a local terminal identifier and a screen projection code which is input by a user and displayed on screen projection equipment; the screen projecting code displayed on the screen projecting equipment is randomly generated by a server in response to a screen projecting code acquisition request which is sent by the screen projecting equipment and carries a local screen projecting equipment identifier, and is issued after the screen projecting code and the screen projecting equipment identifier are stored in an associated manner;

sending the screen projection code and the terminal identification to the server; the screen projection code and the terminal identification are sent and used for indicating the server to establish screen projection connection between the terminal corresponding to the terminal identification and the screen projection equipment corresponding to the screen projection equipment identification after the screen projection equipment identification associated with the screen projection code is found out;

uploading the screen data to the server; the uploaded screen data is used for instructing the server to forward the screen data to the screen projection equipment according to the screen projection connection so that the data displayed on the screen projection equipment is consistent with the data displayed on the terminal;

and displaying a screen projection equipment adding inlet, wherein the screen projection equipment adding inlet is used for adding screen projection equipment corresponding to screen projection equipment identifications associated with different screen projection codes into the screen projection connection after receiving the screen projection codes which are different from the screen projection codes and input by a user, so that the terminal can be projected to a plurality of screen projection equipment at the same time.

2. The method of claim 1, further comprising:

acquiring a first network address and a local second network address of the screen projection equipment;

when the first network address and the second network address belong to the same wireless local area network, then

And when new screen data are acquired, the new screen data are directly sent to the screen projection equipment according to the first network address.

3. The method of claim 1, wherein the screen data comprises layer data for a plurality of layers;

after the screen projection connection is successful, acquiring local screen data, including:

respectively acquiring layer data of a plurality of layers according to different frame rates after the screen projection connection is successful;

the uploading the screen data to the server includes:

uploading the layer data of the plurality of layers to the server according to the layers respectively; and the layer data of the layers which are respectively uploaded are used for indicating the server to respectively forward the layer data of the layers to the screen projection equipment according to the layers according to the screen projection connection.

4. The method of claim 3, wherein the layer data for the plurality of layers includes interface data for interface layers and input indicator data for input indicator layers;

after the screen projection connection is successful, acquiring layer data of a plurality of layers according to different frame rates respectively, including:

after the screen projection connection is successful, acquiring interface data according to a first frame rate, and acquiring input indicator data according to a second frame rate which is greater than the first frame rate;

the uploading the layer data of the plurality of layers to the server according to the layers respectively comprises:

uploading the interface data and the input indicator data to the server respectively; the interface data and the input indicator data which are respectively uploaded are used for indicating the server to respectively forward the interface data and the input indicator data to the screen projection equipment according to the screen projection connection.

5. The method of claim 1, further comprising:

starting a screen projection main process;

executing the steps of acquiring a local terminal identifier and a screen-projecting code input by a user and displayed on screen-projecting equipment through the screen-projecting main process, and sending the screen-projecting code and the terminal identifier to the server;

starting a screen data acquisition sub-process corresponding to the screen projection main process after the screen projection connection is successful and when the screen data acquisition right exists corresponding to the screen projection main process;

executing the step of acquiring local screen data through the screen data acquisition subprocess, and transmitting the acquired screen data to the screen projection main process through the screen data acquisition subprocess;

and executing the step of uploading the screen data to the server through the screen projection main process.

6. The method of claim 5, further comprising:

when the screen projection main process is switched from foreground operation to background operation, playing the soundless audio through the screen projection main process;

and when the screen projection main process is switched from background operation to foreground operation, stopping playing the soundless audio through the screen projection main process.

7. The method according to any one of claims 1-6, further comprising:

acquiring screen projection codes different from the screen projection codes;

sending the different screen projection codes and the terminal identification to a server; and the transmitted different screen projection codes and the terminal identification are used for indicating the server to add the screen projection equipment corresponding to the inquired screen projection equipment identification into the screen projection connection after inquiring the screen projection equipment identification associated with the different screen projection codes.

8. A screen projection method, comprising:

displaying screen projection codes; the screen projecting code is generated randomly by the server in response to a screen projecting code acquisition request which is sent by screen projecting equipment and carries a local screen projecting equipment identifier, is associated and stored with the screen projecting equipment identifier and then is issued to the screen projecting equipment, and is used for indicating a terminal to send the screen projecting code and a terminal identifier of the terminal to the server after acquiring the screen projecting code input by a user; the screen-projecting code and the terminal identifier are used for indicating the server to establish screen-projecting connection between the terminal and the screen-projecting equipment corresponding to the screen-projecting equipment identifier after finding the screen-projecting equipment identifier associated with the screen-projecting code;

and displaying the screen data, wherein the data displayed on the screen projection equipment is consistent with the data displayed on the terminal.

9. The method of claim 8, wherein the screen data comprises layer data for a plurality of layers;

the receiving the screen data which is forwarded by the server according to the screen projection connection and is initiated to be transmitted by the terminal comprises the following steps:

receiving layer data of a plurality of layers, which are respectively forwarded by the server according to the screen projection connection according to the layers and are respectively transmitted by the terminal;

the displaying the screen data includes:

and displaying the layer data of the plurality of layers on different viewing layers according to the layers.

10. The method of claim 9, wherein the layer data for the plurality of layers includes interface data for interface layers and input indicator data for input indicator layers;

the receiving of the layer data of the plurality of layers, which are respectively forwarded by the server according to the layer according to the screen-projecting connection and are respectively initiated by the terminal to transmit, includes:

receiving interface data and input indicator data which are respectively forwarded by the server according to the screen projection connection and are respectively transmitted by the terminal;

displaying the layer data of the plurality of layers on different viewing layers according to the layers, including:

and displaying the interface data on a first viewing layer, and displaying the input indicator data on a second viewing layer positioned above the first viewing layer.

11. The method according to any one of claims 8-10, further comprising:

when the screen projection code updating condition is met, acquiring a local screen projection equipment identifier;

sending a screen projection code acquisition request carrying a local screen projection equipment identifier to the server;

receiving a new screen projection code returned by the server in response to the screen projection code acquisition request;

and updating and displaying the new screen projection code.

12. The method of claim 11, further comprising:

starting timing when a new screen projection code is displayed;

when the timing duration reaches the effective duration of the screen projecting code displayed, or the timing duration does not reach the effective duration of the screen projecting code displayed and network environment switching occurs, then

And judging that the screen-casting code updating condition is met currently.

13. A screen projection method is applied to a server, and comprises the following steps:

acquiring a screen projection code and a terminal identifier sent by a terminal; the terminal acquires a screen projection code displayed on screen projection equipment input by a user, and sends the screen projection code and the terminal identification to the home terminal; the screen projecting code displayed on the screen projecting equipment is randomly generated by a local terminal in response to a screen projecting code acquisition request which is sent by the screen projecting equipment and carries a local screen projecting equipment identifier, and is issued after the screen projecting code and the screen projecting equipment identifier are stored in an associated manner;

receiving screen data uploaded by the terminal;

forwarding the screen data to the screen projection equipment according to the screen projection connection so as to enable the data displayed on the screen projection equipment to be consistent with the data displayed on the terminal;

when the terminal identification and the screen projecting codes different from the screen projecting codes sent by the terminal are received, screen projecting equipment identifications associated with the different screen projecting codes are inquired, and screen projecting equipment corresponding to the inquired screen projecting equipment identifications are added into the screen projecting connection so as to project the terminal to a plurality of screen projecting equipment at the same time; the different screen projection codes are displayed by screen projection equipment different from the screen projection equipment.

14. A screen projection system comprises a terminal, a server and screen projection equipment; it is characterized in that the preparation method is characterized in that,

the screen projection equipment is used for displaying screen projection codes;

the terminal is used for acquiring a screen projection code displayed by the screen projection equipment and a local terminal identifier input by a user; sending the screen projection code and the terminal identification to a server; the screen projecting code displayed on the screen projecting equipment is randomly generated by a server in response to a screen projecting code acquisition request which is sent by the screen projecting equipment and carries a local screen projecting equipment identifier, and is issued after the screen projecting code and the screen projecting equipment identifier are stored in an associated manner;

the screen projection equipment is also used for receiving screen data which is forwarded by the server according to the screen projection connection and is transmitted by the terminal; displaying the screen data, wherein the data displayed on the screen projection equipment is consistent with the data displayed on the terminal;

the server is further used for inquiring screen projection equipment identifications associated with the different screen projection codes when receiving the terminal identifications sent by the terminal and screen projection codes different from the screen projection codes, and adding the screen projection equipment corresponding to the inquired screen projection equipment identifications into the screen projection connection so as to simultaneously project the screen of the terminal to a plurality of screen projection equipment; the different screen projection codes are displayed by screen projection equipment different from the screen projection equipment.

15. A screen projection apparatus, comprising:

the first acquisition module is used for acquiring a local terminal identifier and a screen projection code which is input by a user and displayed on screen projection equipment; the screen projecting code displayed on the screen projecting equipment is randomly generated by a server in response to a screen projecting code acquisition request which is sent by the screen projecting equipment and carries a local screen projecting equipment identifier, and is issued after the screen projecting code and the screen projecting equipment identifier are stored in an associated manner;

the first sending module is used for sending the screen projection code and the terminal identification to the server; the screen projection code and the terminal identification are sent and used for indicating the server to establish screen projection connection between the terminal corresponding to the terminal identification and the screen projection equipment corresponding to the screen projection equipment identification after the screen projection equipment identification associated with the screen projection code is found out;

the second sending module is used for uploading the screen data to the server; the uploaded screen data is used for instructing the server to forward the screen data to the screen projection equipment according to the screen projection connection so that data displayed on the screen projection equipment is consistent with data displayed on the terminal;

the first acquisition module is further used for displaying a screen projection device adding inlet, the screen projection device adding inlet is used for receiving screen projection codes which are different from the screen projection codes and input by a user, and then adding screen projection devices corresponding to screen projection device identifications associated with the different screen projection codes into the screen projection connection, so that the terminal can be projected to a plurality of screen projection devices at the same time.

16. The apparatus of claim 15, wherein the second sending module is further configured to obtain a first network address of the screen-casting device and a local second network address; when the first network address and the second network address belong to the same wireless local area network, when new screen data are obtained, the new screen data are directly sent to the screen projection equipment according to the first network address.

17. The apparatus of claim 15, wherein the screen data comprises layer data for a plurality of layers; the second obtaining module is further configured to obtain layer data of the plurality of layers according to different frame rates after the screen projection connection is successful; the second sending module is further configured to upload the layer data of the multiple layers to the server according to the layers; and the layer data of the layers which are respectively uploaded are used for indicating the server to respectively forward the layer data of the layers to the screen projection equipment according to the layers according to the screen projection connection.

18. The apparatus of claim 17, wherein the layer data for the plurality of layers comprises interface data for interface layers and input indicator data for input indicator layers; the second acquisition module is further used for acquiring interface data according to a first frame rate after the screen projection connection is successful, and acquiring input indicator data according to a second frame rate which is greater than the first frame rate; the second sending module is further used for uploading the interface data and the input indicator data to the server respectively; the interface data and the input indicator data which are respectively uploaded are used for indicating the server to respectively forward the interface data and the input indicator data to the screen projection equipment according to the screen projection connection.

19. The apparatus of claim 15, wherein the first obtaining module is further configured to start a screen projection host process; acquiring a local terminal identifier and a screen projection code which is input by a user and displayed on screen projection equipment by a screen projection main process; the first sending module is further used for sending the screen projection code and the terminal identification to the server through a screen projection main process; the second acquisition module is further used for starting a screen data acquisition sub-process corresponding to the screen projection main process after the screen projection connection is successful and when the screen data acquisition right exists corresponding to the screen projection main process; executing the step of acquiring local screen data through the screen data acquisition subprocess, and transmitting the acquired screen data to the screen projection main process through the screen data acquisition subprocess; the second sending module is further configured to upload the screen data to the server through the screen projection host process.

20. The apparatus of claim 19, wherein the screen projection apparatus further comprises a processing module, configured to play the silent audio through the screen projection main process when the screen projection main process is switched from foreground operation to background operation; and when the screen projection main process is switched from background operation to foreground operation, stopping playing the soundless audio through the screen projection main process.

21. The apparatus of claim 15, wherein the first obtaining module is further configured to obtain a screen projection code different from the screen projection code; the first sending module is further used for sending the different screen projection codes and the terminal identification to a server; and the transmitted different screen projection codes and the terminal identification are used for indicating the server to add the screen projection equipment corresponding to the inquired screen projection equipment identification into the screen projection connection after inquiring the screen projection equipment identification associated with the different screen projection codes.

22. A screen projection apparatus, comprising:

the first display module is used for displaying the screen projection code; the screen projecting code is generated randomly by the server in response to a screen projecting code acquisition request which is sent by screen projecting equipment and carries a local screen projecting equipment identifier, is associated with and stores the screen projecting code and the screen projecting equipment identifier and then is issued to the screen projecting equipment, and is used for indicating the terminal to send the screen projecting code and the terminal identifier of the terminal to the server after acquiring the screen projecting code input by a user; the screen-projecting code and the terminal identifier are used for indicating the server to establish screen-projecting connection between the terminal and the screen-projecting equipment corresponding to the screen-projecting equipment identifier after finding the screen-projecting equipment identifier associated with the screen-projecting code;

and the second display module is used for displaying the screen data, and the data displayed on the screen projection equipment is consistent with the data displayed on the terminal.

23. The apparatus of claim 22, wherein the screen data comprises layer data for a plurality of layers; the receiving module is further configured to receive layer data of a plurality of layers, which are respectively forwarded by the server according to the screen projection connection according to the layers and are respectively initiated by the terminal for transmission; the second display module is further configured to display the layer data of the plurality of layers on different viewing layers according to the layers.

24. The apparatus of claim 23, wherein the layer data for the plurality of layers includes interface data for interface layers and input indicator data for input indicator layers; the receiving module is also used for receiving interface data and input indicator data which are respectively forwarded by the server according to the screen projection connection and are respectively transmitted by the terminal; the second display module is further configured to display the interface data on a first view layer, and display the input indicator data on a second view layer located above the first view layer.

25. The apparatus according to any one of claims 22-24, wherein the first display module is further configured to obtain a local screen projection device identifier when a screen projection code update condition is met; sending a screen projection code acquisition request carrying a local screen projection equipment identifier to the server; receiving a new screen projection code returned by the server in response to the screen projection code acquisition request; and updating and displaying the new screen projection code.

26. The apparatus of claim 25, wherein the first display module is further configured to start timing each time a new screen cast code is displayed; and when the timing duration reaches the effective duration of the screen projecting code displayed, or the timing duration does not reach the effective duration of the screen projecting code displayed and network environment switching occurs, judging that the screen projecting code updating condition is met currently.

27. A screen projection apparatus, comprising:

the acquisition module is used for acquiring the screen projection code and the terminal identification sent by the terminal; the terminal acquires a screen projecting code input by a user and displayed on screen projecting equipment, and sends the screen projecting code and the terminal identifier to a server, wherein the screen projecting code displayed on the screen projecting equipment is randomly generated by the server in response to a screen projecting code acquiring request which is sent by the screen projecting equipment and carries a local screen projecting equipment identifier, and is issued after the screen projecting code and the screen projecting equipment identifier are stored in an associated manner;

the forwarding module is used for forwarding the screen data to the screen projection equipment according to the screen projection connection so as to enable the data displayed on the screen projection equipment to be consistent with the data displayed on the terminal;

the establishing module is further used for inquiring the screen projection equipment identification associated with the different screen projection codes when receiving the terminal identification sent by the terminal and the screen projection codes different from the screen projection codes, and adding the screen projection equipment corresponding to the inquired screen projection equipment identification into the screen projection connection so as to simultaneously project the screen of the terminal to a plurality of screen projection equipment; the different screen projection codes are displayed by screen projection equipment different from the screen projection equipment.

28. A computer device comprising a memory and a processor, the memory having stored thereon a computer program, characterized in that the computer program, when executed by the processor, causes the processor to carry out the steps of the method according to any of claims 1 to 13.

29. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 13.