[go: up one dir, main page]

WO2023040524A1 - Multi-device screen projection or content continuation method, electronic devices and apparatus - Google Patents

Multi-device screen projection or content continuation method, electronic devices and apparatus Download PDF

Info

Publication number
WO2023040524A1
WO2023040524A1 PCT/CN2022/111509 CN2022111509W WO2023040524A1 WO 2023040524 A1 WO2023040524 A1 WO 2023040524A1 CN 2022111509 W CN2022111509 W CN 2022111509W WO 2023040524 A1 WO2023040524 A1 WO 2023040524A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
screen projection
information
content
screen
Prior art date
Application number
PCT/CN2022/111509
Other languages
French (fr)
Chinese (zh)
Inventor
王先峰
胡诗尧
张华翔
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023040524A1 publication Critical patent/WO2023040524A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home

Definitions

  • the embodiments of the present application relate to the field of communication technology, and in particular, to a multi-device screen projection or content connection method, an electronic device, and a computer-readable storage medium.
  • Embodiments of the present application provide a screen projection or content continuation method, an electronic device, and a computer-readable storage medium. Using the embodiments of the present application, multi-device screen projection or automatic content continuation can be realized.
  • the embodiment of the present application provides a screen projection connection method, which is applied to a system including a mobile terminal, a first electronic device, and a second electronic device, and the method includes the mobile terminal and the first electronic device
  • the device establishes a first screen projection connection, and sends first screen projection information to the first electronic device, so that the first electronic device displays the first screen projection content according to the first screen projection information
  • the second electronic device The device acquires a trigger event for continuous screen projection, wherein the trigger event for continuous screen projection is used to trigger the second electronic device to perform continuous screen projection
  • the second electronic device discovers the first electronic device that is casting a screen , and acquire the first screen projection information from the first electronic device, so that the second electronic device displays the first screen projection content according to the first screen projection information.
  • the second electronic device can automatically or according to the user's operation trigger the continuous screen projection, and automatically find the first electronic device that is projecting the screen, and can also automatically obtain the screen projection from the first electronic device Information, so as to realize the automatic continuous projection of the screen, without the need to obtain the projection information through the mobile terminal, which simplifies the process of automatic continuous projection of the screen; in addition, the user does not need to realize the automatic continuous projection of the second electronic device by operating the mobile terminal screen, which greatly facilitates users.
  • the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and the second electronic device discovers all
  • the first electronic device includes: the first electronic device broadcasts a first message in the local area network, so that the second electronic device determines according to the first message that the first electronic device is a screen-casting device ; In this way, the first electronic device realizes that the second electronic device discovers the first electronic device that is casting the screen through active notification.
  • the first message may include screen casting information.
  • the first electronic device actively broadcasts the screen-casting information, and the second electronic device determines that the first electronic device is the screen-casting device, so that the second electronic device does not need to perform discovery-related operations, which simplifies discovery process, improving efficiency.
  • the second electronic device broadcasts a second message in the local area network; the first electronic device sends a third message to the second electronic device in response to the second message, so that the second electronic device According to the third message, it is determined that the first electronic device is the device that is projecting the screen; in this way, the second electronic device realizes that the second electronic device discovers the first electronic device that is projecting the screen by means of query and discovery.
  • the second message may include a discovery request; the third message may include an existence notification. Based on such a design, the second electronic device can discover the first electronic device that is projecting the screen through an active notification method or a query discovery method, and communication can be quickly established.
  • obtaining the first screen projection information from the first electronic device by the second electronic device includes: sending a screen projection information acquisition request by the second electronic device ;
  • the first electronic device sends the first screen projection information to the second electronic device in response to the screen projection information acquisition request, so that the second electronic device obtains the first screen projection information; or
  • the first electronic device carries the first screen projection information in the first message or the third message, so that the second electronic device acquires the first screen projection information.
  • the second message may include a screen projection information acquisition request, or the screen projection information acquisition request may be a message different from the second message. Based on this design, the second electronic device can acquire the first screen projection information from the first electronic device in multiple ways, without re-obtaining the screen projection information through the mobile terminal, which simplifies the communication process between multiple terminal devices, Improve the efficiency of screen projection connection.
  • the trigger event of the continuous screen projection includes one or more of the following items: the second electronic device is turned on; the second electronic device detects that the user Entering the detection range; the second electronic device obtains other detection or sensing devices to detect that the user enters the detection range; the second electronic device obtains other devices with wireless positioning functions to detect the mobile terminal enter the detection range; the second electronic device determines that the user has the intention to watch the second electronic device; the second electronic device determines that the user enters the room where the second electronic device is installed; the second The electronic device receives an instruction message instructing the second electronic device to continue screen projection.
  • the ways of triggering continuous screen projection can include active triggering or passive triggering, among which the user can make the second electronic device perform continuous screen projection through passive triggering according to personal wishes, providing user options and Operation; the second electronic device can also detect the user's behavior or posture through active triggering, and automatically perform continuous screen projection, so that the user does not need to operate, and can automatically perform continuous screen projection according to the user's dynamics, which improves the user experience. user experience.
  • the first screen projection information includes first screen projection resource information and first screen projection state information
  • the first electronic device according to the first screen projection information Displaying the first screen projection content includes: the first electronic device obtains the first screen projection content from a server according to the first screen projection resource information, so that the first electronic device uses the first screen projection
  • the screen projection state indicated by the state information displays the first screen projection content
  • the second electronic device displays the first screen projection content according to the first screen projection information, including: the second electronic device according to the
  • the first screen projection resource information is to obtain the first screen projection content from a server, so that the second electronic device displays the first screen projection content in a screen projection state indicated by the first screen projection state information.
  • the first electronic device and the second electronic device can obtain the content of the screen projection based on the implementation of DLNA, and the second electronic device does not need to obtain the content of the first screen projection from the mobile terminal, which simplifies the communication process and improves the Communication efficiency; in addition, the second electronic device can automatically obtain the first screen projection content from the server according to the first screen projection resource information, without the need for the user to operate the mobile terminal, the first electronic device and the second electronic device, which is convenient for the user; moreover, The second electronic device displays the content of the first screen projection in the first screen projection state, so that the second electronic device can have better continuity with the first electronic device when the screen projection is continued, and the user does not need to re-operate to continue Watching the first screencast content provides an excellent user experience.
  • the first screen projection resource information includes a Uniform Resource Identifier URI
  • the first screen projection state information includes one of playback progress, playback volume, and playback status. or more
  • the playback state includes one or more of play, pause, double speed, full screen, and split screen.
  • the second electronic device can continue to cast the first screen projection content according to the specific screen projection state, so that the user can obtain a better continuous experience when switching electronic devices to continue browsing or watching the first screen projection content .
  • the terminal device obtains the networking information of the second electronic device; the terminal device disconnects the first electronic device from the first electronic device. Screen projection connection, and establish a second screen projection connection with the second electronic device according to the networking information.
  • the screen projection control link between the mobile terminal and the first electronic device can be transferred to the second electronic device, and a new screen projection is established between the mobile terminal and the second electronic device
  • the control link so that the user can control the screen projection content displayed by the second electronic device through the mobile terminal, or the user can directly operate the second electronic device to control the screen projection content displayed, thus providing the user with various Control mode to enhance user experience.
  • the method further includes: sending the second electronic device to the The first electronic device sends the second screen projection information, where the second screen projection information is different from the first screen projection information.
  • the second screen projection information may include: second screen projection resource information different from the first screen projection resource information, and/or, different from the first screen projection state Information about the second screen projection status information.
  • the second electronic device can synchronize the screen projection information to the first electronic device or to the mobile terminal; when the second screen projection information is sent by the mobile terminal Triggered by the terminal, the second electronic device can only synchronize the screen projection information to the first electronic device, so as to keep the screen projection status synchronization between multiple terminal devices and provide users with continuity of browsing and viewing among multiple terminal devices.
  • the first electronic device sends second screen projection information to the second electronic device, where the second screen projection information is different from the first projection screen information. screen information.
  • the mobile terminal can maintain the screen projection control link with the first electronic device, and the mobile terminal can update the screen projection content, or
  • the first electronic device is synchronized to the second electronic device, so as to keep the screen projection status synchronization between multiple terminal devices and provide users with browsing and Continuity of viewing.
  • the displaying the first screen projection content by the second electronic device according to the first screen projection information includes: the second electronic device sends whether to continue projection If an affirmative response is received in response to the inquiry message, the second electronic device displays the first screen projection content according to the first screen projection information.
  • the second electronic device can interact with the user to determine whether to display the first screen projection content, the second electronic device actively asks the user, and the user can choose whether to continue the screen projection by operating the electronic device according to his wishes, thereby Provide users with a real-time sense of participation, and provide users with more choices to improve user participation and experience.
  • the first screen projection information includes the first screen projection content.
  • the first screen projection information may include the first screen projection content, and the mobile terminal may directly upload the first electronic device and the second electronic device Provide screencast content. Based on such a design, the first electronic device and the second electronic device can obtain the screen projection content based on the realization of the mirror data stream, without extracting the screen projection content from the server, thereby simplifying the communication process and improving communication efficiency.
  • the embodiment of the present application also provides a screen projection connection method, which is applied to the first electronic device, and the method includes: the first electronic device establishes a first screen projection connection with the mobile terminal, and the mobile terminal Acquire the first screen projection information, so that the first electronic device displays the first screen projection content according to the first screen projection information; the first electronic device provides the first screen projection information to the second electronic device, so The first screen projection information is used by the second electronic device to display the first screen projection content.
  • the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and when the first electronic device communicates with the second electronic device Before providing the first screen projection information, the method further includes: the first electronic device broadcasts a first message in the local area network, and the first message carries an indication that the first electronic device is casting a screen information;
  • the first electronic device providing the first screen projection information to the second electronic device includes: the first electronic device responds to the screen projection information acquisition request sent by the second electronic device, and provides the second electronic device with The device sends the first screen projection information.
  • the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and the first electronic device provides The first screen projection information includes: the first electronic device broadcasting the first screen projection information in the local area network.
  • the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and when the first electronic device communicates with the second electronic device Before providing the first screen projection information, the method further includes: the first electronic device receiving a second message broadcast by the second electronic device in the local area network.
  • the first screen projection information includes first screen projection resource information and first screen projection status information
  • the first electronic device Displaying the first screen projection content includes: the first electronic device obtains the first screen projection content from a server according to the first screen projection resource information, so that the first electronic device uses the first screen projection
  • the screen projection state indicated by the state information displays the first screen projection content.
  • the first screen projection resource information includes a uniform resource identifier URI
  • the first screen projection state information includes one of playback progress, playback volume, and playback status. or more
  • the playback state includes one or more of play, pause, double speed, full screen, and split screen.
  • the method further includes: the first electronic device acquires networking information of the second electronic device, and sends the networking information to the terminal device .
  • the method further includes: the first electronic device sending second screen projection information to the second electronic device, where the second screen projection information is different from on the first screen projection information.
  • the first screen projection information includes first screen projection content.
  • the embodiment of the present application also provides an electronic device, the electronic device includes a memory and a processor, and the processor is used to implement the screen projection connection as described above when executing the computer program stored in the memory method.
  • the embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the screen projection connection method as described above is implemented.
  • the embodiments of the present application further provide a method for continuing screen projection, which is applied to a second electronic device, and the method includes: the second electronic device acquires a trigger event for continuing screen projection, wherein the continuous projection The trigger event of the screen is used to trigger the second electronic device to perform continuous screen projection; the second electronic device finds the first electronic device that is casting the screen; the second electronic device obtains the first screen projection information, so that the second electronic device displays the first screen projection content according to the first screen projection information.
  • the second electronic device, the mobile terminal, and the first electronic device are in the same local area network, and the second electronic device discovers that all
  • the first electronic device includes: the second electronic device obtains the first message broadcast by the first electronic device in the local area network, so that the second electronic device determines the first message according to the first message
  • the electronic device is a device that is casting a screen; or, the second electronic device broadcasts a second message in the local area network, and acquires a third message sent by the first electronic device in response to the second message, so that The second electronic device determines, according to the third message, that the first electronic device is a device that is currently projecting a screen.
  • obtaining the first screen projection information from the first electronic device by the second electronic device includes: sending a screen projection information acquisition request by the second electronic device ;
  • the second electronic device receives the first screen projection information sent by the first electronic device to the second electronic device in response to the screen projection information acquisition request; or, the second electronic device carries The first screen projection information is obtained from the first message containing the first screen projection information; or, the second electronic device obtains the first screen projection information from the third message carrying the first screen projection information The first screen projection information.
  • the trigger event of the continuous screen projection includes one or more of the following items: the second electronic device is turned on; the second electronic device detects that the user Entering the detection range; the second electronic device obtains other detection or sensing devices to detect that the user enters the detection range; the second electronic device obtains other devices with wireless positioning functions to detect the mobile terminal enter the detection range; the second electronic device determines that the user has the intention to watch the second electronic device; the second electronic device determines that the user enters the room where the second electronic device is installed; the second The electronic device receives an instruction message instructing the second electronic device to continue screen projection.
  • the first screen projection information includes first screen projection resource information and first screen projection state information
  • the second electronic device Displaying the first screen projection content includes: the second electronic device obtaining the first screen projection content from a server according to the first screen projection resource information, so that the second electronic device uses the first screen projection content
  • the screen projection state indicated by the screen projection state information displays the first screen projection content.
  • the first screen projection resource information includes a uniform resource identifier URI
  • the first screen projection state information includes one of playback progress, playback volume, and playback status. or more
  • the playback state includes one or more of play, pause, double speed, full screen, and split screen.
  • the method further includes: sending, by the second electronic device, networking information of the second electronic device to the first electronic device;
  • the device establishes a second screen projection connection with the terminal device;
  • the second electronic device acquires second screen projection information different from the first screen projection information from the terminal device through the second screen projection connection, so that The second electronic device displays second screen projection content according to the second screen projection information.
  • the method further includes: the second electronic device sending the second screen projection information to the first electronic device.
  • the method further includes: the second electronic device acquires second screen projection information sent by the first electronic device, where the second screen projection information It is different from the first screen projection information.
  • the second electronic device displays the first screen projection content according to the first screen projection information, including: the second electronic device sends whether to continue projection If an affirmative response is received in response to the inquiry message, the second electronic device displays the first screen projection content according to the first screen projection information.
  • the first screen projection information includes the first screen projection content.
  • the embodiments of the present application also provide an electronic device, the electronic device includes a memory and a processor, and the processor is configured to implement the screen projection connection method as described when executing the computer program stored in the memory .
  • the embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned screen projection connection method is implemented.
  • the embodiments of the present application also provide a content connection method, which is applied to a system including a first electronic device and a second electronic device, and the method includes: the first electronic device runs and displays the first content
  • the second electronic device acquires a trigger event of content connection, wherein the content connection trigger event is used to trigger the second electronic device to perform content connection; the second electronic device finds that all the first electronic device, and acquire first running information from the first electronic device, so that the second electronic device runs and displays the first content according to the first running information.
  • the first content run by the first electronic device may include running an application program (Application program, APP).
  • the second electronic device can automatically or according to the user operation trigger content connection, and automatically find the first electronic device that is running the first content, and can also automatically obtain the running content from the first electronic device.
  • Information so as to realize the automatic content connection, provide the user with the continuity of browsing or watching the first content, and improve the user experience; in addition, the user does not need to operate to realize the automatic content connection of the second electronic device, which greatly facilitates the user.
  • the first electronic device and the second electronic device are in the same local area network, and the second electronic device discovers that the first electronic device that is running the first content
  • the electronic device includes: the first electronic device broadcasts a first message in the local area network, so that the second electronic device determines according to the first message that the first electronic device is a device running the first content; In this way, the first electronic device enables the second electronic device to discover the first electronic device that is running the first content through active notification.
  • the first message may include running information. Based on this design, the first electronic device actively broadcasts the running information, and the second electronic device determines that the first electronic device is running the first content, so that the second electronic device does not need to perform related operations of discovery, which simplifies The discovery process improves efficiency.
  • the second electronic device broadcasts a second message in the local area network; the first electronic device sends a third message to the second electronic device in response to the second message, so that the second electronic device According to the third message, it is determined that the first electronic device is the device running the first content; thus, the second electronic device discovers the first electronic device running the first content by querying and discovering.
  • the second message may include a discovery request; the third message may include an existence notification. Based on such a design, the second electronic device can discover the first electronic device running the first content through an active notification method or a query discovery method, and communication can be quickly established.
  • the second electronic device acquiring first running information from the first electronic device includes: the second electronic device sending a running information acquisition request; An electronic device sends the first running information to the second electronic device in response to the running information acquisition request, so that the second electronic device acquires the first running information; or, the first electronic device The first running information is carried in the first message or the third message, so that the second electronic device acquires the first running information. Based on such a design, the second electronic device can acquire the first running information from the first electronic device in multiple ways, without user operation to obtain the running information, which simplifies the user operation process and improves user experience.
  • the content connection trigger event includes one or more of the following items: the second electronic device is turned on; the second electronic device detects that a user enters Detection range; the second electronic device obtains other detection or sensing equipment to detect that the user enters the detection range; the second electronic device obtains other devices with wireless positioning functions to detect that the mobile terminal enters The detection range; the second electronic device determines that the user has the intention to watch the second electronic device; the second electronic device determines that the user enters the room where the second electronic device is installed; the second electronic device The device receives an indication message instructing the second electronic device to continue content.
  • the ways of triggering content continuation may include active triggering or passive triggering and other ways, wherein the user can make the second electronic device carry out content continuation through passive triggering according to personal wishes, providing user selection and operation;
  • the second electronic device can also detect the user's behavior or posture through active triggering, and automatically perform content connection, so that the user does not need to operate, and can automatically perform continuous screen projection according to the user's dynamics, which improves user experience.
  • the first running information includes the first content information, the first display interface, and the first running state information
  • the second electronic device Running and displaying the first content with the running information includes: the second electronic device runs in the running state indicated by the first running state information corresponding to the first content information according to the first content information and the first running state information the first content, and display a first display interface corresponding to the first content.
  • the second electronic device can continue to run the first content according to the specific operating state of the first electronic device, so that the second electronic device can have a better continuation of the content with the first electronic device. It is flexible and does not require users to re-operate to continue browsing or watching the first content, providing an excellent user experience.
  • the first content information includes a running application
  • the first display interface includes an interface of the application
  • the first running status information includes running of the application. state.
  • the second electronic device can continue to run the first content according to the specific operating state of the first electronic device in accordance with the first content, so that the second electronic device can at least run the application program, the interface of the application program, and the interface of the application program. Realize content continuation in running state.
  • the first electronic device after the second electronic device runs and displays the first content according to the first running information, the first electronic device continues to run and display the the first content; or, the first electronic device stops running and displays the first content. Based on such a design, after the second electronic device performs content connection, the first electronic device can continue or stop running the first content, so as to provide users with selective operations among multiple devices.
  • FIG. 1 is an application environment architecture diagram of a method for screen projection and connection provided by an embodiment of the present application.
  • FIG. 2 is a flow chart of a screen projection connection method provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of an application scenario of a screen projection connection method provided by an embodiment of the present application.
  • Fig. 4 is a schematic diagram of an interface of an electronic device provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of an application scenario of a screen projection connection method provided by another embodiment of the present application.
  • FIG. 6 is a schematic diagram of an application scenario of screen projection control transfer provided by a screen projection connection method according to an embodiment of the present application.
  • FIG. 7 is a schematic diagram of an application scenario of synchronous screen projection information of a screen projection continuation method provided by an embodiment of the present application.
  • Fig. 8 is a flow chart of a content continuation method provided by an embodiment of the present application.
  • Fig. 9 is a schematic diagram of an electronic device provided by an embodiment of the present application.
  • first and second are only used to distinguish different objects, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order.
  • first application, the second application, etc. are used to distinguish different applications, rather than to describe the specific order of applications, and the features defined as “first” and “second” may explicitly or implicitly include one or More of this feature.
  • FIG. 1 is a schematic diagram of an application environment architecture of a screen projection and connection method provided by an embodiment of the present application.
  • a home floor plan as shown in FIG. 1 may include a plurality of separated spaces/rooms, for example, a first space 12 and a second space 14 .
  • the first space 12 can be but not limited to a living room
  • the second space 14 can be but not limited to a bedroom. It can be understood that the home environment also includes more separated spaces. , such as balconies, kitchens, bathrooms, etc., are not listed here.
  • the screen projection connection method can be based on the Digital Living Network Alliance (Digital Living Network Alliance, DLNA) projection technology, and is applied between multiple terminal devices.
  • the multiple terminal devices include at least a mobile terminal 20 , a first electronic device 30 and a second electronic device 40 .
  • the mobile terminal 20 may be, but not limited to, a smart phone, a tablet computer, a portable computer, a personal digital assistant (Personal Digital Assistant, PDA), a game console, a smart wearable device or other mobile electronic devices with wireless communication functions.
  • PDA Personal Digital Assistant
  • the first electronic device 30 and the second electronic device 40 may be, but not limited to, a television, an interactive network television (Internet Protocol Television, IPTV), a video player, a display, a smart TV, a large-screen device, a tablet computer or Other electronic devices with video playback function.
  • IPTV Internet Protocol Television
  • the first electronic device 30 can be placed in the first space 12
  • the second electronic device 40 can be placed in the second space 14. It can be understood that the first electronic device 30 and the second electronic device 40 may have larger display screens than the mobile terminal 20, so as to provide users with a better visual experience.
  • the mobile terminal 20, the first electronic device 30 and the second electronic device 40 can communicate with each other through a network, for example, communicate with each other through a local area network (Local Area Network, LAN).
  • the servers 50 communicate with each other.
  • the network may be, but not limited to, one or a combination of data transmission methods of WiFi, optical fiber communication or cellular communication.
  • the server 50 may be, but not limited to, a cloud database, providing resource or data query and acquisition.
  • the mobile terminal 20 in order to realize the screen projection connection, that is, after the mobile terminal 20 establishes a screen projection connection with the first electronic device 30, the mobile terminal 20 provides screen projection content or provides screen projection resource information, and the first electronic device 30 to display or play the projection content corresponding to the projection content or the projection resource information, switch to the second electronic device 40 to continue to display or play the projection content or the projection content corresponding to the projection resource information, the user needs to first disconnect the mobile Screen projection connection between the terminal 20 and the first electronic device 30, and then re-find the screen projection content and locate the progress of the screen projection content through the mobile terminal 20, and then re-scan the terminal equipment that can be connected through the mobile terminal 20, and the mobile terminal 20 selects and The second electronic device 40 establishes a screen projection connection, and finally provides the screen projection content or screen projection resource information through the mobile terminal 20, and the second electronic device 40 displays or plays the screen projection content corresponding to the screen projection content or screen projection resource information.
  • the mobile terminal 20, the first electronic device 30 and the second electronic device 40 may be different terminal devices.
  • the implementation of the screen projection and connection method has a complicated operation process, and the power consumption of each terminal device and the duration of the operation process are not optimized enough, resulting in poor user experience.
  • the embodiment of the present application provides a screen projection connection method
  • the mobile terminal 20 establishes a first screen projection connection with the first electronic device 30, and sends the first screen projection information to the first electronic device 30, so that the first electronic device 30
  • the device 30 displays the content of the first screen projection according to the first screen projection information
  • the second electronic device 40 obtains a trigger event of the continuous screen projection, wherein the trigger event of the continuous screen projection is used to trigger the second electronic device 40 Perform continuous screen projection
  • the second electronic device 40 finds the first electronic device 30 that is projecting the screen, and obtains the first screen projection information from the first electronic device 30, so that the second electronic device 40 according to the first screen projection
  • the information displays the content of the first screen projection, so as to realize continuous screen projection between multiple terminal devices, so that the user can switch between multiple terminal devices for continuous screen projection, which is convenient for the user to control the screen projection when the scene is switched.
  • the screen projection information is synchronized between multiple terminal devices, and the playback of the screen projection content is automatically continued, providing users with a
  • FIG. 2 is a flowchart of a screen projection connection method provided by an embodiment of the present application.
  • the screen projection continuation method may include the following steps.
  • Step S211 the mobile terminal 20 establishes a first screen projection connection with the first electronic device 30 .
  • the mobile terminal 20 provides the first screen projection information to the first electronic device 30, and the first screen projection information may include first screen projection resource information, and the first electronic device 30 may A screen projection resource information acquires the screen projection content, and can display the screen projection content, and the mobile terminal 20 can control the screen projection content of the first electronic device 30 .
  • the mobile terminal 20 provides the first screen projection resource information corresponding to the screen projection content, and the first electronic device 30 according to the first A screen projection resource information acquires the screen projection content and displays or plays the screen projection content.
  • the mobile terminal 20 provides the first screen projection resource information corresponding to the video content, and the first electronic device 30 obtains the screen projection resource information according to the first screen projection resource information.
  • the screen projection content is not limited to playing video content, and may also be playing audio content or other displayable browsing content.
  • the mobile terminal 20 can establish a screen projection connection with the first electronic device 30 through DLNA, and the mobile terminal 20 can send the first screen projection resource information to the first electronic device 30, so
  • the first screen projection resource information includes at least the network address of the playing content, such as a Uniform Resource Identifier (Uniform Resource Identifier, URI) address, and the first electronic device 30 can obtain the content from the server 50 according to the network address.
  • play content so that the first electronic device 30 and the mobile terminal 20 can display the play content (that is, screen projection content) synchronously, or, after the first electronic device 30 starts to display the play content, the The mobile terminal 20 stops displaying the playing content.
  • the mobile terminal 20 can perform screen projection control on the first electronic device 30, for example, the mobile terminal 20 can perform, for example, play, pause, stop, fast Forward/rewind, adjust volume, full screen display, split screen display, adjust display ratio and other screen projection controls. Therefore, the user can conveniently use the mobile terminal 20 that is easy to carry and operate to remotely control the projected content of the first electronic device 30 to obtain a better operating experience.
  • the first screen projection resource information may also include first screen projection state information, which is used to carry the above screen projection control information generated by the mobile terminal 20, so that the first electronic device 30 according to the first screen projection state The information displays the playing content.
  • the screen projection control can be realized through a control link established by a Simple Object Access Protocol (SOAP) connected to a DLNA-based Transmission Control Protocol (Transmission Control Protocol, TCP).
  • SOAP Simple Object Access Protocol
  • TCP Transmission Control Protocol
  • the first electronic device 30 can also directly obtain user operations to control the content on the screen, such as playing, pausing, stopping, fast forward/rewind, adjusting volume, full-screen display, split-screen display, and adjusting the display ratio. wait.
  • the user can directly operate the first electronic device 30 to control the projected content, such as operating the display interface of the first electronic device 30 or operating a remote control matched with the first electronic device 30 .
  • Step S212 Trigger the screen projection connection.
  • the second electronic device 40 acquires a trigger event .
  • the triggering event may include, but not limited to, any one or more of the following methods: starting the second electronic device 40, the second electronic device 40 detecting that the user enters the detection range, a device with detection or sensing function detecting It is detected that the user enters the detection range, the device with wireless positioning function detects that the mobile terminal 20 enters the detection range, the second electronic device 40 determines that the user has the intention to watch the second electronic device 40, the second electronic device 40 determines The user enters a room (such as the second space 14 ) where the second electronic device 40 is installed, and the second electronic device 40 receives an instruction message instructing the second electronic device 40 to continue screen projection.
  • the second electronic device 40 when the user activates the second electronic device 40 by switching the power supply, etc., the second electronic device 40 detects a trigger event for screen projection connection; or, the second electronic device 40 is equipped with a camera or When the sensor element detects that the user enters the detection range (such as the shooting range of the camera, or the sensor element detects that the user enters the range of the second space 14), the second electronic device 40 detects it as a trigger event for the screen projection connection; and Or, when a device with a detection or sensing function, such as an infrared sensor, a photoelectric sensor, a thermal detector, a camera device, a millimeter-wave radar, etc., detects that the user enters the detection range (such as the range of the second space 14) A trigger event; or, when a device with a wireless positioning function, such as an indoor wireless base station, a wireless positioning tag, etc., detects that the user carries the mobile terminal 20 into the detection range (such as the range of the second space 14), it is a
  • the second electronic device 40 or other electronic devices can recognize that the position of the mobile terminal 20 is in the second space 14 as a trigger event; or The user actively triggers the continuous screen projection operation through the interface of the second electronic device 40 to form an instruction message to the second electronic device 40, and when the second electronic device 40 receives the instruction message for continuous screen projection, it is a trigger event.
  • the device with detection or sensing function or the device with wireless positioning function sends the trigger event to the second electronic device 40, and the second electronic device 40 obtains the trigger event of screen projection connection , and continue screen projection in response to the trigger event.
  • the screen projection connection There are many ways to trigger the screen projection connection.
  • the user can actively trigger the screen projection connection by starting the second electronic device 40, or the second electronic device 40 is equipped with a camera or a sensor element to detect the user's entry into the detection mode.
  • the triggering event may also include other triggering manners, which are not listed here.
  • the user enters the bedroom (second space 14) from the living room (first space 12), and wishes to continue playing the large screen in the living room (first electronic device 30) through the large screen in the bedroom (second electronic device 40).
  • the played screen projection content can trigger the screen projection continuation, so that the user can continue to watch the same projection screen content through the large screen in the bedroom after entering the bedroom, so that the user can obtain a better visual experience.
  • the above-mentioned triggering conditions are, for example, the second electronic device 40 detects that it is activated, the second electronic device 40 detects that the user enters the detection range, a device with a detection or sensing function detects It is detected that the user enters the detection range or/and the device with the wireless positioning function detects that the mobile terminal 20 enters the detection range.
  • one or more trigger conditions in these trigger conditions are combined as The trigger condition for screencasting connection.
  • FIG. 3 is a schematic diagram of an application scenario of a screen projection connection method provided by an embodiment of the present application.
  • the mobile terminal 20 establishes a screen projection connection with the first electronic device 30, and establishes a control link.
  • the mobile terminal 20 provides resource information of the screen projection content, and the first electronic device 30 obtains the resource information of the screen projection content, and according to The resource information of the screen projection content is acquired from the server 50, and the screen projection content is displayed or played.
  • the mobile terminal 20 moves to the space corresponding to the second electronic device 40 and triggers the screen projection connection, a new screen projection connection can be established between the mobile terminal 20 and the second electronic device 40, and the second electronic device 40 can perform projection. screen continues.
  • Step S213 discovering the device that is casting the screen.
  • the discovery of the device that is casting the screen may include active notification and inquiry of a discovery method.
  • the active notification method may be that the first electronic device 30 accepting screen projection broadcasts its screen projection information through a local area network.
  • the first electronic device 30 can extend the preset message field through the underlying discovery protocol of DLNA, such as Simple Service Discovery Protocol (SSDP), for example, expand the message that is being projected field, broadcasting the screencasting information on the LAN.
  • DLNA Simple Service Discovery Protocol
  • Other electronic devices that acquire the trigger event, such as the second electronic device 40 receive the screen-casting information broadcast by the first electronic device 30 to learn that the first electronic device 30 is screen-casting.
  • the message after expanding the field of the message being projected can be:
  • HOST can be the message field that is set to reserve the multicast address and port for the protocol
  • CACHE-CONTROL can be the message field that formulates the survival time of the notification message
  • LOCATION can be the message field that indicates the URL address that contains the root device description
  • NT can be the message field indicating the service type
  • NTS can be the message field indicating the existence notification message
  • USN can be the uniform service name indicating different services, and the message field indicating the same type of service capability
  • the ISPLAYING field can be extended In the message field of screen casting, when the ISPLAYING field is YES, it can indicate that the device is currently casting a screen, and when the ISPLAYING field is NO, it can indicate that the device is not currently casting a screen.
  • the query discovery method may be that the second electronic device 40 that acquires the trigger event finds whether there is a device that is casting a screen in the local area network.
  • the second electronic device 40 can extend the preset message field through the underlying discovery protocol of DLNA, such as SSDP, for example, expand the message field of the screen being projected, and broadcast a discovery request in the local area network to discover the current
  • the device that is casting the screen when there is a device that is casting the screen, such as the first electronic device 30, the device that is casting the screen (such as the first electronic device 30) sends an existence notification to the broadcast address, that is, the second electronic device 40 , the second electronic device 40 obtains the presence notification to know that the first electronic device 30 is casting a screen.
  • the message after expanding the field of the message being projected can be:
  • HOST is the message field that is set to reserve the multicast address and port for the protocol
  • MAN is the message field that sets the type of protocol query
  • MX is the message field that sets the longest waiting time for the device to respond
  • ST is the content and meaning and Query the message field with the same field as the corresponding field in the request
  • the ISPLAYING field can be an extended message field that is currently casting a screen.
  • the ISPLAYING field is YES, it can indicate that the device is currently casting a screen.
  • the ISPLAYING field is NO, It can indicate that the device is not currently casting a screen.
  • the second electronic device 40 and the first electronic device 30 can discover the device that is projecting the screen through an active notification method or a query discovery method, and communication can be quickly established.
  • Step S214 Interact with the first screen projection information.
  • the first electronic device 30 may send the first screen projection information to the second electronic device 40 .
  • the first screen projection information may also include first screen projection resource information and first screen projection status information
  • the first screen projection status information may include but not limited to playback progress, playback volume, and playback Status (may include but not limited to play, pause, multiplier, full screen, split screen), etc.
  • the first electronic device 30 may also send the networking information of the first electronic device 30 to the second electronic device 40 at the same time, such as IP address and network port.
  • the first electronic device 30 can transmit the message field by extending the message field of the continuous casting protocol of DLNA, such as expanding the message field corresponding to the network address, playback progress, playback volume, and playback status of the projected screen content. Casting information.
  • the first electronic device 30 interacts with the second electronic device 40 with the first screen projection information, so that the second electronic device 40 can obtain the first screen projection resource information (which can correspond to the projection content) and the first screen projection state information (can correspond to obtain the current screen projection state of the first electronic device 30), without reacquiring the screen projection content and identifying the current state of the screen projection content through the mobile terminal 20, which simplifies the communication process between multiple terminal devices and improves the screen projection process. Successive efficiency.
  • the second electronic device 40 may request the current screen projection information from the first electronic device 30, and the first electronic device 30 may respond to the The above request sends screen projection information to the second electronic device 40 .
  • the message for the second electronic device 40 to request screen projection information from the first electronic device 30 may be:
  • User-Agent Mozilla/4.0 (compatible; UPnP/1.0; Windows NT/5.1)
  • the message in which the first electronic device 30 sends screen projection information to the second electronic device 40 in response to the request may be:
  • the first electronic device 30 may add a message of screen projection information to the existence notification sent to the second electronic device 40, the The message of screencasting information can be:
  • ContinueState Continue state, including but not limited to play, pause, multiple, full screen, split screen.
  • the first electronic device 30 when the screen-casting device is found through the active notification method, the first electronic device 30 broadcasts a screen-casting message through the local area network to carry the screen-casting information.
  • the first electronic device 30 can expand the message field of the screen projection information through the underlying discovery protocol of DLNA, such as the Simple Service Discovery Protocol (SSDP), and broadcast the screen projection in the local area network News and screencast information.
  • DLNA Simple Service Discovery Protocol
  • Other electronic devices that acquire the trigger event such as the second electronic device 40, receive the screen-casting message and the screen-casting information broadcast by the first electronic device 30, and while knowing that the first electronic device 30 is screen-casting, can Get screencast information.
  • Step S215 Screen projection continues.
  • the second electronic device 40 may start the screen projection sequence according to the screen projection information received from the first electronic device 30 .
  • the second electronic device 40 may obtain the screen projection content from the server 50 according to the network address of the screen projection content in the screen projection information, and obtain the screen projection content according to the screen projection status in the screen projection information.
  • Information such as playback progress, playback volume, and playback status (which may include but not limited to play, pause, multiplier, full screen, split screen), etc., to continue playing the screen projection content. Therefore, the second electronic device 40 and the first electronic device 30 synchronously play the same screen projection content with the same play progress, play volume and play state.
  • the second electronic device 40 can display or play the screen projection content according to the screen projection resource information corresponding to the screen projection content acquired from the first electronic device 30 and the current state of the screen projection content, so that the second The second electronic device 40 can continue the display or playback status of the first electronic device 30 on the screen projection content, without the need for the mobile terminal 20 to identify the screen projection information of the screen projection content, and then feed it back to the second electronic device 40, simplifying the communication between multiple terminal devices.
  • the communication process improves the efficiency of screen projection connection.
  • the second electronic device 40 after the second electronic device 40 triggers the screen projection connection and finds that the device is casting the screen, it further includes asking the user whether to continue the screen projection.
  • the second electronic device 40 displays a dialog box 44 through a display interface 42 , asking whether to continue the screen projection, and receives a user's operation.
  • the second electronic device 40 When receiving the user's affirmative operation, such as detecting the user's operation on the first icon 46 in the dialog box 44, the second electronic device 40 immediately performs the screen projection connection; when receiving the user's negative operation, such as detecting When the user's operation on the second icon 48 in the dialog box 44 is detected, the second electronic device 40 does not perform the screen projection connection.
  • the first icon 46 is a positive icon
  • the second icon 48 is a negative icon.
  • the first electronic device 30 and the second electronic device 40 may also use other ways to interact and project screen information, for example, the first electronic device 30 may send a message to the second electronic device 40 transmits the mirrored screen projection data stream, that is, the mirrored screen projection is established between the first electronic device 30 and the second electronic device 40, then the second electronic device 40 and the first electronic device 30 synchronously display or play the screencast content, and the second electronic device 30
  • the second electronic device 40 does not need to obtain screen projection content from the server 50, which simplifies the screen projection connection steps and improves efficiency.
  • the first electronic device 30 and the second electronic device 40 may also use other ways to interact and project screen information, for example, the first electronic device 30 may send a message to the second electronic device 40 transmits the mirrored screen projection data stream, that is, a mirrored screen projection connection is established between the first electronic device 30 and the second electronic device 40, and the mobile terminal 20 and the first electronic device 30 can also be a mirrored screen projection connection, then the mobile terminal 20
  • the screen mirroring data stream can be transmitted to the first electronic device 30
  • the first electronic device 30 can transmit the screen mirroring data stream to the second electronic device 40 . That is, the screen projection content of the second electronic device 40 can be provided by the mobile terminal 20 without obtaining the screen projection content from the server 50 , which simplifies screen projection connection steps and improves efficiency.
  • Step S216 Feedback that the screen projection has been continued.
  • the second electronic device 40 may send the screen projection connection information and the networking information of the second electronic device to the first electronic device 30 to inform the first electronic device 30 that the projection has been completed. screen continues.
  • the networking information of the second electronic device 40 may include but not limited to the IP address and network port of the second electronic device 40 .
  • Step S217 Notify the control transfer.
  • the first electronic device 30 may send a control transfer notification to the mobile terminal 20 .
  • the control transfer notification sent by the first electronic device 30 includes the connection information of the screen projected by the second electronic device 40 and the networking information of the second electronic device.
  • the networking information of the second electronic device 40 may include but not limited to the IP address and network port of the second electronic device 40 . Since the second electronic device 40 has established communication with the first electronic device 30 and the first electronic device 30 has established communication with the mobile terminal 20, the second electronic device 40 can convey the second electronic device 40 to the mobile terminal 20 through the first electronic device 30.
  • the networking information of the electronic device 40 enables the mobile terminal 20 to obtain the networking information of the second electronic device 40 , and then the mobile terminal 20 can establish communication with the second electronic device 40 according to the networking information of the second electronic device 40 .
  • Step S218 Re-establish the screen projection control to complete the control transfer.
  • the mobile terminal 20 establishes a second screen projection connection with the second electronic device 40 according to the received networking information of the second electronic device 40, and at the same time, the mobile terminal 20 can disconnect from the The first screen projection connection of the first electronic device 30 .
  • the screen projection connection may be a control link established by Simple Object Access Protocol (SOAP) based on DLNA Transmission Control Protocol (Transmission Control Protocol, TCP) connection.
  • SOAP Simple Object Access Protocol
  • TCP Transmission Control Protocol
  • the user can control (for example, play, pause, stop, fast forward/rewind, adjust volume, full-screen display, split-screen display, and adjust display ratio) the screen projection of the second electronic device 40 through the mobile terminal 20 content.
  • the user can conveniently use the mobile terminal 20 that is easy to carry and operate to remotely control the projected screen content of the second electronic device 40 to obtain a better operating experience.
  • FIG. 6 is a schematic diagram of an application scenario of the screen projection control transfer of the screen projection connection method provided by an embodiment of the present application.
  • the mobile terminal 20 is disconnected from the first screen projection control of the first electronic device 30 , and the mobile terminal 20 establishes a second screen projection control connection with the second electronic device 40 .
  • the second electronic device 40 can also directly obtain user operations to control the content of the screen projection, such as play, pause, stop, fast forward/rewind, adjust volume, full screen display, split screen display, and adjust the display ratio wait.
  • the user can directly operate the second electronic device 40 to control the projected content, for example, operate the display interface of the second electronic device 40 or operate a remote control matched with the second electronic device 40 .
  • the mobile terminal 20 and the second electronic device 40 can establish a second screen projection control connection and disconnect the first screen projection control connection with the first electronic device 30 , the user can also turn off the first electronic device 30, or the first electronic device 30 can also be automatically turned off, and at this time only the second electronic device 40 is used to display or play the projected content. It can be understood that when the user moves from the living room to the bedroom, the projected screen content can only be watched through the second electronic device 40 in the bedroom, and the first electronic device 30 in the living room is no longer required to watch, and the first electronic device 30 can be turned off to Save power.
  • the first screen projection connection between the mobile terminal 20 and the first electronic device 30 may not be transferred, that is, the mobile terminal 20 and the second electronic device 40 do not need to establish a second screen projection connection, then
  • the mobile terminal 20 maintains a control link with the first electronic device 30, the first electronic device 30 receives the control information of the mobile terminal 20, and forwards the control information to the second electronic device 40, so as to achieve the purpose of controlling the second electronic device 40 .
  • steps S216-S218 can be ignored and not executed, thereby simplifying the screen projection connection steps and improving efficiency.
  • the projection between the mobile terminal 20 and the first electronic device 30 Screen control may not be transferred, that is, there is no need to establish a screen projection connection between the mobile terminal 20 and the second electronic device 40, and steps S216-S218 may be ignored, thereby simplifying the screen projection connection steps and improving efficiency.
  • the mobile terminal 20 can establish a second screen projection control connection with the second electronic device 40, and The first screen projection control connection is disconnected from the first electronic device 30 , so as to realize the transfer of the screen projection control link, and realize the screen projection control of the second electronic device 40 by the mobile terminal 20 .
  • Step S219 Synchronize screen projection information.
  • the mobile terminal 20 can establish a second screen projection control connection with the second electronic device 40 and disconnect the first screen projection control connection with the first electronic device 30, and the second When an electronic device 30 is not turned off and continues to play the projected content, the second electronic device 40 establishes information synchronization with the first electronic device 30 .
  • the second electronic device 40 when the second electronic device 40 detects that the user operates the screen-cast content, or when the mobile terminal 20 detects that the user operates the screen-cast content, and the second electronic device 40 obtains the mobile
  • the terminal 20 detects the user's operation on the projected content, for example, changing the playback state (play/pause), changing the playback progress, adjusting the playback volume, adjusting the playback multiplier, adjusting the display ratio, etc.
  • the second electronic device 40 can set the The first electronic device 30 and the mobile terminal 20 are notified of information about the status change of the projected screen content.
  • the second electronic device 40 can synchronize screen projection information to the mobile terminal 20 and the first electronic device 30 in real time, maintaining the synchronization of multiple terminal devices.
  • the second electronic device 40 may notify the first electronic device 30 of the status change of the projected screen content based on the Notify method of the General Event Notification Architecture (GENA) protocol. And the mobile terminal 20.
  • GMA General Event Notification Architecture
  • the second electronic device 40 establishing a screen projection control connection with the mobile terminal 20 serves as the main screen device, and other terminal devices, such as the first electronic device 30 serve as the secondary screen device.
  • the secondary screen device is automatically notified, thereby realizing synchronization of screen projection information of multiple terminal devices.
  • the first electronic device 30 and the second electronic device 40 installed in different spaces synchronously play the projected content, so that multiple users in different spaces can watch the projected content through the first electronic device 30 and the second electronic device 40 respectively. Screen content, convenient for multiple people to watch at the same time.
  • FIG. 7 is a schematic diagram of an application scenario of synchronous screen projection information of a screen projection continuation method provided by an embodiment of the present application.
  • the mobile terminal 20 establishes a screen projection control connection with the second electronic device 40, the second electronic device 40 serves as the main screen device, and the first electronic device 30 serves as the secondary screen device.
  • the second The electronic device 40 automatically notifies the first electronic device 30 , so that the screen projection information of the second electronic device 40 and the first electronic device 30 are synchronized.
  • the mobile terminal 20 can establish a screen projection control connection with the second electronic device 40 and disconnects the screen projection control connection with the first electronic device 30, and the first When the electronic device 30 is turned off, the second electronic device 40 may only synchronize screen projection information to the mobile terminal 20 .
  • the user can preset whether the second electronic device 40 synchronizes the screen projection information through the mobile terminal 20 or the second electronic device 40, and when it is set to not synchronize the screen projection information, the step S219 may be ignored and not executed. If step S219 is not executed and the first electronic device 30 is not turned off, then the first electronic device 30 can obtain the last time before the mobile terminal 20 disconnects the screen projection control connection with the first electronic device 30 to continue displaying or playing the screencasting content.
  • Step S220 Respond to the synchronous screen projection information.
  • the first electronic device 30 may respond to the synchronous screen projection information received from the second electronic device 40 .
  • the second electronic device 40 changes the playing state (pause), and synchronizes the screen projection information to the first electronic device 30 and the mobile terminal 20, and the first electronic device 30 responds to the screen projection information to pause the playback of the screencast content.
  • the first electronic device 30 and the second electronic device 40 keep playing synchronously.
  • the first electronic device 30 may not respond to the synchronous screen projection information received from the second electronic device 40 .
  • the second electronic device 40 changes the playing state (pause), and synchronizes screen projection information to the first electronic device 30 and the mobile terminal 20, and the first electronic device 30 does not respond to the screen projection information. information, and continue to play the content on the screen.
  • the first electronic device 30 and the second electronic device 40 play separately, which can respectively meet the viewing needs of users in different spaces.
  • the mobile terminal 20 or the first electronic device 30 may preset whether to respond to the synchronous screen projection information. It can be understood that, when the mobile terminal 20 or the first electronic device 30 presets not to respond to the synchronous screen projection information, step S220 can be ignored and not executed.
  • the screen projection connection method of the present application provides screen projection connection between multiple terminal devices, so that users can switch between multiple terminal devices and screen projection connections, which is convenient for users to control projection screens in the case of scene switching, and multiple terminal devices
  • the screen projection information is synchronized between the screens, and the playback of the screen projection content is automatically continued, providing users with a better visual experience.
  • it saves multiple tedious steps of re-finding the screen projection content, locating the playback progress, and re-projecting the screen, providing a convenient and fast screen projection connection experience.
  • the screen projection connection method of the present application greatly simplifies the screen projection connection process, and saves the mobile terminal from searching for the screen projection content, locating the projection content progress, and re-projecting the screen.
  • the process and operation simplifies the communication process between multiple terminal devices, improves the efficiency of screen projection and connection, and also provides users with a better experience.
  • FIG. 8 is a flow chart of a method for connecting content based on multiple devices according to an embodiment of the present application.
  • the synchronous display method may include the following steps.
  • Step S811 the first electronic device 30 executes the content.
  • the first electronic device 30 can run an application program (Application program, APP) and display an APP interface.
  • the first electronic device 30 can receive user operations through the APP interface and implement control over the APP.
  • the APP interface may include multiple pages, and the APP interface may switch multiple pages when receiving user operations.
  • the user can browse and operate the APP through the first electronic device 30 in the first space 12 , for example, control the APP through the APP interface or a remote controller paired with the first electronic device 30 .
  • the first electronic device 30 may also exchange APP information with the server 50, for example, interacting with pushed content or network content of the APP.
  • Step S812 triggering content continuation.
  • the second electronic device 40 acquires a content continuation trigger event.
  • the content connection triggering event may include, but not limited to, any one or more of the following methods: starting the second electronic device 40, the second electronic device 40 detecting that the user enters the detection range, a device with a detection or sensing function The device detects that the user enters the detection range or the device with the wireless positioning function detects that the mobile terminal 20 enters the detection range, the second electronic device 40 determines that the user has the intention to watch the second electronic device 40, the second electronic device 40.
  • Step S813 discovering the device running the APP.
  • the discovery of the device running the APP may include active notification and query of the discovery method.
  • the active notification method may be that the first electronic device 30 running the APP broadcasts the running APP information through the local area network.
  • the query discovery method may be that the second electronic device 40 that acquires the trigger event finds whether there is a device running APP in the local area network.
  • Step S814 exchanging running information.
  • the first electronic device 30 can send its operation information to the second electronic device 40 .
  • the running information may include, but not limited to, the running APP of the first electronic device 30 , the currently displayed APP interface and running status, and the like.
  • the first electronic device 30 can transmit the running information by extending the message field of the content connection protocol of DLNA, for example, extending the message field corresponding to the running APP and the currently displayed APP interface.
  • the message field of the extended DLNA content may include:
  • APPContent continue the current running content of the application (such as the interface where it is located, running status, etc.)
  • the rest of the message information of the interactive running information can refer to the message field of the aforementioned step S214.
  • the second electronic device 40 when a running device is found through the active notification method, can request the current running information from the first electronic device 30, and the first electronic device 30 can respond to the request to the second electronic device 40.
  • Device 40 sends operational information.
  • the first electronic device when a running device is found through the query discovery method, may add a message of running information to the existence notification sent to the second electronic device 40 .
  • step S815 the content continues to run.
  • the second electronic device 40 may start a continuous operation according to the operation information received from the first electronic device 30 .
  • the second electronic device 40 can continue to run the same APP according to the running APP in the running information, and can continue to display the same APP interface according to the currently displayed APP interface in the running information.
  • the user can continue to browse and operate the running APP and the displayed APP interface of the first electronic device 30 through the second electronic device 40 in the second space 14 , which is convenient for the user and improves the user experience.
  • the second electronic device 40 can receive user operations through the APP interface and implement control over the APP. It can be understood that the APP interface may include multiple pages, and the APP interface may switch multiple pages when receiving user operations.
  • the user can browse and operate the APP through the second electronic device 40 in the second space 14 , for example, control the APP through the APP interface or a remote controller paired with the second electronic device 40 .
  • the second electronic device 40 can also exchange APP information with the server 50, for example, push content or network content of the interactive APP.
  • the first electronic device 30 can continue to run the APP and display the APP interface, and can receive operations from other users through the APP interface. In some implementations, after the second electronic device 40 continues to run the APP, the first electronic device 30 can be turned off to save power.
  • the second electronic device 40 can automatically run and display the same APP and APP interface as the user's first electronic device 30 in the first space 12 before, so that the user can obtain a better continuous experience of use.
  • FIG. 9 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • the structure of the electronic device is applicable to the first electronic device 30 and the second electronic device 40 .
  • the electronic device 60 may at least include a memory 61 , at least one processor 62 , a display module 63 and a communication module 64 .
  • the structure of the electronic device 60 shown in FIG. 3 does not constitute a limitation of the embodiment of the present application, and the electronic device 60 may also include more or less other hardware or software than shown in the illustration, or Different component arrangements. It should be noted that the electronic device 60 is only an example, and other existing or future electronic products that can be adapted to this application should also be included within the scope of protection of this application.
  • the electronic device 60 includes a terminal capable of automatically performing numerical calculations and/or information processing according to preset or stored instructions, and its hardware includes but not limited to microprocessors, application-specific integrated circuits ( Specific Integrated Circuit, ASIC), programmable gate array (Field-Programmable Gate Array, FPGA), digital processor (Digital Signal Processor, DSP), embedded devices, etc.
  • ASIC Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • DSP Digital Signal Processor
  • the memory 61 is used to store program codes and various data. Described memory 61 can comprise read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), programmable read-only memory (Programmable Read-Only Memory, PROM), erasable programmable read-only memory Memory (Erasable Programmable Read-Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically Erasable Programmable Read-Only Memory (Electrically-Erasable Programmable Read-Only Memory, EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, tape storage, or any other computer-readable medium that can be used to carry or store data.
  • Read-Only Memory Read-Only Memory
  • RAM Random Access Memory
  • PROM Programmable Read-Only Memory
  • PROM Programmable Read-Only Memory
  • EPROM erasable programmable read-only memory Memory
  • the at least one processor 62 may be composed of an integrated circuit, for example, may be composed of a single packaged integrated circuit, or may be composed of multiple integrated circuits with the same function or different functions packaged, including a Or a combination of multiple central processing units (Central Processing unit, CPU), microprocessors, digital processing chips, graphics processors, and various control chips.
  • the at least one processor 62 is the control core (Control Unit) of the first electronic device, by running or executing programs or modules stored in the memory 61, and calling data stored in the memory 61, To perform various functions of the electronic device 60 and process data, for example, perform data processing functions.
  • Control Unit Control Unit
  • the above-mentioned integrated units implemented in the form of software function modules can be stored in a computer-readable storage medium.
  • the above-mentioned software functional modules are stored in a storage medium, and include several instructions to enable a computer device (which may be a personal computer, a terminal, or a network device, etc.) or a processor (processor) to execute the methods described in the various embodiments of the present application. part.
  • Computer programs 65 such as program codes are stored in the memory 61 , and the at least one processor 62 can invoke the program codes stored in the memory 61 to perform related functions.
  • the memory 61 stores a plurality of instructions, and the plurality of instructions are executed by the at least one processor 62 to implement the screen projection continuation method.
  • the display module 63 is used for displaying screen projection content and providing an operation interface.
  • the display module 63 detects the user's operation through the operation interface, and executes the instruction corresponding to the operation, for example, displays a dialog box, asks whether to continue the screen projection, and receives the user's operation.
  • the display module 63 may be, but not limited to, a touch screen and a display screen for receiving commands through a remote controller.
  • the communication module 64 is used to establish a communication connection with other terminal devices and realize data interaction.
  • the communication module 64 can be connected to a network, and exchange data with other terminal devices through the network.
  • the present application also provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, it is used to implement the steps of any one of the screen projection continuation methods described above .
  • the DLNA screen projection protocol is used as an example for description.
  • the screen projection protocol is not limited to DLNA technology. With the evolution of technology, if the screen projection protocol that appears in the future is applicable to this application, If it does not exceed the scope covered by the embodiments of the present application, it shall also belong to the protection scope of the present application.
  • each functional module of the electronic device or server may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software function modules.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephone Function (AREA)

Abstract

Embodiments of the present application disclose a screen projection continuation method, which is applied to a system comprising a mobile terminal, a first electronic device, and a second electronic device. The method comprises: the mobile terminal establishes a first screen projection connection with the first electronic device, and sends first screen projection information to the first electronic device, so that the first electronic device displays first screen projection content according to the first screen projection information; the second electronic device acquires a trigger event for continuous screen projection, wherein the trigger event for continuous screen projection is used to trigger the second electronic device to perform continuous screen projection; and the second electronic device discovers the first electronic device that is currently projecting a screen, and acquires the first screen projection information from the first electronic device, so that the second electronic device displays the first screen projection content according to the first screen projection information. Multi-device screen projection or content continuation may be achieved.

Description

多设备投屏或内容接续方法、电子设备及装置Multi-device projection or content connection method, electronic equipment and device
相关申请的交叉引用Cross References to Related Applications
本申请要求于2021年9月18日提交中国专利局、申请号为202111101585.2、申请名称为“多设备投屏或内容接续方法、电子设备及装置”的中国专利的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent filed on September 18, 2021 with the application number 202111101585.2 and the application name "Multi-device screen projection or content connection method, electronic equipment and device" submitted to the China Patent Office, the entire contents of which are incorporated by reference incorporated in this application.
技术领域technical field
本申请实施例涉及通信技术领域,尤其涉及一种多设备投屏或内容接续方法、电子设备及计算机可读存储介质。The embodiments of the present application relate to the field of communication technology, and in particular, to a multi-device screen projection or content connection method, an electronic device, and a computer-readable storage medium.
背景技术Background technique
随着智能家居的发展,家居使用的智能影音设备丰富多样,其中用于播放内容或运行内容的终端设备越来越多样化,其中通过投屏实现多终端设备间的视频播放成为用户的常用方式。此外,当用户在家居切换活动场景时,需要对应多个活动场景的多终端设备间的投屏或内容的接续和投屏控制的切换,以实现通过一次投屏操作来达到多终端设备投屏或内容接续的效果。目前,对应投屏或内容接续和投屏控制的切换,在切换终端设备投屏时,需要进行断开当前投屏控制连接、对当前投屏或内容进行识别、获取投屏或内容的状态、重新扫描并建立投屏控制、重新获取投屏或内容等多个繁琐的步骤,对各终端设备的功耗及操作时长等尚不够优化,带来了一定程度上的用户体验不佳。With the development of smart home, there are a variety of smart audio-visual devices used in the home. Among them, the terminal devices used to play content or run content are becoming more and more diverse. Among them, video playback between multiple terminal devices through screen projection has become a common way for users. . In addition, when the user switches the activity scene at home, it is necessary to screen projection or content continuation and switching of projection control between multiple terminal devices corresponding to multiple activity scenes, so as to achieve multi-terminal device projection through one screen projection operation Or the effect of content continuation. At present, corresponding to the switching of screen projection or content connection and projection control, when switching terminal device projection, it is necessary to disconnect the current projection control connection, identify the current projection or content, obtain the status of projection or content, The tedious steps of re-scanning and establishing projection control, re-acquiring projection or content, etc., have not yet optimized the power consumption and operation time of each terminal device, which has brought a certain degree of poor user experience.
发明内容Contents of the invention
本申请实施例提供一种投屏或内容接续方法、电子设备及计算机可读存储介质,采用本申请的实施例,可以实现多设备投屏或内容的自动接续。Embodiments of the present application provide a screen projection or content continuation method, an electronic device, and a computer-readable storage medium. Using the embodiments of the present application, multi-device screen projection or automatic content continuation can be realized.
第一方面,本申请的实施例提供一种投屏接续方法,应用于包括移动终端、第一电子设备和第二电子设备的系统中,所述方法包括所述移动终端与所述第一电子设备建立第一投屏连接,并向所述第一电子设备发送第一投屏信息,从而所述第一电子设备根据所述第一投屏信息显示第一投屏内容;所述第二电子设备获取接续投屏的触发事件,其中,所述接续投屏的触发事件用于触发所述第二电子设备进行接续投屏;所述第二电子设备发现正在投屏的所述第一电子设备,并从所述第一电子设备获取所述第一投屏信息,从而所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容。采用本申请的实施例的投屏接续方法,第二电子设备可自动或根据用户操作触发接续投屏,并自动发现正在投屏的第一电子设备,还可自动从第一电子设备获取 投屏信息,从而实现自动接续投屏,而不需要再通过移动终端获取投屏信息,简化了自动接续投屏的过程;此外,用户也不需要通过操作移动终端来实现第二电子设备的自动接续投屏,极大地方便了用户。In the first aspect, the embodiment of the present application provides a screen projection connection method, which is applied to a system including a mobile terminal, a first electronic device, and a second electronic device, and the method includes the mobile terminal and the first electronic device The device establishes a first screen projection connection, and sends first screen projection information to the first electronic device, so that the first electronic device displays the first screen projection content according to the first screen projection information; the second electronic device The device acquires a trigger event for continuous screen projection, wherein the trigger event for continuous screen projection is used to trigger the second electronic device to perform continuous screen projection; the second electronic device discovers the first electronic device that is casting a screen , and acquire the first screen projection information from the first electronic device, so that the second electronic device displays the first screen projection content according to the first screen projection information. Using the screen projection connection method of the embodiment of the present application, the second electronic device can automatically or according to the user's operation trigger the continuous screen projection, and automatically find the first electronic device that is projecting the screen, and can also automatically obtain the screen projection from the first electronic device Information, so as to realize the automatic continuous projection of the screen, without the need to obtain the projection information through the mobile terminal, which simplifies the process of automatic continuous projection of the screen; in addition, the user does not need to realize the automatic continuous projection of the second electronic device by operating the mobile terminal screen, which greatly facilitates users.
根据第一方面,在一种可能的实现方式中,所述移动终端、所述第一电子设备和所述第二电子设备处于同一个局域网中,所述第二电子设备发现正在投屏的所述第一电子设备,包括:所述第一电子设备在所述局域网内广播第一消息,从而所述第二电子设备根据所述第一消息确定所述第一电子设备为正在投屏的设备;如此,第一电子设备通过主动通知的方式实现第二电子设备发现正在投屏的第一电子设备。在一种可能的实现方式中,所述第一消息可以包括正在投屏信息。基于这样的设计,通过第一电子设备主动广播正在投屏信息,第二电子设备据以确定第一电子设备为正在投屏的设备,从而第二电子设备无需进行发现的相关操作,简化了发现的流程,提高了效率。According to the first aspect, in a possible implementation manner, the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and the second electronic device discovers all The first electronic device includes: the first electronic device broadcasts a first message in the local area network, so that the second electronic device determines according to the first message that the first electronic device is a screen-casting device ; In this way, the first electronic device realizes that the second electronic device discovers the first electronic device that is casting the screen through active notification. In a possible implementation manner, the first message may include screen casting information. Based on this design, the first electronic device actively broadcasts the screen-casting information, and the second electronic device determines that the first electronic device is the screen-casting device, so that the second electronic device does not need to perform discovery-related operations, which simplifies discovery process, improving efficiency.
或者,所述第二电子设备在所述局域网内广播第二消息;所述第一电子设备响应于所述第二消息向所述第二电子设备发送第三消息,从而所述第二电子设备根据所述第三消息确定所述第一电子设备为正在投屏的设备;如此,第二电子设备通过查询发现的方式实现第二电子设备发现正在投屏的第一电子设备。在一种可能的实现方式中,所述第二消息可以包括发现请求;所述第三消息可以包括存在通知。基于这样的设计,可以使得第二电子设备可通过主动通知方式或查询发现方式发现正在投屏的第一电子设备,可快速建立通信。Or, the second electronic device broadcasts a second message in the local area network; the first electronic device sends a third message to the second electronic device in response to the second message, so that the second electronic device According to the third message, it is determined that the first electronic device is the device that is projecting the screen; in this way, the second electronic device realizes that the second electronic device discovers the first electronic device that is projecting the screen by means of query and discovery. In a possible implementation manner, the second message may include a discovery request; the third message may include an existence notification. Based on such a design, the second electronic device can discover the first electronic device that is projecting the screen through an active notification method or a query discovery method, and communication can be quickly established.
根据第一方面,在一种可能的实现方式中,所述第二电子设备从所述第一电子设备获取所述第一投屏信息,包括:所述第二电子设备发送投屏信息获取请求;所述第一电子设备响应于所述投屏信息获取请求,向所述第二电子设备发送所述第一投屏信息,从而所述第二电子设备获取所述第一投屏信息;或者,所述第一电子设备在所述第一消息或所述第三消息中携带所述第一投屏信息,从而所述第二电子设备获取所述第一投屏信息。在一种可能的实现方式中,所述第二消息可以包括投屏信息获取请求,或者所述投屏信息获取请求可以为不同于所述第二消息的一条消息。基于这样的设计,第二电子设备可由多种方式从所述第一电子设备获取所述第一投屏信息,不需要经过移动终端重新获取投屏信息,简化了多终端设备间的通信流程,提高了投屏接续的效率。According to the first aspect, in a possible implementation manner, obtaining the first screen projection information from the first electronic device by the second electronic device includes: sending a screen projection information acquisition request by the second electronic device ; The first electronic device sends the first screen projection information to the second electronic device in response to the screen projection information acquisition request, so that the second electronic device obtains the first screen projection information; or The first electronic device carries the first screen projection information in the first message or the third message, so that the second electronic device acquires the first screen projection information. In a possible implementation manner, the second message may include a screen projection information acquisition request, or the screen projection information acquisition request may be a message different from the second message. Based on this design, the second electronic device can acquire the first screen projection information from the first electronic device in multiple ways, without re-obtaining the screen projection information through the mobile terminal, which simplifies the communication process between multiple terminal devices, Improve the efficiency of screen projection connection.
根据第一方面,在一种可能的实现方式中,所述接续投屏的触发事件包括以下项的一种或多种:所述第二电子设备开启;所述第二电子设备侦测到用户进入侦测范围;所述第二电子设备获取其他检测或传感设备侦测到用户进入所述侦测范围;所述第二电子设备获取其他具有无线定位功能的设备侦测到所述移动终端进入所述侦测范围;所述第二电子设备确定用户具有观看所述第二电子设备的意图;所述第二电子设备确定用户进入所述第二电子设备所安装的房间;所述第二电子设备接收到指示所述第二电子设备进行接续投屏的指示消息。基于这样的设计,触发接续投屏的方式可以包括主动触发 或被动触发等多种方式,其中,用户可以根据个人意愿通过被动触发的方式,使第二电子设备进行接续投屏,提供用户选择及操作;第二电子设备也可通过主动触发的方式,检测用户的行为或姿态等,自动进行接续投屏,从而使得用户无需进行操作,即可根据用户的动态来自动进行接续投屏,提高了用户体验。According to the first aspect, in a possible implementation manner, the trigger event of the continuous screen projection includes one or more of the following items: the second electronic device is turned on; the second electronic device detects that the user Entering the detection range; the second electronic device obtains other detection or sensing devices to detect that the user enters the detection range; the second electronic device obtains other devices with wireless positioning functions to detect the mobile terminal enter the detection range; the second electronic device determines that the user has the intention to watch the second electronic device; the second electronic device determines that the user enters the room where the second electronic device is installed; the second The electronic device receives an instruction message instructing the second electronic device to continue screen projection. Based on this design, the ways of triggering continuous screen projection can include active triggering or passive triggering, among which the user can make the second electronic device perform continuous screen projection through passive triggering according to personal wishes, providing user options and Operation; the second electronic device can also detect the user's behavior or posture through active triggering, and automatically perform continuous screen projection, so that the user does not need to operate, and can automatically perform continuous screen projection according to the user's dynamics, which improves the user experience. user experience.
根据第一方面,在一种可能的实现方式中,所述第一投屏信息包括第一投屏资源信息和第一投屏状态信息,所述第一电子设备根据所述第一投屏信息显示第一投屏内容,包括:所述第一电子设备根据所述第一投屏资源信息,从服务器获取所述第一投屏内容,从而所述第一电子设备以所述第一投屏状态信息指示的投屏状态显示所述第一投屏内容;所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容,包括:所述第二电子设备根据所述第一投屏资源信息,从服务器获取所述第一投屏内容,从而所述第二电子设备以所述第一投屏状态信息指示的投屏状态显示所述第一投屏内容。基于这样的设计,可以使第一电子设备和第二电子设备基于DLNA的实现方式获取投屏内容,而且第二电子设备无需再从移动终端获取第一投屏内容,简化了通信流程,提高了通信效率;此外,第二电子设备可以根据第一投屏资源信息自动从服务器获取第一投屏内容,无需用户操作移动终端、第一电子设备及第二电子设备,方便了用户;再者,第二电子设备以所述第一投屏状态显示所述第一投屏内容,使得第二电子设备可与第一电子设备在接续投屏时具有较佳的延续性,无需用户重新操作以接续观看第一投屏内容,提供了极佳的用户体验。According to the first aspect, in a possible implementation manner, the first screen projection information includes first screen projection resource information and first screen projection state information, and the first electronic device according to the first screen projection information Displaying the first screen projection content includes: the first electronic device obtains the first screen projection content from a server according to the first screen projection resource information, so that the first electronic device uses the first screen projection The screen projection state indicated by the state information displays the first screen projection content; the second electronic device displays the first screen projection content according to the first screen projection information, including: the second electronic device according to the The first screen projection resource information is to obtain the first screen projection content from a server, so that the second electronic device displays the first screen projection content in a screen projection state indicated by the first screen projection state information. Based on this design, the first electronic device and the second electronic device can obtain the content of the screen projection based on the implementation of DLNA, and the second electronic device does not need to obtain the content of the first screen projection from the mobile terminal, which simplifies the communication process and improves the Communication efficiency; in addition, the second electronic device can automatically obtain the first screen projection content from the server according to the first screen projection resource information, without the need for the user to operate the mobile terminal, the first electronic device and the second electronic device, which is convenient for the user; moreover, The second electronic device displays the content of the first screen projection in the first screen projection state, so that the second electronic device can have better continuity with the first electronic device when the screen projection is continued, and the user does not need to re-operate to continue Watching the first screencast content provides an excellent user experience.
根据第一方面,在一种可能的实现方式中,所述第一投屏资源信息包括统一资源标识符URI,所述第一投屏状态信息包括播放进度、播放音量、播放状态中的一种或多种,所述播放状态包括播放、暂停、倍速、全屏、分屏中的一种或多种。基于这样的设计,第二电子设备可以根据具体的投屏状态对应接续投屏第一投屏内容,使得用户在切换电子设备继续浏览或观看第一投屏内容时,获得较佳的延续性体验。According to the first aspect, in a possible implementation manner, the first screen projection resource information includes a Uniform Resource Identifier URI, and the first screen projection state information includes one of playback progress, playback volume, and playback status. or more, the playback state includes one or more of play, pause, double speed, full screen, and split screen. Based on this design, the second electronic device can continue to cast the first screen projection content according to the specific screen projection state, so that the user can obtain a better continuous experience when switching electronic devices to continue browsing or watching the first screen projection content .
根据第一方面,在一种可能的实现方式中,所述终端设备获取所述第二电子设备的组网信息;所述终端设备断开与所述第一电子设备之间的所述第一投屏连接,并根据所述组网信息,与所述第二电子设备建立第二投屏连接。基于这样的设计,在第二电子设备实现投屏接续后,移动终端与第一电子设备的投屏控制链路可以转移至第二电子设备,由移动终端与第二电子设备建立新的投屏控制链路,从而用户可通过移动终端实现对第二电子设备所显示的投屏内容进行控制,或者用户可直接操作第二电子设备对所显示的投屏内容进行控制,由此提供用户多种操控方式,提升用户体验。According to the first aspect, in a possible implementation manner, the terminal device obtains the networking information of the second electronic device; the terminal device disconnects the first electronic device from the first electronic device. Screen projection connection, and establish a second screen projection connection with the second electronic device according to the networking information. Based on this design, after the second electronic device realizes the screen projection connection, the screen projection control link between the mobile terminal and the first electronic device can be transferred to the second electronic device, and a new screen projection is established between the mobile terminal and the second electronic device The control link, so that the user can control the screen projection content displayed by the second electronic device through the mobile terminal, or the user can directly operate the second electronic device to control the screen projection content displayed, thus providing the user with various Control mode to enhance user experience.
根据第一方面,在一种可能的实现方式中,在所述终端设备与所述第二电子设备建立所述第二投屏连接之后,所述方法还包括:所述第二电子设备向所述第一电子设备发送所述第二投屏信息,所述第二投屏信息不同于所述第一投屏信息。在一种可能的实现方式中,所述第二投屏信息可以包括:不 同于所述第一投屏资源信息的第二投屏资源信息,和/或,不同于所述第一投屏状态信息的第二投屏状态信息。基于这样的设计,在投屏控制链路转移至第二电子设备后,第二电子设备可以将投屏信息同步至第一电子设备,或者同步至移动终端;当第二投屏信息是由移动终端触发的,第二电子设备可以将投屏信息仅同步至第一电子设备,从而保持多终端设备之间的投屏状态同步,提供用户在多终端设备间浏览及观看的连续性。According to the first aspect, in a possible implementation manner, after the terminal device establishes the second screen projection connection with the second electronic device, the method further includes: sending the second electronic device to the The first electronic device sends the second screen projection information, where the second screen projection information is different from the first screen projection information. In a possible implementation manner, the second screen projection information may include: second screen projection resource information different from the first screen projection resource information, and/or, different from the first screen projection state Information about the second screen projection status information. Based on this design, after the screen projection control link is transferred to the second electronic device, the second electronic device can synchronize the screen projection information to the first electronic device or to the mobile terminal; when the second screen projection information is sent by the mobile terminal Triggered by the terminal, the second electronic device can only synchronize the screen projection information to the first electronic device, so as to keep the screen projection status synchronization between multiple terminal devices and provide users with continuity of browsing and viewing among multiple terminal devices.
根据第一方面,在一种可能的实现方式中,所述第一电子设备向所述第二电子设备发送第二投屏信息,其中,所述第二投屏信息不同于所述第一投屏信息。基于这样的设计,在所述第二电子设备实现投屏接续后,所述移动终端可保持与所述第一电子设备的投屏控制链路,所述移动终端对投屏内容的更新,或者所述第一电子设备对投屏内容的更新,所述第一电子设备同步至所述第二电子设备,从而保持多终端设备之间的投屏状态同步,提供用户在多终端设备间浏览及观看的连续性。According to the first aspect, in a possible implementation manner, the first electronic device sends second screen projection information to the second electronic device, where the second screen projection information is different from the first projection screen information. screen information. Based on this design, after the second electronic device realizes the screen projection connection, the mobile terminal can maintain the screen projection control link with the first electronic device, and the mobile terminal can update the screen projection content, or When the first electronic device updates the screen projection content, the first electronic device is synchronized to the second electronic device, so as to keep the screen projection status synchronization between multiple terminal devices and provide users with browsing and Continuity of viewing.
根据第一方面,在一种可能的实现方式中,所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容,包括:所述第二电子设备发出是否进行接续投屏的询问消息,在接收到响应于所述询问消息的肯定响应的情况下,所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容。基于这样的设计,第二电子设备可以通过与用户互动以确定是否显示所述第一投屏内容,第二电子设备主动询问用户,用户可根据意愿通过操作电子设备以选择是否接续投屏,从而提供用户实时的参与感,并提供用户更多的选择空间,提升用户的参与度及体验。According to the first aspect, in a possible implementation manner, the displaying the first screen projection content by the second electronic device according to the first screen projection information includes: the second electronic device sends whether to continue projection If an affirmative response is received in response to the inquiry message, the second electronic device displays the first screen projection content according to the first screen projection information. Based on such a design, the second electronic device can interact with the user to determine whether to display the first screen projection content, the second electronic device actively asks the user, and the user can choose whether to continue the screen projection by operating the electronic device according to his wishes, thereby Provide users with a real-time sense of participation, and provide users with more choices to improve user participation and experience.
根据第一方面,在一种可能的实现方式中,所述第一投屏信息包括所述第一投屏内容。在一种可能的实现方式中,当多终端设备间为镜像投屏方式时,所述第一投屏信息可以包括第一投屏内容,移动终端可以直接向第一电子设备及第二电子设备提供投屏内容。基于这样的设计,可以使第一电子设备和第二电子设备基于镜像数据流的实现方式获取投屏内容,而无需从服务器提取投屏内容,从而简化了通信流程,提供通信效率。According to the first aspect, in a possible implementation manner, the first screen projection information includes the first screen projection content. In a possible implementation, when the mirroring screen projection mode is used between multiple terminal devices, the first screen projection information may include the first screen projection content, and the mobile terminal may directly upload the first electronic device and the second electronic device Provide screencast content. Based on such a design, the first electronic device and the second electronic device can obtain the screen projection content based on the realization of the mirror data stream, without extracting the screen projection content from the server, thereby simplifying the communication process and improving communication efficiency.
第二方面,本申请的实施例还提供一种投屏接续方法,应用于第一电子设备,所述方法包括:所述第一电子设备与移动终端建立第一投屏连接,并从移动终端获取第一投屏信息,从而所述第一电子设备根据所述第一投屏信息显示第一投屏内容;所述第一电子设备向第二电子设备提供所述第一投屏信息,所述第一投屏信息用于所述第二电子设备显示所述第一投屏内容。In the second aspect, the embodiment of the present application also provides a screen projection connection method, which is applied to the first electronic device, and the method includes: the first electronic device establishes a first screen projection connection with the mobile terminal, and the mobile terminal Acquire the first screen projection information, so that the first electronic device displays the first screen projection content according to the first screen projection information; the first electronic device provides the first screen projection information to the second electronic device, so The first screen projection information is used by the second electronic device to display the first screen projection content.
结合第二方面,在一种可能的实现方式中,所述移动终端、所述第一电子设备和所述第二电子设备处于同一个局域网中,在所述第一电子设备向第二电子设备提供所述第一投屏信息之前,所述方法还包括:所述第一电子设备在所述局域网内广播第一消息,所述第一消息携带有所述第一电子设备正在投屏的指示信息;With reference to the second aspect, in a possible implementation manner, the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and when the first electronic device communicates with the second electronic device Before providing the first screen projection information, the method further includes: the first electronic device broadcasts a first message in the local area network, and the first message carries an indication that the first electronic device is casting a screen information;
所述第一电子设备向第二电子设备提供所述第一投屏信息,包括:所述第一电子设备响应于所述第二电子设备发送的投屏信息获取请求,向所述第 二电子设备发送所述第一投屏信息。The first electronic device providing the first screen projection information to the second electronic device includes: the first electronic device responds to the screen projection information acquisition request sent by the second electronic device, and provides the second electronic device with The device sends the first screen projection information.
结合第二方面,在一种可能的实现方式中,所述移动终端、所述第一电子设备和所述第二电子设备处于同一个局域网中,所述第一电子设备向第二电子设备提供所述第一投屏信息,包括:所述第一电子设备在所述局域网内广播所述第一投屏信息。With reference to the second aspect, in a possible implementation manner, the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and the first electronic device provides The first screen projection information includes: the first electronic device broadcasting the first screen projection information in the local area network.
结合第二方面,在一种可能的实现方式中,所述移动终端、所述第一电子设备和所述第二电子设备处于同一个局域网中,在所述第一电子设备向第二电子设备提供所述第一投屏信息之前,所述方法还包括:所述第一电子设备接收所述第二电子设备在所述局域网内广播的第二消息。With reference to the second aspect, in a possible implementation manner, the mobile terminal, the first electronic device, and the second electronic device are in the same local area network, and when the first electronic device communicates with the second electronic device Before providing the first screen projection information, the method further includes: the first electronic device receiving a second message broadcast by the second electronic device in the local area network.
结合第二方面,在一种可能的实现方式中,所述第一投屏信息包括第一投屏资源信息和第一投屏状态信息,所述第一电子设备根据所述第一投屏信息显示第一投屏内容,包括:所述第一电子设备根据所述第一投屏资源信息,从服务器获取所述第一投屏内容,从而所述第一电子设备以所述第一投屏状态信息指示的投屏状态显示所述第一投屏内容。With reference to the second aspect, in a possible implementation manner, the first screen projection information includes first screen projection resource information and first screen projection status information, and the first electronic device Displaying the first screen projection content includes: the first electronic device obtains the first screen projection content from a server according to the first screen projection resource information, so that the first electronic device uses the first screen projection The screen projection state indicated by the state information displays the first screen projection content.
结合第二方面,在一种可能的实现方式中,所述第一投屏资源信息包括统一资源标识符URI,所述第一投屏状态信息包括播放进度、播放音量、播放状态中的一种或多种,所述播放状态包括播放、暂停、倍速、全屏、分屏中的一种或多种。With reference to the second aspect, in a possible implementation manner, the first screen projection resource information includes a uniform resource identifier URI, and the first screen projection state information includes one of playback progress, playback volume, and playback status. or more, the playback state includes one or more of play, pause, double speed, full screen, and split screen.
结合第二方面,在一种可能的实现方式中,所述方法还包括:所述第一电子设备获取所述第二电子设备的组网信息,并向所述终端设备发送所述组网信息。With reference to the second aspect, in a possible implementation manner, the method further includes: the first electronic device acquires networking information of the second electronic device, and sends the networking information to the terminal device .
结合第二方面,在一种可能的实现方式中,所述方法还包括:所述第一电子设备向所述第二电子设备发送第二投屏信息,其中,所述第二投屏信息不同于所述第一投屏信息。With reference to the second aspect, in a possible implementation manner, the method further includes: the first electronic device sending second screen projection information to the second electronic device, where the second screen projection information is different from on the first screen projection information.
结合第二方面,在一种可能的实现方式中,所述第一投屏信息包括第一投屏内容。With reference to the second aspect, in a possible implementation manner, the first screen projection information includes first screen projection content.
第三方面,本申请的实施例还提供一种电子设备,所述电子设备包括存储器及处理器,所述处理器用于执行所述存储器中存储的计算机程序时实现如上述所述的投屏接续方法。In the third aspect, the embodiment of the present application also provides an electronic device, the electronic device includes a memory and a processor, and the processor is used to implement the screen projection connection as described above when executing the computer program stored in the memory method.
第四方面,本申请的实施例还提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现如上述所述的投屏接续方法。In a fourth aspect, the embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the screen projection connection method as described above is implemented.
第五方面,本申请的实施例还提供一种投屏接续方法,应用于第二电子设备,所述方法包括:所述第二电子设备获取接续投屏的触发事件,其中,所述接续投屏的触发事件用于触发所述第二电子设备进行接续投屏;所述第二电子设备发现正在投屏的第一电子设备;所述第二电子设备从所述第一电子设备获取第一投屏信息,从而所述第二电子设备根据所述第一投屏信息显示第一投屏内容。In the fifth aspect, the embodiments of the present application further provide a method for continuing screen projection, which is applied to a second electronic device, and the method includes: the second electronic device acquires a trigger event for continuing screen projection, wherein the continuous projection The trigger event of the screen is used to trigger the second electronic device to perform continuous screen projection; the second electronic device finds the first electronic device that is casting the screen; the second electronic device obtains the first screen projection information, so that the second electronic device displays the first screen projection content according to the first screen projection information.
结合第五方面,在一种可能的实现方式中,所述第二电子设备、所述移 动终端和所述第一电子设备处于同一个局域网中,所述第二电子设备发现正在投屏的所述第一电子设备,包括:所述第二电子设备获取所述第一电子设备在所述局域网内广播的第一消息,从而所述第二电子设备根据所述第一消息确定所述第一电子设备为正在投屏的设备;或者,所述第二电子设备在所述局域网内广播第二消息,并获取所述第一电子设备响应于所述第二消息所发送的第三消息,从而所述第二电子设备根据所述第三消息确定所述第一电子设备为正在投屏的设备。With reference to the fifth aspect, in a possible implementation manner, the second electronic device, the mobile terminal, and the first electronic device are in the same local area network, and the second electronic device discovers that all The first electronic device includes: the second electronic device obtains the first message broadcast by the first electronic device in the local area network, so that the second electronic device determines the first message according to the first message The electronic device is a device that is casting a screen; or, the second electronic device broadcasts a second message in the local area network, and acquires a third message sent by the first electronic device in response to the second message, so that The second electronic device determines, according to the third message, that the first electronic device is a device that is currently projecting a screen.
结合第五方面,在一种可能的实现方式中,所述第二电子设备从所述第一电子设备获取所述第一投屏信息,包括:所述第二电子设备发送投屏信息获取请求;所述第二电子设备接收所述第一电子设备响应于所述投屏信息获取请求向所述第二电子设备发送的所述第一投屏信息;或者,所述第二电子设备从携带有所述第一投屏信息的所述第一消息中获取所述第一投屏信息;或者,所述第二电子设备从携带有所述第一投屏信息的所述第三消息中获取所述第一投屏信息。With reference to the fifth aspect, in a possible implementation manner, obtaining the first screen projection information from the first electronic device by the second electronic device includes: sending a screen projection information acquisition request by the second electronic device ; The second electronic device receives the first screen projection information sent by the first electronic device to the second electronic device in response to the screen projection information acquisition request; or, the second electronic device carries The first screen projection information is obtained from the first message containing the first screen projection information; or, the second electronic device obtains the first screen projection information from the third message carrying the first screen projection information The first screen projection information.
结合第五方面,在一种可能的实现方式中,所述接续投屏的触发事件包括以下项的一种或多种:所述第二电子设备开启;所述第二电子设备侦测到用户进入侦测范围;所述第二电子设备获取其他检测或传感设备侦测到用户进入所述侦测范围;所述第二电子设备获取其他具有无线定位功能的设备侦测到所述移动终端进入所述侦测范围;所述第二电子设备确定用户具有观看所述第二电子设备的意图;所述第二电子设备确定用户进入所述第二电子设备所安装的房间;所述第二电子设备接收到指示所述第二电子设备进行接续投屏的指示消息。With reference to the fifth aspect, in a possible implementation manner, the trigger event of the continuous screen projection includes one or more of the following items: the second electronic device is turned on; the second electronic device detects that the user Entering the detection range; the second electronic device obtains other detection or sensing devices to detect that the user enters the detection range; the second electronic device obtains other devices with wireless positioning functions to detect the mobile terminal enter the detection range; the second electronic device determines that the user has the intention to watch the second electronic device; the second electronic device determines that the user enters the room where the second electronic device is installed; the second The electronic device receives an instruction message instructing the second electronic device to continue screen projection.
结合第五方面,在一种可能的实现方式中,所述第一投屏信息包括第一投屏资源信息和第一投屏状态信息,所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容,包括:所述第二电子设备根据所述第一投屏资源信息,从服务器获取所述第一投屏内容,从而所述第二电子设备以所述第一投屏状态信息提示的投屏状态显示所述第一投屏内容。With reference to the fifth aspect, in a possible implementation manner, the first screen projection information includes first screen projection resource information and first screen projection state information, and the second electronic device Displaying the first screen projection content includes: the second electronic device obtaining the first screen projection content from a server according to the first screen projection resource information, so that the second electronic device uses the first screen projection content The screen projection state indicated by the screen projection state information displays the first screen projection content.
结合第五方面,在一种可能的实现方式中,所述第一投屏资源信息包括统一资源标识符URI,所述第一投屏状态信息包括播放进度、播放音量、播放状态中的一种或多种,所述播放状态包括播放、暂停、倍速、全屏、分屏中的一种或多种。With reference to the fifth aspect, in a possible implementation manner, the first screen projection resource information includes a uniform resource identifier URI, and the first screen projection state information includes one of playback progress, playback volume, and playback status. or more, the playback state includes one or more of play, pause, double speed, full screen, and split screen.
结合第五方面,在一种可能的实现方式中,所述方法还包括:所述第二电子设备向所述第一电子设备发送所述第二电子设备的组网信息;所述第二电子设备与所述终端设备建立第二投屏连接;所述第二电子设备通过所述第二投屏连接从所述终端设备获取不同于所述第一投屏信息的第二投屏信息,从而所述第二电子设备根据所述第二投屏信息显示第二投屏内容。With reference to the fifth aspect, in a possible implementation manner, the method further includes: sending, by the second electronic device, networking information of the second electronic device to the first electronic device; The device establishes a second screen projection connection with the terminal device; the second electronic device acquires second screen projection information different from the first screen projection information from the terminal device through the second screen projection connection, so that The second electronic device displays second screen projection content according to the second screen projection information.
结合第五方面,在一种可能的实现方式中,所述方法还包括:所述第二电子设备向所述第一电子设备发送所述第二投屏信息。With reference to the fifth aspect, in a possible implementation manner, the method further includes: the second electronic device sending the second screen projection information to the first electronic device.
结合第五方面,在一种可能的实现方式中,所述方法还包括:所述第二 电子设备获取所述第一电子设备发送的第二投屏信息,其中,所述第二投屏信息不同于所述第一投屏信息。With reference to the fifth aspect, in a possible implementation manner, the method further includes: the second electronic device acquires second screen projection information sent by the first electronic device, where the second screen projection information It is different from the first screen projection information.
结合第五方面,在一种可能的实现方式中,所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容,包括:所述第二电子设备发出是否进行接续投屏的询问消息,在接收到响应于所述询问消息的肯定响应的情况下,所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容。With reference to the fifth aspect, in a possible implementation manner, the second electronic device displays the first screen projection content according to the first screen projection information, including: the second electronic device sends whether to continue projection If an affirmative response is received in response to the inquiry message, the second electronic device displays the first screen projection content according to the first screen projection information.
结合第五方面,在一种可能的实现方式中,所述第一投屏信息包括所述第一投屏内容。With reference to the fifth aspect, in a possible implementation manner, the first screen projection information includes the first screen projection content.
第六方面,本申请的实施例还提供一种电子设备,所述电子设备包括存储器及处理器,所述处理器用于执行所述存储器中存储的计算机程序时实现如所述的投屏接续方法。In the sixth aspect, the embodiments of the present application also provide an electronic device, the electronic device includes a memory and a processor, and the processor is configured to implement the screen projection connection method as described when executing the computer program stored in the memory .
第七方面,本申请的实施例还提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现如所述的投屏接续方法。In a seventh aspect, the embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned screen projection connection method is implemented.
另外,第二方面至第七方面中任一种可能设计方式所带来的技术效果可参见投屏接续方法相关中不同设计方式所带来的技术效果,此处不再赘述。In addition, the technical effect brought by any possible design method in the second aspect to the seventh aspect can be referred to the technical effect brought by different design methods related to the screen projection connection method, and will not be repeated here.
第八方面,本申请的实施例还提供一种内容接续方法,应用于包括第一电子设备和第二电子设备的系统中,所述方法包括:所述第一电子设备运行及显示第一内容;所述第二电子设备获取内容接续的触发事件,其中,所述内容接续的触发事件用于触发所述第二电子设备进行内容接续;所述第二电子设备发现正在运行第一内容的所述第一电子设备,并从所述第一电子设备获取第一运行信息,从而所述第二电子设备根据所述第一运行信息运行及显示所述第一内容。在一种可能的实现方式中,第一电子设备运行的第一内容可以包括运行应用程序(Application program,APP)。采用本申请的实施例的投屏接续方法,第二电子设备可自动或根据用户操作触发内容接续,并自动发现正在运行第一内容的第一电子设备,还可自动从第一电子设备获取运行信息,从而实现内容自动接续,提供用户浏览或观看第一内容的连续性,提升用户体验;此外,用户也可不需要操作来实现第二电子设备的自动内容接续,极大地方便了用户。In the eighth aspect, the embodiments of the present application also provide a content connection method, which is applied to a system including a first electronic device and a second electronic device, and the method includes: the first electronic device runs and displays the first content The second electronic device acquires a trigger event of content connection, wherein the content connection trigger event is used to trigger the second electronic device to perform content connection; the second electronic device finds that all the first electronic device, and acquire first running information from the first electronic device, so that the second electronic device runs and displays the first content according to the first running information. In a possible implementation manner, the first content run by the first electronic device may include running an application program (Application program, APP). By adopting the screen projection connection method of the embodiment of the present application, the second electronic device can automatically or according to the user operation trigger content connection, and automatically find the first electronic device that is running the first content, and can also automatically obtain the running content from the first electronic device. Information, so as to realize the automatic content connection, provide the user with the continuity of browsing or watching the first content, and improve the user experience; in addition, the user does not need to operate to realize the automatic content connection of the second electronic device, which greatly facilitates the user.
结合第八方面,在一种可能的实现方式中,所述第一电子设备和所述第二电子设备处于同一个局域网中,所述第二电子设备发现正在运行第一内容的所述第一电子设备,包括:所述第一电子设备在所述局域网内广播第一消息,从而所述第二电子设备根据所述第一消息确定所述第一电子设备为正在运行第一内容的设备;如此,第一电子设备通过主动通知的方式实现第二电子设备发现正在运行第一内容的第一电子设备。在一种可能的实现方式中,所述第一消息可以包括正在运行信息。基于这样的设计,通过第一电子设备主动广播正在运行信息,第二电子设备据以确定第一电子设备为正在运行第一内容的设备,从而第二电子设备无需进行发现的相关操作,简化了发现的流程,提高了效率。With reference to the eighth aspect, in a possible implementation manner, the first electronic device and the second electronic device are in the same local area network, and the second electronic device discovers that the first electronic device that is running the first content The electronic device includes: the first electronic device broadcasts a first message in the local area network, so that the second electronic device determines according to the first message that the first electronic device is a device running the first content; In this way, the first electronic device enables the second electronic device to discover the first electronic device that is running the first content through active notification. In a possible implementation manner, the first message may include running information. Based on this design, the first electronic device actively broadcasts the running information, and the second electronic device determines that the first electronic device is running the first content, so that the second electronic device does not need to perform related operations of discovery, which simplifies The discovery process improves efficiency.
或者,所述第二电子设备在所述局域网内广播第二消息;所述第一电子设备响应于所述第二消息向所述第二电子设备发送第三消息,从而所述第二电子设备根据所述第三消息确定所述第一电子设备为正在运行第一内容的设备;如此,第二电子设备通过查询发现的方式实现第二电子设备发现正在运行第一内容的第一电子设备。在一种可能的实现方式中,所述第二消息可以包括发现请求;所述第三消息可以包括存在通知。基于这样的设计,可以使得第二电子设备可通过主动通知方式或查询发现方式发现正在运行第一内容的第一电子设备,可快速建立通信。Or, the second electronic device broadcasts a second message in the local area network; the first electronic device sends a third message to the second electronic device in response to the second message, so that the second electronic device According to the third message, it is determined that the first electronic device is the device running the first content; thus, the second electronic device discovers the first electronic device running the first content by querying and discovering. In a possible implementation manner, the second message may include a discovery request; the third message may include an existence notification. Based on such a design, the second electronic device can discover the first electronic device running the first content through an active notification method or a query discovery method, and communication can be quickly established.
结合第八方面,在一种可能的实现方式中,所述第二电子设备从所述第一电子设备获取第一运行信息,包括:所述第二电子设备发送运行信息获取请求;所述第一电子设备响应于所述运行信息获取请求,向所述第二电子设备发送所述第一运行信息,从而所述第二电子设备获取所述第一运行信息;或者,所述第一电子设备在所述第一消息或所述第三消息中携带所述第一运行信息,从而所述第二电子设备获取所述第一运行信息。基于这样的设计,第二电子设备可由多种方式从所述第一电子设备获取所述第一运行信息,不需要经过用户的操作获取运行信息,简化了用户操作流程,提升了用户体验。With reference to the eighth aspect, in a possible implementation manner, the second electronic device acquiring first running information from the first electronic device includes: the second electronic device sending a running information acquisition request; An electronic device sends the first running information to the second electronic device in response to the running information acquisition request, so that the second electronic device acquires the first running information; or, the first electronic device The first running information is carried in the first message or the third message, so that the second electronic device acquires the first running information. Based on such a design, the second electronic device can acquire the first running information from the first electronic device in multiple ways, without user operation to obtain the running information, which simplifies the user operation process and improves user experience.
结合第八方面,在一种可能的实现方式中,所述内容接续的触发事件包括以下项的一种或多种:所述第二电子设备开启;所述第二电子设备侦测到用户进入侦测范围;所述第二电子设备获取其他检测或传感设备侦测到用户进入所述侦测范围;所述第二电子设备获取其他具有无线定位功能的设备侦测到所述移动终端进入所述侦测范围;所述第二电子设备确定用户具有观看所述第二电子设备的意图;所述第二电子设备确定用户进入所述第二电子设备所安装的房间;所述第二电子设备接收到指示所述第二电子设备进行内容接续的指示消息。基于这样的设计,触发内容接续的方式可以包括主动触发或被动触发等多种方式,其中,用户可以根据个人意愿通过被动触发的方式,使第二电子设备进行内容接续,提供用户选择及操作;第二电子设备也可通过主动触发的方式,检测用户的行为或姿态等,自动进行内容接续,从而使得用户无需进行操作,即可根据用户的动态来自动进行接续投屏,提高了用户体验。With reference to the eighth aspect, in a possible implementation manner, the content connection trigger event includes one or more of the following items: the second electronic device is turned on; the second electronic device detects that a user enters Detection range; the second electronic device obtains other detection or sensing equipment to detect that the user enters the detection range; the second electronic device obtains other devices with wireless positioning functions to detect that the mobile terminal enters The detection range; the second electronic device determines that the user has the intention to watch the second electronic device; the second electronic device determines that the user enters the room where the second electronic device is installed; the second electronic device The device receives an indication message instructing the second electronic device to continue content. Based on this design, the ways of triggering content continuation may include active triggering or passive triggering and other ways, wherein the user can make the second electronic device carry out content continuation through passive triggering according to personal wishes, providing user selection and operation; The second electronic device can also detect the user's behavior or posture through active triggering, and automatically perform content connection, so that the user does not need to operate, and can automatically perform continuous screen projection according to the user's dynamics, which improves user experience.
结合第八方面,在一种可能的实现方式中,所述第一运行信息包括所述第一内容信息、第一显示界面和第一运行状态信息,所述第二电子设备根据所述第一运行信息运行及显示所述第一内容,包括:所述第二电子设备根据所述第一内容信息及第一运行状态信息,以第一运行状态信息指示的运行状态运行与第一内容信息对应的第一内容,及显示与第一内容对应的第一显示界面。基于这样的设计,第二电子设备可以根据第一内容在第一电子设备具体的运行状态对应接续运行第一内容,使得第二电子设备可与第一电子设备在内容接续时具有较佳的延续性,无需用户重新操作以接续浏览或观看第一内容,提供了极佳的用户体验。With reference to the eighth aspect, in a possible implementation manner, the first running information includes the first content information, the first display interface, and the first running state information, and the second electronic device Running and displaying the first content with the running information includes: the second electronic device runs in the running state indicated by the first running state information corresponding to the first content information according to the first content information and the first running state information the first content, and display a first display interface corresponding to the first content. Based on this design, the second electronic device can continue to run the first content according to the specific operating state of the first electronic device, so that the second electronic device can have a better continuation of the content with the first electronic device. It is flexible and does not require users to re-operate to continue browsing or watching the first content, providing an excellent user experience.
结合第八方面,在一种可能的实现方式中,所述第一内容信息包括运行 的应用程序,所述第一显示界面包括应用程序的界面,所述第一运行状态信息包括应用程序的运行状态。基于这样的设计,第二电子设备可以根据第一内容在第一电子设备具体的运行状态对应接续运行第一内容,使得第二电子设备至少在运行的应用程序、应用程序的界面及应用程序的运行状态上实现内容接续。With reference to the eighth aspect, in a possible implementation manner, the first content information includes a running application, the first display interface includes an interface of the application, and the first running status information includes running of the application. state. Based on this design, the second electronic device can continue to run the first content according to the specific operating state of the first electronic device in accordance with the first content, so that the second electronic device can at least run the application program, the interface of the application program, and the interface of the application program. Realize content continuation in running state.
结合第八方面,在一种可能的实现方式中,在所述第二电子设备根据所述第一运行信息运行及显示所述第一内容之后,所述第一电子设备继续运行及显示所述第一内容;或者,所述第一电子设备停止运行及显示所述第一内容。基于这样的设计,在第二电子设备进行内容接续后,第一电子设备可继续或停止运行第一内容,以提供用户在多设备间的选择性操作。With reference to the eighth aspect, in a possible implementation manner, after the second electronic device runs and displays the first content according to the first running information, the first electronic device continues to run and display the the first content; or, the first electronic device stops running and displays the first content. Based on such a design, after the second electronic device performs content connection, the first electronic device can continue or stop running the first content, so as to provide users with selective operations among multiple devices.
附图说明Description of drawings
图1是本申请一实施例提供的投屏接续方法的应用环境架构图。FIG. 1 is an application environment architecture diagram of a method for screen projection and connection provided by an embodiment of the present application.
图2是本申请一实施例提供的投屏接续方法的流程图。FIG. 2 is a flow chart of a screen projection connection method provided by an embodiment of the present application.
图3是本申请一实施例提供的投屏接续方法的应用场景示意图。FIG. 3 is a schematic diagram of an application scenario of a screen projection connection method provided by an embodiment of the present application.
图4是本申请一实施例提供的电子设备的界面的示意图。Fig. 4 is a schematic diagram of an interface of an electronic device provided by an embodiment of the present application.
图5是本申请另一实施例提供的投屏接续方法的应用场景示意图。FIG. 5 is a schematic diagram of an application scenario of a screen projection connection method provided by another embodiment of the present application.
图6是本申请一实施例提供的投屏接续方法的投屏控制转移的应用场景示意图。FIG. 6 is a schematic diagram of an application scenario of screen projection control transfer provided by a screen projection connection method according to an embodiment of the present application.
图7是本申请一实施例提供的投屏接续方法的同步投屏信息的应用场景示意图。FIG. 7 is a schematic diagram of an application scenario of synchronous screen projection information of a screen projection continuation method provided by an embodiment of the present application.
图8是本申请一实施例提供的内容接续方法的流程图。Fig. 8 is a flow chart of a content continuation method provided by an embodiment of the present application.
图9是本申请一实施例提供的电子设备的示意图。Fig. 9 is a schematic diagram of an electronic device provided by an embodiment of the present application.
主要元件符号说明Description of main component symbols
第一空间 first space 1212
第二空间 second space 1414
移动终端 mobile terminal 2020
第一电子设备 First Electronics 3030
第二电子设备second electronic device 4040
显示界面 UI 4242
对话框 dialog box 4444
第一图标 first icon 4646
第二图标 second icon 4848
服务器 server 5050
电子设备 Electronic equipment 6060
存储器 memory 6161
处理器 processor 6262
显示模块 display module 6363
通信模块 communication module 6464
计算机程序 Computer program 6565
如下具体实施方式将结合上述附图进一步说明本申请。The following specific embodiments will further illustrate the present application in conjunction with the above-mentioned drawings.
具体实施方式Detailed ways
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.
本申请中的术语“和/或”,是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。本文中符号“/”表示关联对象是或者的关系,例如A/B表示A或者B。The term "and/or" in this application is an association relationship describing associated objects, indicating that there may be three relationships, for example, A and/or B, which may mean: A exists alone, A and B exist simultaneously, and There are three cases of B. The symbol "/" in this document indicates that the associated object is an or relationship, for example, A/B indicates A or B.
本申请实施例中,“第一”、“第二”等词汇,仅用于区别不同的对象,不能理解为指示或暗示相对重要性,也不能理解为指示或暗示顺序。例如,第一应用、第二应用等是用于区别不同的应用,而不是用于描述应用的特定顺序,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。In the embodiment of the present application, terms such as "first" and "second" are only used to distinguish different objects, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order. For example, the first application, the second application, etc. are used to distinguish different applications, rather than to describe the specific order of applications, and the features defined as "first" and "second" may explicitly or implicitly include one or More of this feature.
在本申请实施例的描述中,“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。In the description of the embodiments of the present application, words such as "exemplary" or "for example" are used as examples, illustrations or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present application shall not be interpreted as being more preferred or more advantageous than other embodiments or design schemes. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete manner.
请参阅图1,为本申请一实施例提供的投屏接续方法的应用环境架构示意图。Please refer to FIG. 1 , which is a schematic diagram of an application environment architecture of a screen projection and connection method provided by an embodiment of the present application.
所述投屏接续方法可以应用在多个终端设备构成的环境中。例如,如图1所示的为一家居平面图,可以包括多个间隔开的空间/房间,例如,第一空间12和第二空间14。在一些实施方式中,所述第一空间12可以为但不限于为客厅,所述第二空间14可以为但不限于为卧室,可以理解,所述家居环境中还包括更多间隔开的空间,例如阳台、厨房、卫生间等,在此不一一列举。The screen projection connection method can be applied in an environment composed of multiple terminal devices. For example, a home floor plan as shown in FIG. 1 may include a plurality of separated spaces/rooms, for example, a first space 12 and a second space 14 . In some embodiments, the first space 12 can be but not limited to a living room, and the second space 14 can be but not limited to a bedroom. It can be understood that the home environment also includes more separated spaces. , such as balconies, kitchens, bathrooms, etc., are not listed here.
所述投屏接续方法可以为基于数字生活网络联盟(Digital Living Network Alliance,DLNA)投屏技术,应用于多个终端设备之间。在一些实施方式中,所述多个终端设备至少包括移动终端20、第一电子设备30和第二电子设备40。所述移动终端20可为但不限于为智能手机、平板计算机、手提式计算机、个人数字助理(Personal Digital Assistant,PDA)、游戏机、智能穿戴设备或具有无线通信功能的其他移动电子装置。所述第一电子设备30和第二电子设备40可以为但不限于为电视机、交互式网络电视(Internet Protocol Television,IPTV)、视频播放器、显示器、智能电视、大屏设备、平板电脑或其他具有视频播放功能的电子设备。在一些实施 方式中,所述第一电子设备30可置放于所述第一空间12内,所述第二电子设备40可置放于所述第二空间14内。可以理解,所述第一电子设备30和第二电子设备40相比所述移动终端20可具有更大显示屏幕,提供用户更佳的视觉体验。The screen projection connection method can be based on the Digital Living Network Alliance (Digital Living Network Alliance, DLNA) projection technology, and is applied between multiple terminal devices. In some implementation manners, the multiple terminal devices include at least a mobile terminal 20 , a first electronic device 30 and a second electronic device 40 . The mobile terminal 20 may be, but not limited to, a smart phone, a tablet computer, a portable computer, a personal digital assistant (Personal Digital Assistant, PDA), a game console, a smart wearable device or other mobile electronic devices with wireless communication functions. The first electronic device 30 and the second electronic device 40 may be, but not limited to, a television, an interactive network television (Internet Protocol Television, IPTV), a video player, a display, a smart TV, a large-screen device, a tablet computer or Other electronic devices with video playback function. In some implementations, the first electronic device 30 can be placed in the first space 12, and the second electronic device 40 can be placed in the second space 14. It can be understood that the first electronic device 30 and the second electronic device 40 may have larger display screens than the mobile terminal 20, so as to provide users with a better visual experience.
在一些实施方式中,所述移动终端20、第一电子设备30和第二电子设备40可通过网络互相通信,例如通过局域网(Local Area Network,LAN)互相通信,同时,还可通过网络与一服务器50相互通信。所述网络可以为但不限于为WiFi、光纤通信或者蜂窝通信的数据传输方式中的一种或多种的组合。在一些实施方式中,所述服务器50可以为但不限于为云端数据库,提供资源或数据的查询及获取。In some embodiments, the mobile terminal 20, the first electronic device 30 and the second electronic device 40 can communicate with each other through a network, for example, communicate with each other through a local area network (Local Area Network, LAN). The servers 50 communicate with each other. The network may be, but not limited to, one or a combination of data transmission methods of WiFi, optical fiber communication or cellular communication. In some embodiments, the server 50 may be, but not limited to, a cloud database, providing resource or data query and acquisition.
在一些实施方式中,为了实现投屏接续,也即移动终端20与第一电子设备30建立投屏连接后,由移动终端20提供投屏内容或提供投屏资源信息,所述第一电子设备30显示或播放投屏内容或投屏资源信息对应的投屏内容,切换至由第二电子设备40接续显示或播放投屏内容或投屏资源信息对应的投屏内容,用户需要首先断开移动终端20与第一电子设备30的投屏连接、再通过移动终端20重新查找投屏内容及定位投屏内容进度、接着通过移动终端20重新扫描可连接的终端设备、并由移动终端20选择与第二电子设备40建立投屏连接、最后通过移动终端20提供投屏内容或投屏资源信息,并由第二电子设备40显示或播放投屏内容或投屏资源信息对应的投屏内容,才可以完成投屏接续。所述移动终端20、第一电子设备30和第二电子设备40可为不同的终端设备。这种投屏接续方法的实施方式操作流程复杂,且各终端设备的功耗及操作流程时长不够优化,用户体验不佳。In some embodiments, in order to realize the screen projection connection, that is, after the mobile terminal 20 establishes a screen projection connection with the first electronic device 30, the mobile terminal 20 provides screen projection content or provides screen projection resource information, and the first electronic device 30 to display or play the projection content corresponding to the projection content or the projection resource information, switch to the second electronic device 40 to continue to display or play the projection content or the projection content corresponding to the projection resource information, the user needs to first disconnect the mobile Screen projection connection between the terminal 20 and the first electronic device 30, and then re-find the screen projection content and locate the progress of the screen projection content through the mobile terminal 20, and then re-scan the terminal equipment that can be connected through the mobile terminal 20, and the mobile terminal 20 selects and The second electronic device 40 establishes a screen projection connection, and finally provides the screen projection content or screen projection resource information through the mobile terminal 20, and the second electronic device 40 displays or plays the screen projection content corresponding to the screen projection content or screen projection resource information. Screencasting can be completed. The mobile terminal 20, the first electronic device 30 and the second electronic device 40 may be different terminal devices. The implementation of the screen projection and connection method has a complicated operation process, and the power consumption of each terminal device and the duration of the operation process are not optimized enough, resulting in poor user experience.
有鉴于此,本申请实施例提供一种投屏接续方法,移动终端20与第一电子设备30建立第一投屏连接,并向第一电子设备30发送第一投屏信息,从而第一电子设备30根据所述第一投屏信息显示第一投屏内容;第二电子设备40获取接续投屏的触发事件,其中,所述接续投屏的触发事件用于触发所述第二电子设备40进行接续投屏;第二电子设备40发现正在投屏的第一电子设备30,并从第一电子设备30获取所述第一投屏信息,从而第二电子设备40根据所述第一投屏信息显示所述第一投屏内容,从而实现多个终端设备间的接续投屏,使得用户可在多个终端设备间切换接续投屏,方便用户在场景切换的情况下控制投屏,并在多个终端设备间同步投屏信息,自动接续投屏内容的播放,提供用户较佳的观感体验。In view of this, the embodiment of the present application provides a screen projection connection method, the mobile terminal 20 establishes a first screen projection connection with the first electronic device 30, and sends the first screen projection information to the first electronic device 30, so that the first electronic device 30 The device 30 displays the content of the first screen projection according to the first screen projection information; the second electronic device 40 obtains a trigger event of the continuous screen projection, wherein the trigger event of the continuous screen projection is used to trigger the second electronic device 40 Perform continuous screen projection; the second electronic device 40 finds the first electronic device 30 that is projecting the screen, and obtains the first screen projection information from the first electronic device 30, so that the second electronic device 40 according to the first screen projection The information displays the content of the first screen projection, so as to realize continuous screen projection between multiple terminal devices, so that the user can switch between multiple terminal devices for continuous screen projection, which is convenient for the user to control the screen projection when the scene is switched. The screen projection information is synchronized between multiple terminal devices, and the playback of the screen projection content is automatically continued, providing users with a better viewing experience.
接下来,结合附图详细描述本申请实施例提供的投屏接续方法。Next, the screen projection connection method provided by the embodiment of the present application will be described in detail with reference to the accompanying drawings.
请参阅图2,为本申请一实施例提供的投屏接续方法的流程图。示例性地,所述投屏接续方法可以包括以下步骤。Please refer to FIG. 2 , which is a flowchart of a screen projection connection method provided by an embodiment of the present application. Exemplarily, the screen projection continuation method may include the following steps.
步骤S211:移动终端20与第一电子设备30建立第一投屏连接。Step S211 : the mobile terminal 20 establishes a first screen projection connection with the first electronic device 30 .
在一些实施方式中,所述移动终端20向所述第一电子设备30提供第一投屏信息,所述第一投屏信息可包括第一投屏资源信息,第一电子设备30可根据第一投屏资源信息获取投屏内容,并可显示投屏内容,移动终端20 可对所述第一电子设备30的投屏内容进行控制。例如,用户在所述第一空间12内使用移动终端20浏览内容,例如播放视频内容时,通过移动终端20提供投屏内容对应的第一投屏资源信息,所述第一电子设备30根据第一投屏资源信息获取所述投屏内容并显示或播放所述投屏内容,例如移动终端20提供视频内容对应的第一投屏资源信息,第一电子设备30根据第一投屏资源信息获取所述视频内容并播放所述视频内容,从而获得更佳的视觉体验。在另一实施例中,所述投屏内容不限于播放视频内容,也可以是播放音频内容或者其他可显示的浏览内容。In some embodiments, the mobile terminal 20 provides the first screen projection information to the first electronic device 30, and the first screen projection information may include first screen projection resource information, and the first electronic device 30 may A screen projection resource information acquires the screen projection content, and can display the screen projection content, and the mobile terminal 20 can control the screen projection content of the first electronic device 30 . For example, when the user uses the mobile terminal 20 to browse content in the first space 12, such as playing video content, the mobile terminal 20 provides the first screen projection resource information corresponding to the screen projection content, and the first electronic device 30 according to the first A screen projection resource information acquires the screen projection content and displays or plays the screen projection content. For example, the mobile terminal 20 provides the first screen projection resource information corresponding to the video content, and the first electronic device 30 obtains the screen projection resource information according to the first screen projection resource information. The video content and play the video content, so as to obtain a better visual experience. In another embodiment, the screen projection content is not limited to playing video content, and may also be playing audio content or other displayable browsing content.
在一些实施方式中,所述移动终端20可通过DLNA与所述第一电子设备30建立投屏连接,所述移动终端20可向所述第一电子设备30发送第一投屏资源信息,所述第一投屏资源信息至少包括播放内容的网络地址,例如统一资源标识符(Uniform Resource Identifier,URI)地址,所述第一电子设备30可根据所述网络地址从所述服务器50获取所述播放内容,从而所述第一电子设备30与所述移动终端20可以同步显示所述播放内容(也即投屏内容),或者,在所述第一电子设备30开始显示所述播放内容后所述移动终端20停止显示所述播放内容。可选地,移动终端20可对所述第一电子设备30进行投屏控制,例如,所述移动终端20可对所述第一电子设备30的投屏内容进行例如播放、暂停、停止、快进/快退、调节音量、全屏显示、分屏显示、调节显示比例等投屏控制。从而用户可方便地通过方便携带及操作的移动终端20来遥控第一电子设备30的投屏内容,以获得较佳的操作体验。在一些实施例中,第一投屏资源信息还可以包括第一投屏状态信息,用于携带以上所述移动终端20产生的投屏控制信息,从而第一电子设备30根据第一投屏状态信息显示所述播放内容。在一些实施方式中,所述投屏控制可以为通过基于DLNA的传输控制协议(Transmission Control Protocol,TCP)连接的简单对象访问协议(Simple Object Access Protocol,SOAP)建立的控制链路实现的。In some implementation manners, the mobile terminal 20 can establish a screen projection connection with the first electronic device 30 through DLNA, and the mobile terminal 20 can send the first screen projection resource information to the first electronic device 30, so The first screen projection resource information includes at least the network address of the playing content, such as a Uniform Resource Identifier (Uniform Resource Identifier, URI) address, and the first electronic device 30 can obtain the content from the server 50 according to the network address. play content, so that the first electronic device 30 and the mobile terminal 20 can display the play content (that is, screen projection content) synchronously, or, after the first electronic device 30 starts to display the play content, the The mobile terminal 20 stops displaying the playing content. Optionally, the mobile terminal 20 can perform screen projection control on the first electronic device 30, for example, the mobile terminal 20 can perform, for example, play, pause, stop, fast Forward/rewind, adjust volume, full screen display, split screen display, adjust display ratio and other screen projection controls. Therefore, the user can conveniently use the mobile terminal 20 that is easy to carry and operate to remotely control the projected content of the first electronic device 30 to obtain a better operating experience. In some embodiments, the first screen projection resource information may also include first screen projection state information, which is used to carry the above screen projection control information generated by the mobile terminal 20, so that the first electronic device 30 according to the first screen projection state The information displays the playing content. In some implementation manners, the screen projection control can be realized through a control link established by a Simple Object Access Protocol (SOAP) connected to a DLNA-based Transmission Control Protocol (Transmission Control Protocol, TCP).
此外,所述第一电子设备30也可以直接获取用户操作来实现对投屏内容的控制,例如播放、暂停、停止、快进/快退、调节音量、全屏显示、分屏显示、调节显示比例等。在一些实施方式中,用户可直接操作第一电子设备30来实现对投屏内容的控制,例如操作第一电子设备30的显示界面或操作与第一电子设备30配套的遥控器等。In addition, the first electronic device 30 can also directly obtain user operations to control the content on the screen, such as playing, pausing, stopping, fast forward/rewind, adjusting volume, full-screen display, split-screen display, and adjusting the display ratio. wait. In some implementations, the user can directly operate the first electronic device 30 to control the projected content, such as operating the display interface of the first electronic device 30 or operating a remote control matched with the first electronic device 30 .
步骤S212:触发投屏接续。Step S212: Trigger the screen projection connection.
在一些实施方式中,当用户从所述第一电子设备30所在的第一空间12移动到其他空间,例如第二电子设备40所在的第二空间14,所述第二电子设备40获取触发事件。所述触发事件可以包括但不限于以下的任一种或多种方式:启动第二电子设备40、第二电子设备40侦测到用户进入到侦测范围、具有检测或传感功能的设备侦测到用户进入到侦测范围、具有无线定位功能的设备侦测到移动终端20进入到侦测范围、第二电子设备40确定用户具有观看第二电子设备40的意图、第二电子设备40确定用户进入安装有第 二电子设备40的房间(如第二空间14)、第二电子设备40接收到指示第二电子设备40进行接续投屏的指示消息。In some implementations, when the user moves from the first space 12 where the first electronic device 30 is located to another space, such as the second space 14 where the second electronic device 40 is located, the second electronic device 40 acquires a trigger event . The triggering event may include, but not limited to, any one or more of the following methods: starting the second electronic device 40, the second electronic device 40 detecting that the user enters the detection range, a device with detection or sensing function detecting It is detected that the user enters the detection range, the device with wireless positioning function detects that the mobile terminal 20 enters the detection range, the second electronic device 40 determines that the user has the intention to watch the second electronic device 40, the second electronic device 40 determines The user enters a room (such as the second space 14 ) where the second electronic device 40 is installed, and the second electronic device 40 receives an instruction message instructing the second electronic device 40 to continue screen projection.
在一些实施方式中,当用户通过开关电源等启动所述第二电子设备40时,所述第二电子设备40侦测为投屏接续的触发事件;或者,第二电子设备40配备的摄像头或传感器元件侦测到用户进入到侦测范围(例如摄像头的拍摄范围,或传感器元件侦测到用户进入第二空间14范围)时,第二电子设备40侦测为投屏接续的触发事件;又或者,当具有检测或传感功能的设备,例如红外传感器、光电传感器、热探测器、摄像头设备、毫米波雷达等,侦测到用户进入到侦测范围(例如第二空间14范围)时为触发事件;又或者,当具有无线定位功能的设备,例如室内无线基站、无线定位标签等,侦测到用户携带移动终端20进入到侦测范围(例如第二空间14范围)时为触发事件,其中无线定位功能可通过定位技术,例如超宽带(ultra wide band,UWB)定位技术,对移动终端20进行定位;又或者,当用户意图识别模型或算法,根据输入信息(例如摄像头捕捉的图像或视频、传感器数据等),判断用户当前具有观看第二电子设备40的意图时为接续投屏的触发事件;又或者,第二电子设备40或其他电子设备安装有地图应用程序,当用户携带移动终端20进入到安装有第二电子设备40的房间(如第二空间14),则第二电子设备40或其他电子设备可识别移动终端20的位置在第二空间14时为触发事件;又或者,用户通过第二电子设备40的界面主动触发接续投屏的操作以对第二电子设备40形成指示消息,第二电子设备40接收到进行接续投屏的指示消息时为触发事件。In some implementations, when the user activates the second electronic device 40 by switching the power supply, etc., the second electronic device 40 detects a trigger event for screen projection connection; or, the second electronic device 40 is equipped with a camera or When the sensor element detects that the user enters the detection range (such as the shooting range of the camera, or the sensor element detects that the user enters the range of the second space 14), the second electronic device 40 detects it as a trigger event for the screen projection connection; and Or, when a device with a detection or sensing function, such as an infrared sensor, a photoelectric sensor, a thermal detector, a camera device, a millimeter-wave radar, etc., detects that the user enters the detection range (such as the range of the second space 14) A trigger event; or, when a device with a wireless positioning function, such as an indoor wireless base station, a wireless positioning tag, etc., detects that the user carries the mobile terminal 20 into the detection range (such as the range of the second space 14), it is a trigger event, Wherein the wireless positioning function can locate the mobile terminal 20 through positioning technology, such as ultra wide band (UWB) positioning technology; video, sensor data, etc.), judging that the user currently has the intention to watch the second electronic device 40 is a trigger event for continuous screen projection; or, the second electronic device 40 or other electronic devices are installed with map applications. When the terminal 20 enters the room where the second electronic device 40 is installed (such as the second space 14), the second electronic device 40 or other electronic devices can recognize that the position of the mobile terminal 20 is in the second space 14 as a trigger event; or The user actively triggers the continuous screen projection operation through the interface of the second electronic device 40 to form an instruction message to the second electronic device 40, and when the second electronic device 40 receives the instruction message for continuous screen projection, it is a trigger event.
在一些实施方式中,所述具有检测或传感功能的设备或具有无线定位功能的设备将触发事件发送至所述第二电子设备40,所述第二电子设备40获取投屏接续的触发事件,并可响应于所述触发事件继而进行投屏接续。所述触发投屏接续的触发事件的方式为多种,用户可通过启动第二电子设备40主动触发投屏接续,或者,第二电子设备40配备的摄像头或传感器元件侦测用户进入到侦测范围而触发投屏接续,或者具有检测或传感功能的设备侦测用户进入到侦测范围而触发投屏接续,或者具有无线定位功能的设备侦测到移动终端20进入到侦测范围而触发投屏接续,或者第二电子设备40确定用户具有观看第二电子设备40的意图,或者第二电子设备40确定用户进入安装有第二电子设备40的房间,使得用户不需任何操作即可自动进行投屏接续,提供用户方便。在其他的实施方式中,所述触发事件还可包括其他触发方式,在此不一一列举。在一些实施方式中,用户从客厅(第一空间12)进入卧室(第二空间14),希望通过卧室的大屏(第二电子设备40)继续播放客厅的大屏(第一电子设备30)所播放的投屏内容,则可触发投屏接续,使得用户在进入卧室后通过卧室的大屏继续观看相同的投屏内容,从而用户可获得较佳的观感体验。In some implementations, the device with detection or sensing function or the device with wireless positioning function sends the trigger event to the second electronic device 40, and the second electronic device 40 obtains the trigger event of screen projection connection , and continue screen projection in response to the trigger event. There are many ways to trigger the screen projection connection. The user can actively trigger the screen projection connection by starting the second electronic device 40, or the second electronic device 40 is equipped with a camera or a sensor element to detect the user's entry into the detection mode. or the device with detection or sensing function detects that the user enters the detection range and triggers the screen projection connection, or the device with wireless positioning function detects that the mobile terminal 20 enters the detection range and triggers The screen projection is continued, or the second electronic device 40 determines that the user has the intention to watch the second electronic device 40, or the second electronic device 40 determines that the user enters the room where the second electronic device 40 is installed, so that the user does not need any operation. Perform screen projection and connection to provide user convenience. In other implementation manners, the triggering event may also include other triggering manners, which are not listed here. In some embodiments, the user enters the bedroom (second space 14) from the living room (first space 12), and wishes to continue playing the large screen in the living room (first electronic device 30) through the large screen in the bedroom (second electronic device 40). The played screen projection content can trigger the screen projection continuation, so that the user can continue to watch the same projection screen content through the large screen in the bedroom after entering the bedroom, so that the user can obtain a better visual experience.
可选地,在一些实施方式中,上述的触发条件如第二电子设备40侦测到被启动、第二电子设备40侦测到用户进入到侦测范围、具有检测或传感 功能的设备侦测到用户进入到侦测范围或/和具有无线定位功能的设备侦测到移动终端20进入到侦测范围,在实施时这些触发条件中的一种触发条件或多种触发条件进行组合来作为投屏接续的触发条件。Optionally, in some implementations, the above-mentioned triggering conditions are, for example, the second electronic device 40 detects that it is activated, the second electronic device 40 detects that the user enters the detection range, a device with a detection or sensing function detects It is detected that the user enters the detection range or/and the device with the wireless positioning function detects that the mobile terminal 20 enters the detection range. During implementation, one or more trigger conditions in these trigger conditions are combined as The trigger condition for screencasting connection.
请参阅图3,为本申请一实施例提供的投屏接续方法的应用场景示意图。移动终端20与第一电子设备30建立投屏连接,并建立控制链路,所述移动终端20提供投屏内容的资源信息,所述第一电子设备30获取投屏内容的资源信息,并根据投屏内容的资源信息从服务器50获取投屏内容,并显示或播放所述投屏内容。当移动终端20移动到第二电子设备40对应的空间,并触发投屏接续,则移动终端20与第二电子设备40之间可建立新的投屏连接,且第二电子设备40可进行投屏接续。Please refer to FIG. 3 , which is a schematic diagram of an application scenario of a screen projection connection method provided by an embodiment of the present application. The mobile terminal 20 establishes a screen projection connection with the first electronic device 30, and establishes a control link. The mobile terminal 20 provides resource information of the screen projection content, and the first electronic device 30 obtains the resource information of the screen projection content, and according to The resource information of the screen projection content is acquired from the server 50, and the screen projection content is displayed or played. When the mobile terminal 20 moves to the space corresponding to the second electronic device 40 and triggers the screen projection connection, a new screen projection connection can be established between the mobile terminal 20 and the second electronic device 40, and the second electronic device 40 can perform projection. screen continues.
步骤S213:发现正在投屏设备。Step S213: discovering the device that is casting the screen.
在一些实施方式中,所述发现正在投屏设备可以包括主动通知和查询发现方式。In some implementation manners, the discovery of the device that is casting the screen may include active notification and inquiry of a discovery method.
其中,主动通知方式可为由正在接受投屏的第一电子设备30通过局域网广播其正在投屏信息。在一些实施方式中,所述第一电子设备30可通过DLNA的底层发现协议,如简单服务发现协议(Simple Service Discovery Protocol,SSDP),扩展预设报文字段,例如扩展正在投屏的报文字段,在局域网广播正在投屏信息。其他获取触发事件的电子设备,如第二电子设备40,接收所述第一电子设备30广播的正在投屏信息,以获知所述第一电子设备30正在投屏。在一些实施方式中,经过扩展正在投屏的报文字段后的报文可以为:Wherein, the active notification method may be that the first electronic device 30 accepting screen projection broadcasts its screen projection information through a local area network. In some implementations, the first electronic device 30 can extend the preset message field through the underlying discovery protocol of DLNA, such as Simple Service Discovery Protocol (SSDP), for example, expand the message that is being projected field, broadcasting the screencasting information on the LAN. Other electronic devices that acquire the trigger event, such as the second electronic device 40, receive the screen-casting information broadcast by the first electronic device 30 to learn that the first electronic device 30 is screen-casting. In some implementation manners, the message after expanding the field of the message being projected can be:
NOTIFY*HTTP/1.1NOTIFY*HTTP/1.1
HOST:239.255.255.250:1900HOST:239.255.255.250:1900
CACHE-CONTROL:max-age=seconds until advertisement expiresCACHE-CONTROL:max-age=seconds until advertisement expires
LOCATION:URL for UPnP description for root deviceLOCATION: URL for UPnP description for root device
NT:search targetNT: search target
NTS:ssdp:aliveNTS:ssdp:alive
USN:advertisement UUIDUSN: advertisement UUID
ISPLAYING:YES/NOISPLAYING: YES/NO
其中,HOST可为设置为协议保留多播地址和端口的报文字段;CACHE-CONTROL可为制定通知消息存活时间的报文字段;LOCATION可为表示包含根设备描述的URL地址的报文字段;NT可为表示服务类型的报文字段;NTS可为表示存在通知消息的报文字段;USN可为表示不同服务的统一服务名,标示相同类型服务能力的报文字段;ISPLAYING字段可为所扩展的正在投屏的报文字段,所述ISPLAYING字段为YES时,可表示设备当前正在投屏,所述ISPLAYING字段为NO时,可表示设备当前没有投屏。Among them, HOST can be the message field that is set to reserve the multicast address and port for the protocol; CACHE-CONTROL can be the message field that formulates the survival time of the notification message; LOCATION can be the message field that indicates the URL address that contains the root device description; NT can be the message field indicating the service type; NTS can be the message field indicating the existence notification message; USN can be the uniform service name indicating different services, and the message field indicating the same type of service capability; the ISPLAYING field can be extended In the message field of screen casting, when the ISPLAYING field is YES, it can indicate that the device is currently casting a screen, and when the ISPLAYING field is NO, it can indicate that the device is not currently casting a screen.
所述查询发现方式可为由获取触发事件的第二电子设备40在局域网内发现是否有正在投屏的设备。在一些实施方式中,所述第二电子设备40可通过DLNA的底层发现协议,如SSDP,扩展预设报文字段,例如扩展正在投 屏的报文字段,在局域网内广播发现请求以发现正在投屏的设备,当存在正在投屏的设备,例如第一电子设备30,则正在投屏的设备(例如第一电子设备30)向发播地址,也即第二电子设备40,发送存在通知,所述第二电子设备40获取所述存在通知以获知所述第一电子设备30正在投屏。在一些实施方式中,经过扩展正在投屏的报文字段后的报文可以为:The query discovery method may be that the second electronic device 40 that acquires the trigger event finds whether there is a device that is casting a screen in the local area network. In some implementations, the second electronic device 40 can extend the preset message field through the underlying discovery protocol of DLNA, such as SSDP, for example, expand the message field of the screen being projected, and broadcast a discovery request in the local area network to discover the current The device that is casting the screen, when there is a device that is casting the screen, such as the first electronic device 30, the device that is casting the screen (such as the first electronic device 30) sends an existence notification to the broadcast address, that is, the second electronic device 40 , the second electronic device 40 obtains the presence notification to know that the first electronic device 30 is casting a screen. In some implementation manners, the message after expanding the field of the message being projected can be:
M-SEARCH*HTTP/1.1M-SEARCH*HTTP/1.1
HOST:239.255.255.250:1900HOST:239.255.255.250:1900
MAN:ssdp:discoverMAN:ssdp:discover
MX:seconds to delay responseMX:seconds to delay response
ST:search targetST: search target
ISPLAYING:YES/NOISPLAYING: YES/NO
其中,HOST为设置为协议保留多播地址和端口的报文字段;MAN为设置协议查询的类型的报文字段;MX为设置设备响应最长等待时间的报文字段;ST为内容和意义与查询请求的相应字段相同的报文字段;ISPLAYING字段可为所扩展的正在投屏的报文字段,所述ISPLAYING字段为YES时,可表示设备当前正在投屏,所述ISPLAYING字段为NO时,可表示设备当前没有投屏。Among them, HOST is the message field that is set to reserve the multicast address and port for the protocol; MAN is the message field that sets the type of protocol query; MX is the message field that sets the longest waiting time for the device to respond; ST is the content and meaning and Query the message field with the same field as the corresponding field in the request; the ISPLAYING field can be an extended message field that is currently casting a screen. When the ISPLAYING field is YES, it can indicate that the device is currently casting a screen. When the ISPLAYING field is NO, It can indicate that the device is not currently casting a screen.
第二电子设备40与第一电子设备30之间可通过主动通知方式或查询发现方式发现正在投屏的设备,可快速建立通信。The second electronic device 40 and the first electronic device 30 can discover the device that is projecting the screen through an active notification method or a query discovery method, and communication can be quickly established.
步骤S214:交互第一投屏信息。Step S214: Interact with the first screen projection information.
在一些实施方式中,所述第一电子设备30可向所述第二电子设备40发送第一投屏信息。在一些实施方式中,所述第一投屏信息还可包括第一投屏资源信息及第一投屏状态信息,所述第一投屏状态信息可包括但不限于播放进度、播放音量及播放状态(可包括但不限于播放、暂停、倍数、全屏、分屏)等。此外,所述第一电子设备30还可同时向所述第二电子设备40发送第一电子设备30的组网信息,例如IP地址和网络端口等。在一些实施方式中,所述第一电子设备30可通过扩展DLNA的续投协议报文字段,例如扩展投屏内容的网络地址、播放进度、播放音量及播放状态等对应的报文字段,传递投屏信息。所述第一电子设备30通过向第二电子设备40交互第一投屏信息,使得第二电子设备40可获得第一投屏资源信息(可对应获得投屏内容)及第一投屏状态信息(可对应获得第一电子设备30当前的投屏状态),不需经过移动终端20重新获取投屏内容及识别投屏内容的当前状态,简化了多终端设备间的通信流程,提高了投屏接续的效率。In some implementation manners, the first electronic device 30 may send the first screen projection information to the second electronic device 40 . In some implementations, the first screen projection information may also include first screen projection resource information and first screen projection status information, and the first screen projection status information may include but not limited to playback progress, playback volume, and playback Status (may include but not limited to play, pause, multiplier, full screen, split screen), etc. In addition, the first electronic device 30 may also send the networking information of the first electronic device 30 to the second electronic device 40 at the same time, such as IP address and network port. In some implementations, the first electronic device 30 can transmit the message field by extending the message field of the continuous casting protocol of DLNA, such as expanding the message field corresponding to the network address, playback progress, playback volume, and playback status of the projected screen content. Casting information. The first electronic device 30 interacts with the second electronic device 40 with the first screen projection information, so that the second electronic device 40 can obtain the first screen projection resource information (which can correspond to the projection content) and the first screen projection state information (can correspond to obtain the current screen projection state of the first electronic device 30), without reacquiring the screen projection content and identifying the current state of the screen projection content through the mobile terminal 20, which simplifies the communication process between multiple terminal devices and improves the screen projection process. Successive efficiency.
在一些实施方式中,当通过所述主动通知方式发现正在投屏设备时,所述第二电子设备40可向第一电子设备30请求当前投屏信息,所述第一电子设备30可响应所述请求向第二电子设备40发送投屏信息。其中,所述第二电子设备40向第一电子设备30请求投屏信息的报文可以为:In some implementations, when a device that is casting a screen is found through the active notification method, the second electronic device 40 may request the current screen projection information from the first electronic device 30, and the first electronic device 30 may respond to the The above request sends screen projection information to the second electronic device 40 . Wherein, the message for the second electronic device 40 to request screen projection information from the first electronic device 30 may be:
GET/ContinuePlay.xml HTTP/1.1GET/ContinuePlay.xml HTTP/1.1
Accept:text/xml,application/xmlAccept: text/xml, application/xml
User-Agent:Mozilla/4.0(compatible;UPnP/1.0;Windows NT/5.1)User-Agent: Mozilla/4.0 (compatible; UPnP/1.0; Windows NT/5.1)
Host:192.168.1.1:2800Host: 192.168.1.1:2800
Connection:Keep-AliveConnection: Keep-Alive
Cache-Control:no-cacheCache-Control: no-cache
Pragma:no-cachePragma: no-cache
所述第一电子设备30响应所述请求向第二电子设备40发送投屏信息的报文可以为:The message in which the first electronic device 30 sends screen projection information to the second electronic device 40 in response to the request may be:
HTTP/1.1200OKHTTP/1.1200 OK
Server:Unknown/0.0 UPnP/1.0 Conexant-EmWeb/R6_1_0Server:Unknown/0.0 UPnP/1.0 Conexant-EmWeb/R6_1_0
Connection:closeContent-Type:text/xmlConnection:closeContent-Type:text/xml
Expires:Thu,01 Jan 1970 00:00:00 GMTExpires: Thu,01 Jan 1970 00:00:00 GMT
Cache-Control:no-cache Pragma:no-cacheCache-Control: no-cache Pragma: no-cache
<s:Envelope><s:Envelope>
<s:Body><s:Body>
<u:ContinuePlay><u:ContinuePlay>
<ContinueURI>续播视频链接地址</ContinueURI><ContinueURI>Continue video link address</ContinueURI>
<ContinueSeek>续播视频进度</ContinueSeek><ContinueSeek>Continue video progress</ContinueSeek>
<ContinueVolume>续播视频音量</ContinueVolume><ContinueVolume>Continue Video Volume</ContinueVolume>
<ContinueState>续播状态,包括但不限于播放、暂停、倍数、全屏、分屏</ContinueState><ContinueState>Continue state, including but not limited to play, pause, multiple, full screen, split screen</ContinueState>
</u:ContinuePlay></u:ContinuePlay>
</s:Body></s:Envelope></s:Body></s:Envelope>
在一些实施方式中,当通过所述查询发现方式发现正在投屏设备时,所述第一电子设备30可在向第二电子设备40发送的存在通知中添加投屏信息的报文,所述投屏信息的报文可以为:In some implementations, when a device that is casting a screen is found through the query discovery method, the first electronic device 30 may add a message of screen projection information to the existence notification sent to the second electronic device 40, the The message of screencasting information can be:
HTTP/1.1 200 OKHTTP/1.1 200 OK
CACHE-CONTROL:max-age=seconds until advertisement expiresCACHE-CONTROL:max-age=seconds until advertisement expires
DATE:when reponse was generatedDATE: when response was generated
EXT:EXT:
LOCATION:URL for UPnP description for root deviceLOCATION: URL for UPnP description for root device
SERVER:OS/Version UPNP/1.0 product/versionSERVER:OS/Version UPNP/1.0 product/version
ST:search targetST: search target
USN:advertisement UUIDUSN: advertisement UUID
ContinueURI:续播视频链接地址ContinueURI: URL of the video link for the continuation video
ContinueSeek:续播视频进度ContinueSeek: Continue Seek video progress
ContinueVolume:续播视频音量ContinueVolume: Continue video volume
ContinueState:续播状态,包括但不限于播放、暂停、倍数、全屏、分屏。ContinueState: Continue state, including but not limited to play, pause, multiple, full screen, split screen.
在一些实施方式中,当通过所述主动通知方式发现正在投屏设备时,第一电子设备30通过局域网广播其正在投屏的消息中携带所述投屏信息。在 一些实施方式中,所述第一电子设备30可通过DLNA的底层发现协议,如简单服务发现协议(Simple Service Discovery Protocol,SSDP),扩展投屏信息的报文字段,在局域网广播正在投屏消息及投屏信息。其他获取触发事件的电子设备,如第二电子设备40,接收所述第一电子设备30广播的正在投屏消息以及投屏信息,在获知所述第一电子设备30正在投屏的同时,可以获取投屏信息。In some implementations, when the screen-casting device is found through the active notification method, the first electronic device 30 broadcasts a screen-casting message through the local area network to carry the screen-casting information. In some embodiments, the first electronic device 30 can expand the message field of the screen projection information through the underlying discovery protocol of DLNA, such as the Simple Service Discovery Protocol (SSDP), and broadcast the screen projection in the local area network News and screencast information. Other electronic devices that acquire the trigger event, such as the second electronic device 40, receive the screen-casting message and the screen-casting information broadcast by the first electronic device 30, and while knowing that the first electronic device 30 is screen-casting, can Get screencast information.
步骤S215:投屏接续。Step S215: Screen projection continues.
在一些实施方式中,所述第二电子设备40可根据从所述第一电子设备30接收的投屏信息开始投屏接续。在一些实施方式中,所述第二电子设备40可根据所述投屏信息中的投屏内容的网络地址从所述服务器50获取所述投屏内容,并根据投屏信息中的投屏状态信息,例如播放进度、播放音量及播放状态(可包括但不限于播放、暂停、倍数、全屏、分屏)等继续播放所述投屏内容。从而所述第二电子设备40与所述第一电子设备30以相同的播放进度、播放音量及播放状态同步播放相同的投屏内容。在一些实施方式中,所述第二电子设备40可根据从所述第一电子设备30获取的投屏内容对应的投屏资源信息及投屏内容的当前状态显示或播放投屏内容,使得第二电子设备40可接续第一电子设备30的对投屏内容的显示或播放状态,无需移动终端20识别投屏内容的投屏信息,再反馈至第二电子设备40,简化了多终端设备间的通信流程,提高了投屏接续的效率。In some implementations, the second electronic device 40 may start the screen projection sequence according to the screen projection information received from the first electronic device 30 . In some implementations, the second electronic device 40 may obtain the screen projection content from the server 50 according to the network address of the screen projection content in the screen projection information, and obtain the screen projection content according to the screen projection status in the screen projection information. Information, such as playback progress, playback volume, and playback status (which may include but not limited to play, pause, multiplier, full screen, split screen), etc., to continue playing the screen projection content. Therefore, the second electronic device 40 and the first electronic device 30 synchronously play the same screen projection content with the same play progress, play volume and play state. In some implementations, the second electronic device 40 can display or play the screen projection content according to the screen projection resource information corresponding to the screen projection content acquired from the first electronic device 30 and the current state of the screen projection content, so that the second The second electronic device 40 can continue the display or playback status of the first electronic device 30 on the screen projection content, without the need for the mobile terminal 20 to identify the screen projection information of the screen projection content, and then feed it back to the second electronic device 40, simplifying the communication between multiple terminal devices. The communication process improves the efficiency of screen projection connection.
在一些实施方式中,在所述第二电子设备40触发投屏接续且发现正在投屏设备后,还包括向用户询问是否投屏接续。在一些实施方式中,请一并参阅图4,所述第二电子设备40通过显示界面42显示对话框44,询问是否投屏接续,并接收用户的操作。当接收到用户的肯定操作,例如侦测到用户对所述对话框44中的第一图标46的操作,则第二电子设备40立即进行投屏接续;当接收到用户的否定操作,例如侦测到用户对所述对话框44中的第二图标48的操作,则所述第二电子设备40不进行投屏接续。在一些实施方式中,所述第一图标46为肯定图标,所述第二图标48为否定图标。In some implementations, after the second electronic device 40 triggers the screen projection connection and finds that the device is casting the screen, it further includes asking the user whether to continue the screen projection. In some implementation manners, please also refer to FIG. 4 , the second electronic device 40 displays a dialog box 44 through a display interface 42 , asking whether to continue the screen projection, and receives a user's operation. When receiving the user's affirmative operation, such as detecting the user's operation on the first icon 46 in the dialog box 44, the second electronic device 40 immediately performs the screen projection connection; when receiving the user's negative operation, such as detecting When the user's operation on the second icon 48 in the dialog box 44 is detected, the second electronic device 40 does not perform the screen projection connection. In some implementations, the first icon 46 is a positive icon, and the second icon 48 is a negative icon.
可选地,在一些实施方式中,请一并参阅图5,第一电子设备30与第二电子设备40交互投屏信息也可采用其他方式,例如第一电子设备30可向第二电子设备40传输镜像投屏数据流,也即第一电子设备30与第二电子设备40之间建立镜像投屏,则第二电子设备40与第一电子设备30同步显示或播放投屏内容,而第二电子设备40无需再从服务器50获取投屏内容,简化投屏连接步骤,提高效率。Optionally, in some embodiments, please also refer to FIG. 5 , the first electronic device 30 and the second electronic device 40 may also use other ways to interact and project screen information, for example, the first electronic device 30 may send a message to the second electronic device 40 transmits the mirrored screen projection data stream, that is, the mirrored screen projection is established between the first electronic device 30 and the second electronic device 40, then the second electronic device 40 and the first electronic device 30 synchronously display or play the screencast content, and the second electronic device 30 The second electronic device 40 does not need to obtain screen projection content from the server 50, which simplifies the screen projection connection steps and improves efficiency.
可选地,在一些实施方式中,请一并参阅图5,第一电子设备30与第二电子设备40交互投屏信息也可采用其他方式,例如第一电子设备30可向第二电子设备40传输镜像投屏数据流,也即第一电子设备30与第二电子设备40之间建立镜像投屏连接,移动终端20与第一电子设备30也可为镜像投屏连接,则移动终端20可向第一电子设备30传输镜像投屏数据流,第一电子设备30可向第二电子设备40传输镜像投屏数据流。也即,第二电子设备40 的投屏内容可由移动终端20提供,而无需从服务器50获取投屏内容,简化投屏连接步骤,提高效率。Optionally, in some embodiments, please also refer to FIG. 5 , the first electronic device 30 and the second electronic device 40 may also use other ways to interact and project screen information, for example, the first electronic device 30 may send a message to the second electronic device 40 transmits the mirrored screen projection data stream, that is, a mirrored screen projection connection is established between the first electronic device 30 and the second electronic device 40, and the mobile terminal 20 and the first electronic device 30 can also be a mirrored screen projection connection, then the mobile terminal 20 The screen mirroring data stream can be transmitted to the first electronic device 30 , and the first electronic device 30 can transmit the screen mirroring data stream to the second electronic device 40 . That is, the screen projection content of the second electronic device 40 can be provided by the mobile terminal 20 without obtaining the screen projection content from the server 50 , which simplifies screen projection connection steps and improves efficiency.
步骤S216:反馈已投屏接续。Step S216: Feedback that the screen projection has been continued.
在一些实施方式中,所述第二电子设备40可向所述第一电子设备30发送已投屏接续信息及第二电子设备的组网信息,以告知所述第一电子设备30已完成投屏接续。在一些实施方式中,所述第二电子设备40的组网信息可以包括但不限于所述第二电子设备40的IP地址和网络端口等。In some implementations, the second electronic device 40 may send the screen projection connection information and the networking information of the second electronic device to the first electronic device 30 to inform the first electronic device 30 that the projection has been completed. screen continues. In some implementations, the networking information of the second electronic device 40 may include but not limited to the IP address and network port of the second electronic device 40 .
步骤S217:通知控制转移。Step S217: Notify the control transfer.
所述第一电子设备30可向所述移动终端20发送控制转移通知。在一些实施方式中,所述第一电子设备30发送的控制转移通知包括第二电子设备40已投屏接续信息及第二电子设备的组网信息。其中,所述第二电子设备40的组网信息可以包括但不限于所述第二电子设备40的IP地址和网络端口等。由于第二电子设备40与第一电子设备30已建立通信,且第一电子设备30与移动终端20已建立通信,所以第二电子设备40可通过第一电子设备30向移动终端20转达第二电子设备40的组网信息,使得移动终端20可获取第二电子设备40的组网信息,继而移动终端20可根据第二电子设备40的组网信息与第二电子设备40建立通信。The first electronic device 30 may send a control transfer notification to the mobile terminal 20 . In some implementation manners, the control transfer notification sent by the first electronic device 30 includes the connection information of the screen projected by the second electronic device 40 and the networking information of the second electronic device. Wherein, the networking information of the second electronic device 40 may include but not limited to the IP address and network port of the second electronic device 40 . Since the second electronic device 40 has established communication with the first electronic device 30 and the first electronic device 30 has established communication with the mobile terminal 20, the second electronic device 40 can convey the second electronic device 40 to the mobile terminal 20 through the first electronic device 30. The networking information of the electronic device 40 enables the mobile terminal 20 to obtain the networking information of the second electronic device 40 , and then the mobile terminal 20 can establish communication with the second electronic device 40 according to the networking information of the second electronic device 40 .
步骤S218:重新建立投屏控制以完成控制转移。Step S218: Re-establish the screen projection control to complete the control transfer.
在一些实施方式中,所述移动终端20根据接收到的第二电子设备40的组网信息与所述第二电子设备40建立第二投屏连接,同时,所述移动终端20可断开与所述第一电子设备30的第一投屏连接。在一些实施方式中,所述投屏连接可为基于DLNA的传输控制协议(Transmission Control Protocol,TCP)连接的简单对象访问协议(Simple Object Access Protocol,SOAP)建立的控制链路。由此,用户可通过所述移动终端20控制(例如播放、暂停、停止、快进/快退、调节音量、全屏显示、分屏显示、调节显示比例)所述第二电子设备40的投屏内容。从而用户可方便地通过方便携带及操作的移动终端20来遥控第二电子设备40的投屏内容,以获得较佳的操作体验。In some embodiments, the mobile terminal 20 establishes a second screen projection connection with the second electronic device 40 according to the received networking information of the second electronic device 40, and at the same time, the mobile terminal 20 can disconnect from the The first screen projection connection of the first electronic device 30 . In some embodiments, the screen projection connection may be a control link established by Simple Object Access Protocol (SOAP) based on DLNA Transmission Control Protocol (Transmission Control Protocol, TCP) connection. Thus, the user can control (for example, play, pause, stop, fast forward/rewind, adjust volume, full-screen display, split-screen display, and adjust display ratio) the screen projection of the second electronic device 40 through the mobile terminal 20 content. Thus, the user can conveniently use the mobile terminal 20 that is easy to carry and operate to remotely control the projected screen content of the second electronic device 40 to obtain a better operating experience.
请一并参阅图6,为本申请一实施例提供的投屏接续方法的投屏控制转移的应用场景示意图。移动终端20与第一电子设备30的第一投屏控制断开连接,移动终端20与第二电子设备40建立第二投屏控制连接。Please also refer to FIG. 6 , which is a schematic diagram of an application scenario of the screen projection control transfer of the screen projection connection method provided by an embodiment of the present application. The mobile terminal 20 is disconnected from the first screen projection control of the first electronic device 30 , and the mobile terminal 20 establishes a second screen projection control connection with the second electronic device 40 .
此外,所述第二电子设备40也可以直接获取用户操作来实现对投屏内容的控制,例如播放、暂停、停止、快进/快退、调节音量、全屏显示、分屏显示、调节显示比例等。在一些实施方式中,用户可直接操作第二电子设备40来实现对投屏内容的控制,例如操作第二电子设备40的显示界面或操作与第二电子设备40配套的遥控器等。In addition, the second electronic device 40 can also directly obtain user operations to control the content of the screen projection, such as play, pause, stop, fast forward/rewind, adjust volume, full screen display, split screen display, and adjust the display ratio wait. In some implementations, the user can directly operate the second electronic device 40 to control the projected content, for example, operate the display interface of the second electronic device 40 or operate a remote control matched with the second electronic device 40 .
可选地,在一些实施方式中,当所述移动终端20与所述第二电子设备40可建立第二投屏控制连接且与所述第一电子设备30断开第一投屏控制连接之后,用户也可关闭第一电子设备30,或者第一电子设备30也可以自动 关闭,此时仅通过第二电子设备40显示或播放投屏内容。可以理解,当用户从客厅移动到卧室后,可仅通过位于卧室的第二电子设备40观看投屏内容,而不再需要位于客厅的第一电子设备30观看,可关闭第一电子设备30以节省电源。Optionally, in some embodiments, when the mobile terminal 20 and the second electronic device 40 can establish a second screen projection control connection and disconnect the first screen projection control connection with the first electronic device 30 , the user can also turn off the first electronic device 30, or the first electronic device 30 can also be automatically turned off, and at this time only the second electronic device 40 is used to display or play the projected content. It can be understood that when the user moves from the living room to the bedroom, the projected screen content can only be watched through the second electronic device 40 in the bedroom, and the first electronic device 30 in the living room is no longer required to watch, and the first electronic device 30 can be turned off to Save power.
可选地,在一些实施方式中,移动终端20与第一电子设备30之间的第一投屏连接可不进行转移,即移动终端20与第二电子设备40无需建立第二投屏连接,则移动终端20保持与第一电子设备30的控制链路,第一电子设备30接收移动终端20的控制信息,并将控制信息转发至第二电子设备40,以达到控制第二电子设备40的目的。如此,则步骤S216-S218可忽略不执行,从而简化投屏连接步骤,提高效率。Optionally, in some embodiments, the first screen projection connection between the mobile terminal 20 and the first electronic device 30 may not be transferred, that is, the mobile terminal 20 and the second electronic device 40 do not need to establish a second screen projection connection, then The mobile terminal 20 maintains a control link with the first electronic device 30, the first electronic device 30 receives the control information of the mobile terminal 20, and forwards the control information to the second electronic device 40, so as to achieve the purpose of controlling the second electronic device 40 . In this way, steps S216-S218 can be ignored and not executed, thereby simplifying the screen projection connection steps and improving efficiency.
可选地,在一些实施方式中,请一并参阅图5,当第一电子设备30与第二电子设备40之间为镜像投屏时,移动终端20与第一电子设备30之间的投屏控制可不进行转移,即移动终端20与第二电子设备40无需建立投屏连接,则步骤S216-S218可忽略不执行,从而简化投屏连接步骤,提高效率。Optionally, in some embodiments, please refer to FIG. 5 together. When the first electronic device 30 and the second electronic device 40 are mirroring the screen, the projection between the mobile terminal 20 and the first electronic device 30 Screen control may not be transferred, that is, there is no need to establish a screen projection connection between the mobile terminal 20 and the second electronic device 40, and steps S216-S218 may be ignored, thereby simplifying the screen projection connection steps and improving efficiency.
可选地,在一些实施方式中,当第一电子设备30与第二电子设备40之间为镜像投屏时,移动终端20可与第二电子设备40可建立第二投屏控制连接,并与第一电子设备30断开第一投屏控制连接,从而实现投屏控制链路的转移,并实现由移动终端20对第二电子设备40进行投屏控制。Optionally, in some implementations, when the first electronic device 30 and the second electronic device 40 are mirrored for screen projection, the mobile terminal 20 can establish a second screen projection control connection with the second electronic device 40, and The first screen projection control connection is disconnected from the first electronic device 30 , so as to realize the transfer of the screen projection control link, and realize the screen projection control of the second electronic device 40 by the mobile terminal 20 .
步骤S219:同步投屏信息。Step S219: Synchronize screen projection information.
在一些实施方式中,当所述移动终端20与所述第二电子设备40可建立第二投屏控制连接且与所述第一电子设备30断开第一投屏控制连接,且所述第一电子设备30未关闭而继续播放投屏内容时,所述第二电子设备40与所述第一电子设备30建立信息同步。In some embodiments, when the mobile terminal 20 can establish a second screen projection control connection with the second electronic device 40 and disconnect the first screen projection control connection with the first electronic device 30, and the second When an electronic device 30 is not turned off and continues to play the projected content, the second electronic device 40 establishes information synchronization with the first electronic device 30 .
在一些实施方式中,当所述第二电子设备40检测到用户对投屏内容发生操作时,或者当所述移动终端20检测到用户对投屏内容发生操作,且第二电子设备40获取移动终端20检测的用户对投屏内容的操作时,例如,改变播放状态(播放/暂停)、改变播放进度、调节播放音量、调节播放倍数、调节显示比例等,所述第二电子设备40可将投屏内容状态改变的信息通知所述第一电子设备30以及所述移动终端20。由此,第二电子设备40可实时同步投屏信息至所述移动终端20及第一电子设备30,保持多终端设备的同步性。在一些实施方式中,所述第二电子设备40可基于通用事件通知结构(General Event Notification Architecture,GENA)协议的通知(Notify)方式将投屏内容状态改变的信息通知所述第一电子设备30以及所述移动终端20。In some implementations, when the second electronic device 40 detects that the user operates the screen-cast content, or when the mobile terminal 20 detects that the user operates the screen-cast content, and the second electronic device 40 obtains the mobile When the terminal 20 detects the user's operation on the projected content, for example, changing the playback state (play/pause), changing the playback progress, adjusting the playback volume, adjusting the playback multiplier, adjusting the display ratio, etc., the second electronic device 40 can set the The first electronic device 30 and the mobile terminal 20 are notified of information about the status change of the projected screen content. Thus, the second electronic device 40 can synchronize screen projection information to the mobile terminal 20 and the first electronic device 30 in real time, maintaining the synchronization of multiple terminal devices. In some implementation manners, the second electronic device 40 may notify the first electronic device 30 of the status change of the projected screen content based on the Notify method of the General Event Notification Architecture (GENA) protocol. And the mobile terminal 20.
在一些实施方式中,与所述移动终端20建立投屏控制连接的第二电子设备40作为主屏设备,其他终端设备,如所述第一电子设备30作为副屏设备。当所述主屏设备的信息发生改变时,自动通知副屏设备,从而实现多终端设备的投屏信息同步。可以理解,设置于不同空间的第一电子设备30和第二电子设备40同步播放投屏内容,使得身处不同空间的多个用户可分别 通过第一电子设备30和第二电子设备40观看投屏内容,方便多人同时观看。In some embodiments, the second electronic device 40 establishing a screen projection control connection with the mobile terminal 20 serves as the main screen device, and other terminal devices, such as the first electronic device 30 serve as the secondary screen device. When the information of the main screen device changes, the secondary screen device is automatically notified, thereby realizing synchronization of screen projection information of multiple terminal devices. It can be understood that the first electronic device 30 and the second electronic device 40 installed in different spaces synchronously play the projected content, so that multiple users in different spaces can watch the projected content through the first electronic device 30 and the second electronic device 40 respectively. Screen content, convenient for multiple people to watch at the same time.
请一并参阅图7,为本申请一实施例提供的投屏接续方法的同步投屏信息的应用场景示意图。移动终端20与第二电子设备40建立投屏控制连接,第二电子设备40作为主屏设备,第一电子设备30作为副屏设备,当所述第二电子设备40的信息发生改变时,第二电子设备40自动通知所述第一电子设备30,从而实现第二电子设备40与第一电子设备30的投屏信息同步。Please also refer to FIG. 7 , which is a schematic diagram of an application scenario of synchronous screen projection information of a screen projection continuation method provided by an embodiment of the present application. The mobile terminal 20 establishes a screen projection control connection with the second electronic device 40, the second electronic device 40 serves as the main screen device, and the first electronic device 30 serves as the secondary screen device. When the information of the second electronic device 40 changes, the second The electronic device 40 automatically notifies the first electronic device 30 , so that the screen projection information of the second electronic device 40 and the first electronic device 30 are synchronized.
可选地,在一些实施方式中,当所述移动终端20与所述第二电子设备40可建立投屏控制连接且与所述第一电子设备30断开投屏控制连接之后,且第一电子设备30以关闭时,第二电子设备40可仅向移动终端20同步投屏信息。Optionally, in some embodiments, after the mobile terminal 20 can establish a screen projection control connection with the second electronic device 40 and disconnects the screen projection control connection with the first electronic device 30, and the first When the electronic device 30 is turned off, the second electronic device 40 may only synchronize screen projection information to the mobile terminal 20 .
可选地,在一些实施方式中,用户可通过所述移动终端20或所述第二电子设备40预先设置第二电子设备40是否同步投屏信息,当设置为不同步投屏信息时,步骤S219可忽略不执行。若步骤S219不执行且第一电子设备30未关闭,则第一电子设备30可以根据移动终端20断开与第一电子设备30之间的投屏控制连接之前,第一电子设备30最后一次获取到的投屏信息,来继续显示或播放投屏内容。Optionally, in some implementations, the user can preset whether the second electronic device 40 synchronizes the screen projection information through the mobile terminal 20 or the second electronic device 40, and when it is set to not synchronize the screen projection information, the step S219 may be ignored and not executed. If step S219 is not executed and the first electronic device 30 is not turned off, then the first electronic device 30 can obtain the last time before the mobile terminal 20 disconnects the screen projection control connection with the first electronic device 30 to continue displaying or playing the screencasting content.
步骤S220:响应同步投屏信息。Step S220: Respond to the synchronous screen projection information.
可选地,在一些实施方式中,所述第一电子设备30可响应从第二电子设备40接收的同步投屏信息。例如,所述第二电子设备40改变了播放状态(暂停),并同步投屏信息至所述第一电子设备30及所述移动终端20,所述第一电子设备30响应所述投屏信息,暂停播放投屏内容。由此,所述第一电子设备30和所述第二电子设备40保持同步播放。可选地,在另一实施例中,所述第一电子设备30可不响应从第二电子设备40接收的同步投屏信息。Optionally, in some implementations, the first electronic device 30 may respond to the synchronous screen projection information received from the second electronic device 40 . For example, the second electronic device 40 changes the playing state (pause), and synchronizes the screen projection information to the first electronic device 30 and the mobile terminal 20, and the first electronic device 30 responds to the screen projection information to pause the playback of the screencast content. Thus, the first electronic device 30 and the second electronic device 40 keep playing synchronously. Optionally, in another embodiment, the first electronic device 30 may not respond to the synchronous screen projection information received from the second electronic device 40 .
例如,所述第二电子设备40改变了播放状态(暂停),并同步投屏信息至所述第一电子设备30及所述移动终端20,所述第一电子设备30不响应所述投屏信息,继续播放投屏内容。由此,所述第一电子设备30和所述第二电子设备40分别播放,可分别适应处于不同空间的用户的观看需求。可以理解,所述移动终端20或所述第一电子设备30可预先设定是否响应所述同步投屏信息。可以理解,所述移动终端20或第一电子设备30预先设定不响应所述同步投屏信息时,步骤S220可忽略不执行。For example, the second electronic device 40 changes the playing state (pause), and synchronizes screen projection information to the first electronic device 30 and the mobile terminal 20, and the first electronic device 30 does not respond to the screen projection information. information, and continue to play the content on the screen. Thus, the first electronic device 30 and the second electronic device 40 play separately, which can respectively meet the viewing needs of users in different spaces. It can be understood that the mobile terminal 20 or the first electronic device 30 may preset whether to respond to the synchronous screen projection information. It can be understood that, when the mobile terminal 20 or the first electronic device 30 presets not to respond to the synchronous screen projection information, step S220 can be ignored and not executed.
本申请的投屏接续方法提供多个终端设备间的投屏接续,使得用户可在多个终端设备间切换投屏接续,方便用户在场景切换的情况下控制投屏,并在多个终端设备间同步投屏信息,自动接续投屏内容的播放,提供用户较佳的观感体验。同时,省去了重新查找投屏内容、定位播放进度及重新投屏的多个繁琐步骤,提供了方便快捷的投屏接续体验。The screen projection connection method of the present application provides screen projection connection between multiple terminal devices, so that users can switch between multiple terminal devices and screen projection connections, which is convenient for users to control projection screens in the case of scene switching, and multiple terminal devices The screen projection information is synchronized between the screens, and the playback of the screen projection content is automatically continued, providing users with a better visual experience. At the same time, it saves multiple tedious steps of re-finding the screen projection content, locating the playback progress, and re-projecting the screen, providing a convenient and fast screen projection connection experience.
本申请实施例的投屏接续方法与当前投屏接续的方法的主要步骤比对可参表1如下:The comparison of the main steps of the screen projection continuation method in the embodiment of the present application with the current screen projection continuation method can be referred to in Table 1 as follows:
Figure PCTCN2022111509-appb-000001
Figure PCTCN2022111509-appb-000001
本申请的投屏接续方法相较于当前投屏接续的方法,较大地简化了投屏接续的流程,省去了移动终端查找投屏内容、定位投屏内容进度、重新投屏等多个繁琐的流程及操作,简化了多终端设备间的通信流程,提高了投屏接续的效率,同时也提供用户更好的体验。Compared with the current screen projection connection method, the screen projection connection method of the present application greatly simplifies the screen projection connection process, and saves the mobile terminal from searching for the screen projection content, locating the projection content progress, and re-projecting the screen. The process and operation simplifies the communication process between multiple terminal devices, improves the efficiency of screen projection and connection, and also provides users with a better experience.
请参阅图8,为本申请一实施例提供基于多设备间的内容接续方法的流程图。示例性地,所述同步显示方法可以包括以下步骤。Please refer to FIG. 8 , which is a flow chart of a method for connecting content based on multiple devices according to an embodiment of the present application. Exemplarily, the synchronous display method may include the following steps.
步骤S811,第一电子设备30运行内容。Step S811, the first electronic device 30 executes the content.
在一些实施方式中,第一电子设备30可运行应用程序(Application program,APP)并显示APP界面。第一电子设备30可通过所述APP界面接收用户操作并实现对APP的控制。可以理解,所述APP界面可包括多个页面,APP界面接收用户操作时可实现多个页面的切换。在一些实施方式中,用户可在第一空间12内通过第一电子设备30浏览及操作APP,例如,可通过所述APP界面或与第一电子设备30配对的遥控器实现对APP的控制。此外,第一电子设备30还可与服务器50交互APP信息,例如,交互APP的推送内容或网络内容等。In some implementations, the first electronic device 30 can run an application program (Application program, APP) and display an APP interface. The first electronic device 30 can receive user operations through the APP interface and implement control over the APP. It can be understood that the APP interface may include multiple pages, and the APP interface may switch multiple pages when receiving user operations. In some implementations, the user can browse and operate the APP through the first electronic device 30 in the first space 12 , for example, control the APP through the APP interface or a remote controller paired with the first electronic device 30 . In addition, the first electronic device 30 may also exchange APP information with the server 50, for example, interacting with pushed content or network content of the APP.
步骤S812,触发内容接续。Step S812, triggering content continuation.
在一些实施方式中,当用户从第一电子设备30所在的第一空间12移动到其他空间,例如第二电子设备40所在的第二空间14,第二电子设备40获取内容接续触发事件。所述内容接续触发事件可以包括但不限于以下的任一种或多种方式:启动第二电子设备40、第二电子设备40侦测到用户进入到侦测范围、具有检测或传感功能的设备侦测到用户进入到侦测范围或者具有无线定位功能的设备侦测到移动终端20进入到侦测范围、第二电子设备40 确定用户具有观看第二电子设备40的意图、第二电子设备40确定用户进入安装有第二电子设备40的房间(如第二空间14)、第二电子设备40接收到指示第二电子设备40进行接续投屏的指示消息。所述内容接续触发事件的实现过程可参考前述步骤S212。In some implementations, when the user moves from the first space 12 where the first electronic device 30 is located to another space, such as the second space 14 where the second electronic device 40 is located, the second electronic device 40 acquires a content continuation trigger event. The content connection triggering event may include, but not limited to, any one or more of the following methods: starting the second electronic device 40, the second electronic device 40 detecting that the user enters the detection range, a device with a detection or sensing function The device detects that the user enters the detection range or the device with the wireless positioning function detects that the mobile terminal 20 enters the detection range, the second electronic device 40 determines that the user has the intention to watch the second electronic device 40, the second electronic device 40. It is determined that the user enters the room where the second electronic device 40 is installed (such as the second space 14), and the second electronic device 40 receives an instruction message instructing the second electronic device 40 to continue screen projection. For the implementation process of the content continuation trigger event, reference may be made to the aforementioned step S212.
步骤S813,发现正在运行APP的设备。Step S813, discovering the device running the APP.
在一些实施方式中,所述发现正在运行APP的设备可以包括主动通知和查询发现方式。其中主动通知方式可为由正在运行APP的第一电子设备30通过局域网广播其正在运行APP信息。所述查询发现方式可为由获取触发事件的第二电子设备40在局域网内发现是否有正在运行APP的设备。所述主动通知和查询发现方式的实现过程可参考前述步骤S213。In some implementation manners, the discovery of the device running the APP may include active notification and query of the discovery method. The active notification method may be that the first electronic device 30 running the APP broadcasts the running APP information through the local area network. The query discovery method may be that the second electronic device 40 that acquires the trigger event finds whether there is a device running APP in the local area network. For the implementation process of the proactive notification and query discovery method, reference may be made to the aforementioned step S213.
步骤S814,交互运行信息。Step S814, exchanging running information.
在一些实施方式中,第一电子设备30可向第二电子设备40发送其运行信息。所述运行信息可包括但不限于第一电子设备30正在运行的APP、当前显示的APP界面及运行状态等。在一些实施方式中,第一电子设备30可通过扩展DLNA的内容接续协议报文字段,例如扩展正在运行的APP、当前显示的APP界面等对应的报文字段,传递运行信息。In some implementations, the first electronic device 30 can send its operation information to the second electronic device 40 . The running information may include, but not limited to, the running APP of the first electronic device 30 , the currently displayed APP interface and running status, and the like. In some implementations, the first electronic device 30 can transmit the running information by extending the message field of the content connection protocol of DLNA, for example, extending the message field corresponding to the running APP and the currently displayed APP interface.
在一些实施方式中,经过扩展DLNA的内容接续的报文字段可以包括:In some implementations, the message field of the extended DLNA content may include:
ContinueAPP:需要接续的应用名ContinueAPP: the name of the application that needs to be continued
APPContent:接续应用当前运行的内容(例如所在界面、运行状态等)APPContent: continue the current running content of the application (such as the interface where it is located, running status, etc.)
可以理解,交互运行信息的其余报文信息可参前述步骤S214的报文字段。It can be understood that the rest of the message information of the interactive running information can refer to the message field of the aforementioned step S214.
在一些实施方式中,当通过所述主动通知方式发现正在运行设备时,第二电子设备40可向第一电子设备30请求当前运行信息,第一电子设备30可响应所述请求向第二电子设备40发送运行信息。在一些实施方式中,当通过所述查询发现方式发现正在运行设备时,第一电子设备可在向第二电子设备40发送的存在通知中添加运行信息的报文。In some implementations, when a running device is found through the active notification method, the second electronic device 40 can request the current running information from the first electronic device 30, and the first electronic device 30 can respond to the request to the second electronic device 40. Device 40 sends operational information. In some implementations, when a running device is found through the query discovery method, the first electronic device may add a message of running information to the existence notification sent to the second electronic device 40 .
步骤S815,内容接续运行。In step S815, the content continues to run.
在一些实施方式中,第二电子设备40可根据从第一电子设备30接收的运行信息开始接续运行。在一些实施方式中,第二电子设备40可根据所述运行信息中的正在运行的APP接续运行相同的APP,并可根据所述运行信息中的当前显示的APP界面接续显示相同的APP界面。由此,用户可在第二空间14内通过第二电子设备40继续浏览及操作第一电子设备30正在运行的APP及正在显示的APP界面,方便用户的使用,提升用户体验。In some implementations, the second electronic device 40 may start a continuous operation according to the operation information received from the first electronic device 30 . In some implementations, the second electronic device 40 can continue to run the same APP according to the running APP in the running information, and can continue to display the same APP interface according to the currently displayed APP interface in the running information. Thus, the user can continue to browse and operate the running APP and the displayed APP interface of the first electronic device 30 through the second electronic device 40 in the second space 14 , which is convenient for the user and improves the user experience.
在一些实施方式中,第二电子设备40可通过所述APP界面接收用户操作并实现对APP的控制。可以理解,所述APP界面可包括多个页面,APP界面接收用户操作时可实现多个页面的切换。在一些实施方式中,用户可在第二空间14内通过第二电子设备40浏览及操作APP,例如,可通过所述APP界面或与第二电子设备40配对的遥控器实现对APP的控制。此外,第二电子设备40还可与服务器50交互APP信息,例如,交互APP的推送内容或网 络内容等。In some implementations, the second electronic device 40 can receive user operations through the APP interface and implement control over the APP. It can be understood that the APP interface may include multiple pages, and the APP interface may switch multiple pages when receiving user operations. In some implementations, the user can browse and operate the APP through the second electronic device 40 in the second space 14 , for example, control the APP through the APP interface or a remote controller paired with the second electronic device 40 . In addition, the second electronic device 40 can also exchange APP information with the server 50, for example, push content or network content of the interactive APP.
在一些实施方式中,在第二电子设备40接续运行APP后,第一电子设备30仍可继续运行APP及显示APP界面,并可通过APP界面接收其他用户的操作。在一些实施方式中,在第二电子设备40接续运行APP后,第一电子设备30可关闭,以节省电源。In some implementations, after the second electronic device 40 continues to run the APP, the first electronic device 30 can continue to run the APP and display the APP interface, and can receive operations from other users through the APP interface. In some implementations, after the second electronic device 40 continues to run the APP, the first electronic device 30 can be turned off to save power.
在所述多设备间的内容接续方法中,当用户在第一空间12通过第一电子设备30运行APP及显示APP界面,且用户从一个空间切换到另一个空间,例如从第一空间12切换到第二空间14时,第二电子设备40可自动运行并显示与之前用户在第一空间12的第一电子设备30相同的APP及APP界面,使得用户可获得较佳的使用连续性体验。In the method for connecting content between multiple devices, when the user runs the APP and displays the APP interface through the first electronic device 30 in the first space 12, and the user switches from one space to another space, for example, switching from the first space 12 When arriving at the second space 14, the second electronic device 40 can automatically run and display the same APP and APP interface as the user's first electronic device 30 in the first space 12 before, so that the user can obtain a better continuous experience of use.
请参阅图9,为本申请实施例提供的电子设备的结构示意图,所述电子设备的结构适用于所述第一电子设备30和所述第二电子设备40。在一个实施例中,所述电子设备60可以至少包括存储器61、至少一个处理器62、显示模块63及通信模块64。Please refer to FIG. 9 , which is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The structure of the electronic device is applicable to the first electronic device 30 and the second electronic device 40 . In one embodiment, the electronic device 60 may at least include a memory 61 , at least one processor 62 , a display module 63 and a communication module 64 .
本领域技术人员应该了解,图3示出的电子设备60的结构并不构成本申请实施例的限定,所述电子设备60还可以包括比图示更多或更少的其他硬件或者软件,或者不同的部件布置。需要说明的是,所述电子设备60仅为举例,其他现有的或今后可能出现的电子产品如可适应于本申请,也应包含在本申请的保护范围以内。Those skilled in the art should understand that the structure of the electronic device 60 shown in FIG. 3 does not constitute a limitation of the embodiment of the present application, and the electronic device 60 may also include more or less other hardware or software than shown in the illustration, or Different component arrangements. It should be noted that the electronic device 60 is only an example, and other existing or future electronic products that can be adapted to this application should also be included within the scope of protection of this application.
在一些实施例中,所述电子设备60包括一种能够按照事先设定或存储的指令,自动进行数值计算和/或信息处理的终端,其硬件包括但不限于微处理器、专用集成电路(Specific Integrated Circuit,ASIC)、可编程门阵列(Field-Programmable Gate Array,FPGA)、数字处理器(Digital Signal Processor,DSP)、嵌入式设备等。In some embodiments, the electronic device 60 includes a terminal capable of automatically performing numerical calculations and/or information processing according to preset or stored instructions, and its hardware includes but not limited to microprocessors, application-specific integrated circuits ( Specific Integrated Circuit, ASIC), programmable gate array (Field-Programmable Gate Array, FPGA), digital processor (Digital Signal Processor, DSP), embedded devices, etc.
在一些实施例中,所述存储器61用于存储程序代码和各种数据。所述存储器61可以包括只读存储器(Read-Only Memory,ROM)、随机存储器(Random Access Memory,RAM)、可编程只读存储器(Programmable Read-Only Memory,PROM)、可擦除可编程只读存储器(Erasable Programmable Read-Only Memory,EPROM)、一次可编程只读存储器(One-time Programmable Read-Only Memory,OTPROM)、电子擦除式可复写只读存储器(Electrically-Erasable Programmable Read-Only Memory,EEPROM)、只读光盘(Compact Disc Read-Only Memory,CD-ROM)或其他光盘存储器、磁盘存储器、磁带存储器、或者能够用于携带或存储数据的计算机可读的任何其他介质。In some embodiments, the memory 61 is used to store program codes and various data. Described memory 61 can comprise read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), programmable read-only memory (Programmable Read-Only Memory, PROM), erasable programmable read-only memory Memory (Erasable Programmable Read-Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically Erasable Programmable Read-Only Memory (Electrically-Erasable Programmable Read-Only Memory, EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, tape storage, or any other computer-readable medium that can be used to carry or store data.
在一些实施例中,所述至少一个处理器62可以由集成电路组成,例如可以由单个封装的集成电路所组成,也可以是由多个相同功能或不同功能封装的集成电路所组成,包括一个或者多个中央处理器(Central Processing unit,CPU)、微处理器、数字处理芯片、图形处理器及各种控制芯片的组合等。所述至少一个处理器62是所述第一电子设备的控制核心(Control  Unit),通过运行或执行存储在所述存储器61内的程序或者模块,以及调用存储在所述存储器61内的数据,以执行电子设备60的各种功能和处理数据,例如执行数据处理的功能。In some embodiments, the at least one processor 62 may be composed of an integrated circuit, for example, may be composed of a single packaged integrated circuit, or may be composed of multiple integrated circuits with the same function or different functions packaged, including a Or a combination of multiple central processing units (Central Processing unit, CPU), microprocessors, digital processing chips, graphics processors, and various control chips. The at least one processor 62 is the control core (Control Unit) of the first electronic device, by running or executing programs or modules stored in the memory 61, and calling data stored in the memory 61, To perform various functions of the electronic device 60 and process data, for example, perform data processing functions.
上述以软件功能模块的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。上述软件功能模块存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,终端,或者网络设备等)或处理器(processor)执行本申请各个实施例所述方法的部分。The above-mentioned integrated units implemented in the form of software function modules can be stored in a computer-readable storage medium. The above-mentioned software functional modules are stored in a storage medium, and include several instructions to enable a computer device (which may be a personal computer, a terminal, or a network device, etc.) or a processor (processor) to execute the methods described in the various embodiments of the present application. part.
所述存储器61中存储有计算机程序65,例如程序代码,且所述至少一个处理器62可调用所述存储器61中存储的程序代码以执行相关的功能。在本申请的一个实施例中,所述存储器61存储多个指令,所述多个指令被所述至少一个处理器62所执行以实现投屏接续方法。 Computer programs 65 such as program codes are stored in the memory 61 , and the at least one processor 62 can invoke the program codes stored in the memory 61 to perform related functions. In an embodiment of the present application, the memory 61 stores a plurality of instructions, and the plurality of instructions are executed by the at least one processor 62 to implement the screen projection continuation method.
所述显示模块63用于显示投屏内容及提供操作界面。在一些实施方式中,所述显示模块63通过操作界面侦测用户的操作,并执行所述操作对应的指令,例如,显示对话框,询问是否投屏接续,并接收用户的操作。在一些实施方式中,所述显示模块63可为但不限于为触控屏及通过遥控器接收指令的显示屏。The display module 63 is used for displaying screen projection content and providing an operation interface. In some implementations, the display module 63 detects the user's operation through the operation interface, and executes the instruction corresponding to the operation, for example, displays a dialog box, asks whether to continue the screen projection, and receives the user's operation. In some implementations, the display module 63 may be, but not limited to, a touch screen and a display screen for receiving commands through a remote controller.
所述通信模块64用于与其他终端设备建立通信连接,并实现数据交互。在一些实施方式中,所述通信模块64可连接至网络,并通过网络与其他终端设备交互数据。The communication module 64 is used to establish a communication connection with other terminal devices and realize data interaction. In some implementations, the communication module 64 can be connected to a network, and exchange data with other terminal devices through the network.
本申请还提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,所述计算机程序被处理器执行时用以实现如上所述的任一种投屏接续方法的步骤。The present application also provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, it is used to implement the steps of any one of the screen projection continuation methods described above .
上述实施例中以DLNA投屏协议为例进行描述,本领域技术人员应能理解,投屏协议不限于DLNA技术,随着技术的演进,未来出现的投屏协议,如适用于本申请,也不超出本申请实施例覆盖的范围,则也应属于本申请的保护范围。In the above embodiments, the DLNA screen projection protocol is used as an example for description. Those skilled in the art should understand that the screen projection protocol is not limited to DLNA technology. With the evolution of technology, if the screen projection protocol that appears in the future is applicable to this application, If it does not exceed the scope covered by the embodiments of the present application, it shall also belong to the protection scope of the present application.
在本申请各个实施例中电子设备或服务器的各功能模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能模块的形式实现。In each embodiment of the present application, each functional module of the electronic device or server may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software function modules.
对于本领域的技术人员而言,显然本申请不限于上述示范性实施例的细节,而且在不背离本申请的精神或基本特征的情况下,能够以其他具体形式实现本申请。因此,只要在本申请的实质精神范围之内,对以上实施例所作的适当改变和变化都应该落在本申请要求保护的范围之内。It will be apparent to those skilled in the art that the present application is not limited to the details of the exemplary embodiments described above, but that the present application can be embodied in other specific forms without departing from the spirit or essential characteristics of the present application. Therefore, as long as it is within the spirit and spirit of the present application, appropriate changes and changes made to the above embodiments should fall within the protection scope of the present application.

Claims (42)

  1. 一种投屏接续方法,应用于包括移动终端、第一电子设备和第二电子设备的系统中,其特征在于,所述方法包括:A screen projection connection method applied to a system including a mobile terminal, a first electronic device, and a second electronic device, wherein the method includes:
    所述移动终端与所述第一电子设备建立第一投屏连接,并向所述第一电子设备发送第一投屏信息,从而所述第一电子设备根据所述第一投屏信息显示第一投屏内容;The mobile terminal establishes a first screen projection connection with the first electronic device, and sends first screen projection information to the first electronic device, so that the first electronic device displays the first screen projection information according to the first screen projection information. One projection content;
    所述第二电子设备获取接续投屏的触发事件,其中,所述接续投屏的触发事件用于触发所述第二电子设备进行接续投屏;The second electronic device acquires a trigger event for continuous screen projection, wherein the trigger event for continuous screen projection is used to trigger the second electronic device to perform continuous screen projection;
    所述第二电子设备发现正在投屏的所述第一电子设备,并从所述第一电子设备获取所述第一投屏信息,从而所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容。The second electronic device discovers the first electronic device that is projecting a screen, and obtains the first screen projection information from the first electronic device, so that the second electronic device according to the first screen projection information Displaying the first projected screen content.
  2. 根据权利要求1所述的方法,其特征在于,所述移动终端、所述第一电子设备和所述第二电子设备处于同一个局域网中,The method according to claim 1, wherein the mobile terminal, the first electronic device and the second electronic device are in the same local area network,
    所述第二电子设备发现正在投屏的所述第一电子设备,包括:The second electronic device discovers the first electronic device that is casting a screen, including:
    所述第一电子设备在所述局域网内广播第一消息,从而所述第二电子设备根据所述第一消息确定所述第一电子设备为正在投屏的设备;The first electronic device broadcasts a first message in the local area network, so that the second electronic device determines, according to the first message, that the first electronic device is a device that is projecting a screen;
    或者,or,
    所述第二电子设备在所述局域网内广播第二消息;所述第一电子设备响应于所述第二消息向所述第二电子设备发送第三消息,从而所述第二电子设备根据所述第三消息确定所述第一电子设备为正在投屏的设备。The second electronic device broadcasts a second message in the local area network; the first electronic device sends a third message to the second electronic device in response to the second message, so that the second electronic device transmits a third message according to the The third message determines that the first electronic device is a device that is casting a screen.
  3. 根据权利要求2所述的方法,其特征在于,The method according to claim 2, characterized in that,
    所述第二电子设备从所述第一电子设备获取所述第一投屏信息,包括:The acquisition of the first screen projection information by the second electronic device from the first electronic device includes:
    所述第二电子设备发送投屏信息获取请求;所述第一电子设备响应于所述投屏信息获取请求,向所述第二电子设备发送所述第一投屏信息,从而所述第二电子设备获取所述第一投屏信息;The second electronic device sends a screen projection information acquisition request; the first electronic device sends the first screen projection information to the second electronic device in response to the screen projection information acquisition request, so that the second The electronic device acquires the first screen projection information;
    或者,or,
    所述第一电子设备在所述第一消息或所述第三消息中携带所述第一投屏信息,从而所述第二电子设备获取所述第一投屏信息。The first electronic device carries the first screen projection information in the first message or the third message, so that the second electronic device acquires the first screen projection information.
  4. 根据权利要求1-3中任一项所述的方法,其特征在于,所述接续投屏的触发事件包括以下项的一种或多种:The method according to any one of claims 1-3, characterized in that, the trigger event of the continuous screen projection includes one or more of the following items:
    所述第二电子设备开启;the second electronic device is turned on;
    所述第二电子设备侦测到用户进入侦测范围;The second electronic device detects that the user enters the detection range;
    所述第二电子设备获取其他检测或传感设备侦测到用户进入所述侦测范围;The second electronic device acquires that other detection or sensing devices detect that the user enters the detection range;
    所述第二电子设备获取其他具有无线定位功能的设备侦测到所述移动终端进入所述侦测范围;The second electronic device obtains that other devices with a wireless positioning function detect that the mobile terminal enters the detection range;
    所述第二电子设备确定用户具有观看所述第二电子设备的意图;The second electronic device determines that the user has intent to watch the second electronic device;
    所述第二电子设备确定用户进入所述第二电子设备所安装的房间;The second electronic device determines that the user enters a room where the second electronic device is installed;
    所述第二电子设备接收到指示所述第二电子设备进行接续投屏的指示消息。The second electronic device receives an indication message instructing the second electronic device to perform continuous screen projection.
  5. 根据权利要求1-4中任一项所述的方法,其特征在于,所述第一投屏信息包括第一投屏资源信息和第一投屏状态信息,The method according to any one of claims 1-4, wherein the first screen projection information includes first screen projection resource information and first screen projection state information,
    所述第一电子设备根据所述第一投屏信息显示第一投屏内容,包括:The displaying of the first screen projection content by the first electronic device according to the first screen projection information includes:
    所述第一电子设备根据所述第一投屏资源信息,从服务器获取所述第一投屏内容,从而所述第一电子设备信息指示的投屏状态显示所述第一投屏内容;The first electronic device obtains the first screen projection content from a server according to the first screen projection resource information, so that the screen projection state indicated by the first electronic device information displays the first screen projection content;
    所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容,包括:The second electronic device displays the first screen projection content according to the first screen projection information, including:
    所述第二电子设备根据所述第一投屏资源信息,从服务器获取所述第一投屏内容,从而所述第二电子设备以所述第一投屏状态信息指示的投屏状态显示所述第一投屏内容。The second electronic device acquires the first screen projection content from a server according to the first screen projection resource information, so that the second electronic device displays the screen projection status indicated by the first screen projection status information. Describe the content of the first screen projection.
  6. 根据权利要求5所述的方法,其特征在于,所述第一投屏资源信息包括统一资源标识符URI,所述第一投屏状态信息包括播放进度、播放音量、播放状态中的一种或多种,所述播放状态包括播放、暂停、倍速、全屏、分屏中的一种或多种。The method according to claim 5, wherein the first screen projection resource information includes a Uniform Resource Identifier (URI), and the first screen projection status information includes one or more of playback progress, playback volume, and playback status. Various, the playing state includes one or more of play, pause, double speed, full screen, and split screen.
  7. 根据权利要求1-6中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 1-6, wherein the method further comprises:
    所述终端设备获取所述第二电子设备的组网信息;The terminal device acquires networking information of the second electronic device;
    所述终端设备断开与所述第一电子设备之间的所述第一投屏连接,并根据所述组网信息,与所述第二电子设备建立第二投屏连接。The terminal device disconnects the first screen projection connection with the first electronic device, and establishes a second screen projection connection with the second electronic device according to the networking information.
  8. 根据权利要求7所述的方法,其特征在于,在所述终端设备与所述第二电子设备建立所述第二投屏连接之后,所述方法还包括:The method according to claim 7, wherein after the terminal device establishes the second screen projection connection with the second electronic device, the method further comprises:
    所述第二电子设备向所述第一电子设备发送所述第二投屏信息,所述第二投屏信息不同于所述第一投屏信息。The second electronic device sends the second screen projection information to the first electronic device, where the second screen projection information is different from the first screen projection information.
  9. 根据权利要求1-6中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 1-6, wherein the method further comprises:
    所述第一电子设备向所述第二电子设备发送第二投屏信息,其中,所述第二投屏信息不同于所述第一投屏信息。The first electronic device sends second screen projection information to the second electronic device, wherein the second screen projection information is different from the first screen projection information.
  10. 根据权利要求1-9中任一项所述的方法,其特征在于,所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容,包括:The method according to any one of claims 1-9, wherein the second electronic device displays the first screen projection content according to the first screen projection information, comprising:
    所述第二电子设备发出是否进行接续投屏的询问消息,在接收到响应于所述询问消息的肯定响应的情况下,所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容。The second electronic device sends an inquiry message whether to perform continuous screen projection, and if an affirmative response is received in response to the inquiry message, the second electronic device displays the first screen projection information according to the first screen projection information. One screen content.
  11. 根据权利要求1-4中任一项所述的方法,其特征在于,所述第一投屏信息包括所述第一投屏内容。The method according to any one of claims 1-4, wherein the first screen projection information includes the first screen projection content.
  12. 一种投屏接续方法,应用于第一电子设备,其特征在于,所述方法包括:A screen projection connection method applied to a first electronic device, characterized in that the method includes:
    所述第一电子设备与移动终端建立第一投屏连接,并从移动终端获取第一投屏信息,从而所述第一电子设备根据所述第一投屏信息显示第一投屏内容;The first electronic device establishes a first screen projection connection with the mobile terminal, and acquires first screen projection information from the mobile terminal, so that the first electronic device displays first screen projection content according to the first screen projection information;
    所述第一电子设备向第二电子设备提供所述第一投屏信息,所述第一投屏 信息用于所述第二电子设备显示所述第一投屏内容。The first electronic device provides the first screen projection information to the second electronic device, and the first screen projection information is used for the second electronic device to display the first screen projection content.
  13. 根据权利要求12所述的方法,其特征在于,所述移动终端、所述第一电子设备和所述第二电子设备处于同一个局域网中,The method according to claim 12, wherein the mobile terminal, the first electronic device and the second electronic device are in the same local area network,
    在所述第一电子设备向第二电子设备提供所述第一投屏信息之前,所述方法还包括:Before the first electronic device provides the first screen projection information to the second electronic device, the method further includes:
    所述第一电子设备在所述局域网内广播第一消息,所述第一消息携带有所述第一电子设备正在投屏的指示信息;The first electronic device broadcasts a first message in the local area network, and the first message carries indication information that the first electronic device is projecting a screen;
    所述第一电子设备向第二电子设备提供所述第一投屏信息,包括:The first electronic device provides the first screen projection information to the second electronic device, including:
    所述第一电子设备响应于所述第二电子设备发送的投屏信息获取请求,向所述第二电子设备发送所述第一投屏信息。The first electronic device sends the first screen projection information to the second electronic device in response to the screen projection information acquisition request sent by the second electronic device.
  14. 根据权利要求12所述的方法,其特征在于,所述移动终端、所述第一电子设备和所述第二电子设备处于同一个局域网中,The method according to claim 12, wherein the mobile terminal, the first electronic device and the second electronic device are in the same local area network,
    所述第一电子设备向第二电子设备提供所述第一投屏信息,包括:The first electronic device provides the first screen projection information to the second electronic device, including:
    所述第一电子设备在所述局域网内广播所述第一投屏信息。The first electronic device broadcasts the first screen projection information in the local area network.
  15. 根据权利要求12所述的方法,其特征在于,所述移动终端、所述第一电子设备和所述第二电子设备处于同一个局域网中,The method according to claim 12, wherein the mobile terminal, the first electronic device and the second electronic device are in the same local area network,
    在所述第一电子设备向第二电子设备提供所述第一投屏信息之前,所述方法还包括:Before the first electronic device provides the first screen projection information to the second electronic device, the method further includes:
    所述第一电子设备接收所述第二电子设备在所述局域网内广播的第二消息。The first electronic device receives the second message broadcast by the second electronic device in the local area network.
  16. 根据权利要求12-15中任一项所述的方法,其特征在于,所述第一投屏信息包括第一投屏资源信息和第一投屏状态信息,The method according to any one of claims 12-15, wherein the first screen projection information includes first screen projection resource information and first screen projection state information,
    所述第一电子设备根据所述第一投屏信息显示第一投屏内容,包括:The displaying of the first screen projection content by the first electronic device according to the first screen projection information includes:
    所述第一电子设备根据所述第一投屏资源信息,从服务器获取所述第一投屏内容,从而所述第一电子设备以所述第一投屏状态信息指示的投屏状态显示所述第一投屏内容。The first electronic device obtains the first screen projection content from a server according to the first screen projection resource information, so that the first electronic device displays the screen projection status indicated by the first screen projection status information. Describe the content of the first screen projection.
  17. 根据权利要求16所述的方法,其特征在于,所述第一投屏资源信息包括统一资源标识符URI,所述第一投屏状态信息包括播放进度、播放音量、播放状态中的一种或多种,所述播放状态包括播放、暂停、倍速、全屏、分屏中的一种或多种。The method according to claim 16, wherein the first screen projection resource information includes a Uniform Resource Identifier (URI), and the first screen projection status information includes one or more of playback progress, playback volume, and playback status. Various, the playing state includes one or more of play, pause, double speed, full screen, and split screen.
  18. 根据权利要求12-17中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 12-17, further comprising:
    所述第一电子设备获取所述第二电子设备的组网信息,并向所述终端设备发送所述组网信息。The first electronic device acquires the networking information of the second electronic device, and sends the networking information to the terminal device.
  19. 根据权利要求12-17中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 12-17, further comprising:
    所述第一电子设备向所述第二电子设备发送第二投屏信息,其中,所述第二投屏信息不同于所述第一投屏信息。The first electronic device sends second screen projection information to the second electronic device, wherein the second screen projection information is different from the first screen projection information.
  20. 根据权利要求12-15中任一项所述的方法,其特征在于,所述第一投屏信息包括所述第一投屏内容。The method according to any one of claims 12-15, wherein the first screen projection information includes the first screen projection content.
  21. 一种电子设备,其特征在于,所述电子设备包括存储器及处理器,所述处理器用于执行所述存储器中存储的计算机程序时实现如权利要求12至20中任意一项所述的投屏接续方法。An electronic device, characterized in that the electronic device includes a memory and a processor, and the processor is used to implement the screen projection according to any one of claims 12 to 20 when executing the computer program stored in the memory Continuation method.
  22. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求12至20中任意一项所述的投屏接续方法。A computer-readable storage medium, on which a computer program is stored, wherein, when the computer program is executed by a processor, the screen projection continuation method according to any one of claims 12 to 20 is implemented.
  23. 一种投屏接续方法,应用于第二电子设备,其特征在于,所述方法包括:A screen projection connection method applied to a second electronic device, characterized in that the method includes:
    所述第二电子设备获取接续投屏的触发事件,其中,所述接续投屏的触发事件用于触发所述第二电子设备进行接续投屏;The second electronic device acquires a trigger event for continuous screen projection, wherein the trigger event for continuous screen projection is used to trigger the second electronic device to perform continuous screen projection;
    所述第二电子设备发现正在投屏的第一电子设备;The second electronic device discovers the first electronic device that is projecting;
    所述第二电子设备从所述第一电子设备获取第一投屏信息,从而所述第二电子设备根据所述第一投屏信息显示第一投屏内容。The second electronic device acquires first screen projection information from the first electronic device, so that the second electronic device displays the first screen projection content according to the first screen projection information.
  24. 根据权利要求23所述的方法,其特征在于,所述第二电子设备、所述移动终端和所述第一电子设备处于同一个局域网中,The method according to claim 23, wherein the second electronic device, the mobile terminal and the first electronic device are in the same local area network,
    所述第二电子设备发现正在投屏的所述第一电子设备,包括:The second electronic device discovers the first electronic device that is casting a screen, including:
    所述第二电子设备获取所述第一电子设备在所述局域网内广播的第一消息,从而所述第二电子设备根据所述第一消息确定所述第一电子设备为正在投屏的设备;The second electronic device obtains the first message broadcast by the first electronic device in the local area network, so that the second electronic device determines that the first electronic device is a device that is casting a screen according to the first message ;
    或者,or,
    所述第二电子设备在所述局域网内广播第二消息,并获取所述第一电子设备响应于所述第二消息所发送的第三消息,从而所述第二电子设备根据所述第三消息确定所述第一电子设备为正在投屏的设备。The second electronic device broadcasts a second message in the local area network, and acquires a third message sent by the first electronic device in response to the second message, so that the second electronic device broadcasts a second message according to the third message The message determines that the first electronic device is a device that is casting a screen.
  25. 根据权利要求24所述的方法,其特征在于,The method of claim 24, wherein,
    所述第二电子设备从所述第一电子设备获取所述第一投屏信息,包括:The acquisition of the first screen projection information by the second electronic device from the first electronic device includes:
    所述第二电子设备发送投屏信息获取请求;所述第二电子设备接收所述第一电子设备响应于所述投屏信息获取请求向所述第二电子设备发送的所述第一投屏信息;The second electronic device sends a screen projection information acquisition request; the second electronic device receives the first screen projection sent by the first electronic device to the second electronic device in response to the screen projection information acquisition request information;
    或者,or,
    所述第二电子设备从携带有所述第一投屏信息的所述第一消息中获取所述第一投屏信息;The second electronic device obtains the first screen projection information from the first message carrying the first screen projection information;
    或者,or,
    所述第二电子设备从携带有所述第一投屏信息的所述第三消息中获取所述第一投屏信息。The second electronic device acquires the first screen projection information from the third message carrying the first screen projection information.
  26. 根据权利要求23-25中任一项所述的方法,其特征在于,所述接续投屏的触发事件包括以下项的一种或多种:The method according to any one of claims 23-25, characterized in that, the trigger event of the continuous screen projection includes one or more of the following items:
    所述第二电子设备开启;the second electronic device is turned on;
    所述第二电子设备侦测到用户进入侦测范围;The second electronic device detects that the user enters the detection range;
    所述第二电子设备获取其他检测或传感设备侦测到用户进入所述侦测范围;The second electronic device acquires that other detection or sensing devices detect that the user enters the detection range;
    所述第二电子设备获取其他具有无线定位功能的设备侦测到所述移动终端进入所述侦测范围;The second electronic device obtains that other devices with a wireless positioning function detect that the mobile terminal enters the detection range;
    所述第二电子设备确定用户具有观看所述第二电子设备的意图;The second electronic device determines that the user has intent to watch the second electronic device;
    所述第二电子设备确定用户进入所述第二电子设备所安装的房间;The second electronic device determines that the user enters a room where the second electronic device is installed;
    所述第二电子设备接收到指示所述第二电子设备进行接续投屏的指示消息。The second electronic device receives an indication message instructing the second electronic device to perform continuous screen projection.
  27. 根据权利要求23-26中任一项所述的方法,其特征在于,所述第一投屏信息包括第一投屏资源信息和第一投屏状态信息,The method according to any one of claims 23-26, wherein the first screen projection information includes first screen projection resource information and first screen projection state information,
    所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容,包括:The second electronic device displays the first screen projection content according to the first screen projection information, including:
    所述第二电子设备根据所述第一投屏资源信息,从服务器获取所述第一投屏内容,从而所述第二电子设备以所述第一投屏状态信息指示的投屏状态显示所述第一投屏内容。The second electronic device acquires the first screen projection content from a server according to the first screen projection resource information, so that the second electronic device displays the screen projection status indicated by the first screen projection status information. Describe the content of the first screen projection.
  28. 根据权利要求27所述的方法,其特征在于,所述第一投屏资源信息包括统一资源标识符URI,所述第一投屏状态信息包括播放进度、播放音量、播放状态中的一种或多种,所述播放状态包括播放、暂停、倍速、全屏、分屏中的一种或多种。The method according to claim 27, wherein the first screen projection resource information includes a Uniform Resource Identifier (URI), and the first screen projection status information includes one or more of playback progress, playback volume, and playback status. Various, the playing state includes one or more of play, pause, double speed, full screen, and split screen.
  29. 根据权利要求23-28中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 23-28, further comprising:
    所述第二电子设备向所述第一电子设备发送所述第二电子设备的组网信息;The second electronic device sends the networking information of the second electronic device to the first electronic device;
    所述第二电子设备与所述终端设备建立第二投屏连接;The second electronic device establishes a second screen projection connection with the terminal device;
    所述第二电子设备通过所述第二投屏连接从所述终端设备获取不同于所述第一投屏信息的第二投屏信息,从而所述第二电子设备根据所述第二投屏信息显示第二投屏内容。The second electronic device acquires second screen projection information different from the first screen projection information from the terminal device through the second screen projection connection, so that the second electronic device Information displays the content of the second screen projection.
  30. 根据权利要求29所述的方法,其特征在于,所述方法还包括:The method according to claim 29, further comprising:
    所述第二电子设备向所述第一电子设备发送所述第二投屏信息。The second electronic device sends the second screen projection information to the first electronic device.
  31. 根据权利要求23-28中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 23-28, further comprising:
    所述第二电子设备获取所述第一电子设备发送的第二投屏信息,其中,所述第二投屏信息不同于所述第一投屏信息。The second electronic device acquires second screen projection information sent by the first electronic device, where the second screen projection information is different from the first screen projection information.
  32. 根据权利要求23-31中任一项所述的方法,其特征在于,所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容,包括:The method according to any one of claims 23-31, wherein the second electronic device displays the first screen projection content according to the first screen projection information, comprising:
    所述第二电子设备发出是否进行接续投屏的询问消息,在接收到响应于所述询问消息的肯定响应的情况下,所述第二电子设备根据所述第一投屏信息显示所述第一投屏内容。The second electronic device sends an inquiry message whether to perform continuous screen projection, and if an affirmative response is received in response to the inquiry message, the second electronic device displays the first screen projection information according to the first screen projection information. One screen content.
  33. 根据权利要求23-26中任一项所述的方法,其特征在于,所述第一投屏信息包括所述第一投屏内容。The method according to any one of claims 23-26, wherein the first screen projection information includes the first screen projection content.
  34. 一种电子设备,其特征在于,所述电子设备包括存储器及处理器,所述处理器用于执行所述存储器中存储的计算机程序时实现如权利要求23至33中任意一项所述的投屏接续方法。An electronic device, characterized in that the electronic device includes a memory and a processor, and the processor is used to implement the screen projection according to any one of claims 23 to 33 when executing the computer program stored in the memory Continuation method.
  35. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求23至33中任意一项所述的投屏接续方法。A computer-readable storage medium, on which a computer program is stored, wherein, when the computer program is executed by a processor, the screen projection continuation method according to any one of claims 23 to 33 is implemented.
  36. 一种内容接续方法,应用于包括第一电子设备和第二电子设备的系统中,其特征在于,所述方法包括:A content continuation method applied to a system including a first electronic device and a second electronic device, characterized in that the method includes:
    所述第一电子设备运行及显示第一内容;The first electronic device runs and displays first content;
    所述第二电子设备获取内容接续的触发事件,其中,所述内容接续的触发事件用于触发所述第二电子设备进行内容接续;The second electronic device acquires a trigger event of content connection, wherein the content connection trigger event is used to trigger the second electronic device to perform content connection;
    所述第二电子设备发现正在运行第一内容的所述第一电子设备,并从所述第一电子设备获取第一运行信息,从而所述第二电子设备根据所述第一运行信息运行及显示所述第一内容。The second electronic device discovers the first electronic device that is running the first content, and obtains first running information from the first electronic device, so that the second electronic device runs and The first content is displayed.
  37. 根据权利要求36所述的方法,其特征在于,所述第一电子设备和所述第二电子设备处于同一个局域网中,The method according to claim 36, wherein the first electronic device and the second electronic device are in the same local area network,
    所述第二电子设备发现正在运行第一内容的所述第一电子设备,包括:The second electronic device discovering the first electronic device that is running the first content includes:
    所述第一电子设备在所述局域网内广播第一消息,从而所述第二电子设备根据所述第一消息确定所述第一电子设备为正在运行第一内容的设备;The first electronic device broadcasts a first message in the local area network, so that the second electronic device determines that the first electronic device is a device running the first content according to the first message;
    或者,or,
    所述第二电子设备在所述局域网内广播第二消息;所述第一电子设备响应于所述第二消息向所述第二电子设备发送第三消息,从而所述第二电子设备根据所述第三消息确定所述第一电子设备为正在运行第一内容的设备。The second electronic device broadcasts a second message in the local area network; the first electronic device sends a third message to the second electronic device in response to the second message, so that the second electronic device transmits a third message according to the The third message determines that the first electronic device is a device running the first content.
  38. 根据权利要求37所述的方法,其特征在于,The method of claim 37, wherein,
    所述第二电子设备从所述第一电子设备获取第一运行信息,包括:The second electronic device acquires first running information from the first electronic device, including:
    所述第二电子设备发送运行信息获取请求;所述第一电子设备响应于所述运行信息获取请求,向所述第二电子设备发送所述第一运行信息,从而所述第二电子设备获取所述第一运行信息;The second electronic device sends an operation information acquisition request; the first electronic device sends the first operation information to the second electronic device in response to the operation information acquisition request, so that the second electronic device obtains the first running information;
    或者,or,
    所述第一电子设备在所述第一消息或所述第三消息中携带所述第一运行信息,从而所述第二电子设备获取所述第一运行信息。The first electronic device carries the first running information in the first message or the third message, so that the second electronic device acquires the first running information.
  39. 根据权利要求36-38中任一项所述的方法,其特征在于,所述内容接续的触发事件包括以下项的一种或多种:The method according to any one of claims 36-38, wherein the trigger event of the content connection includes one or more of the following items:
    所述第二电子设备开启;the second electronic device is turned on;
    所述第二电子设备侦测到用户进入侦测范围;The second electronic device detects that the user enters the detection range;
    所述第二电子设备获取其他检测或传感设备侦测到用户进入所述侦测范围;The second electronic device acquires that other detection or sensing devices detect that the user enters the detection range;
    所述第二电子设备获取其他具有无线定位功能的设备侦测到所述移动终端进入所述侦测范围;The second electronic device obtains that other devices with a wireless positioning function detect that the mobile terminal enters the detection range;
    所述第二电子设备确定用户具有观看所述第二电子设备的意图;The second electronic device determines that the user has intent to watch the second electronic device;
    所述第二电子设备确定用户进入所述第二电子设备所安装的房间;The second electronic device determines that the user enters a room where the second electronic device is installed;
    所述第二电子设备接收到指示所述第二电子设备进行内容接续的指示消息。The second electronic device receives an indication message instructing the second electronic device to continue content.
  40. 根据权利要求36-39中任一项所述的方法,其特征在于,所述第一运行信息包括所述第一内容信息、第一显示界面和第一运行状态信息,The method according to any one of claims 36-39, wherein the first running information includes the first content information, the first display interface and the first running state information,
    所述第二电子设备根据所述第一运行信息运行及显示所述第一内容,包括:The second electronic device runs and displays the first content according to the first operation information, including:
    所述第二电子设备根据所述第一内容信息及第一运行状态信息,以第一运行状态信息指示的运行状态运行与第一内容信息对应的第一内容,及显示与第一内容对应的第一显示界面。The second electronic device runs the first content corresponding to the first content information in the running state indicated by the first running state information according to the first content information and the first running state information, and displays the The first display interface.
  41. 根据权利要求40所述的方法,其特征在于,所述第一内容信息包括运行的应用程序,所述第一显示界面包括应用程序的界面,所述第一运行状态信息包括应用程序的运行状态。The method according to claim 40, wherein the first content information includes the running application program, the first display interface includes the interface of the application program, and the first running status information includes the running status of the application program .
  42. 根据权利要求36-40中任一项所述的方法,其特征在于,在所述第二电子设备根据所述第一运行信息运行及显示所述第一内容之后,The method according to any one of claims 36-40, characterized in that, after the second electronic device runs according to the first running information and displays the first content,
    所述第一电子设备继续运行及显示所述第一内容;The first electronic device continues to run and display the first content;
    或者,or,
    所述第一电子设备停止运行及显示所述第一内容。The first electronic device stops running and displays the first content.
PCT/CN2022/111509 2021-09-18 2022-09-01 Multi-device screen projection or content continuation method, electronic devices and apparatus WO2023040524A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111101585.2 2021-09-18
CN202111101585.2A CN115834936A (en) 2021-09-18 2021-09-18 Multi-device screen projection or content connection method, electronic device and device

Publications (1)

Publication Number Publication Date
WO2023040524A1 true WO2023040524A1 (en) 2023-03-23

Family

ID=85515362

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/111509 WO2023040524A1 (en) 2021-09-18 2022-09-01 Multi-device screen projection or content continuation method, electronic devices and apparatus

Country Status (2)

Country Link
CN (1) CN115834936A (en)
WO (1) WO2023040524A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024244447A1 (en) * 2023-05-31 2024-12-05 珠海格力电器股份有限公司 Image display method and apparatus, device, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150058888A1 (en) * 2010-02-12 2015-02-26 Samsung Electronics Co., Ltd. Method for controlling video system including a plurality of display apparatuses
CN112258086A (en) * 2020-11-13 2021-01-22 Oppo广东移动通信有限公司 Cross-device task relay method, device, cloud platform and storage medium
CN110537165B (en) * 2017-10-26 2021-02-12 华为技术有限公司 Display method and device
CN112714214A (en) * 2019-10-24 2021-04-27 华为终端有限公司 Content connection method and electronic equipment
CN113207035A (en) * 2021-04-16 2021-08-03 乐视致新信息技术(武汉)有限公司 Video screen projection method, device, equipment and computer readable storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111669424B (en) * 2019-09-29 2023-05-02 深圳乐播科技有限公司 Screen projection connection method, device and system and electronic equipment
CN113360108B (en) * 2020-03-05 2022-09-09 荣耀终端有限公司 A screen projection connection control method and electronic device
CN112988102B (en) * 2021-05-11 2021-09-14 荣耀终端有限公司 Screen projection method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150058888A1 (en) * 2010-02-12 2015-02-26 Samsung Electronics Co., Ltd. Method for controlling video system including a plurality of display apparatuses
CN110537165B (en) * 2017-10-26 2021-02-12 华为技术有限公司 Display method and device
CN112714214A (en) * 2019-10-24 2021-04-27 华为终端有限公司 Content connection method and electronic equipment
CN112258086A (en) * 2020-11-13 2021-01-22 Oppo广东移动通信有限公司 Cross-device task relay method, device, cloud platform and storage medium
CN113207035A (en) * 2021-04-16 2021-08-03 乐视致新信息技术(武汉)有限公司 Video screen projection method, device, equipment and computer readable storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024244447A1 (en) * 2023-05-31 2024-12-05 珠海格力电器股份有限公司 Image display method and apparatus, device, and storage medium

Also Published As

Publication number Publication date
CN115834936A (en) 2023-03-21

Similar Documents

Publication Publication Date Title
US11604493B2 (en) Display assistant device
US9420025B2 (en) Method and apparatus for reproducing content in multimedia data providing system
EP2905967A1 (en) Method for switching playing device, and mobile terminal
US11012260B2 (en) Methods, systems, and devices for managing client devices using a virtual anchor manager
WO2017097088A1 (en) Multi-screen projection control method and system, terminal device, and computer storage medium
TW201110067A (en) Methods and apparatus for a universal device controller using peer to peer communication
WO2013063941A1 (en) Screen sharing method and system for dlna terminal in home network
KR101531532B1 (en) Method and apparatus for using service of home network device based on remote access
US20110145417A1 (en) Communication terminal device and communication device connection control method
CN104270668A (en) Method and system for replaying video content
CN106303679B (en) Media playing control method and media playing client
US10992978B2 (en) Method and system for controlling smart television
JP2003529841A (en) Communication system, control device and controlled device
US9578482B2 (en) Communication apparatus and method of controlling the same
WO2011144025A2 (en) Networking method, server end device, client end device and network system
US11874707B2 (en) Display assistant device
JP2003177980A (en) Information presentation system, device, method for providing information, apparatus, method of information processing, recording medium and program
WO2023040524A1 (en) Multi-device screen projection or content continuation method, electronic devices and apparatus
CN103959827B (en) Communicator and its control method
CN113467262A (en) Method for controlling intelligent household electrical appliance
JP2006053917A (en) Content display system for sharing content between display devices
US20240089526A1 (en) Method for playback in split screen and display device
US20150095956A1 (en) Electronic device, computer program product, and information control method
CN103747350A (en) Method and system for interaction among terminal devices
CN116017032A (en) Screen projection method and related equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22868901

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22868901

Country of ref document: EP

Kind code of ref document: A1