CN112306442A

CN112306442A - Cross-device content screen projection method, device, equipment and storage medium

Info

Publication number: CN112306442A
Application number: CN202011311456.1A
Authority: CN
Inventors: 侯奕含
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-11-20
Filing date: 2020-11-20
Publication date: 2021-02-02
Anticipated expiration: 2040-11-20
Also published as: CN112306442B; WO2022105403A1

Abstract

The embodiment of the application discloses a cross-device content screen projection method, a device, equipment and a storage medium, and belongs to the technical field of content sharing. The device with the display screen can successively receive the content screen projection requests sent by the first device and the second device and can display the first content and the second content in a split screen mode. The first device and the second device send corresponding content screen projection requests to devices with display screens after preset interaction operation is executed. Therefore, the method and the device can reduce the operation complexity of the device with the display screen for simultaneously displaying the screen-projected contents of the devices, and improve the screen-projecting efficiency of the devices.

Description

Cross-device content screen projection method, device, equipment and storage medium

Technical Field

The embodiment of the application relates to the technical field of content sharing, in particular to a cross-device content screen projection method, a cross-device content screen projection device, a cross-device content screen projection equipment and a storage medium.

Background

With the rapid development of intelligent device technology, the scenes of interaction of multiple persons using respective devices are increasing.

In the related art, a plurality of users can use the device to play the same game, and can also log in different shopping applications on the device of the users to compare prices of the same commodity. In the above scenario, if a user in the same room wants to view his device and the other device at the same time, the two users need to be in close positions to view back and forth.

Disclosure of Invention

The embodiment of the application provides a cross-device content screen projection method, a device, equipment and a storage medium. The technical scheme is as follows:

according to an aspect of the present application, there is provided a cross-device content screen projection method, applied to a device having a display screen, the method including:

receiving a first content screen projection request sent by first equipment, wherein the first content screen projection request is a request sent by the first equipment to the equipment with a display screen after executing preset interactive operation;

responding to the first content screen projection request, and playing first content, wherein the first content is content played in the first equipment;

receiving a second content screen projection request sent by a second device, wherein the second content screen projection request is a request sent by the second device to the device with the display screen after the second device executes the preset interactive operation;

and responding to the second content screen projection request, and playing the first content and the second content in a screen splitting mode, wherein the second content is the content played in the second equipment.

According to another aspect of the present application, there is provided a cross-device content screen projection apparatus applied to a device having a display screen, the apparatus including:

the device comprises a first receiving module, a second receiving module and a display module, wherein the first receiving module is used for receiving a first content screen projection request sent by first equipment, and the first content screen projection request is a request sent by the first equipment to the equipment with the display screen after the first equipment executes preset interactive operation;

a first playing module, configured to play the first content in response to the first content screen projection request, where the first content is a content played in the first device;

a second receiving module, configured to receive a second content screen projection request sent by a second device, where the second content screen projection request is a request sent by the second device to the device with the display screen after the second device performs the preset interactive operation;

and the second playing module is used for responding to the second content screen projection request, and playing the first content and the second content in a screen splitting mode, wherein the second content is the content played in the second equipment.

According to another aspect of the application, a cross-device content screen projection system is provided, which comprises a device with a display screen, a first device, at least one second device and a remote control device, wherein a screen projection tag is arranged in the remote control device, and the remote control device is used for remotely controlling the device with the display screen;

the first device is used for scanning information in the screen projection label;

the first device is used for sending a first content screen projection request to the device with the display screen after scanning the information in the screen projection tag;

the device with the display screen is used for receiving the first content screen projection request;

the device with the display screen is used for responding to the first content screen projection request and playing first content, and the first content is content played in the first device;

the second equipment is used for scanning the information in the screen-projecting label;

the second device is used for sending a second content screen projection request to the device with the display screen after scanning the information in the screen projection tag;

the device with the display screen is used for receiving the second content screen projection request;

the device with the display screen is used for responding to the second content screen projection request, and playing the first content and the second content in a screen splitting mode, wherein the second content is the content played in the second device.

According to another aspect of the present application, there is provided a cross-device content screen projection system, the system comprising a device having a display screen, a first device comprising a first image capture component, and at least one second device comprising a second image capture component;

the first device is used for shooting a preset gesture or a preset action through the first image acquisition assembly;

the first device is used for sending a first content screen projection request to the device with the display screen after shooting the preset gesture or the preset action;

the second device is used for shooting the preset gesture or the preset action through the second image acquisition component;

the second device is used for sending a second content screen projection request to the device with the display screen after shooting the preset gesture or the preset action;

According to another aspect of the present application, there is provided an electronic device comprising a processor and a memory, the memory having stored therein at least one instruction, the instruction being loaded and executed by the processor to implement a cross-device content screen projection method as provided in various aspects of the present application.

According to another aspect of the present application, there is provided a computer-readable storage medium having at least one instruction stored therein, the instruction being loaded and executed by a processor to implement a cross-device content screen projection method as provided in various aspects of the present application.

According to one aspect of the present application, a computer program product is provided that includes computer instructions stored in a computer readable storage medium. The computer instructions are read by a processor of a computer device from a computer-readable storage medium, and the computer instructions are executed by the processor to cause the computer device to perform the methods provided in the various alternative implementations of the cross-device content projection aspect described above.

The device with the display screen can successively receive the content screen projection requests sent by the first device and the second device and can display the first content and the second content in a split screen mode. The first device and the second device send corresponding content screen projection requests to devices with display screens after preset interaction operation is executed. Therefore, the method and the device can reduce the operation complexity of the device with the display screen for simultaneously displaying the screen-projected contents of the devices, and improve the screen-projecting efficiency of the devices.

Drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a schematic diagram of an implementation environment for cross-device content projection provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of a split screen mode of an apparatus having a display screen provided based on the embodiment shown in FIG. 1;

FIG. 3 is a schematic diagram of a radio frequency tag reading apparatus provided in the embodiment of FIG. 2;

FIG. 4 is a flowchart of a cross-device content screen projection method provided by an exemplary embodiment of the present application;

FIG. 5 is a flowchart of a cross-device content screen projection method provided by another exemplary embodiment of the present application;

FIG. 6 is a schematic diagram of an application of a cross-device content screen projection method provided based on the embodiment shown in FIG. 5;

FIG. 7 is a flowchart of a cross-device content screen projection method provided by another exemplary embodiment of the present application;

FIG. 8 is a flowchart of a cross-device content screen projection method applied to a proctor scene according to an embodiment of the present application;

FIG. 9 is a flowchart of a cross-device content screen projection method provided by an embodiment of the present application;

FIG. 10 is a schematic display diagram of an apparatus having a display screen provided in accordance with the embodiment shown in FIG. 9;

FIG. 11 is a schematic diagram of a display interface of a device having a display screen provided in accordance with the embodiment shown in FIG. 9;

fig. 12 is a block diagram illustrating a cross-device content screen projection apparatus according to an exemplary embodiment of the present application;

fig. 13 is a block diagram of a device having a display screen according to an exemplary embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

In the description of the present application, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In the description of the present application, it is to be noted that, unless otherwise explicitly specified or limited, the terms "connected" and "connected" are to be interpreted broadly, e.g., as being fixed or detachable or integrally connected; can be mechanically or electrically connected; may be directly connected or indirectly connected through an intermediate. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art. Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

In order to make the solution shown in the embodiments of the present application easy to understand, several terms appearing in the embodiments of the present application will be described below.

A first content screen projection request: the first device sends a piece of information to the device with the display screen, and the information is used for requesting to play the first content played in the first device in the device with the display screen. In one possible approach, the first content screen-casting request may be a character string conforming to a fixed format, the character string including keywords and character content.

Optionally, when the preset interactive operation is scanning of a screen projection tag, the screen projection tag is an electronic tag corresponding to a device with a display screen. The character content may include a first character string that is information read by the first device from a screen-shot tag of a remote control device for remotely controlling the device having the display screen. For example, the first device has an NFC (Near Field Communication) module. The first device is capable of reading a first string in an NFC tag in a device having a display when proximate to a remote control of the device. In another description, an ID (Identity Document) is stored in the NFC tag in the remote controller, and the NFC module in the first device reads the ID in the remote controller as the first character string.

In another possible manner, the first device has a Radio Frequency Identification (RFID) module therein, and the first character string in the RFID tag can be read when the first device is close to a remote controller of the device having the display screen.

It should be noted that, in addition to the NFC and the RFID, the remote control device of the device with a display screen may also be implemented as other short-range radio frequency identification tags, and correspondingly, the first device may be provided with a corresponding short-range identification module. For example, if a radio frequency identification tag conforming to the a protocol is provided in a remote control device of a device having a display screen, a radio frequency identification module conforming to the a protocol may be provided in the first device, and the radio frequency identification module has a capability of reading information in radio frequency identification.

Optionally, when the preset interaction operation includes shooting a preset gesture, or the preset interaction operation includes shooting a preset action, the first content screen projection request may obtain the first character string from the preset application. That is, when the first device shoots a preset gesture or shoots a preset action through the first image acquisition component, the first device can start the preset application and obtain the first character string from the preset application, or the first device can obtain the first character string from the preset application when the preset application is in a starting state. It should be noted that the process of acquiring the second character string by the second device is similar to the process of acquiring the first character string by the first device, and is not described herein again.

The second content screen projection request is as follows: the second device sends a piece of information to the device with the display screen, and the information is used for requesting that the second content played in the second device is continuously played in the device with the display screen. In one possible approach, the second content screen-casting request may be a character string conforming to a fixed format, the character string containing keywords and character content.

Alternatively, a second character string that is information read by the second device from a screen-shot tag of a remote control device for remotely controlling the device having the display screen may be included in the character content. The radio frequency module provided in the second device may be the same type of module as the radio frequency module provided in the first device. In other words, the radio frequency module provided in the second device may be a module conforming to the same radio frequency protocol as the radio frequency module provided in the first device.

A character string template: a character string provided in a device having a display screen. In one possible approach, the string template is the same as the string reserved in the remote control device corresponding to the device having the display screen. When the first device and the second device correctly read the reserved character strings in the remote control device, the first character string in the first device, the second character string in the second device and the character string template are the same character string.

For example, the reserved string in the remote control device is "abcdef 1234" and the string template is also "abcdef 1234". When the first device is attached to the remote control device and the reserved character string is read through the radio frequency module, the generated first character string is 'abcdef 1234', and the device with the display screen can continue to play the first content originally played in the first device through verification when the first character string and the character string template are the same. Similarly, when the second device correctly reads the reserved character string in the remote control device through the radio frequency module, the generated second character string is "abcdef 1234". The device with the display screen continues to play the second content originally played in the second device in the device with the display screen when the second character string and the character string template are the same.

In another possible way, the character string template and the characters reserved in the remote control device corresponding to the device with the display screen are different, but the two character strings are matched with each other. For example, the reserved character in the remote control device is "33445566 abc" and the string template is "1122334455 cba". The device with the display screen stores a character string template in advance, and stores a binding relationship between '1122334455 cba' and '33445566 abc'. When the device having a display screen receives a first content screen-casting request to read "33445566 abc" therefrom or receives a second content screen-casting request to read "33445566 abc" therefrom, the device having a display screen may continue to play the first content in the device having a display screen or the second content in the device having a display screen through authentication in a scene where "33445566 abc" and "1122334455 cba" match.

First content: content displayed on a first device that can be rendered on a device having a display screen by the first device via a cross-device manner. The present application provides two alternative playback modes for the first device, as described below.

In a first optional manner, the first content is originally played in the first device, and after the first device successfully projects the first content to the device with the display screen for playing, the first content continues to be played in the first device. For example, when the first content is a game screen, the game screen may continue to be played in the first device, and the game can normally receive the user's manipulation in the first device. For another example, when the first content is a user interface of a shopping application, the user can continue to display the user interface of the shopping application in the first device, facilitating the user using the first device to continue to operate and view the merchandise information displayed in the shopping application.

In a second optional manner, the first content is originally played in the first device, and after the first device successfully projects the first content to the device with the display screen for playing, the first content stops playing in the first device. In this manner, the first device may also continue to display the manipulation interface with respect to the first content. For example, when the first content is a video, the first device may also display controls to play, stop, fast forward, fast backward, adjust the progress of the play, or adjust the volume.

The first content may be at least one of a social application, a video application, a reading application, a map application, a weather application, a group buying application, an office application, a photography application, a finance application, a trip application, a shopping application, a game application or an examination learning application, in terms of an application type to which the first content belongs.

For the second content, the user interface to which the first content belongs may be the same interface as the user interface to which the second content belongs. The display mode of the second content in the second device may be the same as the display mode of the first content in the first device, and details may refer to the above description of the first content, and are not described herein again.

Illustratively, the first content may include a first item and the second content may include a second item. The first item and the second item are items belonging to the same shopping application.

For example, the cross-device content screen projection method shown in the embodiment of the present application may be applied to a device having a display screen. A device having a display screen is a device provided with a display screen. Alternatively, the display screen size of a device having a display screen is a larger size device in the physical world. For example, the device having a display screen may be a television, a projector, a computer display screen, a mural display screen, or a monitor of a video surveillance system, a tablet computer, or a notebook computer, which is not limited in this application. In another possible scenario, a device with a display screen and equipped with a remote control may be implemented as the device with a display screen shown in this application.

Referring to fig. 1, fig. 1 is a schematic diagram of an implementation environment of cross-device content screen projection provided in an embodiment of the present application. In fig. 1, a device 111 having a display screen, a remote control device 112, a first device 120 and a second device 130 are included. Wherein the remote control device 112 is used for remotely controlling the device 111 having a display screen.

In fig. 1, the device 111 having a display screen is a television, the remote control device 112 is a television remote controller, the first device 120 is a mobile phone, and the second device 130 is also a mobile phone.

The device 111 with a display screen may be a television placed at the user's home, business or public place. The device with a display screen 111 has a display screen with a large size, and the device with a display screen 111 has a function of split-screen display. Alternatively, the display screen size of the device 111 with a display screen may be above 10 inches.

To schematically illustrate the function of split screen, please refer to fig. 2, fig. 2 is a schematic diagram of a split screen mode of a device with a display screen provided based on the embodiment shown in fig. 1. The device 111 with a display screen comprises a first display area 210 and a second display area 220 after entering the split screen mode. The device 111 having a display screen is capable of independently displaying specified contents in the first display area 210 and the second display area 220, respectively. For example, the device 111 having a display screen displays an interface of the game G1 in the first display area 210 and a shopping application S1 in the second display area 220.

The first device 120 may connect to the device 111 having a display screen via bluetooth, WiFi (Wireless Fidelity), or other short-range Wireless connection network. Illustratively, when the first device 120 is in the same WiFi network as the device 111 with the display screen, the first device 120 can project the first content into the device 111 with the display screen.

Accordingly, the second device 130 can project the second content originally displayed in the second device 130 to the device 111 having the display screen by establishing a connection with the device 111 having the display screen in the same manner.

Illustratively, the first device 120 or the second device 130 and the device 111 with a display screen may perform the screen projection processing according to the same screen projection protocol.

In the embodiment of the present application, the screen projection protocol may be any one of AirPlay, Miracast, DLNA, Chromecast, WiDi, WDHI, or a proprietary screen projection protocol. It should be noted that the screen projection protocol herein is only an illustrative example, and does not form a limitation on the screen projection protocol actually applied in the embodiment of the present application.

In the embodiment of the present application, please refer to fig. 3, and fig. 3 is a schematic diagram of a radio frequency tag reading method according to the embodiment shown in fig. 2. It should be noted that in the embodiment of the present application, the first device 120 and the second device 130 both need to read information in the screen shot tag in the remote control device 112. In fig. 3, a process in which the first device 120 and the second device 130 respectively read the screen shot tag 310 in the remote control device is described. It should be noted that the first device 120 is provided with a first rf module 320, and the second device 130 is provided with a second rf module 330.

In a practical application scenario, if the screen-projecting tag 310 in the remote control device 112 performs the card-swiping operation with both the first device 120 and the second device 130, the order is chronological. In the embodiment of the present application, it is defined that the remote control device 112 performs a card-swiping operation with the first device 120, and then performs a card-swiping operation with the second device 130.

In the first swipe phase 3A shown in fig. 3, the first device 120 touches the lower portion of the remote control device 112. The screen-projecting tag 310 provided in the lower portion of the remote control device 112 is read by the first radio frequency module 320 in the first device 120, and the first device 120 generates a first character string from the read information.

In the second swipe phase 3B shown in fig. 3, the second device 130 touches the lower portion of the remote control device 112. The screen-projecting tag 310 provided in the lower portion of the remote control device 112 is read by the second radio frequency module 330 in the second device 130, and the second device 130 generates a second character string according to the read information.

It should be noted that, in fig. 3, the first rf module 320 in the first device 120 is disposed at the upper portion of the back surface of the device, and the second rf module 330 in the second device 130 is disposed at the lower portion of the back surface of the device. The embodiment of the application shows that the radio frequency module is arranged at different positions by explaining different types of equipment. Correspondingly, for the same type of equipment, the positions of the radio frequency modules in the equipment are the same.

Illustratively, the system shown in fig. 1 can include a device having a display screen, a first device, at least one second device, and a remote control device including a screen projection tag therein, and the remote control device is for remotely controlling the device having the display screen. The first equipment is used for scanning information in the screen projection label; the first device is used for sending a first content screen projection request to a device with a display screen after scanning information in the screen projection tag; a device having a display screen for receiving a first content screen-casting request; a device having a display screen for playing a first content in response to a first content screen-casting request, the first content being a content played in the first device; the second equipment is used for scanning the information in the screen projection label; the second device is used for sending a second content screen projection request to the device with the display screen after scanning the information in the screen projection tag; a device having a display screen for receiving a second content screen-casting request; and the equipment is provided with a display screen and is used for responding to the second content screen projection request, and playing the first content and the second content in a split screen mode, wherein the second content is the content played in the second equipment.

In another possible implementation of a cross-device content projection system, the system includes a device having a display screen, a first device including a first image capture component, and at least one second device including a second image capture component. The first device is used for shooting a preset gesture or a preset action through the first image acquisition assembly; the first device is used for sending a first content screen projection request to the device with the display screen after shooting a preset gesture or a preset action; a device having a display screen for receiving a first content screen-casting request; a device having a display screen for playing a first content in response to a first content screen-casting request, the first content being a content played in the first device; the second device is used for shooting a preset gesture or a preset action through the second image acquisition assembly; the second device is used for sending a second content screen projection request to the device with the display screen after shooting the preset gesture or the preset action; a device having a display screen for receiving a second content screen-casting request; and the equipment is provided with a display screen and is used for responding to the second content screen projection request, and playing the first content and the second content in a split screen mode, wherein the second content is the content played in the second equipment.

Referring to fig. 4, fig. 4 is a flowchart of a cross-device content screen projection method according to an exemplary embodiment of the present application. The cross-device content screen projection method can be applied to the device with the display screen shown in fig. 1. In fig. 4, the cross-device content screen projection method includes:

step 410, receiving a first content screen projection request sent by a first device, where the first content screen projection request is a request sent by the first device to a device with a display screen after executing a preset interactive operation.

In this application, the preset interaction operation may include one of scanning a screen-shot tag, shooting a preset gesture, or shooting a preset action.

When the preset interactive operation is scanning of the screen projection tag, the device with the display screen can receive a first content screen projection request sent by the first device. After the screen projection tag is scanned, the first device sends a first content screen projection request to the device with the display screen. In one scenario, if the screen projection tag is arranged in a remote controller of the device with the display screen, the first device is close to or touches an area in the remote controller, where the screen projection tag is arranged, the first device generates a first content screen projection request according to the read information, and sends the first content screen projection request to the device with the display screen.

When the preset interaction operation is shooting a preset gesture, the first device can shoot the gesture of the user through the first image acquisition assembly. Wherein, first image acquisition subassembly can be leading camera or rear camera is shot. The preset gesture includes one of a one-handed gesture, a two-handed gesture, or a combined-handed and facial gesture. A one-handed gesture is a designated gesture made with one hand, either the left hand or the right hand. The two-hand gesture is a gesture made by mutually matching the left hand and the right hand. A hand-face combination gesture is a gesture formed by combining one hand and a human face, or a hand-face combination gesture is a gesture formed by combining two hands and a human face. It should be noted that, the embodiment of the present application does not limit the specific motion of the preset gesture. When the gesture made by the user is a preset gesture, the first device sends a first content screen projection request to a device with a display screen. Accordingly, a device having a display screen receives the first content screen projection request.

When the preset interaction operation is shooting a preset action, the first device can collect multi-frame images containing the action of the user, and when the features extracted from the multi-frame images conform to the features corresponding to the preset action, the first device can determine that the preset action is shot and send a first content screen projection request to the device with the display screen. Accordingly, a device having a display screen receives the first content screen projection request.

Optionally, the device with the display screen may receive the first content screen-casting request sent by the first device by means of short-range wireless communication. The short-range wireless communication mode may be any one of WiFi, bluetooth or Zigbee (Zigbee). When the first device sends the first content screen projection request, the purpose is to continue playing the content originally played in the first device in the device with the display screen. Wherein the first content is content played in the first device. The first content may be a user interface currently playing in the first device, or the first content may be a user interface of an application currently running in the foreground in the first device.

Step 420, in response to the first content screen-casting request, playing the first content, where the first content is the content played in the first device.

After receiving a first content screen projection request, the device with the display screen responds to the request and continues to play the first content originally played in the first device. The played content can be a video, a game picture or an interface displayed by a mobile phone in real time.

Optionally, the device with the display screen may play the first content in response to a first character string in the first content screen-casting request matching the character string template, where the first character string is information read by the first device from the screen-casting tag.

In the application, a device with a display screen can extract a first character string from a first content screen-casting request, and match the first character string with a character string template. When the first character string and the character string template are matched, the device with the display screen plays the first content. In a practical application scenario, the device with the display screen may play the first content in a full screen mode, or may display the first content in one of the display areas when the current device with the display screen is in a multi-screen display mode or a split-screen mode.

It should be noted that the first character string is information read by the first device from the screen shot tag. The screen-projecting tag can be arranged in the remote control device corresponding to the device with the display screen, the screen-projecting tag can also be independently arranged to form a radio frequency card, and the radio frequency identification tag can also be attached to the frame of the device with the display screen.

Step 430, receiving a second content screen projection request sent by the second device, where the second content screen projection request is a request sent by the second device to the device with the display screen after executing the preset interactive operation.

Similar to the process of the device with the display screen receiving the first content screen-casting request sent by the first device, the process of the device with the display screen receiving the second content screen-casting request sent by the second device is similar, and details are not repeated here.

Alternatively, the second device may be a device of the same model as the first device or a device of a different model from the first device. In the present embodiment, devices from the same vendor may be defined as one model of device. Alternatively, devices from both the same manufacturer and the same specific model are defined as devices of the same model.

Alternatively, the second device may be the same type of device as the first device or a different type of device from the first device. In the embodiment of the application, the types of the devices may be classified according to the classification modes of the mobile phone, the tablet computer, the smart watch, the notebook computer and the like.

Step 440, responding to the second content screen projection request, playing the first content and the second content in the split screen mode, wherein the second content is the content played in the second device.

In the application, when the first content that the first device casts the screen is played in the device with the display screen, the device with the display screen can respond to the screen casting request sent by the other device, and simultaneously plays the originally played first content and the second content corresponding to the new requirement through the screen splitting mode.

Optionally, in response to a second character string in the second content screen projection request matching the character string template, the first content and the second content are played simultaneously, where the second character string is information read from the screen projection tag by the second device.

Since the first content is already being played in the device with the display screen, when the second character string matches the character string template, the device with the display screen determines how to display the first content and the second content simultaneously according to the size of the area of the screen occupied by the first content in the device with the display screen.

In one possible implementation, when the device with the display screen displays the first content in a full screen mode, the device with the display screen will adopt a split screen mode to re-divide the two display areas. Wherein one area is used for displaying the first content and the other area is used for displaying the second content. Alternatively, the two display regions may be a first display region and a second display region, respectively. Optionally, the device with the display screen may also be in a multi-screen mode, in which the device with the display screen includes more than 2 display regions. Wherein the 2 display areas are for displaying the first content and the second content.

In another possible implementation, when the device having the display screen displays the first content while already in the split-screen mode or the multi-screen mode, the device having the display screen may display the second content in a display area other than the display area where the first content is displayed.

Through the possible processing mode, the device with the display screen can simultaneously display the first content projected by the first device and the second content projected by the second device.

In summary, in the content screen projection method across devices provided in this embodiment, the device with the display screen can successively receive the content screen projection requests sent by the first device and the second device, and continue to play the first content in the first device in the device with the display screen, and continue to play the second content in the second device in the device with the display screen. The first device and the second device play corresponding contents according to the screen-casting request sent to the device with the display screen after executing the preset interactive operation, so that the capability of the device with the display screen to simultaneously display the contents cast by the multiple devices under the condition of less operation is improved, and the screen-casting efficiency of the multiple devices is improved.

Based on the scheme disclosed in the previous embodiment, the device with the display screen can also enter a split screen mode in advance, receive the requests of the first device and the second device in the split screen mode in sequence, and display corresponding contents at the same time. Please refer to the following examples.

Referring to fig. 5, fig. 5 is a flowchart of a cross-device content screen projection method according to another exemplary embodiment of the present application. The cross-device content screen projection method can be applied to the devices with the display screens. In fig. 5, the cross-device content screen projection method includes:

and step 511, receiving a screen splitting instruction.

A device having a display screen is capable of receiving a split screen instruction. The split-screen instruction may be a voice instruction, an infrared instruction, or an instruction generated when a menu control is triggered.

(1) When the split screen instruction is a voice instruction, the device having the display screen may receive the instruction through software built in the voice assistant or the like. For example, a device with a display screen may enter a voice activated state after receiving a wake up word. When the device with the display screen is in a voice activated state, the microphone of the device with the display screen can receive voice and generate voice instructions according to the voice.

And step 512, responding to the screen splitting instruction, entering a screen splitting mode, wherein the display screen of the device with the display screen at least comprises a first display area and a second display area in the screen splitting mode.

A device having a display screen is capable of entering a split screen mode in response to a split screen command. In the present application, the split screen mode includes a first display region and a second display region. The first display area is used for displaying first content, and the second display area is used for displaying second content.

For example, a user speaks the wake word "duffel cloth" and a device with a display screen will enter a voice activated state. At this point, the device with the display screen will enter the split screen mode again when the user says to enter the split screen mode.

For another example, the user can open a menu designated in the device having the display screen through the remote controller, and when a split screen button in the menu is clicked, the device having the display screen enters a split screen mode.

Step 520, a first content screen projection request sent by a first device is received.

In this example, step 520 is the same as the process performed in step 410, and is not described here again.

Step 530, responding to the matching of the first character string in the first content screen projection request and the character string template, and playing the first content in the first display area.

When the display area of the device having the display screen is divided into the first display area and the second display area, the first display area may be an area on the left side, and the second display area may be an area on the right side.

And step 540, receiving a second content screen projection request sent by the second device.

In this example, step 540 is the same as the process performed in step 430, and is not described here.

In response to the matching of the second character string in the second content screen-casting request and the character string template, the second content is played in the second display area while the first content is played in the first display area, step 550.

In this example, the first content is already being displayed in the first display area. Thus, the device having the display screen arranges the second content for display in the second display area.

The above will be described by way of an example of a practical application.

Referring to fig. 6, fig. 6 is a schematic application diagram of a cross-device content screen projection method provided based on the embodiment shown in fig. 5. In fig. 6, the device having the display screen is a television, the first device is an a-cell phone, the second device is a B-cell phone, and the screen-projecting tab having a binding relationship with the device having the display screen is provided in the remote controller of the device having the display screen.

First, the user can control the tv 620 to enter a left-right split mode using the remote control 610 or by voice. Illustratively, when the user controls the television 620 by voice, the television 620 will display the prompt 621 "the television will go to left and right split screen".

Then, the user uses the a-cell phone 630 to abut against the remote control 610, and the radio frequency module of the a-cell phone 630 reads the first character string from the screen projection tag in the remote control 610, and includes the information in the first content screen projection request, and sends the first content screen projection request to the television 620. Accordingly, the television 620 displays the content originally displayed in the a-phone 630 in the first display area 622 on the left side upon verifying that the first character string matches the character string template stored in the television 620.

Then, another user may use the B-cell phone 640 to attach to the same remote control 610, and the rf module of the B-cell phone 640 reads a second string from the screen-casting tag in the remote control 610, and the information is included in a second content screen-casting request and sent to the tv 620. Accordingly, the television 620 displays the content originally displayed in the B-phone 640 in the second display area 623 on the right side upon verifying that the second character string matches the character string template stored in the television 620.

In summary, the present embodiment can enter the split screen mode in advance according to the voice instruction of the user or the instruction of the remote controller in advance. After the first device passes the authentication of the device with the display screen, the first content displayed in the first device will be displayed in one of the display areas, and likewise, after the second device passes the authentication of the device with the display screen, the device with the display screen will display the second content displayed in the second device in the display area except for the display area in which the first content is displayed. The information used for verifying the device with the display screen by the first device and the second device is obtained from the screen projection tag which is in binding relationship with the device with the display screen. Therefore, the device with the display screen can provide the split screen mode which is convenient to enter, the content played in other devices can be directly projected into one display area in the split screen mode only by one step, and then the content in other devices can still be rapidly projected into other display areas in the split screen mode under the condition that the content for projection is available. Therefore, the method provided by the embodiment of the application can improve the capability of the device with the display screen to simultaneously display the screen projection contents in a plurality of other devices.

In the embodiment of the application, besides entering the split screen mode in advance, the device with the display screen also has the capability of intelligently judging whether to enter the split screen mode to display the first content and the second content. Please refer to the following examples.

Referring to fig. 7, fig. 7 is a flowchart of a cross-device content screen projection method according to another exemplary embodiment of the present application. The cross-device content screen projection method can be applied to the devices with the display screens. In fig. 7, the cross-device content screen projection method includes:

step 710, receiving a first content screen projection request sent by a first device.

In this example, the step 710 is the same as the step 410, and is not described herein again.

And 720, responding to the matching of the first character string in the first content screen projection request and the character string template, and playing the first content in a full screen mode.

Step 730, a second content screen projection request sent by the second device is received.

In this example, the step 730 is the same as the step 430, and is not described herein again.

Step 741, in response to the second content screen projection request, acquiring the screen splitting information.

It should be noted that the split screen information may be included in the second content screen projection request. The split screen information is used for providing the device with the display screen so as to enable the device with the display screen to judge whether to enter the split screen.

Step 742, in response to that the split screen information meets the preset condition, playing the first content in the first display area and playing the second content in the second display area, where the display screen of the device having the display screen at least includes the first display area and the second display area in the split screen mode.

In this example, when the split screen information meets the preset condition, the device having the display screen plays the first content in the first display area, and plays the second content in the second display area. Wherein the first display region and the second display region are display regions that do not overlap with each other.

It should be noted that, according to the specific form of the split screen information, the present application can provide a corresponding scheme for automatically entering the split screen mode, which is described below.

(1) The split screen information is device information related to split screen, and specifically embodies the time when the first device successfully casts the screen and the time when the second device successfully casts the screen.

Step a1, in response to the second content screen-casting request, acquiring a reference time length between the screen-casting time of the first device and the screen-casting time of the second device.

Step a2, in response to the reference time length being less than the first threshold, playing the first content in the first display area and playing the second content in the second display area.

In this example, the screen-casting time of the first device is used to indicate the time when the second content is successfully cast in the device with the display screen, and the screen-casting time of the second device is used to indicate the time when the third content is successfully cast in the device with the display screen.

Illustratively, the device with the display screen calculates the time length between two screen projecting times, that is, the reference time length, according to the screen projecting time when the first device successfully projects the screen on the device with the display screen and the screen projecting time when the second device successfully projects the screen on the device with the display screen. The reference duration can reflect the relevance of screen projection between the first device and the second device, and if the reference duration is shorter, the screen projection performed by the first device on the device with the display screen is indicated, and the two events of screen projection performed by the second device on the device with the display screen have stronger relevance. Therefore, based on the design idea, when the reference duration is less than the first threshold, the first content is played in the first display area, and the second content is played in the second display area. Through the processing, the equipment with the display screen can intelligently play the first content projected by the first equipment and the second content projected by the second equipment at the same time.

Correspondingly, when the reference duration is greater than or equal to the first threshold, the first content originally displayed in the device with the display screen is replaced and displayed by the second content in the second device.

In one practical example. For example, the reference time period is 37 seconds and the first threshold is 120 seconds. In this case, the reference duration is less than the first threshold. Accordingly, a device having a display screen plays first content in a first display area and plays second content in a second display area.

In another example, the reference duration is 560 seconds. In this case, the reference duration is greater than the first threshold. Thus, the first content originally displayed in the device having the display screen will be replaced by the second content, and the device having the display screen will display the second content.

(2) The split screen information relates to split screen equipment information, and specifically is historical screen projection information of the second equipment.

Step b1, responding to the second content screen-projecting request, obtaining historical screen-projecting information of the second device, wherein the historical screen-projecting information includes at least one of screen-projecting times or accumulated screen-projecting duration of the second device successfully projecting screens to the device with the display screen.

And step b21, responding to the screen-throwing times being larger than or equal to the second threshold value, playing the first content in the first display area, and playing the second content in the second display area.

And b22, responding to the screen-shot accumulated time length being larger than or equal to the third threshold value, playing the first content in the first display area, and playing the second content in the second display area.

It should be noted that, after the device having the display screen performs step b1, step b21 or step b22 may be performed.

In this example, the device having the display screen can determine whether to display the first content and the second content simultaneously in a split screen manner according to the accumulated screen-casting duration of the second device. If the cumulative screen-projection duration of the second device is long enough, it indicates that the second device has a strong correlation with the device having the display screen in terms of screen projection. In this case, the device having the display screen will split the screen into two display regions that do not overlap with each other, i.e., a first display region and a second display region. Then, the device having the display screen displays the first content in the first display area and the second content in the second display area, respectively.

In this example, the device with the display screen is further capable of determining whether to display the first content and the second content in a split screen manner according to the screen projection times of the second device which has historically succeeded in performing screen projection on the device with the display screen. When the screen-casting times of the second device on the device with the display screen are greater than or equal to the second threshold, it is indicated that the second device has strong correlation with the device with the display screen in terms of screen casting, and the device with the display screen displays the first content and the second content simultaneously after screen splitting.

In contrast, when the historical screen projection information indicates that the second device is not strongly related in screen projection to the device having the display screen, the device having the display screen will display a dialog box in the display screen. The dialog box is used for reminding a user of selecting whether a device with a display screen displays the first content and the second content through split screens. Or the dialog box is used for reminding the user of selecting the equipment with the display screen to stop displaying the first content and displaying the second content in the display area originally displaying the first content.

(3) The split screen information is content related to split screen, specifically image information of the first content and image information of the second content.

And c1, responding to the screen projection request of the second content, acquiring the first image information in the first content according to a preset strategy, and acquiring the second image information in the second content according to the preset strategy.

Step c2, in response to the similarity between the first image information and the second image information being greater than or equal to the fourth threshold, playing the first content in the first display area and playing the second content in the second display area.

In this example, a device having a display screen is capable of autonomously image-recognizing the first content and the second content. In a specific application mode, the device with the display screen can acquire the second content according to the second content screen projection request and acquire the second key frame in the second content. Wherein the second key frame is an image frame acquired at a specified time. And acquiring the image frame in the first content at the same specified time by the equipment with the display screen, wherein the image frame in the first content is a first key frame. A device having a display screen is capable of extracting image features in a first key frame and is capable of extracting image features in a second key frame. And when the similarity between the image features in the first key frame and the image features in the second key frame is greater than or equal to a fourth threshold, indicating that the first content and the second content are more likely to belong to the same application, or indicating that the first content and the second content display corresponding objects. For example, the first content and the second content have the same character or the same item displayed therein.

Since the contents displayed in the first content and the second content are similar, it is more likely that the user wishes to simultaneously cast screens for simultaneous viewing in a device having a display screen for comparison. Therefore, in this scenario, a device having a display screen will enter a split screen state and display the first content and the second content simultaneously.

(4) The split screen information is related to the split screen content, specifically, the content identifier of the first content and the content identifier of the second content.

And d1, responding to the second content screen projection request, and acquiring a first content identifier corresponding to the first content and a second content identifier corresponding to the second content.

Step d2, in response to the first content identification and the second content identification matching, playing the first content in the first display area and playing the second content in the second display area.

In this example, the content identifier may indicate an identifier of an application corresponding to the content, may indicate a category to which the application corresponding to the content belongs, and may indicate a type of an object in the content.

(1) The content identification indicates an application to which the content corresponds. For example, the first content identification and the second content identification are both used to indicate an application to which the content corresponds. When the first content identifier is the identifier of the application A and the second content identifier is the identifier of the application A, the device with the display screen determines that the first content identifier and the second content identifier are matched, and plays the first content in the first display area and simultaneously plays the second content in the second display area. In contrast, when the application indicated by the first content indicator and the application indicated by the second content indicator are different applications, the device having the display screen may stop displaying the first content and display the second content in the display area where the first content is originally displayed.

(2) The content identification indicates a category of application to which the content corresponds. For example, the first content identifier and the second content identifier are used to indicate a category of an application corresponding to the first content and a category of an application corresponding to the second content, respectively. For example, when the first content identifier is a game-class application identifier and the second content identifier is a video application identifier, the first content identifier and the second content identifier do not match. And when the first content identification is the game application identification and the second content identification is also the game application identification, the first content identification is matched with the second content identification.

(3) The content id indicates an object in the content, which may be a character or other item. For example, if the first content id indicates character jack and the second content id indicates character brown, the first content id and the second content id do not match. If the first content identifier indicates that the character is brown and the second content identifier also indicates that the character is brown, the first content identifier and the second content identifier are matched.

In the embodiment of the present application, the four scenarios are used to instruct a device having a display screen to automatically recognize that a split screen mode needs to be entered, and respectively display a first content and a second content in different display areas. The device with the display screen can also provide a control for the user to select, so that the user can automatically select whether to enter the split screen mode, and accordingly the first content is displayed in the first display area and the second content is displayed in the second display area in the split screen mode. See the following protocol for manual selection by the user.

And step e1, responding to the second content screen projection request, and displaying a screen splitting button.

And e2, responding to the screen splitting button being triggered, playing the first content in the first display area and playing the second content in the second display area.

In an embodiment of the application, a device having a display screen is capable of displaying a split screen button upon receiving a content screen-casting request from a second device. Illustratively, the split button may be displayed in a display screen of a device having a display screen. The user can trigger the split screen button using a remote control device, and when the split screen button is triggered, the device having the display screen will play the first content in the first display area and the second content in the second display area.

Optionally, the device with the display screen is also capable of displaying a close control, which when triggered by the user will stop displaying the split screen button.

In summary, the device with the display screen can receive the first content screen-casting request of the first device first, and display the first content corresponding to the first device in a full screen manner when the request meets the preset condition. Subsequently, the device with the display screen automatically identifies the importance degree of the second content or the safety of the second device for projecting the second content in multiple modes, and when the second content is important or the second device is safe relative to the device with the display screen, the device with the display screen automatically enters a split screen mode and simultaneously displays the first content and the second content, so that the intelligence of the device with the display screen is improved, the operation required by a user for simultaneously displaying the first content and the second content is reduced, and the convenience of simultaneously projecting the screen on one device by multiple devices is improved.

Optionally, the device with the display screen can determine whether to automatically perform the split-screen display according to the time length of the reference time length between the time when the first content and the second content start to be projected. When the time interval between the first content and the second content is not long, the correlation between the two contents is high enough, the device with the display screen automatically enters a split screen state, and the first content and the second content are displayed simultaneously, so that the capability of intelligently determining whether to display the first content and the second content simultaneously from the screen projection behavior of the device with the display screen is realized.

Optionally, the device with the display screen can confirm the intimacy degree between the second device and the device with the display screen according to the history screen projection information of the second device, and when the device with the display screen and the second device are frequently connected and have a relatively close relationship, the device with the display screen automatically enters a screen splitting state and simultaneously displays the first content and the second content, so that the capability of the device with the display screen to intelligently judge whether to simultaneously display the first content and the second content from the history screen projection condition of the second device is improved.

Optionally, the device with the display screen can also decide whether to automatically enter the split screen state according to the similarity of the first content and the second content on the image, so as to display the first content and the second content at the same time. When the similarity of the first content and the second content on the image is large, the first content and the second content are relatively strong in relevance, and the user is relatively likely to view and compare the first content and the second content at the same time. Therefore, the device having the display screen can automatically enter the split screen state in this scene, thereby simultaneously displaying the first content and the second content.

Optionally, the device with the display screen can further determine whether to enter a split screen state according to whether the first content identifier and the second content identifier match, and when the two content identifiers match, it is stated that the first content and the second content need to be displayed in a state capable of being viewed simultaneously. Therefore, in the scene, the device with the display screen automatically enters the split screen state and simultaneously displays the first content and the second content, and the device with the display screen automatically and simultaneously displays the first content and the second content under the condition that the contents displayed by the plurality of devices are related.

Except for the scene needing split screen automatic identification, the embodiment of the application can be applied to mobile equipment for answering, and the invigilating equipment monitors the mobile equipment. In this scenario, the device with the display screen is a monitoring device, and the first device and the second device are both devices that display test papers and are intended for the test taker. For an introduction of the application scenario, please refer to the content shown in fig. 8.

Referring to fig. 8, fig. 8 is a flowchart of a cross-device content screen projection method applied to an invigilation scene according to an embodiment of the present application. The method referred to in fig. 8 may be implemented by the device with a display screen shown in fig. 1, in the following details:

step 811, start the device with display screen, which is the monitoring device of the examination room.

In this example, the device with the display screen is a monitoring device in an examination room, and the examiner can know the content displayed in the examination device used by the examinee through the device with the display screen during the examination.

It should be noted that the first device and the second device are both testing devices. A first device and several second devices may be included in the present application. The first device is a device which casts a screen in the device with the display screen, and the second device is a device which casts the screen in the device with the display screen after the first device finishes casting the screen.

In this scenario, the monitoring device may provide a radio frequency card in a matching manner, and the radio frequency card is a screen-projecting tag. The first device, the second device and the like can be close to the radio frequency card, so that information can be read from the radio frequency card, and the first character string or the second character string can be generated.

It should be noted that, in a possible manner, the radio frequency card is provided for each examination room, and the examinees taking examinations in the examination rooms use their own examination devices to scan the radio frequency card.

In another possible way, the radio frequency card can be provided with one radio frequency card on each examinee seat.

Step 812, a first content screen-projection request sent by the first device is received.

In this example, after the first device reads information from the radio frequency card and generates the second character string, the second character string is placed in the first content screen projection request, and the first content screen projection request is sent to the first device.

Correspondingly, the device with the display screen receives a first content screen projection request sent by the first device.

Step 813, in response to the first character string in the first content screen projection request matching the character string template, playing the first content.

The device with the display screen can read the first character string from the content screen projection request after receiving the first content screen projection request, and play the first content when the first character string is matched with the character string template.

Wherein the first content is content displayed in a first device screen. That is, the content displayed in real time in the first device will be synchronously projected to the device having the display screen for display.

Step 814, receiving a second content screen-projection request sent by the second device.

And step 815, responding to the matching of the second character string in the second content screen projection request and the character string template, and simultaneously playing the first content and the second content.

Similar to the first device projecting the first content to the device with the display screen for display, the second device will repeat the same operations as the first device, also projecting the content in the device with the display screen. In the embodiment of the application, the number of the examinees in one examination room is usually several or dozens. Thus, one device with a display screen may correspond to one first device and several second devices.

In the above-described corresponding design, the number of the second devices may be 7, 9, 15, 19, or the like in consideration of the screen size of the device having the display screen.

After the second device successfully casts the second content onto the device with the display screen, the device with the display screen will simultaneously display the first content and the second content. In the scene, the examinees use the first device or the second device to answer the examination. Because of the particularity of electronic devices, it is also difficult for an examiner to simultaneously examine examination devices used by a plurality of examinees. In the method provided by the application, an inspector can see the first content and the plurality of second contents in a device with a display screen simultaneously so as to view an answer interface seen by a test taker in real time.

Step 821, responding to the abnormal image included in the first content and/or the second content, and recording the abnormal image and the display time of the abnormal image.

In this example, a device having a display screen is capable of image recognition of images in the first content and/or the second content. In one possible approach, a device with a display screen is capable of image recognition on a frame-by-frame basis. In another possible approach, a device with a display screen can identify images in the same content every N frames. For example, a device having a display screen performs image recognition on image frames in the first content, with 30 frame images as a set of images. A device having a display screen is capable of performing image recognition on a first image frame in a set of images.

Wherein, the device with the display screen can be preset with an image template belonging to normal. The device with the display screen compares the image frames obtained from the first content or the second content with the image template. When the similarity is higher than a preset threshold value, the image frame is indicated to belong to a normal image; and when the similarity is equal to or lower than a preset threshold value, indicating that the image frame belongs to an abnormal image.

When the device with the display screen identifies the abnormal image, the device with the abnormal image is recorded, and the time when the abnormal image is displayed is recorded.

In another way of identifying an anomalous image, the application to which the anomalous image belongs does not belong to the whitelist application list. In an examination scenario, a device having a display screen may maintain a white list of applications into which application identifiers associated with a local examination are to be listed. When the examinee uses the application related to the examination, the identifier of the application to which the first content or the second content belongs to the white list application list. If the examinee uses other applications, the examinee can be grabbed by a device with a display screen for the first time. It should be noted that each image frame in the first content or the second content acquired by the device with the display screen corresponds to the identifier of the application to which the image frame belongs.

For example, applications that belong to the whitelist application list include an a-test application and a B-calculator application. When the device with the display screen recognizes that the application to which one image frame belongs is neither the a-test application nor the B-calculator application in the first content, it is determined that the first content is content including an abnormal image.

Optionally, the device with the display screen may continue to perform step 822 in addition to step 821.

Step 822, highlighting the content including the abnormal image, wherein the highlighting includes at least one of highlighting, displaying a preset mark or displaying a preset text.

In the embodiment of the application, the device with the display screen can highlight the content comprising the abnormal image in order to remind the examiner of the abnormal condition. For example, the first content in the first device includes an anomalous image, and the device having the display screen highlights the first content when displaying the first content. Alternative highlighting means include, but are not limited to, highlighting the area, or attaching a predetermined mark to the first content, or attaching predetermined text to the first content. The embodiment of the present application does not limit the specific manner of highlighting.

Step 830, sending a lock signal to the device with the abnormal image, wherein the lock signal is used for instructing the device with the abnormal image to stop receiving the input signal.

In this case, the device having the display screen is also capable of transmitting a lock signal to the device in which the abnormal image occurs, so that the device in which the abnormal image occurs cannot receive the input signal any more by the lock signal. Through the design, the corresponding examination equipment can be directly locked when the abnormality occurs in other equipment for invigilation, so that the abnormal phenomenon of the examination is strictly handled, paperless examination is performed by the equipment for daily use of the user, and the effect of strictly invigilating can be received.

To sum up, the method provided by the embodiment of the application can be applied to invigilating scenes of paperless examinations, can realize the effect that examinees use mobile devices used daily by themselves to take part in the examinations, can realize a strict invigilating effect, reduces the cost for building paperless examination rooms, and ensures the strict invigilating effect of the examinations.

In the embodiment of the present application, in addition to the device having a display screen capable of simultaneously displaying the first content and the second content, the device having a display screen is capable of controlling the content displayed by the device having a display screen, and details can refer to the embodiment shown in fig. 9.

Referring to fig. 9, fig. 9 is a flowchart of a cross-device content screen projection method according to an embodiment of the present disclosure. The method may be applied in a device having a display screen as shown in fig. 1. In fig. 9, the method comprises:

step 911, receiving a first content screen projection request sent by a first device.

Step 912, in response to the first character string in the first content screen-casting request matching the character string template, playing the first content.

And step 913, receiving a second content screen projection request sent by the second device.

And step 914, responding to the matching of the second character string in the second content screen projection request and the character string template, and simultaneously playing the first content and the second content.

In this embodiment, the execution process of steps 911 to 914 may refer to the execution process of steps 410 to 440, which is not described herein again.

Step 921, receiving local area information.

Wherein the local area information is used to indicate information of one local area in the first device or information of one local area in the second device.

And step 922, responding to the local area information, and amplifying the area corresponding to the local area information by k times.

Wherein k is greater than 1. The device with the display screen can enable the user to observe the area concerned by the user more easily by amplifying the area corresponding to the local area information.

Step 923, the area corresponding to the local area information which is magnified by k times is displayed in the display area corresponding to the local area information.

In the embodiment of the application, the device with the display screen can display the local area in the first content in an enlarged mode under the control of a user. In one possible approach, the local area information is information that the first device sends to the device having the display screen. In another possible way, the local area information is information sent by a remote control device corresponding to the device having the display screen.

When the device with the display screen acquires the local area information, the device with the display screen determines an area corresponding to the local area information. Then, the image originally displayed in the area is displayed at a magnification of k times. And if the display area corresponding to the local area information is the first display area, the equipment with the display screen displays the area corresponding to the local area information which is magnified by k times in the first display area. And if the display area corresponding to the local area information is the second display area, the equipment with the display screen displays the area corresponding to the local area information which is magnified by k times in the second display area.

Referring to fig. 10, fig. 10 is a schematic display diagram of an apparatus having a display screen provided based on the embodiment shown in fig. 9. In fig. 10, a device 111 having a display screen includes a first display area 210 and a second display area 220 therein. A first partial display area 211 is included in the first display area 210. The local area information indicates the first local display area 211. Subsequently, the device 111 having a display screen displays the image enlarged by k times in the second partial display area 212.

For example, a small map in the originally displayed first content in the partial display area 211, a device with a display screen may display the small map in the area further enlarged so that the user can see details in more detail for the content of interest.

Alternatively, the device having the display screen can display the corresponding partial area of the second content at a magnification of k times. For example, if the second content is the same as the first content and a game interface is also displayed, the device with the display screen is provided with an area display that places the minimap in the first content and the minimap in the first device close together, so that the user can compare the determined parts of the first content and the second content directly from the device with the display screen.

Step 931, performing image recognition on the first content to obtain a first text matched with the preset keyword.

Step 932, performing image recognition on the second content to obtain a second text matched with the preset keyword.

Step 933, comparing and displaying the first text and the second text.

In the application, the device with the display screen can perform image recognition on the first content and the second content and acquire text information in the first content and the second content. When the text information is matched with the preset key, the device with the display screen compares the first text with the second text for displaying. The preset keywords are keywords set in equipment with a display screen. In one form of display, the first text is displayed in a first display area and the second text is displayed in a second display area, the distance between the first text and the second text being less than a fifth threshold. Optionally, the first text and the second text are displayed in a contrasting area, the contrasting area being an area spanning the first display area and the second display area.

Illustratively, the partitioning algorithm for the first text and the second text is the same. For example, if the first text is a sentence, the second text is also a sentence. If the first text is a paragraph, the second text is also a paragraph.

For example, if the first content is a shopping page for merchandise a in shopping application S2, the second content is a shopping page for merchandise a in shopping application S3. Wherein the preset keyword is "actual price". The first text extracted in the first content by the device with the display screen is "actual price: 224 yuan, while the second text extracted by the first device in the second content is "actual price: 206 yuan. The device having the display screen then displays the first text and the second text simultaneously at a location where the first display area borders the second display area so that the user can directly compare to the information of most interest.

Referring to fig. 11, fig. 11 is a schematic view of a display interface of a device with a display screen provided based on the embodiment shown in fig. 9. In fig. 11, the display area of the device 111 having a display screen includes a first display area 210 and a second display area 220. A first contrast display area 213 is included in the first display area 210, and a second contrast display area 221 is included in the second display area 220. The device 111 having a display screen may display the extracted first text 11A in the first content in the first contrast display area 213, and the device 111 having a display screen may display the extracted second text 11B in the second content in the second contrast display area 221, so that the user can visually compare portions of the first content and the second content, which the user is interested in.

The first content and the second content shown in fig. 11 are each a product of basketball, and the extracted information includes a price, a sales volume, and a name of a business to which the content belongs. Optionally, the device with the display may also highlight lower priced text.

Step 941, receive a first commodity extraction command sent by the first device.

Wherein the first commodity extracting command is used for extracting the commodity specified in the first content.

In step 942, in response to the first commodity extracting command, the corresponding first commodity is extracted and stored.

Step 943, receiving a second commodity extracting command sent by the second device.

Wherein the second commodity extracting command is used for extracting the commodity specified in the second content.

In step 944, in response to the second commodity extraction command, the corresponding second commodity is extracted and stored.

Step 945, receiving the summarizing instruction, and sending the stored first commodity and the stored second commodity to the device sending the summarizing instruction.

The device sending the summarizing instruction is the first device or the second device.

In the embodiment of the application, the first device and the second device can respectively select the commodities to be extracted from the contents which are projected to the device with the display screen. Wherein the goods may be text, images or links.

Optionally, the first item and the second item are the same type of item, the type being the target type.

Illustratively, the method and the device can extract objects such as scenic spots, commodities, restaurants, shopping malls, stars, movie names, concerts or pages and the like besides the commodities.

It should be noted that after the device with the display screen extracts and stores the corresponding object, the corresponding policy may be executed according to different object types. For example, when the target type is an attraction, a device having a display screen automatically generates a travel route and transmits the travel route to the first device or the second device.

For another example, when the target type is a commodity, the device having the display screen automatically compares the lowest-priced commodities among the commodities that have been extracted, and transmits a purchase addition instruction for instructing to add the commodity to a shopping cart in the shopping application to the first device or the second device.

In summary, in the embodiment of the present application, the device having the display screen can enlarge the content that needs to be enlarged simultaneously in the first content and the second content that have been displayed by screen projection, and the capability of effectively displaying the area focused by the user is realized.

Optionally, the device with the display screen can also perform image recognition on the first content and the second content, and texts matched with preset keywords are included in the first content and the second content and displayed together in a close-fitting manner, so that difficulty in comparison of important focused information in the two contents by a user is reduced, and efficiency in comparison of contents displayed in a plurality of other devices in the device with the display screen is improved.

Optionally, the device with the display screen may further extract and store corresponding objects respectively under the control of the first device and the second device, where the first device and the second device may both select an object in their respective devices, and finally, in one of the devices where the selected objects may be summarized, the capability that multiple devices may complete common object selection in a scene where the device with the display screen displays references is achieved.

The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.

Referring to fig. 12, fig. 12 is a block diagram illustrating a cross-device content screen projection apparatus according to an exemplary embodiment of the present application. The cross-device content projection screen device can be implemented as all or part of a device with a display screen through software, hardware or a combination of the two. The device includes:

a first receiving module 1210, configured to receive a first content screen projection request sent by a first device, where the first content screen projection request is a request sent by the first device to the device with a display screen after performing a preset interactive operation;

a first playing module 1220, configured to play a first content in response to the first content screen projection request, where the first content is a content played in the first device;

a second receiving module 1230, configured to receive a second content screen-casting request sent by a second device, where the second content screen-casting request is a request sent by the second device to the device with a display screen after the second device performs the preset interactive operation;

a second playing module 1240, configured to respond to the second content screen projection request, and play the first content and the second content in a split screen mode, where the second content is a content played in the second device.

In an optional embodiment, the preset interactive operation related to the apparatus includes scanning a screen projection tag, where the screen projection tag is an electronic tag corresponding to the device with the display screen; or the preset interactive operation comprises shooting a preset gesture; or the preset interactive operation comprises shooting a preset action.

In an optional embodiment, the apparatus further includes a third receiving module and a screen splitting module, where the third receiving module is configured to receive a screen splitting instruction; the screen splitting module is used for responding to the screen splitting instruction and entering the screen splitting mode, and the display screen of the equipment with the display screen at least comprises a first display area and a second display area in the screen splitting mode; the first display area is used for displaying the first content, and the second display area is used for displaying the second content.

In an optional embodiment, the second playing module 1240 is configured to obtain the split screen information in response to the second content screen projection request; and responding to that the split screen information meets a preset condition, entering the split screen mode, wherein the display screen of the equipment with the display screen at least comprises a first display area and a second display area in the split screen mode, playing the first content in the first display area, and playing the second content in the second display area.

In an optional embodiment, the second playing module 1240 is configured to, in response to the second content screen projection request, obtain a reference duration between the screen projection time of the first device and the screen projection time of the second device; in response to the reference duration being less than a first threshold, playing the first content in the first display area and playing the second content in the second display area.

In an optional embodiment, the second playing module 1240 is configured to obtain, in response to the second content screen-projecting request, historical screen-projecting information of the second device, where the historical screen-projecting information includes at least one of screen-projecting times or accumulated screen-projecting duration of the second device that successfully projects a screen to the device with a display screen; in response to the number of screen shots being greater than or equal to a second threshold, playing the first content in the first display area and playing the second content in the second display area; or responding to that the accumulated screen-casting duration is greater than or equal to a third threshold value, playing the first content in the first display area, and playing the second content in the second display area.

In an optional embodiment, the second playing module 1240 is configured to, in response to the second content screen projection request, obtain first image information in the first content according to a preset policy, and obtain second image information in the second content according to the preset policy; in response to a similarity between the first image information and the second image information being greater than or equal to a fourth threshold, playing the first content in the first display area and playing the second content in the second display area.

In an optional embodiment, the second playing module 1240 is configured to, in response to the second content screen projection request, obtain a first content identifier corresponding to the first content and a second content identifier corresponding to the second content; in response to the first content identification and the second content identification matching, playing the first content in the first display area and playing the second content in the second display area.

In an optional embodiment, the apparatus further comprises a button display module for displaying a split screen button in response to the second content screen projection request; the second playing module 1240 is configured to enter the split screen mode in response to the split screen button being triggered, where the display screen of the device having the display screen includes at least a first display area and a second display area in the split screen mode.

In an optional embodiment, the apparatus further includes an exception recording module and a highlighting module, where the exception recording module is configured to record, in response to an exception image included in the first content and/or the second content, the exception image and a time at which the exception image is displayed, where an application to which the exception image belongs does not belong to a whitelist application list; the highlighting module is used for highlighting the content comprising the abnormal image, and the highlighting mode comprises at least one of highlighting, displaying a preset mark or displaying a preset text.

In an optional embodiment, the apparatus further includes a device locking module, configured to send a lock signal to a device where the abnormal image occurs, where the lock signal is configured to instruct the device where the abnormal image occurs to stop receiving an input signal.

In an optional embodiment, the apparatus further includes a fourth receiving module, a partial enlarging module and a partial displaying module, where the fourth receiving module is configured to receive partial area information, and the partial area information is used to indicate information of one partial area in the first device or information of one partial area in the second device; the local amplification module is used for responding to the local area information and amplifying an area corresponding to the local area information by k times, wherein k is larger than 1; the local display module is configured to display, in a display area corresponding to the local area information, an area corresponding to the local area information that is enlarged by k times, where when the local area information is used to indicate one local area in the first content, the display area corresponding to the local area information is a first display area; when the local area information is used for indicating a local area in the second content, the display area corresponding to the local area information is the second display area.

In an optional embodiment, the apparatus further includes a first recognition module, a second recognition module, and an attachment display module, where the first recognition module is configured to perform image recognition on the first content to obtain a first text matching a preset keyword, where the preset keyword is a keyword set in the device with the display screen; the second identification module is used for carrying out image identification on the second content to obtain a second text matched with the preset keyword; and the comparison display module is used for comparing and displaying the first text and the second text.

In an optional embodiment, the apparatus further comprises a fifth receiving module, a first processing module, a sixth receiving module, a second processing module, and a third processing module; the fifth receiving module is configured to receive a first commodity extraction command sent by the first device, where the first commodity extraction command is used to extract a commodity specified in the first content; the first processing module is used for responding to a first object extraction command, and extracting and storing a corresponding first commodity; the sixth receiving module is configured to receive a second commodity extraction command sent by the second device, where the second commodity extraction command is used to extract a commodity specified in the second content; the second processing module is used for responding to the second commodity extraction command, and extracting and storing the corresponding second commodity; the third processing module is used for receiving a summary instruction, and sending the stored first commodity and the stored second commodity to the equipment sending the summary instruction, wherein the equipment sending the summary instruction is the first equipment or the second equipment.

In an optional embodiment, the first article and the second article involved in the apparatus are articles belonging to the same shopping application, and the summary instruction includes an identifier of the shopping application corresponding to both the first article and the second article.

In summary, in the content screen-projecting device across devices provided in this embodiment, the device with the display screen can successively receive the content screen-projecting requests sent by the first device and the second device, and continue to play the first content in the first device in the device with the display screen, and continue to play the second content in the second device in the device with the display screen. The first device and the second device acquire the corresponding character strings through the radio frequency tags in the binding relation with the devices with the display screens, and when the character strings are matched with the built-in character string templates, the devices with the display screens play corresponding contents, so that the capability of displaying the contents of screen projection of a plurality of devices simultaneously under the condition of less operation of the devices with the display screens is improved, and the screen projection efficiency of the devices is improved.

Referring to fig. 13, fig. 13 is a block diagram illustrating a device with a display screen according to an exemplary embodiment of the present application, and as shown in fig. 13, the device with a display screen includes a processor 1320, a memory 1340, a communication component 1360 and a display screen 1380, where the memory 1340 stores at least one instruction, and the instruction is loaded and executed by the processor 1320 to implement a cross-device content screen projection method according to various method embodiments of the present application.

In this application, the device 1300 having a display screen is an electronic device having a display function. The method comprises the steps that a device 1300 with a display screen receives a first content screen projection request sent by a first device, wherein the first content screen projection request is used for continuing playing first content in the device with the display screen, and the first content is the content played in the first device; responding to matching of a first character string in the first content screen projection request and a character string template, and playing the first content, wherein the first character string is information read by the first equipment from a screen projection tag, and the screen projection tag and the equipment with the display screen have a binding relationship; receiving a second content screen projection request sent by a second device, wherein the second content screen projection request is used for continuing playing second content in the device with the display screen, and the second content is the content played in the second device; and responding to matching of a second character string in the second content screen projection request and a character string template, and simultaneously playing the first content and the second content, wherein the second character string is information read from the screen projection tag by the second equipment.

Processor 1320 may include one or more processing cores. The processor 1320 connects various portions throughout the device 1300 having a display screen using various interfaces and lines, and performs various functions of the device 1300 having a display screen and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 1340, and calling data stored in the memory 1340. Alternatively, the processor 1320 may be implemented in at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). Processor 1320 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen; the modem is used to handle wireless communications. It is to be appreciated that the modem may not be integrated into the processor 1320 and may be implemented on a single chip.

Memory 1340 may include Random Access Memory (RAM) or Read-Only Memory (ROM). Optionally, the memory 1340 includes non-transitory computer-readable media. The memory 1340 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 1340 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like; the storage data area may store data and the like referred to in the following respective method embodiments.

The communication component 1360 is configured to establish a communication connection with other devices through a specified communication protocol, where the communication connection includes WiFi, bluetooth, ZigBee, and other communication protocols, and the communication protocol is not limited in this embodiment of the application. The communication component 1360 of the device 1300 having a display screen may be used to establish communication connections with multiple devices simultaneously.

The display 1380 is used to display images rendered by the processor. Alternatively, when the device having the display screen is a large-screen display device such as a television, the display screen 1380 may be a large-sized television screen. The television screen may be 30 inches, 32 inches, 34 inches, 40 inches, 42 inches, 48 inches, 55 inches, 60 inches, 65 inches, or 100 inches, etc. In other possible implementations, if the device having the display screen is a computer display or the like, the display screen 1380 may be implemented in 18 inches, 20 inches, 22 inches, 24 inches, or 32 inches, etc. dimensions.

The embodiment of the present application further provides a computer-readable medium, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the cross-device content screen projection method according to the above embodiments.

It should be noted that: in the above-described embodiment, when the cross-device content screen projection apparatus executes the cross-device content screen projection method, only the division of the functional modules is illustrated, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the functions described above. In addition, the cross-device content screen projection device provided by the above embodiment and the cross-device content screen projection method embodiment belong to the same concept, and specific implementation processes thereof are detailed in the method embodiment and are not described herein again.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only exemplary of the implementation of the present application and is not intended to limit the present application, and any modifications, equivalents, improvements, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A cross-device content screen projection method is applied to a device with a display screen, and comprises the following steps:

2. The method of claim 1,

the preset interactive operation comprises scanning a screen projection tag, wherein the screen projection tag is an electronic tag corresponding to the equipment with the display screen;

or the like, or, alternatively,

the preset interactive operation comprises shooting a preset gesture;

or the like, or, alternatively,

the preset interactive operation comprises shooting a preset action.

3. The method of claim 1 or 2, wherein before receiving the first content screen-casting request sent by the first device, the method further comprises:

receiving a screen splitting instruction;

entering the split screen mode in response to the split screen instruction, wherein the display screen of the device with the display screen at least comprises a first display area and a second display area in the split screen mode;

the first display area is used for displaying the first content, and the second display area is used for displaying the second content.

4. The method according to claim 1 or 2, wherein the playing the first content and the second content in a split screen mode in response to the second content screen-casting request comprises:

responding to the second content screen projection request, and acquiring screen splitting information;

responding to that the split screen information meets a preset condition, entering a split screen mode, wherein a display screen of the equipment with the display screen at least comprises a first display area and a second display area in the split screen mode;

playing the first content in the first display area and playing the second content in the second display area.

5. The method of claim 4, wherein the obtaining split screen information in response to the second content screen projection request comprises:

responding to the second content screen projection request, and acquiring reference time length between the screen projection time of the first equipment and the screen projection time of the second equipment;

and entering the split screen mode in response to the fact that the split screen information meets a preset condition, wherein the step of entering the split screen mode comprises the following steps:

and responding to the condition that the reference duration is smaller than a first threshold value, and entering the split screen mode.

6. The method of claim 4, wherein the obtaining split screen information in response to the second content screen projection request comprises:

responding to the second content screen projection request, and acquiring historical screen projection information of the second equipment, wherein the historical screen projection information comprises at least one of screen projection times or screen projection accumulated duration of the second equipment to the first equipment successfully;

entering the split screen mode in response to the screen-casting times being greater than or equal to a second threshold;

or the like, or, alternatively,

and responding to the fact that the screen projection accumulated duration is larger than or equal to a third threshold value, and entering the screen splitting mode.

7. The method of claim 4, wherein the obtaining split screen information in response to the second content screen projection request comprises:

responding to the second content screen projection request, acquiring first image information in the first content, and acquiring second image information in the second content;

entering the split screen mode in response to a similarity between the first image information and the second image information being greater than or equal to a fourth threshold.

8. The method of claim 4, wherein the obtaining split screen information in response to the second content screen projection request comprises:

responding to the second content screen projection request, and acquiring a first content identifier corresponding to the first content and a second content identifier corresponding to the second content;

and entering the split screen mode in response to the first content identification and the second content identification matching.

9. The method of claim 1 or 2, wherein after the receiving of the second content screen-casting request sent by the second device, the method further comprises:

displaying a split screen button in response to the second content screen-casting request;

entering the split screen mode in response to the split screen button being triggered, the display screen of the device having a display screen including at least a first display area and a second display area in the split screen mode.

10. The method according to claim 1 or 2, characterized in that the method further comprises:

responding to the first content and/or the second content including abnormal images, recording the abnormal images and the display time of the abnormal images, wherein the application to which the abnormal images belong does not belong to a white list application list;

and highlighting the content comprising the abnormal image, wherein the highlighting mode comprises at least one of highlighting, displaying a preset mark or displaying a preset text.

11. The method of claim 10, further comprising:

and sending a locking signal to the equipment with the abnormal image, wherein the locking signal is used for indicating the equipment with the abnormal image to stop receiving input signals.

12. The method according to claim 1 or 2, wherein after the playing the first content and the second content in the split screen mode, the method further comprises:

receiving local area information indicating a local area in the first content or a local area in the second content;

in response to the local area information, amplifying the area indicated by the local area information by k times, wherein k is larger than 1;

displaying an area corresponding to the local area information after being amplified by k times in a display area corresponding to the local area information;

when the local area information is used for indicating a local area in the first content, the display area corresponding to the local area information is a first display area; when the local area information is used for indicating a local area in the second content, the display area corresponding to the local area information is the second display area.

13. The method of claim 1, further comprising:

performing image recognition on the first content to obtain a first text matched with a preset keyword, wherein the preset keyword is a keyword set in the equipment with the display screen;

performing image recognition on the second content to obtain a second text matched with the preset keyword;

and comparing and displaying the first text and the second text.

14. The method of claim 13, further comprising;

receiving a first commodity extracting command sent by the first device, wherein the first commodity extracting command is used for extracting a commodity specified in the first content;

responding to a first object extraction command, extracting and storing a corresponding first commodity;

receiving a second commodity extracting command sent by the second equipment, wherein the second commodity extracting command is used for extracting a commodity specified in the second content;

responding to the second commodity extraction command, and extracting and storing the corresponding second commodity;

receiving a summary instruction, and sending the stored first commodity and the stored second commodity to a device sending the summary instruction, wherein the device sending the summary instruction is the first device or the second device.

15. The method of claim 14, wherein the first item and the second item are items belonging to the same shopping application, and the summary instruction includes an identifier of the shopping application to which the first item and the second item correspond.

16. A cross-device content screen projection device is applied to a device with a display screen, and comprises the following components:

17. An electronic device, comprising a processor, a memory coupled to the processor, and program instructions stored on the memory, which when executed by the processor, implement a cross-device content projection method as claimed in any one of claims 1 to 14.

18. A computer readable storage medium having stored thereon program instructions which, when executed by a processor, implement a cross-device content screen projection method according to any one of claims 1 to 14.

19. A cross-device content screen projection system is characterized by comprising a device with a display screen, a first device, at least one second device and a remote control device, wherein a screen projection label is arranged in the remote control device, and the remote control device is used for remotely controlling the device with the display screen;

20. A cross-device content screen projection system, the system comprising a device having a display screen, a first device comprising a first image capture component, and at least one second device comprising a second image capture component;