Disclosure of Invention
The embodiment of the invention provides a method and a device for controlling contents displayed on equipment, which are used for solving the problem of poor convenience in controlling the displayed contents in the prior art under the scene of synchronously displaying the contents displayed on a mobile terminal by using other equipment.
The method for controlling the content displayed on the equipment provided by the embodiment of the invention comprises the following steps:
a first device receives a control instruction aiming at first content, wherein the first content is synchronously presented on the first device according to second content presented on a second device;
and the first equipment controls the second content according to the control instruction.
Optionally, before the first device receives a control instruction for the first content, the method further includes:
the first device is connected with the second device;
the first device synchronously presents the first content according to the second content through the connection.
Optionally, the connecting of the first device and the second device specifically includes:
the first equipment is connected with the second equipment based on a mobile terminal high definition audio and video standard interface (MHL) protocol.
Optionally, the first device displays the first content through a touch screen;
the control instruction is issued through touch operation on the touch screen.
Optionally, the first content and the second content are the same content.
Optionally, after receiving a control instruction for the first content, the method further includes:
and the first equipment controls the first content according to the control instruction.
Optionally, the controlling, by the first device, the second content according to the control instruction specifically includes:
the first device controls the second content by sending the control instruction to the second device; or,
and the first equipment generates a control synchronization instruction suitable for the second equipment according to the control instruction, and controls the second content by sending the control synchronization instruction to the second equipment.
Optionally, the first device is a television, and the second device is a mobile terminal.
The device for controlling the content displayed on the equipment provided by the embodiment of the invention comprises:
the device comprises a receiving module, a display module and a control module, wherein the receiving module receives a control instruction aiming at first content, and the first content is synchronously displayed on first equipment according to second content displayed on second equipment;
and the control module is used for controlling the second content according to the control instruction.
Optionally, the apparatus further comprises:
and the synchronous display module is connected with the second equipment before the receiving module receives the control instruction aiming at the first content, and synchronously displays the first content according to the second content through the connection.
Optionally, the synchronous display module is connected to the second device, and specifically includes:
and the synchronous display module is based on a mobile terminal high-definition audio and video standard interface (MHL) protocol and is connected with the second equipment.
Optionally, the first device displays the first content through a touch screen;
the control instruction is issued through touch operation on the touch screen.
Optionally, the first content and the second content are the same content.
Optionally, after the receiving module receives a control instruction for a first content, the control module controls the first content according to the control instruction.
Optionally, the controlling module controls the second content according to the control instruction, and specifically includes:
the control module controls the second content by sending the control instruction to the second device; or,
and the control module generates a control synchronization instruction suitable for the second equipment according to the control instruction, and controls the second content by sending the control synchronization instruction to the second equipment.
Optionally, the first device is a television, and the second device is a mobile terminal.
In the method and the device for controlling the content displayed on the device, provided by the embodiment of the invention, under the scene that the content displayed on the mobile terminal is synchronously displayed by using other devices, the displayed content can be controlled by using the mobile terminal, and the displayed content can also be controlled by using the other devices.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart illustrating a method for controlling content displayed on a device according to an embodiment of the present invention.
From the perspective of the device, the execution subject of the flow may be any device (referred to as a first device in the present invention) that can synchronously present the content presented on a certain device (referred to as a second device in the present invention). The device may be a mobile device, such as a mobile phone, a tablet computer, a car machine, a notebook computer, a smart wearable device (e.g., a smart watch, a smart bracelet), etc.; the device may also be a non-mobile device such as a television, a Personal Computer (PC), a midrange computer, a cluster of computers, etc.
In the scenario mentioned in the background art, the second device is generally a mobile terminal such as a mobile phone, the first device is generally a non-mobile terminal such as a television, and further, the first device is generally a smart television.
From the viewpoint of the program, the execution subject of the flow may specifically be an application installed on the first device, an operating system of the first device, or the like.
The process in fig. 1 may include the following steps:
s101: the method comprises the steps that a first device receives a control instruction aiming at first content, wherein the first content is synchronously shown on the first device according to second content shown on a second device.
In the embodiment of the present invention, the first content and the second content may be the same content, such as a scene like a content projection or a screen projection; the first content and the second content may also be different in content, for example, the second content is synchronously enhanced, modified, linked, or skipped to obtain scenes such as the first content, and then the scenes are synchronously displayed on the first device, and for example, the first content is obtained by superimposing the second content on a basic television program, so that the television program and the second content are simultaneously displayed on the first device. Generally, the first content is at least partially restricted to the second content, and when the second content changes, the first content changes accordingly.
In the embodiment of the present invention, there are various specific embodiments to implement the "synchronous exhibition". Take the example that the first device is a television and the first content is the same as the second content.
When the second device is a Mobile phone or a tablet computer, the inter-device connection may be performed based on a Mobile High-Definition Link (MHL) protocol, so as to synchronously display the content displayed on the Mobile phone or the tablet computer on the television.
When the second device is a notebook computer, the inter-device connection may be performed based on a High Definition Multimedia Interface (HDMI) or a Video Graphics Array (VGA) Interface, so as to synchronously display the content displayed on the notebook computer on the television.
In practical applications, the connection between the devices can also be performed based on a wireless communication protocol such as Wi-Fi, bluetooth, and the like, so as to implement synchronous display of the device contents.
In the embodiment of the present invention, the control instruction is issued based on a user operating the first device, and a specific object of the operation is the first content displayed on the first device, so the control instruction is referred to as a "control instruction for the first content", and since the first content is synchronously displayed according to the second content, the control instruction is actually also for the second content.
Further, the present invention does not limit what kind of control action the control command specifically instructs to do, and may depend on what the user needs, and what the first content is specifically. For example, when the first content is a multimedia player application interface that is playing a movie, and the second content is a screen-shot content of the first content, assuming that the user wants to pause playing the movie, the play pause control instruction for the second content (the first content) can be reached by clicking a play pause button control in the second content that is presented. For another example, when the first content is a song order menu interface, and the second content is an MTV playing interface of a currently selected song on the song order menu interface, assuming that the user wants to switch to a next song, the song switching control instruction for the second content (the first content) can be reached by clicking a song switching button control in the displayed second content.
S102: and the first equipment controls the second content according to the control instruction.
In the prior art, for a scene of synchronously displaying the content of equipment such as a screen projection device, the content source equipment of the screen projection device cannot be reversely controlled by the synchronously displaying equipment of the screen projection device.
In the embodiment of the present invention, a user can control the second content displayed on the second device by operating only the first device (e.g., reaching a control instruction, etc.), that is, by controlling the second device by the first device, which is different from the control idea of the prior art in synchronously displaying the scenes of the device content.
Through the method in fig. 1, in a scenario where other devices are used to synchronously display the content displayed on the mobile terminal, not only the mobile terminal may be used to control the displayed content, but also the other devices may be used to control the displayed content, and for the latter, the other devices are equivalently used to counter control the mobile terminal, thereby providing more control mode options for the user, which is beneficial to improving the control convenience, and therefore, the problems in the prior art may be partially or completely solved.
Based on the method in fig. 1, the embodiments of the present invention also provide some specific embodiments of the method, and further embodiments, which are described below.
In this embodiment of the present invention, for step S101, before the first device receives the control instruction for the first content, the following steps may be further performed: the first device is connected with the second device; the first device synchronously presents the first content according to the second content through the connection. As can be seen from the foregoing description, the connection may be a wired connection or a wireless connection.
In addition, the invention does not limit which party initiates the connection process, and the connection process may be initiated by the first device or the second device.
In practical application, when a user is at home, the scenes in which the content is most frequently displayed synchronously are as follows: and synchronously displaying the contents displayed on the mobile phone on the television. This scenario is taken as an example for further explanation.
The mobile phone does not support commonly used interfaces on notebook computers such as HDMI and VGA, and content synchronous display is difficult to carry out originally, but some mobile phones already support MHL protocol at present, and based on the MHL protocol, content synchronous display from the mobile phone to a television can be realized. In this case, the connection between the first device and the second device may specifically include: and the first equipment is connected with the second equipment based on an MHL protocol.
In addition, it should be noted that the synchronous display mode based on the MHL protocol generally requires corresponding cable support, for example, a cable with an MHL-to-HDML conversion head. However, this is not absolute, and a synchronous display mode based on the MHL protocol can also be implemented through wireless communication, for example, the conversion head is integrated on the first device or the second device, and wireless transmission is performed after conversion on the device, so that synchronous display of the device content can be implemented.
In the embodiment of the present invention, it has been mentioned above that the control instruction is issued based on the operation of the first device by the user. How the first device operates in detail may also be done in a number of ways, typically depending on what the first device is. For example, if the first device has a touch screen and displays the first content through the touch screen, the user may issue a control instruction for the first content by performing a touch operation on the touch screen. For another example, if the first device is equipped with a remote controller or a peripheral such as a mouse, the user may issue a control command through the remote controller or the mouse.
In this embodiment of the present invention, as for step S102, the controlling, by the first device, the second content according to the control instruction may specifically include: the first device controls the second content by sending the control instruction to the second device; or the first device generates a control synchronization instruction suitable for the second device according to the control instruction, and controls the second content by sending the control synchronization instruction to the second device. For ease of understanding, these two modes are illustrated separately.
For example, with the former method, signals transmitted between the first device and the second device generally do not need to be converted, and compatibility is better. For example, devices produced by the same device manufacturer, or applications corresponding to the displayed content on the devices are provided by the same service provider, and so on. In this case, the former approach is actually to relay the control command to implement the control of the second content.
For another example, with the latter approach, the signals transmitted between the first device and the second device typically need to be converted. Taking a television and a mobile phone with a touch screen as an example, based on an MHL protocol, content displayed on the mobile phone is synchronously displayed on the television, a user can perform touch operation on the content displayed on the television, and a touch instruction issued by the touch operation is a control instruction in step S101, so that the control instruction can be converted by the television based on the MHL protocol or other protocols that can be used for converting the control instruction to generate a control synchronization instruction, which is equivalent to a touch instruction issued by performing corresponding touch operation on content at a corresponding position on the mobile phone (from the perspective of the user, equivalent to performing touch operation on the television by the user, correspondingly performing simulation on the mobile phone, and having the same effect as performing touch operation on the mobile phone by the user).
In this embodiment of the present invention, for step S101, after receiving the control instruction for the first content, the following may be further performed: and the first equipment controls the first content according to the control instruction. It should be noted that, in the scenes such as screen projection or projection, the first content is actually a mirror image of the second content, the contents are completely the same, and the first content automatically changes completely the same with the change of the second content, so that in these scenes, the optional step in this segment may not be executed, because, when step S102 is executed, the first content also changes along with the control of the second content, and there is no need to additionally control the first content.
The method for controlling the content displayed on the device according to the embodiment of the present invention is described above, and for convenience of understanding, the embodiment of the present invention further provides a specific implementation flow diagram of the method in fig. 1 in an actual application scenario (a scenario of a television and a mobile phone with a touch screen), as shown in fig. 2.
The flow in fig. 2 may include the following steps:
s201: the mobile phone is connected with the television, and the connection is based on MHL protocol.
S202: and the television synchronously displays the contents displayed on the mobile phone through the connection.
S203: and the user performs touch operation on the content synchronously displayed on the television through the touch screen of the television, and then reaches a control instruction aiming at the content.
S204: and the television converts the received control instruction into a control synchronization instruction suitable for the mobile phone according to the MHL protocol, wherein the control synchronization instruction simulates the corresponding touch operation of the user on the corresponding content on the mobile phone.
S205: the television sends the control synchronization instruction to the mobile phone to control the corresponding content displayed on the mobile phone.
Further, the embodiment of the present invention also provides some effect schematic diagrams corresponding to fig. 2, as shown in fig. 3a to fig. 3 c.
Fig. 3a is a first effect diagram corresponding to fig. 2 in an actual application scenario provided by the embodiment of the present invention. In fig. 3a, the mobile phone is the second device (i.e., the content source device), the television is the first device (i.e., the synchronous display device), the mobile phone is connected to the television, the current mobile phone displays its desktop, 8 applications, 1 to 8, are on the desktop, and accordingly, the television also displays the desktop of the mobile phone synchronously.
Fig. 3b is an effect diagram two corresponding to fig. 2 in an actual application scenario provided by the embodiment of the present invention. In fig. 3b, it is assumed that the application 8 is a multimedia player application, and the user currently wants to start the application 8, for this purpose, in the prior art, the user can only click on the application 8 displayed on the mobile phone, while in the solution of the present invention, the user can directly click on the application 8 synchronously displayed on the television, as shown in fig. 3 b.
Fig. 3c is a third effect diagram corresponding to fig. 2 in an actual application scenario provided by the embodiment of the present invention. Fig. 3c is a schematic diagram of the application 8 displayed on the tv synchronously clicked by the user, and it can be seen that, no matter on the tv or the mobile phone, the application 8 has been started normally and displays the corresponding multimedia player interface, that is, the back control of the content original device mobile phone by the tv of the synchronous display device is realized.
Based on the same idea, the above method for controlling content displayed on a device provided in the embodiment of the present invention further provides a corresponding apparatus, as shown in fig. 4.
Fig. 4 is a schematic structural diagram of an apparatus for controlling content displayed on a device in fig. 1 according to an embodiment of the present invention, where the apparatus is located on a first device, and the apparatus includes:
a receiving module 401, receiving a control instruction for a first content, wherein the first content is synchronously presented on a first device according to a second content presented on a second device;
the control module 402 controls the second content according to the control instruction.
Optionally, the apparatus further comprises:
and a synchronous display module 403, configured to connect to the second device before the receiving module receives the control instruction for the first content, and synchronously display the first content according to the second content through the connection.
Optionally, the synchronous display module 403 is connected to the second device, and specifically includes:
the synchronous display module 403 is connected with the second device based on a mobile terminal high definition audio and video standard interface MHL protocol.
Optionally, the first device displays the first content through a touch screen;
the control instruction is issued through touch operation on the touch screen.
Optionally, the first content and the second content are the same content.
Optionally, after the receiving module receives a control instruction for a first content, the control module 402 controls the first content according to the control instruction.
Optionally, the controlling module 402 controls the second content according to the control instruction, specifically including:
the control module 402 controls the second content by sending the control instruction to the second device; or,
the control module 402 generates a control synchronization instruction suitable for the second device according to the control instruction, and controls the second content by sending the control synchronization instruction to the second device.
Optionally, the first device is a television, and the second device is a mobile terminal.
According to the device for controlling the content displayed on the equipment, provided by the embodiment of the invention, under the scene that the content displayed on the mobile terminal is synchronously displayed by using other equipment, the displayed content can be controlled by using the mobile terminal, and the displayed content can also be controlled by using the other equipment.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.