CN116048341A - Multi-screen cooperation method and electronic equipment - Google Patents

Abstract

The embodiment of the present application provides a multi-screen collaboration method and electronic equipment, which can make the display interface of the coordination terminal display the window of the coordinated terminal without blocking each other with other windows in the display interface, so that the interaction between the user and each window More convenient and better user experience. The method is applied to the coordinating terminal, and the display interface of the coordinating terminal includes a first window, and the first window is used to display the display interface of the coordinated terminal. The method includes: displaying a manipulation interface in response to a first operation on a first control in the first window. The manipulation interface includes at least one mark, and each mark corresponds to a different area in the display area of the coordination terminal. In response to the second operation on the first mark in the manipulation interface, the first window is moved to the first area corresponding to the first mark, and the display interface of the coordination terminal is moved to an area other than the first area. Wherein, the first mark is any mark in the manipulation interface.

Description

A multi-screen collaboration method and electronic device

technical field

The embodiments of the present application relate to the field of data interaction, and in particular to a multi-screen collaboration method and electronic equipment.

Background technique

Multi-screen collaboration is a way of interaction between different electronic devices. Exemplarily, after the electronic device 1 and the electronic device 2 establish multi-screen coordination, a window will appear on the display interface of the electronic device 2, and the content displayed on the display interface of the electronic device 1 can be displayed in the window. Electronic device 2 can interact with electronic device 1 in response to input directed to the window. For example, electronic device 2 may send an instruction to electronic device 1 to open the folder in response to a double-click operation on the folder in the window. Correspondingly, the electronic device 1 may open the folder in response to the instruction.

It can be seen that the objects of multi-screen collaboration are at least two electronic devices, and the electronic device that displays windows of other electronic devices on the display interface can be called a collaboration terminal, and the electronic device that displays windows on the display interface of other electronic devices can be called an electronic device. as the coordinated end.

In practical applications, when the window of the coordinated terminal is displayed on the display interface of the coordinated terminal, other content in the displayed interface of the coordinated terminal is often blocked, affecting user operations, resulting in a relatively general user experience.

Contents of the invention

The embodiment of the present application provides a multi-screen collaboration method and electronic equipment, which can make the display interface of the coordination terminal display the window of the coordinated terminal without blocking each other with other windows in the display interface, so that the interaction between the user and each window is more convenient. Convenient and better user experience.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions.

In a first aspect, a multi-screen collaboration method is provided, which is applied to a coordinating terminal. The display interface of the coordinating terminal includes a first window, and the first window is used to display the display interface of the coordinated terminal. The method includes: displaying a manipulation interface in response to a first operation on a first control in the first window. The manipulation interface includes at least one mark, and each mark corresponds to a different area in the display area of the coordination terminal. The display area of the coordination terminal is the area displayed by the display screen of the coordination terminal. In response to the second operation on the first mark in the manipulation interface, the first window is moved to the first area corresponding to the first mark, and the display interface of the coordination terminal is moved to an area other than the first area. Wherein, the first mark is any mark in the manipulation interface.

Based on this solution, after the display interface is moved to an area other than the first area, the original windows in the display interface will not block the first window. If the user opens other windows in the collaborative terminal, these newly opened windows will only be displayed in the area where the display interface is located, and will not block the first window. Thus, the interaction between the user and each window is more convenient, and the user experience is better.

In a possible design, the method further includes: when the horizontal length of the first area is greater than the vertical length, sending a first instruction to the coordinated end, the first instruction is used to indicate that the coordinated end will be horizontally screened by the coordinated end's display interface show. Based on this solution, the shape of the first window can be made to better fit the first area, and the visibility of the first window can be improved.

In a possible design, the manipulation interface includes four marks, which are respectively the second mark, the third mark, the fourth mark and the fifth mark. Taking the center of the display area of the coordination terminal as the reference point, the second mark is located above the reference point, the third mark is located below the reference point, the fourth mark is located on the left of the reference point, and the fifth mark is located on the right of the reference point. Based on this solution, it is convenient for the user to know the position of each marker more intuitively.

In a possible design, the display area of the coordination terminal includes a second area, a third area, a fourth area and a fifth area. The second area is located above the reference point, the third area is located below the reference point, the fourth area is located to the left of the reference point, and the fifth area is located to the right of the reference point. The second mark corresponds to the second area, the third mark corresponds to the third area, the fourth mark corresponds to the fourth area, and the fifth mark corresponds to the fifth area. Based on this solution, it is convenient for the user to know the area corresponding to each mark according to the position of each mark.

In one possible design, the markers are rectangular blocks or arrows. Based on this scheme, it may be convenient for the user to more intuitively know the area corresponding to each mark.

In a possible design, both the first operation and the second operation are mouse pointer operations. In response to the second operation on the first mark in the manipulation interface, moving the first window to the first area corresponding to the first mark, and moving the display interface of the coordination terminal to the front of an area other than the first area, the method further includes : In response to the mouse pointer moving to the first marker, set the first marker to a first color, and display the border of the first area. And/or in response to the mouse pointer moving to the first marker, highlighting the first marker and displaying a border of the first area. Based on this scheme, it is convenient for the user to more intuitively know the area corresponding to the marker where the pointer is currently located.

In a possible design, the first operation is any one of the following: click, double click, long press, and single click. The second operation is any one of the following: click, double click, long press, single click. Based on this solution, the user can conveniently input instructions to the coordination terminal through the above operations.

In a possible design, in response to the first operation on the first control in the first window, displaying the manipulation interface includes: in response to the click operation on the first window, setting the first window to a selected state. In response to the first operation on the first control, a manipulation interface is displayed. Based on this scheme, the accuracy of operation can be improved.

In a second aspect, an electronic device is provided, and the electronic device includes one or more processors and one or more memories. One or more memories are coupled to the one or more processors, and the one or more memories store computer programs. When one or more processors execute the computer program, the electronic device is made to execute the multi-screen coordination method according to the first aspect.

In a third aspect, a computer-readable storage medium is provided, the computer-readable storage medium includes a computer program, and when the computer instructs the program, the multi-screen collaboration method according to the first aspect is executed.

In a fourth aspect, a computer program product is provided, the computer program product includes instructions, and when the computer program product is run on a computer, the computer can execute the multi-screen collaboration method according to the first aspect according to the instructions.

It should be understood that the technical features of the technical solutions provided by the second aspect, the third aspect, and the fourth aspect can all correspond to the multi-screen collaboration method provided in the first aspect and its possible design, so the beneficial The effects are similar and will not be repeated here.

Description of drawings

FIG. 1 is a schematic diagram of a multi-screen collaborative establishment process between a computer and a mobile phone;

FIG. 2 is a schematic diagram of multi-screen collaboration between a computer and a mobile phone;

FIG. 3 is another schematic diagram of multi-screen collaboration between a computer and a mobile phone;

FIG. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

FIG. 5 is a flow chart of a multi-screen collaboration method provided by an embodiment of the present application;

FIG. 6 is a schematic diagram of a display interface of a computer provided in an embodiment of the present application;

FIG. 7 is a schematic diagram of another computer display interface provided by the embodiment of the present application;

FIG. 8 is a schematic diagram of a manipulation interface provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of another manipulation interface provided by the embodiment of the present application;

FIG. 10 is a schematic diagram of a display area of a cooperative terminal display screen provided by an embodiment of the present application;

Fig. 11 is a schematic diagram of another manipulation interface provided by the embodiment of the present application;

Fig. 12 is a schematic diagram of another control interface provided by the embodiment of the present application;

Fig. 13 is a schematic diagram of the display area of another cooperative display screen provided by the embodiment of the present application;

Fig. 14 is a schematic diagram of the display area of another cooperative display screen provided by the embodiment of the present application;

Fig. 15 is a schematic diagram of the display area of another cooperative display screen provided by the embodiment of the present application;

Fig. 16 is a schematic diagram of the display area of another cooperative display screen provided by the embodiment of the present application;

FIG. 17 is a schematic diagram of an electronic device provided by an embodiment of the present application;

FIG. 18 is a schematic composition diagram of a chip system provided by an embodiment of the present application.

Detailed ways

"First", "second" and "third" in the embodiments of the present application are used to distinguish different objects, rather than to limit a specific order. In addition, the words "exemplary" or "for example" are used to mean an example, illustration, or illustration. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present application shall not be interpreted as being more preferred or more advantageous than other embodiments or design schemes. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete manner.

In order to facilitate the understanding of the embodiments of the present application, the application background of the present application will be introduced below by taking the computer as the coordinating terminal and the mobile phone as the coordinated terminal as examples.

First, introduce the process of establishing multi-screen collaboration between the computer and the mobile phone. It should be noted that the prerequisite for establishing multi-screen collaboration between a computer and a mobile phone is that both the computer and the mobile phone have a wireless communication function. Among them, the wireless communication function includes Bluetooth function, NFC (Near Field Communication, near field communication technology) function and so on.

Taking computers and mobile phones with NFC function as an example, an NFC area will be set on the mobile phone or computer with NFC function, which is used to sense other electronic devices and establish a near-field communication connection with other electronic devices.

From the perspective of the mobile phone and the computer, the process of establishing multi-screen collaboration between the computer and the mobile phone is as follows: the mobile phone enables the NFC function; After the collaboration request, a multi-screen collaboration pop-up window is displayed, and the multi-screen collaboration pop-up window includes a confirmation control and a cancellation control; the mobile phone responds to the click operation on the confirmation control in the multi-screen collaboration pop-up window, and sends the data of the display interface to the computer After the computer receives the data sent by the mobile phone, it displays the data on the display interface of the mobile phone through an independent window, which can be called the mobile phone interface window. In this way, the multi-screen collaboration between the computer and the mobile phone is established. It should be noted that the display interface of the electronic device refers to the interface displayed on the display screen of the electronic device, which will not be described in detail later.

Please refer to FIG. 1 , which is a schematic diagram of a multi-screen collaboration establishment process between a computer and a mobile phone. As shown in Figure 1, from the user's point of view, the process of establishing multi-screen collaboration between a computer and a mobile phone is as follows: the user clicks the NFC icon in the drop-down notification menu of the mobile phone to open the NFC function; touches the NFC area of the mobile phone to the NFC area of the computer; clicks The confirmation control in the multi-screen collaboration pop-up window displayed on the mobile phone. In this way, a mobile phone interface window will appear in the display interface of the computer, and the mobile phone interface window is used to display the data of the mobile phone display interface. So far, the multi-screen collaboration between the computer and the mobile phone has been established.

It can be understood that in the multi-screen collaboration shown in FIG. 1 above, the computer is the cooperating terminal, and the mobile phone is the coordinated terminal.

When the display interface of the computer displays the window of the mobile phone interface, it may block the content originally displayed on the display interface of the computer. Please refer to FIG. 2 , which is a schematic diagram of multi-screen collaboration between a computer and a mobile phone. As shown in FIG. 2 , before establishing multi-screen collaboration with the mobile phone, a window 1 is displayed on the display interface of the computer. After the multi-screen collaboration with the mobile phone is established, the mobile phone interface window blocks window 1, which interferes with the user's interaction with window 1, resulting in a relatively ordinary user experience.

Even if the mobile phone interface window does not block the content originally displayed on the computer display interface, when the computer opens a new window, the new window may block the mobile phone interface window. Please refer to FIG. 3 , which is another schematic diagram of multi-screen collaboration between a computer and a mobile phone. As shown in FIG. 3 , after the multi-screen collaboration between the computer and the mobile phone is established, and before the computer opens window 2, the interface window of the mobile phone and window 1 do not block each other. After the computer opens window 2, window 2 blocks the mobile phone interface window, which interferes with the interaction between the user and the mobile phone interface window, resulting in a relatively general user experience.

In order to solve the above problems, the embodiment of the present application provides a multi-screen collaboration method and electronic equipment, which can make the display interface of the coordination terminal display the window of the coordinated terminal without blocking each other with other windows in the display interface, so that the user can communicate with each other. The interaction between windows is more convenient and the user experience is better.

或者其它操作系统的设备。The multi-screen collaboration method provided in the embodiment of the present application can be applied to electronic devices. An electronic device may refer to a device with a display screen, such as a mobile phone, a tablet, a notebook computer, a desktop computer, a wearable device (such as a smart watch), a vehicle device, a laptop computer (Laptop), and the like. Exemplary embodiments of electronic devices include, but are not limited to

Or devices with other operating systems.

As an example, please refer to FIG. 4 , which is a schematic structural diagram of an electronic device 400 provided in an embodiment of the present application.

As shown in FIG. 4 , the electronic device 400 may include a processor 401 , a communication module 402 , a display screen 403 and the like.

Wherein, the processor 401 may include one or more processing units, for example: the processor 401 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processing device (image signal processor, ISP), controller, memory, video stream codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) and so on. Wherein, different processing units may be independent devices, or may be integrated in one or more processors 401 .

The controller may be the nerve center and command center of the electronic device 400 . The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.

A memory may also be provided in the processor 401 for storing instructions and data. In some embodiments, the memory in processor 401 is a cache memory. The memory may hold instructions or data that the processor 401 has just used or recycled. If the processor 401 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 401 is reduced, thereby improving the efficiency of the system.

In some embodiments, processor 401 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver) /transmitter, UART) interface, mobile industry processor 401 interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and / Or a universal serial bus (universal serial bus, USB) interface 411, etc.

The electronic device 400 implements a display function through a GPU, a display screen 403 , and an application processor 401 . The GPU is a microprocessor for image processing, and is connected to the display screen 403 and the application processor 401 . GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 401 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 403 is used to display images, video streams and the like.

The communication module 402 may include an antenna 1 , an antenna 2 , an antenna 3 and an antenna 4 . Four antennas can form a 4*4 MIMO antenna. That is to say, the electronic device 400 can simultaneously turn on the antenna 1 , the antenna 2 , the antenna 3 and the antenna 4 to transmit signals or receive signals.

Each antenna in electronic device 400 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.

The mobile communication module 402A can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 400 . The mobile communication module 402A may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and so on. The mobile communication module 402A can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 402A can also amplify the signal modulated by the modem processor, convert it into electromagnetic wave and radiate it through the antenna. In some embodiments, at least part of the functional modules of the mobile communication module 402A may be set in the processor 401 . In some embodiments, at least part of the functional modules of the mobile communication module 402A and at least part of the modules of the processor 401 may be set in the same device.

A modem processor may include a modulator and a demodulator. Wherein, the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is passed to the application processor after being processed by the baseband processor. The application processor outputs sound signals through audio equipment (not limited to speaker 406A, receiver 406B, etc.), or displays images or video streams through display screen 403 . In some embodiments, the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent from the processor 401, and be set in the same device as the mobile communication module 402A or other functional modules.

The wireless communication module 402B can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite system, etc. applied on the electronic device 400 (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 402B may be one or more devices integrating at least one communication processing module. The wireless communication module 402B receives electromagnetic waves through the antenna, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 401 . The wireless communication module 402B can also receive the signal to be sent from the processor 401, frequency-modulate it, amplify it, and convert it into electromagnetic wave and radiate it through the antenna.

In some embodiments, wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA) ), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technology, etc. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenithsatellite system (QZSS) and/or satellite based augmentation systems (SBAS).

As shown in Figure 4, in some implementations, the electronic device 400 may also include an external memory interface 410, an internal memory 404, a universal serial bus (universal serial bus, USB) interface 411, a charging management module 412, and a power management module 413, battery 414, audio module 406, speaker 406A, receiver 406B, microphone 406C, earphone jack 406D, sensor module 405, button 409, motor, indicator 408, camera 407, and subscriber identification module (subscriber identification module, SIM) card interface etc.

The charging management module 412 is configured to receive charging input from the charger. Wherein, the charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 412 can receive charging input from a wired charger through the USB interface 411 . In some wireless charging embodiments, the charging management module 412 may receive a wireless charging input through a wireless charging coil of the electronic device 400 . While the charging management module 412 is charging the battery 414 , it can also supply power to the electronic device 400 through the power management module 413 .

The power management module 413 is used for connecting the battery 414 , the charging management module 412 and the processor 401 . The power management module 413 receives input from the battery 414 and/or the charging management module 412, and supplies power to the processor 401, the internal memory 404, the external memory, the display screen 403, the camera 407, and the wireless communication module 402B. The power management module 413 can also be used to monitor parameters such as the capacity of the battery 414 , the number of cycles of the battery 414 , and the state of health of the battery 414 (leakage, impedance). In some other embodiments, the power management module 413 may also be set in the processor 401 . In some other embodiments, the power management module 413 and the charging management module 412 may also be set in the same device.

The external memory interface 410 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 400. The external memory card communicates with the processor 401 through the external memory interface 410 to realize the data storage function. Such as saving files such as music, video streaming, etc. in an external memory card.

Internal memory 404 may be used to store computer-executable program code, which includes instructions. The processor 401 executes various functional applications and data processing of the electronic device 400 by executing instructions stored in the internal memory 404 .

The internal memory 404 may also store one or more computer programs corresponding to the multi-screen collaboration method provided in the embodiment of the present application.

The electronic device 400 may implement an audio function through an audio module 406 , a speaker 406A, a receiver 406B, a microphone 406C, an earphone interface 406D, and an application processor 401 . Such as music playback, recording, etc.

The keys 409 include a power key, a volume key and the like. The key 409 may be a mechanical key 409 . It can also be a touch button 409 . The electronic device 400 may receive an input of a key 409 and generate a key signal input related to user setting and function control of the electronic device 400 .

The indicator 408 can be an indicator light, which can be used to indicate the charging status, the change of the battery capacity, and can also be used to indicate messages, missed calls, notifications and the like.

The SIM card interface is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 400 by inserting it into the SIM card interface or pulling it out from the SIM card interface. The electronic device 400 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface can support Nano SIM card, Micro SIM card, SIM card, etc. The same SIM card interface can insert multiple cards at the same time. The types of the multiple cards may be the same or different. The SIM card interface is also compatible with different types of SIM cards. The SIM card interface is also compatible with external memory cards. The electronic device 400 interacts with the network through the SIM card to implement functions such as calling and data communication. In some embodiments, the electronic device 400 adopts an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the electronic device 400 and cannot be separated from the electronic device 400 .

The sensor module 405 in the electronic device 400 may include a touch sensor, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, an ambient light sensor, a fingerprint sensor, a temperature sensor, a bone conduction sensor, etc. Components to realize sensing and/or acquisition functions for different signals.

It can be understood that the structure shown in this embodiment does not constitute a specific limitation on the electronic device 400 . In other embodiments, the electronic device 400 may include more or fewer components than shown, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

When the multi-screen collaboration method provided in the embodiment of the present application is applied to the electronic device shown in FIG. 4 above, the electronic device may be a collaboration terminal in the multi-screen collaboration.

That is to say, the multi-screen collaboration method provided in the embodiment of the present application is applied to the collaboration terminal. The coordinating terminal establishes multi-screen collaboration with the coordinated terminal. In other words, the display interface of the coordinating terminal includes a first window, and the first window is used to display the display interface of the coordinated terminal. As mentioned above, the display interface refers to the interface displayed on the display screen, which may include icons, colors, text and so on.

Please refer to FIG. 5 , which is a flowchart of a multi-screen collaboration method provided by an embodiment of the present application. As shown in Fig. 5, the method includes S501-S502.

S501. Display a manipulation interface in response to a first operation on a first control in a first window. As mentioned above, the first window is used to display the display interface of the coordinated end. The manipulation interface includes at least one mark, and each mark corresponds to a different area of the display screen area of the coordination terminal. In this embodiment of the present application, all areas in the display screen of the coordination terminal may be referred to as display areas.

Exemplarily, the coordinating terminal is a computer, and the coordinated terminal is a mobile phone. Please refer to FIG. 6 , which is a schematic diagram of a computer display interface provided by an embodiment of the present application. As shown in FIG. 6 , the display interface of the computer may include a first window and a second window. The display interface of the mobile phone may be displayed in the first window, and the display interface of the mobile phone may include, but not limited to, application icons installed in the mobile phone, application names, battery icons, mobile network signal icons, wireless network signal icons, and the like.

The first window may further include a first control as shown in FIG. 6 , a window maximization control, a window minimization control, a window closing control, and the like. The computer can receive and respond to external input through the above-mentioned controls. For example, the computer may display a manipulation interface in response to a click operation on the first control. In response to the click operation on the window maximization control, the computer can enlarge the first window to fill the display area of the display interface of the coordination terminal. The computer may shrink the first window to the taskbar in response to clicking on the window minimizing control. The computer may close the first window in response to clicking on the window close control.

In some embodiments, the first operation may be a touch operation, such as clicking, double-clicking, and long-pressing.

In some other embodiments, the first operation may also be a pointer operation, such as single click, double click and so on.

The first control may be in a shape as shown in FIG. 6 , that is, a shape in which a letter D is displayed in a circle. It can be understood that the first control may also have other shapes, which are only illustrated here as examples, and the shape of the first control in the present application is not specifically limited.

In this embodiment of the present application, the first operation on the first control in the first window refers to the first operation on the first control when the first window is in a selected state. That is to say, the premise of performing the first operation on the first control is that the first window is in a selected state.

As shown in FIG. 6, when the first window is in the selected state, the layer where the first window is located is located at the top layer of the display interface. Please refer to FIG. 7 , which is a schematic diagram of another computer display interface provided by the embodiment of the present application. As shown in FIG. 7 , when the first window is in the unselected state, the layer where it is located is not located at the top layer of the display interface.

The selected state and unselected state of the first window can be converted to each other. Taking the first operation as a click operation or click operation as an example, when the first window is in the unselected state as shown in Figure 7, the coordinating terminal may respond to the click operation or click operation on the area where the first window is located, and The first window is set to the selected state as shown in FIG. 6 . When the first window is in the selected state as shown in FIG. 6, the coordination terminal may set the first window to the unselected state as shown in FIG.

In the embodiment of the present application, the coordination terminal displays the manipulation interface in response to the first operation on the first control in the first window. The manipulation interface includes a plurality of marks, wherein each mark corresponds to an area in the display interface of the coordination terminal.

In some embodiments, the marks on the manipulation interface may be rectangular blocks. Please refer to FIG. 8 , which is a schematic diagram of a manipulation interface provided by an embodiment of the present application. As shown in FIG. 8 , the control interface may include four blocks, respectively called block a, block b, block c, and block d. Block a, block b, block c and block d may all be rectangular blocks. Block a is located above the center of the display screen, block b is located below the center of the display screen, block c is located to the left of the center of the display screen, and block d is located to the right of the center of the display screen.

In other embodiments, the mark on the manipulation interface may also be an arrow. Please refer to FIG. 9 , which is a schematic diagram of another manipulation interface provided by the embodiment of the present application. As shown in FIG. 9 , the manipulation interface may include four arrows, which are respectively called a first arrow, a second arrow, a third arrow and a fourth arrow. Wherein, the first arrow points to the top of the center of the display screen, the second arrow points to the bottom of the center of the display screen, the third arrow points to the left of the center of the display screen, and the fourth arrow points to the right of the center of the display screen.

It should be noted that when the control interface is displayed on the display interface of the coordination terminal, the layer where the control interface is located is located at the top layer of the display interface.

Corresponding to the control interface shown in FIG. 8 or FIG. 9 above, the display area of the display screen of the coordination terminal can be divided into 4 areas. Please refer to FIG. 10 , which is a schematic diagram of a display area of a cooperative terminal display screen provided by an embodiment of the present application. As shown in FIG. 10 , the display area of the coordination terminal may include four areas, called area A, area B, area C, and area D, respectively. Among them, area A is located above the center of the display screen, area B is located below the center of the display screen, area C is located to the left of the center of the display screen, area D is located to the right of the center of the display screen, and the areas do not overlap. It should be noted that, in order to simplify the display area, the above-mentioned area division will not be displayed on the display screen of the coordination terminal.

When the control interface is shown in Figure 8 and the division of the display area is shown in Figure 10, block a may correspond to area A, block b may correspond to area B, block c may correspond to area C, and block d Can correspond to area D.

When the control interface is shown in Figure 9 and the division of the display area is shown in Figure 10, the first arrow may correspond to Area A, the second arrow may correspond to Area B, the third arrow may correspond to Area C, and the fourth arrow may correspond to Area C. Can correspond to area D.

It can be seen that adopting the above-mentioned corresponding relationship between the control interface and the display area can improve the recognition of each mark in the control interface, facilitate the user to understand and remember the corresponding relationship between each mark and the display area, and help improve the user experience.

It can be understood that the above description of the manipulation interface and the display area is only exemplary, and does not mean that the present application is limited thereto. Some possible implementations are shown below.

Please refer to FIG. 11 , which is a schematic diagram of another manipulation interface provided by the embodiment of the present application. As shown in FIG. 11 , the control interface may include four blocks, respectively called block e, block f, block g, and block h. Block e is located at the upper left of the center of the display screen, block f is located at the upper right of the center of the display screen, block g is located at the lower left of the center of the display screen, and block h is located at the lower right of the center of the display screen.

Please refer to FIG. 12 , which is a schematic diagram of another manipulation interface provided by the embodiment of the present application. As shown in FIG. 12 , the manipulation interface may include four arrows, which are respectively called the fifth arrow, the sixth arrow, the seventh arrow and the eighth arrow. The fifth arrow points to the upper left of the center of the display screen, the sixth arrow points to the upper right of the center of the display screen, the seventh arrow points to the lower left of the center of the display screen, and the eighth arrow points to the lower right of the center of the display screen.

Please refer to FIG. 13 , which is a schematic diagram of a display area of another cooperative display screen provided by the embodiment of the present application. As shown in FIG. 13 , the display area of the cooperative display screen can be divided into four areas, which are called area E, area F, area G, and area H respectively. Area E is located at the upper left of the center of the display screen, area F is located at the upper right of the center of the display screen, area G is located at the lower left of the center of the display screen, and area H is located at the lower right of the center of the display screen.

When the control interface is shown in Figure 11 and the division of the display area is shown in Figure 13, block e can correspond to area E, block f can correspond to area F, block g can correspond to area G, and block h can correspond to area E. Can correspond to area H.

When the control interface is shown in Figure 12 and the division of the display area is shown in Figure 13, the fifth arrow can correspond to area E, the sixth arrow can correspond to area F, the seventh arrow can correspond to area G, and the eighth arrow can correspond to area E. Can correspond to area H.

When the control interface is displayed on the display interface of the coordination terminal, it can receive external input on the control interface and execute corresponding feedback.

S502. In response to the second operation on the first mark in the manipulation interface, move the first window to the first area corresponding to the first mark, and move the display interface of the coordination terminal to a display area other than the first area. Wherein, the first mark is any mark in the manipulation interface.

In the embodiment of the present application, the first mark is any mark in the manipulation interface. That is to say, the first mark can be any one of block a, block b, block c, and block d in the above-mentioned Figure 8, and can also be the first arrow, the second arrow, the third Any one of the arrow and the fourth arrow can also be any one of block e, block f, block g, and block h in the above-mentioned figure 11, or it can be the fifth arrow in the above-mentioned figure 12, the sixth arrow Arrow, any one of the seventh arrow and the eighth arrow.

The coordinating end may set the first mark to the first color and/or highlight the first mark in response to the pointer moving to the area where the first mark is located. Wherein, the first color may be blue, green, etc., which are not specifically limited here. That is to say, when the user moves the mouse pointer to the area where the first mark is located, the first mark will change to the first color. In this way, it is convenient for the user to know the mark pointed by the mouse pointer, which is beneficial to improve the user experience.

In addition, in response to the mouse pointer moving to the area where the first mark is located, the coordinating end may display a border of the area corresponding to the first mark. In this way, it is convenient for the user to know the position of the area corresponding to the first mark in the display area of the coordination terminal.

The first area corresponds to the first mark. Exemplarily, if the first mark is the block b in the above-mentioned Figure 8, then the first area is the area B in the above-mentioned Figure 10; if the first mark is the third arrow in the above-mentioned Figure 9, then the first area is Region C in Figure 10 above. I won't repeat them here.

It should also be noted that the second operation may be a touch operation, such as clicking, double-clicking, long pressing, etc.; the second operation may also be a pointer operation, such as single-clicking, double-clicking, and the like. The second operation may be the same as or different from the first operation, which is not limited in this application.

As an example, both the first operation and the second operation may be click operations. In this way, by clicking the first control and then clicking the first mark, the user can move the first window to the first area corresponding to the first mark, and move the display interface to a display area other than the first area.

In another example, the first operation and the second operation may be consecutive operations. For example, the continuous operation may be clicking and sliding. The coordination terminal may move the mouse pointer to the center of the display screen in response to the click operation on the first control in the first window. Afterwards, the coordination end may respond to the pointer sliding to the first mark, move the first window to the first area corresponding to the first mark, and move the display interface to a display area other than the first area.

The above S502 is described below by taking a specific scenario as an example.

On the control interface as shown in Figure 8, the division of the display area is shown in Figure 10, the first mark is block a, the first area corresponding to the first mark is area A, and when the second operation is a click operation, the above S502 It is: the coordinating end responds to the click operation on the block a in the control interface as shown in Figure 8, moves the first window to the area A corresponding to the block a, and moves the display interface to the area other than area A Display area.

Before executing the multi-screen collaboration method provided by the embodiment of the present application, the display area of the display screen of the collaboration terminal is shown in FIG. 6 , and the first window blocks part of the content of the second window. Then, after executing the multi-screen collaboration method provided by the embodiment of the present application for the coordination terminal, the display area of the display screen of the coordination terminal is as shown in Figure 14, that is, the first window is displayed in area A, and the display interface (including the second window) is displayed in the area A. Displayed in area B. It should be noted that the display interface can also be displayed in area C or area D, or partially displayed in area C, partially displayed in area B, or partially displayed in area B, partially displayed in area D, or partially displayed in area B display, partly in area C and partly in area D. This application does not specifically limit it.

In some other embodiments, if the horizontal length of block a and block b is greater than the vertical length, the coordination terminal can also respond to the single-click operation on block a or block b in the manipulation interface as shown in Figure 8, Send the first instruction to the coordinated end. The first instruction is used to instruct the coordinated end to change the screen display mode to horizontal screen display. Correspondingly, the coordinated end changes the screen display mode to horizontal screen display in response to the first instruction. Wherein, the horizontal direction in the embodiment of the present application refers to the direction parallel to the long side of the display screen, and the vertical direction refers to the direction parallel to the short side of the display screen.

Please refer to FIG. 15 , which is a schematic diagram of a display area of another cooperative terminal display screen provided by an embodiment of the present application. As shown in FIG. 15 , when the screen display mode of the coordinated terminal is horizontal screen display, the display interface of the coordinated terminal displayed in the first window of the coordinated terminal is also in the horizontal screen form.

On the control interface as shown in Figure 9, the division of the display area is shown in Figure 10, the first mark is the first arrow, the first area corresponding to the first mark is area A, and when the second operation is a click operation, the above S502 It is: in response to the click operation on the first arrow in the control interface shown in Figure 8, the coordinating terminal moves the first window to the area A corresponding to the first arrow, and moves the display interface to the area other than area A Display area.

If the display area of the display screen of the coordination terminal is shown in FIG. 6 before executing the multi-screen coordination method provided by the embodiment of the present application, the first window blocks part of the content of the second window. Then, after the multi-screen collaboration method provided by the embodiment of the present application is executed for the coordination terminal, the display area of the display screen of the coordination terminal is shown in FIG. 14 , which will not be repeated here.

On the control interface as shown in Figure 11, the division of the display area is shown in Figure 13, the first mark is block e, the first area corresponding to the first mark is area E, and when the second operation is a click operation, the above S502 It is: in response to the single-click operation on the block e in the control interface as shown in Figure 11, the coordinating terminal moves the first window to the area E corresponding to the block e, and moves the display interface to the area other than the area E Display area.

If before executing the multi-screen collaboration method provided by the embodiment of the present application, the display area of the display screen of the collaboration terminal is as shown in FIG. 6 , the first window covers part of the content of the second window. Then, after executing the multi-screen collaboration method provided by the embodiment of the present application for the coordination terminal, the display area of the display screen of the coordination terminal may be as shown in FIG. 16 . That is, the first window is displayed in area E, and the display interface (including the second window) is displayed in area F. It should be noted that the display interface may also be displayed in one or more of the area F, area G, and area H, which is not specifically limited in this application.

On the control interface as shown in Figure 12, the division of the display area is shown in Figure 13, the first mark is the fifth arrow, the first area corresponding to the first mark is area E, and the second operation is a click operation, the above S502 It is: in response to the click operation of the fifth arrow in the manipulation interface shown in Figure 11, the coordinating terminal moves the first window to the area E corresponding to the fifth arrow, and moves the display interface to the area other than area E Display area.

If before executing the multi-screen collaboration method provided by the embodiment of the present application, the display area of the display screen of the collaboration terminal is as shown in FIG. 6 , the first window covers part of the content of the second window. Then, after the multi-screen collaboration method provided by the embodiment of the present application is executed for the coordination terminal, the display area of the display screen of the coordination terminal may be as shown in FIG. 16 , which will not be repeated here.

It should be noted that the newly opened windows can only be displayed on the display interface. Therefore, after the display interface is moved to other areas except the first area, if the user opens other windows in the coordination terminal, these newly opened windows will only be displayed in the area where the display interface is located, so they will not block the first area. window.

Therefore, the multi-screen collaboration method provided by the embodiment of the present application can make the display interface of the coordinating terminal display the window of the coordinating terminal without blocking each other with other windows in the display interface, thereby making the interaction between the user and each window more convenient. User experience is better.

Please refer to FIG. 17 , which is a schematic diagram of an electronic device 1700 provided in an embodiment of the present application. The electronic device 1700 may be any electronic device in the foregoing examples, for example, the electronic device 1700 may be a mobile phone, a computer, and the like. Exemplarily, as shown in FIG. 17 , the electronic device 1700 may include: a processor 1701 and a memory 1702 . The memory 1702 is used to store computer-executable instructions. Exemplarily, in some embodiments, when the processor 1701 executes the instructions stored in the memory 1702, the electronic device 1700 can be made to perform any function of the electronic device in the above-mentioned embodiments, so as to realize any of the functions in the above-mentioned examples. a way.

It should be noted that all relevant content of the steps involved in the above method embodiments can be referred to the function description of the corresponding function module, and will not be repeated here.

FIG. 18 shows a schematic composition diagram of a chip system 1800 . The chip system 1800 can be set in an electronic device. For example, the chip system 1800 can be set in a mobile phone. Exemplarily, the chip system 1800 may include: a processor 1801 and a communication interface 1802, configured to support the electronic device to implement the functions involved in the foregoing embodiments. In a possible design, the chip system 1800 also includes a memory for storing necessary program instructions and data of the electronic device. The system-on-a-chip may consist of chips, or may include chips and other discrete devices. It should be noted that, in some implementation manners of the present application, the communication interface 1802 may also be called an interface circuit.

It should be noted that all relevant content of the steps involved in the above method embodiments can be referred to the function description of the corresponding function module, and will not be repeated here.

The embodiment of the present application also provides a computer storage medium, the computer storage medium stores computer instructions, and when the computer instructions are run on the terminal device, the terminal device executes the above related method steps to implement the method in the above embodiment.

An embodiment of the present application further provides a computer program product, which, when running on a computer, causes the computer to execute the above-mentioned related steps, so as to implement the methods in the above-mentioned embodiments.

In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device is running, The processor can execute the computer-executable instructions stored in the memory, so that the chip executes the methods in the foregoing method embodiments.

Wherein, the terminal device, computer storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding method provided above, therefore, the beneficial effects it can achieve can refer to the corresponding method provided above. The beneficial effects of the method will not be repeated here.

The foregoing mainly introduces the solutions provided by the embodiments of the present application from the perspective of electronic devices. In order to realize the above functions, it includes corresponding hardware structures and/or software modules for performing various functions. Those skilled in the art should easily realize that the present application can be implemented in the form of hardware or a combination of hardware and computer software in combination with the units and algorithm steps of each example described in the embodiments disclosed herein. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.

The embodiments of the present application may divide the involved devices into functional modules according to the above method examples. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of modules in the embodiment of the present application is schematic, and is only a logical function division, and there may be other division methods in actual implementation.

The functions or actions or operations or steps in the above-mentioned embodiments may be fully or partially implemented by software, hardware, firmware or any combination thereof. When implemented using a software program, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server, or data center Transmission to another website site, computer, server or data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer, or may include one or more data storage devices such as servers and data centers that can be integrated with the medium. The available medium may be a magnetic medium (such as a floppy disk, a hard disk, or a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (solid state disk, SSD)), etc.

Although the application has been described in conjunction with specific features and embodiments thereof, it will be apparent that various modifications and combinations can be made thereto without departing from the spirit and scope of the application. Accordingly, the specification and drawings are merely illustrative of the application as defined by the appended claims and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of this application. Obviously, those skilled in the art can make various changes and modifications to the application without departing from the spirit and scope of the application. In this way, if these modifications and variations of the application fall within the scope of the claims of the application and their equivalent technologies, the application also intends to include these modifications and variations.

Although the application has been described in conjunction with specific features and embodiments thereof, it will be apparent that various modifications and combinations can be made thereto without departing from the spirit and scope of the application. Accordingly, the specification and drawings are merely illustrative of the application as defined by the appended claims and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of this application. Obviously, those skilled in the art can make various changes and modifications to the application without departing from the spirit and scope of the application. In this way, if these modifications and variations of the application fall within the scope of the claims of the application and their equivalent technologies, the application also intends to include these modifications and variations.

Claims (11)

1. A method for multi-screen collaboration, characterized in that it is applied to a coordination terminal, and the display interface of the coordination terminal includes a first window, and the first window is used to display the display interface of the coordinated terminal; the method includes: In response to the first operation on the first control in the first window, a manipulation interface is displayed; the manipulation interface includes at least one mark, and each mark corresponds to a different area in the display area of the coordination terminal; the coordination terminal The display area is the area displayed by the display screen of the coordination terminal; In response to the second operation on the first mark in the manipulation interface, moving the first window to the first area corresponding to the first mark, and moving the display interface of the coordination terminal to the area other than the first An area outside the area; wherein, the first mark is any mark in the manipulation interface. 2. The multi-screen collaborative method according to claim 1, further comprising: When the horizontal length of the first area is greater than the vertical length, sending a first instruction to the coordinated end, the first instruction is used to instruct the coordinated end to display the display interface of the coordinated end in a horizontal screen. 3. The multi-screen collaboration method according to claim 1, wherein the control interface includes 4 marks, namely the second mark, the third mark, the fourth mark and the fifth mark; Taking the center of the display area of the coordination terminal as a reference point, the second mark is located above the reference point, the third mark is located below the reference point, and the fourth mark is located beside the reference point On the left, the fifth mark is located on the right of the reference point. 4. The multi-screen collaboration method according to claim 3, wherein the display area of the coordination terminal includes a second area, a third area, a fourth area and a fifth area; The second area is located above the reference point, the third area is located below the reference point, the fourth area is located to the left of the reference point, and the fifth area is located at the reference point to the right of The second mark corresponds to the second area, the third mark corresponds to the third area, the fourth mark corresponds to the fourth area, and the fifth mark corresponds to the fifth area correspond. 5. The multi-screen collaborative method according to claim 4, wherein the mark is a rectangular block or an arrow. 6. The multi-screen collaboration method according to any one of claims 1-5, wherein the first operation and the second operation are mouse pointer operations; In response to the second operation on the first mark in the manipulation interface, the first window is moved to the first area corresponding to the first mark, and the display interface of the coordination terminal is moved to the Before the area outside the first area, the method also includes: In response to the mouse pointer moving to the first mark, setting the first mark to a first color and displaying a border of the first region; and/or In response to the mouse pointer moving to the first mark, highlighting the first mark and displaying a border of the first area. 7. The multi-screen collaboration method according to any one of claims 1-5, wherein the first operation is any of the following: click, double-click, long press, single-click; The second operation is any one of the following: click, double click, long press, and single click. 8. The multi-screen collaboration method according to any one of claims 1-5, wherein the displaying a manipulation interface in response to the first operation on the first control in the first window comprises: In response to a click operation on the first window, setting the first window to a selected state; In response to a first operation on the first control, a manipulation interface is displayed. 9. An electronic device, characterized in that the electronic device comprises one or more processors and one or more memories; the one or more memories are coupled to the one or more processors, and the one or more Computer programs are stored in one or more memories; when the one or more processors execute the computer programs, the electronic device is made to execute the multi-screen collaborative method according to any one of claims 1-8. 10. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a computer program, and when the computer program executes the multi-screen collaboration method according to any one of claims 1-8. 11. A computer program product, characterized in that the computer program product includes instructions, and when the computer program product is run on a computer, the computer can execute any of claims 1-8 according to the instructions. One of the multi-screen collaborative methods.

Images