CN113721808B

CN113721808B - Control method and device

Info

Publication number: CN113721808B
Application number: CN202111013473.1A
Authority: CN
Inventors: 方宝彤; 李翔
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2021-08-31
Filing date: 2021-08-31
Publication date: 2024-09-20
Anticipated expiration: 2041-08-31
Also published as: CN113721808A

Abstract

The application discloses a control method and a control device, comprising the following steps: acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, wherein the display screen comprises a main screen and/or an expansion screen of the electronic equipment; in response to an operation of moving a target object in the main screen or the extension screen to the target screen based on the target window, the target object is displayed on the target screen, the target screen being a screen different from a screen to which the target object belongs before being moved. The method and the device have the advantages that the target object can be rapidly moved to different display screens for display through the target window, so that the object can be moved on the different screens more conveniently and accurately.

Description

Control method and device

Technical Field

The present application relates to the field of information processing technologies, and in particular, to a control method and apparatus.

Background

With the continuous development of electronic technology, current electronic devices generally have an external display screen, or a function of obtaining an extended display screen through AR (Augmented Reality ) technology projection. The multi-screen expansion can realize that the content is put into a plurality of different screens for display, and rich interaction experience is provided for users.

When a file or other application object in a certain screen of the multiple screens needs to be moved to a corresponding expansion screen for presentation, the file needs to be moved through a mouse to pass through the edge of the main screen to the expansion screen. If the edge position of the main screen is not obvious when the AR virtual expansion screen is used, the problem that the file is moved again due to inaccurate operation can occur, and the file is inconvenient to move to the expansion screen for display.

Disclosure of Invention

In view of this, the present application provides a control method and apparatus, as follows:

A control method, comprising:

acquiring a trigger instruction, and displaying a target window on a display screen of electronic equipment, wherein the display screen comprises a main screen and/or an expansion screen of the electronic equipment;

In response to an operation of moving a target object in the home screen or the extension screen to a target screen based on the target window, the target object is displayed on the target screen, the target screen being a screen different from a screen to which the target object was before being moved.

Optionally, the obtaining a trigger instruction includes at least one of:

Detecting triggering operation acting on a target button or a target control, and determining to obtain the triggering instruction;

Or alternatively, the first and second heat exchangers may be,

Detecting that at least one expansion screen is connected or disconnected, and determining to acquire the trigger instruction; or alternatively, the first and second heat exchangers may be,

Detecting that the electronic equipment is switched from a current operation mode to a target operation mode, and determining to acquire the trigger instruction; or alternatively, the first and second heat exchangers may be,

Detecting that the electronic equipment is accessed to a target network, and determining to acquire the trigger instruction; or alternatively, the first and second heat exchangers may be,

Detecting that the electronic equipment starts a target process, and determining to acquire the trigger instruction; or alternatively, the first and second heat exchangers may be,

Detecting to obtain a screen management request, and determining to obtain the trigger instruction; or alternatively, the first and second heat exchangers may be,

And detecting that the moving track of the target object meets a preset condition, and determining to obtain the trigger instruction.

Optionally, displaying the target window on a display screen of the electronic device includes:

Displaying a first target window on a main screen and/or an expansion screen of the electronic equipment, wherein the first target window is displayed with identifiers corresponding to the main screen and the expansion screen; or alternatively, the first and second heat exchangers may be,

Displaying a second target window on a main screen of the electronic equipment, displaying a third target window on an expansion screen of the electronic equipment, wherein the second target window at least does not display an identifier corresponding to the screen where the second target window is positioned, and the third target window at least does not display an identifier corresponding to the screen where the third target window is positioned; or alternatively, the first and second heat exchangers may be,

Acquiring attribute information of the trigger instruction, and displaying a corresponding target window on a display screen of the electronic equipment at least based on the attribute information; or alternatively, the first and second heat exchangers may be,

And obtaining the use information of the electronic equipment, and displaying a corresponding target window on a display screen of the electronic equipment at least based on the use information.

Optionally, the operation of moving the target object in the main screen or the extension screen to the target screen based on the target window includes:

An operation of moving a target object in the main screen or the extension screen to a target position in the target window, wherein the target position is an area where a target mark corresponding to the target screen is located; or alternatively, the first and second heat exchangers may be,

An operation of moving a screen identifier corresponding to a screen to which the target object belongs to a target position in the target window, wherein the target position is an area where the target identifier corresponding to the target screen is located; or alternatively, the first and second heat exchangers may be,

Moving a target mark corresponding to the target screen in the target window to the position of the target object; or alternatively, the first and second heat exchangers may be,

And inputting the mark information corresponding to the target object in the main screen or the extension screen to a target position in the target window, wherein the target position is an area where a target mark corresponding to the target screen is located.

Optionally, in response to an operation of moving a target object in the main screen or the extension screen to a target position in the target window, displaying the target object on the target screen includes:

Acquiring editing state information of the target window;

Monitoring first coordinate information of a first operation of moving the target object if the target window is not editable, and displaying the target object on the target screen if the first coordinate information is matched with the target position; and/or the number of the groups of groups,

If the target window is editable, monitoring whether the operation of moving the target object comprises a second operation at the target position, and if so, displaying the target object on the target screen.

Optionally, displaying the target object on the target screen includes:

In response to an operation of moving or inputting a first identifier corresponding to a first screen in the display screen to a target position in the target window, displaying a target object determined from the first screen on the target screen, wherein the target position is an area where the target identifier corresponding to the target screen is located, and the first screen is any one of the main screen and the extension screen; or alternatively, the first and second heat exchangers may be,

And displaying the target object on the target screen in response to an operation of modifying the identification of the target object of the main screen or the extension screen to the target identification corresponding to the target screen.

Optionally, determining a target object from the first screen includes:

Determining an application window at the forefront end of a current display screen in the first screen as the target object; or alternatively, the first and second heat exchangers may be,

Determining an object with a first association relationship with an application window displayed at the forefront end of a screen in the first screen as the target object; or alternatively, the first and second heat exchangers may be,

Determining an object with a movement track meeting preset conditions in the first screen as the target object; or alternatively, the first and second heat exchangers may be,

And determining an object capable of realizing a first preset function in the first screen as a target object.

acquiring an operation of moving a target object based on the target window;

Analyzing the operation to obtain a target area of the target window to which the target object moves;

Detecting screen content corresponding to the target area;

and if the screen content corresponding to the target area is not matched with the screen content of the screen to which the target object belongs before being moved, determining the operation as the operation of moving the target object in the main screen or the extended screen to the target screen based on the target window.

Optionally, the displaying the target object on the target screen includes:

acquiring at least one of first position information of the target object in the target window, second position information of the target window in the display screen, or third position information of the target window in the target window, wherein the first position information corresponds to the region of the target screen;

Acquiring screen size ratio information of the display screen and the target screen;

determining a target display position based on at least one of the first position information, the second position information, the third position information, and the screen size ratio information;

and displaying the target object at a target display position of the target screen.

A control apparatus comprising:

The electronic equipment comprises an acquisition unit, a display unit and a display unit, wherein the acquisition unit is used for acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, and the display screen comprises a main screen and/or an expansion screen of the electronic equipment;

And a display unit configured to display a target object in the main screen or the extension screen on the target screen in response to an operation of moving the target object to the target screen based on the target window, the target screen being a screen different from a screen to which the target object belongs before being moved.

An electronic device includes a memory and a processor;

the memory is used for storing an application program and data generated by the running of the application program;

the processor is configured to execute the application program to implement:

A storage medium having stored thereon computer program code which, when executed by a processor, implements a control method as described in any one of the above.

As can be seen from the technical scheme, the control method and the control device disclosed by the application comprise the following steps: acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, wherein the display screen comprises a main screen and/or an expansion screen of the electronic equipment; in response to an operation of moving a target object in the main screen or the extension screen to the target screen based on the target window, the target object is displayed on the target screen, the target screen being a screen different from a screen to which the target object belongs before being moved. The method and the device have the advantages that the target object can be rapidly moved to different display screens for display through the target window, so that the object can be moved on the different screens more conveniently and accurately.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of an application scenario provided in an embodiment of the present application;

Fig. 2 is a flow chart of a control method according to a first embodiment of the present application;

FIG. 3 is a schematic diagram of a target window display according to an embodiment of the present application;

fig. 4 is a schematic view of an application scenario based on a screen management window according to an embodiment of the present application;

Fig. 5 is a schematic diagram of an application scenario based on a shortcut window according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a control device according to a second embodiment of the present application;

fig. 7 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The control method provided by the embodiment of the application is applied to an information processing scene with a plurality of display screens, as shown in fig. 1, and fig. 1 is a schematic diagram of an application scene provided by the embodiment of the application. The electronic device 100 itself has a display screen 101, the display screen 101 may be used as a main screen, in order to facilitate information display, the electronic device 100 is further connected with an extension screen 102, an extension screen 103, and an extension screen 104, where the main screen and the extension screen may display the same information, may display different information, may move an object in the current main screen and/or the extension screen to other screens for display or storage, and it should be noted that the extension screen may be connected with the electronic device 100 by a wire or by a wireless connection, and the extension screen may also be a virtual screen displayed based on a screen throwing process. In order to facilitate movement of objects in different screens, a control method is provided in the embodiment of the present application, and referring to fig. 2, a flow chart of the control method provided in the first embodiment of the present application is provided, and the technical solution of the embodiment may improve convenience and accuracy of movement of objects between different screens.

Specifically, the control method may include the steps of:

S201, acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment.

As shown in fig. 2, the display screen includes a home screen and/or an extension screen of the electronic device. The trigger instruction is an instruction for displaying a target window on a display screen of the electronic device. The instruction may be an instruction determined based on the operation information, for example, an instruction to operate a shortcut key for displaying the target window, or an instruction to select menu information for displaying the target window. The triggering instruction may also be an instruction that triggers automatically based on the detected state of the electronic device, for example, if it is detected that the electronic device is connected with a plurality of display screens, the triggering instruction may be automatically generated, or the display content of the main screen of the electronic device may be detected, and if it is detected that there are more display objects, the triggering instruction may be automatically generated.

Various ways of determining the trigger instruction may be included in embodiments of the present application, and will be described in detail in the following examples, which are not described in detail herein.

After the trigger instruction is obtained, the target window can be displayed on a display screen of the electronic device, wherein the display screen can be a main screen, an extension screen or all the screens corresponding to the electronic device, namely the main screen and the extension screen. Therefore, the target window can be positioned on any display screen of the electronic device, can be positioned on all display screens, can be positioned on part of the display screens, and can be determined based on actual application scenes and display requirements. The target window may be a window including a corresponding identifier of each display screen, a window including only a corresponding identifier of an extended screen, a window including a corresponding identifier of a part of display screens, wherein the identifier may be an image representing a screen, a shortcut window representing a screen, a target area representing a screen, or the like. Correspondingly, the target window can be in a specific state, for example, the target window can only identify specific instructions, the target window is fixed in position and the target window is not editable; the target window may also be in an editable state, for example, information such as response form, size, position, etc. of the target window may be edited.

S202, in response to an operation of moving the target object in the main screen or the extension screen to the target screen based on the target window, the target object is displayed on the target screen.

The target object is an object located in the main screen or the extension screen, may be an object in any format, for example, may be a text document, a picture, an application, a display form corresponding to each object is not displayed, may be a full-screen display object, may be an unopened object displayed with an icon identifier, may be a minimized object, or may be a window display object. I.e. in the embodiment of the application, the moving operation can be realized no matter what state the object is in. The target object may be an object in the home screen, i.e. the object in the home screen may be moved into at least one extension screen for display. The target object may also be an object in an extension screen, i.e. an object in an extension screen may be moved to a different extension screen and/or home screen.

It should be noted that, in the embodiment of the present application, the movement of the target object is implemented based on the target window, that is, the movement of the object is not required to be performed after the edges of the main screen and/or the extension screen are identified. The target window may include a logo and/or an area corresponding to each display screen. Taking the example that the target window is displayed on the main screen and the target window includes window areas corresponding to the expansion screens as an example, if the object a on the main screen is moved to the window area corresponding to the expansion screen 1 displayed in the target window of the main screen, the object a is displayed on the expansion screen 1. Of course, the target screen to be moved finally can also be determined based on the attribute of different objects, the content of different target windows and the triggering condition, which will be described in detail in the following embodiments of the present application.

The embodiment of the application discloses a control method, which comprises the following steps: acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, wherein the display screen comprises a main screen and/or an expansion screen of the electronic equipment; in response to an operation of moving a target object in the main screen or the extension screen to the target screen based on the target window, the target object is displayed on the target screen, the target screen being a screen different from a screen to which the target object belongs before being moved. The method and the device have the advantages that the target object can be rapidly moved to different display screens for display through the target window, so that the object can be moved on the different screens more conveniently and accurately.

In the embodiment of the application, the target window is displayed on the display screen of the electronic equipment based on the trigger instruction. Wherein the trigger instruction is obtained, including at least one of:

and in the first mode, the trigger operation acting on the target button or the target control is detected, and the trigger instruction is determined to be obtained.

In the first mode, the trigger instruction is obtained based on a trigger operation, wherein the trigger operation may be an operation received by a target button or a target control. The target key may be an entity key in the input device, such as a key in a keyboard, and the setting of the execution function corresponding to the target key is to trigger the display of the target window, specifically, may be implemented by setting a shortcut key, for example, "alt+q" in the keyboard is set as a shortcut key for displaying the target window, and when the user presses the shortcut key, the corresponding trigger operation is determined to be a trigger instruction, so as to trigger the display screen of the electronic device to display the target window. Correspondingly, the target key can also be a virtual key, such as a virtual key identifier displayed through projection in the touch pad, and the corresponding trigger operation is determined to be a trigger instruction when the user touches the corresponding target key. The control refers to encapsulation of data and a method, wherein the target control in the embodiment of the application refers to encapsulation of a method for displaying a target window on a display screen of an electronic device, specifically, the target control may be a user interface control including interface elements such as a window, a text box, a button, a drop-down menu and the like, if the target control includes the drop-down menu, an option for displaying the target window is provided in the drop-down menu, and an operation of selecting the option by a user is determined as a trigger instruction, so that after the user selects the option, the target window is displayed on the display screen of the electronic device.

And secondly, detecting that at least one expansion screen is connected or disconnected, and determining to acquire the trigger instruction.

In the embodiment of the application, the electronic equipment is provided with the main screen and the extension screen, wherein the main screen can be a display screen of the electronic equipment and can also be a display screen connected with the electronic equipment and meeting specific conditions. When the extended screen is detected to be connected to the electronic device, an application matched with the extended screen is started, for example, identification information related to the extended screen is generated when the screen is identified. Therefore, when the access of the expansion screen to the electronic device is detected, the trigger instruction can be automatically generated, so that the access of the expansion screen can be identified, and display information corresponding to the access of the expansion screen can be generated, namely, a target window is displayed on the display screen of the target device. Similarly, when it is detected that the extension screen is disconnected, the trigger instruction is determined to be obtained, and the extension screen is disconnected, for example, the extension screen a is used as a display of the host a, and when the extension screen a is disconnected from the host a and is connected to the host B, that is, is used as the extension screen of the host B, the trigger instruction is also generated. Correspondingly, if the current host is connected with three expansion screens, one expansion screen is disconnected with the current host, the trigger instruction is also generated, and the trigger instruction indicates that the display target window is an updated target window and the target window corresponding to the three expansion screens connected before are different.

It should be noted that, in the embodiment of the present application, the connection manner between the extension screen and/or the main screen and the electronic device may be a wired connection or a wireless connection, where the wired connection may be a wired network connection or an adaptive connection manner between the wired display and the host, and correspondingly, the wireless connection may be a wireless network connection, a bluetooth connection, or a wireless screen-throwing manner.

And thirdly, detecting that the electronic equipment is switched from the current operation mode to the target operation mode, and determining to obtain a trigger instruction.

The current operating mode refers to a normal operating mode of the electronic device, while the target operating mode may characterize a mode in which the extended screen needs to be activated. For example, the current operation mode may be a display mode of the electronic device for information based on the main screen, if the user starts the application of the extension screen, the current connected extension screen is identified by identifying the starting instruction, and the current operation mode is entered into the display mode of the extension screen, and a trigger instruction for displaying the target window correspondingly is generated. For another example, when the current all-in-one mode is switched to the display mode, a trigger instruction is obtained, and the display mode is a display mode for a plurality of screens. Or switching from the current information browsing mode to the office mode to obtain a trigger instruction, so that a target window can be displayed on the display screen, and the application of the expansion screen is started. Or the trigger instruction is obtained by switching the operation mode of the main screen or the operation mode of the electronic device, for example, the electronic device is switched from the current sleep mode to the normal operation mode, and the trigger instruction is determined to be obtained. For another example, the electronic device is a notebook computer, the main screen is a notebook display screen, when detecting that the unfolded state of the notebook is switched to the box cover state, the electronic device can identify that other display screens are possibly started to display information, and the trigger instruction is determined to be obtained.

And fourthly, detecting that the electronic equipment is accessed to the target network, and determining to obtain the trigger instruction.

The target network may be a network having a different attribute or state from the current network of the electronic device, or may be a network connected from a network-free state to a network-free state. If the electronic device is currently in the wired network connection mode, when switching to the wireless network connection mode, the trigger instruction can be determined to be obtained. Or the electronic equipment is accessed into the target local area network from an unconnected state to finish office tasks, and the trigger instruction is determined to be obtained.

And fifthly, detecting the starting target process of the electronic equipment, and determining to acquire the trigger instruction.

The target process may be an application process related to a screen process or a display process, such as a screen management application, such as an information multi-screen display application.

And a sixth mode is to detect and acquire a screen management request and determine to acquire the trigger instruction.

The screen management request refers to a request for managing display screens of the current electronic device, for example, a request for displaying all display screens of the electronic device, and after identifying the request, relevant information of a main screen and/or an extended screen of the electronic device may be predicted to be displayed, so that the trigger instruction may be determined to be obtained after the request is detected. It should be noted that the screen management request may be a request generated by the user based on the electronic device, such as a request for invoking a screen management menu. Or may be a request sent by another terminal received by the electronic device, such as a remote screen management request, etc.

And seventhly, determining to obtain the trigger instruction when detecting that the moving track of the target object meets the preset condition.

The target object is an object in a display screen of the electronic device, and can be an object on a main screen or an object in an extension screen, and the moving track of the target object refers to track information for moving the target object from an original position to a target position. The preset condition may be a line condition of the track, or may be a condition of a predicted end point region in the track. Taking a preset condition as a condition for predicting an end point area as an example, identifying a moving track of a target object to obtain an end point area corresponding to the moving track, if the end point area is positioned in a boundary area of a current display screen, presetting a requirement for moving the target object to other screens for display, and determining to obtain a trigger instruction so as to display a target window on the display screen.

It should be noted that, in the embodiment of the present application, whether there is a need to generate a target window is comprehensively analyzed based on the current application scenario in combination with the state, display requirement, access information, application process information, receiving or sending information, network state, etc. of the electronic device, if there is a need, it may be determined to obtain a trigger instruction, so that the target window is displayed on the display screen of the electronic device based on the trigger instruction. Thereby meeting the realization requirement that the electronic equipment is in any application scene.

After the trigger instruction is obtained, displaying a target window on a display screen of the electronic device based on the trigger instruction, and correspondingly, in the embodiment of the application, displaying the target window on the display screen of the electronic device, including one or more of the following conditions:

(1) The first target window is displayed on a main screen and/or an extension screen of the electronic device.

The first target window displays identifiers corresponding to the main screen and the expansion screen. In this manner, the first target window may be displayed on all display screens of the electronic device, such as the main screen and the extension screen, or may be displayed on only the main screen, or may be displayed on only the extension screen. The display content included in the first target window is the identification corresponding to the main screen and the expansion screen, namely the identification of each display screen of the electronic device is included in the first target window. If the main screen of the electronic device is identified as a main screen 001 and the three corresponding identifications of the extension screen are respectively an extension screen 002, an extension screen 003 and an extension screen 004, the contents displayed in the first target window are the main screen 001, the extension screen 002, the extension screen 003 and the extension screen 004. The first target window may be a screen management window in an actual application scene, that is, an area corresponding to each screen is displayed.

(2) And displaying a second target window on a main screen of the electronic device, and displaying a third target window on an extension screen of the electronic device.

The second target window is at least an identifier corresponding to the screen where the display is located, and the third target window is at least not displayed with the identifier corresponding to the screen where the display is located. In this manner, the corresponding target windows are displayed on the main screen and the extension screen, that is, the second target window is displayed on the main screen, the third target window is displayed on the extension screen, and the respective displayed target windows do not include their own corresponding screen identifiers. For example, the second target window displayed in the home screen includes only the identifications corresponding to the respective extension screens.

(3) And obtaining the attribute information of the trigger instruction, and displaying a corresponding target window on a display screen of the electronic equipment at least based on the attribute information.

In the embodiment, the trigger instruction is analyzed to obtain the corresponding attribute information to display the target window, so that different target windows can be displayed based on different trigger instructions. The attribute information may include an application attribute of the current electronic device, a status attribute of the electronic device, a display screen attribute of the electronic device, and an information attribute to be displayed. For example, when the trigger instruction of the electronic device is generated based on the accessed extension screen, if it is detected that the extension screen newly accessed by the electronic device includes the extension screen 2 and the extension screen 3, a target window is displayed on the main screen, and the target window includes the identifiers corresponding to the extension screen 2 and the extension screen 3. For another example, the resolution of the main screen is obtained through the attribute information, and the resolution of the information to be displayed is higher than the resolution of the main screen, a target window is generated on the main screen, and the target window includes the identification of the extended screen meeting the resolution requirement of the information to be displayed.

(4) And obtaining the use information of the electronic equipment, and displaying the corresponding target window on a display screen of the electronic equipment at least based on the use information.

The usage information of the electronic device includes information of multiple dimensions, such as a running state dimension, a usage parameter dimension and a usage object dimension, and specifically may include, but is not limited to, running information of the electronic device, usage object information, a usage duration, a usage frequency, historical usage data, a historical call application, and the like. If the electronic equipment is identified to comprise a plurality of using objects, performing biological characteristic identification on the current using object to determine the identification information of the current using object, and then determining an extension screen frequently applied by the current using object based on the identification information of the current using object, so that a target window displayed in the display screen of the electronic equipment comprises the identification of the extension screen frequently applied by the object. For another example, operation information of the electronic device is obtained, an expansion screen with higher information transmission efficiency of the electronic device can be determined by analyzing the operation information, and then an identifier corresponding to the expansion screen is displayed in the target window.

In the embodiment of the application, the content or the display form of the corresponding target window displayed in the display screen is determined based on the screen information of the electronic equipment, the attribute information of the triggering instruction, the use information of the electronic equipment and the like, so that the displayed target window can be automatically matched with different processing requirements, and the user experience effect is improved.

Based on the foregoing embodiments, in the embodiments of the present application, the operation of moving the target object in the main screen or the extension screen to the target screen based on the target window includes at least one of the following modes:

Mode one, an operation of moving a target object in a home screen or an extension screen to a target position in a target window.

The target position is an area where a target mark corresponding to the target screen is located. Referring to fig. 3, a schematic diagram of a target window display provided in an embodiment of the present application is shown on a home screen of an electronic device, where the home screen is identified as a home screen 001. The electronic device comprises two expansion screens, the corresponding identifications of the two expansion screens are expansion screen 002 and expansion screen 003, and corresponding areas comprising different identification information are displayed in a target window, for example, the identification information corresponding to the area 1 is a main screen 001, the identification information corresponding to the area 2 is expansion screen 002, and the identification information included in the area 3 is expansion screen 003. When the target object moves to a different area of the target window, it is displayed on the corresponding screen. For example, when the target object is dragged to the region 2 of the target window, the target object is displayed on the expansion screen 2.

If the position of the target object dragged does not belong to any one of the areas, the position belongs to an invalid operation and is not displayed on any display screen. Only when the target object moves to a position within the area, the target object can be displayed on the display screen corresponding to the area. For example, if the target object needs to be displayed on the expansion screen 003, the target object is moved to the region 3 of the target window.

And secondly, moving a screen identifier corresponding to a screen to which the target object belongs in the target window to a target position.

In this manner, the target position is an area where the target mark of the corresponding target screen is located. Still taking fig. 3 as an example, if the target object on the main screen is moved to the extension screen 002 for displaying, after the target object is selected, the identifier of the main screen in the target window may be moved to the area 2 corresponding to the extension screen 002, so that the moving operation is completed, and the target object may be displayed on the extension screen 002.

And thirdly, moving the target mark corresponding to the target screen in the target window to the position of the target object.

In this embodiment, the target object may not be moved, but the identification of the corresponding target screen may be moved. For example, when the target window is displayed on the main screen and the target object in the main screen needs to be displayed on the extension screen, the identifier corresponding to the extension screen in the target window may be moved to the position where the target object in the main screen is located, so that the target object is displayed on the extension screen.

And fourthly, inputting the marking information corresponding to the target object in the main screen or the expansion screen into the target position in the target window.

The target position is an area where a target identifier corresponding to the target screen is located, wherein the mark information may be a name identifier of the target object, a coordinate mark of the target object, number information of the target object, and the like. In this embodiment, the target object realized based on the information input operation is displayed in a different display screen. If the target object of the extension screen needs to be displayed in the home screen, and the name of the target object is identified as document a, then "document a" may be input in the area corresponding to the home screen in the target window of the extension screen where the target object is located, so that the target object is displayed on the home screen.

According to the embodiment of the application, different moving operations for the target object can be realized based on the target window, so that the requirement of displaying the target object on different display screens is met, and only related operations for the target window are performed, and operations do not need to be performed across the edges of the screens, so that the operation is more convenient.

Based on the foregoing embodiments, in response to an operation of moving a target object in a home screen or an extension screen to a target position in a target window in an embodiment of the present application, displaying the target object on the target screen includes:

Acquiring editing state information of a target window;

If the target window is not editable, monitoring first coordinate information of a first operation of the moving target object, and if the first coordinate information is matched with the target position, displaying the target object on a target screen; and/or the number of the groups of groups,

If the target window is editable, monitoring whether the operation of moving the target object comprises a second operation at the target position, and if the operation comprises the second operation, displaying the target object on a target screen.

In this embodiment, it is necessary to determine whether or not the target object can be displayed on the target screen based on the editing status information of the target window. By identifying the editing state information, whether the target window can be edited or not can be obtained, wherein if the target window can be edited, the target window can receive a corresponding operation instruction and respond to the operation instruction, and the response mode of the target window can be set, for example, the corresponding area of the target window can be activated through clicking, or corresponding menu information can be displayed through a right key.

If the target window is not editable, the first coordinate information of the first operation of the moving target object is monitored, and the target object can be displayed on the target screen only if the first coordinate information is matched with the target position. The first coordinate information may be end point information reached by the moving target object. For example, after the target object is moved to the area corresponding to the second expansion screen in the target window, stopping, if the obtained first coordinate information is matched with the effective identification area corresponding to the second expansion screen, then moving the target object to the second expansion screen. If the target object is moved to the edge area corresponding to the second expansion screen, the obtained first coordinate information is not matched with the effective identification area corresponding to the second expansion screen, and the target object is not moved to the second expansion screen for display.

If the target window is editable, it is necessary to monitor whether a second operation included in the target position is included in the operations for the target object, which is a determination operation of the currently moving target position, so that it is possible to determine to move the target object to the target position. The corresponding operation may be a click confirmation operation or may be an operation of calling a corresponding display menu based on the second operation and selecting information in the display menu. For example, after the target object is dragged to the target position and is determined by double-clicking the right key, the target object is displayed on the display screen corresponding to the target position. Or a target object, such as a copy target object, can be selected, and a paste option is selected at a target position through right click, so that the target object is displayed on a target screen.

It should be noted that, the state of the target window may be switched in different application scenarios, for example, in some application scenarios, in order to avoid misoperation, the target window may be set to an editable state, and if less scenarios are applied to the expansion screen, the target window may be set to an uneditable state. Based on the edit status of the target status, it is flexibly verified whether the operation on the target object satisfies the condition of moving it to the target screen display. According to the embodiment of the application, the operation of the moving target object can be identified based on the state of the target window, so that the requirement that the target object is displayed on different display screens can be more accurately met.

Based on the foregoing examples, in one implementation, displaying a target object on a target screen includes:

And displaying the target object determined from the first screen on the target screen in response to an operation of moving or inputting the first identification corresponding to the first screen in the display screen to the target position in the target window.

The target position is an area where a target mark corresponding to the target screen is located; the first screen is any one of a home screen and an extension screen. In this embodiment, when the first identifier corresponding to the first screen is moved or input to the target position, it is known that the target object in the first screen needs to be displayed on the target screen. The first identifier may be a name identifier of the first screen, or may be number information of the first screen.

In another embodiment, displaying a target object on a target screen includes:

in response to an operation of modifying the identification of the target object of the home screen or the extension screen to the target identification of the corresponding target screen, the target object is displayed on the target screen.

In this embodiment, corresponding objects in different display screens may have an identification naming convention corresponding to the display screen in which they are located. If the target object belongs to the first screen, when the object belongs to the first screen, the corresponding identification prefix is 100, the identification rule is used for identifying the target object as 100A, and the target screen corresponds to the second screen, when the object belongs to the second screen, the corresponding identification prefix is 100, and if the identification of the target object on the second screen is 200A, for example, the modification of the identification of the target object into the target identification corresponding to the target screen through voice control information is controlled, so that the target object can be displayed on the target display screen. Thus, upon recognition of a change in the identity of the target object, the display of the target object on the target screen is triggered.

In the embodiment of the application, the target object can be determined to be displayed on the target screen based on the triggering mode of voice and gesture recognition, for example, the target object which needs to be displayed on the target screen is determined based on voice information. Specifically, "please select the third row of the second document", then performing related operation on the area of the target screen identifier corresponding to the target window to determine to display the document on the target screen. The target object may be moved to the target position of the target window by a gesture, so that the target object is displayed on a screen corresponding to the target position.

Further, in the above embodiment, determining the target object from the first screen includes:

and determining the application window at the forefront end of the current screen in the first screen as a target object.

In this embodiment, if the first screen includes a plurality of application windows displayed therein, the application window currently at the forefront of the screen is determined as the target object, that is, the application window currently maximized is determined as the target object or the application window recently edited by the user is determined as the target object.

Or alternatively;

and determining an object with a first association relationship with an application window displayed at the forefront end of the screen in the target screen in the first screen as a target object.

The application window displayed at the forefront end of the screen in the target screen can be an application window which is currently used or has a display requirement, and then an object which has a first association relation with the application window is determined to be a target object in the first screen. The first association may characterize that both have the same document format, the same attribute, or are in the same project or business scenario. If the application window at the forefront end of the current target screen is a teaching content display, the ancient poetry picture associated with the teaching content in the first screen can be taken as a target object, so that the ancient poetry picture is displayed in the target screen.

Or alternatively;

and determining the object with the movement track meeting the preset condition in the first screen as a target object.

By analyzing the movement track of the object, information such as the movement direction, angle, line, end position and the like of the object can be obtained. The object movement purpose can then be determined, if the position of the object in the first screen is adjusted, or if the object needs to be moved to the target screen for display. If the movement track is analyzed, the area to which the object moves can be determined to be the screen edge area, the object can be predicted to be required to be displayed on other display screens, and the object is determined to be a target object. Or the moving track is identified as the track for moving the object to the target window, and the object is determined to be the target object.

Or alternatively;

The first preset function is a function determined based on an application scene and an actual display requirement, for example, the first preset function may be a function capable of displaying information matched with target information when the target information is displayed, or may be a function capable of being matched with a trigger instruction. For example, if the setting of the page layout is required in the target screen, an application in the first screen that can satisfy the page layout setting function is determined as a target object, and the application is displayed on the target screen, so that the setting of the page layout can be completed based on the application.

In the embodiment of the application, the operation of moving the target object in the main screen or the extension screen to the target screen based on the target window is an effective operation, that is, the operation of displaying the target object on the target screen can be realized. But not every operation is an effective operation that enables display on the target screen. In one embodiment, the method comprises:

acquiring an operation of moving a target object based on the target window;

Detecting screen content corresponding to the target area;

Firstly, an operation of moving a target object based on a target window is obtained, and then the operation is analyzed to obtain a target area of the target object moving to the target window. And detecting the screen content of the display screen corresponding to the different areas in the target window, and determining whether the screen of the target object and the screen to be displayed belong to the same screen or are similar screens according to the screen content, wherein if the screen is the same screen or is similar, the operation may be misoperation, and the target object is not displayed on the screen corresponding to the target area. If the screen contents obtained based on the screen content detection do not match, the operation may be determined as an operation to move the target object in the main screen or the extension screen to the target screen based on the target window, thereby displaying the target object on the target screen.

Further, when an operation of moving the target object in the main screen or the extension screen to the target screen based on the target window is detected, the current screen content of the target screen may also be detected to determine whether the target screen meets the display requirement of the target object. For example, if it is detected that the target screen is playing video information and the target object is a picture, the playing of the video is affected if the picture is displayed on the target screen, so that corresponding prompt information may be generated to prompt the user whether the target object is necessarily to be displayed on the target screen, if the received feedback information is not to be displayed, the target screen continues playing the video, and if the feedback information is to be displayed, the playing of the video is interrupted and the picture is displayed.

When it is determined that the target object is to be displayed in the target screen, if the target object is a document that is not opened or displayed, the document may be displayed at any position in the target screen, preferably in a screen blank area of the target screen. If the target object is in the window form, the target object is also displayed in the window form when displayed in the target screen.

In one embodiment of the present application, the optimal display position of the target object on the target screen may also be determined based on the information of the target window, the screen to which the target object belongs, and the screen to be displayed.

Specifically, displaying the target object on the target screen includes:

acquiring at least one of first position information of a target object in a target window corresponding to a region of a target screen, second position information of the target window in a display screen, or third position information of a region of the target screen in the target window;

Acquiring screen size ratio information of a display screen and a target screen;

Determining a target display position based on at least one of the first position information, the second position information, and the third position information and the screen size ratio information;

Coordinate information of the target object in the target screen area can be obtained based on the first position information; based on the second position information and the third position information, scaling information of the target screen area and the current display screen may be determined. And then, the proportional relation between the area corresponding to the target screen and the target screen can be determined according to the screen size ratio information of the display screen and the target screen, and the coordinate information of the target object in the target screen can be determined based on the proportional relation and the first information, namely, the target display position can be determined, so that the target object is displayed at the target display position of the target screen.

The coordinates of the starting point of the first screen to which the target object belongs and the target screen of the screen to be displayed can also be obtained, and then the position of the target object on the target screen is calculated. For example, the first screen has a start point of (0, 0) and a width of 1920; the starting point of the target screen is (1920,0), the sizes of the two screens can be obtained by utilizing the width and height information in the boundary information in the screen information, if the target object is positioned at the left upper corner of the first screen, the ratio of the left upper corner coordinate and the sizes of the two screens is obtained, and the position of the target object on the target screen can be calculated.

In an actual application scenario, the screen management window may be taken as a target window. Referring to fig. 4, an application scenario schematic diagram based on a screen management window according to an embodiment of the present application is shown on a main screen. When the electronic device detects the extended screen information, the extended screen information is acquired, and extended screen shortcut interface information (such as extended screen position information and resolution information) can be created. And based on the screen management window, the shortcut interface information is added into the screen management window, and in fig. 4, the shortcut interface information is embodied as the corresponding identifier of each screen. For example, the region marked 1 corresponds to the main screen, the region marked 2 corresponds to the first extension screen, and the region marked 3 corresponds to the second extension screen. When the mouse moves or drags an object to a relevant area in a corresponding screen management window, the object may be directly displayed on a screen corresponding to the area. Further, in order to prevent the misoperation corresponding to the mouse or related operations from being generated, a right key or a shortcut key can be set to activate a corresponding area, so that the purpose of displaying the object on the target screen is achieved. For example, moving the object to the area marked with 3, the object will be displayed on the second extension screen.

Correspondingly, a shortcut window which is independently created can be used as a target window, and only the identification area of the screen except the screen where the target window is located can be displayed in the shortcut window. As shown in fig. 5, after moving the object corresponding to the icon 1 to the area corresponding to the expansion screen 1 in the shortcut window and moving the application window a to the area corresponding to the expansion screen 2, the icon 1 is displayed on the expansion screen 1, and the application window a is displayed on the expansion screen 2.

Referring to fig. 6, in order to provide a control device according to a second embodiment of the present application, the technical solution in this embodiment is mainly used to improve the convenience and accuracy of displaying objects on different screens.

Specifically, the apparatus in this embodiment may include the following units:

an obtaining unit 601, configured to obtain a trigger instruction, and display a target window on a display screen of an electronic device, where the display screen includes a main screen and/or an extension screen of the electronic device;

And a display unit 602 configured to display a target object in the main screen or the extension screen on the target screen in response to an operation of moving the target object to the target screen based on the target window, the target screen being a screen different from a screen to which the target object was previously moved.

As can be seen from the above technical solution, the second embodiment of the present application discloses a control device, which includes: acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, wherein the display screen comprises a main screen and/or an expansion screen of the electronic equipment; in response to an operation of moving a target object in the main screen or the extension screen to the target screen based on the target window, the target object is displayed on the target screen, the target screen being a screen different from a screen to which the target object belongs before being moved. The method and the device have the advantages that the target object can be rapidly moved to different display screens for display through the target window, so that the object can be moved on the different screens more conveniently and accurately.

In one embodiment, the acquisition unit 601 comprises a subunit of at least one of:

the first detection subunit is used for detecting triggering operation acting on a target button or a target control and determining to acquire the triggering instruction;

Or alternatively, the first and second heat exchangers may be,

The second detection subunit is used for detecting that at least one expansion screen is connected or disconnected, and determining to obtain the trigger instruction; or alternatively, the first and second heat exchangers may be,

The third detection subunit is used for detecting that the electronic equipment is switched from the current operation mode to the target operation mode, and determining to obtain the trigger instruction; or alternatively, the first and second heat exchangers may be,

The fourth detection subunit is used for detecting that the electronic equipment is accessed to the target network and determining to acquire the trigger instruction; or alternatively, the first and second heat exchangers may be,

A fifth detection subunit, configured to detect that the electronic device starts a target process, and determine to obtain the trigger instruction; or alternatively, the first and second heat exchangers may be,

A sixth detection subunit, configured to detect that a screen management request is obtained, and determine that the trigger instruction is obtained; or alternatively, the first and second heat exchangers may be,

And the seventh detection subunit is used for detecting that the moving track of the target object meets a preset condition and determining to obtain the trigger instruction.

Optionally, the obtaining unit includes a first display subunit, configured to display a target window on a display screen of the electronic device, where the first display subunit is specifically configured to:

In one embodiment, the display unit 602 includes:

the first acquisition subunit is used for acquiring the editing state information of the target window;

A first monitoring subunit, configured to monitor first coordinate information of a first operation of moving the target object if the target window is not editable, and if the first coordinate information matches the target position, display the target object on the target screen; and/or the number of the groups of groups,

And the second monitoring subunit is used for monitoring whether the operation of moving the target object comprises a second operation at the target position if the target window is editable, and displaying the target object on the target screen if the operation comprises the second operation.

Wherein displaying the target object on the target screen includes:

Wherein determining a target object from the first screen comprises:

Wherein the operation of moving the target object in the main screen or the extension screen to the target screen based on the target window includes:

acquiring an operation of moving a target object based on the target window;

Detecting screen content corresponding to the target area;

Optionally, the display unit 602 includes a second display subunit, configured to display the target object on the target screen, where the second display subunit is specifically configured to:

It should be noted that, the specific implementation of each unit in this embodiment may refer to the corresponding content in the foregoing, which is not described in detail herein.

Referring to fig. 7, a schematic structural diagram of an electronic device according to a third embodiment of the present application is provided, and the technical solution in this embodiment is mainly used to improve the convenience and accuracy of displaying objects on different screens.

Specifically, the electronic device in this embodiment may include the following structure:

a memory 701 for storing an application program and data generated by the operation of the application program;

A processor 702, configured to execute the application program to implement:

According to the technical scheme, the electronic equipment disclosed by the third embodiment of the application obtains the trigger instruction, and the target window is displayed on the display screen of the electronic equipment, wherein the display screen comprises the main screen and/or the extension screen of the electronic equipment; in response to an operation of moving a target object in the main screen or the extension screen to the target screen based on the target window, the target object is displayed on the target screen, the target screen being a screen different from a screen to which the target object belongs before being moved. The method and the device have the advantages that the target object can be rapidly moved to different display screens for display through the target window, so that the object can be moved on the different screens more conveniently and accurately.

Based on the foregoing embodiments, the present application further provides a storage medium having stored thereon computer program code which, when executed by a processor, implements an audio processing method as described in any of the above.

It should be noted that, the specific implementation of the processor in this embodiment may refer to the corresponding content in the foregoing, which is not described in detail herein.

In the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, and identical and similar parts between the embodiments are all enough to refer to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.

Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software modules may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A control method, comprising:

Acquiring a trigger instruction, and displaying a target window on a display screen of electronic equipment, wherein the display screen comprises a main screen and an expansion screen of the electronic equipment;

when a target object is an object located in the main screen, displaying the target object on a target screen in response to an operation of moving the target object in the main screen to the target screen based on the target window;

When a target object is an object located in the extension screen, displaying the target object on the target screen in response to an operation of moving the target object in the extension screen to the target screen based on the target window;

Wherein the target screen is a screen different from a screen to which the target object belongs before being moved.

2. The method of claim 1, the obtaining a trigger instruction comprising at least one of:

Or alternatively, the first and second heat exchangers may be,

3. The method of claim 1 or 2, wherein displaying the target window on a display screen of the electronic device comprises:

Displaying a first target window on a main screen and an expansion screen of the electronic equipment, wherein the first target window is displayed with identifiers corresponding to the main screen and the expansion screen; or alternatively, the first and second heat exchangers may be,

4. A method according to claim 3, wherein moving the target object in the home screen or extended screen to a target screen based on the target window comprises:

5. The method of claim 4, wherein displaying the target object in the target screen in response to an operation to move the target object in the home screen or the extension screen to a target position in the target window comprises:

Acquiring editing state information of the target window;

6. The method of claim 3, wherein displaying the target object on the target screen comprises:

7. The method of claim 6, wherein determining a target object from the first screen comprises:

8. The method of claim 1, wherein moving the target object in the home screen or the extended screen to the target screen based on the target window comprises:

acquiring an operation of moving a target object based on the target window;

Detecting screen content corresponding to the target area;

9. The method of claim 1, the displaying the target object on the target screen, comprising:

10. A control apparatus comprising:

The electronic equipment comprises an acquisition unit, a display unit and a display unit, wherein the acquisition unit is used for acquiring a trigger instruction, and displaying a target window on a display screen of the electronic equipment, and the display screen comprises a main screen and an expansion screen of the electronic equipment;

A display unit configured to display a target object in the home screen in response to an operation of moving the target object in the home screen to a target screen based on the target window when the target object is an object located in the home screen; when a target object is an object located in the extension screen, displaying the target object on the target screen in response to an operation of moving the target object in the extension screen to the target screen based on the target window; wherein the target screen is a screen different from a screen to which the target object belongs before being moved.