CN117707395A - Response processing method, electronic device and storage medium - Google Patents

Abstract

The application discloses a response processing method, electronic equipment and a storage medium, relates to the technical field of terminals, and is used for solving the problem that a current window does not respond due to focus robbery of a newly displayed window. The method comprises the following steps: the electronic equipment displays a first window, and a cursor is displayed on a first object of the first window; the electronic device receives a mouse-down event from an input device of the electronic device; the electronic device displays a second window, the focus is occupied by the second window, and the electronic device receives a mouse release event from an input device of the electronic device; in a case where the cursor is displayed on the first object, the electronic device responds to the operation of the first object based on the mouse-down event and the mouse-release event.

Description

Response processing method, electronic device and storage medium

Technical field

The present application relates to the field of terminal technology, and in particular, to a response processing method, electronic device and storage medium.

Background technique

When a user uses an electronic device (such as a terminal), the electronic device will display relevant content to the user in the form of a window so that the user can perform relevant operations or view relevant content in the window. For example, when a user uses an input device (such as a mouse device) to perform a related operation (such as a click operation) on a window displayed by the electronic device, the window will trigger a corresponding response.

Contents of the invention

This application provides a response processing method, electronic device, and storage medium to solve the problem of the current window not responding due to a newly displayed window grabbing focus.

In order to achieve the above purpose, this application adopts the following technical solutions:

The first aspect provides a response processing method applied to electronic devices. The method includes:

The electronic device displays a first window and displays a cursor on a first object of the first window;

The electronic device receives a mouse press event from an input device of the electronic device;

The electronic device displays a second window, and the focus is occupied by the second window, and the electronic device receives a mouse release event from an input device of the electronic device;

When the cursor is displayed on the first object, the electronic device responds to the operation of the first object based on the mouse press event and the mouse release event.

In the above technical solution, after the cursor is displayed on the first object of the first window and the mouse press event from the input device of the electronic device is received, if the second window is newly displayed and the focus is occupied by the second window, After receiving a mouse release event from the input device of the electronic device, it can be determined whether to respond to the operation of the first object in the first window by determining whether the cursor is displayed on the first object. Furthermore, when the cursor is displayed on the first object, based on the mouse press event and the mouse release event, the mouse operation can be performed in the first window in response to the operation of the first object. The incident was responded to smoothly. In this way, by setting the judgment condition of the cursor position, it can be determined whether the current first window needs to process this mouse operation event. Furthermore, when the second window is newly displayed, the current first window that needs to process the mouse operation event continues to respond, which can solve the problem of the current window not responding due to the newly displayed window grabbing focus, and improve the response. Processing reliability.

In a possible implementation of the first aspect, the electronic device includes an event monitor, the event monitor is used to monitor mouse press events and mouse release events of an input device of the electronic device;

The method also includes:

The event monitor sends the mouse press event and the mouse release event to the process corresponding to the first window.

In this possible implementation, a method for obtaining the current mouse operation event for the first window is provided. Wherein, when receiving a mouse press event from the input device of the electronic device, the mouse press event needs to be sent to the process corresponding to the first window, so that the subsequent process corresponding to the first window can based on the received mouse press event. Press event to handle. When the second window is newly displayed, when receiving a mouse release event from the input device of the electronic device, the mouse release event needs to be sent to the process corresponding to the first window so that the process corresponding to the first window can be followed. Processing based on the mouse release event received. In this way, it can be ensured that the mouse operation event is successfully responded to in the first window, thereby improving the reliability of the response processing.

In another possible implementation of the first aspect, the event monitor sends the mouse press event and the mouse release event to the process corresponding to the first window, including:

When the mouse press event and the mouse release event are preset mouse events, the event monitor sends the mouse press event and the mouse release event to the process corresponding to the first window.

In this possible implementation, a method of triggering and sending this mouse operation event based on a preset mouse event is provided. Wherein, when receiving a mouse press event from the input device of the electronic device, by judging whether the mouse press event belongs to a preset mouse event, it is ensured that the mouse press event belongs to the preset mouse event. The process corresponding to the first window sends the mouse press event. When the second window is newly displayed, when a mouse release event from the input device of the electronic device is received, it is determined whether the mouse release event belongs to the preset mouse event to ensure that the mouse release event belongs to the preset mouse event. In this case, the mouse release event is sent to the process corresponding to the first window. In this way, it can be ensured that the mouse operation event is successfully responded to in the first window, thereby improving the reliability of the response processing.

In another possible implementation of the first aspect, after the event monitor sends the mouse release event to the process corresponding to the first window, the method further includes:

Switch the focus from the second window to the first window.

In this possible implementation, when the second window is newly displayed, by continuing to send the mouse release event to the process corresponding to the first window, the focus can be switched back to the first window, thereby solving the problem of the new window. The problem of the displayed window grabbing focus and causing the current window to become unresponsive has improved the reliability of response processing.

In another possible implementation of the first aspect, after the electronic device receives a mouse release event from the input device of the electronic device, the method further includes:

The event monitor obtains a position detection result of the cursor, and the position detection result is used to indicate whether the cursor is displayed on the first object.

In this possible implementation, a method of obtaining the position detection result of the cursor is provided, which can quickly and accurately determine whether the cursor is displayed on the first object.

In another possible implementation of the first aspect, the mouse press event includes a first position in the display screen corresponding to the mouse press, and the mouse release event includes a second position in the display screen corresponding to the mouse release;

The electronic device responds to the operation of the first object based on the mouse press event and the mouse release event, including:

When both the first position and the second position are located within the first window, the electronic device responds to the operation of the first object within the first window.

In this possible implementation, the mouse press is determined by determining whether the first position corresponding to the mouse press event and the second position corresponding to the mouse release event in this mouse operation event are both located within the first window. Whether the next event and the mouse release event belong to the same mouse operation event are ensured to respond to the same mouse operation event, avoid abnormal response problems, and improve the reliability of response processing.

In another possible implementation of the first aspect, the first window is a window including a target control;

When both the first position and the second position are located within the first window, the electronic device responds to the operation of the first object within the first window, including:

When both the first position and the second position are located in the first window, the electronic device switches the display state of the target control from the first state to the second state in the first window.

In this possible implementation, a response processing solution using a control window as an example is provided, which can enable the control window that needs to process this mouse operation event to continue to respond when the second window is newly displayed, and also That is, the display state of the target control is switched from the first state to the second state, which improves the reliability of response processing.

In another possible implementation of the first aspect, the first window is a window including text content;

When both the first position and the second position are located within the first window, the electronic device responds to the operation of the first object within the first window, including:

When both the first position and the second position are located within the first window, the electronic device displays a third window within the first window, the third window including at least one functional control related to the text content .

In this possible implementation, a response processing solution using a text window as an example is provided, which can enable the text window that needs to process this mouse operation event to continue to respond when the second window is newly displayed, and also That is, the third window including at least one functional control is displayed, which improves the reliability of response processing.

In a second aspect, this application provides an electronic device, including: a display screen, a memory, and a processor. The display screen is used to provide display functions. The memory is used to store program code, and the processor is used to call the program code stored in the memory, thereby implementing any method provided in the first aspect.

In a third aspect, a computer-readable storage medium is provided, including program code. When the program code is run on an electronic device, it causes the electronic device to execute any method provided in the first aspect.

A fourth aspect provides a computer program product, including program code. When the program code is run on an electronic device, it causes the electronic device to execute any method provided in the first aspect.

It should be noted that the technical effects brought by any implementation method in the second to fourth aspects can be referred to the technical effects brought by the corresponding implementation method in the first aspect, and will not be described again here.

Description of the drawings

Figure 1 is a schematic diagram of an electronic device provided by an embodiment of the present application;

Figure 2 is a schematic diagram of a display screen of an electronic device provided by an embodiment of the present application;

Figure 3 is a schematic diagram of a display screen of an electronic device provided by an embodiment of the present application;

Figure 4 is a schematic diagram of a display screen of an electronic device provided by an embodiment of the present application;

Figure 5 is a schematic diagram of a display screen of an electronic device provided by an embodiment of the present application;

Figure 6 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application;

Figure 7 is a schematic diagram of the software structure of an electronic device provided by an embodiment of the present application;

Figure 8 is a schematic flowchart of a response processing method provided by an embodiment of the present application;

Figure 9 is an architectural schematic diagram of a response processing method provided by an embodiment of the present application;

Figure 10 is an architectural interaction diagram of a response processing method provided by an embodiment of the present application;

Figure 11 is a structural block diagram of a response processing device provided by an embodiment of the present application.

Detailed ways

In the description of this application, unless otherwise stated, "/" means "or". For example, A/B can mean A or B. "And/or" in this article is just an association relationship that describes related objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone these three situations. In addition, "at least one" means one or more, and "plurality" means two or more. Words such as "first" and "second" do not limit the quantity and order of execution, and words such as "first" and "second" do not limit the number or order of execution.

It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design described herein as "exemplary" or "such as" is not intended to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the words "exemplary" or "such as" is intended to present the concept in a concrete manner.

In some embodiments, the response processing method provided by the embodiment of the present application can be applied to the electronic device 100 as shown in FIG. 1 . Illustratively, FIG. 1 is a schematic diagram of an electronic device provided by an embodiment of the present application.

Wherein, the electronic device 100 may be a terminal device. Exemplarily, the electronic device 100 may be at least one of a smart phone, a smart watch, a desktop computer, a laptop computer, a virtual reality terminal, an augmented reality terminal, a wireless terminal, a laptop computer, and other devices.

In this embodiment of the present application, the electronic device 100 may be connected to an input device 101 . For example, the input device 101 may be a mouse device, a touch pad, a touch screen pen, etc. For example, the electronic device 100 may be connected to the input device 101 in a wired or wireless manner.

In some embodiments, the electronic device 100 is provided with functionality to trigger a window response based on the input device 101 . For example, referring to FIG. 1, when the user uses the electronic device 100, the electronic device 100 will display relevant content to the user in the form of a window, so that the user can perform relevant operations or view relevant content in the window. Furthermore, when the user uses the input device 101 to perform relevant operations (such as click operations) on the window displayed by the electronic device 100, the window will trigger a corresponding response.

The response processing method provided by the embodiment of the present application can be applied to the response scenario of the window displayed by the electronic device 100.

The window may be an application window, that is, a window related to application display. For example, an application window can be divided into an application main window and an application sub-window. The application main window is used to display the application interface, such as an interface including text content. The application sub-window is used to display application pop-up windows, such as floating windows and other auxiliary windows.

For example, taking a text application (such as a wps application, word application, excel application, ppt application, or txt application), the window may be the application main window of the text application, that is, a window used to display text content. Alternatively, the window can also be an application sub-window of the text application, such as the window where the function control is located.

As another example, taking a social application (such as a chat application) as an example, the window may be the application main window of the social application, that is, a window used to display conversation content. Alternatively, the window can also be an application sub-window of the social application, such as the window where the function control is located.

As another example, taking an email application as an example, the window may be the application main window of the email application, that is, a window used to display email content. Alternatively, the window can also be an application sub-window of the mail application, such as the window where the function control is located.

To simplify the description, the window containing text content may be referred to as the text window, the window containing functional controls as the control window, the window containing session content as the session window, and the window containing email content as the mail window.

The following takes the word extraction application provided by the electronic device as an example to illustrate the solution. Among them, the word extraction application is used for text word extraction or picture word extraction. The word extraction application is first introduced below.

The entrance to the word extraction application can be provided in the computer housekeeper application, side shortcut bar or other locations provided by the electronic device. Illustratively, taking the entrance in the computer housekeeper application as an example, FIG. 2 is a schematic diagram of a display screen of an electronic device provided by an embodiment of the present application. After the electronic device receives the user's opening operation of the computer housekeeper application, see Figure 2, in response, the electronic device can display the computer housekeeper interface 201. Among them, the computer housekeeper interface 201 includes various functional controls, such as a word retrieval control 202. It should be understood that the word extraction control 202 is also the entrance to the above word extraction application.

The user can start the word fetching application by performing a triggering operation on the entrance of the word fetching application. Exemplarily, FIG. 3 is a schematic diagram of a display screen of an electronic device provided by an embodiment of the present application. After the electronic device receives the user's triggering operation on the entrance of the word-taking application, see FIG. 3 , in response, the electronic device may display at least one functional control of the word-taking application. For example, the at least one functional control may include a copy all control 301, a translate all control 302, a read all control 303, a favorite all control 304, and a screenshot word capture control 305. Among them, the copy all control 301 is used to copy all the selected text content. The translate all control 302 is used to translate all the selected text content. The read all control 303 is used to read all the selected text content. The collect all control 304 is used to collect all selected text contents. The screenshot word capture control 305 is used to trigger a screenshot and perform image recognition on the image obtained by the screenshot to obtain text content. It should be understood that when the electronic device displays at least one of the above function controls, it means that the word extraction application is turned on at this time.

In some embodiments, taking the text word extraction scenario as an example, the electronic device may display a text window including text content. For example, the text window can be a window of a wps application, a window of a word application, a window of an excel application, a window of a ppt application, or a window of a txt application, etc. After the word-retrieval application is opened, the user can use an input device (such as a mouse device) to perform a sliding word-retrieval operation in the text window (i.e., press the left button of the mouse device and move the mouse device, and release the left mouse button after selecting the required text) This operation), the electronic device responds to the sliding word retrieval operation and displays a function window for text word retrieval. The function window may include at least one function control, such as a copy control, a translation control, a search control, a jump control, a reading control, a collection control, and so on.

Exemplarily, FIG. 4 is a schematic diagram of a display screen of an electronic device provided by an embodiment of the present application. Referring to FIG. 4 , after the electronic device receives the user's sliding word-retrieval operation in the text window, see FIG. 4 , in response, the electronic device may display a text word-retrieval function window 401 . Among them, the text word extraction function window 401 includes various functional controls, such as a copy control 402, a translation control 403, a search control 404, a jump control 405, a reading control 406, and a collection control 407.

In other embodiments, taking the word-picking scene from a picture as an example, the electronic device may display a window 1 including a picture (which may be referred to as a picture window for short), and the picture includes text. At this time, the user can use an input device (such as a mouse device) to click on the screenshot word capture control. Here, the component including the screenshot and word capture control can also be called a window. Then, the user uses the mouse device to click on the screen capture and word capture control. It can also be understood that the user uses the mouse device to click on the screen capture word capture control in the window 2 including the screen capture and word capture control. Perform a click operation (i.e., press and release the left button of the mouse device). In response to the click operation, the electronic device switches the display state of the screenshot word capture control from state 1 to state 2 in window 2 . Among them, state 1 is used to indicate that the screen capture word capture control has not been triggered, and state 2 is used to indicate that the screen capture word capture control has been triggered. For example, state 1 is gray and state 2 is blue. In addition, in response to the click operation, the electronic device takes a screenshot of the content displayed on the display screen of the electronic device and performs image recognition on the image obtained by the screenshot to obtain the text. Furthermore, the electronic device displays the text obtained through image recognition on the above-mentioned window 1 . In addition, the text is in an optional state (such as grayed out, that is, the text background is gray). Afterwards, the user can use the mouse device to perform a sliding word-retrieval operation in the displayed text, and the electronic device displays a text word-retrieval function window in response to the sliding word-retrieval operation.

Exemplarily, FIG. 5 is a schematic diagram of a display screen of an electronic device provided by an embodiment of the present application. Referring to FIG. 5 , the above-mentioned window 1 including pictures may be the window 501 shown in FIG. 5 . The above-mentioned window 2 including the screenshot word capture control may be the window 502 shown in FIG. 5 . After the electronic device receives the user's click operation in the window 502, in response, the electronic device can switch the display state of the screenshot word capture control from a gray state to a blue state in the window 502, and, for the electronic device Take a screenshot of the content displayed on the display screen of the device and perform image recognition on the image obtained by the screenshot to obtain the text. Furthermore, the electronic device displays the text 503 obtained through image recognition in the window 501. After receiving the user's sliding word-picking operation in the displayed text 503, see FIG. 5, in response, the electronic device may display a text word-picking operation. Function window 504. Among them, the function window 504 is the same as the above-mentioned function window 401 and will not be described again.

It should be understood that for text word extraction scenarios, since the text window itself supports sliding text selection, there is no need to use the screenshot word extraction control of the word extraction application and the text word extraction can be performed directly. In the picture word extraction scenario, since the picture window does not support sliding text selection, you need to use the screenshot word extraction control of the word extraction application to first take a screenshot and then perform image recognition on the screenshot image to obtain the text, thereby completing the text word extraction. . Of course, in some embodiments, in a text word extraction scenario, text word extraction can also be achieved by triggering the screenshot word extraction control of the word extraction application, taking a screenshot of the display screen and performing image recognition on the image obtained by the screenshot to obtain the text. .

Currently, if a new window is displayed when the user uses an input device (such as a mouse device) to perform related operations, the current window will become unresponsive due to the newly displayed window grabbing focus.

For example, taking the above word extraction application as an example, when clicking the screenshot word extraction control, if a new window is displayed, the focus will change to the newly displayed window, causing the screen capture word extraction control to become unresponsive. For another example, take the text window as an example. When sliding to retrieve words in the text window, if a new window is displayed, the focus will change to the newly displayed window, causing the sliding to retrieve words to become unresponsive.

In some embodiments, the response processing method provided by the embodiments of the present application can be applied to the response scenarios of the windows involved in the word extraction application, such as text windows, picture windows (including optional text), and windows where all controls are copied. , translate the window where all controls are located, read the window where all controls are located, collect the window where all controls are located, including the window where screenshots and word capture controls are located, etc. It should be understood that here, similar to the window including the screenshot word capture control, the component including all the controls for copying can also be called a window, the component including all the controls for translating can also be called a window, and the component including all the controls for reading aloud can also be called a window. For a window, the component that contains all the controls is also called a window.

It should be noted that the word extraction application can be a program plug-in attached to the text application and runs when the text application is opened. Alternatively, the word extraction application can also be a word extraction application that runs independently from the text application, such as MagicText AI, etc. The embodiments of this application do not limit the application of word selection.

In view of this, embodiments of the present application provide a response processing method. After the cursor is displayed on the first object of the first window and a mouse press event from the input device of the electronic device is received, if the second window is newly displayed and The focus is occupied by the second window. After receiving a mouse release event from the input device of the electronic device, it can be determined whether the cursor is displayed on the first object in the first window. to respond to the operation. Furthermore, when the cursor is displayed on the first object, based on the mouse press event and the mouse release event, respond to the operation of the first object, so as to subsequently respond to the current mouse operation in the first window. Smooth response to operational events. In this way, by setting the judgment condition of the cursor position, it can be determined whether the current first window needs to process this mouse operation event. Furthermore, when the second window is newly displayed, the current first window that needs to process the mouse operation event continues to respond, which can solve the problem of the current window not responding due to the newly displayed window grabbing focus, and improve the response. Processing reliability.

It can be understood that after the electronic device is connected to the input device (such as a mouse device), a cursor (or mouse pointer) can be displayed on the display screen of the electronic device to prompt the user that the input device has been successfully connected. In the embodiment of the present application, the electronic device is used to display a first window, display a cursor on a first object of the first window; receive a mouse press event from an input device of the electronic device; display a second window, and the focus is The second window is occupied and receives a mouse release event from the input device of the electronic device; when the cursor is displayed on the first object, based on the mouse press event and the mouse release event, the first object is to respond to the operation.

For example, a schematic structural diagram of the electronic device 100 in FIG. 1 is shown in FIG. 6 . FIG. 6 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application.

Referring to Figure 6, the electronic device 100 may include a processor 610, an external memory interface 620, an internal memory 621, a universal serial bus (USB) interface 630, a charging management module 640, a power management module 641, a battery 642, and an antenna. 1. Antenna 2, mobile communication module 650, wireless communication module 660, audio module 670, sensor module 680, buttons 690, and display screen 691. The sensor module 680 may include a pressure sensor 680A, a touch sensor 680B, and the like.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.

The processor 610 may include one or more processing units. For example, the processor 610 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), an image signal processor ( image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and/or neural-network processing unit (NPU), etc. . Among them, different processing units can be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the electronic device 100 . The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

The processor 610 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 610 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 610 . If the processor 610 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 610 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 610 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuitsound, I2S) interface, a pulse code modulation (PCM) interface, or a universal asynchronous receiver (universal asynchronous receiver) /transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and/or USB interface 603, etc.

The USB interface 630 is an interface that complies with USB standard specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 630 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. For example, USB interface 630 may be used to connect an input device, such as a mouse device. For another example, the USB interface 630 can also be used to connect headphones and play audio through the headphones. This interface can also be used to connect other electronic devices, such as AR devices, etc.

It can be understood that the interface connection relationships between the modules illustrated in the embodiment of the present invention are only schematic illustrations and do not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charge management module 640 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 640 may receive charging input from the wired charger through the USB interface 630 . In some wireless charging embodiments, the charging management module 640 may receive wireless charging input through the wireless charging coil of the electronic device 100 . While charging the battery 642, the charging management module 640 can also provide power to the electronic device through the power management module 641.

The power management module 641 is used to connect the battery 642, the charging management module 640 and the processor 610. The power management module 641 receives input from the battery 642 and/or the charging management module 640, and supplies power to the processor 610, internal memory 621, external memory, display screen 691, wireless communication module 660, etc. The power management module 641 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters. In some other embodiments, the power management module 641 may also be provided in the processor 610. In other embodiments, the power management module 641 and the charging management module 640 can also be provided in the same device.

The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 650, the wireless communication module 660, the modem processor and the baseband processor, etc.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.

The mobile communication module 650 can provide solutions for wireless communication including 2G/3G/4G/5G applied on the electronic device 100 . The mobile communication module 650 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 650 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 650 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 650 may be disposed in the processor 610 . In some embodiments, at least part of the functional modules of the mobile communication module 650 and at least part of the modules of the processor 610 may be provided in the same device.

A modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs sound signals through audio devices (not limited to speakers, receivers, etc.), or displays images or videos through the display screen 691. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 610 and may be provided in the same device as the mobile communication module 650 or other functional modules.

The wireless communication module 660 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), Bluetooth (bluetoo2, BT), and global navigation satellite system. Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR). The wireless communication module 660 may be one or more devices integrating at least one communication processing module. The wireless communication module 660 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 610. The wireless communication module 660 can also receive the signal to be sent from the processor 610, perform frequency modulation and amplification on it, and convert it into electromagnetic waves through the antenna 2 for radiation. In some embodiments, the electronic device 100 can connect to an input device, such as a mouse device, through Bluetooth in the wireless communication module 660 .

In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 650, and the antenna 2 is coupled to the wireless communication module 660, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.

The electronic device 100 implements display functions through a GPU, a display screen 691, an application processor, and the like. The GPU is an image processing microprocessor and is connected to the display screen 691 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 610 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 691 is used to display images, videos, etc. Display screen 691 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). (AMOLED), flexible light-emitting diodes (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 691, where N is a positive integer greater than 1.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can continuously learn by itself. The NPU can realize intelligent cognitive applications of the electronic device 100, such as image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 620 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 . The external memory card communicates with the processor 610 through the external memory interface 620 to implement the data storage function. For example, save music, video and other files on an external memory card.

Internal memory 621 may be used to store computer executable program code, which includes instructions. The processor 610 executes instructions stored in the internal memory 621 to execute various functional applications and data processing of the electronic device 100 . The internal memory 621 may include a program storage area and a data storage area. Among them, the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.). The storage data area may store data created during use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 621 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

The electronic device 100 can implement audio functions through the audio module 670 and an application processor. For example, music playback, recording, etc.

The audio module 670 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Audio module 670 may also be used to encode and decode audio signals. In some embodiments, the audio module 670 may be disposed in the processor 610, or some functional modules of the audio module 670 may be disposed in the processor 610.

The pressure sensor 680A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 680A may be disposed on the display screen 691. There are many types of pressure sensors 680A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor may include at least two parallel plates of conductive material. When a force is applied to pressure sensor 680A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is performed on the display screen 691, the electronic device 100 detects the strength of the touch operation according to the pressure sensor 680A. The electronic device 100 may also calculate the touched position based on the detection signal of the pressure sensor 680A. In some embodiments, touch operations acting on the same touch location but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

Touch sensor 680B, also known as "touch panel". The touch sensor 680B can be disposed on the display screen 691. The touch sensor 680B and the display screen 691 form a touch screen, which is also called a "touch screen". Touch sensor 680B is used to detect touch operations on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through the display screen 691. In other embodiments, the touch sensor 680B may also be disposed on the surface of the electronic device 100 in a position different from that of the display screen 691 .

It should be pointed out that the structure shown in Figure 6 does not constitute a limitation of the electronic device. In addition to the components shown in Figure 6, the electronic device may also include more or less components than those shown in the figure, or a combination of them. Certain parts, or different arrangements of parts.

Software systems of electronic devices can adopt layered architecture, event-driven architecture, microkernel architecture, microservice architecture or cloud architecture. In some embodiments, the software structure of the embodiment of the present application may be a structure based on the Android system or a structure based on the Window system. The embodiment of this application takes the Window system with a layered architecture as an example to illustrate the software structure of the electronic device. Exemplarily, FIG. 7 is a schematic diagram of the software structure of an electronic device provided by an embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has clear roles and division of labor. The layers communicate through software interfaces. In some embodiments, the Window system can be divided into an application layer, an intermediate layer, a system layer and a hardware driver layer.

Among them, the application layer is also the application layer. In the embodiment of the present application, the application layer is used to receive and record mouse operation events, and then respond to this mouse operation event based on the mouse operation events.

As shown in Figure 7, the application layer can include a series of application packages. For example, the application package may include computer housekeeping applications, wps applications, word applications, txt applications, excel applications, ppt applications, word picking applications, music applications, video applications, social networking applications and other applications.

In some embodiments, the electronic device displays relevant content of the above application program in the form of a window, so that the user can perform relevant operations or view relevant content in the window.

As shown in FIG. 7 , the middle layer may include an event monitor, which is used to monitor all types of mouse operation events in the system of the electronic device. In some embodiments, the event monitor may be a global hook function.

For example, the mouse operation event may include a mouse press event and a mouse release event. For example, the mouse press event may be a left mouse button press event, a right mouse button press event, a mouse wheel press event, etc. Further, the mouse press event may also include a mouse press move event, such as a left mouse button press move event, a right mouse button press move event, a mouse wheel press move event, etc. The mouse release event can be a left mouse button release event, a right mouse button release event, a mouse wheel release event, etc.

In the embodiment of the present application, the middle layer is used to determine whether the mouse operation event belongs to the preset mouse event. Furthermore, if the mouse operation event belongs to the preset mouse event, the mouse operation event is sent to the process corresponding to the first window of the application layer. . For example, determine whether the mouse press event is a preset mouse event, and then, if the mouse press event is a preset mouse event, send the mouse press event to the process corresponding to the first window of the application layer, and determine whether the mouse press event is a preset mouse event. Whether the release event belongs to the preset mouse event, and further, if the mouse release event belongs to the preset mouse event, obtain the cursor position detection result, if the cursor position detection result indicates that the cursor is displayed on the first object of the first window on the application layer, sending a mouse release event to the process corresponding to the first window of the application layer.

The system layer is responsible for grassroots data collection, daily business processing, management monitoring, etc. As shown in Figure 7, the system layer may include the Window system. In the embodiment of the present application, the system layer is used to detect mouse operation events and send mouse operation events to the event monitor of the middle layer.

In some embodiments, the mouse operation event may include a mouse button flag (used to indicate what kind of operation the user has performed on the mouse device, such as pressing, lifting, moving, or scrolling), coordinate information (when the user moves the mouse When the user operates the mouse device, it is used to indicate the to indicate which of the left, middle, or right buttons of the mouse device the user operated on).

As shown in Figure 7, the hardware driver layer is the layer between hardware and software. In some embodiments, the hardware driver layer includes at least a mouse driver, a keyboard driver, a display driver, a camera driver, an audio driver, a sensor driver, etc. In the embodiment of this application, the hardware driver layer is used to connect the input device and the electronic device.

In the embodiment of the present application, the electronic device can complete the function of triggering a window response based on the input device through the cooperation among the above-mentioned application layer, middle layer, system layer and hardware driver layer.

Figure 8 is a schematic flowchart of a response processing method provided by an embodiment of the present application. Referring to Figure 8, with the electronic device as the execution subject, the method includes the following S801-S807:

S801. The electronic device displays a first window, and displays a cursor on the first object of the first window.

In the embodiment of the present application, the first window is used to refer to the window to be triggered by the user among the windows currently displayed by the electronic device.

In some embodiments, the first window may be a control window, a text window, a picture window, a conversation window, a mail window, etc. For example, the control window can be the window where functional controls such as opening controls, viewing controls, and full-screen controls are located. The text window can be a word application window, a wps application window, an excel application window, a ppt application window or a txt application window, etc. The following embodiments of this application will take the control window and the text window as examples to explain the solution.

The first object refers to the object to be operated included in the first window. Taking the first window as a control window as an example, the first object is also a function control included in the control window. Taking the first window as a text window as an example, the first object is the text content included in the text window.

Exemplarily, as shown in S801 in Figure 8 , taking the first window as a window that includes a screenshot word capture control in a word capture application, the first object is also a screen capture word capture control. At this time, the cursor is displayed on the screenshot On the word fetch control.

S802. The electronic device receives a mouse press event from the input device of the electronic device.

Among them, the mouse press event is also the down event of the input device. It should be understood that the mouse press event is also an event based on the mouse press operation.

In some embodiments, the mouse press event may be a left mouse button press event, a right mouse button press event, a mouse wheel press event, or the like. Further, the mouse press event may also be a mouse press move event, that is, an event in which the mouse moves after pressing a mouse button (such as the left button, right button, or scroll wheel). For example, the operation of moving left or right after pressing the mouse button, or the operation of moving up or down after pressing the mouse button, etc.

The mouse press event may include a mouse button flag (pressed), key position information (such as the left button), and the corresponding first position in the display screen when the mouse is pressed. The first position is the corresponding position coordinate in the display screen when the mouse is pressed.

Among them, the mouse button flag can be represented by a name, a number, and an identity document (ID). Key information can also be represented by name, number, and identification number. The first position can be represented by two-dimensional coordinates (such as X coordinate, Y coordinate).

In some embodiments, the electronic device includes a system layer. If the user performs a mouse press operation on the input device, the electronic device can detect the mouse press operation of the input device through the system layer and receive a mouse press event from the input device.

In some embodiments, the electronic device further includes an intermediate layer that includes an event monitor for monitoring mouse down events and mouse release events of an input device of the electronic device. Further, in some embodiments, after receiving a mouse press event from the input device, the system layer also sends the mouse press event to the event monitor for the event monitor to perform subsequent response processing.

S803. The event monitor in the electronic device sends the mouse press event to the process corresponding to the first window.

After the event monitor sends the mouse press event to the process corresponding to the first window, the process corresponding to the first window receives and records the mouse press event.

In this way, a way to obtain this mouse operation event for the first window is provided. Wherein, when receiving a mouse press event from the input device of the electronic device, the mouse press event needs to be sent to the process corresponding to the first window, so that the subsequent process corresponding to the first window can based on the received mouse press event. The press event is processed so that subsequent mouse operation events can be smoothly responded to in the first window, which improves the reliability of response processing.

In some embodiments, before sending the mouse press event to the first window, the event monitor further determines whether the mouse press event belongs to the preset mouse event based on the preset mouse event. Furthermore, when the mouse down event belongs to a preset mouse event, the event monitor sends the mouse down event to the process corresponding to the first window.

The preset mouse event may be a preset mouse operation event supported by the first window. For example, left mouse button press event, left mouse button release event, mouse wheel press event, mouse wheel release event, left mouse button press move event, mouse wheel press move event, etc. Alternatively, in the embodiment of the mouse press event, the preset mouse event may also be a preset mouse press event supported by the first window. For example, left mouse button press event, mouse wheel press event, left mouse button press move event, mouse wheel press move event, etc.

In this way, a way to trigger the sending of this mouse operation event based on a preset mouse event is provided. When receiving a mouse press event from the input device of the electronic device, by determining whether the mouse press event belongs to a preset mouse event, it is ensured that if the mouse press event belongs to a preset mouse event, the first mouse press event is received. The process corresponding to the window sends the mouse press event so that the mouse operation event can be successfully responded to in the first window, thereby improving the reliability of response processing.

In the embodiment of the present application, by setting up an event monitor, all types of mouse operation events in the system can be monitored, and then, for mouse operation events belonging to preset mouse events, the subsequent process of sending the mouse operation events is performed to ensure that this mouse operation event The operational event went smoothly.

S804. The electronic device displays the second window, and the focus is occupied by the second window. The electronic device receives a mouse release event from the input device of the electronic device.

In the embodiment of this application, the second window is used to refer to any newly displayed window. In some embodiments, the second window may be an alarm window (that is, a window that includes alarm information), a prompt window (that is, a window that includes prompt information), a session window (that is, a window that includes session information), etc. It should be noted that the first window and the second window may belong to the same window application or may belong to different window applications.

In some embodiments, after the electronic device displays the second window, the process corresponding to the second window automatically occupies the focus.

The mouse release event is also the up event of the input device. It should be understood that the mouse release event is also an event based on the mouse release operation. In some embodiments, the mouse release event may be a left mouse button release event, a right mouse button release event, a mouse wheel release event, or the like.

The mouse release event may include a mouse button flag (lift), key position information (such as left button), and a second position corresponding to the display screen when the mouse is released. The second position is the corresponding position coordinate in the display screen when the mouse is released. The second position can be represented by two-dimensional coordinates.

In some embodiments, the electronic device includes a system layer. If the user performs a mouse release operation on the input device, the electronic device can detect the mouse release operation of the input device through the system layer and receive a mouse release event from the input device.

Further, in some embodiments, after receiving the mouse release event from the input device, the system layer also sends the mouse release event to the event monitor for the event monitor to perform subsequent response processing.

S805. The event monitor in the electronic device obtains the position detection result of the cursor, and the position detection result is used to indicate whether the cursor is displayed on the first object.

Wherein, whether the cursor is displayed on the first object refers to whether the cursor is displayed in a preset area of the first object. For example, the preset area may be an area within a preset distance from the center point of the first object, or the preset area may be a rectangular frame area where the first object is located. It should be understood that if the cursor is displayed in the vicinity of the first object, it means that the cursor is displayed on the first object.

In some embodiments, the event monitor obtains the position detection result of the cursor from a preset function. The preset function is used to detect the position of the cursor to determine whether the cursor is displayed on the first object.

In some embodiments, the process of obtaining the cursor position detection result through a preset function may be: obtaining the cursor position and the rectangular frame position of the first object. Furthermore, based on the cursor position and the rectangular frame position, the position detection result of the cursor is determined.

For example, the preset function may include the Get Cursor Pos() function, which is used to obtain the cursor position. The preset function may also include a Get Window Rect() function, which is used to obtain the rectangular frame position of the first object. The preset function may also include a Pt In Rect (pt, rect) function. The Pt In Rect (pt, rect) function is used to compare the cursor position with the rectangular frame position to determine whether the cursor is displayed on the first object. . Furthermore, the Pt In Rect (pt, rect) function can be used to determine whether the cursor is located within the rectangular frame position, thereby obtaining the position detection result of the cursor.

It should be noted that in some embodiments, through the Pt In Rect (pt, rect) function, the cursor position detection result can also be actively returned to the event monitor, so that the event monitor can perform subsequent processing corresponding to the first window. The process that sends this mouse release event.

In the above embodiment, a method of obtaining the position detection result of the cursor is provided. By comparing the relationship between the cursor position and the rectangular frame position of the first object, it can be quickly and accurately determined whether the cursor is displayed on the first object, thereby obtaining the position detection result of the cursor.

S806. When the cursor is displayed on the first object, the event monitor sends the mouse release event to the process corresponding to the first window.

After the event monitor sends the mouse release event to the process corresponding to the first window, the process corresponding to the first window receives and records the mouse release event.

In this way, a method for obtaining event information of this mouse operation event for the first window is provided. When the second window is newly displayed, when receiving a mouse release event from the input device of the electronic device, the mouse release event needs to be sent to the process corresponding to the first window so that the process corresponding to the first window can be followed. Processing is performed based on the received mouse release event, so that subsequent mouse operation events can be successfully responded to in the first window, thereby improving the reliability of response processing.

In some embodiments, before sending the mouse release event to the first window, the event monitor further determines whether the mouse release event belongs to the preset mouse event based on the preset mouse event. Furthermore, if the mouse release event belongs to a preset mouse event, the event monitor sends the mouse release event to the process corresponding to the first window.

In the embodiment of the mouse release event, the preset mouse event may also be a preset mouse release event supported by the first window. For example, the left mouse button release operation, the mouse wheel release operation, etc.

In this way, a way to trigger the sending of this mouse operation event based on a preset mouse event is provided. When the second window is newly displayed, when a mouse release event from the input device of the electronic device is received, it is determined whether the mouse release event belongs to the preset mouse event to ensure that the mouse release event belongs to the preset mouse event. In this case, the mouse release event is sent to the process corresponding to the first window, so that the subsequent mouse operation event in the first window can be successfully responded to, thereby improving the reliability of response processing.

In the above embodiment shown in S804 to S806, when the electronic device displays the second window in S804, the process corresponding to the second window automatically occupies the focus, that is, the focus switches from the first window to the second window. Furthermore, after sending the mouse release event to the process corresponding to the first window in S806, the process corresponding to the first window switches the focus from the second window to the first window. In this way, when the second window is newly displayed, by continuing to send the mouse release event to the process corresponding to the first window, the focus can be switched back to the first window, thereby solving the problem caused by the newly displayed window grabbing focus. The problem of the current window not responding has improved the reliability of response processing.

In addition, in some embodiments, when the electronic device sends the mouse release event to the process corresponding to the first window, it can also send the mouse release event to the process corresponding to the newly displayed second window. It should be noted that the response priority of the first window is higher than the response priority of the newly displayed second window. For example, the mouse release event may be sent to the process corresponding to the first window first, and then the mouse release event may be sent to the process corresponding to the newly displayed second window. For another example, the first window can be controlled to respond to this mouse operation event first, and the newly displayed second window can be controlled to respond to this mouse operation event later. For another example, the first window can be controlled to respond to this mouse operation event, and the newly displayed second window cannot respond to this mouse operation event. It should be understood that the newly displayed second window will generally not respond.

S807. The electronic device responds to the operation of the first object based on the mouse press event and the mouse release event.

In some embodiments, after the process corresponding to the first window receives the mouse press event and the mouse release event, based on the mouse press event and the mouse release event, in the first window, the first object is operation in response.

In some embodiments, taking the first position corresponding to the mouse press event and the second position corresponding to the mouse release event as an example, the electronic device determines whether the first position and the second position are both located within the first window. . Furthermore, when the first position and the second position are both located within the first window, the electronic device responds to the operation of the first object within the first window.

In this embodiment, by determining whether the first position corresponding to the mouse press event and the second position corresponding to the mouse release event in this mouse operation event are both located within the first window, the relationship between the mouse press event and the mouse release event is determined. Whether the mouse release event belongs to the same mouse operation event to ensure that the response is to the same mouse operation event, avoid abnormal response problems, and improve the reliability of response processing.

In some embodiments, taking the first window as a window including a target control as an example, accordingly, the above-mentioned S807 can be replaced with: when the first position and the second position are both located within the first window, The electronic device switches the display state of the target control from the first state to the second state in the first window.

For example, in the word extraction application scenario, the target control can be copying all controls, translating all controls, reading all controls, collecting all controls, taking screenshots of word extraction controls, etc. Of course, other controls can be set in addition to the example controls shown above. The embodiment of the present application does not limit the setting of the target control.

The first state is used to indicate that the target control has not been triggered. The second state is used to indicate that the target control has been triggered. For example, the first state can be a gray state and the second control can be a blue (or other color) state. For another example, the first state may be a static state, and the second control may be a shaking state. For another example, the first state may be a normal state, and the second control may be a highlighted state. Of course, in addition to the example states shown above, other states can also be set. The embodiment of the present application does not limit the setting of the display state.

Illustratively, in the scenario of a word extraction application, taking the first window as a window including a screenshot word extraction control, the mouse press event is also an event based on the mouse press operation. Accordingly, the above-mentioned S807 can Replace with: based on the mouse press event and the mouse release event, switch the display state of the screenshot word capture control from the gray state to the blue state.

In the above embodiment, a response processing solution using a control window as an example is provided, which can enable the control window that needs to process this mouse operation event to continue to respond when the second window is newly displayed, that is, the control window will continue to respond. The display state of the target control is switched from the first state to the second state, which improves the reliability of response processing.

In other embodiments, taking the first window as a text window including text content as an example, the mouse press event is an event based on mouse press and movement operation. Accordingly, the above S807 can be replaced with: When both the first position and the second position are located within the first window, the electronic device displays a third window within the first window. Wherein, the third window includes at least one functional control related to the text content.

For example, in the word extraction application scenario, the text window may be a text window displayed in the text word extraction scenario, or a picture window including optional text newly displayed in the picture word extraction scenario.

As another example, in a word extraction application scenario, the third window may be a functional window for text word extraction. At least one functional control included in the third window may include a copy control, a translation control, a search control, a jump control, a reading control, a collection control, etc.

In this embodiment, a response processing solution is provided, taking a text window as an example, which can enable the text window that needs to process this mouse operation event to continue to respond when the second window is newly displayed, that is, display The third window including at least one functional control improves the reliability of response processing.

For example, taking the down event and up event based on the mouse device as an example, after the down event occurs in the current first window, if the focus is snatched by other newly displayed second windows, when the up event occurs, the event monitor The up event will still be sent to the process corresponding to the current first window. Furthermore, the process corresponding to the current first window determines whether the positions of the down event and the up event are both within the current first window, and if so, responds within the current first window.

Below, when the word capture application is open, taking the first object as a screenshot word capture control as an example, and the first window as a window including a screenshot word capture control as an example, the response processing process of the window including a screenshot word capture control will be illustrated. sexual description.

In one example, taking the input device as a mouse device, after the electronic device receives a mouse press event of the mouse device in a window that includes a screen capture word capture control, the electronic device sends the mouse press event to a window that includes a screen capture word capture control. window. At this time, the focus of the mouse device is on the window containing the screenshot capture control. When the electronic device displays the second window and the focus is occupied by the second window, the electronic device determines whether the cursor of the mouse device is displayed in the window after receiving the mouse release event of the mouse device in the window that includes the screenshot word capture control. On the screenshot word capture control. If the cursor of the mouse device is displayed on the screenshot word capture control, the mouse release event is sent to the window including the screenshot word capture control. At this time, the focus of the mouse device is switched from the second window back to the window including the screenshot word capture control. Furthermore, the window including the screen capture word capture control switches the screen capture word capture control from a gray state to a blue state based on the received mouse press event and the mouse release event.

In the following, when the word acquisition application is opened, taking the first object as text as an example and the first window as a text window as an example, the response processing process of the text window will be exemplified.

In another example, assuming that the input device is a mouse device, after the electronic device receives a mouse press event of the mouse device within the text window, the electronic device sends the mouse press event to the text window. At this time, the focus of the mouse device is on the text window. When the electronic device displays the second window and the focus is occupied by the second window, it is determined whether the cursor of the mouse device is displayed on the text. If the mouse device's cursor is displayed on the text, send the mouse release event to the text window. At this time, the focus of the mouse device is switched back to the text window from the second window. Furthermore, the text window displays a function window for text word extraction based on the received mouse press event and mouse release event.

The technical solution provided by the embodiment of the present application is that after the cursor is displayed on the first object of the first window and the mouse press event from the input device of the electronic device is received, if the second window is newly displayed and the focus is on the second window, After receiving the mouse release event from the input device of the electronic device, it can be determined whether to respond to the operation of the first object in the first window by determining whether the cursor is displayed on the first object. Furthermore, when the cursor is displayed on the first object, based on the mouse press event and the mouse release event, respond to the operation of the first object, so as to subsequently respond to the current mouse operation in the first window. Smooth response to operational events. In this way, by setting the judgment condition of the cursor position, it can be determined whether the current first window needs to process this mouse operation event. Furthermore, when the second window is newly displayed, the current first window that needs to process the mouse operation event continues to respond, which can solve the problem of the current window not responding due to the newly displayed window grabbing focus, and improve the response. Processing reliability.

Based on the schematic software structure diagram shown in Figure 7, as an example, Figure 9 is an architectural schematic diagram of a response processing method provided by an embodiment of the present application. Referring to Figure 9, taking the hierarchical architecture of the system layer, middle layer, and application layer as an example, by setting an event monitor (hook function) in the middle layer, the mouse operation events in the system, such as the input device of the electronic device, can be monitored. Mouse press event and mouse release event. Furthermore, by determining whether the first window needs to process the mouse operation event, for example, determining whether the cursor of the mouse device is displayed on the first object of the first window. If the first window needs to process the mouse operation event, the first window is triggered to process the mouse response. If the first window does not need to process the mouse operation event, the automatic flow of the mouse operation event is triggered.

Among them, through the Window system at the system layer, the mouse operation event based on the mouse device in the first window can be detected. After detecting a mouse operation event based on the mouse device in the first window, the mouse operation event can be sent to the event monitor of the middle layer through a hook function. Furthermore, referring to the dotted line process shown in Figure 9, the event monitor of the middle layer determines whether the cursor of the mouse device is displayed on the first object of the first window. If the cursor of the mouse device is displayed on the first window on the first object, indicating that the first window needs to process the mouse operation event, then the mouse operation event is sent to the first window to trigger the first window to process the mouse response. Referring to the dotted line process shown in Figure 9, if the cursor of the mouse device is not displayed on the first object of the first window, it means that the first window does not need to process the mouse operation event, and the mouse operation event is returned to the system layer. , to trigger the system layer to send the mouse operation event to the application layer, so that the mouse operation event is automatically transferred to the second window. In this way, when a new window pops up but the first window needs to process the mouse operation event, it can be ensured that the first window responds to the mouse operation event.

Figure 10 is an architectural interaction diagram of a response processing method provided by an embodiment of the present application. Referring to Figure 10, taking the input device as a mouse device as an example, and taking the interaction process between the system layer, the middle layer, and the application layer as an example, the method includes the following S1001-S1015:

S1001. The application layer displays the first window, and displays the cursor on the first object of the first window.

S1002. The user performs a mouse pressing operation in the first window based on the mouse device.

S1003. After detecting a mouse press operation in the first window based on the mouse device, the system layer receives a mouse press event from the mouse device.

S1004. The system layer sends the mouse press event to the event monitor of the middle layer.

S1005. The event monitor receives the mouse press event and determines whether the mouse press event is a preset mouse event.

S1006. When the mouse press event is a preset mouse event, the event monitor sends the mouse press event to the process corresponding to the first window of the application layer.

S1007. The process corresponding to the first window receives and records the mouse press event.

S1008. The application layer displays the second window, and the focus is occupied by the second window.

S1009. The user performs a mouse release operation in the first window based on the mouse device.

S1010. After detecting a mouse release operation based on the mouse device in the first window, the system layer receives a mouse release event from the mouse device.

S1011. The system layer sends the mouse release event to the event monitor.

S1012. The event monitor receives the mouse release event and determines whether the mouse release event is a preset mouse event.

S1013. When the mouse release event is a preset mouse event, the event monitor obtains the cursor position detection result.

S1014. When the cursor position detection result indicates that the cursor is displayed on the first object, the event monitor sends the mouse release event to the process corresponding to the first window.

S1015. The process corresponding to the first window receives the mouse release event, and responds to the operation of the first object in the first window based on the mouse press event and the mouse release event.

Compared with the solution of the related technology, when the window focus changes, the mouse release event originally sent to the first window is sent to the newly displayed second window, resulting in the first window being unable to obtain the mouse release event of the mouse device. , thus causing the problem of the first window not responding. The technical solution provided by this application can solve the problem of the current first window not responding due to the newly displayed second window grabbing focus.

Figure 11 is a schematic framework diagram of a response processing device provided by an embodiment of the present application. Referring to Figure 11, the response processing device includes a display module 1101, a receiving module 1102 and a response module 1103. in,

The display module 1101 is used to display the first window and display the cursor on the first object of the first window;

A receiving module 1102, configured to receive a mouse press event from an input device of the electronic device;

The display module 1101 is also used to display a second window, and the focus is occupied by the second window, and the electronic device receives a mouse release event from the input device of the electronic device;

The response module 1103 is configured to respond to the operation of the first object based on the mouse press event and the mouse release event when the cursor is displayed on the first object.

The technical solution provided by the embodiment of the present application is that after the cursor is displayed on the first object of the first window and the mouse press event from the input device of the electronic device is received, if the second window is newly displayed and the focus is on the second window, After receiving the mouse release event from the input device of the electronic device, it can be determined whether to respond to the operation of the first object in the first window by determining whether the cursor is displayed on the first object. Furthermore, when the cursor is displayed on the first object, based on the mouse press event and the mouse release event, respond to the operation of the first object, so as to subsequently respond to the current mouse operation in the first window. Smooth response to operational events. In this way, by setting the judgment condition of the cursor position, it can be determined whether the current first window needs to process this mouse operation event. Furthermore, when the second window is newly displayed, the current first window that needs to process the mouse operation event continues to respond, which can solve the problem of the current window not responding due to the newly displayed window grabbing focus, and improve the response. Processing reliability.

In some embodiments, the electronic device includes an event monitor configured to monitor mouse press events and mouse release events of an input device of the electronic device;

The device also includes a sending module for:

The event monitor sends the mouse press event and the mouse release event to the process corresponding to the first window.

In some embodiments, the sending module is specifically used to:

When the mouse press event and the mouse release event are preset mouse events, the event monitor sends the mouse press event and the mouse release event to the process corresponding to the first window.

In some embodiments, the device further includes a switching module for:

Switch the focus from the second window to the first window.

In some embodiments, the device further includes an acquisition module for:

The event monitor obtains a position detection result of the cursor, and the position detection result is used to indicate whether the cursor is displayed on the first object.

In some embodiments, the mouse press event includes a first position in the display screen corresponding to the mouse press, and the mouse release event includes a second position in the display screen corresponding to the mouse release;

The response module 1103 is specifically used for:

When both the first position and the second position are located within the first window, the electronic device responds to the operation of the first object within the first window.

In some embodiments, the first window is a window that includes the target control;

The response module 1103 is specifically used for:

When both the first position and the second position are located in the first window, the electronic device switches the display state of the target control from the first state to the second state in the first window.

In some embodiments, the first window is a window that includes text content;

The response module 1103 is specifically used for:

When both the first position and the second position are located within the first window, the electronic device displays a third window within the first window, the third window including at least one functional control related to the text content .

It can be understood that, in order to implement the above functions, the electronic device (such as a terminal) in the embodiment of the present application includes a corresponding hardware structure and/or software module to perform each function. Persons skilled in the art should easily realize that, in conjunction with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of the embodiments of the present application.

An embodiment of the present application also provides an electronic device, including: a display screen, a memory, and a processor. The display screen is used to provide display functions. The processor is connected to the memory, and the memory is used to store program codes. The processor executes the program codes stored in the memory, thereby implementing the response processing method provided by the embodiment of the present application.

Embodiments of the present application also provide a computer-readable storage medium. Program code is stored on the computer-readable storage medium. When the program code is run on an electronic device, it causes the electronic device to execute the electronic device in the above method embodiment. Each function or step performed.

Embodiments of the present application also provide a computer program product, including program code. When the program code is run on an electronic device, the electronic device causes the electronic device to perform various functions or steps performed by the electronic device in the above method embodiments.

Among them, the electronic devices, computer-readable storage media or computer program products provided by the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the corresponding methods provided above. The beneficial effects of this method will not be repeated here.

Through the above description of the embodiments, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be allocated as needed. It is completed by different functional modules, that is, the internal structure of the device (such as electronic equipment) is divided into different functional modules to complete all or part of the functions described above. For the specific working processes of the systems, devices (such as electronic equipment) and units described above, reference can be made to the corresponding processes in the foregoing method embodiments, which will not be described again here.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices (such as electronic devices) and methods can be implemented in other ways. For example, the device (such as electronic equipment) embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple divisions. Units or components may be combined or integrated into another system, or some features may be omitted, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

The unit described as a separate component may or may not be physically separated, and the component shown as a unit may or may not be a physical unit, that is, it may be located in one place, or may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the method in various embodiments of the present application. The aforementioned storage media include: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk and other media that can store program codes.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application. should be covered by the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (10)

1. A response processing method, characterized in that it is applied to electronic devices, and the method includes: The electronic device displays a first window, and displays a cursor on a first object of the first window; The electronic device receives a mouse press event from an input device of the electronic device; The electronic device displays a second window, and the focus is occupied by the second window, and the electronic device receives a mouse release event from an input device of the electronic device; When the cursor is displayed on the first object, the electronic device responds to the operation of the first object based on the mouse press event and the mouse release event. 2. The method of claim 1, wherein the electronic device includes an event monitor configured to monitor mouse press events and mouse release events of an input device of the electronic device; The method also includes: The event monitor sends the mouse press event and the mouse release event to the process corresponding to the first window. 3. The method of claim 2, wherein the event monitor sends the mouse press event and the mouse release event to the process corresponding to the first window, including: When the mouse press event and the mouse release event belong to the preset mouse events, the event monitor sends the mouse press event and the mouse release event to the process corresponding to the first window. . 4. The method according to claim 2 or 3, characterized in that after the event monitor sends the mouse release event to the process corresponding to the first window, the method further includes: Switch the focus from the second window to the first window. 5. The method according to any one of claims 2 to 4, wherein after the electronic device receives a mouse release event from an input device of the electronic device, the method further includes: The event monitor obtains a position detection result of the cursor, and the position detection result is used to indicate whether the cursor is displayed on the first object. 6. The method according to any one of claims 1 to 5, wherein the mouse press event includes a first position corresponding to the display screen when the mouse is pressed, and the mouse release event includes a corresponding first position when the mouse is released. second position in the display; The electronic device responds to the operation of the first object based on the mouse press event and the mouse release event, including: When both the first position and the second position are located within the first window, the electronic device responds to the operation of the first object within the first window. 7. The method according to claim 6, wherein the first window is a window including a target control; When the first position and the second position are both located within the first window, the electronic device responds to the operation of the first object within the first window, including : When both the first position and the second position are located within the first window, the electronic device switches the display state of the target control from the first state to Second state. 8. The method according to claim 6, wherein the first window is a window including text content; When the first position and the second position are both located within the first window, the electronic device responds to the operation of the first object within the first window, including : When the first position and the second position are both located within the first window, the electronic device displays a third window within the first window, the third window including the text At least one functional control related to the content. 9. An electronic device, characterized in that it includes a display screen, a memory and a processor; the display screen is used to provide a display function; the memory is used to store program code; the processor is used to call the program code, To perform the method according to any one of claims 1-8. 10. A computer-readable storage medium, characterized by comprising program code, which when run on an electronic device causes the electronic device to perform the method according to any one of claims 1-8.