CN112751954B - Operation prompting method and electronic equipment - Google Patents

Abstract

A method for operation prompt and electronic equipment are provided, the method is applied to the electronic equipment with a foldable touch screen, the foldable touch screen comprises a first screen and a second screen, an included angle between the first screen and the second screen is smaller than a preset included angle, in the method, the electronic equipment detects a first operation on a display touch area on the first screen; and responding to the first operation, displaying a prompt identifier at a corresponding position of the second screen according to a position mapping relation, wherein the display position of the prompt identifier on the second screen is associated with the touch position of the first operation, and the position mapping relation is determined according to the display touch areas of the first screen and the second screen. In the embodiment of the application, the first screen is used as the auxiliary screen, the second screen is used as the main screen as an example, the user performs first operation on the display touch area of the auxiliary screen, and the prompt mark can be displayed at the corresponding position of the main screen according to the position mapping relation, so that the operation acting on the auxiliary screen is prompted on the main screen, and misoperation is prevented.

Description

A method and electronic device for operating prompts

technical field

The present invention relates to the technical field of terminals, and in particular, to an operation prompting method and electronic device.

Background technique

At present, various common electronic devices, such as mobile phones, tablet computers, etc., have larger and larger screens in order to provide users with a better user experience, providing users with richer information, which can improve the efficiency of human-computer communication. However, the large screen of such electronic devices will also affect their portability, and foldable electronic devices have begun to be popularized because they can give users a large-screen experience when unfolded, and can also meet portable needs when folded.

When the foldable electronic device is folded, the display screen facing the user is called the main screen, and the display screen folded on the back of the electronic device is called the secondary screen. The user can see the content displayed on the main screen, but not the secondary screen. After the foldable electronic device is folded, the user can only directly operate the main screen with fingers to open applications or controls on the main screen. Perform operations to display the corresponding operation results on the main screen. Since the user cannot see the secondary screen of the mobile phone, when the user operates the secondary screen, the user cannot see whether the operation position is the desired operation position, which may occur. misoperation, thus affecting the user experience.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an operation prompting method and electronic device, so as to implement prompting on the main screen for operations acting on the secondary screen, thereby preventing misoperation.

In a first aspect, an embodiment of the present application provides an operation prompting method, which is applied to an electronic device with a foldable touch screen. The foldable touch screen includes a first screen and a second screen, and a clip between the first screen and the second screen is The angle is smaller than the preset angle, and in this method, the electronic device detects a first operation on the display touch area on the first screen; in response to the first operation, according to the position mapping relationship, a prompt sign is displayed at the corresponding position on the second screen , wherein the display position of the prompting mark on the second screen is associated with the touch position of the first operation, and the position mapping relationship is determined according to the display touch areas of the first screen and the second screen.

In the embodiment of the present application, there is a position mapping relationship between the display touch area of the first screen and the display touch area of the second screen in the electronic device, so that when the user performs a first operation on the display touch area of the first screen, the The operation position of an operation in the display touch area can be mapped to the display touch area on the second screen, so that a prompt sign is displayed in the position that has a positional mapping relationship with the first operation in the second screen, and the first screen is Take the secondary screen and the second screen as the main screen as an example, by performing operations on the secondary screen, the main screen can prompt the operations acting on the secondary screen to prevent misoperation.

In a possible design, the area of the display touch area of the first screen is smaller than or equal to the area of the display touch area of the second screen. In this way, the user's finger only needs to operate on the small-area display touch area on the first screen, and the entire display touch area on the large-area second screen can be operated, which is convenient for the user to operate.

In a possible design, the first operation may be a click operation. The user performs a click operation on the display touch area of the first screen, and the electronic device may display a prompt sign in the display touch area of the second screen in response to the click operation. The prompt sign may be an arrow, a circle, or other shapes. There are no restrictions here.

In a possible design, the first operation may be a sliding operation, and the prompt logo may move on the second screen as the finger slides in the display touch area. In this way, the user performs a sliding operation on the display touch area of the first screen, and can see the movement track of the prompting mark on the second screen, so that the corresponding operation can be performed at the position where the next operation is desired.

In a possible design, the electronic device responds to the first operation and, according to the location mapping relationship, after the prompt identification is displayed on the second screen, the method further includes: identifying the location of the prompt identification on the second screen The displayed content is recognized; in response to the sliding operation in the first direction, the recognized display content is enlarged; in response to the sliding operation in the second direction, the recognized display content is zoomed out. It should be understood that the clicking operation and the sliding operation can be performed by the same finger. For example, the index finger of the user's right hand first performs the clicking operation to recognize the displayed content of the location of the prompting mark, and then uses the index finger to perform the sliding operation. Alternatively, the clicking operation and the sliding operation can also be performed by different fingers. For example, the user's right index finger first performs the clicking operation, and the right middle finger performs the sliding operation. Of course, the clicking operation and the sliding operation can also be performed by two fingers of different hands. .

Through this design, the user can click and slide on the display touch area of the first screen, so as to enlarge the content displayed on the second screen that you want to view more carefully, or reduce the content displayed on the first screen.

In a possible design, the first operation is a click operation, and the touch position of the click operation on the first screen corresponds to the position of the application displayed on the second screen; in response to the first operation, according to the position mapping relationship, on the second screen After the prompt logo is displayed, the application can also be opened on the second screen in response to the click operation.

It should be understood that any operation performed on the display touch area on the first screen can display the corresponding operation execution result on the display touch area on the second screen.

In a possible design, the display touch area on the first screen is provided with a fingerprint sensor, and the first operation is a touch operation; in response to the first operation, before the prompt logo is displayed on the second screen, the fingerprint sensor can also collect information. Touch the fingerprint corresponding to the operation and verify that the fingerprint matches the fingerprint template in the fingerprint template library.

Through this design, users who meet the condition that the fingerprint matches the fingerprint template in the fingerprint template library can operate the display touch area of the first screen, thereby increasing the security. Of course, the user can enter the fingerprint of the commonly used finger into the fingerprint In the template library, this can also prevent the user's other fingers from accidentally touching.

In a possible design, the display touch area on the first screen is provided with a fingerprint sensor, and the first operation is a touch operation; in response to the first operation, displaying a prompt logo on the second screen includes: collecting the touch operation through the fingerprint sensor The corresponding fingerprint is displayed on the second screen. In this way, when the user enters a fingerprint in the display touch area of the first screen, the user can see that the fingerprint entry is displayed on the second screen, so as to collect a complete and usable fingerprint.

In one possible design, the preset included angle is less than or equal to 180 degrees. In this way, the angle between the first screen and the second screen is less than 180 degrees, that is to say, at this time, the foldable touch screen of the electronic device is in a folded state, and the first screen can be operated, and the second screen can be operated. Prompt way to prevent accidental touch.

In a second aspect, an embodiment of the present application provides an electronic device, including a foldable touch screen, a processor, and a memory, the foldable touch screen includes a first screen and a second screen, and the first screen and the second screen are between the first screen and the second screen. The included angle between them is smaller than the preset included angle, and the memory is used to store one or more computer programs; when the one or more computer programs stored in the memory are executed by the processor, the electronic device can realize the above-mentioned The first aspect and any possible design method in the first aspect.

In a third aspect, an embodiment of the present application further provides an apparatus, where the apparatus includes a module/unit for performing any one of the possible design methods in any of the foregoing aspects. These modules/units can be implemented by hardware or by executing corresponding software by hardware.

In a fourth aspect, the embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium includes a computer program, and when the computer program runs on an electronic device, the electronic device is made to perform the above-mentioned first aspect and any possible design method in the first aspect.

In a fifth aspect, an embodiment of the present application further provides a computer program product that, when the computer program product runs on a terminal, enables the electronic device to execute the first aspect and any possible design of the first aspect Methods.

For the beneficial effects of the second aspect to the fifth aspect of the present application, please refer to the relevant description of the first aspect, which will not be repeated here.

Description of drawings

FIG. 1A is a schematic diagram of a fully unfolded scene of a mobile phone according to an embodiment of the present application;

FIG. 1B is a schematic diagram of a partially folded mobile phone scene according to an embodiment of the present application;

FIG. 1C is a schematic diagram of a fully folded mobile phone scenario according to an embodiment of the present application;

2A is a schematic structural diagram of a mobile phone according to an embodiment of the application;

2B is a schematic diagram of a software structure provided by an embodiment of the present application;

2C is a schematic diagram of another software structure provided by an embodiment of the present application;

3 is a schematic diagram of a group of interfaces provided by the embodiment of the present application;

FIG. 4 is another set of interface schematic diagrams provided by the embodiment of the present application;

FIG. 5 is a schematic diagram of a location mapping provided by an embodiment of the present application;

FIG. 6 is another set of interface schematic diagrams provided by an embodiment of the present application;

FIG. 7 is another set of interface schematic diagrams provided by an embodiment of the present application;

FIG. 8 is another set of interface schematic diagrams provided by an embodiment of the present application;

FIG. 9 is another set of interface schematic diagrams provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.

For the electronic device with a foldable touch screen in the embodiments of the present application, the electronic device may be a mobile phone, a pad, a notebook computer, or the like. Taking the electronic device as a mobile phone as an example, the foldable touch screen of the mobile phone may adopt an integrated flexible display screen, or a display screen composed of two rigid screens and a flexible screen located between the two rigid screens. The foldable touch screen provided in this embodiment of the present application includes three parts as an example. As shown in FIGS. 1A , 1B and 1C , the foldable touch screen may include a first screen 111 , a second screen 112 , and a connection between the first screen 111 and the second screen 111 . The bendable area 112 of the screen 113.

The shapes of the foldable touch screen of the mobile phone in different states will be described below with reference to the accompanying drawings.

FIG. 1A shows a schematic diagram of the shape of the mobile phone when it is fully unfolded. As shown in FIG. 1A , when the mobile phone is unfolded, the casing 120 of the mobile phone is unfolded, and at the same time, the foldable touch screen 110 is also unfolded. The foldable touch screen 110 may include a first screen 111 , a bendable area 112 and a second screen 113 . When the foldable touch screen 110 of the mobile phone is fully unfolded, the first screen 111 , the bendable area 112 and the second screen 113 is connected to form a whole screen. At this time, the gravity sensor can detect that the angle a between the first screen 111 and the second screen 113 is 180° (the actual folding angle may not reach 180°, and the actual reported folding angle prevail).

In this embodiment of the present application, when the first screen 111 or the second screen 113 is rotated, the foldable touch screen 110 can be folded through the foldable area 112 . When the foldable touch screen of the mobile phone is partially folded, see FIG. 1B . The fully folded shape can be seen in Figure 1C.

As shown in FIGS. 1B and 1C , when the mobile phone is folded, the casing 120 of the mobile phone is also folded; at the same time, the foldable touch screen 110 is also folded. 1B and 1C exemplarily show that the foldable touch screen 110 is located on the exposed side when the mobile phone is folded. It should be understood that when the mobile phone is folded, the casing 120 may also be exposed and the foldable touch screen 110 is located on the inner side.

During the process from fully unfolding to being fully folded of the foldable touch screen 110 of the mobile phone, the angle a between the first screen 111 and the second screen 113 becomes smaller and smaller. As shown in FIG. 1A , when the foldable touch screen 110 is fully unfolded, the included angle between the first screen 111 and the second screen 113 is 180°. As shown in FIG. 1B , when the foldable touch screen 110 of the mobile phone is partially folded, the gravity sensor 180E can detect that the angle between the first screen 111 and the second screen 113 is 40°. As shown in 1C, when the foldable touch screen 110 of the mobile phone is completely folded, the sensor detects that the included angle between the first screen 111 and the second screen 113 is 0 degrees (the actual folding angle may not reach 0°, and the actual folding angle may not reach 0°. The reported folding angle shall prevail), at this time, the first screen 111 and the second screen 113 are located on the exposed side when the phone is folded, so that the first screen 111 and the second screen 113 can be operated simultaneously when the phone is folded.

In the embodiment of the present application, when the mobile phone is fully unfolded, the first screen 111 and the second screen 113 form a whole screen, and the user faces the entire screen. When the gravity sensor detects that the first screen 111 is rotated, the second screen 113 faces the user. It is called the main screen, and the first screen 111 is called the secondary screen on the back. In response to the user's operation on the secondary screen, the mobile phone can display a corresponding prompt on the user interface on the main screen to prompt the user for the position of the operation.

It should be noted that the term "and/or" in this document is only an association relationship to describe associated objects, indicating that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, and A exists at the same time and B, there are three cases of B alone. In addition, the character "/" in this text, unless otherwise specified, generally indicates that the related objects before and after are an "or" relationship. In the description of the embodiments of the present application, words such as "first" and "second" are only used for the purpose of distinguishing and describing, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order. In the description of this application, unless stated otherwise, "plurality" means two or more.

或者其它操作系统的便携式设备。上述便携式设备也可以是其它便携式设备，只要具备可折叠触摸屏和算法运算能力(能够运行本申请实施例提供的操作提示的方法)即可。还应当理解的是，在本申请其他一些实施例中，上述电子设备也可以不是便携式设备，而是具备可折叠触摸屏和算法运算能力(能够运行本申请实施例提供的操作提示的方法)的台式计算机。Electronic devices, graphical user interfaces for such electronic devices, and embodiments for using such electronic devices are described below. In some embodiments of the present application, the electronic device may be a portable device, such as a mobile phone, a tablet computer, a wearable device (such as a smart watch) with a wireless communication function, and the like. The portable terminal has a foldable touch screen and algorithm computing capability (capable of running the operation prompting method provided by the embodiment of the present application). Exemplary embodiments of portable devices include, but are not limited to, carry-on

Or portable devices with other operating systems. The above-mentioned portable device may also be other portable devices, as long as it has a foldable touch screen and an algorithm computing capability (which can run the method for operating prompts provided by the embodiments of the present application). It should also be understood that, in some other embodiments of the present application, the above-mentioned electronic device may not be a portable device, but a desktop with a foldable touch screen and algorithm computing capability (the method capable of running the operation prompt provided by the embodiment of the present application). computer.

The structure of the above electronic device is further described with reference to the accompanying drawings.

Taking the electronic device as a mobile phone as an example, FIG. 2A only shows a schematic diagram of the hardware structure of a mobile phone 100 provided by an embodiment of the present application. On the basis of that shown in FIG. 2A , other structural modifications may also exist. As shown in FIG. 2A, the mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1. Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Interface 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, Camera 193, Display screen 194, and a subscriber identification module (SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the mobile phone 100 . In other embodiments of the present application, the mobile phone 100 may include more or less components than those shown in FIG. 2A , or combine some components, or separate some components, or different component arrangements. The components shown in Figure 2A may be implemented in hardware, software, or a combination of software and hardware.

The components of the mobile phone 100 shown in FIG. 2A will be described in detail below.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor ( image signal processor, ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and/or neural-network processing unit (NPU), etc. . Wherein, different processing units may be independent devices, or may be integrated in one or more processors. The controller may be the nerve center and command center of the mobile phone 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be directly called from the memory, so that repeated access can be avoided, the waiting time of the processor 110 can be reduced, and the efficiency of the system can be improved.

The processor 110 may execute the operation prompting method provided by the embodiment of the present application, and the processor may determine that the position of the touch operation on the secondary screen is mapped to the main screen in response to a touch operation on the secondary screen when the mobile phone 100 is in a folded state. position, and the prompt logo corresponding to the touch operation is displayed at the corresponding position on the main screen. When the processor 110 integrates different devices, such as integrating a CPU and a GPU, the CPU and the GPU may cooperate to execute the operation prompt method provided by the embodiments of the present application. For example, in the operation prompt method, some algorithms are executed by the CPU, and another part of the algorithms are executed by the GPU Execute for faster processing efficiency.

In some embodiments, the processor 110 may include one or more interfaces. For example, the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal) interface asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and /or a universal serial bus (universal serial bus, USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193 and the like through different I2C bus interfaces. For example, the processor 110 may couple the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, so as to realize the touch function of the mobile phone 100 .

The I2S interface can be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 . In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through a Bluetooth headset.

The PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160 . For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . The MIPI interface includes a camera serial interface (camera serial interface, CSI), a display serial interface (displayserial interface, DSI), and the like. In some embodiments, the processor 110 communicates with the camera 193 through a CSI interface, so as to realize the shooting function of the mobile phone 100 . The processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the mobile phone 100 .

The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface may be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the mobile phone 100, and can also be used to transmit data between the mobile phone 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices.

It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the mobile phone 100 . In other embodiments of the present application, the mobile phone 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The charging management module 140 is used to receive charging input from the charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from the wired charger through the USB interface 130 . In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through the wireless charging coil of the mobile phone 100 . While the charging management module 140 charges the battery 142 , it can also supply power to the electronic device through the power management module 141 .

The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be provided in the processor 110 . In other embodiments, the power management module 141 and the charging management module 140 may also be provided in the same device.

The wireless communication function of the mobile phone 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in handset 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the mobile phone 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .

The modem processor may include a modulator and a demodulator. Wherein, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and passed to the application processor. The application processor outputs sound signals through audio devices (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or videos through the display screen 194 . In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 110, and may be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the mobile phone 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite systems ( global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .

In some embodiments, the antenna 1 of the mobile phone 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the mobile phone 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code Division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (quasi-zenith). satellite system, QZSS) and/or satellite based augmentation systems (SBAS).

The mobile phone 100 realizes the display function through the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). , AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (quantum dot light emitting diodes, QLED) and so on. In some embodiments, the handset 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

In the embodiment of the present application, the display screen 194 may be an integrated flexible display screen, or a spliced display screen composed of two rigid screens and a flexible screen located between the two rigid screens. When the processor 110 executes the operation prompting method provided by the embodiment of the present application, when the display screen 194 is folded, the secondary screen receives a touch operation, and the processor 110 determines that the touch position of the touch operation on the secondary screen is mapped to the touch operation on the main screen. position, and display a prompt on the home screen.

The mobile phone 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor.

The ISP is used to process the data fed back by the camera 193 . For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193 .

Camera 193 is used to capture still images or video. The object is projected through the lens to generate an optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the mobile phone 100 may include one or N cameras 193 , where N is a positive integer greater than one.

A digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the mobile phone 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point, and the like.

Video codecs are used to compress or decompress digital video. The handset 100 may support one or more video codecs. In this way, the mobile phone 100 can play or record videos in various encoding formats, such as: Moving Picture Experts Group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.

The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process the input information, and can continuously learn by itself. Applications such as intelligent cognition of the mobile phone 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area can store data (such as audio data, phone book, etc.) created during the use of the mobile phone 100 and the like. In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like. The processor 110 executes various functional applications and data processing of the mobile phone 100 by executing the instructions stored in the internal memory 121 and/or the instructions stored in the memory provided in the processor.

The mobile phone 100 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. Such as music playback, recording, etc.

The audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .

Speaker 170A, also referred to as a "speaker", is used to convert audio electrical signals into sound signals. The mobile phone 100 can listen to music through the speaker 170A, or listen to a hands-free call.

The receiver 170B, also referred to as "earpiece", is used to convert audio electrical signals into sound signals. When the mobile phone 100 answers a call or a voice message, the voice can be answered by placing the receiver 170B close to the human ear.

The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C through a human mouth, and input the sound signal into the microphone 170C. The mobile phone 100 may be provided with at least one microphone 170C. In other embodiments, the mobile phone 100 may be provided with two microphones 170C, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, the mobile phone 100 may further be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The earphone jack 170D is used to connect wired earphones. The earphone port 170D may be the USB port 130 or a 3.5mm open mobile terminal platform (OMTP) standard port, a cellular telecommunications industry association of the USA (CTIA) standard port.

The pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be provided on the display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, and the like. The capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The cell phone 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the mobile phone 100 detects the intensity of the touch operation according to the pressure sensor 180A. The mobile phone 100 can also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

The gyroscope sensor 180B can be used to determine the motion attitude of the mobile phone 100 . In some embodiments, the angular velocity of cell phone 100 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyroscope sensor 180B detects the shaking angle of the mobile phone 100, calculates the distance to be compensated by the lens module according to the angle, and allows the lens to offset the shaking of the mobile phone 100 through reverse motion to realize anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenarios.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the mobile phone 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

The magnetic sensor 180D includes a Hall sensor. The mobile phone 100 can use the magnetic sensor 180D to detect the opening and closing of the flip holster. In some embodiments, when the mobile phone 100 is a flip machine, the mobile phone 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Further, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, characteristics such as automatic unlocking of the flip cover are set.

The acceleration sensor 180E can detect the magnitude of the acceleration of the mobile phone 100 in various directions (generally three axes). When the mobile phone 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.

Distance sensor 180F for measuring distance. The cell phone 100 can measure the distance through infrared or laser. In some embodiments, when shooting a scene, the mobile phone 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. The mobile phone 100 emits infrared light through the light emitting diodes. Cell phone 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the mobile phone 100 . When insufficient reflected light is detected, the cell phone 100 may determine that there is no object near the cell phone 100 . The mobile phone 100 can use the proximity light sensor 180G to detect that the user holds the mobile phone 100 close to the ear to talk, so as to automatically turn off the screen to save power. Proximity light sensor 180G can also be used in holster mode, pocket mode automatically unlocks and locks the screen. In the embodiment of the present application, the proximity light sensor 180G may be disposed on the first screen of the foldable display screen 194, and the proximity light sensor 180G detects the folding angle between the first screen and the second screen according to the optical path difference of the infrared signal Or the size of the unfolding angle.

The ambient light sensor 180L is used to sense ambient light brightness. The mobile phone 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the mobile phone 100 is in the pocket, so as to prevent accidental touch.

The fingerprint sensor 180H is used to collect fingerprints. The mobile phone 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like. For example, a fingerprint sensor may be disposed on the front of the mobile phone 100 (below the display screen 194 ), or a fingerprint sensor may be disposed on the back of the mobile phone 100 (below the rear camera). In addition, the fingerprint identification function can also be realized by configuring a fingerprint sensor in the touch screen, that is, the fingerprint sensor can be integrated with the touch screen to realize the fingerprint identification function of the mobile phone 100 . In this case, the fingerprint sensor may be configured in the touch screen, may be a part of the touch screen, or may be configured in the touch screen in other ways. In addition, the fingerprint sensor can also be implemented as a full-panel fingerprint sensor. Therefore, the touch screen can be regarded as a panel that can perform fingerprint collection at any position. In some embodiments, the fingerprint sensor can process the collected fingerprint (for example, whether the fingerprint is verified) and send it to the processor 110, and the processor 110 performs corresponding processing according to the fingerprint processing result. In other embodiments, the fingerprint sensor can also send the collected fingerprint to the processor 110, so that the processor 110 can process the fingerprint (eg, fingerprint verification, etc.). The fingerprint sensor in the embodiments of the present application may adopt any type of sensing technology, including but not limited to optical, capacitive, piezoelectric, or ultrasonic sensing technology.

The temperature sensor 180J is used to detect the temperature. In some embodiments, the cell phone 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the mobile phone 100 reduces the performance of the processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the mobile phone 100 heats the battery 142 to avoid abnormal shutdown of the mobile phone 100 caused by the low temperature. In some other embodiments, when the temperature is lower than another threshold, the mobile phone 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the mobile phone 100 , which is different from the position where the display screen 194 is located.

The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the pulse of the human body and receive the blood pressure beating signal. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone, combined with the bone conduction earphone. The audio module 170 can analyze the voice signal based on the vibration signal of the vocal vibration bone block obtained by the bone conduction sensor 180M, so as to realize the voice function. The application processor can analyze the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M, and realize the function of heart rate detection.

The keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. It can also be a touch key. The cell phone 100 can receive key input and generate key signal input related to user settings and function control of the cell phone 100 .

Motor 191 can generate vibrating cues. The motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. The motor 191 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 194 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be contacted and separated from the mobile phone 100 by being inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 . The mobile phone 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card and so on. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The mobile phone 100 interacts with the network through the SIM card to realize functions such as call and data communication. In some embodiments, the handset 100 employs an eSIM, ie: an embedded SIM card. The eSIM card can be embedded in the mobile phone 100 and cannot be separated from the mobile phone 100 .

Although not shown in FIG. 2A , the mobile phone 100 may further include a Bluetooth device, a positioning identification device, a flash, a micro-projection device, a near field communication (NFC) device, etc., which will not be repeated here.

The software system of the mobile phone 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of the mobile phone 100 .

FIG. 2B is a block diagram of the software structure of the mobile phone 100 according to the embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and system libraries, and a kernel layer.

The application layer can include a series of application packages. As shown in Figure 2B, applications such as camera, gallery, calendar, call, map, navigation, bluetooth, music, video, short message, etc. can be installed in the application layer.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for the applications of the application layer. The application framework layer includes some predefined functions.

As shown in FIG. 2B, the application framework layer may include a window manager (WMS), a content provider, a telephony manager, a resource manager, a display manager service (DMS), a view system, an activity manager , notification manager, etc., which are not limited in this embodiment of the present application.

Among them, the display management service can be used to obtain the specific physical form of the current flexible screen from the underlying display system, such as the fully folded state shown in FIG. 1C , the partially folded state shown in FIG. 1B , and the unfolded state shown in FIG. 1A . state.

The system library and kernel layer below the application framework layer can be called the underlying system. The underlying system includes the underlying display system used to provide display services. For example, the underlying display system includes the display driver in the kernel layer and the surface in the system library. manager, etc. In addition, the underlying system in the present application also includes a state monitoring service for identifying changes in the physical shape of the flexible screen, and the state monitoring service can be independently set in the underlying display system, or can be set in the system library and/or the kernel layer.

Exemplarily, the state monitoring service may call a sensor service (sensor service) to start sensors such as a gyroscope and an acceleration sensor for detection. The status monitoring service can calculate the angle between the current main screen and the secondary screen according to the detection data reported by each sensor. In this way, through the angle between the main screen and the secondary screen, the state monitoring service can determine whether the flexible screen is in an unfolded state, a folded state, or a stand state. In addition, the state monitoring service can report the determined physical form to the above-mentioned display management service.

As shown in FIG. 2C , it is a schematic diagram of the data flow inside the Android operating system. Exemplarily, the gyroscope and acceleration sensor at the hardware layer can report the detected data to the sensor driver, and the sensor driver reports the data detected by the gyroscope and the acceleration sensor to the status monitoring service through the sensor service. The status monitoring service can determine the angle between the main screen and the secondary screen based on the data detected by the gyroscope and acceleration sensor, and then determine the physical form of the phone. At the same time, the touch device can also report the detected input event data to the status monitoring service through the TP driver. The state monitoring service can report the determined physical form of the mobile phone to the display management service. When the display management service determines that the input event acts on the secondary screen, it determines the operation position on the secondary screen and the location where the input event is mapped to the main screen. And notify the window manager to draw and display the corresponding prompt logo on the main screen.

The Android Runtime includes core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.

A system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL) and so on. The Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing. 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, a sensor driver, and the like, which are not limited in this embodiment of the present application.

The following embodiments can all be implemented in an electronic device having the above-mentioned hardware structure, such as a mobile phone 100. The following embodiments will take the mobile phone 100 as an example, and describe in detail the operation prompting method provided by the embodiments of the present application with reference to the accompanying drawings.

The term "user interface" in the description, claims and drawings of this application is a medium interface for interaction and information exchange between application programs or operating systems and users, which realizes the internal form of information and the form acceptable to users. conversion between. A commonly used form of user interface is a graphical user interface (graphic user interface, GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen 194 of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. Visual interface elements.

Some exemplary user interfaces (UIs) provided by the cell phone 100 are described below.

In the embodiment of the present application, when the electronic device 100 is in a fully expanded state, the secondary screen and the main screen of the electronic device 100 form an integral screen, displaying a user interface.

As shown in 3a in FIG. 3 , the foldable touch screen of the mobile phone 100 is in a fully unfolded state, and a user interface 310 displayed by the mobile phone 100 is the main interface of the mobile phone. The user interface 310 may include a status bar 311, a time and weather widget 313, and icons of various applications, such as an icon of an alarm clock application, an icon of a Taobao application, a picture of a photo application, an icon of a memo, and the like. The status bar 311 may include an operator name (eg, China Mobile), a Wi-Fi icon, time, and remaining battery (eg, 30%), and the like. The user interface may also include a hideable navigation bar (not shown in the figures) that may include a back key icon, a home key icon, and a forward key icon. In addition, it can be understood that, in some embodiments, the status bar 311 may further include a Bluetooth icon, a mobile network (eg, 4G), an alarm clock icon, an external device icon, and the like. It can also be understood that, in other embodiments, the user interface 310 shown in 3a in FIG. 3 may further include a Dock bar 312, and the Dock bar 312 may include commonly used application icons, such as browser application icons, Set the icon of the application, the icon of the WeChat application, the icon of the camera application, etc. After the processor 110 detects the touch event of the user's finger (or stylus, etc.) on the icon of a certain application, in response to the touch event, the user interface of the application corresponding to the application icon is opened, and the user interface of the application corresponding to the application icon is opened on the display screen 194 Displays the app's user interface.

In some other embodiments, the cell phone 100 may also include a home screen key. The home screen key can be a physical key or a virtual key. The home screen key is used to return the graphical user interface GUI displayed on the touch screen to a certain page of the home screen according to the user's operation, so that the user can view the home screen at any time and operate the controls (such as icons) in the home screen. . The above operation may specifically be that the user presses the home screen key, or the user presses the home screen key twice in a short period of time, or the user presses the home screen key for a long time. In some other embodiments of the present application, the home screen key may also be integrated with a fingerprint sensor, so that when the user presses the home screen key, the mobile phone 100 will then perform fingerprint collection to confirm the user's identity. In still other embodiments, the home screen key may further include an under-screen fingerprint sensor. When the display screen is on, the light emitted by the display screen illuminates the fingerprint lines, and the light reflected on the fingerprint lines is captured by the under-screen fingerprint sensor. The fingerprint image is compared with the pre-stored fingerprint image. In the screen fingerprint unlocking scenario, if the matching is successful, the unlocking is performed. The comparison process can be to extract the fingerprint image features to compare with the pre-stored feature templates, and the matching is successful when the similarity exceeds a certain threshold.

It can be understood that, 3a in FIG. 3 only exemplarily shows the user interface of the foldable touch screen of the mobile phone 100 in a fully unfolded state, and does not constitute a limitation to the embodiments of the present application.

In the following embodiments of the present application, when the mobile phone 100 is folded, both the main screen and the sub-screen are located on the exposed side as an example for description.

When the complete display screen 194 of the mobile phone 100 is folded, the secondary screen and the main screen can display the same content, for example, the main screen displays the user interface 320 shown in 3b in FIG. Similarly, for example, a status bar, time and weather widgets, and icons of various applications, etc. may be included. For details, please refer to the description about the user interface 310 . The user interface displayed on the secondary screen may be the same as the user interface 320 , that is, the secondary screen also displays the same user interface 320 . The secondary screen and the primary screen may also display different contents, for example, the primary screen displays the user interface 320 as shown in 3b in FIG. 3 , and the secondary screen does not display content.

In the embodiment of the present application, when the mobile phone 100 is in a folded state, as shown in 3b in FIG. 3 , the user faces the main screen, and the secondary screen is on the back of the main screen, so the user can only see the content displayed on the main screen, but not the content displayed on the main screen. For the content on the secondary screen, when the general user holds the mobile phone 100 with one hand, in order to support the weight of the mobile phone and maintain the balance of the mobile phone, they are used to the palm facing the secondary screen, the thumb on one side of the main screen, and the other fingers on the other side of the main screen. Hold the phone by the side, and the user's index finger can operate on the secondary screen. The mobile phone can detect the user's operation on the secondary screen, and display the result of the operation on the main screen, so that the user can see the operation status of the user on the secondary screen at any time. Therefore, the embodiments of the present application provide a method for prompting operations. The mobile phone 100 can provide a display touch area on the secondary screen, and the mobile phone 100 can respond to the touch when the mobile phone 100 receives a user's touch operation on the display touch area on the secondary screen. The operation displays a prompt sign at the corresponding position on the main screen according to the position mapping relationship, and the display position of the prompt sign in the main screen is associated with the touch position of the touch operation, and the position mapping relationship is determined according to the display touch area of the main screen and the secondary screen. In this way, the mobile phone 100 can display the prompt logo on the main screen after receiving the user's touch operation on the display touch area of the secondary screen, so that the user can adjust the operation position in time when seeing the prompt logo, thereby preventing the user from being unable to see the secondary screen As a result, a position error triggered by the touch operation is caused, which improves the user experience.

The operation prompting method provided in this embodiment of the present application can be applied to various scenarios. In different scenarios, the size of the display touch area of the secondary screen may also be different. In some scenarios, the display touch area of the secondary screen may be the size of the secondary screen. The entire screen displays the touch area. In other scenarios, the display touch area of the secondary screen may also be a part of the screen area on the secondary screen, so that the user's finger only needs to operate on a small range of display touch areas, and the entire display touch area of the large range of the main screen can be achieved. area to operate, which is convenient for users to operate.

For ease of understanding, the following embodiments of the present application will take the mobile phone with the structure shown in FIG. 2A as an example, and combine the software structure of FIG. 2C and various application scenarios provided by the embodiments of the present application to provide an operation prompt method provided by the embodiments of the present application. for a detailed introduction.

Application scenario 1: a scenario in which the main screen of the mobile phone 100 displays a certain user interface (such as the main interface, the negative screen, or the user interface of other applications, etc.). In this scenario, there is a positional mapping relationship between the display touch area included in the secondary screen and the display touch area on the main screen, that is, when an operation is performed on the display touch area on the secondary screen, a prompt sign can be displayed at the corresponding position on the main screen.

The following embodiments take the main interface displayed on the main screen of the mobile phone 100 as an example, and introduce the process of displaying the prompt logo on the main screen by operating the sub-screen.

Referring to 4a in FIG. 4, a main interface 410 is displayed on the main screen of the mobile phone 100, and the main interface 410 may include one or more application icons, such as the icon of the alarm clock application shown in 4a in FIG. 4, the icon of the Taobao application, the icon of the photo application icon, the icon of the memo application, the icon of the mail application, the icon of the settings application, the icon of the WeChat application, and the icon of the camera application. A display touch area 420 is displayed on the secondary screen of the mobile phone 100 .

Referring to 4b in FIG. 4 , the user's finger performs a touch operation on the touch position 421 of the display touch area 420 on the secondary screen. The touch device in the mobile phone 100 detects the touch operation of the user's finger on the display touch area 420 on the secondary screen. Through the TP The driver reports the input event and the coordinate value of the touch position 421 on the secondary screen to the status detection service, and the status monitoring service reports the input event and the coordinate value of the touch position 421 on the secondary screen to the display management service. The display management service determines that the coordinate value of the touch position 421 on the secondary screen is at The response position on the main screen, that is, the position where the prompt mark 411 shown in 4b in FIG. 4 is located.

The following describes the position mapping relationship between the display touch area 410 of the main screen and the display touch area 420 of the secondary screen with reference to FIG. 5 . Referring to FIG. 5 , a schematic diagram of a location mapping relationship provided for this application.

As shown in FIG. 5 , the shape of the display touch area 420 of the secondary screen and the shape of the display touch area 410 of the main screen are both rectangles. The coordinates of each pixel on the map are mapped to obtain the position mapping relationship. It should be understood that the embodiment of the present application does not limit the shape of the display touch area on the secondary screen, for example, the shape of the display touch area may also be an ellipse, a diamond, a circle, or other shapes.

Exemplarily, for the position A(x, y) on the display touch area 420 on the secondary screen of the mobile phone 100, according to the position mapping relationship between the display touch area 420 on the secondary screen and the display touch area 410 on the main screen, the position can be A(x, y) is mapped to position B(X, Y) in the display touch area 410 of the home screen. That is to say, when the user performs a touch operation at the position A(x, y) where the touch area 420 is displayed on the secondary screen, the mobile phone 100 can display a prompting mark at the position B(X, Y) in response to the touch operation. Among them, the mapping parameter between the position A (x, y) and the position B (X, Y) can be a numerical value, for example, the mapping parameter is m, and the position B (mx, my) corresponding to the position A (x, y); The mapping parameter can also be an array, such as (m,n), and position A (x, y) corresponds to position B as (mx, ny). The mapping parameters are not limited in this embodiment of the present application.

Exemplarily, the area of the display touch area of the secondary screen is smaller than or equal to the area of the display touch area of the main screen, so that the user's finger only needs to operate on the small area of the display touch area, and the entire display touch area of the large area of the main screen can be realized. area to operate, which is convenient for users to operate.

After determining that the coordinate value of the touch position 421 of the user's finger on the secondary screen is mapped to the response position on the main screen, the display management service reports the coordinate value of the response position on the main screen to the window manager. In response to the coordinate value of the position, draw the prompt flag 411, and send the drawn layer including the prompt flag 411 and other layers to the surface manager (SurfaceFlinger). After the surface manager merges all the layers, it is sent to the display drive, so as to drive the display screen (such as the main screen) to display the display interface including the prompt mark 411 through the display drive.

In this embodiment of the present application, the prompting mark 411 may be an arrow icon, and it should be understood that the prompting mark 411 may also be other icons, such as icons such as dots and pens, which are not limited here.

The user can also perform a touch operation on the display touch area 420 on the secondary screen to realize that after the prompt logo 411 is displayed on the main screen, slide a finger on the display touch area 420 of the secondary screen to move the prompt logo to the desired opening. On the icon of the application, and then click on the secondary screen to open the application.

After the application is opened, a touch operation can also be performed on the secondary screen to operate the user interface of the application displayed on the primary screen, and the position of the finger operating on the secondary screen is displayed on the primary screen. The following embodiment takes opening the photo application on the main screen as an example, and introduces the process of displaying the prompt logo on the main screen by operating the secondary screen of the mobile phone.

Referring to 6a in FIG. 6 , the display touch area 610 of the main screen of the mobile phone 100 displays a picture 630, and the display touch area 620 of the secondary screen is a rectangle. The specific shape of the display touch area 620 is not limited here, and may be other shapes. . There is a position mapping relationship between the display touch area 610 and the display touch area 620 .

Exemplarily, the mobile phone 100 detects the touch operation on the display touch area 620 on the secondary screen, the touch device in the mobile phone 100 detects the touch operation on the display touch area 620 on the secondary screen by the user's finger, and drives the state detection through the TP. The service reports the input event and the coordinate value of the touch position 621 on the secondary screen, and the state monitoring service reports the input event and the coordinate value of the touch position 621 on the secondary screen to the display management service. The display management service determines that the coordinate value of the touch position 621 on the secondary screen is at The response position on the main screen, that is, the position where the prompt mark 611 shown in 6a in FIG. 6 is located.

After determining that the coordinate value of the touch position 621 of the user's finger on the secondary screen is mapped to the response position on the main screen, the display management service reports the coordinate value of the response position on the main screen to the window manager. Draw the prompt flag 611 in response to the coordinate value of the position, and send the drawn layer including the picture 630, prompt flag 611 and other layers to the surface manager (SurfaceFlinger). It is sent to the display driver to drive the display screen (eg, the main screen) to display the display interface including the prompt mark 611 through the display driver.

For example, the prompting mark 611 is an arrow icon, and the prompting mark 611 may also be in other shapes, and the specific shape of the prompting mark 611 is not limited here.

When the user's finger slides the finger on the secondary screen, the prompt sign 611 displayed on the main screen will also move along with the finger sliding operation. Users can slide their fingers on the secondary screen to the area that needs to be operated, and perform operations, such as clicking (single, double-click, multiple clicks) on the area that needs to be operated, and the click operation is used to lock (or identify) the desired area. The area where the next operation is performed, and then perform the sliding operation. For example, in the scene where the main screen displays a picture, the sliding operation is used to zoom in or out the locked area in the picture. For example, in the scene of playing video or playing music, the The sliding operation is used to go forward or backward, or to adjust the brightness to increase or decrease.

After the prompt sign 611 is displayed on the home screen, referring to 6b in FIG. 6 , when the mobile phone 100 detects the operation of sliding up at the touch position 622, an enlarged picture is displayed on the home screen in response to the operation (as shown in 6c in FIG. 6 ). display), a prompt sign 613 may also be displayed on the main screen, and the prompt sign 613 is used to instruct the user to slide a finger upward on a certain point on the secondary screen. Correspondingly, the mobile phone 100 detects a downward sliding operation at the touch position 622, and can display a zoomed-out picture on the main screen in response to the operation, and a prompt indicator for indicating the sliding track of the user's finger on the secondary screen.

In the examples shown in FIG. 4 and FIG. 6 , the secondary screen may be a touch screen or a fingerprint screen with a fingerprint entry function, and the fingerprint screen may be a fingerprint sensor provided under the display screen for collecting fingerprints. For example, if the photo application is provided with the function of fingerprint verification, before operating the photo, it is also necessary to verify whether the input fingerprint corresponding to the touch operation is the fingerprint in the fingerprint template library. During the touch operation, the fingerprint sensor can collect the input fingerprint of the user's finger, and the fingerprint sensor reports the collected input fingerprint to the fingerprint trusted application in the TEE, and identifies whether the fingerprint image matches the fingerprint template stored in the secure memory to obtain the fingerprint. Identify the results. The fingerprint trusted application sends the fingerprint identification result to the fingerprint daemon. After that, the fingerprint daemon reports the fingerprint identification result to the fingerprint manager through the fingerprint service. If the fingerprint identification result is a match, the fingerprint verification is successful; if the fingerprint identification result is a mismatch , then the fingerprint verification fails. When the fingerprint manager determines that the fingerprint verification is successful, it sends a drawing instruction to the WMS. The drawing instruction packet is used to instruct the drawing of the atlas 630 and the layer of the prompt identification 611. When the fingerprint manager determines that the fingerprint verification fails, it does not send a drawing instruction to the WMS. That is to say, the mobile phone 100 does not respond to the user's touch operation on the display touch area of the secondary screen, that is, does not display a prompting mark on the main screen.

With the example shown in Figure 6 above, the user can click and slide the display touch area on the secondary screen with a single finger. to zoom in or out on the picture shown above.

In some other embodiments, the user can also use two fingers to click and slide on the display touch area on the secondary screen, so as to zoom in or zoom out the picture displayed on the main screen.

7 a, the display touch area 710 on the main screen displays a picture 730, the user can perform a click operation on the touch position 721 of the display touch area 720 on the secondary screen, the mobile phone 100 detects the click operation, and collects and executes the operation. Click the fingerprint A corresponding to the operation, and match the fingerprint A with the fingerprint template in the fingerprint template library. If there is a fingerprint template in the fingerprint template library that matches the fingerprint A, the mobile phone 100 responds to the click operation on the main screen. Prompt identification 711, the graphic identification 711 may be an oval icon. If there is no fingerprint template matching the fingerprint A in the fingerprint template database, the mobile phone 100 does not respond to the click operation, that is, the main screen does not display the prompt identification 711 .

After that, the mobile phone 100 detects that the sliding operation is performed at the touch position 722, the fingerprint sensor collects the fingerprint B that performs the sliding operation, and matches the fingerprint B with the fingerprints in the fingerprint template library. If there is a fingerprint template in the fingerprint template library Matching with the fingerprint B, the mobile phone 100 displays an enlarged picture on the main screen (as shown in 7c in FIG. 7 ) in response to the sliding operation (such as sliding up), and correspondingly, the mobile phone 100 detects that the sliding operation is performed at the touch position 722 (such as swiping down), a reduced picture can be displayed on the home screen in response to this action. If there is no fingerprint template matching the fingerprint B in the fingerprint template database, the mobile phone 100 does not respond to the sliding operation.

Through the example shown in FIG. 7 above, the user can click and slide the display touch area on the secondary screen with two fingers, that is, the tapping and sliding operations are performed by two fingers respectively, so as to realize the upper display on the main screen. to zoom in or out. In the example shown in FIG. 7 , the clicking operation and the sliding operation may be performed by two different fingers of the same hand, or may be performed by two fingers of different hands. For the convenience of operation, two different fingers of the same hand are generally used to perform the clicking operation and the sliding operation respectively. For example, the user may use the index finger of the right hand to perform a click operation, and use the middle finger of the right hand to perform a sliding operation.

It should be noted that, in the examples shown in the above Figures 6 and 7, the click operation is used to lock the position to be enlarged, the upward sliding operation is used to realize the enlargement of the picture, and the downward sliding operation is used to realize the reduction of the picture. Operations such as double-clicking, multiple-clicking, and drawing circles can be performed on the position that needs to be enlarged, so as to lock the position that needs to be enlarged, which is not limited in this application.

It should be understood that it is also possible to directly perform a sliding operation to zoom in or zoom out a picture, that is, the user does not need to perform an operation to lock the position that needs to be zoomed in. For example, the position of the center point of the picture can be zoomed in or out by default when the sliding operation is performed; and then For example, when a sliding operation is performed, the mobile phone 100 can automatically identify the target object in the picture (the person shown in 6a in FIG. 6 ), and then zoom in or out on the target object; for another example, the mobile phone can start the sliding operation The position of the starting point can be zoomed in or out.

In some other embodiments, an upward sliding operation may also be set to reduce the picture, and the downward sliding operation may be used to realize the enlargement of the picture. In some other embodiments, a click operation can be set to enlarge the picture, and a long press operation can be set to reduce the picture; or, a click operation can be set to reduce the picture, and the long press operation can be set to enlarge the picture.

In some other scenarios, the secondary screen can support fingerprint entry functions, such as fingerprint entry, fingerprint unlocking, etc.), the display touch area in the secondary screen (such as the display touch area 810 in application scenario 2, and the display in application scenario 3). The touch area 910) supports the fingerprint entry function, and when the fingerprint entry function is enabled, the fingerprint can be collected through the fingerprint sensor located in the display touch area of the secondary screen.

Among them, the fingerprint entry function of the secondary screen can be triggered and turned on in various ways. In a possible implementation manner, when the mobile phone 100 is in the off-screen state, the main screen of the mobile phone 100 is awakened (ie, when the main screen enters the bright-screen state from the off-screen state), the fingerprint entry function of the secondary screen is enabled. In another possible implementation manner, the mobile phone 100 may enable the fingerprint entry function of the secondary screen when detecting that the mobile phone 100 is picked up by the user. In another possible implementation, when the mobile phone 100 detects that the angle between the secondary screen and the main screen is smaller than a preset threshold, it means that the mobile phone is in a folded state, and the fingerprint entry function of the secondary screen is turned on. The preset threshold can be 180°, or any angle less than 180°, which is not limited here.

It should be understood that, after the fingerprint entry function is enabled, the fingerprint entry function can always be enabled. In order to save power consumption, when the main screen enters the off-screen state from the bright screen state, the mobile phone 100 turns off the fingerprint entry function of the secondary screen. When the main screen is awakened again, the mobile phone 100 enables the fingerprint entry function of the secondary screen. In some other embodiments, after enabling the fingerprint entry function, the fingerprint entry function may be disabled periodically. For example, after the fingerprint entry function is enabled for a certain period of time, the fingerprint entry function of the secondary screen is disabled, and the fingerprint entry function is triggered to be enabled again when the fingerprint entry function needs to be used. It is also possible to disable the fingerprint entry function of the secondary screen when the mobile phone 100 does not detect an operation on the secondary screen for a long time.

In the embodiment of the present application, when the main screen of the mobile phone 100 is in the off-screen state, the main screen of the mobile phone needs to be woken up first, so that the main screen is in the bright screen state, so that the prompt sign can be displayed. The secondary screen can be in the off-screen state, or it can be in the bright screen state. When the secondary screen needs to be touched, the fingerprint entry function of the secondary screen can be turned on.

Application Scenario 2: Fingerprint Entry Scenario. When the user of the mobile phone 100 needs to enter a new fingerprint in the mobile phone 100, the mobile phone 100 can start the Settings application when the fingerprint entry function of the secondary screen has been turned on, and open the fingerprint entry interface for the settings application to enter the fingerprint entry. In the scenario, the setting application of the application layer sends the relevant parameters of the user interface for fingerprint entry to the surface manager through WMS, and the surface manager calls the display driver to drive the display device (such as the main screen) to display the user for fingerprint entry. interface. In addition, when the setting application enters the user interface of the fingerprint icon 820 , the setting application of the application layer issues a command code of the fingerprint entry scenario, such as command code 1, to the underlying system. After the fingerprint sensor driver receives the command code 1, it drives the fingerprint sensor to switch to the image capture mode and waits for finger input.

As shown in 8a in FIG. 8 , there is a position mapping relationship between the display touch area of the secondary screen and the display touch area of the main screen. For example, the fingerprint frame 810 on the secondary screen is mapped to the fingerprint icon 820 on the main screen. When the touch device detects that the user's finger touches the fingerprint frame 810 in the display touch area of the secondary screen, the TP driver reports the input event and the coordinate value of the fingerprint frame 810 on the secondary screen to the display management service through the status detection service, and the display management The service may determine the location of the fingerprint icon 820 according to the location mapping relationship between the display touch area of the main screen and the display touch area of the secondary screen. That is, the user's finger enters a fingerprint in the fingerprint box 810 of the secondary screen, and a prompt mark 821 can be displayed in the fingerprint icon 820 of the main screen.

When the fingerprint sensor detects that the finger is pressed, an interrupt message is reported to the fingerprint sensor driver, and the fingerprint sensor drives the fingerprint sensor to collect the fingerprint image. After that, the fingerprint sensor driver reads the fingerprint image collected by the fingerprint sensor, and reports the fingerprint image and the command code 1 to the fingerprint manager. The fingerprint image is stored in the internal memory as a fingerprint template, and the result that the fingerprint has been successfully entered is reported to the setting application.

In some embodiments, in the process of fingerprint entry, when the collected fingerprint does not meet the requirements, for example, the touch position is not within the designated area, the area of the entered fingerprint is smaller than the preset area, etc., it may be necessary to adjust the finger on the secondary screen several times. The touch position on the displayed touch area can be synthesized according to the fingerprints collected multiple times to obtain a complete fingerprint, and the complete fingerprint is stored as a fingerprint template in the internal memory 121 of the mobile phone 100, so that the fingerprint can be unlocked when the fingerprint is unlocked. In the scene, the collected input fingerprint is compared with the fingerprint template, and when the input fingerprint matches the fingerprint template in the fingerprint database, the function of fingerprint unlocking is realized. In order to ensure the security of the fingerprint template, the fingerprint template can also be stored in secure hardware, for example, the secure hardware can be a secure memory, and in the scenario of fingerprint unlocking, the input fingerprint is verified in a trusted execution environment.

Referring to 8b in FIG. 8 , when the mobile phone 100 detects a touch operation in which the user's finger touches the fingerprint frame 810 in the secondary screen, the touch operation occupies a part of the fingerprint frame 810 in the touch area 811 of the fingerprint frame 810, and the mobile phone 100 on the main screen The fingerprint icon 820 displays a prompt mark 821 corresponding to the touch area 811, the shape of the prompt mark 821 is consistent with the shape of the touch area 811, and the position of the prompt mark 821 in the display touch area of the main screen is the same as the display of the touch area 811 on the secondary screen The position of the touch area satisfies the position mapping relationship, so that the mobile phone can prompt the user on the main screen of the shape and position of the fingerprint entered in the secondary screen.

When the user sees that the area of the prompt mark 821 on the main screen as shown in 8b in FIG. 8 is smaller than that of the fingerprint icon 820, and the prompt mark 821 is located in the middle of the fingerprint icon 820, it means that the fingerprint collected by the mobile phone is incomplete. , so the prompt mark 821 indicates that the fingerprint collected by the touch area 811 does not meet the requirements, and the user can adjust the touch position of the finger in the display touch area 820. For example, the fingerprint icon 820 is not occupied by the prompt mark 821. Touch operation again, So that the mobile phone 100 can collect a more complete fingerprint.

After the main screen displays the prompt logo 821 as shown in 8b in FIG. 8, the user performs a touch operation again on the left side of the fingerprint frame 810 of the secondary screen. Referring to 8c in FIG. 8, the mobile phone 100 responds to the user's finger on the secondary screen. The touch operation of the fingerprint frame 810 on the fingerprint frame 810 (the touch position is in the touch area 811 of the fingerprint frame 810), the fingerprint icon 820 on the main screen displays a prompt mark 822, and the shape of the prompt mark 822 corresponds to the touch operation in the touch area of the fingerprint frame 810. 812 has the same shape, and the position of the prompt mark 822 in the display touch area of the main screen and the position of the touch area 812 in the display touch area of the secondary screen satisfies a position mapping relationship. The prompt mark 822 indicates that the area of the fingerprint still does not meet the requirements for fingerprint entry, and it is necessary to continue to adjust the touch position of the user's finger on the secondary screen until the prompt mark displayed by the fingerprint icon 820 on the main screen of the mobile phone 100 indicates that the entered fingerprint meets the requirements.

After the main screen displays the prompt logo 822 as shown in 8c in FIG. 8, the user performs a touch operation again on the right position in the fingerprint frame 810 of the secondary screen. Referring to 8d in FIG. 8, the mobile phone 100 responds to the user's finger on the secondary screen The touch operation of the fingerprint frame 810 (the touch position is in the touch area 813 of the fingerprint frame 810), the fingerprint icon 820 on the main screen displays a prompt mark 823, the shape of the prompt mark 823 is the same as the touch operation in the touch area 813 of the fingerprint frame 810. The shape of the fingerprint is the same, and the prompt mark 823 indicates that the area of the fingerprint meets the requirements for fingerprint entry. At this time, the mobile phone 100 can obtain a complete fingerprint, and store the complete fingerprint in the secure memory as a fingerprint template.

It can be seen from 8a, 8b, 8c and 8d in the above-mentioned FIG. 8 that the user adjusts the touch position on the secondary screen twice to collect fingerprints that meet the requirements. In other embodiments, referring to 8a, 8b and 8d in FIG. 8 , after the prompt logo 822 as shown in 8b in FIG. 8 is displayed on the main screen, after one adjustment of the touch position on the secondary screen, the result shown in FIG. 8 can be obtained. The prompt identification 823 shown in 8d in the middle indicates a fingerprint that meets the requirements. In some other embodiments, referring to 8a and 5d in FIG. 8 , the user can obtain a complete fingerprint with one touch operation directly on the display touch area 810 on the secondary screen. The embodiments of the present application only illustrate one, two, and three touch operations on the touch area on the secondary screen, so as to collect a complete fingerprint. In specific implementation, it may be necessary to adjust the touch area on the secondary screen more than three times. Touch the location to collect a complete fingerprint.

Application scenario 3: fingerprint unlocking scenario. In the embodiment of the present application, the fingerprint unlocking scenario may be a scenario of unlocking the mobile phone 100 in a locked screen state, or a scenario in which a fingerprint needs to be verified when using the payment functions of applications such as Alipay and WeChat on the mobile phone 100 . In the fingerprint unlocking scenario, the user can perform a touch operation in the display touch area on the secondary screen of the mobile phone 100, and a prompt logo is displayed in the display touch area on the main screen, and the prompt logo can indicate that the user's finger is in the display touch area on the secondary screen. touch area and touch location in .

The following description takes the scenario of unlocking the mobile phone 100 in the locked screen state as an example.

Referring to 9a in FIG. 9 , a fingerprint icon 920 is displayed on the display touch area of the main screen of the mobile phone 100, and the fingerprint icon 920 is used to display the fingerprint collected when the user touches the fingerprint frame 910 on the display touch area of the secondary screen. The secondary screen of the mobile phone 100 displays a fingerprint frame 910 for collecting fingerprints when a touch operation on the fingerprint frame 910 is detected.

When fingerprint verification is required, when the user performs a touch operation on the fingerprint frame 910 on the secondary screen, the recorded fingerprints may be incomplete. As shown in 9b in FIG. 9 , when the fingerprint sensor of the mobile phone 100 detects the user's fingerprint frame on the secondary screen 910 touch operation, the touch operation is in the touch area 911 formed by the fingerprint frame 910, the mobile phone 100 responds to the touch operation in the fingerprint icon 920 on the home screen and displays a prompt mark 921, at this time, the prompt mark 921 displays a broken fingerprint , so that the user knows that the fingerprint entered by the touch operation is incorrect, and the position of the indicator 921 in the fingerprint icon 920 is shifted to the left, so that the user can adjust the touch position to the right to perform the touch operation, so as to achieve the result as shown in 9c in FIG. 9 . full fingerprint. The prompt identifier 921 may also be text prompt information, such as prompting to adjust the fingerprint entry position.

Referring to 9c in FIG. 9 , when the mobile phone 100 detects a user's touch operation on the fingerprint frame 910 on the secondary screen, the touch operation is performed in the touch area 912 formed by the fingerprint frame 910, and the mobile phone 100 responds to the touch operation on the main screen. A prompting mark 922 is displayed in the fingerprint icon 920, and at this time, the prompting mark 921 displays a complete fingerprint, so that the user knows that the fingerprint area entered by the touch operation is correct. Then, the mobile phone 100 compares the fingerprint collected from the display touch area 912 with the fingerprint template stored in the mobile phone. If the collected fingerprint matches the fingerprint template, unlocking can be achieved; if the collected fingerprint does not match the fingerprint template, unlocking is performed. fail.

After unlocking, referring to 9d in FIG. 9 , the mobile phone 100 may display a user interface 930 on the home screen, and the user interface 930 may include a plurality of application icons. The user can operate on the display touch area 940 of the secondary screen, map the position of the touch operation to the display touch area on the main screen, and display a prompt sign at the corresponding position on the main screen. For the specific process, see the relevant introduction in FIG. 6 . It is not repeated here.

It should be understood that the implementation process of the above fingerprint unlocking scenario can also be applied to the fingerprint verification scenario of fingerprint applications. When using the payment functions in fingerprint applications such as Alipay and WeChat, fingerprint verification may be used instead of password verification. The implementation process of the fingerprint verification of the application is similar to the implementation process of the fingerprint unlocking scenario.

In other embodiments of the present application, an electronic device is also disclosed. As shown in FIG. 10 , the electronic device may include: a touch screen 1001, wherein the touch screen 1001 includes a touch panel 1006 and a display screen 1007; one or A plurality of processors 1002; memories 1003; one or more application programs (not shown); wherein the one or more computer programs 1004 are stored in the aforementioned memory 1003 and configured to be executed by the one or more processors 1002, the one or more computer programs 1004 comprising instructions that can be used to perform the aforementioned implementations method in the example.

Embodiments of the present application further provide a computer storage medium, where computer instructions are stored in the computer storage medium, and when the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned relevant method steps to implement the methods in the above-mentioned embodiments.

Embodiments of the present application further provide a computer program product, which, when the computer program product runs on a computer, causes the computer to execute the above-mentioned relevant steps, so as to implement the methods in the above-mentioned embodiments.

In addition, the embodiments of the present application also provide an apparatus, which may specifically be a chip, a component or a module, and the apparatus may include a connected processor and a memory; wherein, the memory is used for storing computer execution instructions, and when the apparatus is running, The processor can execute the computer-executed instructions stored in the memory, so that the chip executes the touch screen method in the above method embodiments.

The electronic devices, computer storage media, computer program products or chips provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, for the beneficial effects that can be achieved, reference may be made to the corresponding methods provided above. The beneficial effects of the method are not repeated here.

From the description of the above embodiments, those skilled in the art can understand that for the convenience and brevity of the description, only the division of the above functional modules is used as an example for illustration. In practical applications, the above functions can be allocated by different The function module is completed, that is, the internal structure of the device is divided into different function modules, so as to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented. Another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or units, which may be in electrical, mechanical or other forms.

Units described as separate components may or may not be physically separated, and components shown as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, which are stored in a storage medium , including several instructions to make a device (which may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a removable hard disk, a read only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk and other media that can store program codes.

The above content is only a specific embodiment of the present application, but the protection scope of the present application is not limited to this. Covered within the scope of protection of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (9)

1. The utility model provides an operation suggestion method, its characterized in that is applied to the electronic equipment that has collapsible touch-sensitive screen, collapsible touch-sensitive screen includes first screen and second screen, the contained angle between first screen and the second screen is less than preset contained angle, be equipped with fingerprint sensor on the first screen, the method includes:

detecting a first operation on a display touch area on a first screen;

in response to the first operation, acquiring a fingerprint corresponding to the first operation through the fingerprint sensor arranged on the first screen, and displaying a prompt identifier at a corresponding position of the second screen according to a position mapping relation when verifying that the fingerprint is matched with a fingerprint template in a fingerprint template library, wherein the prompt identifier is associated with a touch position of the first operation at a display position of the second screen, the position mapping relation is determined according to display touch areas of the first screen and the second screen, the area of the display touch area of the first screen is smaller than that of the display touch area of the second screen, and the display touch area of the second screen is the whole screen area or a part of screen area of the second screen;

when the first operation is a click operation, after a prompt mark is displayed at a position corresponding to the second screen, locking the display content at the position of the prompt mark in the second screen; zooming in the locked display content in response to a sliding operation in a first direction on the first screen; zooming out the locked display content in response to a sliding operation in a second direction on the first screen.

2. The method of claim 1, wherein the prompt indicia moves in the second screen with a sliding operation of a finger in a display touch area of the first screen.

3. The method according to claim 1, wherein the displaying a prompt mark at a corresponding position of the second screen comprises:

displaying the fingerprint on the second screen.

4. The method of any one of claims 1-3, wherein the predetermined included angle is less than or equal to 180 degrees.

5. An electronic device is characterized by comprising a foldable touch screen, a processor and a memory, wherein the foldable touch screen comprises a first screen and a second screen, an included angle between the first screen and the second screen is smaller than a preset included angle, a fingerprint sensor is arranged on the first screen, and the memory is used for storing one or more computer programs;

the memory stores one or more computer programs that, when executed by the processor, cause the electronic device to perform:

detecting a first operation on a display touch area on a first screen;

in response to the first operation, acquiring a fingerprint corresponding to the first operation through the fingerprint sensor arranged on the first screen, and displaying a prompt identifier at a corresponding position of the second screen according to a position mapping relation when verifying that the fingerprint is matched with a fingerprint template in a fingerprint template library, wherein the prompt identifier is associated with a touch position of the first operation at a display position of the second screen, the position mapping relation is determined according to display touch areas of the first screen and the second screen, the area of the display touch area of the first screen is smaller than that of the display touch area of the second screen, and the display touch area of the second screen is the whole screen area or a part of screen area of the second screen;

when the first operation is a click operation, after a prompt mark is displayed at a position corresponding to the second screen, locking the display content at the position of the prompt mark in the second screen; zooming in the locked display content in response to a sliding operation in a first direction on the first screen; zooming out the locked display content in response to a sliding operation in a second direction on the first screen.

6. The electronic device of claim 5, wherein the prompt indicia moves in the second screen with a sliding operation of a finger in a display touch area of the first screen.

7. The electronic device of claim 5, wherein the one or more computer programs stored in the memory, when executed by the processor, cause the electronic device to perform, in particular:

displaying the fingerprint on the second screen.

8. The electronic device of any of claims 5-7, wherein the predetermined included angle is less than or equal to 180 degrees.

9. A computer-readable storage medium, comprising a computer program which, when run on an electronic device, causes the electronic device to perform the method of any of claims 1 to 4.

Images