CN116027940B - Screen capturing method, device and storage medium - Google Patents

Abstract

This application provides a screenshot method, device and storage medium. By dividing the touch screen into multiple screen segments with relatively small areas, and by determining the constant parameters corresponding to the screen segment where the tapping position is located, the gradient threshold of the screen segment where the acceleration sensor is located, and the two screen segments. The relative distance between the blocks and the distance coefficient corresponding to the relative distance are used to determine the gradient threshold corresponding to the screen block where the tapping position is located, so that different tapping positions can correspond to different gradient thresholds, and thus more accurate Identifying whether this tap triggers a screenshot operation greatly improves the recognition rate of the screenshot operation.

Description

Screenshot methods, equipment and storage media

Technical field

The present application relates to the technical field of terminal equipment, and in particular to a screen capture method, equipment and storage medium.

Background technique

With the continuous development of terminal device technology, the functions supported by terminal devices are becoming more and more abundant. For example, existing terminal devices usually support the screen capture function, so that users can capture what they need at any time through the screen capture function while using the terminal device. Content.

Currently, in order to facilitate users to take screenshots with one hand, many terminal devices have the feature of supporting screenshots with knuckles, so that users can continuously tap the screen with one knuckle to take screenshots.

However, the existing knuckle screenshot function is usually suitable for terminal devices with relatively small screens such as mobile phones. For terminal devices with larger screens such as tablet computers, the success rate of knuckle screenshots is low.

Contents of the invention

In order to solve the above technical problems, this application provides a screen capture method, device and storage medium, aiming to improve the success rate of knuckle screen capture of large screen devices, such as tablet computer devices.

In the first aspect, this application provides a screenshot method, which is applied to terminal equipment. Wherein, the touch screen of the terminal device is divided into multiple screen segments, and the method includes: in response to the user's tapping operation on the touch screen, determining the screen segment where the tapping position is located and the gradient value corresponding to the tapping operation, where the gradient value is Used to indicate the amount of data change between multiple frames of acceleration data; determine the relative distance between the screen block where the tapping position is located and the screen block where the acceleration sensor is located; based on the gradient threshold and relative distance of the screen block where the acceleration sensor is located , the distance coefficient corresponding to the relative distance and the constant parameter corresponding to the screen block where the tapping position is located determine the gradient threshold of the screen block where the tapping position is located; when the gradient value corresponding to the tapping operation is greater than the screen where the tapping position is located When the gradient threshold of the block is exceeded, a screenshot is triggered. Therefore, by dividing the touch screen into multiple screen blocks with relatively small areas, and by determining the constant parameters corresponding to the screen block where the tapping position is located, the gradient threshold of the screen block where the acceleration sensor is located, and these two The relative distance between the screen blocks and the distance coefficient corresponding to the relative distance are used to determine the gradient threshold corresponding to the screen block where the tapping position is located, so that different tapping positions can correspond to different gradient thresholds, and thus It can more accurately identify whether this tap triggers a screenshot operation, which greatly improves the recognition rate of the screenshot operation.

According to the first aspect, determining the screen segment where the tapping position is located includes: determining the coordinates of the tapping position relative to the touch screen; determining the screen segment where the tapping position is located based on the coordinates of the tapping position relative to the touch screen. In this way, by locating the coordinates of the knocking position, the screen block where the knocking position is located can be accurately determined based on the specific coordinates, thereby ensuring the relative distance determined based on the screen block where the knocking position is located and the screen block where the acceleration sensor is located. It is more accurate, thereby ensuring that the calculated gradient threshold is more accurate, thus further improving the recognition rate of screenshot operations.

According to the first aspect, or any implementation of the above first aspect, determining the coordinates of the tapping position relative to the touch screen includes: collecting reporting point data when the user taps the tapping position through a touch sensor in the touch screen; constructing a coordinate relative to the tapping position; The coordinate system of the touch screen; determine the coordinates of the tapping position in the coordinate system based on the reported point data.

According to the first aspect, or any implementation of the above first aspect, determining the coordinates of the tapping position in the coordinate system includes: based on the tapping position collected by the touch sensor in the reporting point data at the first time before tapping. The first capacitance value within the threshold, the second capacitance value at the moment of tapping, and the third capacitance value within the second time threshold after tapping determine the changing trend of the capacitance value; according to the changing trend of the capacitance value, the tapping position is determined Coordinates in a coordinate system. Since the capacitance value changes when the finger or knuckle comes into contact with the touch screen, in order to ensure the recognition rate and reduce misjudgments as much as possible, the tapping moment and the capacitance value within a certain period of time before and after the tapping moment can be obtained. The change in capacitance value can be accurately known, so that through the changing trend of capacitance value, it can be accurately determined whether a tapping operation has occurred and the specific tapping position.

According to the first aspect, or any implementation of the above first aspect, after obtaining the point reporting data, the method further includes: collecting acceleration data when the user taps the tapping position through an acceleration sensor; according to the point reporting data and the acceleration data , predict the confidence value of a screenshot triggered by a tapping operation; when the confidence value is greater than the set confidence threshold, perform the operation of constructing a coordinate system relative to the touch screen. In this way, the process of the screenshot method provided by this application is only executed when the confidence value is greater than the set confidence threshold, thereby further improving the recognition rate of the screenshot operation.

According to the first aspect, or any implementation of the first aspect above, constructing a coordinate system relative to the touch screen includes: taking the lower left corner of the touch screen as the coordinate origin; setting the X-axis to point horizontally to the right, and the Y-axis to point vertically to the top, The Z-axis points to the front of the touch screen, obtaining the coordinate system relative to the touch screen.

According to the first aspect, or any implementation of the above first aspect, determining the gradient value corresponding to the tapping operation includes: collecting acceleration data when the user taps the tapping position through an acceleration sensor; according to the acceleration data , determine the gradient value corresponding to the tapping operation.

According to the first aspect, or any implementation of the above first aspect, based on the following formula, according to the gradient threshold of the screen block where the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the tapping position. The constant parameter corresponding to the screen block determines the gradient threshold of the screen block where the tapping position is located:

Current_Grandient=Threshold_Grandient*distance*Coeff+K

Among them, Current_Grandient is the gradient threshold of the screen block where the knocking position is located, Threshold_Grandient is the gradient threshold of the screen block where the acceleration sensor is located; distance is the difference between the screen block where the knocking position is located and the screen block where the acceleration sensor is located. Coeff is the distance coefficient corresponding to the relative distance, and K is the constant parameter corresponding to the screen block where the tapping position is located.

According to the first aspect, or any implementation of the above first aspect, the number of acceleration sensors is greater than 1; determining the gradient value corresponding to the tapping operation includes: obtaining acceleration data collected by each acceleration sensor when the user taps the tapping position. ;According to each acceleration sensor, collect the acceleration data when the user taps the tapping position, and determine the gradient value corresponding to each acceleration sensor when the tapping operation acts on the tapping position.

According to the first aspect, or any implementation of the above first aspect, determining the relative distance between the screen segment where the knocking position is located and the screen segment where the acceleration sensor is located includes: determining the screen segment where the knocking position is located. The relative distance between the block and the screen block where each acceleration sensor is located.

According to the first aspect, or any implementation of the above first aspect, according to the gradient threshold value of the screen block where the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the corresponding distance coefficient of the screen block where the tapping position is located. Constant parameter to determine the gradient threshold of the screen block where the tapping position is located, including: selecting the shortest relative distance from multiple determined relative distances; the gradient threshold of the screen block where the acceleration sensor is located based on the shortest relative distance. The threshold, the shortest relative distance, the distance coefficient corresponding to the shortest relative distance, and the constant parameter corresponding to the screen block where the knocking position is located determine the gradient threshold of the screen block where the knocking position is located. In this way, when there are multiple acceleration sensors in the terminal device, the shortest relative distance is given priority, as well as the distance coefficient corresponding to the shortest relative distance and the gradient threshold of the screen block where the acceleration sensor is located to calculate the screen block where the tapping position is located. Gradient threshold, thereby ensuring that the calculated gradient threshold is more accurate, thereby further improving the recognition rate of screenshot operations.

According to the first aspect, or any implementation of the above first aspect, when the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block where the tapping position is located, a screenshot is triggered, including: at the shortest relative distance When the gradient value corresponding to the corresponding acceleration sensor is greater than the gradient threshold of the screen block where the tapping position is located, a screenshot is triggered. In this way, it is ensured that all judgments are based on the relevant parameters corresponding to the shortest relative distance, thus ensuring the accuracy of the results.

According to the first aspect, or any implementation of the above first aspect, before determining the relative distance between the screen block where the knocking position is located and the screen block where the acceleration sensor is located, the method further includes: determining each screen The relative distance between the block and the screen block where the acceleration sensor is located; with the acceleration sensor as the center, map outward based on the distance relationship function, and set a corresponding distance coefficient for each relative distance. In this way, the acceleration sensor is used as the center to map outward, and distance coefficients corresponding to different relative distances are set, so that the distance coefficient required when calculating the gradient threshold can more accurately fit the tapping operation, thereby ensuring the calculated gradient The threshold value is more accurate, further improving the recognition rate of screenshot operations.

According to the first aspect, or any implementation of the above first aspect, before determining the relative distance between the screen segment where the tapping position is located and the screen segment where the acceleration sensor is located, the method further includes: determining the relative distance between the camera and the touch screen coordinates; determine the folding line of the touch screen based on the coordinates of the camera relative to the touch screen, the coordinates of the camera relative to the touch screen are located on the folding line, and the folding line runs through part of the screen segments of the touch screen; according to the coordinates of the camera relative to the touch screen and the folding line, for each The constant parameters corresponding to the screen block settings. Due to the protrusion of the camera, when the terminal device is placed horizontally, some areas cannot be parallel to the horizontal plane, that is, there is a certain angle. In this way, when the user clicks on the touch screen of the terminal device, the difference between the reported point data and the acceleration data will be very large. Therefore, by Considering the coordinates of the camera relative to the touch screen, setting special constant parameters for the screen segment where the camera is located and the screen segment on the diagonal line where the camera is located can ensure that the calculated gradient threshold is more accurate, thereby further improving the efficiency of the screenshot operation. Recognition rate.

According to the first aspect, or any implementation of the above first aspect, in response to the user's tapping operation on the touch screen, determining the screen segment where the tapping position is located and the gradient value corresponding to the tapping operation include: setting When receiving N tap operations from the user on any same area of the touch screen within the time threshold, determine the screen block where the tap position is located and the gradient value corresponding to the tap operation, where N is an integer greater than 1. In this way, within a specific period of time, when multiple taps on the same area of the touch screen are detected, the screenshot process provided by this application is triggered, thereby reducing the accidental touch rate and possibly avoiding the situation where the user accidentally touches the screen and takes a screenshot.

In a second aspect, this application provides a terminal device. The terminal device includes: a memory and a processor, and the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the terminal device executes the first aspect or any possible implementation of the first aspect. method instructions.

For example, the terminal device in the second aspect may be a terminal device with a relatively large screen size such as a tablet computer.

In a third aspect, the present application provides a computer-readable medium for storing a computer program, the computer program comprising instructions for performing a method in the first aspect or any possible implementation of the first aspect.

In a fourth aspect, the present application provides a computer program, the computer program comprising instructions for performing a method in the first aspect or any possible implementation of the first aspect.

In a fifth aspect, this application provides a chip, which includes a processing circuit and transceiver pins. Wherein, the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the method in the first aspect or any possible implementation of the first aspect to control the receiving pin to receive the signal, so as to Control the sending pin to send signals.

Description of the drawings

Figure 1 is a schematic diagram of the hardware structure of a terminal device;

Figure 2 is a schematic diagram of the software structure of a terminal device;

Figure 3 is an exemplary schematic diagram of an interface operation of a mobile phone;

Figure 4 is a schematic diagram illustrating the oscillation characteristics of acceleration data after tapping the screen of a mobile phone;

Figure 5 is an exemplary schematic diagram of a tablet used for interface operation;

Figure 6 is a schematic diagram of another tablet for interface operation;

Figure 7 is a schematic diagram illustrating the oscillation characteristics of acceleration data after tapping the screen area shown in Figure 6;

Figure 8 is a schematic flow chart of an exemplary screenshot method;

Figure 9 is a schematic diagram illustrating the division format of a tablet touch screen;

Figure 10 is a schematic diagram of an exemplary knocking plate;

Figure 11 is a schematic flow chart of yet another screenshot method;

Figure 12 is a schematic flow chart of yet another screenshot method;

FIG. 13 is a schematic diagram illustrating two acceleration sensors provided in a flat panel.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

The term "and/or" in this article is just an association relationship that describes related objects, indicating that three relationships can exist. For example, A and/or B can mean: A exists alone, A and B exist simultaneously, and they exist alone. B these three situations.

The terms “first” and “second” in the description and claims of the embodiments of this application are used to distinguish different objects, rather than to describe a specific order of objects. For example, the first target object, the second target object, etc. are used to distinguish different target objects, rather than to describe a specific order of the target objects.

In the embodiments of this application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "such as" in the embodiments of the present application is not to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the words "exemplary" or "such as" is intended to present the concept in a concrete manner.

In the description of the embodiments of this application, unless otherwise specified, the meaning of “plurality” refers to two or more. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

In order to better understand the technical solutions provided by the embodiments of the present application, before describing the technical solutions of the embodiments of the present application, first, in conjunction with the accompanying drawings, the terminal devices (such as mobile phones, tablet computers, touch-enabled PCs) to which the embodiments of the present application are applicable will be described. Machine, etc.) hardware structure is explained.

It should be noted that the technical solutions provided by the embodiments of the present application are particularly suitable for terminal devices with relatively large screens, such as tablet computers, touch-enabled PCs, smart screens, etc. For ease of explanation, Figure 1 takes a tablet computer as an example. illustrate.

Referring to Figure 1, the terminal device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, and a battery 142. Antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, Display 194, and subscriber identification module (subscriber identification module, SIM) card interface 195, etc.

Exemplarily, in some implementations, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, and an ambient light sensor. , bone conduction sensors, etc., will not be listed one by one here, and this application does not limit this.

In order to better understand the working principles of each of the above sensors, detailed descriptions are given below:

Pressure sensors are used to sense pressure signals and convert pressure signals into electrical signals. In some implementations, the pressure sensor may be disposed on the display screen 194 . There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor may include at least two parallel plates of conductive material. When a force acts on a pressure sensor, the capacitance between the electrodes changes. The terminal device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is performed on the display screen 194, the terminal device 100 detects the strength of the touch operation according to the pressure sensor. The terminal device 100 may also calculate the touched position based on the detection signal of the pressure sensor. In some implementations, touch operations acting on the same touch location but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold is applied to the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

The gyro sensor can be used to determine the movement posture of the terminal device 100 . In some implementations, the angular velocity of the terminal device 100 about three axes (ie, x, y, and z axes) may be determined by a gyroscope sensor. The gyro sensor can be used for image stabilization. For example, when the shutter is pressed, the gyro sensor detects the angle at which the terminal device 100 shakes, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shake of the terminal device 100 through reverse movement to achieve anti-shake. Gyroscope sensors can also be used for navigation and somatosensory gaming scenarios.

Air pressure sensors measure air pressure. In some implementations, the terminal device 100 calculates the altitude through the air pressure value measured by the air pressure sensor to assist positioning and navigation.

Magnetic sensors include Hall sensors. The terminal device 100 may detect opening and closing of the flip holster using a magnetic sensor. In some implementations, when the terminal device 100 is a flip machine, the terminal device 100 may detect opening and closing of the flip cover based on a magnetic sensor. Then, based on the detected opening and closing status of the leather case or the opening and closing status of the flip cover, features such as automatic unlocking of the flip cover are set.

The acceleration sensor can detect the acceleration of the terminal device 100 in various directions (generally three axes). When the terminal device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices and be used in horizontal and vertical screen switching, pedometer and other applications.

Distance sensor for measuring distance. The terminal device 100 can measure distance through infrared or laser. In some implementations, when shooting a scene, the terminal device 100 can use a distance sensor to measure distance to achieve fast focusing.

Proximity light sensors may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diode may be an infrared light emitting diode. The terminal device 100 emits infrared light through a light emitting diode. The terminal device 100 detects infrared reflected light from nearby objects using photodiodes. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 100 . When insufficient reflected light is detected, the terminal device 100 may determine that there is no object near the terminal device 100 . The terminal device 100 can use the proximity light sensor to detect when the user holds the terminal device 100 close to the ear for talking, so as to automatically turn off the screen to save power. The proximity light sensor can also be used in holster mode, and pocket mode automatically unlocks and locks the screen.

The ambient light sensor is used to sense ambient light brightness. The terminal device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor can also be used to automatically adjust white balance when taking photos. The ambient light sensor can also cooperate with the proximity light sensor to detect whether the terminal device 100 is in the pocket to prevent accidental touching.

The fingerprint sensor is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application lock, fingerprint photography, fingerprint answering incoming calls, etc.

Temperature sensor is used to detect temperature. In some implementations, the terminal device 100 uses the temperature detected by the temperature sensor to execute the temperature processing policy. For example, when the temperature reported by the temperature sensor exceeds a threshold, the terminal device 100 reduces the performance of a processor located near the temperature sensor in order to reduce power consumption and implement thermal protection. In other implementations, when the temperature is lower than another threshold, the terminal device 100 heats the battery 142 to avoid the low temperature causing the terminal device 100 to shut down abnormally. In some other implementations, when the temperature is lower than another threshold, the terminal device 100 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

Touch sensor, also called "touch panel". The touch sensor can be disposed on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, which is also called a "touch screen". Touch sensors are used to detect touches on or near them. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type, which may include, for example, sliding, clicking, long pressing and other touch event types. Visual output related to the touch operation may be provided through display screen 194 . In other implementations, the touch sensor may also be disposed on the surface of the terminal device 100 in a position different from that of the display screen 194 . Specifically, in the technical solutions provided by the embodiments of this application, when the user touches or taps the touch screen, the touch sensor will detect the user's operating behavior, and the terminal device 100 will respond after receiving the data collected by the touch sensor in the touch screen. For this operation behavior, for example, the operation of determining the screen segment where the tapping position is located in the technical solution provided by the embodiment of the present application is performed.

Bone conduction sensors can pick up vibration signals. In some implementations, the bone conduction sensor can acquire the vibration signal of the vibrating bone mass of the human body. Bone conduction sensors can also contact the human body's pulse and receive blood pressure beat signals. In some implementations, bone conduction sensors can also be provided in earphones and combined into bone conduction earphones. The audio module 170 can analyze the voice signal based on the vibration signal of the vocal vibrating bone obtained by the bone conduction sensor to implement the voice function. The application processor can analyze the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor to implement the heart rate detection function.

Specifically, in the technical solutions provided by the embodiments of this application, the sensor module 180 needs to include at least a touch sensor and an acceleration sensor. In this way, the data collected by the touch sensor can be used to determine whether the user tapped the touch screen, and the specific coordinates of the user's tapping location can be determined. The data collected by the acceleration sensor can be used to determine the data changes between multiple frames of acceleration data, and determine The specific coordinates of the acceleration sensor. Then determine the specific screen segment of the touch screen where the tap position is based on the coordinates of the tapping position, determine the specific screen segment of the acceleration sensor on the touch screen based on the coordinates of the acceleration sensor, and then obtain calculations based on the two determined screen segments. The gradient threshold of the screen block where the tapping position is located can accurately determine whether this tapping needs to trigger a screenshot operation.

In addition, it should be noted that the processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit, GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and/or neural network processor (neural network processor) -network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors.

It can be understood that the controller may be the nerve center and command center of the terminal device 100 . In practical applications, the controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

In addition, it should be noted that the processor 110 may also be provided with a memory for storing instructions and data. In some implementations, the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

By way of example, in some implementations, processor 110 may include one or more interfaces. Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and/ Or universal serial bus (USB) interface, etc.

Continuing to refer to FIG. 1 , the charging management module 140 is illustratively configured to receive charging input from a charger. Among them, the charger can be a wireless charger or a wired charger. In some wired charging implementations, the charging management module 140 may receive charging input from the wired charger through the USB interface 130 . In some implementations of wireless charging, the charging management module 140 may receive wireless charging input through the wireless charging coil of the terminal device 100 . While the charging management module 140 charges the battery 142, it can also provide power to the electronic device through the power management module 141.

Continuing to refer to FIG. 1 , for example, the power management module 141 is used to connect the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, wireless communication module 160, etc. The power management module 141 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters. In some other implementations, the power management module 141 may also be provided in the processor 110 . In other implementations, the power management module 141 and the charging management module 140 can also be provided in the same device.

Continuing to refer to FIG. 1 , for example, the wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

It should be noted that antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other implementations, the antenna can be used in conjunction with a tuning switch.

Continuing to refer to FIG. 1 , as an example, the mobile communication module 150 can provide a solution for wireless communication including 2G/3G/4G/5G applied on the terminal device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some implementations, at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 . In some implementations, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

In addition, it should be noted that the modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194. In some implementations, the modem processor may be a stand-alone device. In other implementations, the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.

Continuing to refer to FIG. 1 , by way of example, the wireless communication module 160 can provide a network that is applied on the terminal device 100 , including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions plan. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

Specifically, in the technical solutions provided by the embodiments of this application, the terminal device 100 can communicate with the cloud server or other servers through the mobile communication module 150 or the wireless communication module 160 . For example, the terminal device 100 can send the corresponding delay time to the cloud server through the mobile communication module 150 . For example, the cloud can be a server cluster composed of multiple servers.

In addition, it should be noted that the terminal device 100 implements the display function through the GPU, the display screen 194, and the application processor. The GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

Continuing to refer to FIG. 1 , illustratively, the display screen 194 is used to display images, videos, etc. Display 194 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light). emitting diode (AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc. In some implementations, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

In addition, it should be noted that the terminal device 100 can implement the shooting function through an ISP, camera 193, video codec, GPU, display screen 194, application processor, etc.

In addition, it should be noted that the ISP is used to process the data fed back by the camera 193 . For example, when taking a photo, the shutter is opened, the light is transmitted to the camera sensor through the lens, the optical signal is converted into an electrical signal, and the camera sensor passes the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some implementations, the ISP may be located in the camera 193 .

In addition, it should be noted that the camera 193 is used to capture still images or videos. The object passes through the lens to produce an optical image that is projected onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other format image signals. In some implementations, the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

Specific to the technical solutions provided by the embodiments of this application, considering that the protrusion of the rear camera will affect the horizontal placement of the terminal device 100, the constant parameters set for each screen segment take into account the impact of the location of the camera on each screen segment. Influence.

In addition, it should be noted that the digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Additionally, it should be noted that video codecs are used to compress or decompress digital video. The terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record videos in multiple encoding formats, such as moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

Continuing to refer to FIG. 1 , for example, the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. Such as saving music, videos, etc. files in external memory card.

Continuing with reference to FIG. 1 , by way of example, internal memory 121 may be used to store computer executable program code including instructions. The processor 110 executes instructions stored in the internal memory 121 to execute various functional applications and data processing of the terminal device 100 . The internal memory 121 may include a program storage area and a data storage area. Among them, the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.). The storage data area may store data created during use of the terminal device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

Specifically, in the technical solutions provided by the embodiments of this application, there are constant parameters corresponding to each screen block, distance coefficients corresponding to the relative distance between any screen block and the screen block where the acceleration sensor is located, and the distance coefficient where the acceleration sensor is located. The gradient threshold value of the screen block can be predetermined and stored in the internal memory 121 of the terminal device, so as to facilitate quick reading.

In addition, it should be noted that the terminal device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.

In addition, it should be noted that the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Audio module 170 may also be used to encode and decode audio signals. In some implementations, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .

Continuing to refer to FIG. 1 , by way of example, the keys 190 include a power key, a volume key, etc. Key 190 may be a mechanical key. It can also be a touch button. The terminal device 100 may receive key input and generate key signal input related to user settings and function control of the terminal device 100 .

Continuing to refer to FIG. 1 , for example, the motor 191 may generate a vibration prompt. The motor 191 can be used for vibration prompts for incoming calls and can also be used for touch vibration feedback. For example, touch operations for different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The motor 191 can also respond to different vibration feedback effects for touch operations in different areas of the display screen 194 . Different application scenarios (such as time reminders, receiving information, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

Continuing to refer to FIG. 1 , for example, the indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, or may be used to indicate messages, missed calls, notifications, etc.

This concludes the introduction to the hardware structure of the terminal device 100. It should be understood that the terminal device 100 shown in Figure 1 is only an example. In a specific implementation, the terminal device 100 may have more or more hardware than what is shown in the figure. With fewer parts, two or more parts may be combined, or may have different part configurations. The various components shown in Figure 1 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

In order to better understand the software structure of the terminal device 100 shown in Figure 1, the software structure of the terminal device 100 is described below. Before describing the software structure of the terminal device 100, the architecture that can be adopted by the software system of the terminal device 100 is first described.

Specifically, in actual applications, the software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

In addition, it is understandable that the software systems currently used by mainstream terminal devices include but are not limited to Windows systems, Android systems, and iOS systems. For ease of explanation, this embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the terminal device 100 .

In addition, in the specific implementation of the subsequent screenshot solutions provided by the embodiments of the present application, the screenshot solutions provided by the embodiments of the present application are also applicable to other systems.

Refer to Figure 2, which is a software structure block diagram of the terminal device 100 according to the embodiment of the present application.

As shown in Figure 2, the layered architecture of the terminal device 100 divides the software into several layers, and each layer has clear roles and division of labor. The layers communicate through software interfaces. In some implementations, the Android system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime and system libraries, and kernel layer.

Among them, the application layer can include a series of application packages. As shown in Figure 2, the application package can include applications such as application market, video, shopping, rights management, Bluetooth, Wi-Fi, settings, etc., which will not be listed one by one here, and this application does not limit this.

The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer.

Among them, the application framework layer includes some predefined functions. As shown in Figure 2, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc., which will not be listed one by one here. This application does not limit this. .

A window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc. Specifically, in the technical review provided by the embodiments of this application, the screenshot operation requires the use of a window manager.

Content providers are used to store and retrieve data and make this data accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc., which will not be listed one by one here, and this application does not limit this.

The view system includes visual controls, such as controls that display text, controls that display pictures, etc. A view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of the electronic device 100 . For example, call status management (including connected, hung up, etc.).

The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc., which are not listed here one by one. This application does not limit this.

The notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a beep sounds, the electronic device vibrates, the indicator light flashes, etc.

Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for the scheduling and management of the Android system.

The core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android.

The application layer and application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and application framework layer into binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.

System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.

The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing.

It is understandable that the above-mentioned 2D graphics engine is a drawing engine for 2D drawing.

In addition, it is understandable that the kernel layer in the Android system is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, sensor driver, etc. For example, the sensor driver can be used to output the detection signal of the sensor (such as a touch sensor) to the viewing system, so that the viewing system displays the corresponding application interface in response to the detection signal.

This concludes the introduction to the software structure of the terminal device 100. It can be understood that the layers in the software structure shown in FIG. 2 and the components included in each layer do not constitute specific limitations on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer layers than shown in the figure, and each layer may include more or fewer components, which is not limited by this application.

In order to better understand the technical solution provided by this application, the usage scenarios of the screenshot solution will be described below with reference to Figures 3 to 7, taking the terminal device as a mobile phone with a relatively small screen and a tablet with a relatively large screen as examples respectively.

Referring to FIG. 3 , by way of example, the current display interface 10a of the mobile phone 10 may include one or more controls. Controls include but are not limited to: network controls, power controls, application icon controls, etc.

Continuing to refer to Figure 3, exemplary application icon controls include but are not limited to: clock application icon control, calendar application icon control, gallery application icon control, memo application icon control, file management application icon control, email application icon control, music Application icon control, calculator application icon control, video application icon control, setting application icon control, weather application icon control, browser application icon control 302, etc. are not listed here one by one, and this application does not limit them.

Continuing to refer to Figure 3, for example, taking the user triggering the knuckle screenshot function on the display page 10a, when the user uses his fingers/knuckles (Figure 3 shows using knuckles) to capture the area 10a-1 of the display page 10a, at a certain time, for example, two consecutive taps within 1 second, the mobile phone 10 will respond to the user's tapping operation. It is understandable that since the screen of the mobile phone 10 is relatively small, even if the area 10a-1 that the user taps is relatively far from the acceleration sensor in the mobile phone 10, the acceleration data collected by the acceleration sensor (hereinafter referred to as: ACC data) The oscillation characteristics are also obvious, so the mobile phone 10 can determine that this tapping operation triggers the knuckle screenshot function, so it will generate a screenshot instruction, trigger the screenshot operation, and then capture the screen corresponding to the display page 10a.

For example, in some implementations, the ACC data collected by the acceleration sensor can be configured to include sampling points corresponding to the tapping moment, and ACC data corresponding to some sampling points before and after the tapping moment, for example, a total of 126 before and after the tapping moment. ACC data of sampling points.

For example, in other implementations, the ACC data collected by the acceleration sensor can be set to include the tapping moment, the ACC data within a certain period before the tapping moment, and the ACC data within a certain period after the tapping moment.

In addition, it should be noted that in order to make the oscillation characteristics more obvious, the ACC data collected by the acceleration sensor can be multiplied by a fixed multiple, so that the oscillation characteristics of the ACC data corresponding to this tapping operation can be determined more clearly and intuitively. As shown in Figure 4, when the user taps the area 10a-1, the ACC data of 126 collection points collected by the acceleration sensor in the mobile phone 10 before and after the tap is multiplied by a fixed multiple.

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment.

From the above description, it can be seen that in practical applications, for terminal devices with relatively small screens such as mobile phones 10, because their screens are relatively small, when tapping any position on the screen, the oscillation characteristics of the ACC data collected by the internal acceleration sensor are It is relatively obvious, so even if the same gradient threshold is used for different tapping areas (data variables used to indicate multi-frame/multi-sampling point ACC data files), it can be accurately identified whether the current tapping operation requires triggering instructions. Joint screenshot function. However, for terminal devices with relatively large screens, such as the tablet 20 shown in Figures 5 and 6, assuming that the acceleration sensor provided in the tablet 20 is located near 20a, when the user taps 20a, the ACC data collected by the acceleration sensor oscillates The characteristics will be more obvious. The oscillation characteristic map can be shown in Figure 4, for example. That is, by using the existing method of using different tapping areas to correspond to the same gradient threshold, it can still be accurately identified that the current tapping operation needs to trigger a knuckle screenshot. Function. However, when the user taps in the area 20b shown in Figure 6, because the area 20b is far from the acceleration sensor located near the area 20a, and the screen of the tablet 20 is large, the ACC data collected by the acceleration sensor is The oscillation characteristics are not obvious enough. For example, as shown in Figure 7, even if the ACC data is multiplied by a fixed multiple, the maximum oscillation amplitude is between 3000 and 5000, while the one shown in Figure 4 is directly between -3000 and 18000. For terminal devices with relatively large screens such as the tablet 20, when the tapping position is far from the acceleration sensor, the gradient value corresponding to the tapping operation (used to indicate the data change between multiple frames of acceleration data) is often not greater than the preset There is a fixed gradient threshold, so the tapping operation is often not recognized as triggering a screenshot operation. The recognition rate and misjudgment rate are both very low, and the user experience is poor.

Therefore, in order to solve the shortcomings of the existing knuckle screenshot function when it is applied to large-screen devices, this application provides a screenshot solution by dividing the touch screen into multiple screen segments with relatively small areas, and by determining the keystrokes. The constant parameters corresponding to the screen block where the click position is located, the gradient threshold of the screen block where the acceleration sensor is located, as well as the relative distance between the two screen blocks and the distance coefficient corresponding to the relative distance are used to determine the click position. The gradient threshold corresponding to the screen block, so that different tapping positions can correspond to different gradient thresholds, so that only the gradient value corresponding to the tapping operation is compared with the gradient threshold of the screen block where the tapping position is located , it can accurately identify whether this tap triggers a screenshot operation, making the gradient threshold used in the judgment more reasonable, thus greatly improving the recognition rate of the screenshot operation.

Combined with the screenshot scenarios shown in Figures 3 to 7, the following takes the terminal device as a tablet device with a relatively large screen as an example, and uses several specific embodiments to illustrate the implementation details of the technical solution provided by this application. The following content is only Implementation details are provided for ease of understanding and are not necessary to implement this solution.

For example, referring to Figure 8, in some embodiments, the specific implementation steps of the screenshot solution provided by this application include:

S101: When receiving N tap operations by the user on any same area of the touch screen within a set time threshold, determine the screen segment where the tap position is located and the gradient value corresponding to the tap operation.

It is understandable that the current knuckle screenshot function is usually triggered by tapping the same position of the touch screen multiple times, such as twice, within a certain period of time, such as 1 second. Therefore, the above N is an integer greater than 1. In other words, when the tablet device receives N tap operations on any same area of the touch screen by the user within a set time threshold, it will respond to the user's tap operation on the touch screen and then determine the screen segment where the tap location is located. piece.

It should be noted that the above-mentioned screen segmentation can be obtained by dividing the touch screen according to business requirements, or can be obtained by dividing the touch screen according to product models. This application does not limit this.

In addition, it should be noted that in some implementations, the multiple screen blocks divided by the touch screen may be uniform blocks or uneven blocks, and this application does not limit this.

After detecting the user's tapping operation on the touch screen, the tablet device responds to the user's tapping operation and determines the screen segment where the tapping position is located. In some implementations, the coordinates of the tapping position relative to the touch screen can be determined first. , and then determine the screen blocks where the tapping position is located based on the determined coordinates of the tapping position relative to the touch screen.

It is understandable that touch events/knock events are usually sensed through the touch sensor (or capacitive sensor) in the touch screen. Therefore, when determining the coordinates of the tap position relative to the touch screen, the user taps the above-mentioned taps collected by the touch sensor can be used. Determine the point report data when clicking the position.

The so-called report (Touch report) refers to the integrated circuit (Touch Panel Integrated Circuit, TP IC) of the touch screen reporting to the tablet device through the integrated circuit bus (Inter Integrated Circuit, I2C) or the serial peripheral interface (Serial Peripheral Interface, SPI). The coordinates obtained at the tapping position reported by the application processor (ApplicationProcessor, AP). Since the tapping operation may correspond to more than one coordinate of the tapping position on the touch screen, the touch sensor will collect multiple coordinates. In this embodiment, the multiple collected reported points are called reported point data.

Correspondingly, after obtaining the point reporting data, the coordinates of the tapping position corresponding to this tapping operation relative to the touch screen can be determined based on the existing standards for determining the specific coordinates of the tapping position based on the reporting point data collected by the touch sensor. For example, according to the tapping position collected by the touch sensor in the report point data, the first capacitance value within the first time threshold before tapping, the second capacitance value at the tapping moment, and the third capacitance value within the second time threshold after tapping are Three capacitance values determine the changing trend of the capacitance value; determine the coordinates of the tapping position in the coordinate system based on the changing trend of the capacitance value.

It is understandable that in some implementations, the changing trend of the capacitance value can also be set to be determined based on the capacitance values collected at multiple sampling points, such as a total of 126 sampling points at the tapping moment, before the tapping moment, and after the tapping moment. Capacitance value collected.

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment.

In addition, it should be noted that in order to ensure that the coordinates of two consecutive tapping positions are for the same coordinate system, subsequent calculations are feasible. Therefore, this embodiment chooses to use the coordinate system constructed with the touch screen as the reference standard as an example to determine the coordinates of the tapping position, that is, the coordinates of the tapping position relative to the touch screen determined based on the reported point data. In essence, it is to determine the coordinates of the tapping position in the constructed coordinates in the system.

For example, regarding the coordinate system constructed with the touch screen as the reference standard, it can be agreed that the coordinate origin is located at the lower left corner of the touch screen, the X-axis points horizontally to the right, the Y-axis points vertically to the top, the Z-axis points in front of the touch screen, and the coordinates behind the touch screen are Z-axis with negative values. That is, take the lower left corner of the touch screen as the coordinate origin, set the X-axis to point horizontally to the right, the Y-axis to point vertically to the top, and the Z-axis to point in front of the touch screen, so that a coordinate system relative to the touch screen can be obtained.

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment.

In addition, the gradient value corresponding to the tapping operation determined in this embodiment is specifically used to indicate the amount of data change between multiple frames of acceleration data (ACC data), or the oscillation characteristics. Therefore, the gradient value corresponding to the tapping operation is specifically determined based on the acceleration data collected by the acceleration sensor when the user taps the tapping position.

It is understandable that since the gradient value is used to indicate the data change between multiple frames of acceleration data (ACC data), or the oscillation characteristics, acceleration sensors can be calculated in some implementations, such as the X-axis, The maximum and minimum values of the signals on the Y-axis and Z-axis are used to calculate the signal oscillation amplitude vector based on the maximum and minimum values of the signals on the three axes, and then the gradient value corresponding to the tapping operation is obtained.

For example, in other implementations, the gradient value corresponding to the tapping operation can also be determined based on current touch technology and software algorithms. For specific implementation methods, please refer to relevant standards and will not be repeated here.

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment.

S102: Determine the relative distance between the screen segment where the tapping position is located and the screen segment where the acceleration sensor is located.

Based on the above description of touch screen division, it can be seen that no matter which division method is used, after the division method and the number of divisions required are determined, the screen blocks where the acceleration sensor in the terminal device is located is known, so in response to the user When tapping the touch screen, you can directly obtain the information of the screen block where the acceleration sensor is located.

For example, in some implementations, the information of the screen block where the acceleration sensor is located can be pre-recorded in the internal memory, so that the internal memory can be directly accessed and read when needed.

For example, in some implementations, the relative distance between the two screen segments may be determined based on the coordinates of the center points of the two screen segments. Taking the touch screen divided into multiple screen blocks into uniform rectangular blocks as an example, after determining the screen block where the tapping position is located, first determine the center point of the screen block based on the coordinates of the four vertices of the screen block. coordinate of. Similarly, after obtaining the screen block where the acceleration sensor is located, first determine the coordinates of the center point of the screen block based on the coordinates of the four vertices of the screen block. Then, based on the distance formula between the two points and the determined coordinates of the two center points, the relative distance between the two screen segments is determined.

For example, in other implementations, the relative distance between the screen segment where the tapping position is located and the screen segment where the acceleration sensor is located may also be determined based on the coordinates of the tapping position and the coordinates of the acceleration sensor.

In addition, it should be noted that no matter which two position coordinate information is used to determine the relative distance between the screen block where the tapping position is located and the screen block where the acceleration sensor is located, since the tapping operation will not have any The position changes, so when determining the relative distance between the two screen blocks based on the distance formula between two points, there is no need to consider the coordinate information of the Z axis, only the coordinate information of the X axis and the Y axis can be used .

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment.

S103. Determine the gradient threshold of the screen block where the tapping position is located based on the gradient threshold of the screen block where the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameters corresponding to the screen block where the tapping position is located. threshold.

For example, in some implementations, the gradient threshold of the screen block where the acceleration sensor is located (subsequently expressed as: Threshold_Grandient) can be preset based on factors such as the device model, the acceleration sensor model, the chip model used by the device, etc., for example, setting for 300. The distance coefficient corresponding to the relative distance and the constant parameters corresponding to the screen block where the tapping position is located can be found through algorithm running, or from the distance coefficient table and constant parameter table constructed from data obtained from different device tests.

For example, regarding the construction of a distance coefficient table that records distance coefficients corresponding to different distances, for example, after determining the relative distance between each screen segment and the screen segment where the acceleration sensor is located, centering on the acceleration sensor , based on the distance relationship function and outward mapping, set for each relative distance.

For example, regarding the construction of a constant parameter table that records the constant parameters corresponding to the screen segments where different tapping positions are located, for example, the camera, especially the protruding rear camera, can be considered for each screen segment. block settings.

For example, when considering the camera factor, the constant parameters corresponding to each screen segment can be set in the following ways:

First, determine the coordinates of the camera relative to the touch screen.

Then, according to the coordinates of the camera relative to the touch screen, the folding line of the touch screen is determined.

It should be noted that the above-mentioned folding line runs through some screen blocks of the touch screen, and the coordinates of the camera relative to the touch screen are located on the folding line.

Finally, according to the coordinates and fold line of the camera relative to the touch screen, the corresponding constant parameters are set for each screen block.

For example, in some implementations, different constant parameters can be set for each screen block that the polyline runs through. For example, different constant parameters can be set taking into account the distance from the camera.

For example, in other implementations, different constant parameters can be set for the screen segment where the camera is located and the screen segment including the four top corners of the touch screen.

For example, in other implementations, different constant parameters may be set for the screen segments above the fold line and the screen segments below the fold line.

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment.

S104: When the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block where the tapping position is located, a screenshot is triggered.

It is understandable that when the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block where the tapping position is located, the tablet device will generate a screenshot instruction in response to the operation, and then call the corresponding process according to the screenshot instruction. The process captures the screen currently displayed on the tablet device and saves the captured content as a picture to complete the screenshot operation.

In order to better understand the technical details of this embodiment, taking the touch screen of a tablet device divided into 16 uniform screen blocks as an example, detailed description will be given with reference to FIG. 9 and FIG. 10 .

Referring to Figure 9, for example, the touch screen 20a of the tablet 20 has a resolution of 2000*1200, and the touch screen 20a is divided into 16 (4*4) screen blocks. The lower left corner of these 16 screen blocks is the origin as mentioned above. , the X-axis points to the right, the Y-axis points vertically upward, and the Z-axis points to the position in the coordinate system above the screen (not shown in the figure), as shown in Figure 9. The sequence numbers are respectively represented as screen block 0 ~ screen block 15.

In order to realize that different screen blocks correspond to different gradient thresholds, the distance coefficient table can be constructed according to the method given above to set the distance coefficient corresponding to the relative distance between any screen block and the screen block where the acceleration sensor is located. At the same time, considering the factor of camera, different constant parameters are set for each screen block, that is, a constant parameter table is constructed.

For ease of explanation, take the camera (the rear camera protruding on the back of the tablet 20) 20a-1 as shown in Figure 9 and the acceleration sensor 20a-2 as shown in Figure 9 (located in the screen segment 8) as an example. , giving a distance coefficient table and constant parameter table.

Table 1 Distance coefficient table

relative distance The distance coefficient corresponding to the relative distance relative distance The distance coefficient corresponding to the relative distance D _8-0 Coeff _8-0 D _8-1 Coeff _8-1 D _8-2 Coeff _8-2 D _8-3 Coeff _8-3 D _8-4 Coeff _8-4 D _8-5 Coeff _8-5 D _8-6 Coeff _8-6 D _8-7 Coeff _8-7 D _8-8 Coeff _8-8 D _8-9 Coeff _8-9 D _8-10 Coeff _8-10 D _8-11 Coeff _8-11 D _8-12 Coeff _8-12 D _8-13 Coeff _8-13 D _8-14 Coeff _8-14 D _8-15 Coeff _8-15

Table 2 Constant parameter table

For example, according to business requirements, the distance coefficients corresponding to any two relative distances in Table 1 may be the same or different.

Correspondingly, the constant parameters corresponding to any two screen blocks in Table 2 may be the same or different.

For example, in practical applications, the distance coefficients recorded in Table 1 and the constant parameters recorded in Table 2 can also be recorded in the form of a queue. For example, Coeff_list is used to represent the queue for recording distance coefficients, and K_list is used to represent the queue for recording constant parameters. . Then, the content in Table 1 is converted into Coeff_list and can be expressed as Coeff_list{Coeff _8-0 , Coeff _8-1 , Coeff _8-2 , Coeff _8-3 , Coeff _8-4 , Coeff _8-5 , Coeff _8-6 , Coeff _8-7 , Coeff _8-8 , Coeff _8-9 , Coeff _8-10 , Coeff _8-11 , Coeff _{8-12, Coeff 8-13} , Coeff _{8-14 ,} Coeff _8-15 }; in Table 2 The content converted into K_list can be expressed as K_list{K ₀ , K ₁ , K ₂ , K ₃ , K ₄ , K 5 , K ₆ , K ₇ , K ₈ , K ₉ , K _{`10 ,} K ₁₁ , K ₁₂ , K ₁₃ , K ₁₄ , K ₁₅ }.

For example, when the coordinate system constructed based on the touch screen 20a is as shown in Figure 9, when the user taps the touch screen 20a to trigger the screenshot operation, the probability that the tapping position is located on the left side of the fold line I is relatively high, so the fold line I can be The screen blocks on the left, such as screen block 0, screen block 1, screen block 2, screen block 4, screen block 5 and screen block 8 correspond to constant parameters greater than the screen blocks on the right side of the diagonal line I , such as screen block 7, screen block 10, screen block 11, screen block 13, screen block 14 and screen block 15.

In addition, different constant parameters can also be set for screen block 3, screen block 6, screen block 9 and screen block 12 that the fold line I penetrates.

Regarding the values of constant parameters set for different screen blocks, for example, it can be K_list{475, 300, 260, 115, 300, 260, 200, 115, 350, 130, 165, 230, 150, 125, 245, 340 }.

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment.

After completing the settings of the above distance coefficient and constant parameters, if the user taps the position 20a-3 in Figure 10 twice continuously within 1 second, the tablet 20 responds to the tapping operation and collects data from the touch sensor in the touch screen 20a The reported point data determines the coordinates of the tapping position 20a-3 in the coordinate system shown in Figure 10, and then determines the tapping position 20a-3 based on the coordinates of the tapping position 20a-3 and the coordinate information included in each screen segment. 3 is located in screen block 2. According to the above table 2, it can be determined that the constant parameter corresponding to screen block 2 is K ₂ .

Continuing to refer to Figure 10, for example, since the acceleration sensor is located in the screen block 8, the screen block can be determined according to the above-mentioned method of determining the relative distance between the two screen blocks according to the coordinates of the center point of the screen block. The relative distance between 2 and the screen block is D _8-2 . According to the above mark 1, it can be determined that the distance coefficient corresponding to the relative distance D _8-2 is Coeff _8-2 .

After determining that the relative distance is D _8-2 , the distance coefficient corresponding to the relative distance D _8-2 is Coeff _8-2 , and the constant parameter corresponding to the screen block 2 where the tapping position 20a-3 is located is K ₂ , according to the determined These three parameters and the gradient threshold (Threshold_Grandient) set for the screen block where the acceleration sensor is located can determine the gradient threshold corresponding to screen block 2 where the tapping position 20a-3 is located (subsequently expressed as: Current_Grandient).

Regarding the way to determine Current_Grandient based on the above parameters, it can be expressed by the following formula:

Current_Grandient=Threshold_Grandient*distance*Coeff+K

Among them, Current_Grandient is the gradient threshold of the screen block where the tapping position corresponding to each tapping operation is, such as the gradient threshold of screen block 2 in the above example; Threshold_Grandient is the gradient set for the screen block where the acceleration sensor is located. Threshold value; distance is the relative distance between the screen block where the determined tapping position is located and the screen block where the acceleration sensor is located, such as the relative distance D _8-2 in the above example; Coeff is the distance coefficient corresponding to the determined relative distance, For example, in the above example, the distance coefficient corresponding to the relative distance D _8-2 is Coeff _8-2 ; K is the constant parameter corresponding to the screen block where the tapping position is located, such as the screen block where the tapping position 20a-3 is located in the above example. The constant parameter corresponding to 2 is K ₂ .

Next, after calculating the gradient threshold value Current_Grandien corresponding to the screen segment where the tapping position is located, for example, the screen segment 2 where the tapping position 20a-3 is located according to the above formula, the Current_Grandien is calculated with the gradient value corresponding to this tapping operation. Compare, if the gradient value corresponding to this tapping operation is greater than Current_Grandien, it is determined that the currently recognized tapping operation triggers the screenshot function. In this case, a screenshot instruction will be generated, and the corresponding process will be called according to the screenshot instruction to take a screenshot. .

Correspondingly, if the gradient value corresponding to this tapping operation is not greater than Current_Grandien, it is determined that the currently recognized tapping operation does not trigger the screenshot function, and may be an accidental touch by the user. In this case, no screenshot instruction will be generated, that is, Screen capture function is not triggered.

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment. In practical applications, it can also be stipulated that the gradient value corresponding to this tapping operation is not less than Current_Grandien, that is, if it is greater than or equal to Current_Grandien, it is considered that the currently recognized tapping operation triggers the screenshot function.

Therefore, the screenshot method provided by this embodiment divides the touch screen into multiple screen blocks with relatively small areas, and determines the constant parameters corresponding to the screen block where the tapping position is located, and the screen block where the acceleration sensor is located. The gradient threshold value, as well as the relative distance between the two screen blocks and the distance coefficient corresponding to the relative distance are used to determine the gradient threshold value corresponding to the screen block where the knocking position is located, so that different knocking positions can correspond Different gradient thresholds can more accurately identify whether this tap triggers a screenshot operation, which greatly improves the recognition rate of the screenshot operation.

For example, referring to Figure 11, in other embodiments, the specific implementation steps of the screenshot solution provided by this application include:

S201: When receiving N tapping operations of the user on any same area of the touch screen within the set time threshold, collect the point report data when the user taps the tapping position through the touch sensor in the touch screen, and collect the user's point report data through the acceleration sensor. Acceleration data when striking the strike location.

For the specific implementation details of step S201, please refer to the text description part of the embodiment shown in Figure 8, and will not be described again here.

S202: Predict the confidence value of a screenshot triggered by a tapping operation based on the point report data and acceleration data.

For example, in some implementations, point reporting data and acceleration data can be used as input parameters, input into a pre-trained neural network model, and the neural network model performs recognition processing, and then predicts the confidence of the screenshot triggered by this tapping operation. degree value.

Correspondingly, if the confidence value is greater than the set confidence threshold, such as 80, step S203 is executed; otherwise, it is considered that this tapping operation does not trigger the screenshot function, that is, there is no need to perform subsequent steps S203 to S209. Directly exit the processing flow of the screenshot method provided in this embodiment.

It is understandable that the above-mentioned neural network model can be obtained by training based on data that triggers the knuckle screenshot function of various large-screen devices currently on the market (tablets, smart screens, touch PCs, etc.) . For specific methods of training neural network models, please refer to existing standards and will not be described again here.

In addition, in order to further reduce the misjudgment rate and thereby improve the recognition rate, in some implementations, it is possible to determine whether the reported point data and acceleration data are valid before making confidence predictions.

For example, in other implementations, the operation of determining whether the reported point data and acceleration data are valid can also be performed after confidence prediction is performed, specifically before the predicted confidence value is greater than the set confidence threshold.

Regarding the way to determine whether the report point data and acceleration data are valid, for example, after detecting the user's first tap on a certain area of the touch screen, it can be determined whether the acceleration sensor senses a change in the acceleration vector that exceeds the preset value. event, and whether the touch sensor senses a valid touch event in the same period.

Correspondingly, if the acceleration sensor senses an acceleration vector change event that exceeds the preset value, and the touch sensor senses a valid touch event in the same period, the timer is started. If the user's second tap on the same area of the touch screen is detected within a certain period of time, such as 1 second, continue to determine whether the acceleration sensor senses an acceleration vector change event exceeding the preset value, and touch the sensor at the same time. Whether a valid touch event is sensed.

Correspondingly, if the acceleration sensor senses an acceleration vector change event that exceeds the preset value, and the touch sensor senses a valid touch event at the same time, then the two tap operations before and after are judged, and the position of the touch event sensed by the touch sensor on the touch screen is determined. Whether the effective distance is less than the preset value.

Correspondingly, if it is less than, it is determined that the reported point data and acceleration data are valid.

On the contrary, if any of the above judgments are abnormal, the tap can be considered as an accidental touch and there is no need to trigger the screenshot function.

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment.

S203: When the confidence value is greater than the set confidence threshold, construct a coordinate system relative to the touch screen.

S204: Determine the coordinates of the tapping position in the coordinate system based on the reported point data.

S205: Determine the screen block where the tapping position is located based on the coordinates of the tapping position relative to the touch screen.

S206: Determine the gradient value corresponding to the tapping operation based on the acceleration data.

S207: Determine the relative distance between the screen segment where the tapping position is located and the screen segment where the acceleration sensor is located.

S208: Determine the gradient threshold of the screen block where the tapping position is located based on the gradient threshold of the screen block where the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameters corresponding to the screen block where the tapping position is located. threshold.

S209: When the gradient value corresponding to the tapping operation is greater than the gradient threshold of the screen block where the tapping position is located, a screenshot is triggered.

For the specific implementation details of steps S203 to S209, please refer to the text description part of the embodiment shown in Figure 8, and will not be described again here.

Therefore, the screenshot method provided by this embodiment only executes the process of the screenshot method provided by this application when the confidence value is greater than the set confidence threshold, thereby further improving the recognition rate of the screenshot operation.

For example, referring to Figure 12, in other embodiments, the specific implementation steps of the screenshot solution provided by this application include:

S301: When receiving N tap operations on any same area of the touch screen by the user within the set time threshold, determine the screen segment where the tap position is located and the corresponding acceleration sensor of each acceleration sensor when the tap operation acts on the tap position. gradient value.

S302: Determine the relative distance between the screen segment where the tapping position is located and the screen segment where each acceleration sensor is located.

It is not difficult to find that the difference between this embodiment and the embodiment shown in Figure 8 is that in this embodiment, the number of acceleration sensors in the terminal device is greater than 1, so it is necessary to obtain the screen block where each acceleration sensor is located, as well as the tapping position. The relative distance between the screen segment and the screen segment where each acceleration sensor is located. For specific implementation details about obtaining the screen segment where each acceleration sensor is located, and the relative distance between the screen segment where the tapping position is located and the screen segment where each acceleration sensor is located, please refer to the text of the embodiment shown in Figure 8 part, which will not be repeated here.

S303: Select the shortest relative distance from the determined multiple relative distances.

For a better understanding, taking two acceleration sensors installed in a tablet device as an example, detailed description will be given in conjunction with Figure 13.

Referring to Fig. 13, for example, the tablet 20 may be a foldable device with the central axis 20a-5 as the axis, and the touch screen 20a thereof is divided into 16 uniform rectangular screen blocks. A rear camera is provided at the position 20a-1 shown in Figure 13, an acceleration sensor is provided at the position 20a-2, and another acceleration sensor is provided at the position of the central axis 20a-4. The constant parameters corresponding to each screen segment can be as shown in Table 2 in the above embodiment. The distance coefficient corresponds to the relative distance between the screen segment 8 where the acceleration sensor is located at the position 20a-2 and any screen segment. It can be as shown in Table 1 in the above embodiment.

For example, based on the same method, the distance coefficient corresponding to the relative distance between the screen block 11 where the acceleration sensor is located at position 20a-4 and any screen block can be as shown in Table 3 below.

Table 3 Distance coefficient table

relative distance The distance coefficient corresponding to the relative distance relative distance The distance coefficient corresponding to the relative distance D _11-0 Coeff _11-0 D _11-1 Coeff _11-1 D _11-2 Coeff _11-2 D _11-3 Coeff _11-3 D _11-4 Coeff _11-4 D _11-5 Coeff _11-5 D _11-6 Coeff _11-6 D _11-7 Coeff _11-7 D _11-8 Coeff _11-8 D _11-9 Coeff _11-9 D _11-10 Coeff _11-10 D _11-11 Coeff _11-11 D _11-12 Coeff _11-12 D _11-13 Coeff _11-13 D _11-14 Coeff _11-14 D _11-15 Coeff _11-15

Continuing to refer to Figure 13, for example, when the user taps position 20a-3 in Figure 13, the screen segment where the tap position 20a-3 is located is determined to be screen segment 2 through the point report data collected by the touch sensor. , the acceleration data collected by the acceleration sensor at position 20a-2 determines that the acceleration sensor at position 20a-2 is located in screen block 2, and the acceleration data collected by the acceleration sensor at position 20a-4 determines that position 20a-4 is The acceleration sensor is located on screen segment 11. Next, according to the coordinates of the center point of screen block 2 and the coordinates of the center point of screen block 8, the relative distance between screen block 2 and screen block 8 is determined to be D1 (D _8-2 in Table 1). According to the screen The coordinates of the center point of block 2 and the coordinates of the center point of screen block 11 determine that the relative distance between screen block 2 and screen block 11 is D2 (D _11-2 in Table 3). Next, by comparing the sizes of D1 and D2, when D2 is smaller than D1, D2 is determined as the relative distance that is ultimately used to calculate the gradient threshold of screen block 2 where the tapping position 20a-3 is located, and the distance coefficient corresponding to D2 That is Coeff _11-2 in Table 3; conversely, if D1 is less than D2, determine D1 as the relative distance that is ultimately used to calculate the gradient threshold of screen block 2 where the tapping position 20a-3 is located, corresponding to D1 The distance coefficient is Coeff _8-2 in Table 1. In this way, it can be more accurately identified whether this tapping operation needs to trigger the knuckle screenshot function.

It should be understood that the above description is only an example for a better understanding of the technical solution of this embodiment, and is not the only limitation on this embodiment.

S304: Determine the keystroke based on the gradient threshold of the screen block where the acceleration sensor is located corresponding to the shortest relative distance, the shortest relative distance, the distance coefficient corresponding to the shortest relative distance, and the constant parameters corresponding to the screen block where the knocking position is located. The gradient threshold of the screen block where the click position is located.

S305: When the gradient value corresponding to the acceleration sensor corresponding to the shortest relative distance is greater than the gradient threshold of the screen block where the tapping position is located, a screenshot is triggered.

In this way, it is ensured that all judgments are based on the relevant parameters corresponding to the shortest relative distance, thus ensuring the accuracy of the results.

For specific implementation details of steps S304 and S305, please refer to the text description part of the embodiment shown in FIG. 8, and will not be described again here.

In addition, it should be understood that in practical applications, this embodiment can also be improved on the basis of the embodiment shown in FIG. 11 , and this application does not limit this.

Therefore, the screenshot method provided by this embodiment, when there are multiple acceleration sensors in the terminal device, gives priority to the shortest relative distance, as well as the distance coefficient corresponding to the shortest relative distance and the gradient threshold of the screen block where the acceleration sensor is located. Calculate the gradient threshold of the screen block where the tapping position is located, thereby ensuring that the calculated gradient threshold is more accurate, thereby further improving the recognition rate of the screenshot operation.

It should be understood that the above-mentioned embodiments are only to enumerate specific implementation methods for a better understanding of the screenshot solution provided by this application, and are not intended to be the only limitation on the technical solution of this application.

In addition, it can be understood that in order to implement the above functions, the terminal device includes corresponding hardware and/or software modules that perform each function. In conjunction with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions in conjunction with the embodiments for each specific application, but such implementations should not be considered to be beyond the scope of this application.

In addition, it should be noted that in actual application scenarios, the screenshot methods provided by the above embodiments implemented by a terminal device can also be executed by a chip system included in the terminal device, where the chip system can include processing device. The chip system can be coupled with a memory, so that when the chip system is running, it calls the computer program stored in the memory to implement the steps executed by the terminal device. The processor in the chip system may be an application processor or a non-application processor.

In addition, embodiments of the present application also provide a computer-readable storage medium. Computer instructions are stored in the computer storage medium. When the computer instructions are run on a terminal device, the terminal device causes the terminal device to execute the above-mentioned related method steps to implement the above-mentioned embodiments. How to take a screenshot.

In addition, embodiments of the present application also provide a computer program product. When the computer program product is run on a terminal device, the terminal device performs the above related steps to implement the screenshot method in the above embodiment.

In addition, embodiments of the present application also provide a chip (which may also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein the transceiver pins and the The processing circuits communicate with each other through internal connection paths. The processing circuits execute the above-mentioned relevant method steps to implement the screenshot method in the above-mentioned embodiments to control the receiving pin to receive signals and to control the sending pin to send signals.

In addition, it can be seen from the above description that the terminal equipment, computer-readable storage media, computer program products or chips provided by the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be Refer to the beneficial effects of the corresponding methods provided above, which will not be described again here.

As mentioned above, the above embodiments are only used to illustrate the technical solution of the present application, but not to limit it. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still make the foregoing technical solutions. The technical solutions described in each embodiment may be modified, or some of the technical features may be equivalently replaced; however, these modifications or substitutions do not cause the essence of the corresponding technical solutions to depart from the scope of the technical solutions in each embodiment of the present application.

Claims (16)

1. A screen capturing method applied to a terminal device, a touch screen of the terminal device being divided into a plurality of screen segments, the method comprising:

responding to the knocking operation of a user on the touch screen, determining a screen block where a knocking position is located and a gradient value corresponding to the knocking operation, wherein the gradient value is used for indicating the data change amount among multiple frames of acceleration data;

Determining the relative distance between the screen block where the knocking position is located and the screen block where the acceleration sensor is located;

determining a gradient threshold value of the screen block where the knocking position is located according to the gradient threshold value of the screen block where the acceleration sensor is located, the relative distance, a distance coefficient corresponding to the relative distance and a constant parameter corresponding to the screen block where the knocking position is located;

triggering screen capturing when the gradient value corresponding to the knocking operation is larger than the gradient threshold value of the screen block where the knocking position is located;

wherein, before determining the relative distance between the screen segment where the knocking position is located and the screen segment where the acceleration sensor is located, the method further includes:

determining the relative distance between each screen block and the screen block where the acceleration sensor is located;

and setting a corresponding distance coefficient for each relative distance based on the outward mapping of the distance relation function by taking the acceleration sensor as a center.

2. The method of claim 1, wherein determining the screen tile in which the tap location is located comprises:

Determining coordinates of the knocking position relative to the touch screen;

and determining the screen block where the knocking position is located according to the coordinate of the knocking position relative to the touch screen.

3. The method of claim 2, wherein the determining coordinates of the tap location relative to the touch screen comprises:

collecting point report data when a user knocks the knocking position through a touch sensor in the touch screen;

constructing a coordinate system relative to the touch screen;

and determining the coordinates of the knocking position in the coordinate system according to the point data.

4. A method according to claim 3, wherein said determining coordinates of said tap location in said coordinate system based on said point data comprises:

determining a change trend of the capacitance value according to a first capacitance value of the knocking position, which is acquired by the touch sensor in the point data, in a first time threshold before knocking, a second capacitance value at the knocking moment and a third capacitance value in a second time threshold after knocking;

and determining the coordinates of the knocking position in the coordinate system according to the change trend of the capacitance value.

5. A method according to claim 3, wherein after obtaining the report data, the method further comprises:

collecting acceleration data when a user knocks the knocking position through the acceleration sensor;

predicting a confidence value of the screen capturing triggered by the knocking operation according to the point data and the acceleration data;

and when the confidence value is larger than a set confidence threshold value, constructing a coordinate system relative to the touch screen.

6. A method according to claim 3, wherein said constructing a coordinate system relative to said touch screen comprises:

taking the lower left corner of the touch screen as an origin of coordinates;

setting an X axis to horizontally point to the right, setting a Y axis to vertically point to the top, and setting a Z axis to point to the front of the touch screen to obtain a coordinate system relative to the touch screen.

7. The method of claim 1, wherein the determining a gradient value for the tapping operation comprises:

collecting acceleration data when a user knocks the knocking position through the acceleration sensor;

and determining a gradient value corresponding to the knocking operation according to the acceleration data.

8. The method of claim 1, wherein the gradient threshold value of the screen segment in which the tap position is located is determined based on the following formula according to the gradient threshold value of the screen segment in which the acceleration sensor is located, the relative distance, a distance coefficient corresponding to the relative distance, and constant parameters corresponding to the screen segment in which the tap position is located:

Current_Grandient＝Threshold_Grandient*distance*Coeff+K

The current_gradient is a gradient Threshold value of the screen block where the knocking position is located, and the threshold_gradient is a gradient Threshold value of the screen block where the acceleration sensor is located; distance is the relative distance between the screen block where the knocking position is located and the screen block where the acceleration sensor is located, coeff is the distance coefficient corresponding to the relative distance, and K is the constant parameter corresponding to the screen block where the knocking position is located.

9. The method of claim 1, wherein the number of acceleration sensors is greater than 1;

the determining the gradient value corresponding to the knocking operation comprises the following steps:

acquiring acceleration data of each acceleration sensor when a user knocks the knocking position;

and acquiring acceleration data of a user when the user knocks the knocking position according to each acceleration sensor, and determining a gradient value corresponding to each acceleration sensor when the knocking operation acts on the knocking position.

10. The method of claim 9, wherein determining the relative distance between the screen segment where the tap location is located and the screen segment where the acceleration sensor is located comprises:

And determining the relative distance between the screen block where the knocking position is located and the screen block where each acceleration sensor is located.

11. The method of claim 10, wherein determining the gradient threshold value of the screen segment in which the tapping position is located according to the gradient threshold value of the screen segment in which the acceleration sensor is located, the relative distance, the distance coefficient corresponding to the relative distance, and the constant parameter corresponding to the screen segment in which the tapping position is located comprises:

selecting the shortest relative distance from the determined plurality of relative distances;

and determining the gradient threshold value of the screen block where the knocking position is located according to the gradient threshold value of the screen block where the acceleration sensor corresponding to the shortest relative distance is located, the shortest relative distance, the distance coefficient corresponding to the shortest relative distance and the constant parameter corresponding to the screen block where the knocking position is located.

12. The method of claim 11, wherein triggering a screen capture when a gradient value corresponding to the tap operation is greater than a gradient threshold value for a screen segment in which the tap location is located comprises:

And triggering screen capturing when the gradient value corresponding to the acceleration sensor corresponding to the shortest relative distance is larger than the gradient threshold value of the screen block where the knocking position is located.

13. The method according to any one of claims 1 to 12, wherein prior to said determining the relative distance between the screen segment where the tap position is located and the screen segment where the acceleration sensor is located, the method further comprises:

determining the coordinates of the camera relative to the touch screen;

determining a doubling line of the touch screen according to the coordinates of the camera relative to the touch screen, wherein the coordinates of the camera relative to the touch screen are positioned on the doubling line, and the doubling line penetrates through partial screen blocks of the touch screen;

and setting corresponding constant parameters for each screen block according to the coordinates of the camera relative to the touch screen and the doubling line.

14. The method according to any one of claims 1 to 12, wherein the determining, in response to a user's tapping operation on the touch screen, a screen block where a tapping position is located and a gradient value corresponding to the tapping operation includes:

and when N times of knocking operation of a user on any same area of the touch screen are received in the set time threshold, determining a screen block where the knocking position is located and a gradient value corresponding to the knocking operation, wherein N is an integer larger than 1.

15. A terminal device, characterized in that the terminal device comprises: a memory and a processor, the memory and the processor coupled; the memory stores program instructions that, when executed by the processor, cause the terminal device to perform the screen capture method of any of claims 1 to 14.

16. A computer readable storage medium comprising a computer program which, when run on a terminal device, causes the terminal device to perform the screen capture method of any of claims 1 to 14.