CN112613475B - Code scanning interface display method and device, mobile terminal and storage medium - Google Patents

Abstract

Embodiments of the present application provide a code scanning interface display method, device, mobile terminal and storage medium, and relate to the technical field of mobile payment. The method includes: obtaining the mobile posture information of the mobile terminal; performing recognition processing on the mobile posture information to obtain a recognition result; the recognition result is used to indicate whether the mobile terminal is in a code scanning pre-state, and the code scanning pre-state refers to displaying The front state when scanning the code interface; in response to the recognition result, it is used to indicate that the mobile terminal is in the front state of scanning the code, and the target image is obtained. The target image is used to indicate payment based on the graphic code provided by the service provider; the display provided by the service provider The scanning interface corresponding to the graphic code. The embodiment of the present application automatically displays the code scanning interface corresponding to the graphic code based on the position and posture of the mobile terminal, eliminating the need for cumbersome interface touch operations, simplifying the operations required to open the code scanning interface, and improving the interface opening process. efficiency.

Description

Code scanning interface display method, device, mobile terminal and storage medium

Technical field

The embodiments of the present application relate to the technical field of mobile payment, and in particular to a code scanning interface display method, device, mobile terminal and storage medium.

Background technique

With the development of terminal technology, users can use their mobile phones to pay the amount corresponding to the item.

In related technologies, users can purchase goods by scanning QR codes to pay. The user first needs to find the icon of the application corresponding to the QR code so that the application displays the homepage; then the user needs to find the entrance to scan the above QR code on the homepage; scan the QR code through the entrance to complete the scan code payment process.

Contents of the invention

Embodiments of the present application provide a code scanning interface display method, device, mobile terminal and storage medium. The technical solutions are as follows:

On the one hand, embodiments of the present application provide a method for displaying a code scanning interface. The method includes:

Obtaining movement posture information of the mobile terminal, the movement posture information being used to indicate the position and posture of the mobile terminal in a moving state;

The mobile pose information is recognized and processed to obtain a recognition result. The recognition result is used to indicate whether the mobile terminal is in a code scanning pre-state. The code scanning pre-state refers to the pre-scanning interface when the code scanning interface is displayed. Set state;

In response to the recognition result indicating that the mobile terminal is in the code scanning pre-state, a target image is obtained, and the target image is used to indicate payment based on the graphic code provided by the service provider;

Display the code scanning interface corresponding to the graphic code provided by the service provider.

On the other hand, embodiments of the present application provide a code scanning interface display device, which includes:

An information acquisition module, configured to acquire movement posture information of the mobile terminal, where the movement posture information is used to indicate the position and posture of the mobile terminal in a moving state;

An information recognition module, used to perform recognition processing on the mobile posture information to obtain a recognition result. The recognition result is used to indicate whether the mobile terminal is in a code scanning pre-state. The code scanning pre-state refers to displaying The preset state when scanning the QR code interface;

An image acquisition module, configured to acquire a target image in response to the recognition result indicating that the mobile terminal is in the code scanning pre-state, where the target image is used to indicate payment based on the graphic code provided by the service provider;

The interface display module is used to display the code scanning interface corresponding to the graphic code provided by the service provider.

On the other hand, embodiments of the present application provide a mobile terminal. The mobile terminal includes a processor and a memory. The memory stores a computer program. The computer program is loaded and executed by the processor to implement the above aspects. The method of displaying the QR code scanning interface described above.

On the other hand, embodiments of the present application provide a computer-readable storage medium. A computer program is stored in the computer-readable storage medium. The computer program is loaded and executed by a processor to implement the code scanning as described above. Interface display method.

In another aspect, embodiments of the present application provide a computer program product, the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the mobile terminal reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the mobile terminal executes the above code scanning interface display method.

The technical solutions provided by the embodiments of this application can bring the following beneficial effects:

Based on the mobile posture information of the mobile terminal, it is determined whether the mobile terminal is in the code scanning pre-state; when it is determined that the mobile terminal is in the code scanning pre-state, an image used to indicate the graphic code provided by the service provider is obtained, and the graphics are displayed The code scanning interface corresponding to the code. The embodiment of the present application automatically displays the code scanning interface corresponding to the graphic code based on the position and posture of the mobile terminal, eliminating the need for cumbersome interface touch operations, simplifying the operations required to open the code scanning interface, and improving the interface opening process. efficiency.

Description of the drawings

Figure 1 is a flow chart of a code scanning interface display method provided by an embodiment of the present application;

Figure 2 is a flow chart of a code scanning interface display method provided by another embodiment of the present application;

Figure 3 is a schematic diagram of recognition model training provided by an embodiment of the present application;

Figure 4 is a schematic diagram of the payment process provided by an embodiment of the present application;

Figure 5 is a flow chart of a code scanning interface display method provided by another embodiment of the present application;

Figure 6 is a schematic diagram of the code scanning interface display process provided by an embodiment of the present application;

Figure 7 is a block diagram of a code scanning interface display device provided by an embodiment of the present application;

Figure 8 is a structural block diagram of a mobile terminal provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

In the method provided by the embodiments of this application, the execution subject of each step may be a mobile terminal. In a possible implementation, the mobile terminal is an electronic device such as a mobile phone, a tablet computer, a smart wearable device, a laptop computer, etc.

Illustratively, the mobile terminal in the embodiment of the present application includes a display screen. Optionally, the above-mentioned display screen may be a TFT (Thin Film Transistor, thin film field effect transistor) liquid crystal display screen. A TFT liquid crystal display screen means that each liquid crystal pixel point on the liquid crystal display is composed of a thin film transistor integrated behind it. driver, so that screen information can be displayed at high speed, high brightness, and high contrast. Optionally, the above-mentioned display screen may be an STN (Super Twisted Nematic) screen. The STN screen has the advantages of low power consumption and power saving. Optionally, the above-mentioned display screen can also be an OLED (Organic Light-Emitting Display, organic light-emitting display) display screen. OLED display screen has the characteristics of thinner and lighter, active light emitting, no viewing angle problems, high definition, high brightness, and response speed. It has the characteristics of fast speed, low energy consumption, wide operating temperature range, strong earthquake resistance, low cost and soft display. The display screen of the above-mentioned terminal may only have a display function. Of course, in other possible implementations, the display screen of the terminal may also have both display and touch functions, which is not limited in the embodiments of the present application.

Illustratively, the mobile terminal in the embodiment of the present application also includes an image collection device, and the image collection device may be a camera or other device, which is not limited in the embodiment of the present application. Taking the mobile terminal as a mobile phone as an example for introduction and explanation, the image acquisition device can be set on the front panel of the mobile terminal, or can be set on the back panel of the mobile terminal, or can be set on both the front panel and the back panel of the mobile terminal. The embodiments of the present application do not limit this.

Below, the present application is introduced and explained through several embodiments.

Please refer to Figure 1, which shows a flow chart of a code scanning interface display method provided by an embodiment of the present application. This method can be applied to mobile terminals, and the method can include the following steps.

Step 101: Obtain the mobile posture information of the mobile terminal.

In this embodiment of the present application, the movement posture information is used to indicate the position and posture of the mobile terminal in a moving state.

In a possible implementation, the movement posture information of the mobile terminal is obtained through a sensor. For example, when the mobile terminal is in a working state, sensor data is continuously collected through the sensor, and the sensor data is used as the mobile posture information of the mobile terminal.

In possible implementations, sensor data can be collected by a single sensor or by multiple sensors of different types.

In one example, the mobile terminal can collect data in two dimensions of acceleration and displacement through a gyroscope sensor to obtain acceleration data and displacement data. The acceleration data includes three axes (x-axis, y-axis, z-axis). Acceleration and displacement data include displacement in three directions (x-axis, y-axis, z-axis). The mobile terminal determines the acceleration data and displacement data as the mobile posture information of the mobile terminal.

In another example, the mobile terminal can collect acceleration data and displacement data through an acceleration sensor (Accelerometer Sensor, ASensor) and a gravity sensor (Gravity Sensor, GSensor). The acceleration data includes three axes (x-axis, y-axis, z-axis). acceleration in three directions, and the displacement data includes displacement in three directions (x-axis, y-axis, z-axis). The mobile terminal determines the acceleration data and displacement data as the mobile posture information of the mobile terminal.

In a possible implementation, the mobile terminal collects sensor data for a preset number of times through the sensor, and determines the sensor data for the preset number of times as the mobile posture information of the mobile terminal. For example, the preset number of times may be 30-200 times. , if the preset times are too few, the mobile terminal collection time is too short, which may result in less accurate recognition results; if the preset times are too long, the mobile terminal collection time is too long, which may require the user to take a long time Only handheld mobile terminals can carry out resource transfer, making resource transfer efficiency low. For example, the mobile terminal can collect 128 times of sensor data (displacement and acceleration in the three directions of x, y, and z), and splice the collected 128 times of sensor data into 128*6-dimensional data (mobile posture of the mobile terminal). information).

Step 102: Perform recognition processing on the mobile pose information to obtain a recognition result. The recognition result is used to indicate whether the mobile terminal is in a code scanning pre-state.

The QR code scanning front state refers to the front state when the QR code scanning interface is displayed. In a possible implementation, when the user performs a code scanning payment action, the mobile terminal obtains mobile posture information, and determines based on the mobile posture information that the mobile terminal is in the code scanning pre-state. For example, the code scanning pre-state is also It can be called the pending payment state. Of course, in other possible implementations, the code scanning pre-state can also be called other states, which is not limited in the embodiments of this application.

Step 103: In response to the recognition result indicating that the mobile terminal is in the code scanning pre-state, obtain a target image. The target image is used to indicate payment based on the graphic code provided by the service provider.

The service provider refers to the object that provides services. For example, the service provider can provide at least one of the following services: food, hotels, entertainment, movies, rides, leisure, etc.

The graphic code provided by the service provider can be any graphic code. For example, the graphic code provided by the service provider can be a barcode, a QR code, or other forms of graphic codes. The embodiment of the present application does not limit the display form of the graphic code. .

In a possible implementation, when the recognition result is used to indicate that the mobile terminal is in a pre-code scanning state, the target image is acquired through an image acquisition device. For example, the mobile terminal obtains the target image in the background, and the user will not perceive this operation. In a possible implementation, the image acquisition device may be an AON (Always on) camera, which consumes less power.

In a possible implementation, the target image may include one or more images, and the number of images included in the target image may be determined by the acquisition frequency of the image acquisition device. The target image may be an image collected by the image acquisition device within one second, or an image collected by the image acquisition device within a preset time. The preset time may be a default time, or a time set by the user.

In a possible implementation, image acquisition devices are provided on both the front panel and the back panel of the mobile terminal, and the mobile terminal determines which image acquisition device should be used to collect the target image based on the current posture. The mobile terminal can determine whether to use the image acquisition device on the front panel to collect the target image or the image acquisition device on the back panel to collect the target image based on the current posture of the user holding the mobile terminal and the current posture of the mobile terminal. In a possible implementation, the mobile terminal can simultaneously use the image acquisition device on the front panel and the image acquisition device on the back panel to collect the target image.

Step 104: Display the code scanning interface corresponding to the graphic code provided by the service provider.

In this embodiment of the present application, the code scanning interface is used to scan the graphic code provided by the service provider.

Different graphic codes may correspond to different code scanning interfaces. The terminal needs to display the scanning interface corresponding to the graphic code to successfully scan and identify the graphic code.

In a possible implementation, in response to the recognition result indicating that the mobile terminal is not in the code scanning pre-state, execution starts from step 101 again.

It should be noted that payment can also be called resource transfer. Of course, in other possible implementation methods, payment can also be called by other names, which is not limited in the embodiments of this application.

To sum up, in the technical solution provided by the embodiments of the present application, it is determined whether the mobile terminal is in the code scanning pre-state based on the mobile posture information of the mobile terminal; when it is determined that the mobile terminal is in the code scanning pre-state, the user is obtained Display the code scanning interface corresponding to the graphic code on the image indicating the graphic code provided by the service provider. The embodiment of the present application automatically displays the code scanning interface corresponding to the graphic code based on the position and posture of the mobile terminal, eliminating the need for cumbersome interface touch operations, simplifying the operations required to open the code scanning interface, and improving the interface opening process. efficiency.

Please refer to FIG. 2 , which shows a flow chart of a code scanning interface display method provided by another embodiment of the present application. This method can be applied to mobile terminals, and the method can include the following steps.

Step 201: Obtain the mobile posture information of the mobile terminal.

In this embodiment of the present application, the movement posture information is used to indicate the position and posture of the mobile terminal in a moving state.

For an introduction to step 201, please refer to the above embodiment and will not be described again here.

Step 202: Perform recognition processing on the mobile pose information through the recognition model to obtain a recognition result. The recognition result is used to indicate whether the mobile terminal is in a code scanning pre-state. The code scanning pre-state refers to the pre-state when the code scanning interface is displayed. .

The identification model refers to the model used to identify whether the mobile terminal is in the pre-scanning state. For example, the recognition model may be a CNN (Convolutional Neural Network, convolutional neural network) model.

The recognition model can be set in SensorHub (intelligent sensor hub). SensorHub is a kind of software and hardware based on low-power MCU (Micro Control Unit) and lightweight RTOS (Real-Time Operating System, real-time operating system). Solutions for connecting and processing sensor data collected by various sensors. In a possible implementation, the terminal's SOC (System on Chip, system-on-chip) is integrated with an MCU. The operating system runs on the SOC, and the RTOS runs on the MCU. The MCU processes sensor data collected by the sensor (i.e., mobile The mobile posture information of the terminal) is used for action recognition.

Illustratively, the recognition model in the embodiment of the present application can be adapted to sequence data. The size of the recognition model in the embodiment of the present application is less than 20kb after quantization. The quantized recognition model is stored in SensorHub.

In a possible implementation, when the mobile terminal performs recognition processing on the mobile posture information through the recognition model, before obtaining the recognition result, the recognition model needs to be trained. The training process of the recognition model may include the following steps:

1. Obtain training data, which includes at least one training movement pose information and a standard recognition result corresponding to the training movement pose information;

2. Use the recognition model to identify and process the training mobile pose information to obtain the predicted recognition results;

3. Train the recognition model based on the predicted recognition results and standard recognition results, and obtain the recognition model that has completed the training.

In a possible implementation, the training movement pose information when the mobile terminal is in the code scanning pre-state is used as a positive sample, and the training movement posture information when the mobile terminal is not in the code scanning pre-state is used as a negative sample. The neural network model is trained, and finally a recognition model that meets the recognition accuracy requirements is obtained.

For example, as shown in Figure 3, it shows a schematic diagram of recognition model training provided by an embodiment of the present application. Assume that the 128*6-dimensional data collected by the sensor is spliced into 128*6-dimensional data as the training movement pose information; the training movement pose information is labeled (either manually or by an annotation model), Obtain the standard recognition result; perform recognition processing on the training mobile pose information through the neural network model (recognition model) to obtain the predicted recognition result; in response to the error between the predicted recognition result and the standard recognition result being less than the threshold, obtain the recognition model that has completed the training .

Step 203: In response to the recognition result indicating that the mobile terminal is in the pre-code scanning state, image collection is performed through the rear camera of the mobile terminal to obtain the collected image.

When the mobile terminal is in the pre-code scanning state, the mobile terminal collects images through a rear camera. For example, the rear camera can be an AON rear camera, which consumes less power.

In a possible implementation, in response to the recognition result being used to indicate that the mobile terminal is in the pre-code scanning state, image collection is performed through the front camera of the mobile terminal to obtain the collected image.

In a possible implementation, the mobile terminal determines whether to use the front camera or the rear camera for image collection based on the current posture.

In a possible implementation, an image collection device may also be provided on the middle frame of the mobile terminal, and the mobile terminal may collect images through the image collection device provided on the middle frame.

Step 204: In response to the graphic code being included in the captured image, obtain a target image including the graphic code from the captured image.

In this embodiment of the present application, the target image is used to indicate payment based on the graphic code provided by the service provider.

In a possible implementation, the mobile terminal performs image recognition on the collected image, determines whether the collected image includes a graphic code, and obtains the target image from the collected image in response to the graphic code being included in the collected image.

In a possible implementation, when the mobile terminal performs image collection and obtains the collected image, and recognizes the above collected image and finds that there is no graphic code provided by the service provider, the terminal can confirm whether the collected image includes a code scanning device. If If the collected image does not include the scanning device or the graphic code provided by the service provider, misrecognition may occur at this time, and the mobile terminal can start again from the step of obtaining the mobile terminal's movement posture information.

After identifying that the mobile terminal is in the code scanning pre-state, image recognition technology is used to detect graphic codes, which helps to reduce the probability of false calls on the code scanning interface and improve the actual display accuracy and display security of the code scanning interface.

Step 205: Based on the image characteristics of the target image, determine the payment program corresponding to the graphic code provided by the service provider. The payment program refers to an application program that provides payment functions.

In a possible implementation, the mobile terminal crops the graphic code area from the target image; and determines the image characteristics of the graphic code area. Different payment programs correspond to different graphic codes. Therefore, the image characteristics of the graphic code areas corresponding to different payment programs are different. The image characteristics of the target image are used to indicate the identification information of the payment program, and the mobile terminal determines the payment program for scanning the graphic code provided by the service provider based on the identification information of the payment program.

In a possible implementation, if the mobile terminal cannot determine the payment program corresponding to the graphic code provided by the service provider, the mobile terminal can determine the payment program corresponding to the graphic code as the default payment program. The default payment program can be the user's own The setting may also be determined by the mobile terminal based on the frequency of use, which is not limited in the embodiments of the present application. If a scanning error occurs after using the default payment program to scan the QR code, it will automatically switch to the corresponding scanning interface of another payment program.

In a possible implementation, a graphic code recognition model may be pre-stored in the mobile terminal. The input of the graphic code recognition model is a target image, and the output is a payment program corresponding to the graphic code in the target image. For example, for the trained code scanning device detection model, before the model is deployed, the model can also be processed by cutting the network, optimizing the network, and quantifying the model to further streamline the model, improve the model inference speed, and meet the real-time requirements of the mobile terminal. Testing requirements.

Step 206: Display the QR code scanning interface corresponding to the payment program.

The QR code scanning interface is the interface corresponding to the payment program determined in step 205 above.

Step 207: Display the payment interface, which includes an input box for the payment amount and a payment confirmation control.

In response to the code scanning interface successfully scanning and identifying the graphic code provided by the service provider, the mobile terminal will jump to display the payment interface.

The payment amount input box refers to the control used to enter the payment amount, and the payment confirmation control refers to the control used to confirm payment to the service provider.

Step 208: Obtain the amount entered in the payment amount input box.

In a possible implementation, the user can input the amount in the payment amount input box through voice, touch, gesture, etc.

Taking the user inputting the amount in the input box of the payment amount through voice as an example for introduction and explanation, the mobile terminal receives the voice instruction for the input box of the payment amount; the amount is determined from the voice instruction.

In a possible implementation, the terminal needs to perform voiceprint recognition on the voice command, and determine the voiceprint of the registered user (the registered user may refer to the registered user of the payment application) or the owner of the mobile terminal based on the voiceprint recognition. Based on the registration The amount of money is determined by the voiceprint of the user or the owner of the machine. The embodiment of the present application determines the amount of money based only on the voiceprint of the registered user or the owner of the machine, which helps to improve the security of payment. In a possible implementation, after the registered user or owner's information is determined through voiceprint recognition, the mobile terminal can provide the service provider with the amount of the payment amount without receiving an instruction to confirm the selection of the payment control, that is, It is not necessary to perform the following step 209.

As shown in Figure 4, the user turns over the mobile terminal 401, the mobile terminal 401 obtains the mobile pose information, and determines that it is in the QR code scanning pre-state based on the mobile pose information. The mobile terminal acquires a target image, and the target image is used to indicate based on the information provided by the service provider. The graphic code 402 is used for payment, and the mobile terminal displays the code scanning interface 403. When the mobile terminal 401 successfully scans and identifies the graphic code 402 provided by the service provider through the code scanning interface 403, the mobile terminal 401 displays the payment interface 404, and the mobile terminal 401 collects the The owner's voiceprint determines the amount, and the amount is paid to the service provider.

The embodiments of this application can automatically switch the payment program based on the graphic code provided by the service provider, provide a more convenient payment method, and bring higher convenience and security to people's lives. The embodiment of the present application triggers payment on the mobile terminal by detecting the gestures or postures of the user holding the mobile terminal. The motion detection triggers the rear camera to take pictures and identify the graphic code. The corresponding payment program is automatically opened based on the recognized graphic code. After unlocking, the payment program is triggered according to the pattern code. The owner's voiceprint identifies the amount, allowing the mobile terminal to automatically enter the specific amount to be paid, making payment more convenient when it is inconvenient for the user to enter the amount through touch.

Step 209: In response to receiving the selection instruction for the confirmation payment control, pay the service provider the amount of the amount.

In a possible implementation, the instruction to confirm the selection of the payment control can be triggered by voice, gesture, touch, etc.

In a possible implementation, when the mobile terminal successfully pays the amount of money to the service provider (that is, the mobile terminal successfully transfers the exchange resources from the first resource account to the second resource account, the first resource account is the user of the mobile terminal) After the corresponding resource account (the second resource account is the resource account corresponding to the service provider), the mobile terminal resumes displaying the original user interface. The original user interface refers to the user interface displayed by the mobile terminal before the mobile terminal is in the QR code scanning pre-state. For example, the original user interface may be a screen-closed interface, an unlocked desktop, a user interface of a previous application, etc. The embodiment of the present application does not limit the original user interface.

In a possible implementation, when the payment program enables password-free payment, the payment interface only includes an input box for the payment amount, obtains the amount entered in the input box for the payment amount, and obtains the amount entered by the mobile terminal to the service provider. amount.

Through voice input of the amount and voice confirmation of payment, the embodiment of the present application provides a convenient payment method that is touchless and contactless, improving the user experience.

It should be noted that the amount can also be called virtual resources, and the amount amount can also be called the virtual resource amount. Of course, in other possible implementation methods, the amount and amount amount can also be called other names. Embodiments of this application There is no limit to this.

In this embodiment of the present application, the user only needs to perform pre-code scanning actions and use the mobile terminal to capture the image of the graphic code, and the mobile terminal can automatically display the code scanning interface without the need for cumbersome interface touch operations. Moreover, with the code scanning pre-action as the prerequisite, the mobile terminal does not need to turn on the camera for a long time to collect images, which reduces the overall power consumption of the terminal when automatically displaying the code scanning interface.

The embodiment of the present application uses a sensor to detect whether the user's gesture action is to open the payment program to identify the graphic code. When the recognition result is to open the payment program to identify the graphic code, the payment program corresponding to the graphic code is automatically opened to scan the code, avoiding the user from opening the wrong one. The inconvenience caused by needing to switch applications improves the user experience. The embodiment of the present application uses the rear camera to capture an image of the environment opposite to the rear camera of the mobile terminal to confirm whether the resource transfer is based on the graphic code, thus avoiding the first misidentification based on the mobile pose information and ensuring The recognition accuracy and success rate of payment scenarios provide users with a convenient payment method that is touchless and contactless.

To sum up, in the technical solution provided by the embodiment of the present application, the payment operation process is simplified and the payment efficiency is improved by automatically displaying the QR code scanning interface.

The embodiment of the present application improves payment efficiency by determining that the mobile terminal is in the code scanning pre-state, and then using image recognition technology to determine the payment program corresponding to the graphic code provided by the service provider, and then displaying the code scanning interface corresponding to the payment program. Probability of success.

Please refer to FIG. 5 , which shows a flow chart of a code scanning interface display method provided by another embodiment of the present application. This method can be applied to mobile terminals, and the method can include the following steps.

Step 501: Obtain the movement posture information of the mobile terminal. The movement posture information is used to indicate the position and posture of the mobile terminal in a moving state.

Step 502: Perform recognition processing on the mobile pose information to obtain a recognition result. The recognition result is used to indicate whether the mobile terminal is in a code scanning pre-state. The code scanning pre-state refers to the pre-state when the code scanning interface is displayed.

Step 503: In response to the recognition result indicating that the mobile terminal is in the code scanning pre-state, obtain a target image. The target image is used to indicate payment based on the graphic code provided by the service provider.

For an introduction to steps 501 to 503, please refer to the above embodiments and will not be described again here.

Step 504: When the mobile terminal is in an unlocked state, jump from the original user interface to the QR code scanning interface.

The unlocked state means that the mobile terminal is in normal operation. The unlocked state and the locked screen state are two different states.

The original user interface refers to the user interface displayed by the mobile terminal before the mobile terminal is in the QR code scanning pre-state, that is, the user interface that the user is watching before the user performs the QR code scanning payment operation.

When the mobile terminal is in the code scanning pre-state and the target image is used to indicate payment based on the graphic code provided by the service provider, the mobile terminal confirms that payment needs to be made through the code scanning interface. If the mobile terminal is in an unlocked state, the mobile terminal can jump directly from the original user interface to the QR code scanning interface without performing an unlocking operation.

Step 505: When the mobile terminal is in the lock screen state, receive the identity verification information input by the user. The identity verification information is used to trigger the mobile terminal to perform identity verification; in response to the user input, the identity verification information is consistent with the preset identity verification information. , jump from the lock screen interface to the QR code scanning interface.

Identity verification can include any of the following methods: password verification, voice verification, face verification, iris verification, and fingerprint verification. For example, the identity verification information may include any of the following: password, voice, face, iris, fingerprint.

It should be noted that steps 504 and 505 will not be executed at the same time, and the mobile terminal will determine whether it is in an unlocked state; when the mobile terminal is in an unlocked state, step 504 will be executed; when the mobile terminal is in a lock screen state, step 505 will be executed. Begin execution.

The preset identity verification information is information pre-stored by the user in the mobile terminal and used to verify the user's identity. The default authentication information is of the same type as the authentication information entered by the user, that is, when the authentication information entered by the user is a password, the default authentication information is a password; when the authentication information entered by the user is a voice , the default authentication information is voice; when the authentication information input by the user is a face, the default authentication information is a face; when the authentication information input by the user is iris, the default authentication information is Iris; when the authentication information entered by the user is a fingerprint, the default authentication information is the fingerprint.

Taking identity verification as password verification as an example, the mobile terminal displays a password input interface. The mobile terminal receives the password entered by the user in the password input interface. When the password entered in response is consistent with the set password, it is determined that the identity verification is passed.

In a possible implementation, multiple preset identity verification information are pre-stored in the mobile terminal. When the identity verification information input by the user is consistent with one of the multiple preset identity verification information, the identity is confirmed. Verification passed.

The lock screen interface refers to the interface displayed when the mobile terminal is not unlocked, and is the interface displayed when the mobile terminal is in the locked screen state. When the mobile terminal determines that the identity verification information entered by the user is consistent with the preset identity verification information, it means that the mobile terminal is successfully unlocked and the mobile terminal jumps from the lock screen interface to the QR code scanning interface.

In a possible implementation, when the identity verification information input by the user is inconsistent with the preset identity verification information, the mobile terminal displays prompt information, and the prompt information is used to prompt the user to re-enter the identity verification information.

Step 506: Display the code scanning interface corresponding to the graphic code provided by the service provider.

The mobile terminal is in the locked screen state as an example for introduction and explanation, as shown in Figure 6, which shows a schematic diagram of a code scanning interface display process. The mobile terminal displays a lock screen interface 601, and the user moves the mobile terminal so that the mobile terminal is in a pre-code scanning state; the mobile terminal obtains a target image, and the target image is used to indicate that the resource transfer method provided by the service provider is resource transfer based on graphic codes; The mobile terminal receives the identity verification information input by the user, and in response to the identity verification information input by the user being consistent with the preset identity verification information, the mobile terminal jumps from the lock screen interface 601 to the QR code scanning interface 602. The mobile terminal simulates opening the payment program corresponding to the graphic code in the background, and enters the home page of the payment program, and then simulates receiving an instruction to open the code scanning interface from the home page of the payment program, so that the terminal screen displays the code scanning interface, making the operation simple.

The following are device embodiments of the present application, which can be used to execute method embodiments of the present application. For details not disclosed in the device embodiments of this application, please refer to the method embodiments of this application.

Please refer to Figure 7, which shows a block diagram of a code scanning interface display device provided by an embodiment of the present application. The device has the function of implementing the above method example. The function can be implemented by hardware, or the hardware can execute corresponding software. accomplish. The device 700 may include:

The information acquisition module 710 is used to obtain the movement posture information of the mobile terminal, where the movement posture information is used to indicate the position and posture of the mobile terminal in a moving state;

The information recognition module 720 is used to perform recognition processing on the mobile posture information to obtain a recognition result. The recognition result is used to indicate whether the mobile terminal is in a code scanning pre-state. The code scanning pre-state refers to The front state when displaying the QR code scanning interface;

Image acquisition module 730, configured to acquire a target image in response to the recognition result indicating that the mobile terminal is in the code scanning pre-state, where the target image is used to indicate payment based on the graphic code provided by the service provider. ;

The interface display module 740 is used to display the code scanning interface corresponding to the graphic code provided by the service provider.

To sum up, in the technical solution provided by the embodiments of the present application, it is determined whether the mobile terminal is in the code scanning pre-state based on the mobile posture information of the mobile terminal; when it is determined that the mobile terminal is in the code scanning pre-state, the user is obtained Display the code scanning interface corresponding to the graphic code on the image indicating the graphic code provided by the service provider. The embodiment of the present application automatically displays the code scanning interface corresponding to the graphic code based on the position and posture of the mobile terminal, eliminating the need for cumbersome interface touch operations, simplifying the operations required to open the code scanning interface, and improving the interface opening process. efficiency.

In an exemplary embodiment, the image acquisition module 730 is used for:

Perform image collection through the rear camera of the mobile terminal to obtain the collected image;

In response to the graphic code being included in the captured image, the target image including the graphic code is acquired from the captured image.

In an exemplary embodiment, the interface display module 740 is used for:

Based on the image characteristics of the target image, determine the payment program corresponding to the graphic code provided by the service provider, where the payment program refers to an application program that provides payment functions;

Display the QR code scanning interface corresponding to the payment program.

In an exemplary embodiment, the device further includes: a quantity acquisition module and an amount payment module (not shown in the figure).

The interface display module 740 is also used to display the payment interface, which includes an input box for the payment amount and a payment confirmation control;

A quantity acquisition module, used to obtain the amount entered in the input box of the payment amount;

An amount payment module, configured to pay the amount of the amount to the service provider in response to receiving a selection instruction on the confirmation payment control.

In an exemplary embodiment, the quantity acquisition module is used for:

Receive voice instructions for the input box of the payment amount;

The amount is determined from the voice command.

In an exemplary embodiment, the device further includes: an interface jump module (not shown in the figure).

The interface jump module is used for:

When the mobile terminal is in an unlocked state, jump from the original user interface to the code scanning interface;

When the mobile terminal is in a locked screen state, receive identity verification information input by the user, and the identity verification information is used to trigger the mobile terminal to perform identity verification; in response to the identity verification information input by the user and the preset The identity verification information is consistent and jumps from the lock screen interface to the QR code scanning interface.

In an exemplary embodiment, the information identification module 720 is used for:

The mobile pose information is recognized and processed through a recognition model to obtain the recognition result.

In an illustrative embodiment, the device further includes: a model training module (not shown in the figure);

The model training module is used for:

Obtain training data, the training data including at least one training movement pose information and a standard recognition result corresponding to the training movement pose information;

Perform recognition processing on the training movement pose information through the recognition model to obtain predicted recognition results;

The recognition model is trained based on the predicted recognition results and the standard recognition results to obtain the trained recognition model.

It should be noted that when the device provided in the above embodiment implements its functions, only the division of the above functional modules is used as an example. In actual application, the above functions can be allocated to different functional modules according to needs, that is, the equipment The internal structure is divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be described again here.

Please refer to FIG. 8 , which shows a structural block diagram of a mobile terminal provided by an embodiment of the present application.

The mobile terminal in the embodiment of the present application may include one or more of the following components: a processor 810 and a memory 820.

Processor 810 may include one or more processing cores. The processor 810 uses various interfaces and lines to connect various parts of the entire terminal, and executes the terminal by running or executing instructions, programs, code sets or instruction sets stored in the memory 820, and calling data stored in the memory 820. Various functions and processing data. Optionally, the processor 810 may adopt at least one of digital signal processing (Digital Signal Processing, DSP), field-programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). implemented in hardware form. The processor 810 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU) and a modem. Among them, the CPU mainly handles operating systems and applications, etc.; the modem is used to handle wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 810 and may be implemented by a separate chip.

Optionally, when the processor 810 executes the program instructions in the memory 820, the methods provided by the above method embodiments are implemented.

The memory 820 may include random access memory (RAM) or read-only memory (Read-Only Memory, ROM). Optionally, the memory 820 includes non-transitory computer-readable storage medium. Memory 820 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 820 may include a stored program area and a stored data area, where the stored program area may store instructions for implementing the operating system, instructions for at least one function, instructions for implementing each of the above method embodiments, etc.; the storage data area Data created based on the use of the mobile terminal, etc. can be stored.

The structure of the above mobile terminal is only illustrative. In actual implementation, the mobile terminal may include more or fewer components, such as a display screen, an image acquisition device, etc., which is not limited in this embodiment.

Those skilled in the art can understand that the structure shown in Figure 8 does not constitute a limitation on the mobile terminal, and may include more or fewer components than shown, or combine certain components, or adopt different component arrangements.

In an exemplary embodiment, a computer-readable storage medium is also provided. A computer program is stored in the computer-readable storage medium. The computer program is loaded and executed by a processor of the mobile terminal to implement the above code scanning interface. Various steps in method embodiments are shown.

In an exemplary embodiment, a computer program product is provided that includes computer instructions stored in a computer-readable storage medium. The processor of the mobile terminal reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the mobile terminal executes the above code scanning interface display method.

It should be understood that "plurality" mentioned in this article means two or more. "And/or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and/or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the related objects are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the numbering sequence, such as two different numbers. The steps are executed simultaneously, or two steps with different numbers are executed in the reverse order as shown in the figure, which is not limited in the embodiments of the present application.

The above are only exemplary embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection of the present application. within the range.

Claims (10)

1. The code scanning interface display method is characterized by comprising the following steps of:

acquiring movement pose information of a mobile terminal, wherein the movement pose information is used for indicating the position and the pose of the mobile terminal in a movement state;

the mobile pose information is identified to obtain an identification result, wherein the identification result is used for indicating whether the mobile terminal is in a code scanning preposition state, and the code scanning preposition state refers to a preposition state when a code scanning interface is displayed;

responding to the identification result to indicate that the mobile terminal is in the pre-scanning state, and acquiring a target image, wherein the target image is used for indicating payment based on a graphic code provided by a service provider; the mobile terminal acquires the target image in the background, and the operation of acquiring the target image in the background is not perceived by a user;

determining a payment program corresponding to the graphic code provided by the service provider based on the image characteristics of the target image, wherein the payment program refers to an application program for providing a payment function;

And displaying a code scanning interface corresponding to the payment program.

2. The method of claim 1, wherein the acquiring the target image comprises:

acquiring an image through a rear camera of the mobile terminal to obtain an acquired image;

and in response to the acquired image including the graphic code, acquiring the target image including the graphic code from the acquired image.

3. The method of claim 1, wherein after displaying the scan code interface corresponding to the payment procedure, further comprising:

displaying a payment interface, wherein the payment interface comprises an input box of payment amount and a payment control;

acquiring the amount input in the payment amount input box;

and in response to receiving a selection instruction of the confirmed payment control, paying the amount of the amount to the service provider.

4. A method according to claim 3, wherein the obtaining the amount entered in the payment amount entry box comprises:

receiving a voice instruction of an input box for the payment amount;

the amount is determined from the voice command.

5. The method of claim 1, wherein before displaying the scan code interface corresponding to the payment procedure, further comprises:

jumping from an original user interface to the code scanning interface under the condition that the mobile terminal is in an unlocking state;

under the condition that the mobile terminal is in a screen locking state, receiving authentication information input by a user, wherein the authentication information is used for triggering the mobile terminal to perform authentication; and responding to the identity verification information input by the user being consistent with the preset identity verification information, and jumping from the screen locking interface to the code scanning interface.

6. The method according to any one of claims 1 to 5, wherein the identifying the moving pose information to obtain an identification result includes:

and carrying out recognition processing on the mobile pose information through a recognition model to obtain a recognition result.

7. The method according to claim 6, wherein the identifying the moving pose information by the identifying model further comprises, before obtaining the identifying result:

acquiring training data, wherein the training data comprises at least one piece of training movement pose information and a standard recognition result corresponding to the training movement pose information;

The training movement pose information is identified through the identification model, and a prediction identification result is obtained;

and training the recognition model based on the predicted recognition result and the standard recognition result to obtain the recognition model after training.

8. A code scanning interface display device, the device comprising:

the information acquisition module is used for acquiring movement pose information of the mobile terminal, wherein the movement pose information is used for indicating the position and the pose of the mobile terminal in a movement state;

the information identification module is used for carrying out identification processing on the mobile pose information to obtain an identification result, wherein the identification result is used for indicating whether the mobile terminal is in a code scanning preposition state, and the code scanning preposition state refers to a preposition state when a code scanning interface is displayed;

the image acquisition module is used for responding to the identification result and used for indicating that the mobile terminal is in the code scanning preposition state and acquiring a target image, and the target image is used for indicating that payment is carried out based on the graphic code provided by the service provider; the mobile terminal acquires the target image in the background, and the operation of acquiring the target image in the background is not perceived by a user;

The interface display module is used for determining a payment program corresponding to the graphic code provided by the service provider based on the image characteristics of the target image, wherein the payment program refers to an application program for providing a payment function; and displaying a code scanning interface corresponding to the payment program.

9. A mobile terminal, characterized in that it comprises a processor and a memory, said memory storing a computer program, said computer program being loaded and executed by said processor to implement the method of displaying a swipe code interface according to any of claims 1 to 7.

10. A computer readable storage medium having a computer program stored therein, the computer program being loaded and executed by a processor to implement the scan code interface display method of any one of claims 1 to 7.