CN108614971A - Encryption processing method and device, decryption processing method and device, and storage medium - Google Patents

Abstract

The method is executed by a trusted application program, the trusted application program runs in a trusted execution environment, depth data acquired by the trusted application program from special hardware is encrypted, a target speckle pattern for decryption is obtained by calibrating a diffractive optical element, uniqueness and randomness of the speckle pattern are achieved, even if software or hardware except the trusted application program and the special hardware reads the depth data, decryption cannot be conducted, leakage of the depth data can be effectively prevented, safety of the depth data is improved, and the problem that safety of face imaging data is low in identity verification based on a face in the prior art is solved. In the authentication process, the imaging data required by the authentication is acquired by the special hardware in the trusted environment, so that the security of the authentication data source is ensured, and the security and the reliability are further improved.

Description

Encryption processing and decryption processing method and device

technical field

The present application relates to the technical field of mobile terminals, in particular to an encryption processing and decryption processing method and device.

Background technique

With the development of science and technology, identification technology based on biometrics has become increasingly mature and has shown great advantages in practical applications. Currently, imaging data of a human face can be collected by an image sensor on an electronic device, and then identity verification is performed based on the imaging data.

Due to the relatively low security of electronic equipment terminals, they are vulnerable to attacks by viruses or malware, and the imaging data of the face collected during identity verification may be obtained by malware, resulting in the leakage of face imaging data. If malicious software uses the obtained data to pass identity verification, it will cause unexpected economic losses to users. It can be seen that in the existing face-based identity verification methods, the security of face imaging data is relatively low.

Contents of the invention

This application aims to solve one of the technical problems in the related art at least to a certain extent.

To this end, this application proposes a decryption processing method to realize that the depth data read by a trusted application program from dedicated hardware is encrypted, and the target speckle pattern obtained by calibrating the diffractive optical element of the structured light sensor is used to perform encryption. Decryption, since the target speckle pattern is obtained by calibrating the diffractive optical element, even if the depth data is read by software or hardware other than trusted applications and dedicated hardware, it cannot be decrypted, which can effectively prevent the leakage of depth data, thereby improving In-depth data security.

This application proposes an encryption processing method.

This application proposes a decryption processing device.

The present application proposes a microprocessor.

This application proposes a mobile terminal.

An embodiment of the present application proposes a decryption processing method, the method is executed by a trusted application, and the trusted application runs in a trusted execution environment, including:

Control the structured light sensor to perform imaging through the dedicated hardware of the trusted execution environment;

Obtain encrypted depth data from the dedicated hardware; the depth data is obtained by imaging the structured light sensor;

The encrypted depth data is decrypted according to the pre-stored target speckle pattern to obtain the depth data; wherein the target speckle pattern is obtained by calibrating the diffractive optical element of the structured light sensor.

The decryption processing method of the embodiment of the present application is executed by a trusted application program, which runs in a trusted execution environment, controls the structured light sensor to perform imaging through the dedicated hardware of the trusted execution environment, and obtains the image passing through the dedicated hardware. Decrypt the encrypted depth data obtained by imaging the structured light sensor according to the pre-stored target speckle pattern to obtain the depth data; the target speckle pattern is used to calibrate the diffractive optical element of the structured light sensor owned. In this embodiment, since the depth data acquired by the trusted application program from the dedicated hardware is encrypted, and the target speckle pattern used for decryption is obtained by calibrating the diffractive optical element, it has uniqueness and the uniqueness of the speckle pattern itself. Randomness, so even if software or hardware other than trusted applications and dedicated hardware read the deep data, it cannot be decrypted, which can effectively prevent deep data leakage, thereby improving the security of deep data and solving existing problems. In the face-based identity verification method in the technology, the security of face imaging data is relatively low. In the aforementioned identity verification process, since the imaging data required for identity verification is obtained through dedicated hardware in a trusted environment, the security of the source of identity verification data is guaranteed, and the safety and reliability are further improved.

An embodiment of the present application proposes an encryption processing method, the method is executed by dedicated hardware in a trusted execution environment, including:

When the trusted application running under the trusted execution environment instructs the structured light sensor to perform imaging, control the structured light sensor to perform imaging, and acquire depth data obtained by imaging the structured light sensor;

Encrypting the depth data by using a pre-stored target speckle pattern to obtain encrypted depth data, and sending the encrypted depth data to the trusted application.

In the encryption processing method of the embodiment of the present application, when the trusted application program running in the trusted execution environment instructs the structured light sensor to perform imaging, the structured light sensor is controlled to perform imaging, and the depth data obtained by the structured light sensor imaging is obtained, and the pre-stored target is used. The speckle pattern encrypts the depth data to obtain encrypted depth data and sends the encrypted depth data to a trusted application. In this embodiment, the target speckle pattern is used to encrypt the depth data acquired by the structured light sensor imaging. Due to the randomness of the speckle pattern itself, even software or hardware other than trusted applications and dedicated hardware read The depth data cannot be decrypted even if it is obtained, which can effectively prevent the leakage of the depth data, thereby improving the security of the depth data, and solving the problem of face imaging data security in the existing technology of identity verification based on the face lower problem.

An embodiment of the present application proposes a decryption processing device, the device has a trusted execution environment, and the device includes:

A control module, configured to control the structured light sensor to perform imaging through the dedicated hardware of the trusted execution environment;

An acquisition module, configured to acquire encrypted depth data from the dedicated hardware; the depth data is obtained by imaging the structured light sensor;

The decryption module is configured to decrypt the encrypted depth data according to the prestored target speckle pattern to obtain the depth data.

The decryption processing device in the embodiment of the present application has a trusted execution environment, controls the structured light sensor to perform imaging through the dedicated hardware of the trusted execution environment, and obtains the encrypted depth data obtained by imaging the structured light sensor from the dedicated hardware, according to the pre-stored Decrypt the encrypted depth data to obtain the depth data; wherein, the target speckle pattern is obtained by calibrating the diffractive optical element of the structured light sensor. In this embodiment, since the depth data acquired by the trusted application program from the dedicated hardware is encrypted, and the target speckle pattern used for decryption is obtained by calibrating the diffractive optical element, it has uniqueness and the uniqueness of the speckle pattern itself. Randomness, so even if software or hardware other than trusted applications and dedicated hardware read the deep data, it cannot be decrypted, which can effectively prevent deep data leakage, thereby improving the security of deep data and solving existing problems. In the face-based identity verification method in the technology, the security of face imaging data is relatively low. In the aforementioned identity verification process, since the imaging data required for identity verification is obtained through dedicated hardware in a trusted environment, the security of the source of identity verification data is guaranteed, and the safety and reliability are further improved.

An embodiment of the present application proposes a microprocessor, the microprocessor is dedicated hardware for a trusted execution environment, and the microprocessor includes:

A control module, configured to control the structured light sensor to perform imaging when the trusted application running under the trusted execution environment instructs the structured light sensor to perform imaging, and acquire depth data obtained by imaging the structured light sensor;

An encryption module, configured to encrypt the depth data by using a pre-stored target speckle pattern to obtain encrypted depth data, and send the encrypted depth data to the trusted application.

The microprocessor of the embodiment of the present application, the microprocessor is dedicated hardware of the trusted execution environment, when the trusted application program running in the trusted execution environment instructs the structured light sensor to perform imaging, it controls the structured light sensor to perform imaging, and obtains The depth data obtained by the imaging of the structured light sensor is encrypted by using the pre-stored target speckle pattern to obtain encrypted depth data, and the encrypted depth data is sent to a trusted application. In this embodiment, the target speckle pattern is used to encrypt the depth data acquired by the structured light sensor imaging. Due to the randomness of the speckle pattern itself, even software or hardware other than trusted applications and dedicated hardware read The depth data cannot be decrypted even if it is obtained, which can effectively prevent the leakage of the depth data, thereby improving the security of the depth data, and solving the problem of face imaging data security in the existing technology of identity verification based on the face lower problem.

The embodiment of the present application proposes a mobile terminal, including: a structured light sensor, a memory, a micro-processing chip MCU, a processor, and a trusted application;

The MCU is dedicated hardware of the trusted execution environment, connected to the structured light sensor and the processor, and used to execute the encryption processing method described in the above embodiment;

When the processor executes the trusted application program, the decryption processing method as described in the foregoing embodiments is implemented.

The embodiment of the present application proposes a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the decryption processing method as described in the above-mentioned embodiment is realized, or the encryption as described in the above-mentioned embodiment is realized. Approach.

Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.

Description of drawings

The above and/or additional aspects and advantages of the present application will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:

FIG. 1 is a schematic flow diagram of a decryption processing method provided in an embodiment of the present application;

FIG. 2 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

FIG. 3 is a schematic flowchart of another decryption processing method provided by the embodiment of the present application;

FIG. 4 is a schematic flowchart of another decryption processing method provided by the embodiment of the present application;

FIG. 5 is a schematic flowchart of an encryption processing method provided in an embodiment of the present application;

FIG. 6 is a schematic flowchart of another encryption processing method provided in the embodiment of the present application;

FIG. 7 is a schematic structural diagram of a decryption processing device provided in an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a microprocessor provided in an embodiment of the present application;

FIG. 9 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present application.

Detailed ways

Embodiments of the present application are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary, and are intended to explain the present application, and should not be construed as limiting the present application.

The encryption processing and decryption processing methods and devices according to the embodiments of the present application are described below with reference to the accompanying drawings.

At present, the security of electronic device terminals is relatively low, and they are vulnerable to attacks by viruses or malware. The face imaging data collected during identity verification may be obtained by malware, resulting in the leakage of face imaging data. If malicious software uses the obtained data to pass identity verification, it will cause unexpected economic losses to users. It can be seen that in the existing face-based identity verification methods, the security of face imaging data is relatively low.

In response to this problem, the embodiment of this application proposes a decryption processing method to realize that the depth data read by the trusted application program from the dedicated hardware is encrypted, and the target obtained by calibrating the diffractive optical element of the structured light sensor is used. Since the target speckle pattern is obtained by calibrating the diffractive optical element, even if software or hardware other than trusted applications and dedicated hardware read the depth data, it cannot be decrypted, which can effectively prevent depth Data leakage, thereby improving the security of the depth data, and solving the problem of relatively low security of the face imaging data in the face-based identity verification method in the prior art. In the aforementioned identity verification process, since the imaging data required for identity verification is obtained through dedicated hardware in a trusted environment, the security of the source of identity verification data is guaranteed, and the safety and reliability are further improved.

FIG. 1 is a schematic flowchart of a decryption processing method provided by an embodiment of the present application.

The decryption processing method can be applied to an electronic device. As a possible implementation manner, the structure of the electronic device can be referred to in FIG. 2 , which is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

It should be noted that those skilled in the art can know that the corresponding method in Figure 1 is not only applicable to the electronic device shown in Figure 2, the electronic device shown in Figure 2 is only used as a schematic description, and the corresponding method in Figure 1 can also be used for other An electronic device having a trusted execution environment and dedicated hardware for the trusted execution environment is not limited in this embodiment.

As shown in FIG. 2 , the electronic device includes: a laser camera, a floodlight, a visible light camera, a laser light, and a microprocessor (Microcontroller Unit, MCU for short). Wherein, the MCU includes a pulse width modulation (Pulse Width Modulation, PWM for short), a depth engine, a bus interface and a random access memory RAM.

In addition, the electronic device also includes a processor, the processor has a trusted execution environment, the MCU is dedicated hardware for the trusted execution environment, and the trusted application program that executes the method shown in Figure 1 runs under the trusted execution environment; the processor also There may be a general execution environment that is isolated from the trusted execution environment.

Among them, PWM is used to modulate the floodlight to emit infrared light, and modulate the laser light to emit structured light; the laser camera is used to collect the structured light image or visible light image of the imaging object; the depth engine is used to, according to the structured light image, The depth data corresponding to the imaging object is obtained through calculation; the bus interface is used to send the depth data to the processor, and the trusted application program running on the processor uses the depth data to perform corresponding operations. Wherein, the bus interface includes: Mobile Industry Processor Interface (MIPI for short), I2C synchronous serial bus interface, and Serial Peripheral Interface (SPI for short).

As shown in Figure 1, the decryption processing method includes:

Step 101, control the structured light sensor to perform imaging through the dedicated hardware of the trusted execution environment.

The decryption processing method can be executed by a trusted application program, and the trusted application program runs in a trusted execution environment.

In this embodiment, the trusted application program may be understood as an application program with a higher security level, such as an electronic payment program, an unlocking program, and the like.

A trusted execution environment is a secure area on the main processor of an electronic device (including smartphones, tablets, etc.), which can guarantee the security, confidentiality, and integrity of codes and data loaded into the environment compared with ordinary execution environments. sex. The trusted execution environment provides an isolated execution environment, and the security features provided include: isolated execution, integrity of trusted applications, confidentiality of trusted data, secure storage, etc. In summary, the execution space provided by TEE provides a higher level of security than common mobile operating systems, such as ISO, Android, etc.

In this embodiment, the trusted application program runs in the trusted execution environment, which improves data security from the running environment.

When the trusted application program is executed, such as electronic payment and electronic device unlocking, the structured light sensor can be controlled to perform imaging through the dedicated hardware of the trusted execution environment. Wherein, the dedicated hardware may be an MCU.

In this embodiment, the structured light sensor includes a laser camera and a laser light, and the laser light on the electronic device can be modulated by PWM in the MCU to emit structured light and project it to the imaging object. The structured light is hindered by the imaging object and reflected by the imaging object. The laser camera captures the structured light sensor to receive and image the reflected structured light to obtain a structured light image.

Step 102, obtain encrypted depth data from dedicated hardware; the depth data is obtained by imaging the structured light sensor.

In this embodiment, the MCU can acquire the structured light image imaged by the structured light sensor, and the depth engine in the MCU can demodulate the phase information corresponding to the deformed position pixel in the structured light image, convert the phase information into height information, and determine The depth data corresponding to the imaging object is encrypted, and the trusted application program obtains the encrypted depth data from the MCU.

Step 103, decrypt the encrypted depth data according to the pre-stored target speckle pattern to obtain the depth data; wherein, the target speckle pattern is obtained by calibrating the diffractive optical element of the structured light sensor.

In this embodiment, the target speckle pattern used for decryption is obtained by calibrating the diffractive optical element of the structured light sensor.

The speckle pattern has a high degree of randomness, and will change the pattern with different distances. The diffraction element can be calibrated to obtain the speckle pattern. For example, within the range of 0 to 4 meters from the laser camera, any one Referring to the plane, the speckle pattern corresponding to the position can be obtained. It can be understood that when the calibrated positions are different, different speckle patterns can be obtained, so the speckle patterns are diverse and unique, and the speckle patterns themselves have a high degree of randomness.

Since the ordinary diffraction element diffracts the light beam to obtain most of the diffracted light, but the intensity of each diffracted light varies greatly, and the risk of damage to human eyes is also large. Even if the diffracted light is diffracted twice, the uniformity of the obtained beam is low. Therefore, the projection effect of the light beam diffracted by the common diffraction element on the measured object is relatively poor.

In this embodiment, a collimating beam-splitting element is used, which not only has the function of collimating the uncollimated beam, but also has the function of splitting light, that is, the uncollimated light reflected by the mirror passes through the collimating beam-splitting element and then Multiple collimated beams are emitted from different angles, and the cross-sectional areas of the emitted multiple collimated beams are approximately equal, and the energy flux is approximately equal, so that the projection effect of the scattered light after the diffraction of the beam is better. At the same time, the outgoing light is dispersed to each beam, which further reduces the risk of harming the human eye. Compared with other evenly arranged structured light, when the speckle structured light achieves the same collection effect, the speckle structured light consumes less Lower power.

Since the speckle pattern obtained by calibrating the diffractive optical element of the structured light sensor is not only highly random, but also unique at each calibration position, even software or hardware other than trusted applications and dedicated hardware The depth data cannot be decrypted even if it is read, so decrypting with the target speckle pattern can effectively prevent the leakage of the depth data and improve the security of the depth data.

On the basis of the foregoing embodiments, FIG. 3 is a schematic flowchart of another decryption processing method provided by the embodiment of the present application. As shown in Figure 3, step 103 may include:

Step 301, taking the value of each pixel in the target speckle pattern as the value of the corresponding element in the one-dimensional sequence.

Since the value of each pixel in different target speckle patterns is different, the target speckle pattern can be used as a key. In this embodiment, a two-dimensional matrix may be generated according to the value of each pixel in the target speckle pattern, wherein the rows and columns of the two-dimensional matrix correspond to the rows and columns of the pixels in the target speckle pattern respectively. Then, in units of rows or columns, the elements in the two-dimensional matrix are sequentially spliced in a preset order to obtain a one-dimensional sequence.

As an example, in units of rows, after obtaining the elements of the first row from left to right, the elements of the second row are sequentially spliced from left to right after the last element of the first row. After splicing the elements of the first row and the second row, the elements of the third row from left to right are spliced after the last element of the second row until all the elements in the two-dimensional matrix are spliced to obtain a one-dimensional sequence.

As another example, in units of columns, after getting the elements of the first column from top to bottom, after the last element of the first column, splice the elements of the second column from top to bottom at the end of the first column After one element, until all the elements in the two-dimensional matrix are concatenated, a one-dimensional sequence is obtained.

Step 302, using the one-dimensional sequence as a key to decrypt the encrypted depth data to obtain the decrypted depth data.

In this implementation example, since the elements in the one-dimensional sequence are the values of each pixel in the target speckle pattern, the one-dimensional sequence is used as the key, that is, the value of each pixel in the target speckle pattern is used as the key. After decrypting the encrypted depth data, the decrypted depth data can be obtained.

In the decryption processing method of the embodiment of the present application, the value of each pixel in the target speckle pattern is used as a key to decrypt the encrypted depth data. Since the value of each pixel in a different speckle pattern The values are different, so the value of each pixel in the target speckle pattern is used as a one-dimensional sequence as the key. Even if the encrypted depth data is stolen, it cannot be decrypted, which can effectively prevent the leakage of depth data and improve the depth data. security.

Based on the above embodiments, after the trusted application program decrypts the encrypted depth data, it can also match the depth data with the preset face depth model. FIG. 4 is a schematic flowchart of another decryption processing method provided by the embodiment of the present application , as shown in Figure 4, on the basis of Figure 1, the decryption processing method also includes after step 103:

Step 104, matching the structured light depth model constructed according to the depth data with the preset face depth model.

Specifically, the trusted application can construct the structured light depth model of the imaging object according to the depth data, and compare the structured light depth model with the preset face depth model. When the similarity exceeds the preset threshold, it can be considered The structured light depth model of the imaging object matches the preset face depth model.

It can be understood that the preset face depth model here is a pre-stored structured light image obtained by imaging the face of the owner of the electronic device using a structured light sensor, and constructing the human face by using the depth data in the structured light image. Face depth model for authentication.

Step 105, when the structured light depth model matches the preset face depth model, it is determined that the identity verification is passed.

When the structured light depth model of the imaging object matches the preset face depth model, it can be determined that the identity verification is passed, and the user is allowed to perform subsequent operations, such as after the unlocking is successful, the user is allowed to use the electronic device. When the structured light depth model does not match the preset face depth model, it can be determined that the authentication has not been passed, and the authentication failure information is returned.

In the decryption processing method of the embodiment of the present application, the encrypted depth data is decrypted by using the target speckle pattern, and the structured light depth model constructed according to the depth data is matched with the preset face depth model to perform identity verification. The depth data is pre-encrypted, and the target speckle pattern used for decryption is highly random and cannot be decrypted by other software or hardware, which can improve the security and reliability of authentication. In the identity verification process, since the in-depth data required for identity verification is obtained through dedicated hardware in a trusted environment, the security of the source of identity verification data is guaranteed, and the security and reliability of identity verification are further improved. In the aforementioned identity verification process, since the imaging data required for identity verification is obtained through dedicated hardware in a trusted environment, the security of the source of identity verification data is guaranteed, and the safety and reliability are further improved.

The embodiment of the present application also proposes an encryption processing method, which is executed by dedicated hardware in a trusted execution environment. Wherein, the dedicated hardware may be the MCU in FIG. 2 , and FIG. 5 is a schematic flowchart of an encryption processing method provided in an embodiment of the present application.

As shown in Figure 5, the encryption processing method includes:

Step 501, when the trusted application running under the trusted execution environment instructs the structured light sensor to perform imaging, control the structured light sensor to perform imaging, and acquire depth data obtained by the structured light sensor.

When the trusted application program running in the trusted execution environment instructs the structured light sensor to perform imaging, such as when the electronic device is unlocked or electronic payment is made, it can send instructions for structured light sensor imaging to the dedicated hardware. After receiving the instructions, the dedicated hardware can control the structured light sensor for imaging.

In this embodiment, the structured light sensor may include a laser lamp and a laser camera. The PWM in the dedicated hardware MCU can modulate the laser light to emit structured light, and the structured light is irradiated to the imaging object. The structured light is reflected by the obstruction of the imaging object, and the laser camera can capture the structured light reflected by the imaging object for imaging to obtain a structured light image.

The MCU obtains the structured light image from the laser camera, and the depth engine in the MCU can calculate and obtain the depth data corresponding to the imaging object according to the structured light image. Specifically, the depth engine demodulates the phase information corresponding to the deformed position pixel in the structured light image, and converts The phase information is converted into height information, so as to determine the depth data corresponding to the imaging object according to the height information.

Step 502, using the pre-stored target speckle pattern to encrypt the depth data to obtain encrypted depth data, and send the encrypted depth data to a trusted application.

The dedicated hardware uses the pre-stored target speckle pattern to encrypt the depth data, and sends the encrypted data to a trusted application, and the trusted application uses the depth data to perform corresponding operations.

Since the speckle pattern is highly random, even if it is acquired by other malicious software or hardware, the depth data cannot be decrypted. Therefore, encrypting the depth data with the target speckle pattern can prevent the leakage of the depth data and improve the security of the depth data. .

Furthermore, before the dedicated hardware uses the pre-stored target speckle pattern to encrypt the depth data, the diffractive optical element of the structured light sensor can be calibrated to obtain the target speckle pattern.

The speckle pattern has a high degree of randomness, and will change the pattern with different distances. The diffraction element can be calibrated to obtain the speckle pattern. For example, within the range of 0 to 4 meters from the laser camera, any one Referring to the plane, the speckle pattern corresponding to the position can be obtained. It can be understood that when the calibrated positions are different, different speckle patterns can be obtained, so the speckle patterns are diverse and unique, and the speckle patterns themselves have a high degree of randomness.

Since the ordinary diffraction element diffracts the light beam to obtain most of the diffracted light, but the intensity of each diffracted light varies greatly, and the risk of damage to human eyes is also large. Even if the diffracted light is diffracted twice, the uniformity of the obtained beam is low. Therefore, the projection effect of the light beam diffracted by the common diffraction element on the measured object is relatively poor.

In this embodiment, a collimating beam-splitting element is used, which not only has the function of collimating the uncollimated beam, but also has the function of splitting light, that is, the uncollimated light reflected by the mirror passes through the collimating beam-splitting element and then Multiple collimated beams are emitted from different angles, and the cross-sectional areas of the emitted multiple collimated beams are approximately equal, and the energy flux is approximately equal, so that the projection effect of the scattered light after diffracted by the beam is better. At the same time, the outgoing light is dispersed to each beam, which further reduces the risk of harming the human eye. Compared with other evenly arranged structured light, when the speckle structured light achieves the same collection effect, the speckle structured light consumes less Lower power.

Since the speckle pattern obtained by calibrating the diffractive optical element of the structured light sensor is not only highly random, but also unique at each calibration position, even software or hardware other than trusted applications and dedicated hardware Obtained depth data cannot be decrypted, so encryption with the target speckle pattern can effectively prevent depth data leakage and improve the security of depth data.

On the basis of the above embodiments, FIG. 6 is a schematic flowchart of another encryption processing method provided in the embodiment of the present application. As shown in FIG. 6, step 502 may include:

Step 601, taking the value of each pixel in the target speckle pattern as the value of the corresponding element in the one-dimensional sequence.

Since the value of each pixel in different target speckle patterns is different, the target speckle pattern can be used as a key. In this embodiment, a two-dimensional matrix may be generated according to the value of each pixel in the target speckle pattern, wherein the rows and columns of the two-dimensional matrix correspond to the rows and columns of the pixels in the target speckle pattern respectively. Then, in units of rows or columns, the elements in the two-dimensional matrix are sequentially spliced in a preset order to obtain a one-dimensional sequence.

As an example, in units of rows, after obtaining the elements of the first row from left to right, the elements of the second row are sequentially spliced from left to right after the last element of the first row. After splicing the elements of the first row and the second row, the elements of the third row from left to right are spliced after the last element of the second row until all the elements in the two-dimensional matrix are spliced to obtain a one-dimensional sequence.

As another example, in units of columns, after getting the elements of the first column from top to bottom, after the last element of the first column, splice the elements of the second column from top to bottom at the end of the first column After one element, until all the elements in the two-dimensional matrix are concatenated, a one-dimensional sequence is obtained.

Step 602, using the one-dimensional sequence as a key to encrypt the depth data to obtain encrypted depth data.

In this implementation example, since the elements in the one-dimensional sequence are the values of each pixel in the target speckle pattern, the one-dimensional sequence is used as the key, that is, the value of each pixel in the target speckle pattern is used as the key. After encrypting the encrypted depth data, the encrypted depth data can be obtained.

In the encryption processing method of the embodiment of the present application, the value of each pixel in the target speckle pattern is used as a one-dimensional sequence as the key to encrypt the encrypted depth data. Since the value of each pixel in different speckle patterns The values are different, so the value of each pixel in the target speckle pattern is used as a one-dimensional sequence as the key. Even if the encrypted depth data is stolen, it cannot be decrypted, which can effectively prevent the leakage of depth data and improve the depth data. security.

The embodiment of the present application also proposes a decryption processing device, which has a trusted execution environment. FIG. 7 is a schematic structural diagram of a decryption processing device provided by an embodiment of the present application.

As shown in FIG. 7 , the decryption processing device includes: a control module 710 , an acquisition module 720 , and a decryption module 730 .

The control module 710 is configured to control the structured light sensor to perform imaging through the dedicated hardware of the trusted execution environment;

The obtaining module 720 is used to obtain encrypted depth data from dedicated hardware; the depth data is obtained by imaging with a light sensor;

The decryption module 730 is configured to decrypt the encrypted depth data according to the pre-stored target speckle pattern to obtain depth data.

In a possible implementation of this embodiment, the decryption module 730 may include:

An acquisition unit, configured to use the value of each pixel in the target speckle pattern as the value of the corresponding element in the one-dimensional sequence;

The decryption unit is configured to use the one-dimensional sequence as a key to decrypt the encrypted depth data to obtain the decrypted depth data.

In a possible implementation manner of this embodiment, the acquiring unit is further configured to:

Generate a two-dimensional matrix according to the value of each pixel in the target speckle pattern;

In units of rows or columns, the elements in the two-dimensional matrix are sequentially spliced in a preset order to obtain a one-dimensional sequence.

In a possible implementation manner of this embodiment, the device may further include:

The matching module is configured to match the structured light depth model constructed according to the depth data with the preset face depth model; when the structured light depth model matches the preset face depth model, it is determined that the identity verification is passed.

The division of each module in the above-mentioned decryption processing device is only for illustration. In other embodiments, the decryption processing device can be divided into different modules according to needs, so as to complete all or part of the functions of the above-mentioned image processing device.

It should be noted that the foregoing explanations of the embodiment of the decryption processing method are also applicable to the decryption processing device of this embodiment, so details are not repeated here.

The decryption processing device in the embodiment of the present application has a trusted execution environment, controls the structured light sensor to perform imaging through the dedicated hardware of the trusted execution environment, and obtains the encrypted depth data obtained by imaging the structured light sensor from the dedicated hardware, according to the pre-stored Decrypt the encrypted depth data to obtain the depth data; wherein, the target speckle pattern is obtained by calibrating the diffractive optical element of the structured light sensor. In this embodiment, since the depth data acquired by the trusted application program from the dedicated hardware is encrypted, and the target speckle pattern used for decryption is obtained by calibrating the diffractive optical element, it has uniqueness and the uniqueness of the speckle pattern itself. Randomness, so even if software or hardware other than trusted applications and dedicated hardware read the deep data, it cannot be decrypted, which can effectively prevent deep data leakage, thereby improving the security of deep data and solving existing problems. In the face-based identity verification method in the technology, the security of face imaging data is relatively low.

In the aforementioned identity verification process, since the imaging data required for identity verification is obtained through dedicated hardware in a trusted environment, the security of the source of identity verification data is guaranteed, and the safety and reliability are further improved.

The embodiment of the present application also proposes a microprocessor, which is dedicated hardware for a trusted execution environment. FIG. 8 is a schematic structural diagram of a microprocessor provided in an embodiment of the present application.

As shown in FIG. 8 , the microprocessor includes: a control module 810 and an encryption module 820 .

The control module 810 is configured to control the structured light sensor to perform imaging when the trusted application program running under the trusted execution environment instructs the structured light sensor to perform imaging, and obtain depth data obtained by imaging the structured light sensor;

The encryption module 820 is configured to use the pre-stored target speckle pattern to encrypt the depth data to obtain encrypted depth data, and send the encrypted depth data to a trusted application.

In a possible implementation of this embodiment, the encryption module 820 may include:

The reading unit is configured to use the value of each pixel in the target speckle pattern as the value of the corresponding element in the one-dimensional sequence;

The encryption unit is configured to use the one-dimensional sequence as a key to encrypt the depth data to obtain encrypted depth data.

In a possible implementation manner of this embodiment, the reading unit is also used for:

Generate a two-dimensional matrix according to the value of each pixel in the target speckle pattern;

In units of rows or columns, the elements in the two-dimensional matrix are sequentially spliced in a preset order to obtain a one-dimensional sequence.

In a possible implementation manner of this embodiment, the microprocessing unit may further include:

The calibration module is used to calibrate the diffractive optical element of the structured light sensor to obtain the target speckle pattern.

The division of each module in the above-mentioned microprocessor is only for illustration. In other embodiments, the microprocessor can be divided into different modules according to needs, so as to complete all or part of the functions of the above-mentioned microprocessor.

It should be noted that the foregoing explanations of the embodiment of the encryption processing method are also applicable to the microprocessor of this embodiment, so details are not repeated here.

The microprocessor of the embodiment of the present application, the microprocessor is dedicated hardware of the trusted execution environment, when the trusted application program running in the trusted execution environment instructs the structured light sensor to perform imaging, it controls the structured light sensor to perform imaging, and obtains The depth data obtained by the imaging of the structured light sensor is encrypted by using the pre-stored target speckle pattern to obtain encrypted depth data, and the encrypted depth data is sent to a trusted application. In this embodiment, the target speckle pattern is used to encrypt the depth data acquired by the structured light sensor imaging. Due to the randomness of the speckle pattern itself, even software or hardware other than trusted applications and dedicated hardware read The depth data cannot be decrypted even if it is obtained, which can effectively prevent the leakage of the depth data, thereby improving the security of the depth data, and solving the problem of face imaging data security in the existing technology of identity verification based on the face lower problem.

The embodiment of the present application also proposes a mobile terminal. FIG. 9 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present application.

In this embodiment, the mobile terminal includes but is not limited to devices such as mobile phones and tablet computers.

As shown in FIG. 9 , the mobile terminal includes: a structured light sensor 910, a memory 920, an MCU 930, a processor 940, and a trusted application program ( not shown in Figure 9).

Wherein, the MCU 930 is dedicated hardware of a trusted execution environment, connected with the structured light sensor 910 and the processor 940, and used to implement the encryption processing method described in the above-mentioned embodiments.

When the processor 940 executes the trusted application program, it implements the decryption processing method described in the foregoing embodiments.

In a possible implementation manner of this embodiment, the mobile terminal further includes: an infrared sensor and a visible light sensor.

Among them, the infrared sensor includes a laser camera and a floodlight; the structured light sensor includes: a laser light, and a laser camera shared with the infrared sensor; the visible light sensor includes: a visible light camera.

In a possible implementation of this embodiment, the MCU 930 includes: a PWM, a depth engine, a bus interface, and a RAM;

PWM for modulating floodlights for infrared light and laser lights for structured light;

A laser camera for collecting structured light images of imaging objects;

a depth engine, configured to calculate and obtain depth data corresponding to the imaging object according to the structured light image; and

The bus interface is used to send the depth data to the processor 940, and the trusted application running on the processor 940 uses the depth data to perform corresponding operations.

In this embodiment, the PWM can modulate the floodlight to emit infrared light, the infrared light is irradiated to the imaging object, and is reflected by the imaging object, the laser camera collects the reflected infrared light for imaging to obtain an infrared image, and the visible light camera can collect Visible light imaging is performed to obtain visible light images.

In this embodiment, the bus interface may include a MIPI bus interface, an I2C synchronous serial bus interface, and an SPI bus interface.

The embodiment of the present application also proposes a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the decryption processing method as described in the foregoing embodiments is realized, or the encryption method as described in the foregoing embodiments is realized. Approach.

In the description of this specification, the terms "first" and "second" are used for description purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present application, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing custom logical functions or steps of a process , and the scope of preferred embodiments of the present application includes additional implementations in which functions may be performed out of the order shown or discussed, including in substantially simultaneous fashion or in reverse order depending on the functions involved, which shall It should be understood by those skilled in the art to which the embodiments of the present application belong.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used. For the purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate or transmit a program for use in or in conjunction with an instruction execution system, device or device. More specific examples (non-exhaustive list) of computer-readable media include the following: electrical connection with one or more wires (electronic device), portable computer disk case (magnetic device), random access memory (RAM), Read Only Memory (ROM), Erasable and Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, since the program can be read, for example, by optically scanning the paper or other medium, followed by editing, interpretation or other suitable processing if necessary. The program is processed electronically and stored in computer memory.

It should be understood that each part of the present application may be realized by hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: a discrete Logic circuits, ASICs with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.

Those of ordinary skill in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. During execution, one or a combination of the steps of the method embodiments is included.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are realized in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, and the like. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims (14)

1. A decryption processing method, characterized in that, the method is executed by a trusted application, and the trusted application runs in a trusted execution environment, and the method comprises the following steps: Control the structured light sensor to perform imaging through the dedicated hardware of the trusted execution environment; Obtain encrypted depth data from the dedicated hardware; the depth data is obtained by imaging the structured light sensor; The encrypted depth data is decrypted according to the pre-stored target speckle pattern to obtain the depth data; wherein the target speckle pattern is obtained by calibrating the diffractive optical element of the structured light sensor. 2. The decryption processing method according to claim 1, wherein the decryption of the encrypted depth data according to the pre-stored target speckle pattern comprises: Taking the value of each pixel in the target speckle pattern as the value of the corresponding element in the one-dimensional sequence; The one-dimensional sequence is used as a key to decrypt the encrypted depth data to obtain the decrypted depth data. 3. The decryption processing method according to claim 2, wherein said taking the value of each pixel in the target speckle pattern as the value of the corresponding element in the one-dimensional sequence includes: Generate a two-dimensional matrix according to the value of each pixel in the target speckle pattern; Taking rows or columns as units, the elements in the two-dimensional matrix are sequentially spliced in a preset order to obtain a one-dimensional sequence. 4. The decryption processing method according to any one of claims 1-3, wherein the encrypted depth data is decrypted according to the pre-stored target speckle pattern to obtain the depth data. ,Also includes: Matching the structured light depth model constructed according to the depth data with the preset face depth model; When the structured light depth model matches the preset face depth model, it is determined that the identity verification is passed. 5. An encryption processing method, characterized in that the method is executed by dedicated hardware in a trusted execution environment, and the method comprises: When the trusted application running under the trusted execution environment instructs the structured light sensor to perform imaging, control the structured light sensor to perform imaging, and acquire depth data obtained by imaging the structured light sensor; Encrypting the depth data by using a pre-stored target speckle pattern to obtain encrypted depth data, and sending the encrypted depth data to the trusted application. 6. The encryption processing method according to claim 5, wherein said adopting a pre-stored target speckle pattern to encrypt said depth data to obtain encrypted depth data comprises: Taking the value of each pixel in the target speckle pattern as the value of the corresponding element in the one-dimensional sequence; The one-dimensional sequence is used as a key to encrypt the depth data to obtain encrypted depth data. 7. The encryption processing method according to claim 6, wherein said taking the value of each pixel in the target speckle pattern as the value of the corresponding element in the one-dimensional sequence comprises: Generate a two-dimensional matrix according to the value of each pixel in the target speckle pattern; Taking rows or columns as units, the elements in the two-dimensional matrix are sequentially spliced in a preset order to obtain a one-dimensional sequence. 8. The decryption processing method according to any one of claims 5-7, wherein, before encrypting the depth data by using the pre-stored target speckle pattern, further comprising: The diffractive optical element of the structured light sensor is calibrated to obtain the target speckle pattern. 9. A decryption processing device, characterized in that the device has a trusted execution environment, and the device comprises: A control module, configured to control the structured light sensor to perform imaging through the dedicated hardware of the trusted execution environment; An acquisition module, configured to acquire encrypted depth data from the dedicated hardware; the depth data is obtained by imaging the structured light sensor; The decryption module is configured to decrypt the encrypted depth data according to the prestored target speckle pattern to obtain the depth data. 10. A microprocessor, characterized in that, the microprocessor is dedicated hardware for a trusted execution environment, and the microprocessor comprises: A control module, configured to control the structured light sensor to perform imaging when the trusted application running under the trusted execution environment instructs the structured light sensor to perform imaging, and acquire depth data obtained by imaging the structured light sensor; An encryption module, configured to encrypt the depth data by using a pre-stored target speckle pattern to obtain encrypted depth data, and send the encrypted depth data to the trusted application. 11. A mobile terminal, characterized in that it comprises: a structured light sensor, a memory, a micro-processing chip MCU, a processor, and a trusted application; The MCU is dedicated hardware of the trusted execution environment, connected to the structured light sensor and the processor, and used to execute the encryption processing method described in any one of claims 5-8; When the processor executes the trusted application program, the decryption processing method according to any one of claims 1-4 is implemented. 12. The mobile terminal according to claim 11, further comprising: an infrared sensor and a visible light sensor; Wherein, the infrared sensor includes a laser camera and a floodlight; The structured light sensor includes: a laser lamp, and a laser camera shared with the infrared sensor; The visible light sensor includes: a visible light camera. 13. The mobile terminal according to claim 12, wherein the MCU comprises: a pulse width modulation PWM, a depth engine, a bus interface, and a random access memory RAM; The PWM is used to modulate the floodlight to emit infrared light, and modulate the laser light to emit structured light; The laser camera is used to collect the structured light image of the imaging object; The depth engine is configured to calculate and obtain depth data corresponding to the imaging object according to the structured light image; and The bus interface is configured to send the depth data to the processor, and a trusted application running on the processor uses the depth data to perform corresponding operations. 14. A computer-readable storage medium, on which a computer program is stored, characterized in that, when the program is executed by a processor, the decryption processing method according to any one of claims 1-4 is realized, or the decryption processing method according to any one of claims 1-4 is realized, or the The encryption processing method described in any one of 5-8 is required.