CN111915686B

CN111915686B - Calibration method and device and temperature measurement face recognition device

Info

Publication number: CN111915686B
Application number: CN202010985286.9A
Authority: CN
Inventors: 马骏生
Original assignee: Shenzhen Sensetime Technology Co Ltd
Current assignee: Shenzhen Sensetime Technology Co Ltd
Priority date: 2020-09-18
Filing date: 2020-09-18
Publication date: 2022-07-26
Anticipated expiration: 2040-09-18
Also published as: KR20220120660A; TWI773452B; TW202213176A; WO2022057327A1; CN111915686A

Abstract

The disclosure relates to a calibration method and device and a temperature measurement face recognition device, wherein the method comprises the following steps: in a calibration mode, acquiring a thermal infrared image and a color image corresponding to a calibration reference object at a calibration position, wherein a human face image is arranged on the calibration reference object, and a heating body is arranged at a preset position of the human face image; determining the coordinate of the highest temperature point corresponding to the thermal infrared image; determining coordinates corresponding to the preset positions of the face images in the color images; and establishing a calibration relation between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image according to the coordinate corresponding to the preset position of the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image. The embodiment of the disclosure can improve the calibration efficiency.

Description

Calibration method and device and temperature measurement face recognition device

Technical Field

The disclosure relates to the technical field of computers, in particular to a calibration method and device and a temperature measurement face recognition device.

Background

The dual-photothermal imager has two functions of color imaging (RGB (Red, Green, Blue) imaging) and thermal infrared imaging. Color imaging is used to identify objects or people and thermal infrared imaging is used to determine object or human temperature.

Because the camera of color formation of image and the camera of thermal infrared formation of image install in different coordinate positions, and every camera still has manufacturing and assembly error, cause the unable one-to-one correspondence of image that two cameras shot. Therefore, the calibration of color imaging and thermal infrared imaging for the dual-photothermal imager is required.

Disclosure of Invention

The present disclosure provides a technical solution for calibrating a temperature measuring device.

According to an aspect of the present disclosure, there is provided a calibration method, including:

in a calibration mode, acquiring a thermal infrared image and a color image corresponding to a calibration reference object at a calibration position, wherein a human face image is arranged on the calibration reference object, and a heating body is arranged at a preset position of the human face image;

determining the coordinate of the highest temperature point corresponding to the thermal infrared image;

determining coordinates corresponding to the preset position of the face image in the color image;

and establishing a calibration relation between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image according to the coordinate corresponding to the preset position of the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image.

In a possible implementation manner, the calibration positions are multiple, and for any one of the multiple calibration positions, the face image in the color image acquired by the calibration position fills up the display area corresponding to the position in the color image,

and a plurality of display areas corresponding to the plurality of calibration positions form the color image.

In a possible implementation manner, the determining coordinates corresponding to a preset position of the face image in the color image includes:

extracting the face features of the color images to obtain the face features of the color images;

and determining a preset position of the face image according to the face features to obtain a coordinate corresponding to the preset position.

In one possible implementation, the method further includes:

collecting a color image and a thermal infrared image corresponding to a target object;

performing living body detection on the color image corresponding to the target object; and starting a calibration mode under the condition that the color image corresponding to the target object does not pass the living body detection and the face image in the color image corresponding to the target object is matched with the face image corresponding to the pre-stored calibration reference object.

In one possible implementation, the method further includes:

determining the coordinates of a preset part of the target object according to the human face characteristics in the color image under the condition that the human face image in the color image corresponding to the target object is not matched with the human face image corresponding to a pre-stored calibration reference object and/or the color image corresponding to the target object is detected by a living body;

determining a coordinate corresponding to a preset part in a thermal infrared image corresponding to the target object according to the coordinate of the preset part of the target object and the calibration relation;

and determining the temperature of the target object from the thermal infrared image corresponding to the target object according to the coordinates corresponding to the preset part in the thermal infrared image corresponding to the target object.

In a possible implementation manner, the distance between the calibration position of the calibration reference object and the image acquisition device is within a preset distance interval, the calibration relation is a relation corresponding to the preset distance interval,

the determining the coordinate corresponding to the preset part in the thermal infrared image corresponding to the target object according to the coordinate of the preset part of the target object and the calibration relation comprises:

determining a calibration relation corresponding to a distance interval where the distance is located according to the distance between the target object and the image acquisition equipment;

and determining the coordinate corresponding to the preset part in the thermal infrared image corresponding to the target object according to the calibration relation corresponding to the distance interval and the coordinate of the preset part of the target object.

According to an aspect of the present disclosure, there is provided a temperature measurement face recognition device, including: a temperature measuring device and a calibration reference object,

the calibration reference object is used for calibrating the temperature measuring equipment, and comprises: the heating element is arranged at a preset position of the face image;

the temperature measuring device is used for acquiring a color image and a thermal infrared image corresponding to a target object, calibrating through the calibration reference object to obtain a calibration relation of coordinates of the highest temperature point of the color image and the thermal infrared image, and determining the temperature of the target object according to the acquired color image, the thermal infrared image and the calibration relation.

In one possible implementation manner, the temperature measuring device comprises a thermal infrared image acquisition module, a color image acquisition module, a face recognition module and a temperature determination module,

the thermal infrared image acquisition module is used for acquiring a thermal infrared image corresponding to a target object;

the color image acquisition module is used for acquiring a color image corresponding to the target object;

the face recognition module is used for carrying out face recognition on the color image to obtain the coordinates of the preset position of the target object;

the temperature determining module is used for determining the temperature of the target object from the thermal infrared image according to the coordinates of the preset position of the target object and the calibration relation.

In a possible implementation manner, the temperature measurement device starts a calibration mode when the face recognition module determines that the color image is not subjected to living body detection and determines that a face image in the color image is matched with a face image corresponding to a calibration reference object;

in a calibration mode, the temperature measuring device collects a thermal infrared image corresponding to a calibration reference object at a calibration position through the thermal infrared image collection module, collects a color image corresponding to the calibration reference object at the calibration position through the color image collection module, and establishes a calibration relation between a coordinate of a highest temperature point of the thermal infrared image and a coordinate of a preset position of the color image according to a coordinate of the highest temperature point in the thermal infrared image corresponding to the calibration reference object and a coordinate of the preset position of the color image corresponding to the calibration reference object.

According to an aspect of the present disclosure, there is provided a calibration apparatus including:

the system comprises a first acquisition module, a second acquisition module and a control module, wherein the first acquisition module is used for acquiring a thermal infrared image and a color image of a calibration reference object corresponding to a calibration position in a calibration mode, the calibration reference object is provided with a face image, and a heating element is arranged at a preset position of the face image;

the first determining module is used for determining the coordinate of the highest temperature point corresponding to the thermal infrared image;

the second determining module is used for determining a coordinate corresponding to a preset position of the face image in the color image;

and the calibration module is used for establishing a calibration relation between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image according to the coordinate corresponding to the preset position of the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image.

and a plurality of display areas corresponding to the calibration positions form the color image.

In a possible implementation manner, the second determining module is further configured to:

extracting the face features of the color image to obtain the face features of the color image;

In one possible implementation, the apparatus further includes:

the second acquisition module is used for acquiring a color image and a thermal infrared image corresponding to the target object;

the detection module is used for carrying out living body detection on the color image corresponding to the target object;

and the processing module is used for starting a calibration mode under the condition that the color image corresponding to the target object does not pass through the living body detection and the face image in the color image corresponding to the target object is matched with the face image corresponding to the pre-stored calibration reference object.

In one possible implementation, the apparatus further includes:

the third determining module is used for determining the coordinates of the preset part of the target object according to the human face characteristics in the color image under the condition that the human face image in the color image corresponding to the target object is not matched with the human face image corresponding to the pre-stored calibration reference object and/or the color image corresponding to the target object passes through living body detection;

the fourth determining module is used for determining the coordinate corresponding to the preset part in the thermal infrared image corresponding to the target object according to the coordinate of the preset part of the target object and the calibration relation;

a fifth determining module, configured to determine, according to the coordinate corresponding to the preset portion in the thermal infrared image corresponding to the target object, the temperature of the target object from the thermal infrared image corresponding to the target object.

In a possible implementation manner, the distance between the calibration position of the calibration reference object and the image acquisition device is within a preset distance interval, the calibration relationship is a relationship corresponding to the preset distance interval, and the fourth determining module is further configured to:

and determining the coordinates corresponding to the preset part in the thermal infrared image corresponding to the target object according to the calibration relation corresponding to the distance interval and the coordinates of the preset part of the target object.

According to an aspect of the present disclosure, there is provided an electronic device including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the memory-stored instructions to perform the above-described method.

According to an aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the above-described method.

In the embodiment of the disclosure, in the calibration mode, a thermal infrared image and a color image corresponding to a calibration position of a calibration reference object are collected, a face image is arranged on the calibration reference object, and a heating element is arranged at a preset position of the face image. And determining the coordinate of the highest temperature point corresponding to the thermal infrared image and determining the coordinate corresponding to the preset position of the face image in the color image. And establishing a calibration relation between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image according to the coordinate corresponding to the preset position of the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image. According to the calibration method and device and the temperature measurement face recognition device provided by the embodiment of the disclosure, the calibration operation is performed by calibrating the reference object, so that the calibration cost can be reduced, manual coordinate calibration is avoided, and the calibration efficiency can be improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.

FIG. 1 shows a flow chart of a calibration method according to an embodiment of the disclosure;

FIG. 2 illustrates a flow chart of a calibration method according to an embodiment of the present disclosure;

FIG. 3 shows a flow chart of a calibration method according to an embodiment of the disclosure;

FIG. 4 shows a flow chart of a calibration method according to an embodiment of the present disclosure;

FIG. 5 shows a flow chart of a calibration method according to an embodiment of the present disclosure;

FIG. 6 shows a schematic view of a calibration reference according to an embodiment of the disclosure;

FIG. 7 shows a schematic view of a calibration reference according to an embodiment of the disclosure;

FIG. 8 shows a block diagram of a calibration arrangement according to an embodiment of the disclosure;

FIG. 9 shows a block diagram of an electronic device 900 in accordance with an embodiment of the disclosure;

fig. 10 shows a block diagram of an electronic device 1900 according to an embodiment of the disclosure.

Detailed Description

Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

The term "and/or" herein is merely an association relationship describing an associated object, and means that there may be three relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.

Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the subject matter of the present disclosure.

In the related technology, calibration is carried out by placing a black body at a fixed position, the black body is imaged in a thermal imager, and the coordinate of the corresponding highest temperature point in the thermal infrared image is found through manual or program automatic scanning. The recording of the coordinate position in the color image is carried out manually and the two coordinates are taken as a set of calibration data. Similarly, the black body is moved to other different distances and positions, the processes are repeated, the corresponding relation of the coordinate points of the thermal infrared image and the color image at different positions is obtained, and then multiple groups of calibration data are obtained. According to the multiple groups of calibration data, the corresponding relation between the color image and the thermal infrared image can be generated, and the calibration process is completed.

The calibration process needs black body equipment which is high-value fixed asset, so that the calibration cost is high, common users are difficult to perform calibration operation, the calibration operation can only be performed in the factory production stage, and the problem of field calibration cannot be solved when mechanical deformation occurs in the use process to cause calibration deviation. Moreover, the calibration process needs manual participation, and the calibration efficiency is low.

Fig. 1 shows a flowchart of a calibration method according to an embodiment of the present disclosure, which may be performed by an electronic device such as a terminal device or a server, where the terminal device may be a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, an in-vehicle device, a wearable device, or the like, and the method may be implemented by a processor calling a computer readable instruction stored in a memory. Alternatively, the method may be performed by a server.

As shown in fig. 1, the calibration method includes:

in step S11, in the calibration mode, a thermal infrared image and a color image corresponding to a calibration position of a calibration reference object are collected, the calibration reference object is provided with a human face image, and a heating element is arranged at a preset position of the human face image.

For example, the above calibration mode is a mode for performing a calibration operation between a thermal infrared image and a color image. In the calibration mode, the thermal infrared image and the color image corresponding to the calibration reference object at the calibration position may be acquired by an image acquisition device, wherein the image acquisition device may include an image acquisition device for acquiring the thermal infrared image and an image acquisition device for acquiring the color image (e.g., color model images such as RGB, CMYK (Cyan, Magenta, Yellow, black), HSB (hue, saturation, brightness), and the like).

The embodiment of the disclosure can be realized by terminal equipment and also can be realized by a background server, the disclosure does not limit the above, and when the embodiment is realized by the terminal equipment, the image acquisition device can be the terminal equipment itself or an image acquisition device externally connected with the terminal equipment; when the image acquisition device is implemented through the background server, the image acquisition device can be a terminal device (or an image acquisition device externally connected with the terminal device) which performs data interaction with the background server.

The calibration reference object may be a card in which a face image is disposed on the housing and a heating element is disposed at a preset position of the face image (for example, when the temperature is generally measured, the temperature of the forehead is measured, so that the heating element may be disposed at the forehead of the face image). The calibration reference object can be placed at one calibration position, or can be sequentially placed at a plurality of different calibration positions (the position of the image acquisition device is unchanged), and after the heating body of the calibration reference object heats, the thermal infrared image and the color image corresponding to the calibration reference object at the calibration position are acquired.

For example: the image acquisition device may be a device having a display device, or the image acquisition apparatus may be externally connected to a display device, the display device is configured to display a color image, the color image may be divided into nine display regions (for example, set to a nine-grid display mode) on the display device, and thermal infrared images and color images corresponding to the calibration reference object at nine different calibration positions may be acquired, wherein when the calibration reference object is at any one of the calibration positions, the calibration reference object may be displayed in one of the nine-grid.

In step S12, the coordinates of the highest temperature point corresponding to the thermal infrared image are determined.

For example, the pixel value of any pixel point in the thermal infrared image may be used to represent the temperature corresponding to the pixel point, and the pixel point corresponding to the maximum value in the thermal infrared image may be determined as the highest temperature point. Theoretically, the highest temperature point in the thermal infrared image is the preset position of the heating element arranged in the face image, so that the coordinate corresponding to the highest temperature point can be determined, and the coordinate corresponding to the highest temperature point is the coordinate of the preset position in the face image.

In step S13, the coordinates corresponding to the preset position of the face image in the color image are determined.

For example, the preset position corresponds to a preset portion, the preset portion of the face image can be identified through a face recognition algorithm, and then the coordinate corresponding to the preset portion is determined to be the coordinate corresponding to the preset position of the face image. For example: if the preset part is the forehead, the forehead of the face image can be identified through a face identification algorithm, and the corresponding coordinates of the forehead in the color image are determined.

In step S14, a calibration relationship between the coordinate of the highest temperature point in the thermal infrared image and the coordinate of the preset position in the color image is established according to the coordinate corresponding to the preset position in the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image.

For example, after obtaining the coordinate of the highest temperature point in the thermal infrared image corresponding to the calibration position and the coordinate of the preset position of the face image in the color image corresponding to the calibration position, the two coordinates may be used as a calibration data to obtain the calibration relationship between the coordinate of the highest temperature point in the thermal infrared image and the coordinate of the preset position of the color image, or when there are a plurality of calibration positions, the same may be said to obtain a plurality of calibration data corresponding to a plurality of calibration positions, and then the calibration relationship between the coordinate of the highest temperature point in the thermal infrared image and the coordinate of the preset position of the color image is established through the plurality of calibration data.

For example, the calibration data may be directly used as a calibration relationship, or a fitting function may be established according to the calibration data, where the fitting function is a calibration relationship between a coordinate of a highest temperature point of the thermal infrared image and a coordinate of a preset position of the color image, and this is not specifically limited in this embodiment of the disclosure.

For example, after obtaining the calibration relationship between the coordinates of the highest temperature point of the thermal infrared image and the coordinates of the preset position of the color image, the calibration relationship may be stored (when the historical calibration relationship is stored, the historical calibration relationship may be deleted, and the calibration relationship may be stored), and the calibration mode may be exited. After the thermal infrared image and the color image are collected for the target object, the thermal infrared image and the color image can be calibrated according to the calibration relation so as to complete the temperature measurement for the target object.

In this way, in the calibration mode, a thermal infrared image and a color image corresponding to the calibration position of the calibration reference object are collected, the calibration reference object is provided with a face image, and a heating element is arranged at the preset position of the face image. And determining the coordinate of the highest temperature point corresponding to the thermal infrared image and determining the coordinate corresponding to the preset position of the face image in the color image. And establishing a calibration relation between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image according to the coordinate corresponding to the preset position of the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image. According to the calibration method provided by the embodiment of the disclosure, the calibration operation is performed through the calibration reference object, so that the calibration cost can be reduced, manual coordinate calibration is avoided, and the calibration efficiency can be improved.

In a possible implementation manner, the calibration positions may be multiple, and for any one of the multiple calibration positions, the face image in the color image acquired by the calibration position fills the display area corresponding to the position in the color image, and the multiple display areas corresponding to the multiple calibration positions form the color image.

For example, the color image may be divided into a plurality of display regions (e.g., squared cases, sixteen squared cases, etc.), the plurality of display regions correspond to a plurality of calibration positions, that is, each calibration position corresponds to one display region, the calibration reference object is located in the color image acquired at any one of the calibration positions, and the face image fills the display region corresponding to the calibration position. For example: when the Sudoku is used for displaying (including the case 1 and the case 2 … …) the face image of the calibration reference object in the color image 1 collected at the calibration position 1 fills the case 1, the face image of the calibration reference object in the color image 2 collected at the calibration position 2 fills the case 2, … …, and the face image of the calibration reference object in the color image collected at the calibration position 9 fills the case 9.

It should be noted that the squared figure is only an example of the multiple display areas in the embodiment of the present disclosure, and is not a limitation, and actually, the multiple display areas may adopt any pattern, for example: sixteen lattices, twenty-four lattices and the like can be adopted, and the embodiment of the disclosure is not limited thereto.

Therefore, when the temperature is measured, the distance between the measured object and the image acquisition device is specified, and basically, the area occupied by the face image acquired within the specified distance is the size of the display area, so that the calibration relation obtained by adopting the embodiment of the disclosure is more accurate, more accurate coordinates of the measured area are obtained when the calibration relation is adopted to measure the human body temperature, and the measured human body temperature is more accurate.

In a possible implementation manner, referring to fig. 2, in step S13, the determining coordinates corresponding to the preset position of the face image in the color image may include:

step S131, extracting the face characteristics of the color image to obtain the face characteristics of the color image.

For example, the face feature extraction may be performed on the color image through a face feature point detection algorithm to obtain the face feature of the face image in the color image, for example: eye, mouth, nose, and forehead, among others.

Step S132, determining a preset position of the face image according to the face features, and obtaining coordinates corresponding to the preset position.

For example, the predetermined portion of the face image may be determined by face features, such as: the preset position is the forehead, and after face recognition is carried out through the face features, the position corresponding to the forehead in the face image can be determined, the position can be determined as the preset position of the face image, and then the coordinate information corresponding to the preset position in the color image is obtained.

Therefore, the coordinates in the color image can be calibrated through the face recognition algorithm, manual calibration of the coordinates is avoided, calibration efficiency and precision can be improved, and labor cost can be reduced.

In one possible implementation, referring to fig. 3, the method may further include:

in step S15, a color image and a thermal infrared image corresponding to the target object are acquired.

For example, when a target object is recognized (for example, a human face image is recognized), image acquisition may be performed on the target object, for example: the method comprises the steps of collecting a thermal infrared image corresponding to a target object through a thermal infrared image collecting device, and collecting a color image corresponding to the target object through a color image collecting device.

In step S16, the living body detection is performed on the color image corresponding to the target object.

For example, the face recognition usually has a living body recognition capability, and the face image on the calibration reference object does not have a living body feature, and when the living body feature is detected in the color image corresponding to the target object, it is determined that the color image corresponding to the target object passes through the living body detection, whereas when the living body feature is not detected in the color image corresponding to the target object, it is determined that the color image corresponding to the target object does not pass through the living body detection. Therefore, whether the calibration mode is started or not can be determined by judging whether the color image corresponding to the target object passes through living body detection or not, and the calibration mode is prevented from being triggered by a normal human face with the similar human face characteristics.

In step S17, if the color image corresponding to the target object does not pass live body detection and the face image in the color image corresponding to the target object matches the face image corresponding to the pre-stored calibration reference object, the calibration mode is turned on.

For example, the face image and/or the first face feature of the face image corresponding to the calibration reference object may be extracted and stored in advance. After the color image corresponding to the target object is acquired, extracting a second face feature in the color image corresponding to the target object, comparing the second face feature with a pre-stored first face feature (or extracting a first face feature of the face image corresponding to the calibration reference object), determining the face image in the color image corresponding to the target object to be matched with the pre-stored face image corresponding to the calibration reference object under the condition that the first face feature is matched with the second face feature (for example, the similarity meets a threshold value which is a preset numerical value), and when the color image corresponding to the target object does not pass through a living body detection, determining that the target object is the calibration reference object, and starting the calibration mode.

On the contrary, when a high-temperature object exists in the thermal infrared image within a certain range and the color image corresponding to the target object passes through the living body detection, if the face image in the color image corresponding to the target object is matched with the face image corresponding to the pre-stored calibration reference object, the calibration mode is not started, so that the accuracy of starting the calibration mode can be improved, and the problems of misoperation and the like are prevented.

It should be noted that the calibration mode may also be started through a control, a voice instruction control, and the like, for example: displaying a control for starting a calibration mode on a display interface, triggering the control by a user through clicking, long-time pressing, touching and the like, and starting the calibration mode by the terminal equipment in response to the triggering of the control; or the user may input a voice instruction for starting the calibration mode (for example, inputting a voice instruction of "start calibration mode"), and the terminal device starts the calibration mode in response to the voice instruction.

In one possible implementation, referring to fig. 4, the method may further include:

in step S18, when the face image in the color image corresponding to the target object does not match the face image corresponding to the pre-stored calibration reference object, and/or when the color image corresponding to the target object passes through live body detection, coordinates of the preset portion of the target object are determined according to the face features in the color image.

For example, when the first facial feature and the second facial feature are not matched (for example, the similarity does not satisfy the threshold), the facial image in the color image corresponding to the target object is determined to be not matched with the facial image corresponding to the pre-stored calibration reference object, and the calibration mode may not be started. Or, in a case that a color image corresponding to the target object is detected by a living body, it may be determined that the target object is not a calibration reference object, and a first facial feature may be extracted to perform face recognition, so as to recognize a preset portion of the target object in the color image, for example: the forehead of the target object in the color image is identified. After the predetermined location is identified, the coordinates of the predetermined location in the color image may be determined.

In step S19, according to the coordinates of the preset portion of the target object and the calibration relationship, the coordinates corresponding to the preset portion in the thermal infrared image corresponding to the target object are determined.

For example, after obtaining the coordinates of the preset portion in the color image, the coordinates corresponding to the preset portion in the thermal infrared image corresponding to the target object may be obtained by fitting according to the calibration relationship between the stored coordinates of the highest temperature point of the thermal infrared image and the coordinates of the preset position of the color image and the coordinates of the preset portion.

For example, when the calibration relationship between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image is a fitting function obtained through calibration data, the coordinate of the preset portion in the color image may be substituted into the fitting function for fitting, so as to obtain the coordinate corresponding to the preset portion in the thermal infrared image corresponding to the target object.

Or, when the calibration relationship between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image is multiple sets of calibration data, the coordinate in the color image corresponding to the target object may be determined from the multiple sets of calibration data, and the coordinate corresponding to the preset position in the thermal infrared image corresponding to the target object is determined according to the mean value of the difference values between the coordinates in the color image and the coordinates in the thermal infrared image in the k sets of calibration data.

For example: the mean of the differences between the coordinates in the color image and the coordinates in the thermal infrared image in the k sets of calibration data is: the abscissa a and the ordinate B may determine the coordinates (x + a, y + B) corresponding to the preset portion in the thermal infrared image corresponding to the target object after determining the coordinates (x, y) of the preset portion in the color image corresponding to the target object.

In step S20, the temperature of the target object is determined from the thermal infrared image corresponding to the target object according to the coordinates corresponding to the preset portion in the thermal infrared image corresponding to the target object.

For example, after obtaining the coordinates corresponding to the preset portion in the thermal infrared image corresponding to the target object, the pixel value of the pixel point corresponding to the coordinates in the thermal infrared image may be read, and the pixel value is determined as the temperature of the target object.

In a possible implementation manner, the determining, according to the coordinates of the preset portion of the target object and the calibration relationship, the coordinates corresponding to the preset portion in the thermal infrared image corresponding to the target object in step S19, where the determining includes:

in step S191, according to the distance between the target object and the image capturing apparatus, a corresponding relationship corresponding to the distance section where the distance is located is determined.

For example, in the calibration process, calibration relationships corresponding to different distance intervals may be determined according to the different distance intervals between the calibration reference object and the image acquisition device. For example: when the distance between the calibration reference object and the image acquisition device is within one meter (the distance interval 1 is (0, 1) meter), a thermal infrared image and a color image corresponding to the calibration position may be acquired in the distance interval 1 (for example: adopting a Sudoku display area to collect 9 color images and thermal infrared images corresponding to the 9 color images, to determine the calibration relation corresponding to the distance interval 1; when the distance between the calibration reference object and the image acquisition device is beyond one meter and within two meters (the distance interval 2 is (1, 2) meters), thermal infrared images and color images corresponding to a plurality of positions may be acquired in the distance zone 2 (for example: the farther the distance, the more divided the display area of the image, a sixteen-grid display area can be adopted to collect 16 color images and thermal infrared images corresponding to the 16 color images) so as to determine the calibration relation corresponding to the distance interval 2.

The distance between the target object and the image acquisition device can be determined according to the color image (for example, the distance between the target object and the image acquisition device is determined according to the color image by adopting a pre-trained neural network for measuring the distance), and then the distance section to which the distance belongs is determined, so that the calibration relation corresponding to the distance section is determined.

For example: if the target object is 2 meters away from the image acquisition device and belongs to the distance interval 2, the calibration relation between the coordinate of the highest temperature point of the corresponding thermal infrared image and the coordinate of the preset position of the color image can be determined to be the calibration relation corresponding to the distance interval 2.

In step S192, according to the calibration relationship corresponding to the distance interval and the coordinates of the preset portion of the target object, the coordinates corresponding to the preset portion in the thermal infrared image corresponding to the target object are determined.

For example, the coordinates corresponding to the preset portion in the thermal infrared image corresponding to the target object may be determined according to the determined calibration relationship and the coordinates of the preset portion of the target object (for a specific process, reference may be made to the foregoing embodiment, and details of the embodiment of the present disclosure are not repeated here).

Therefore, different distance intervals correspond to different calibration relations, the corresponding calibration relation can be determined adaptively according to the distance between the target object and the image acquisition device, and the measurement precision of the temperature of the target object can be improved.

In order that those skilled in the art will better understand the embodiments of the present disclosure, the embodiments of the present disclosure are described below by way of specific examples.

Illustratively, in the calibration operation process, it is avoided that no high-temperature object exists in the view angle of the image acquisition device in the environment, and after the operation terminal device enters the calibration mode, a 9-grid-style display area is displayed on the display screen, and a color image and the current environment highest temperature point are displayed.

After the calibration reference object is powered on, the calibration reference object is waited to be heated, the calibration reference object is placed in front of the image acquisition equipment, and at the moment, a face image corresponding to the calibration reference object and a highest temperature point corresponding to a heating body arranged at the forehead of the face image are arranged on the screen.

The user moves the calibration reference object to enable the size of the face and the calibration position to fill a corresponding display area (one grid) in the nine-square grid, immediately scans the current thermal infrared image, selects and records the coordinate of the highest temperature point, and completes the calibration of the calibration position; and carrying out face recognition on the current color image, recognizing the coordinate of the forehead position of the face image, and combining the coordinate of the highest temperature point in the thermal infrared image and the coordinate of the forehead position of the face image in the color image to form a group of calibration data.

According to the method and the process, the calibration reference object is moved, and the calibration of each calibration position is completed in sequence. In fact, calibration of each position may also be performed after image acquisition of a plurality of calibration positions is completed, which is not limited in the embodiment of the present disclosure.

It should be noted that the grid region in this example is a schematic, and may actually be a finer division, and may be calibrated for multiple times by adopting multiple different division granularities according to the difference between the distance from the target object to the image acquisition device and the field angle. For example, the distance is calibrated once at 1 m by adopting the nine-square grid, and the distance is calibrated by adopting the sixteen-square grid at a longer distance so as to adapt to different distances.

After calibration is complete, the calibration mode may be exited. For example, the calibration mode may be exited by a control, voice command control, or the like, for example: displaying a control for exiting the calibration mode on a display interface, triggering the control by a user through clicking, long pressing, touching and the like, and exiting the calibration mode by the terminal equipment in response to the triggering of the control; or the user may input a voice instruction for starting the calibration mode (for example, input a voice instruction of "exit the calibration mode"), and the terminal device exits the calibration mode in response to the voice instruction.

The embodiment of the present disclosure provides a temperature measurement face recognition device, the temperature measurement face recognition device includes: a temperature measuring device and a calibration reference,

the calibration reference may be used to calibrate the temperature measurement device, and may include: the heating element is arranged at a preset position of the face image;

the temperature measuring device can be used for acquiring a color image and a thermal infrared image corresponding to a target object, calibrating through the calibration reference object to obtain a calibration relation between a coordinate of a preset position of the color image and a coordinate of a highest temperature point of the thermal infrared image, and determining the temperature of the target object according to the acquired color image, the thermal infrared image and the calibration relation.

For example, referring to fig. 6 and 7, the calibration reference object may include a heating element 61 and a case 62 provided with a face image. For example, the housing 62 may be a real-size human face image card made of paper or plastic. The heat-generating body 61 may be adhered to or embedded in a predetermined position of the face image in the case 62, for example, at the forehead. An exemplary heating element is a heating element with a diameter of 2-3 cm, the surface of the heating element can be made of rubber or plastic, and the heating element can be heated to 20-25 ℃ higher than the ambient temperature.

The calibration reference object can also comprise a cable 63 and a power supply device 64, and the power supply device 64 can supply power to the heating body 61 through the cable 63. Illustratively, the power supply 64 may be located on the back of the face card (the power supply 64 may be a readily available power source such as an AA-type dry cell battery, or a power adapter, etc.).

After the power supply device 64 supplies power to the heating element 61, the temperature measurement device may perform calibration operation by using a calibration reference object (the calibration process may refer to any one of the foregoing calibration method embodiments, which are not described herein again), so as to obtain a calibration relationship between the coordinates of the preset position of the color image and the coordinates of the highest temperature point of the thermal infrared image.

The temperature measuring device may collect a color image and a thermal infrared image of the target object, and determine the temperature of the target object according to the collected color image, the collected thermal infrared image, and the calibration relationship (for a specific process, reference may be made to the foregoing embodiment, and details of the embodiment of the present disclosure are not repeated here).

Therefore, the temperature measuring equipment is calibrated through the calibration reference object, and the calibration reference object is simple and cheap in structure and material, so that the calibration cost can be reduced, manual coordinate calibration is avoided, the calibration efficiency can be improved, and the temperature measurement precision can be improved.

In one possible recognition mode, the temperature measuring device comprises a thermal infrared image acquisition module, a color image acquisition module, a face recognition module and a temperature determination module,

the thermal infrared image acquisition module can be used for acquiring a thermal infrared image corresponding to a target object; the color image acquisition module can be used for acquiring a color image corresponding to the target object; the face recognition module can be used for carrying out face recognition on the color image to obtain the coordinates of the preset position of the target object; the temperature determination module may be configured to determine the temperature of the target object from the thermal infrared image according to the coordinates of the preset position of the target object and the calibration relationship.

For example, the temperature measuring device may collect a thermal infrared image corresponding to the target object through the thermal infrared image collecting module, and collect a color image corresponding to the target object through the color image collecting module. The temperature measuring equipment can perform face recognition on the color image through the face recognition module, recognize the preset part of the target object in the color image, and obtain the coordinates of the preset position corresponding to the preset part in the color image. The temperature determining module may determine the coordinates of the preset position in the thermal infrared image according to the coordinates of the preset position in the color image and the calibration relationship (the specific process may refer to the foregoing embodiment), and determine the pixel value corresponding to the coordinates of the preset position in the thermal infrared image as the temperature of the target object.

in a calibration mode, the temperature measuring device collects a thermal infrared image corresponding to a calibration reference object at a calibration position through the thermal infrared image collecting module, collects a color image corresponding to a target object at the calibration position through the color image collecting module, and establishes a calibration relation between a coordinate of a highest temperature point of the thermal infrared image and a coordinate of a preset position of the color image according to a coordinate of the highest temperature point in the thermal infrared image corresponding to the calibration reference object and a coordinate of the preset position of the color image corresponding to the calibration reference object.

For example, in the calibration mode, the temperature measurement device may perform calibration operation according to a calibration reference object to obtain a calibration relationship between a coordinate of a highest temperature point of the thermal infrared image and a coordinate of a preset position of the color image (the specific calibration process and the start of the calibration mode may refer to the foregoing embodiment of the calibration method, which is not described herein again in this disclosure), and then in the non-calibration mode, may perform temperature measurement on the target object according to the calibration relationship between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image obtained by calibration.

It is understood that the above-mentioned method embodiments of the present disclosure can be combined with each other to form a combined embodiment without departing from the logic of the principle, which is limited by the space, and the detailed description of the present disclosure is omitted. Those skilled in the art will appreciate that in the above methods of the specific embodiments, the specific order of execution of the steps should be determined by their function and possibly their inherent logic.

In addition, the present disclosure also provides a calibration apparatus, an electronic device, a computer-readable storage medium, and a program, which can be used to implement any one of the calibration methods provided by the present disclosure, and the corresponding technical solutions and descriptions and corresponding descriptions of the method portions are not repeated.

Fig. 8 shows a block diagram of a calibration arrangement according to an embodiment of the disclosure, as shown in fig. 8, the arrangement comprising:

the first acquisition module 81 can be used for acquiring a thermal infrared image and a color image of a calibration reference object corresponding to a calibration position in a calibration mode, wherein a human face image is arranged on the calibration reference object, and a heating element is arranged at a preset position of the human face image;

a first determining module 82, configured to determine coordinates of a highest temperature point corresponding to the thermal infrared image;

the second determining module 83 may be configured to determine a coordinate corresponding to a preset position of the face image in the color image;

the calibration module 84 may establish a calibration relationship between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image according to the coordinate corresponding to the preset position of the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image.

In this way, in the calibration mode, a thermal infrared image and a color image corresponding to the calibration position of the calibration reference object are collected, the calibration reference object is provided with a face image, and a heating element is arranged at the preset position of the face image. And determining the coordinate of the highest temperature point corresponding to the thermal infrared image and determining the coordinate corresponding to the preset position of the face image in the color image. And establishing a calibration relation between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image according to the coordinate corresponding to the preset position of the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image. According to the calibration method and device and the temperature measurement face recognition device provided by the embodiment of the disclosure, the calibration operation is performed by calibrating the reference object, so that the calibration cost can be reduced, manual coordinate calibration is avoided, and the calibration efficiency can be improved.

In a possible implementation manner, the calibration position may be multiple, and for any one of the multiple calibration positions, the face image in the color image acquired by the calibration position fills up the display area corresponding to the position in the color image,

In a possible implementation manner, the second determining module 83 may be further configured to:

In one possible implementation manner, the apparatus may further include:

the second acquisition module can be used for acquiring a color image and a thermal infrared image corresponding to the target object;

the detection module can be used for carrying out living body detection on the color image corresponding to the target object;

the processing module can be used for starting a calibration mode under the condition that the color image corresponding to the target object does not pass through living body detection and the face image in the color image corresponding to the target object is matched with the face image corresponding to the pre-stored calibration reference object.

In one possible implementation manner, the apparatus may further include:

the third determining module can be used for determining the coordinates of the preset part of the target object according to the facial features in the color image under the condition that the facial image in the color image corresponding to the target object is not matched with the facial image corresponding to the pre-stored calibration reference object and/or the color image corresponding to the target object is detected by a living body;

the fourth determining module may be configured to determine, according to the coordinate of the preset portion of the target object and the calibration relationship, a coordinate corresponding to the preset portion in the thermal infrared image corresponding to the target object;

the fifth determining module may be configured to determine the temperature of the target object from the thermal infrared image corresponding to the target object according to the coordinate corresponding to the preset portion in the thermal infrared image corresponding to the target object.

In a possible implementation manner, the distance between the calibration position of the calibration reference object and the image acquisition device is within a preset distance interval, the calibration relationship is a relationship corresponding to the preset distance interval, and the fourth determining module may be further configured to:

In some embodiments, functions of or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the method described in the above method embodiments, and for specific implementation, reference may be made to the description of the above method embodiments, and for brevity, details are not described here again.

Embodiments of the present disclosure also provide a computer-readable storage medium, on which computer program instructions are stored, and when executed by a processor, the computer program instructions implement the above method. The computer readable storage medium may be a non-volatile computer readable storage medium.

An embodiment of the present disclosure further provides an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the memory-stored instructions to perform the above-described method.

Embodiments of the present disclosure also provide a computer program product, which includes computer readable code, and when the computer readable code runs on a device, a processor in the device executes instructions for implementing the calibration method provided in any of the above embodiments.

The embodiments of the present disclosure also provide another computer program product for storing computer readable instructions, which when executed cause a computer to perform the operations of the calibration method provided in any of the above embodiments.

The electronic device may be provided as a terminal, server, or other form of device.

Fig. 9 illustrates a block diagram of an electronic device 900 in accordance with an embodiment of the disclosure. For example, the electronic device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, or the like terminal.

Referring to fig. 9, electronic device 900 may include one or more of the following components: processing component 902, memory 904, power component 906, multimedia component 908, audio component 910, input/output (I/O) interface 912, sensor component 914, and communication component 916.

The processing component 902 generally controls overall operation of the electronic device 900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing component 902 may include one or more processors 920 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 902 can include one or more modules that facilitate interaction between processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.

The memory 904 is configured to store various types of data to support operation at the electronic device 900. Examples of such data include instructions for any application or method operating on the electronic device 900, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 906 provides power to the various components of the electronic device 900. The power components 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 900.

The multimedia components 908 include a screen that provides an output interface between the electronic device 900 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 900 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 910 is configured to output and/or input audio signals. For example, the audio component 910 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 900 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 904 or transmitted via the communication component 916. In some embodiments, audio component 910 further includes a speaker for outputting audio signals.

The I/O interface 912 provides an interface between the processing component 902 and a peripheral interface module, which may be a keyboard, click wheel, button, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor component 914 includes one or more sensors for providing status evaluations of various aspects of the electronic device 900. For example, sensor assembly 914 may detect an open/closed state of electronic device 900, the relative positioning of components, such as a display and keypad of electronic device 900, sensor assembly 914 may also detect a change in the position of electronic device 900 or a component of electronic device 900, the presence or absence of user contact with electronic device 800, orientation or acceleration/deceleration of electronic device 900, and a change in the temperature of electronic device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 914 may also include a light sensor, such as a Complementary Metal Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 916 is configured to facilitate communications between the electronic device 900 and other devices in a wired or wireless manner. The electronic device 900 may access a wireless network based on a communication standard, such as a wireless network (WiFi), a second generation mobile communication technology (2G) or a third generation mobile communication technology (3G), or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium, such as the memory 904, is also provided, including computer program instructions executable by the processor 920 of the electronic device 900 to perform the above-described methods.

Fig. 10 shows a block diagram of an electronic device 1900 according to an embodiment of the disclosure. For example, the electronic device 1900 may be provided as a server. Referring to fig. 10, electronic device 1900 includes a processing component 1922 further including one or more processors and memory resources, represented by memory 1932, for storing instructions, e.g., applications, executable by processing component 1922. The application programs stored in memory 1932 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1922 is configured to execute instructions to perform the methods described above.

The electronic device 1900 may also include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input/output (I/O) interface 1958. The electronic device 1900 may operate based on an operating system, such as a Microsoft Server operating system (Windows Server), stored in the memory 1932 ^TM ) Apple Inc. of a graphical user interface based operating system (Mac OS X) ^TM ) Multi-user, multi-process computer operating system (Unix) ^TM ) Free and open native code Unix-like operating System (Linux) ^TM ) Open native code Unix-like operating System (FreeBSD) ^TM ) Or the like.

In an exemplary embodiment, a non-transitory computer readable storage medium, such as the memory 1932, is also provided that includes computer program instructions executable by the processing component 1922 of the electronic device 1900 to perform the above-described methods.

The present disclosure may be systems, methods, and/or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present disclosure.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be interpreted as a transitory signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or an electrical signal transmitted through an electrical wire.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

Computer program instructions for carrying out operations of the present disclosure may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry that can execute the computer-readable program instructions implements aspects of the present disclosure by utilizing the state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).

Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The computer program product may be embodied in hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.

Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A calibration method, characterized in that the method comprises:

in a calibration mode, acquiring a thermal infrared image and a color image corresponding to a calibration reference object at a calibration position, wherein a human face image is arranged on the calibration reference object, and a heating element is arranged at a preset position of the human face image;

determining the coordinate of a highest temperature point corresponding to the thermal infrared image, wherein the coordinate of the highest temperature point is used for indicating the coordinate corresponding to the preset position of the face image in the thermal infrared image;

according to the coordinate corresponding to the preset position of the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image, establishing a calibration relation between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image;

the determining the coordinates corresponding to the preset position of the face image in the color image comprises:

2. The method according to claim 1, wherein the calibration position is plural, and for any calibration position in the plural calibration positions, the face image in the color image collected by the calibration position fills up the display area corresponding to the position in the color image,

3. The method of claim 1, further comprising:

4. The method of claim 3, further comprising:

determining the coordinates of a preset part of the target object according to the face features in the color image under the condition that the face image in the color image corresponding to the target object is not matched with the face image corresponding to a pre-stored calibration reference object and/or the color image corresponding to the target object is detected by a living body;

determining the coordinate corresponding to the preset part in the thermal infrared image corresponding to the target object according to the coordinate of the preset part of the target object and the calibration relation;

5. The method according to claim 4, wherein the distance between the calibration position of the calibration reference object and the image acquisition device is within a preset distance interval, the calibration relation is a relation corresponding to the preset distance interval,

6. A temperature measurement face recognition device, characterized in that includes: a temperature measuring device, a calibration reference object and a face recognition module,

the calibration reference object is used for calibrating the temperature measuring equipment, and comprises: the heating element is arranged at a preset position of the human face image;

the temperature measuring device is used for acquiring a color image and a thermal infrared image corresponding to a target object, calibrating through the calibration reference object to obtain a calibration relation of coordinates of a highest temperature point of the color image and the thermal infrared image, and then determining the temperature of the target object according to the acquired color image, the thermal infrared image and the calibration relation, wherein the coordinates of the highest temperature point are used for indicating the coordinates corresponding to a preset position of the face image in the thermal infrared image;

and the face recognition module is used for carrying out face recognition on the color image to obtain the coordinates of the preset position of the target object.

7. The thermometric face recognition device according to claim 6, wherein the temperature measuring apparatus comprises a thermal infrared image acquisition module, a color image acquisition module and a temperature determination module,

8. The temperature measurement face recognition device according to claim 7, wherein the temperature measurement device starts a calibration mode when the face recognition module determines that the color image has not been subjected to living body detection and determines that the face image in the color image matches the face image corresponding to the calibration reference;

9. A calibration device, comprising:

the system comprises a first acquisition module, a second acquisition module and a control module, wherein the first acquisition module is used for acquiring a thermal infrared image and a color image corresponding to a calibration reference object at a calibration position in a calibration mode, the calibration reference object is provided with a face image, and a heating body is arranged at a preset position of the face image;

the first determining module is used for determining a coordinate of a highest temperature point corresponding to the thermal infrared image, and the coordinate of the highest temperature point is used for indicating a coordinate corresponding to a preset position of the face image in the thermal infrared image;

the second determining module is used for determining coordinates corresponding to the preset position of the face image in the color image;

the calibration module is used for establishing a calibration relation between the coordinate of the highest temperature point of the thermal infrared image and the coordinate of the preset position of the color image according to the coordinate corresponding to the preset position of the face image in the color image and the coordinate of the highest temperature point in the thermal infrared image;

the determining the coordinates corresponding to the preset position of the face image in the color image includes:

10. An electronic device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to invoke the memory-stored instructions to perform the method of any one of claims 1 to 5.

11. A computer readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1 to 5.