CN118963215A - A control method and device for a refrigerated infrared thermal imager - Google Patents
A control method and device for a refrigerated infrared thermal imager Download PDFInfo
- Publication number
- CN118963215A CN118963215A CN202411065401.5A CN202411065401A CN118963215A CN 118963215 A CN118963215 A CN 118963215A CN 202411065401 A CN202411065401 A CN 202411065401A CN 118963215 A CN118963215 A CN 118963215A
- Authority
- CN
- China
- Prior art keywords
- platform controller
- image
- infrared
- information
- thermal imager
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000004891 communication Methods 0.000 claims abstract description 48
- 238000001514 detection method Methods 0.000 claims abstract description 16
- 230000006870 function Effects 0.000 claims description 48
- 238000012937 correction Methods 0.000 claims description 26
- 230000005855 radiation Effects 0.000 claims description 13
- 238000006243 chemical reaction Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 9
- 238000012360 testing method Methods 0.000 claims description 9
- 230000002159 abnormal effect Effects 0.000 claims description 8
- 238000003702 image correction Methods 0.000 claims description 8
- 238000009529 body temperature measurement Methods 0.000 claims description 7
- 229920006395 saturated elastomer Polymers 0.000 claims description 6
- 238000013135 deep learning Methods 0.000 claims description 4
- 230000005856 abnormality Effects 0.000 claims description 3
- 230000009194 climbing Effects 0.000 claims description 3
- 238000010845 search algorithm Methods 0.000 claims description 3
- 230000037072 sun protection Effects 0.000 claims 1
- 238000005057 refrigeration Methods 0.000 abstract description 19
- 230000008859 change Effects 0.000 abstract description 7
- 238000003384 imaging method Methods 0.000 abstract description 6
- 230000001276 controlling effect Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 8
- 238000004364 calculation method Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 230000000903 blocking effect Effects 0.000 description 5
- 230000007613 environmental effect Effects 0.000 description 5
- 238000002834 transmittance Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 230000035945 sensitivity Effects 0.000 description 4
- 238000001931 thermography Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000003745 diagnosis Methods 0.000 description 3
- 238000007710 freezing Methods 0.000 description 3
- 230000008014 freezing Effects 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 206010063385 Intellectualisation Diseases 0.000 description 2
- 238000003331 infrared imaging Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 230000035699 permeability Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
- G05B19/0423—Input/output
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/02—Constructional details
- G01J5/0275—Control or determination of height or distance or angle information for sensors or receivers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/02—Constructional details
- G01J5/07—Arrangements for adjusting the solid angle of collected radiation, e.g. adjusting or orienting field of view, tracking position or encoding angular position
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/48—Thermography; Techniques using wholly visual means
- G01J5/485—Temperature profile
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/25—Pc structure of the system
- G05B2219/25257—Microcontroller
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Radiation Pyrometers (AREA)
Abstract
The invention discloses a control method and a device of a refrigeration type thermal infrared imager, wherein the method comprises the following steps: displaying an infrared image in real time after the thermal infrared imager finishes power-on initialization; receiving a self-checking instruction of the platform controller, performing fault detection on the refrigerator, the infrared detector, the power supply and the communication state, and outputting self-checking feedback information; receiving a function control instruction of a platform controller, executing a corresponding task according to the function control instruction, and feeding back task execution state information to the platform controller, wherein the task at least comprises an automatic focusing task based on a predicted automatic focusing algorithm and a sun-proof strong light task based on physical protection; and outputting the infrared image corrected according to the function control instruction to the platform controller. The scheme can improve the imaging quality and stability of the thermal infrared imager under the complex change environment.
Description
Technical Field
The invention relates to the technical field of infrared thermal imaging, in particular to a control method, a control device, a computing device and a storage medium of a refrigeration type thermal infrared imager.
Background
The infrared imaging system is widely applied to a plurality of fields such as military investigation, safety monitoring, medical imaging, environmental monitoring and the like, and is characterized by being capable of working at night or under low illumination conditions. The refrigeration type medium wave infrared thermal imaging system is used as a high-performance imaging technology, and is particularly suitable for occasions requiring extremely high image quality and sensitivity. The refrigerating medium wave infrared thermal imaging system reduces the working temperature of the detector by using a refrigerating machine so as to improve the sensitivity of the system and reduce the thermal noise in the device, and can capture the medium wave spectrum range between 3 micrometers and 5 micrometers, thereby realizing long-distance, large-range and long-time reconnaissance monitoring of key areas and important targets.
Due to the fact that the scene changes frequently or the parameters of the optical system change caused by severe environmental temperature changes in the observation process, the imaging surface of the thermal imager is dispersed, and the focal length is not practical. In a dynamic environment or when a fast moving target is tracked, there are problems that an automatic focusing reaction is not rapid enough, a focus is difficult to accurately identify, and a temperature distribution abnormal region in an infrared image cannot be identified and processed in real time. When the device faces extreme illumination conditions such as direct sunlight, the adjustable light ring is generally used for controlling the incoming light quantity of external illumination, or a filter with specific wavelength is used for blocking certain frequency bands in the sunlight, and even if the device has an anti-glare function, the dynamic range of the thermal imager is insufficient for completely eliminating the problems of overexposure or light spots.
Disclosure of Invention
In order to improve the target tracking performance of the refrigeration type thermal infrared imager in a complex change environment, the scheme provides a control method and a device of the refrigeration type thermal infrared imager, an automatic focusing algorithm is adopted to more accurately predict and respond to the change of an actual scene, and the abnormality in an infrared image is automatically identified and monitored through a deep learning algorithm, so that the intelligent level of the thermal infrared imager can be improved; the physical protection system capable of being dynamically deployed can respond to external strong light irradiation in time, and the stability and reliability of the thermal imaging system can be improved.
According to a first aspect of the present invention, there is provided a control method of a refrigeration type thermal infrared imager, including: displaying an infrared image in real time after the thermal infrared imager finishes power-on initialization; receiving a self-checking instruction of the platform controller, performing fault detection on the refrigerator, the infrared detector, the power supply and the communication state, and outputting self-checking feedback information; receiving a function control instruction of a platform controller, executing a corresponding task according to the function control instruction, and feeding back task execution state information to the platform controller, wherein the task at least comprises an automatic focusing task based on a predicted automatic focusing algorithm and a sun-proof strong light task based on physical protection; and outputting the infrared image corrected according to the function control instruction to the platform controller.
According to the technical scheme, potential problems of equipment can be found in time through a self-checking mechanism, the infrared image can be dynamically adjusted and corrected according to the function control instruction, and the thermal infrared imager can provide high-quality images under different environments and different target detection requirements.
Optionally, in the control method of the refrigeration type thermal infrared imager provided by the invention, whether serial communication interface data are repeatedly received according to a preset time interval is judged, and if the serial communication interface data are received, whether the data bit number and the check bit are correct is judged; if the data bit number and the check bit are correct, feeding back a communication normal state bit, otherwise feeding back a communication fault state bit;
In the correction process, judging whether the motor is movable and moves to a designated position, if the motor cannot move or cannot move to the designated position, feeding back a motor fault state bit, otherwise feeding back a motor operation normal state bit; inquiring temperature data of the analog-to-digital conversion circuit, judging whether the temperature data is in a normal range, if so, feeding back a temperature normal state bit, otherwise, feeding back a fault state bit of the refrigerator; judging whether the thermal imager normally outputs an image, if the image is normally output, feeding back the image to output a normal state bit, otherwise, feeding back the image to output a fault state bit.
According to the technical scheme, the states of the key components are automatically detected and fed back, so that maintenance personnel can quickly position the problem source, and the maintenance efficiency is improved.
Optionally, in the control method of the refrigeration type thermal infrared imager provided by the invention, a field zoom instruction sent by the platform controller is received, the field motor is controlled to move so as to adjust the increase or decrease of the field, and the current field state information is fed back to the platform controller; receiving a manual focusing instruction sent by a platform controller, controlling a focusing motor to move so that the image definition reaches a preset threshold value, and feeding back current focusing state information to the platform controller; receiving an automatic focusing instruction sent by a platform controller, controlling a focusing motor to move based on a predicted automatic focusing algorithm, enabling the focusing motor to automatically stop at an image best definition position, and feeding back current focusing state information to the platform controller;
Receiving an image polarity conversion instruction sent by a platform controller, switching black heat or white heat attributes of an image, and feeding back current polarity state information to the platform controller; receiving an electronic zoom instruction sent by a platform controller, amplifying and displaying an image, and feeding back current image display information to the platform controller; receiving a brightness adjustment instruction sent by the platform controller, adjusting the brightness of the image to correspondingly increase or decrease, and feeding back current brightness information to the platform controller; receiving a contrast adjustment instruction sent by a platform controller, adjusting the gray level of an image to increase or decrease the contrast of the image, and feeding back the current contrast information to the platform controller;
Receiving a sun-proof strong light instruction sent by a platform controller, judging whether an image mean value reaches a saturation threshold, switching in a reference source if the image mean value reaches the saturation threshold, and feeding back current image saturation information to the platform controller; receiving an equipment state reading instruction sent by a platform controller, reading a focusing value and a focal length value fed back by a current encoder, and feeding back the current focusing value and the focal length value to the platform controller; receiving an image correction instruction sent by a platform controller, carrying out non-uniformity correction on an image, and feeding back a current image correction result to the platform controller; receiving a cross switch instruction sent by a platform controller, controlling a cross to be opened or closed, and feeding back current cross switch state information to the platform controller;
receiving an image mirror image instruction sent by a platform controller, horizontally or vertically mirroring an image, and feeding back current image mirror image information to the platform controller; and receiving an image enhancement instruction sent by the platform controller, opening or closing image enhancement, and feeding back current image enhancement switch information to the platform controller.
According to the technical scheme, through various control and feedback mechanisms, the image display parameters can be adjusted and optimized in real time so as to adapt to different visual demands and environmental conditions.
Optionally, in the control method of the refrigeration type thermal infrared imager provided by the invention, a plurality of infrared image samples corresponding to different focal lengths are obtained, and the Laplacian operator of the infrared image samples is calculated; carrying out peak value judgment in gradient information of the Laplacian according to a hill climbing search algorithm, and searching a focusing motor moving position corresponding to the optimal definition of the image; and adjusting the axial speed and the direction of the focusing motor in real time based on the PID controller to enable the image to reach a preset definition threshold.
According to the technical scheme, the edge and detail of the image can be effectively evaluated by calculating the definition through the Laplace operator, the best focus can be quickly approximated by locally searching the maximum gradient value of the Laplace operator, and the focusing efficiency is improved.
Optionally, in the control method of the refrigeration type thermal infrared imager provided by the invention, whether the average value of the infrared image reaches a saturation threshold value is judged; under the condition that the strong light automatic protection function is started, if the image mean value is saturated, controlling the correction baffle to cut in until the radiation signal level received by the thermal imager window is detected to be within a preset level threshold range, controlling the correction baffle to cut out; and under the condition that the strong light automatic protection function is closed, if the image mean value is saturated, sending strong light alarm information to the platform controller.
According to the technical scheme, the light intensity of the infrared detector window is reduced through the physical protection mechanism, and image saturation and potential hardware damage caused by direct sunlight are avoided.
Optionally, in the control method of the refrigeration type thermal infrared imager provided by the invention, a target object or region in the infrared image is identified and marked based on a deep learning algorithm; and when the abnormal temperature distribution of the target object or region is detected, sending temperature abnormality warning information to the platform controller.
According to the technical scheme, through automatic target identification and real-time anomaly detection, the intellectualization and the accuracy of the thermal infrared imager are improved, and the applicability of the thermal infrared imager in various application scenes is enhanced.
According to a second aspect of the present invention, there is provided a control device of a refrigeration type thermal infrared imager, including an initialization module, a self-checking module, a function control module and an image output module.
The initialization module is used for displaying infrared images in real time after the thermal infrared imager is powered on and initialized; the self-checking module is used for receiving a self-checking instruction of the platform controller, performing fault detection on the refrigerator, the infrared detector, the power supply and the communication state, and outputting self-checking feedback information; the function control module is used for receiving a function control instruction of the platform controller, executing a corresponding task according to the function control instruction, and feeding back task execution state information to the platform controller, wherein the task at least comprises an automatic focusing task based on a predicted automatic focusing algorithm and a sun-proof strong light task based on physical protection; the image output module is used for outputting the infrared image corrected according to the function control instruction to the platform controller.
Optionally, in the control device of the refrigeration type thermal infrared imager provided by the invention, an AD interface, a DDR interface, a FLASH interface and a temperature measurement interface are arranged in the thermal infrared imager, and are respectively used for converting infrared radiation signals into digital signals and then storing the digital signals in an AD chip, storing infrared image data in the DDR chip, storing configuration data and correction parameters in the FLASH, and acquiring temperature measurement data of the temperature measurement chip.
The infrared thermal imager and the platform controller are in information interaction through a serial communication interface and an SDI video interface, the serial communication interface is used for forming a data frame according to a RS422 communication protocol on a control instruction of the platform controller and feedback state information of the infrared thermal imager, different control instructions correspond to different instruction codes and operands, and different feedback state information corresponds to different response codes and response numbers; the SDI video interface is used for unidirectionally transmitting the infrared image output by the thermal infrared imager to the platform controller according to a preset frame frequency according to an SDI interface protocol.
According to a third aspect of the present invention there is provided a computing device comprising: at least one processor; and a memory storing program instructions, wherein the program instructions are configured to be adapted to be executed by the at least one processor, the program instructions comprising instructions for performing the method of controlling the above-described cryogenic thermal infrared imager.
According to a fourth aspect of the present invention, there is provided a readable storage medium storing program instructions that, when read and executed by a computing device, cause the computing device to execute the control method of the refrigeration thermal infrared imager described above.
According to the control method and the control device of the refrigeration type thermal infrared imager, provided by the invention, the fault detection is carried out on key components (such as the refrigerator, the infrared detector, the power supply and the communication system) in the starting or running process of equipment, so that the equipment can be ensured to quickly take measures when any abnormal situation is found, and the occurrence of faults is prevented in advance. By receiving and executing the function control instructions from the platform controller, implementation of these functions significantly improves image quality in complex light or dynamic environments. Especially, the corner point can be automatically adjusted according to environmental change and target movement based on an automatic focusing algorithm, and the target tracking performance under a complex environment can be ensured by the sun-proof strong light control based on physical protection.
The foregoing description is only an overview of the present invention, and is intended to be implemented in accordance with the teachings of the present invention in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present invention more readily apparent.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
FIG. 1 illustrates a software architecture diagram of a thermal infrared imager and a platform controller according to one embodiment of the invention;
FIG. 2 illustrates a flow diagram of a method 200 for controlling a thermal infrared imager of the refrigerated type, according to one embodiment of the invention;
FIG. 3 illustrates a software operational flow diagram in a thermal infrared imager operating mode according to one embodiment of the invention;
fig. 4 is a schematic structural view showing a control apparatus 400 of a thermal infrared imager of a refrigeration type according to an embodiment of the present invention;
FIG. 5 illustrates a block diagram of computing device 100, according to one embodiment of the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Fig. 1 shows a software architecture diagram of a thermal infrared imager and a platform controller according to an embodiment of the invention. As shown in FIG. 1, the platform controller and the thermal imager interact with control instructions and state information through a serial communication interface, so that the functions of infrared signal processing, thermal imager self-checking, fault diagnosis, function control and the like are completed. And the thermal infrared imager transmits the standard video image processed by the infrared signals to the platform controller through the SDI interface.
Specifically, after the thermal infrared imager is electrified, initialization is completed, self-inspection is started, and a digital image signal is output after analog signals output by the infrared detector are amplified and sampled. In order to avoid geometric distortion caused by the position of the detector or the optical system, geometric correction can be performed on the digital image signal, for example, dark spots or bright spots appearing in the image are eliminated through non-uniformity correction, abnormal or missing pixel data are replaced through blind pixel filling, gray stretching or compression is performed on the image according to the dynamic range of the infrared signal, and a standard video image with good visual effect is obtained.
The self-checking and fault diagnosis of the thermal imager are completed by detecting and positioning the working state of the key component. The refrigerator in the thermal imager is responsible for keeping the working temperature of the detector in a stable low temperature range, and the running state of the refrigerator can be checked in the self-checking process or the temperature of the detector can be detected by a temperature sensor to obtain the state zone bit of the refrigerator. The detector is responsible for receiving infrared radiation and converting the infrared radiation into an electric signal, and can check the output signal of the detector and the working state of the signal processing circuit in the self-checking process to obtain the detector state marker bit. And acquiring a power supply state flag bit according to whether the power supply output voltage and current are in a normal range.
The status zone bits can be directly displayed in a digital video, and can also be transmitted to the platform controller through a serial communication interface, so that an operator can monitor the running state and the health condition of the thermal imager in real time. Through the self-checking and fault diagnosis programs, the thermal imager can improve the reliability and stability, and ensure that the thermal imager can effectively operate and provide accurate infrared image information under various working environments and conditions.
The thermal imager completes control tasks such as manual/automatic contrast adjustment, manual/automatic brightness adjustment, sun-proof strong light, field zooming, electronic zooming, manual/automatic focusing compensation, image freezing and restoring, integral time adjustment, image correction, image polarity conversion, image detail enhancement, image mirroring, cross switches, equipment state reading and the like by receiving various control instructions of the platform controller.
Fig. 2 shows a flow diagram of a method 200 for controlling a thermal infrared imager of the cooling type according to an embodiment of the invention. As shown in fig. 2, first, in step S210, after the thermal infrared imager completes power-up initialization, an infrared image is displayed in real time.
The thermal infrared imager is provided with a working mode and a maintenance module, wherein the working mode comprises an initialization state, a correction state and an imaging state. FIG. 3 illustrates a software flow diagram during a thermal infrared imager operating mode according to one embodiment of the invention. As shown in fig. 3, the thermal imager is first initialized after being powered on, and the original image data output by the AD chip is displayed. And after the initialization is finished, an imaging state is carried out, and in the imaging state, a control instruction of the signal processing extension software is received and the correction state is entered. In the correction state, the original image data output by the AD chip is input, and the standard video image is output through image correction, electronic zooming, polarity processing and the like.
And then executing step S220, receiving a self-checking instruction of the platform controller, performing fault detection on the refrigerator, the infrared detector, the power supply and the communication state, and outputting self-checking feedback information.
The thermal imager self-test comprises a communication function self-test, a motor operation self-test, a temperature self-test and an image output self-test. Specifically, whether serial communication interface data is repeatedly received at a preset time interval, for example 80ms, is judged; if the serial communication interface data is received, judging whether the data bit number and the check bit are correct, if the data bit number and the check bit are correct, feeding back a communication normal state bit, otherwise feeding back a communication fault state bit.
In the infrared imaging correction process, judging whether the focusing motor is movable and moves to a designated position, if the focusing motor cannot move or cannot move to the designated position, feeding back a motor fault state bit, and otherwise, feeding back a motor operation normal state bit.
And inquiring temperature data of the analog-to-digital conversion circuit, judging whether the temperature is in a normal range, if so, feeding back a temperature normal state bit, otherwise, feeding back a fault state bit of the refrigerator. Judging whether the thermal imager normally outputs an image, if the image is output normally, feeding back the image to output a normal state bit, otherwise, outputting the image to output a fault state bit.
Subsequently, in step S230, a function control instruction of the platform controller is received, a corresponding task is executed according to the function control instruction, and task execution status information is fed back to the platform controller, where the tasks at least include an autofocus task based on a predicted autofocus algorithm and a sun glare task based on physical protection.
Under the condition that the communication function is normal, the thermal infrared imager receives a control instruction of the platform controller through the serial communication interface. The data can be stored in a received data buffer area according to the receiving sequence, and after the frame header and the check bit pass the check according to the RS422 communication protocol, the effective data frame of the control instruction is obtained. Different control instructions correspond to unused instruction codes and operands.
The thermal infrared imager feeds back status information to the platform controller through the serial communication interface, and can compose the status information into data frames (baud rate 115200b/s, each frame of information comprises 10 bits, namely, a first-bit start bit, eight bits, a first-low and then-high data, a first-bit end bit and no parity check bit) according to the RS422 communication protocol, store the data frames into a transmitting data buffer area according to the sequence, and transmit valid data frames according to the communication protocol.
Specifically, the thermal infrared imager can receive a field zoom instruction sent by the platform controller, control the field motor to move, control linkage of the optical assembly to adjust the increase or decrease of the field, and feed back the current field state information to the platform controller.
And receiving a manual focusing instruction sent by the platform controller, controlling the focusing motor to move, enabling the image definition to reach a preset threshold value, and feeding back the current focusing state information to the platform controller.
And receiving an automatic focusing instruction sent by the platform controller, controlling the focusing motor to move based on a predicted automatic focusing algorithm, enabling the focusing motor to automatically stop at the position of the best definition of the image, and feeding back the current focusing state information to the platform controller.
In the auto-focusing mode, the lens group or the single lens is moved in the optical axis direction to change the focus position. In the automatic focusing process, a plurality of infrared image samples corresponding to different focal lengths can be obtained, and the Laplacian of the infrared image samples is calculated;
And carrying out peak value judgment in gradient information of the Laplacian according to a hill climbing search algorithm, and searching a focusing motor moving position corresponding to the optimal definition of the image. The laplace operator is a second order differential operator, and can be used for fast changes of the highlighting area, i.e. edges, in image processing. The maximum response of the laplace operator during autofocus corresponds to the best focus position.
The axial speed and the direction of the focusing motor are regulated in real time based on the PID controller, so that the image reaches a preset definition threshold value, the difference between the target focus position and the current focus position is reduced, and the image reaches the preset definition threshold value.
And receiving an image polarity conversion instruction sent by the platform controller, switching the black heat or white heat attribute of the image, and feeding back the current polarity state information to the platform controller.
And receiving an electronic zoom instruction sent by the platform controller, amplifying and displaying the image, and feeding back the display information of the current image to the platform controller.
And receiving a brightness adjustment instruction sent by the platform controller, adjusting the brightness of the image to correspondingly increase or decrease, and feeding back the current brightness information to the platform controller.
And receiving a contrast adjustment instruction sent by the platform controller, adjusting the gray level of the image to increase or decrease the contrast of the image, and feeding back the current contrast information to the platform controller.
And receiving a sun-proof strong light instruction sent by the platform controller, judging whether the image mean value reaches a saturation threshold, switching in a reference source if the image mean value reaches the saturation threshold, and feeding back the current image saturation information to the platform controller.
According to one embodiment of the invention, when the detector of the thermal imager receives an abnormally high radiation signal, it may be detected whether the image mean exceeds a saturation threshold, which represents a maximum safety margin for window brightness. Under the condition that the strong light automatic protection function is started, if the image mean value is saturated, the correction blocking piece is controlled to cut in so as to reduce radiation signals received by the infrared detector, and when the radiation signal level received by the thermal imager window is detected to be within a preset level threshold range, the correction blocking piece is controlled to cut out. Such an automatic protection mechanism can effectively prevent damage to the device or distortion of data due to the too strong radiation.
Under the condition that the strong light automatic protection function is closed, if the image mean value is saturated, strong light alarm information is sent to the platform controller, the correction blocking piece is not automatically adjusted any more, and an operator is allowed to manually adjust the direction of the correction blocking piece or the turntable system.
And receiving an equipment state reading instruction sent by the platform controller, reading a focusing value and a focal length value fed back by the current encoder, and feeding back the current focusing value and the focal length value to the platform controller.
And receiving an image correction instruction sent by the platform controller, carrying out non-uniformity correction on the image, and feeding back the current image correction result to the platform controller.
And receiving a cross switch instruction sent by the platform controller, controlling the cross to be opened or closed, and feeding back the current state information of the cross switch to the platform controller.
And receiving an image mirror image instruction sent by the platform controller, horizontally or vertically mirroring the image, and feeding back the current image mirror image information to the platform controller.
And receiving an image enhancement instruction sent by the platform controller, opening or closing image enhancement, and feeding back current image enhancement switch information to the platform controller.
Finally, step S240 is executed to output the corrected infrared image according to the function control instruction to the platform controller.
To increase the level of intellectualization of a thermal infrared imager, a target object or region in an infrared image may be identified and marked based on a deep learning algorithm. And when the abnormal temperature distribution of the target object or region is detected, sending temperature abnormal alarm information to a platform controller.
Through the control scheme, the thermal infrared imager can achieve the following technical indexes:
F number: 4, a step of;
2. Angle of view: 21.7 ° (H) ×17.5 ° (V) to 2.7 ° (H) ×2.2 ° (V), error ± 5%;
3. focal length: continuously zooming with the thickness of 25 mm-200 mm;
4. minimum Resolvable Temperature Difference (MRTD): less than or equal to 250mK (f=6.7 cy/mrad);
5. Noise Equivalent Temperature Difference (NETD): not more than 35 mK@25deg.C;
6. Electronic zoom: 1X, 2X, 4X;
7. Frame rate: 25Hz;
8. Work preparation time: not more than 8min;
9. Video output: outputting one standard HD-SDI digital image; one path of analog video output: PAL output of standard CCIR format.
10. Image adjustment function: the system has the functions of manual/automatic adjustment of brightness and contrast, image freezing and recovery, integral time adjustment, non-uniformity correction, polarity conversion, image enhancement, electric focusing compensation and the like.
The recognition distance of the thermal imager to the target is a function of the target size, the thermal imager instantaneous field of view, the target-to-background temperature difference Δt, the atmospheric transmittance τ a, and the thermal imager minimum resolvable temperature difference MRTD. The detection and identification action distance of the thermal infrared imager to the target is mainly influenced by two aspects, namely temperature resolution and spatial resolution. The temperature resolution is mainly influenced by factors such as the temperature difference between a target and the environment, the temperature sensitivity of equipment, the atmospheric transmittance and the like; the spatial resolution is mainly determined by factors such as the target size, the pixel size, the lens focal length and the like.
The relationship between the recognition distance and the spatial resolution θ required for target recognition is:
θ— the required spatial resolution (instantaneous field of view) (mrad);
r- -distance (㎞);
H- -target horizontal critical dimension (m);
Gamma-the number of pairs needed to complete the identification with a certain probability of identification.
According to the Johnson criterion, the number of line pairs required for a target recognition probability of 100% is 6. For a rectangular object, the narrow side has a higher requirement for spatial resolution than the long side, so the following calculations all identify the required spatial resolution in terms of narrow side calculations (pedestrians in terms of long sides):
The target size of the vehicle is 2.3m×4.6m, and when the recognition distance is 4 km, the minimum spatial resolution θ 1 =0.095 mrad required. The target size of the pedestrian is 0.5m×1.7m, and when the recognition distance is 2 km, the minimum spatial resolution θ 2 =0.142 mrad required.
Because theta is smaller than min (theta 1,θ2), namely the actual spatial resolution of the thermal infrared imager is better than the spatial resolution required by two kinds of target identification, the spatial resolution of the thermal infrared imager designed by the scheme can meet the target identification requirement.
The influence of temperature on target identification mainly considers factors such as target temperature difference, atmospheric transmission, temperature sensitivity of equipment and the like. Thermal radiation of the target will be attenuated by atmospheric transport, with the following characteristics of atmospheric permeability:
From the data, the average value ta of the atmospheric transmittance in summer and winter in China under the condition of 8km of visibility is shown in the following table, and the equivalent temperature difference delta t=ta=Δt0 (delta t0=3k) of the target at different distances after the atmospheric attenuation is considered. The atmospheric transmittance at different distances is shown in the following table:
The following calculations only consider summer conditions due to poor climate conditions in summer. From the table, it can be calculated that after atmospheric decay, the equivalent temperature difference Δt=τa×Δt 0,(ΔT0 =3k for the target at different distances. Since the climate conditions in summer are poor, the following calculation only considers the summer situation, and therefore the equivalent temperature difference calculation result of the target under different detection and identification distances is as follows:
| Sequence number | Target object | Identifying distance | Identifying an equivalent temperature difference at a distance |
| 1 | Vehicle 2.3 m.times.4.6 m | 4km | 1.002K |
| 2 | Pedestrian 0.5m 1.7m | 2km | 1.374K |
Because the minimum resolvable temperature difference of the thermal infrared imager is better than 0.25K, the equivalent temperature differences of different targets are all larger than the minimum resolvable temperature difference. In addition, the calculation is considered in summer, and the atmospheric transmittance in other seasons is actually better than summer, namely, tau a in the weather environment is larger than the calculation value, so that the temperature resolution of the system can meet the detection and identification distance requirements of two types of targets in different seasons.
Fig. 4 shows a schematic structural view of a control apparatus 400 of a thermal infrared imager of a refrigeration type according to an embodiment of the present invention. As shown in fig. 4, the control apparatus includes an initialization module 410, a self-checking module 420, a function control module 430, and an image output module 440.
The initialization module 410 is configured to display an infrared image in real time after the thermal infrared imager is initialized after power-up. The infrared image displayed at this time is an infrared image obtained by sampling a radiation signal received by the infrared detector, performing geometric correction, and performing image processing on the data after geometric correction such as non-uniformity correction, blind pixel filling, gray level conversion and the like.
The self-checking module 420 can receive a self-checking instruction of the platform controller, perform fault detection on the refrigerator, the infrared detector, the power supply and the communication state, and output self-checking feedback information. The detection result can be represented by a status flag bit, and the status flag bit can be directly displayed in a digital video or uploaded to a tracker platform controller through a communication interface.
The function control module 430 may receive a function control instruction of the platform controller, execute a corresponding task according to the function control instruction, and feed back task execution status information to the platform controller, where the task at least includes an autofocus task based on a predicted autofocus algorithm and a solar protection task based on physical protection. For example, the function control command of the platform controller is 10 bytes, one start bit, eight data bits from high to low, and one parity-free end bit, and after the control command is analyzed, control tasks such as contrast manual/automatic adjustment, brightness manual/automatic adjustment, image polarity conversion, electric focusing compensation, image freezing and recovery, integration time adjustment, non-uniformity correction, image enhancement and the like are completed, and task execution state information of the thermal infrared imager is fed back to the platform controller.
The image output module 440 may output the infrared image corrected according to the function control instruction to the stage controller.
According to one embodiment of the invention, an AD interface, a DDR interface, a FLASH interface and a temperature measuring interface are arranged in the thermal infrared imager and are respectively used for converting infrared radiation signals into digital signals and then storing the digital signals in the AD chip, storing infrared image data in the DDR chip, storing configuration data and correction parameters in the FLASH and acquiring temperature measurement data of the temperature measuring chip.
The thermal infrared imager and the platform controller are in information interaction through a serial communication interface and an SDI video interface, the serial communication interface is used for forming a data frame according to a RS422 communication protocol on a control instruction of the platform controller and feedback state information of the thermal infrared imager, different control instructions correspond to different instruction codes and operands, and different feedback state information corresponds to different response codes and response numbers.
Table 1 shows a command data format table representing instruction codes and operands corresponding to different function control instructions, according to one embodiment of the invention.
Table 1 command data format table
Table 2 shows a response data format table according to an embodiment of the present invention, which represents response codes and response numbers corresponding to different task execution status feedback information.
TABLE 2 Serial port Command and response Table
The SDI video interface is used for unidirectionally transmitting the infrared image output by the thermal infrared imager to the platform controller according to a preset frame frequency, such as 50 Hz.
FIG. 5 illustrates a block diagram of computing device 100, according to one embodiment of the invention. As shown in fig. 5, computing device 100 may include memory 106 and processor 104. The memory bus 108 may be used for communication between the processor 104 and the system memory 106.
Memory 106 may include an operating system 120, applications 122, and program data 124. The application 122 may be arranged to execute instructions on an operating system by the one or more processors 104 using the program data 124. The application 122 includes program instructions for implementing various user-desired functions.
When the computing device 100 starts up running, the processor 104 reads the program instructions of the operating system 120 from the memory 106 and executes them. Applications 122 run on top of operating system 120, utilizing interfaces provided by operating system 120 and underlying hardware to implement various user-desired functions. When a user launches the application 122, the application 122 is loaded into the memory 106, and the processor 104 reads and executes the program instructions of the application 122 from the memory 106.
Computing device 100 also includes storage device 132 and output device 142, storage device 132 being coupled to storage interface bus 134. And an interface bus 140 that facilitates communication from various interface devices (e.g., an output device 142, a peripheral interface 144, and a communication device 146) via bus/interface controller 130.
Peripheral interface 144 may include a serial interface controller 154 and a parallel interface controller 156, which may be configured to facilitate communication with external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device) or other peripherals (e.g., printer, scanner, etc.) via one or more I/O ports 158. The communication device 146 may include a network controller 160 that may be arranged to facilitate communication with one or more other computing devices 162 via one or more communication ports 164 over a network communication link. In the computing device 100 according to the invention, the application 122 comprises instructions for performing the method 200 of controlling a thermal infrared imager of the invention.
According to the control method and the control device of the refrigeration type thermal infrared imager, the key components are subjected to fault detection in the starting or running process of the equipment, so that the equipment can quickly take measures when any abnormal situation is found, and the occurrence of faults is prevented in advance. By receiving and executing the function control instructions from the platform controller, implementation of these functions significantly improves image quality in complex light or dynamic environments. Especially, the corner point can be automatically adjusted according to environmental change and target movement based on an automatic focusing algorithm, and the target tracking performance under a complex environment can be ensured by the sun-proof strong light control based on physical protection.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
As used herein, unless otherwise specified the use of the ordinal terms "first," "second," "third," etc., to describe a general object merely denote different instances of like objects, and are not intended to imply that the objects so described must have a given order, either temporally, spatially, in ranking, or in any other manner.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411065401.5A CN118963215A (en) | 2024-08-05 | 2024-08-05 | A control method and device for a refrigerated infrared thermal imager |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411065401.5A CN118963215A (en) | 2024-08-05 | 2024-08-05 | A control method and device for a refrigerated infrared thermal imager |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118963215A true CN118963215A (en) | 2024-11-15 |
Family
ID=93390601
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202411065401.5A Pending CN118963215A (en) | 2024-08-05 | 2024-08-05 | A control method and device for a refrigerated infrared thermal imager |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118963215A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104459940A (en) * | 2013-09-25 | 2015-03-25 | 北京环境特性研究所 | Quick self-adaptation automatic focusing method |
| CN207991693U (en) * | 2017-12-29 | 2018-10-19 | 烟台易尚电子科技有限公司 | A kind of infrared digital image signal processing platform |
| CN114353954A (en) * | 2021-12-13 | 2022-04-15 | 浙江兆晟科技股份有限公司 | Method and system for preventing thermal infrared imager from being burnt by sun |
| CN115767077A (en) * | 2022-11-03 | 2023-03-07 | 西安应用光学研究所 | Self-checking method for electronic unit of photoelectric imaging equipment |
| CN117793532A (en) * | 2024-01-02 | 2024-03-29 | 北京环境特性研究所 | Automatic focusing and correcting control equipment, system and method for thermal infrared imager |
-
2024
- 2024-08-05 CN CN202411065401.5A patent/CN118963215A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104459940A (en) * | 2013-09-25 | 2015-03-25 | 北京环境特性研究所 | Quick self-adaptation automatic focusing method |
| CN207991693U (en) * | 2017-12-29 | 2018-10-19 | 烟台易尚电子科技有限公司 | A kind of infrared digital image signal processing platform |
| CN114353954A (en) * | 2021-12-13 | 2022-04-15 | 浙江兆晟科技股份有限公司 | Method and system for preventing thermal infrared imager from being burnt by sun |
| CN115767077A (en) * | 2022-11-03 | 2023-03-07 | 西安应用光学研究所 | Self-checking method for electronic unit of photoelectric imaging equipment |
| CN117793532A (en) * | 2024-01-02 | 2024-03-29 | 北京环境特性研究所 | Automatic focusing and correcting control equipment, system and method for thermal infrared imager |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2628745C2 (en) | Protective observation system and relevant method of initializing alarm | |
| EP3265994B1 (en) | Anomalous pixel detection | |
| US8139112B2 (en) | Methods and apparatus related to improved surveillance | |
| US20110261225A1 (en) | Image capturing apparatus, method of detecting tracking object, and computer program product | |
| US20110169960A1 (en) | Video enhancement system | |
| KR20230036024A (en) | Electric vehicle charger fire detection and charger condition prediction system | |
| CN108156371B (en) | Infrared automatic focusing fast searching method | |
| KR102473142B1 (en) | Fast zoom and focusing apparatus predicting for high-speed tracking and predicting moving object for camera for providing a high-quality image seamlessly and method for high-speed tracking and predicting moving object for camera using the same | |
| US20050231627A1 (en) | Front lens shutter mount for uniformity correction | |
| CN103162843A (en) | Zero shutter thermal infrared imager based on voice operated exchange (VOX) detector and use method thereof | |
| CN105928627A (en) | Method for eliminating image reproduction non-uniformity of refrigeration type thermal imager | |
| CN105491285A (en) | Method and device for switching working mode of PIR camera | |
| CN105430280A (en) | Double-field thermal imager and automatic focusing method thereof | |
| US20110187866A1 (en) | Camera adjusting system and method | |
| KR101038815B1 (en) | Imaging system with high speed autofocus | |
| US20210297573A1 (en) | Imaging device, control method, and storage medium | |
| US10466110B2 (en) | Infrared image acquisition device and infrared image acquisition method | |
| Venkateswarlu et al. | Nonuniformity compensation for IR focal plane array sensors | |
| US11457147B2 (en) | Method for enhancing the performance of a video camera | |
| CN118963215A (en) | A control method and device for a refrigerated infrared thermal imager | |
| US11095824B2 (en) | Imaging apparatus, and control method and control program therefor | |
| CN118283419A (en) | Lens control method, device, object sensing system and storage medium | |
| US10609275B2 (en) | Image processing device, image processing method, and recording medium | |
| KR20110081515A (en) | Versatile Surveillance Camera | |
| JP2019215661A (en) | Image quality adjustment system and image quality adjustment method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |