CN110428637A - A kind of road gate grasp shoot method and road gate capturing system - Google Patents

Abstract

The embodiment of the present application discloses a road checkpoint capture method and a road checkpoint capture system, which are used to realize all-weather supplementary light in the car, thereby improving the capture effect of the checkpoint image. The method in the embodiment of the present application is applied to a road checkpoint capture system. The road checkpoint capture system includes a laser supplementary light component and a camera, wherein the camera includes a first imaging component and a second imaging component; when the vehicle passes through the road checkpoint, the capture When the device is triggered, the road bayonet capture system triggers the laser supplementary light component to supplement the light inside the vehicle, and triggers the camera to output the capture frame at this time. Wherein the supplementary light intensity of the laser supplementary light component is proportional to the light illuminance of the current environment; while the laser supplementary light component supplements the interior of the vehicle, the first imaging component generates a color image, and the second imaging component generates a color image. An infrared image; finally, the road checkpoint capture system outputs a capture result according to the color image and the infrared image.

Description

A road checkpoint capture method and road checkpoint capture system

technical field

The present application relates to the field of video monitoring, in particular to a road checkpoint capture method and a road checkpoint capture system.

Background technique

In today's intelligent traffic system (Intelligent Traffic System, ITS), the realization of all-weather vehicle face capture has important social value for road monitoring. This requires that the road camera can clearly see the facial features of the drivers and passengers in the car during the day, and at the same time, the imaging cannot affect the normal recognition of the license plate.

In the current ITS application scenarios, high-definition cameras are usually used in combination with gas exposure flashlights, which have a better fill-in light effect at night; Without the effect of supplementary light, the interior of the car is dim and unclear, and it is impossible to obtain face information in the window. The reason is that the window glass, water surface, high-temperature road surface, etc. will produce reflections similar to mirror surfaces. Excessively high reflected light will make the reflected light information of the car window much higher than the face information inside the car, making it impossible to see the objects inside the car due to insufficient light entering.

Therefore, how to fill in the light inside the car and make the capture effect in the car clear is a problem that needs to be solved urgently.

Contents of the invention

The embodiment of the present application provides a road checkpoint capture method and a road checkpoint capture system, which are used to realize all-weather supplementary light in the car, thereby improving the capture effect of the checkpoint image.

In the first aspect, an embodiment of the present application provides a road checkpoint capture method, which is applied to a road checkpoint capture system, wherein the road checkpoint capture system includes a laser supplementary light component and a camera, wherein the camera includes a first imaging component and a second imaging component. Two imaging components; when the vehicle passes the shooting trigger device of the road checkpoint, the road checkpoint capture system triggers the laser supplementary light component to supplement light for the interior of the vehicle, and triggers the camera to output the capture frame at this time. Wherein the supplementary light intensity of the laser supplementary light assembly is proportional to the light illuminance of the current environment, that is, the greater the light illumination of the current environment, the greater the supplementary light intensity of the laser supplementary light assembly; While supplementing light, the first imaging component generates a color image, and the second imaging component generates an infrared image; finally, the road checkpoint capture system outputs a capture result according to the color image and the infrared image.

In this embodiment, the snapping result may be that a snapped image is output, or it may be that the content in the snapped frame is identified and output as a recognition result according to requirements, which is not specifically limited here.

In the technical solution provided by the embodiment of the present application, the activated supplementary light component adjusts the supplementary light intensity according to the light illuminance of the current environment, that is, when the light illumination of the external environment is high, the supplementary light intensity is also large, so that it can 1. When the environment inside the car is dark due to strong backlight, the light intensity inside the car can be effectively increased, so that the captured image inside the car can reach a clear state; and when the light illuminance of the external environment is small, the intensity of the supplementary light is also small, which can effectively avoid The ambient illumination outside the car and inside the car is too different, so as to improve the effect of the overall captured image. In this way, all-weather supplementary light can be realized in the car, so that the captured image effect can be consistent.

Optionally, the laser supplementary light component is a vertical cavity surface emitting laser (Vertical Cavity Surface Emitting Laser, VCSEL) laser chip array, wherein the VCSEL laser chip array is a high-power VCSEL laser chip array, and its specific output optical power needs to be greater than 25 Watt (W). The VCSEL laser chip array can be designed as a flash mode, and the flash duration of a single supplementary light is within 10ms. In a specific embodiment, the single supplementary light time can be determined according to the capture time of the camera, which needs to be synchronized with the capture of the camera , so that the captured images in the car can be clearly captured. The VCSEL laser chip array emits a collimated laser light source, which can improve the efficiency of supplementary light, thereby improving the supplementary light effect.

Optionally, the camera may be a binocular fixed-focus camera, so that the first imaging component and the second imaging component are respectively one of the eyes of the binocular fixed-focus camera. Wherein, the first imaging component includes a first camera, a polarizer, a near-infrared cut-off and a first image sensor, wherein the polarizer and the near-infrared cut-off are between the first camera and the first image sensor. The front and rear positions of the polarizer and the near-infrared cutoff are not limited here. The second imaging component includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is located between the second camera and the second image sensor. In this embodiment, the road checkpoint capture system adopts a binocular fixed-focus camera, which can reduce costs on the basis of ensuring the output of two images.

Optionally, the laser supplementary light component of the road bayonet capture system is a VCSEL laser chip, wherein the VCSEL laser chip array is a high-power VCSEL laser chip array, and its specific output optical power needs to be greater than 25 watts (W). The camera may be a binocular fixed-focus camera, so that the first imaging component and the second imaging component are respectively one eye of the binocular fixed-focus camera. Wherein, the first imaging component includes a first camera, a polarizer, a near-infrared cut-off and a first image sensor, wherein the polarizer and the near-infrared cut-off are between the first camera and the first image sensor. The front and rear positions of the polarizer and the near-infrared cutoff are not limited here. The second imaging component includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is located between the second camera and the second image sensor. Wherein, the central wavelength of the VCSEL laser chip array is in the infrared band, so the VCSEL laser chip array is used for supplementing infrared light to the second imaging component. At this time, the central wavelength of the infrared narrowband filter in the second imaging component matches the central wavelength of the VCSEL laser chip array. For example, if the central wavelength of the VCSEL laser chip array is 940 nanometers (nm), then the central wavelength of the infrared narrowband filter is also 940 nm.

Optionally, when the first imaging component includes a first camera, a polarizer, a near-infrared cut-off and a first image sensor, the polarizer and the near-infrared cut-off can be switched and combined according to the light illuminance of the current environment; Combinations can be switched according to time. A specific embodiment can be as follows: the road checkpoint capture system acquires the light illuminance of the current environment; The film works at the same time; when the illuminance of the light is less than the preset threshold, the road checkpoint capture system determines that the near-infrared cut film in the first imaging component is working. The preset threshold can be set by the user himself, or can be determined according to the imaging effect of the color image. At the same time, in this embodiment, the road bayonet capture system can use a double filter switcher (IR-CUT) device to switch the combination of the polarizer and the near-infrared cut-off film.

Optionally, when the road bayonet capture system outputs the capture result according to the color image and the infrared image, the following scheme may be specifically adopted:

In a possible implementation, the road checkpoint capture system acquires the light illuminance of the current environment; then when the light illuminance is greater than a preset threshold, the road checkpoint capture system outputs the infrared image and the color image respectively as the capture result ; when the light illuminance is less than the second preset threshold, the road bayonet capture system performs dual-light fusion of the infrared image and the color image to generate a capture image, and outputs the capture image as the capture result.

In another manner, the road checkpoint capture system performs dual-light fusion of the infrared image and the color image to generate a capture image, and outputs the capture image as the capture result.

In this embodiment, when the road bayonet capture system is performing dual-light fusion, the road bayonet capture system can perform in-vehicle enhancement and license plate overexposure suppression processing on the infrared image, and then combine the processed infrared image with the color image Fusion is performed to generate the captured image. There are two specific methods for license plate overexposure suppression processing. One way is that the road bayonet capture system can perform license plate enhancement after locating the license plate area based on an intelligent algorithm. Another way is that the road bayonet capture system converts the two images into the color coding space (YUV space), performs linear weighted fusion based on overexposure suppression on the Y component of the color image and the infrared image to obtain Y', and then The infrared image is combined with the color image to form a snapshot image.

In the second aspect, the embodiment of the present application provides a road checkpoint capture system, which specifically includes: an input device, a laser supplementary light component, a camera, and an output device; wherein the camera includes a first imaging component and a second imaging component; the input device , used to obtain a trigger signal when the vehicle passes the shooting trigger device of the road checkpoint; the laser supplementary light component is used to supplement the light inside the vehicle according to the trigger signal, wherein the supplementary light of the laser supplementary light component The intensity is proportional to the light illuminance of the current environment; the first imaging component is used to generate a color image; the second imaging component is used to generate an infrared image; the output device is used to output a snapshot according to the color image and the infrared image result.

From the above technical solutions, it can be seen that the embodiment of the present application has the following advantages: in the road bayonet capture system, the activated supplementary light device adjusts the supplementary light intensity according to the light illuminance of the current environment, that is, the light illuminance of the external environment When it is large, the fill light intensity is also high, which can effectively avoid the dark environment in the car under strong reflection and strong backlight scenes, thereby improving the effect of capturing images in the car to achieve a clear state; The light intensity is also small, which can effectively avoid too much correlation between the outside world and the brightness of the car environment, thereby improving the overall capture image effect to achieve a clear state. In this way, all-weather supplementary light can be realized in the car, so that the captured image effect can be consistent.

Description of drawings

Fig. 1 is a frame schematic diagram of the road checkpoint capture system in the embodiment of the present application;

Fig. 2 is a schematic diagram of an embodiment of the road checkpoint capture method in the embodiment of the present application;

Fig. 3 a is a schematic flow chart of the road checkpoint capture method in the embodiment of the present application;

Fig. 3b is a schematic flow chart of the road checkpoint capture method in the embodiment of the present application;

Fig. 4 is a device schematic diagram of the road checkpoint capture system in the embodiment of the present application;

Fig. 5 is a schematic diagram of another device of the road checkpoint capture system in the embodiment of the present application.

Detailed ways

The embodiment of the present application provides a road checkpoint capture method and a road checkpoint capture system, which are used to realize all-weather supplementary light in the car, thereby improving the capture effect of the checkpoint image.

The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and not necessarily Used to describe a specific sequence or sequence. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device comprising a sequence of steps or elements is not necessarily limited to the expressly listed instead, may include other steps or elements not explicitly listed or inherent to the process, method, product or apparatus.

The technical solution provided by this application is applied to an intelligent traffic system (intelligent traffic system, ITS). In this ITS system, all-weather car and in-car face capture are realized. In this ITS system, the system framework of the road checkpoint capture system is shown in Figure 1, the road checkpoint capture system includes: an input device 101, a laser supplementary light assembly 102, a camera 103 and an output device 104; wherein, the camera 103 It includes a first imaging component and a second imaging component. The input device includes but is not limited to hardware devices such as sensors, cameras, sensors, microphones, and vibrators, and users can set them according to actual needs in specific situations. The output device includes, but is not limited to, hardware devices such as display screens. Wherein the road checkpoint capture system in the embodiment of the present application performs the method of road checkpoint shooting specifically as follows: when the vehicle passes the shooting trigger device of the road checkpoint, the input device 101 obtains the trigger signal and triggers the laser supplementary light The component 102 supplements light for the interior of the vehicle, and triggers the camera 103 to output the captured frame at this time. Wherein the supplementary light intensity of the laser supplementary light assembly 102 is directly proportional to the light illuminance of the current environment, that is, the greater the light illumination of the current environment, the greater the supplementary light intensity of the laser supplementary light assembly 102; While supplementing the light inside the vehicle, the first imaging component generates a color image, and the second imaging component generates an infrared image; finally, the output device 104 outputs a snapshot result according to the color image and the infrared image.

For easier understanding, the technical terms involved in the embodiments of the present application are described below.

Color image: refers to an image composed of R, G, and B components for each pixel, where R, G, and B are described by different gray levels, and in this embodiment refers to an image generated by visible light.

Infrared image: a single-channel image generated by acquiring the infrared light intensity of an object, which in this embodiment refers to an image generated by infrared light.

VCSEL laser chip array: VCSEL is a new type of laser that emits light vertically. Its characteristics are as follows: 1. The small divergence angle and the circularly symmetrical far-field and near-field distribution greatly improve the coupling efficiency with the optical fiber, without the need for a complex and expensive beam shaping system; the length of the optical cavity is extremely short, resulting in its Longitudinal mode spacing is widened, single longitudinal mode operation can be realized in a wide temperature range, and dynamic modulation frequency is high; the cavity volume is reduced so that its spontaneous emission factor is several orders of magnitude higher than that of ordinary end-emitting lasers, which leads to many physical properties. In order to improve; it can be tested on the chip, which greatly reduces the development cost; the direction of light output is vertical to the substrate, which can easily realize the integration of high-density two-dimensional area array and achieve higher power output. At the same time, multiple lasers can be arranged in parallel in the direction perpendicular to the substrate to form a laser array.

IR-CUT device: IR-CUT double filter refers to a set of filters built in the camera lens group. When the infrared sensing point outside the lens detects the change of light intensity, the built-in IR-CUT automatically switches the filter. The mirror can automatically switch according to the intensity of the external light, so that the image can achieve the best effect. That is to say, in day or night, the double filter can automatically switch the filter, so no matter in day or night, the best imaging effect can be obtained.

Dual-light fusion: The infrared image generated by infrared imaging has only brightness (grayscale) information and no color information, while the color image generated by visible light imaging has both brightness information and color information. When combining two lights, it is only necessary to consider how to fuse the brightness information of the infrared image into the color image. The usual method is to convert the infrared image and the color image into color space (that is, convert from RGB to YUV), where the Y component represents the brightness component; then the brightness component of the infrared image and the brightness component of the color image are fused to improve the visual Effect.

In-vehicle enhancement: In order to improve the visual effect of the target in the vehicle, the image enhancement algorithm is used to enhance the window area, improve the contrast in the vehicle, and improve the details of dark areas. The image enhancement algorithm can use mature enhancement methods (such as histogram enhancement, CLAHE and other algorithms).

License plate overexposure suppression: In the generated infrared image, the license plate position is overexposed. Therefore, we should try to reduce the influence of the infrared image on the fusion result when the two-light fusion is performed. The specific implementation method can be to first locate the license plate position through an intelligent algorithm, and then perform special processing on the fusion of the license plate area (for example, setting the fusion weight of the pixel points of the infrared image to be lower than that of the color image, reducing the influence of the infrared image on the fusion result. influences).

Please refer to Fig. 2 for details below, an embodiment of the road checkpoint shooting method in the embodiment of the present application is as follows:

201. The road checkpoint capture system acquires a trigger signal when the vehicle passes the capture trigger device of the road checkpoint.

When the vehicle passes through the road checkpoint, if the shooting trigger device of the road checkpoint is triggered, the road checkpoint capture system acquires the trigger signal.

In this embodiment, the snapping trigger device of the road checkpoint can be a distance sensor. For example, a distance sensor is built in the road checkpoint snapping system. The trigger signal; or, the capture trigger device of the road checkpoint may be a ground vibration sensor, and when the vehicle travels on the ground vibration sensor, the road checkpoint capture system acquires the trigger signal; or, the road checkpoint capture The capture trigger device may be a speed sensor, and when the driving speed of the vehicle exceeds a preset value, the road checkpoint capture system acquires the trigger signal. Meanwhile, the trigger signal may be an electrical signal or an optical signal, which is not specifically limited here.

202. The road bayonet capture system triggers the laser supplementary light component to supplement the light inside the vehicle according to the trigger signal, and triggers the camera to output the captured frame at this time, wherein the supplementary light intensity of the laser supplementary light component is consistent with the current environment proportional to the illuminance of the light.

According to the trigger signal, the road bayonet capture system triggers the laser supplementary light assembly to emit a light source for supplementary light inside the vehicle, and triggers the camera to output the snapshot frame at this time. Among them, the supplementary light intensity of the laser supplementary light component is directly proportional to the light illumination of the current environment, that is, if the current environment’s light illumination is stronger, the supplementary light intensity of the laser supplementary light component will also increase, so that it can be used in strong reflections, strong When the backlight scene makes the environment in the car dim, the light intensity inside the car can be effectively increased, so that the captured image in the car can reach a clear state; when the light illuminance of the current environment is low, the fill light intensity is also small, which can effectively avoid the car The ambient illumination outside and inside the car is too different, so as to improve the overall capture image effect and achieve a clear state. In this way, all-weather supplementary light can be realized in the car, so that the captured image effect can be consistent.

Optionally, the laser supplementary light component is a vertical cavity surface emitting laser (Vertical Cavity Surface Emitting Laser, VCSEL) laser chip array, wherein the VCSEL laser chip array is a high-power VCSEL laser chip array, and its specific output optical power needs to be greater than 25 Watt (W). At the same time, the VCSEL laser array light source is designed as a flash mode, and the duration of a single supplementary light is within 10ms. The VCSEL supplementary light device emits a collimated laser light source, which can improve the supplementary light efficiency, thereby improving the supplementary light effect. In this embodiment, the VCSEL laser chip array can choose to use 25 (its arrangement can be a 5*5 array, or a circular array, as long as it can form a whole, the specific implementation will not be done here. limited), a single 2W power VCSEL laser chip. At the same time, the road bayonet capture system can use current to trigger the VCSEL laser chip array to emit pulsed laser, so as to achieve the purpose of supplementary light for clear imaging in the car. The VCSEL laser chip array emits a collimated laser light source, which can improve the efficiency of supplementary light, thereby improving the supplementary light effect. At the same time, the central wavelength of the pulsed laser emitted by the VCSEL laser chip array can be selected from the infrared light band, so that the effect of being insensitive to human eyes can be achieved. In this embodiment, the central wavelength of the pulsed laser light emitted by the VCSEL laser chip array can be selected to be 940 nm. It can be understood that when the central wavelength of the VCSEL laser chip array is 940nm, it does not mean that the VCSEL laser chip array can only emit 940nm laser, and the wavelength of the emitted laser light may be distributed in the range of 930nm to 950nm.

203. The first imaging component generates a color image, and at the same time, the second imaging component generates an infrared image.

When the road bayonet capture system triggers the laser supplementary light component to supplement the light inside the vehicle, the camera also captures a picture at the same time, and generates a color image through the first imaging component, and generates an infrared image through the second imaging component.

Optionally, the first imaging component and the second imaging component may be integrated into a monocular camera, or may be two camera components of a binocular fixed-focus camera. When the first imaging assembly and the second imaging assembly are two independent camera assemblies of a binocular fixed-focus camera, the first imaging assembly includes a first camera, a polarizer, a near-infrared cutoff sheet and a first sensor, wherein , the polarizer and the near-infrared cutoff are between the first camera and the first image sensor. The front and rear positions of the polarizer and the near-infrared cutoff are not limited here. The second imaging component includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is located between the second camera and the second image sensor.

At the same time, when the first imaging component includes a first camera, a polarizer, a near-infrared cut-off and a first image sensor, the polarizer and the near-infrared cut-off can be switched and combined according to the light illuminance of the current environment; Time to switch combinations. A specific embodiment can be as follows: the road checkpoint capture system acquires the light illuminance of the current environment; The film works at the same time; when the illuminance of the light is less than the preset threshold, the road checkpoint capture system determines that the near-infrared cut film in the first imaging component is working. The preset threshold can be set by the user himself, or can be determined according to the imaging effect of the color image. At the same time, in this embodiment, the road bayonet capture system can use a double filter switcher (IR-CUT) device to switch the combination of the polarizer and the near-infrared cut-off film. If the polarizer and the near-infrared cut-off are switched and combined according to time, the details can be as follows: the road checkpoint capture system determines that the polarizer and near-infrared cut-off in the first imaging component The cut-off film works at the same time; the road bayonet capture system determines that the near-infrared cut-off film in the first imaging component works between 6:00 pm and 7:00 am the next day.

It can be understood that if the central wavelength of the laser supplementary light assembly is in the infrared light band, the laser supplementary light assembly can perform infrared supplementary light on the interior of the vehicle. The laser supplementary light component of the road bayonet capture system can be a VCSEL laser chip array, wherein the VCSEL laser chip array is a high-power VCSEL laser chip array, and its specific output optical power needs to be greater than 25 watts (W). The chip array can be designed as a flash mode, and the flash duration of a single supplementary light can be within 10ms. In a specific embodiment, the single supplementary light time can be determined according to the capture time of the camera, which needs to be synchronized with the capture of the camera, so that Make the captured image in the car reach a clear state. The camera may be a binocular fixed-focus camera, so that the first imaging component and the second imaging component are respectively one eye of the binocular fixed-focus camera. Wherein, the first imaging component includes a first camera, a polarizer, a near-infrared cut-off and a first image sensor, wherein the polarizer and the near-infrared cut-off are between the first camera and the first image sensor. The front and rear positions of the polarizer and the near-infrared cutoff are not limited here. The second imaging component includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is located between the second camera and the second image sensor. Wherein, the central wavelength of the VCSEL laser chip array is in the infrared band, so the VCSEL laser chip array is used for supplementing infrared light to the second imaging component. At this time, the central wavelength of the infrared narrowband filter in the second imaging component matches the central wavelength of the VCSEL laser chip array. For example, if the central wavelength of the VCSEL laser chip array is 940 nanometers (nm), then the central wavelength of the infrared narrowband filter is also 940 nm.

204. The road checkpoint capture system outputs a capture result according to the color image and the infrared image.

In this embodiment, the snapping result may be that a snapped image is output, or it may be that the content in the snapped frame is identified and output as a recognition result according to requirements, which is not specifically limited here. For example, after capturing the information of the vehicle, identify the vehicle and output the license plate number of the vehicle, the model, color and other information of the vehicle, and identify the portrait and output whether it is a criminal or a perpetrator.

If the snapping result is a snapping image, the road bayonet snapping system can specifically adopt the following scheme when outputting the snapping result according to the color image and the infrared image:

In a possible implementation, the road checkpoint capture system acquires the light illuminance of the current environment; then when the light illuminance is greater than a preset threshold, the road checkpoint capture system outputs the infrared image and the color image respectively as the capture result ; when the light illuminance is less than the second preset threshold, the road bayonet capture system performs dual-light fusion of the infrared image and the color image to generate a capture image, and outputs the capture image as the capture result. In this embodiment, the preset threshold can be set by the user, or can be determined according to the clarity of the captured image. The details are not limited here. It can be understood that, in this embodiment, it is also possible to determine whether to perform dual-light fusion according to time. For example, during the period from 7:00 a.m. to 6:00 p.m., the road checkpoint capture system uses the infrared image and the color image as the The capture results are output separately, and during the period from 6:00 pm to 7:00 am, the road bayonet capture system performs dual-light fusion of the infrared image and the color image before outputting.

In another manner, the road checkpoint capture system performs dual-light fusion of the infrared image and the color image to generate a capture image, and outputs the capture image as the capture result. That is to say, the road bayonet capture system can perform dual-light fusion of the color image and the infrared image to generate a capture image every time regardless of the current ambient light and illuminance.

In this embodiment, when the road bayonet capture system is performing dual-light fusion, the road bayonet capture system can perform in-vehicle enhancement and license plate overexposure suppression processing on the infrared image, and then combine the processed infrared image with the color image Fusion is performed to generate the captured image. There are two specific methods for license plate overexposure suppression processing. One way is that the road bayonet capture system can perform license plate enhancement after locating the license plate area based on an intelligent algorithm. Another way is that the road bayonet capture system converts the two images into the color coding space (YUV space), performs linear weighted fusion based on overexposure suppression on the Y component of the color image and the infrared image, and then converts the infrared image Combined with the color image to form a snapshot image.

The capture method of the road checkpoint capture system has been described above, and the road checkpoint capture method in the embodiment of the present application will be carried out below in conjunction with the road checkpoint capture process shown in Figure 3a and Figure 3b and the road checkpoint capture system shown in Figure 4 Further explanation:

In Fig. 4, the road checkpoint capture system includes an input device, a VCSEL laser chip array, a first camera, a polarizer, a near-infrared cut-off film, a first image sensor, a second camera, an infrared narrowband filter and a second image sensor ; Wherein, the polarizer and the near-infrared cut-off are between the first camera and the first image sensor, and the infrared narrow-band filter is located between the second camera and the second image sensor. Specifically, the camera structure in this embodiment may include: an optical lens system (two fixed-focus lenses, that is, the first camera and the second camera); light-sensitive sensors (two global exposure sensors, that is, the first image sensor and the second image sensor); an image signal processing system. Among them, the image signal processing system is used to process the original image collected by the sensor (such as demosaicing, noise reduction, white balance, color correction, etc.); the output system is used to output video or image; the signal synchronization system is used to send Or receive an external signal (such as controlling an external laser supplementary light component to emit light). In this embodiment, except that the optical lens system and the light-sensitive sensor are two sets of equipment for collecting dual optical path information, there is only one set of software and hardware for other parts of the camera. The working principle of the road bayonet capture system is shown in Figure 3a and Figure 3b:

When the light illuminance of the current environment is greater than the threshold (for example, when the threshold is limited to the daytime light illuminance), the polarizer and the near-infrared cut-off work together (as shown in Figure 3a);

When the vehicle passes the capture trigger line or the ground sensing coil (that is, the capture trigger device), the road bayonet capture system is triggered to start the capture process; and the VCSEL laser chip array is triggered to perform pulse supplementary light; then the visible light passes through the polarizer to weaken the strong reflection of the window , and then filter the infrared light through the near-infrared cut-off film, and generate the color image of the vehicle capture frame through the first image sensor; the visible light passes through another infrared narrow-band filter to leave only the infrared light, and generate the vehicle capture frame through the second image sensor Infrared images; the color image of the vehicle capture frame generated by the first image sensor and the infrared image of the vehicle capture frame generated by the second image sensor can be directly output to the intelligent algorithm for further processing (such as face recognition in the car, license plate recognition , vehicle information identification); it is also possible to generate the color image of the vehicle capture frame by the first image sensor and the infrared image of the vehicle capture frame generated by the second image sensor to perform dual-light fusion to generate a fusion color image output (in this embodiment, use Two-light fusion is performed for illustration).

When the light illuminance of the current environment is less than the threshold (for example, when the threshold is limited to the light illuminance at night), the near-infrared cut-off film works independently (as shown in Figure 3b);

When the vehicle passes the capture trigger line or the ground sensing coil (that is, the capture trigger device), the road bayonet capture system is triggered to start the capture process; and the VCSEL laser chip array is triggered to perform pulse supplementary light; then the visible light passes through the near-infrared cut-off sheet to filter the infrared light, The color image of the vehicle capture frame is generated by the first image sensor; the visible light passes through another infrared narrow-band filter to leave only the infrared light, and the infrared image of the vehicle capture frame is generated by the second image sensor; the vehicle is generated by the first image sensor The color image of the captured frame and the infrared image generated by the vehicle captured frame on the second image sensor can be directly output to the intelligent algorithm for further processing (such as face recognition in the car, license plate recognition, vehicle information recognition); An image sensor generates a color image of the captured frame of the vehicle, and performs dual light fusion on the infrared image of the captured frame of the vehicle generated on the second image sensor to generate a fused color image output.

The embodiment of the present application has the following advantages: in the road bayonet capture system, the activated supplementary light device adjusts the supplementary light intensity according to the light illuminance of the current environment, that is, when the light illuminance of the external environment is large, the supplementary light intensity is also large , which can effectively avoid the dark environment in the car under strong reflection and strong backlight scenes, thereby improving the effect of capturing images in the car to achieve a clear state; and when the light illuminance of the external environment is small, the intensity of supplementary light is also small, which can effectively To avoid too much correlation between the outside world and the brightness of the car environment, so as to improve the overall capture image effect and achieve a clear state. In this way, all-weather supplementary light can be realized in the car, so that the captured image effect can be consistent.

The road checkpoint shooting method in the embodiment of the present application has been described above, and the road checkpoint capture system in the embodiment of the present application is described below:

Please refer to Fig. 1 for details, an embodiment of the road checkpoint capture system in the embodiment of the present application includes: an input device 101, a laser supplementary light assembly 102, a camera 103 and an output device 104; wherein, the camera 103 includes a first imaging assembly and Second imaging component.

Optionally, the road checkpoint capture system may be as shown in FIG. 5 , wherein the laser supplementary light component 102 is a vertical cavity surface emitting laser VCSEL laser chip array.

Optionally, the camera 103 is a binocular fixed-focus camera, and the first imaging assembly includes a first camera, a polarizer, a near-infrared cut-off and a first image sensor, wherein the polarizer and the near-infrared cut-off are in the between the first camera and the first image sensor;

The second imaging component includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is between the second camera and the second image sensor.

Optionally, the first imaging component switches the filter combination of the polarizer and the near-infrared cut-off according to the light illumination of the current environment.

Optionally, the laser supplementary light component 102 is a VCSEL laser chip array, the central wavelength of the VCSEL laser chip array is in the infrared band, and the VCSEL laser chip array is used to perform infrared supplementary light on the second imaging component, wherein the first The second imaging assembly includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is between the second camera pair and the second image sensor, and the central wavelength of the infrared narrowband filter is It matches the central wavelength of the VCSEL laser chip array.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or part of the contribution to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, and other media that can store program codes.

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still understand the foregoing The technical solutions described in each embodiment are modified, or some of the technical features are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the application.

Claims (16)

1. A road checkpoint capture method, applied to a road checkpoint capture system, wherein the road checkpoint capture system includes a laser supplementary light assembly and a camera, and the camera includes: a first imaging assembly, a second imaging assembly, It is characterized by including: When the vehicle passes the capture trigger device of the road checkpoint, the road checkpoint capture system triggers the laser supplementary light component to supplement the light inside the vehicle, and triggers the camera to output a capture frame, wherein the The intensity of the supplementary light of the laser supplementary light component is proportional to the light intensity of the current environment; said first imaging assembly generates a color image; the second imaging component generates an infrared image; The road checkpoint capture system outputs a capture result according to the color image and the infrared image. 2. The method according to claim 1, wherein the laser supplementary light component is a vertical cavity surface emitting laser (VCSEL) laser chip array. 3. The method according to claim 1, wherein the camera is a binocular fixed-focus camera, and the first imaging assembly includes a first camera, a polarizer, a near-infrared cut-off sheet and a first image sensor, wherein , the polarizer and the near-infrared cutoff are between the first camera and the first image sensor; The second imaging component includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is between the second camera and the second image sensor. 4 . The method according to claim 3 , wherein the first imaging component switches the filter combination of the polarizer and the near-infrared cut-off according to the light illumination of the current environment. 5. The method according to claim 4, wherein generating a color image by the first imaging component comprises: The road checkpoint capture system acquires the light illuminance of the current environment; When the light illuminance is greater than a first preset threshold, the polarizing plate and the near-infrared cut-off plate in the first imaging component work simultaneously to generate the color image; When the illuminance of light is less than the first preset threshold, the near-infrared cut-off film in the first imaging component works to generate the color image. 6. The method according to any one of claims 1 to 5, wherein the laser supplementary light assembly is a VCSEL laser chip array, the central wavelength of the VCSEL laser chip array is an infrared band, and the VCSEL laser The chip array is used for supplementing infrared light on the second imaging component, wherein the second imaging component includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is in the Between the second camera and the second image sensor, the central wavelength of the infrared narrowband filter matches the central wavelength of the VCSEL laser chip array. 7. The method according to any one of claims 1 to 6, wherein the road checkpoint capture system outputting a capture result according to the color image and the infrared image comprises: The road checkpoint capture system acquires the light illuminance of the current environment; When the light illuminance is greater than a second preset threshold, the road checkpoint capture system outputs the infrared image and the color image respectively as the capture result; When the light illuminance is less than the second preset threshold, the road checkpoint capture system performs dual-light fusion of the infrared image and the color image to generate a capture image, and outputs the capture image, the capture The image is used as the snapping result. 8. The method according to any one of claims 1 to 6, wherein the road bayonet capture system outputs shooting results according to the color image and the infrared image including: The road checkpoint capture system performs dual-light fusion of the infrared image and the color image to generate a capture image, and outputs the capture image as the capture result. 9. A road bayonet capture system, characterized in that it comprises: an input device, a laser supplementary light assembly, a video camera and an output device; The camera includes a first imaging component and a second imaging component; The input device is used to obtain a trigger signal when the vehicle passes the shooting trigger device of the road checkpoint; The laser supplementary light component is used to supplement the light inside the vehicle according to the trigger signal, wherein the supplementary light intensity of the laser supplementary light component is proportional to the light illuminance of the current environment; The first imaging component is used to generate a color image; The second imaging component is used to generate an infrared image; The output device is configured to output a snapshot result according to the color image and the infrared image. 10. The system according to claim 9, wherein the laser supplementary light component is a VCSEL laser chip array. 11. The system according to claim 9, wherein the camera is a binocular fixed-focus camera, and the first imaging assembly includes a first camera, a polarizer, a near-infrared cutoff and a first image sensor, wherein , the polarizer and the near-infrared cutoff are between the first camera and the first image sensor; The second imaging component includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is between the second camera and the second image sensor. 12 . The system according to claim 11 , wherein the first imaging component switches the filter combination of the polarizer and the near-infrared cut-off film according to the light illumination of the current environment. 13 . 13. The system according to claim 12, wherein the input device is also used to obtain the light illuminance of the current environment; The first imaging component is specifically configured to, when the illuminance of the light is greater than a first preset threshold, the polarizing plate and the near-infrared cut-off plate in the first imaging component work at the same time, and generate the color image; When the light illuminance is less than the first preset threshold, the near-infrared cut-off film in the first imaging component works to generate the color image. 14. The system according to any one of claims 9 to 13, wherein the laser supplementary light assembly is a VCSEL laser chip array, the central wavelength of the VCSEL laser chip array is an infrared band, and the VCSEL laser The chip array is used to supplement infrared light to the second imaging component, wherein the second imaging component includes a second camera, an infrared narrowband filter and a second image sensor, wherein the infrared narrowband filter is Between the second camera pair and the second image sensor, the central wavelength of the infrared narrowband filter matches the central wavelength of the VCSEL laser chip array. 15. The system according to any one of claims 9 to 14, wherein the input device is configured to obtain the light illuminance of the current environment; The output device is specifically configured to respectively output the infrared image and the color image as the capture result when the light illuminance is greater than a second preset threshold; when the light illuminance is less than the second preset threshold When the threshold is reached, the infrared image and the color image are subjected to dual-light fusion to generate a snapshot image, and the snapshot image is output, and the snapshot image is used as the snapshot result. 16. The system according to any one of claims 9 to 14, wherein the output device is specifically configured to perform dual-light fusion of the infrared image and the color image to generate a snapshot image, and output the The snapshot image is used as the snapshot result.