CN108766002A - A kind of traffic lights identification and prior-warning device for oversize vehicle - Google Patents

Abstract

The invention provides a traffic light recognition and early warning device, which can capture the image information of the traffic light in front of the vehicle through the camera on the top of the vehicle, analyze and identify the state of the traffic light through the chip, and then transmit it to the LED display at the rear of the vehicle to display the text , shape and other visual information, and at the same time broadcast the real-time traffic light color, shape, time and other status through the loudspeaker, centering on large vehicles, spread the instant information of traffic lights to the surrounding, so as to avoid the traffic lights caused by large vehicles All kinds of inconvenience. The present invention also provides a method for displaying traffic light information at the rear of a large vehicle, the method can identify the state of the traffic light in front of the vehicle and propagate it to the rear, so as to help the owner of the vehicle behind to know the state of the traffic light in front in real time; at the same time, the method It can also display other information such as advertisements on the rear of the large vehicle.

Description

A traffic light recognition and early warning device for large vehicles

technical field

The invention relates to a traffic light recognition and early warning device, specifically a device installed on a large vehicle such as a bus, which uses machine vision and image processing technology to identify the traffic light information in front and makes a comprehensive judgment in combination with the vehicle speed and vehicle distance detection system , and then through the LED display screen and loudspeaker, it is an intelligent alarm device that gives early warning to vehicles on the side and rear of large vehicles.

Background technique

Traffic lights are one of the main means of traffic control. They play a key role in diverting traffic flow and improving road capacity. Therefore, it is particularly important to ensure the accurate transmission of traffic light information. But traffic signal light installation position and angle all are fixed, and at crossroads, when there is large-scale vehicle ahead, the vehicle that follows behind often can't see traffic signal light. However, large vehicles start slowly, and it is possible that the traffic light has changed from green to red while passing. If the vehicles behind follow, it is easy to cause various violations of traffic rules and even cause traffic accidents; if you choose to wait, it is easy to cause traffic accidents. Traffic jam. In order to reduce the occurrence of such situations, it is necessary to develop an intelligent alarm device that can be installed at the rear of a large vehicle to warn vehicles behind the side and rear of the large vehicle with text, shape, sound, etc.

Contents of the invention

The purpose of the present invention is to provide a traffic light recognition and early warning device for large vehicles, which can capture the image information of the traffic lights in front of the vehicle through the camera on the top of the vehicle, and analyze and identify the status of the traffic lights through the chip, and then transmit it to the vehicle The LED display at the rear displays visual information such as text and shape, and at the same time broadcasts the color, shape, time and other status of real-time traffic lights through the loudspeaker. Centering on large vehicles, it spreads the instant information of traffic lights to the surroundings, so as to avoid accidents caused by large vehicles. All the inconveniences caused by blocking traffic lights.

Another object of the present invention is to provide a method for displaying traffic light information at the rear of a large vehicle, which can identify the state of the traffic light in front of the vehicle and propagate it to the rear, so as to help the owner of the vehicle behind to know the state of the traffic light ahead in real time; at the same time , the method can also display other information such as advertisements on the rear of a large vehicle.

The purpose of the present invention is achieved like this:

The present invention provides a traffic light recognition and early warning device for large vehicles, comprising a camera, an LED display, a loudspeaker, an ultrasonic vehicle distance probe and a host, and is characterized in that the camera is installed in the center of the top of the large vehicle, and the LED display, The loudspeaker and ultrasonic distance probe are installed at the rear of the large vehicle, the host is installed near the driver's seat, and the camera, LED display, speaker, and ultrasonic distance probe are all electrically connected to the host through cables.

The host includes a main control circuit module, a battery electrically connected to the main control circuit module, an external control module, a vehicle networking module, a vehicle speed detection module, a video acquisition module, a traffic light identification module, an ultrasonic distance detection module, a power supply and A battery management module, an LED display module and an audio module; wherein, the video acquisition module is electrically connected to the camera, the ultrasonic distance detection module is electrically connected to the ultrasonic vehicle distance probe, the LED display module is electrically connected to the LED display, and the audio module is electrically connected to the speaker.

An SD memory card is installed inside the LED display module.

The described external control module is provided with a touch screen and a USB interface.

The power supply voltage stabilization and battery management module is connected with the vehicle cigarette lighter interface to obtain the power required by the equipment.

A method for displaying traffic light information at the rear of a large vehicle provided by the present invention comprises the following steps:

(1) Capture the real-time image in front of the large vehicle, analyze the shape information and characteristic information of the traffic light according to the real-time image; detect the speed information of the large vehicle; detect the distance information between the large vehicle and the rear vehicle;

(2) make a judgment,

(2-1) When the speed of the large vehicle is above 20km/h or the distance between the large vehicle and the vehicle behind is greater than 20 meters, play an advertising video or display other information at the rear of the vehicle;

(2-2) When the speed of the large vehicle is below 10km/h and the distance between the large vehicle and the vehicle behind is less than 20 meters, the shape information and characteristic information of the traffic light are displayed at the rear of the vehicle, and the shape information and characteristic information of the traffic light are displayed The information is converted into a voice message broadcast (such as broadcasting "red light ahead, please stop and wait", "green light ahead, please keep the distance between vehicles", "yellow light ahead, please slow down").

In the described method, if the shape information of the traffic light is circular (that is, the traffic light is a circular traffic light), and the characteristic information of the traffic light is red, green, and yellow lights, then the state of the traffic light is expressed in text And display at the rear of the vehicle (such as displaying text "red light", "green light", "yellow light"); if the shape information of the traffic light is an arrow (that is, the traffic light is an arrow traffic light), the characteristic information of the traffic light is direction The red, green and yellow lights of the traffic lights are displayed in the form of red, green and yellow arrows, and the status of the traffic lights is displayed at the rear of the vehicle (such as red "←", green "↑", yellow "→ ").

In the method, if the characteristic information of the traffic light has time, the time is displayed in the rear of the vehicle in the form of characters.

In the method, other information in step (2-1) may be information such as location, weather, and emergency news.

The advantage of the product of the present invention is that in terms of function, the present invention can effectively avoid the situation that the traffic light information cannot be understood in time due to the occlusion of the vehicle in front, and can also reduce the failure of violating traffic rules due to fatigue driving, etc. probability. Technically, high-definition cameras are used to intelligently capture traffic lights at intersections, and then image processing technology is used to identify traffic lights, and algorithms are used to filter and denoise multiple times to ensure the accuracy of recognition. Display traffic light information through words and shapes, and hang on the rear of large vehicles, effectively solving the problem of blocking the line of sight. Simultaneous voice announcements can also be made to provide auditory feedback. In addition, during normal driving, simple advertisements can be played to improve the utilization rate and increase the practical value of the device.

Description of drawings

Fig. 1 is a schematic view of the front side of the device of the present invention.

Fig. 2 is a schematic diagram of the side and rear of the device of the present invention.

Fig. 3 is a circuit design block diagram of the present invention.

Fig. 4 is a main control circuit diagram of the present invention.

Fig. 5 is a circuit diagram of the battery management of the present invention.

Fig. 6 is a circuit diagram of video signal acquisition of the present invention.

Fig. 7 is a circuit diagram of the LED display module of the present invention.

Fig. 8 is a circuit diagram of the SD card of the present invention.

Fig. 9 is a circuit diagram of the ultrasonic distance detection of the present invention.

Fig. 10 is an audio circuit diagram of the present invention.

Fig. 11 is an external control circuit diagram of the present invention.

Fig. 12 is a vehicle speed detection circuit diagram of the present invention.

Fig. 13 (1) is one of the traffic light recognition circuit diagrams of the present invention.

Fig. 13 (2) is the second circuit diagram of the traffic light identification of the present invention.

Fig. 13 (3) is the third circuit diagram of the traffic light identification of the present invention.

Fig. 14 is a circuit diagram of the vehicle networking module of the present invention.

Fig. 15 is a voltage stabilizing circuit diagram of the present invention.

Fig. 16 is a circuit diagram of the camera of the present invention.

Fig. 17 is a working flowchart of the present invention.

In the figure: 1. Camera, 2. LED display, 3. Speaker, 4. Ultrasonic vehicle distance probe, 5. External control module, 6. Vehicle networking module, 7. Vehicle speed detection module, 8. Video acquisition module, 9 1. Traffic light recognition module, 10. Ultrasonic distance detection module, 11. Power supply and battery management module, 12. LED display module, 13. Audio module, 14. Main control circuit module.

Detailed ways

The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

Referring to Fig. 1, Fig. 2 and Fig. 3, the camera 1 is installed in the center of the top of the large vehicle, the LED display 2, the speaker 3 and the ultrasonic distance probe 4 are installed at the rear of the large vehicle, and the above parts are electrically connected to the host through cables . The host part is installed near the driver's seat. The host is equipped with a battery, an external control module, a vehicle networking module, a vehicle speed detection module, a video acquisition module, a traffic light recognition module, an ultrasonic distance detection module, a power supply and battery management module, and an LED display. modules, all of which are electrically connected to the main control circuit module. In addition, the LED display module is equipped with an SD memory card; the external control module is equipped with a touch screen and USB interface; the power supply voltage stabilization and battery management module are connected to the vehicle cigarette lighter interface to obtain the power required by the equipment.

As shown in Figure 4, the main control circuit is a single-chip quasi-system composed of AT89S52 and its auxiliary circuits. The oscillator circuit is composed of the crystal oscillator XTAL and two 30PF capacitors. The charging and discharging of the capacitors and the touch screen can constitute power-on reset and There are two reset methods for touch screen reset, and two step-down voltage regulator chips LM1117-3.3V and LM1117-2.5V can be used to convert 5V to 3.3V, 2.5V, 1.8V and 1.2V as some required circuits meet the voltage requirements.

As shown in Figure 5, the battery management circuit uses TP4057 as the main control chip, and TP4057 can work with adapter power. An external sense resistor and blocking diode are not required due to the internal PMOSFET architecture, plus anti-charge circuitry. Thermal feedback regulates charge current to limit die temperature during high power operation or high ambient temperature conditions. The charging voltage is fixed at 4.2V, while the charging current can be programmed externally with a single resistor. When the charge current drops to 1/10 of the set value after reaching the final float voltage, TP4057 will automatically terminate the charge cycle. In the power supply and battery management circuit, the red light indicates that it is not fully charged, and the green light indicates that it is fully charged.

As shown in Figure 6, the video signal acquisition circuit is based on ADV7181D and FPGA technology. The ADV7181D is a high quality, single chip, multiformat video decoder and graphics digitizer. This multi-format decoder supports conversion of PAL, NTSC and SECAM standard signals in composite video or S-Video to digital ITU-R BT.656 format. The ADV7181D also supports decoding RGB/YPrPb component video signals into digital YCrCb or RGB pixel output streams. Supported component video includes standards such as 525i, 625i, 525p, 625p, 720p, 1080i, and many other HD and SMPTE standards. The ADV7181D also supports graphics digitization, which is capable of digitizing RGB graphics signals at VGA to XGA rates and converting them to digital DDR RGB or YCrCb pixel output streams. In addition, the ADV7181D can simultaneously process CVBS and standard definition RGB signals to support SCART and overlay functions. The mixing of these signals is controlled by the fast blanking (FB) pin. The ADV7181D mainly consists of two processing sections. The first part is the Standard Definition Processor (SDP), which can handle all types of PAL, NTSC and SECAM signals. The second part is the component video signal processing block (CP), which can process YPrPb and RGB component formats, including RGB graphics.

As shown in Figure 7, the LED screen circuit uses 74F138 to select the channel and connect the triode to give the LED enough driving current to light it up. 74F138 is a high-speed 38 decoder. Compared with 74LS138, 74F138 has higher speed. When the output port of 74F138 is selected, the port outputs low level, and the triode is turned on and the selected LCD screen is lit.

As shown in Figure 8, the SD card circuit consists of SRAM chips ISSI IS61WV51216ALL/BLL and IS64WV51216BLL, which are high-speed 8M-bit static RAM, organized into 512K bytes by 16 bits. It is fabricated using ISSI's high-performance CMOS technology.

As shown in Figure 9, the ultrasonic distance detection directly uses the URM37 ultrasonic ranging module. Ultrasonic sensors are sensors that convert ultrasonic signals into other energy signals (usually electrical signals). Ultrasound is a mechanical wave with a vibration frequency higher than 20KHz. It has the characteristics of high frequency, short wavelength, small diffraction phenomenon, especially good directionality, and can become ray and directional propagation. Ultrasound has a great penetrating ability to liquids and solids, especially in solids that are opaque to sunlight. When the ultrasonic wave hits the impurity or the interface, it will produce significant reflection to form an echo, and when it hits the moving object, it will produce the Doppler effect.

As shown in Figure 10, the audio module is composed of VS1003 chip. VS1003 is a single chip MP3/WMA/MIDI audio decoder and ADPCM encoder. It contains a high-performance, self-owned low-power DSP processor core VS_DSP4, working data memory, providing 5KB instruction RAM and 0.5KB data RAM for user applications. Serial control and data interfaces, 4 general-purpose I/O ports, a UART, and a high-quality variable-sample-rate ADC and stereo DAC, as well as a headphone amplifier and ground buffer. VS1003 receives the input bit stream through a serial interface, it can be used as a system slave. The incoming bitstream is decoded and passed through a digital fader to an 18-bit oversampled multibit ε-ΔDAC. The decoder is controlled via the serial bus. In addition to basic decoding, it can also do other special applications in user RAM, such as DSP audio processing.

As shown in Figure 11, the external control circuit is composed of DIP switch and 74LS138 decoder. When a certain channel is selected, the channel is at low level, a signal is given to the main control circuit, and then the next operation is performed.

As shown in Figure 12, the vehicle speed detection circuit uses the Hall sensor to detect the vehicle speed, which is stored in the AT24C02 after being processed by the single-chip microcomputer through the signal preprocessing circuit. Hall sensors can be divided into their applications according to the nature of the detected object: direct application and indirect application. The former is to directly detect the magnetic field or magnetic properties of the detected object itself, and the latter is to detect the artificially set magnetic field on the detected object, using this magnetic field as the carrier of the detected information, through which, many non-electric, non-magnetic Physical quantities such as force, torque, pressure, stress, position, displacement, velocity, acceleration, angle, angular velocity, revolutions, rotational speed, and the time when the working state changes, etc., are converted into electricity for detection and control. So the Hall sensor can be used as the vehicle speed detection device.

As shown in Figure 13, the traffic light recognition circuit uses FPGA (Field-Programmable Gate Array) as a video processing chip, that is, field programmable gate array, which is further developed on the basis of programmable devices such as PAL, GAL, and CPLD. product. It emerged as a semi-custom circuit in the field of application-specific integrated circuits (ASIC), which not only solves the shortcomings of custom circuits, but also overcomes the shortcomings of the limited number of original programmable device gates. The lock collar integrated inside the FPGA can multiply the frequency of the external clock, and the core frequency can reach hundreds of M, while the running speed of the single-chip microcomputer is much lower. In high-speed occasions, single-chip microcomputers cannot replace FPGAs. FPGA internal programs run in parallel and have the ability to handle more complex functions. Single-chip microcomputer programs are executed serially, and the next one can only be executed after one is executed. When dealing with emergencies, only limited interrupt resources can be called; while different logics of FPGA can be parallelized Execution, different tasks can be processed at the same time, which leads to more efficient FPGA work. Therefore, FPGA has great advantages as video signal processing.

As shown in Figure 14, the EST527 IoV module is an OBD protocol data analysis product for the IOV standard module of a car-gauge machine. The AT command set of this module is simple and easy to use. The EST527 Internet of Vehicles OBD module collects and records driving behavior habits such as start time, end time, and total fuel consumption. Commonly used vehicle speed, speed, water temperature, voltage, OBD fault code information, and passes the data through The communication is transferred to the background. Car networking big data, integrating OBD, GPS, etc., to obtain vehicle data, geographic location information, and driving behavior habit data.

As shown in Figure 15, the voltage regulator circuit uses MC34063 as the main chip, and the voltage of 12V will be converted to 5V in the future. The MC34063 chip itself contains the monolithic control circuit of the main functions required by the DC/DC converter and is cheap. It is composed of a reference voltage generator with automatic temperature compensation function, a comparator, an oscillator with controllable duty ratio, an R-S flip-flop and a large current output switching circuit, etc. The device can be used in the control core of boost converter, buck converter and inverter, and the DC/DC converter formed by it only needs a small amount of external components. It is mainly used in systems based on microprocessors (MPUs) or single-chip microcomputers (MCUs).

As shown in Figure 16, the camera uses OV7670 as video capture and FIFO as data buffer. Since FIFO is used as the data buffer, the data acquisition is very simple. The user only needs to care about how to read it, and does not need to care about how the specific data is collected. This can reduce or even care about the CMOS control and timing relationship. image acquisition can be realized.

The described traffic light recognition and early warning device for large vehicles, its specific operation method is:

(1) Install the main unit in the vehicle and introduce 12V DC from the vehicle. On the one hand, the battery is charged through the power supply and battery management module, and on the other hand, the device is powered through the power supply and battery management module.

(2) When the driver presses the touch screen installed on the dashboard, the camera starts to work, and transmits the captured real-time images to the video acquisition circuit for feature extraction and selection. The traffic light recognition module will analyze the shape and characteristics of the traffic light, and transmit the information to the main control circuit module.

(3) When the device detects that the speed is above 20km/h or there is no vehicle within 20 meters behind the vehicle through the vehicle speed detection module and the ultrasonic distance detection module, the LED display module will display the advertising video in the SD card on the lower right corner of the LED display, and Display information such as location, weather and emergency news transmitted by the vehicle networking module on the upper right corner of the LED display.

(4) To avoid improper switching caused by too fast mode switching or other interference. When the speed is 10-20km/h, it belongs to the buffer zone, the vehicle accelerates, and the system functions remain unchanged. When the vehicle speed detection module detects that the vehicle speed is below 10km/h and the ultrasonic distance detection module detects that there is a vehicle within 20 meters, the main control circuit module transmits the traffic light information received in step (2) to the LED display module. The distance between the car and the rear car measured by the distance detection module is displayed in a larger font in the upper left corner of the LED display module to remind the driver behind, and the audio module will broadcast the traffic light information voice. If the traffic light is a circular traffic light, the LED display will display red, green and yellow lights in text; if the traffic light is an arrow traffic light, the LED display will display the shape of the arrow on the screen; if the traffic light has a time , the time will be displayed under the text.

Claims (9)

1. A traffic light identification and early warning device for large vehicles, comprising camera, LED display, loudspeaker, ultrasonic vehicle distance probe and host, characterized in that: the camera is installed in the center of the top of the large vehicle, LED display, loudspeaker and The ultrasonic vehicle distance probe is installed at the rear of the large vehicle, and the host is installed near the driver's seat. The camera, LED display, speaker, and ultrasonic vehicle distance probe are all electrically connected to the host through cables. 2. The device according to claim 1, characterized in that: the host includes a main control circuit module, and a battery electrically connected to the main control circuit module, an external control module, a vehicle-mounted Internet of Vehicles module, a vehicle speed detection module, a video Acquisition module, traffic light recognition module, ultrasonic distance detection module, power supply and battery management module, LED display module and audio module; among them, the video acquisition module is electrically connected to the camera, the ultrasonic distance detection module is electrically connected to the ultrasonic vehicle distance probe, and the LED display The module is electrically connected with the LED display, and the audio module is electrically connected with the speaker. 3. The device according to claim 1, wherein an SD memory card is installed inside the LED display module. 4. The device according to claim 1, characterized in that: said external control module is provided with a touch screen and a USB interface. 5 . The device according to claim 1 , wherein the power supply voltage stabilization and battery management module is connected to the vehicle cigarette lighter interface to obtain the power required by the equipment. 6 . 6. A method for displaying traffic light information at the rear of a large vehicle, comprising the following steps: (1) Capture the real-time image in front of the large vehicle, analyze the shape information and characteristic information of the traffic light according to the real-time image; detect the speed information of the large vehicle; detect the distance information between the large vehicle and the rear vehicle; (2) make a judgment, (2-1) When the speed of the large vehicle is above 20km/h or the distance between the large vehicle and the vehicle behind is greater than 20 meters, play an advertising video or display other information at the rear of the vehicle; (2-2) When the speed of the large vehicle is below 10km/h and the distance between the large vehicle and the vehicle behind is less than 20 meters, the shape information and characteristic information of the traffic light are displayed at the rear of the vehicle, and the shape information and characteristic information of the traffic light are displayed The information is converted into a voice information broadcast. 7. The method according to claim 6, characterized in that: if the shape information of the traffic light is circular, and the characteristic information of the traffic light is red, green, and yellow lights, the state of the traffic light is expressed in text and Display at the rear of the vehicle; if the shape information of the traffic light is an arrow, and the characteristic information of the traffic light is red, green, and yellow lights with directions, then the red, green, and yellow arrows are used to indicate the status of the traffic light. displayed at the end. 8. The method according to claim 6, characterized in that if the characteristic information of the traffic light has time, the time will be displayed in text form at the rear of the vehicle. 9. The method according to claim 6, characterized in that: the other information in step (2-1) is location information, weather information or emergency news information.