CN114954307A - Driving assistance system based on artificial intelligence - Google Patents
Driving assistance system based on artificial intelligence Download PDFInfo
- Publication number
- CN114954307A CN114954307A CN202210848230.8A CN202210848230A CN114954307A CN 114954307 A CN114954307 A CN 114954307A CN 202210848230 A CN202210848230 A CN 202210848230A CN 114954307 A CN114954307 A CN 114954307A
- Authority
- CN
- China
- Prior art keywords
- module
- vehicle
- central control
- control module
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013473 artificial intelligence Methods 0.000 title claims abstract description 15
- 238000012544 monitoring process Methods 0.000 claims abstract description 96
- 230000007613 environmental effect Effects 0.000 claims abstract description 13
- 230000006870 function Effects 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims abstract description 7
- 230000008569 process Effects 0.000 claims abstract description 4
- 238000004891 communication Methods 0.000 claims description 18
- 210000001747 pupil Anatomy 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 9
- 206010000117 Abnormal behaviour Diseases 0.000 claims description 8
- 238000013135 deep learning Methods 0.000 claims description 8
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 8
- 230000006399 behavior Effects 0.000 claims description 6
- 238000012790 confirmation Methods 0.000 claims description 6
- 230000002159 abnormal effect Effects 0.000 claims description 3
- 239000000446 fuel Substances 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 claims description 3
- 206010039203 Road traffic accident Diseases 0.000 abstract description 6
- 230000009471 action Effects 0.000 description 11
- 230000000875 corresponding effect Effects 0.000 description 6
- 238000001514 detection method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 208000003443 Unconsciousness Diseases 0.000 description 2
- 238000004887 air purification Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000001502 supplementing effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H3/00—Other air-treating devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/008—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/2018—Central base unlocks or authorises unlocking
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60S—SERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
- B60S1/00—Cleaning of vehicles
- B60S1/02—Cleaning windscreens, windows or optical devices
- B60S1/04—Wipers or the like, e.g. scrapers
- B60S1/06—Wipers or the like, e.g. scrapers characterised by the drive
- B60S1/08—Wipers or the like, e.g. scrapers characterised by the drive electrically driven
- B60S1/0818—Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q2300/00—Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
- B60Q2300/30—Indexing codes relating to the vehicle environment
- B60Q2300/31—Atmospheric conditions
- B60Q2300/314—Ambient light
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Automation & Control Theory (AREA)
- Traffic Control Systems (AREA)
Abstract
本发明公开了一种基于人工智能的辅助驾驶系统,包括中央控制模块;周围环境监测模块,用于监测车辆周围的环境情况,并反馈给中央控制模块;车内环境监测模块,用于监测车辆内部的环境情况,并反馈给中央控制模块;车辆状态监测模块,用于监测车辆本体的运行状况,并反馈给中央控制模块;驾驶人状态监测模块,用于监测当前驾驶人员的疲劳状态,并反馈给中央控制模块;驾驶辅助模块,在中央控制模块控制下实现车速调节、车道调节、超车、刹车、泊车功能,以实现驾驶员在驾驶过程中对车辆驾驶辅助;优点是能够提高安全驾驶系数,提醒驾驶员规范操作,规避安全道路安全风险,保障人员和车辆安全,减少交通事故的发生。
The invention discloses an assisted driving system based on artificial intelligence, comprising a central control module; a surrounding environment monitoring module for monitoring the environmental conditions around the vehicle and feeding back to the central control module; and an in-vehicle environment monitoring module for monitoring the vehicle The internal environmental conditions are fed back to the central control module; the vehicle status monitoring module is used to monitor the running status of the vehicle body and fed back to the central control module; the driver status monitoring module is used to monitor the current driver's fatigue status and Feedback to the central control module; the driving assistance module, under the control of the central control module, realizes the functions of speed adjustment, lane adjustment, overtaking, braking and parking, so as to realize the driver's driving assistance to the vehicle during the driving process; the advantage is that it can improve safe driving. coefficient, reminding drivers to operate properly, avoid road safety risks, ensure the safety of people and vehicles, and reduce the occurrence of traffic accidents.
Description
技术领域technical field
本发明涉及领域,尤其涉及一种基于人工智能的辅助驾驶系统。The present invention relates to the field, in particular to an assisted driving system based on artificial intelligence.
背景技术Background technique
随着社会经济的发展和人们生活水平的提高,人们对汽车的使用越来越多,汽车也逐渐融入到人们的生活中去,安全驾驶问题变得尤为重要,人工智能驾驶辅助技术成为社会研究的热点。目前辅助驾驶系统一般基于摄像头和雷达的技术,通过提供车辆前方、侧面及后方的环境数据并采取相应操作,针对即将发生的风险向驾驶员发出警告,为驾驶员提供辅助,它们还能够提供制动和转向输入等直观的提示或操作,帮助“引导”驾驶员保持在车道内行驶,或是提供自适应巡航控制系统等便利功能。With the development of social economy and the improvement of people's living standards, people use more and more cars, and cars are gradually integrated into people's lives. The issue of safe driving has become particularly important, and artificial intelligence driving assistance technology has become a social research hot spot. At present, assisted driving systems are generally based on camera and radar technology. By providing environmental data in front, side and rear of the vehicle and taking corresponding actions, it can warn the driver of imminent risks and provide assistance to the driver. They can also provide control. Intuitive prompts or actions, such as motion and steering inputs, help “guide” the driver to stay in the lane, or provide convenience features such as adaptive cruise control.
但传统的辅助驾驶系统功能有限,不具有车内环境监测以及驾驶员监测分析功能,特别是近年来,交通事故率越来越高,并且多数交通事故是由于人为因素导致的,例如驾驶员疲劳驾驶、酒驾、醉驾等;数据表明,不专心驾驶是导致车祸的重要因素之一;因此,迫切需要在现有的辅助驾驶系统上增加对驾驶员的监测功能,以提高安全驾驶系数,提醒驾驶员规范操作,规避安全道路安全风险,保障人员和车辆安全,减少交通事故的发生。However, the traditional assisted driving system has limited functions, and does not have the functions of in-vehicle environment monitoring and driver monitoring and analysis. Especially in recent years, the traffic accident rate is getting higher and higher, and most traffic accidents are caused by human factors, such as driver fatigue. Driving, drunk driving, drunk driving, etc.; data shows that inattentive driving is one of the important factors leading to car accidents; therefore, it is urgent to increase the driver monitoring function on the existing assisted driving system to improve the safe driving factor and remind driving Operators should operate in a standardized manner, avoid road safety risks, ensure the safety of personnel and vehicles, and reduce the occurrence of traffic accidents.
发明内容SUMMARY OF THE INVENTION
为了解决上述现有技术中存在的不足,本发明提供一种基于人工智能的辅助驾驶系统,其能够提高安全驾驶系数,提醒驾驶员规范操作,规避安全道路安全风险,保障人员和车辆安全,减少交通事故的发生。In order to solve the above-mentioned deficiencies in the prior art, the present invention provides an assisted driving system based on artificial intelligence, which can improve the safe driving factor, remind drivers to operate in a standardized manner, avoid safe road safety risks, ensure the safety of personnel and vehicles, reduce the occurrence of traffic accidents.
本发明解决上述技术问题所采用的技术方案为:一种基于人工智能的辅助驾驶系统,包括The technical solution adopted by the present invention to solve the above technical problems is as follows: an assisted driving system based on artificial intelligence, comprising:
中央控制模块;Central control module;
周围环境监测模块,用于监测车辆周围的环境情况,并反馈给所述中央控制模块;a surrounding environment monitoring module for monitoring the environmental conditions around the vehicle and feeding back to the central control module;
车内环境监测模块,用于监测车辆内部的环境情况,并反馈给所述中央控制模块;an in-vehicle environment monitoring module, which is used to monitor the environmental conditions inside the vehicle and feed it back to the central control module;
车辆状态监测模块,用于监测车辆本体的运行状况,并反馈给所述中央控制模块;a vehicle state monitoring module for monitoring the running state of the vehicle body and feeding back to the central control module;
驾驶人状态监测模块,用于监测当前驾驶人员的疲劳状态,并反馈给所述中央控制模块;a driver state monitoring module, which is used to monitor the fatigue state of the current driver and feed it back to the central control module;
驾驶辅助模块,在所述中央控制模块控制下实现车速调节、车道调节、超车、刹车、泊车功能,以实现驾驶员在驾驶过程中对车辆驾驶辅助;A driving assistance module, which realizes the functions of vehicle speed adjustment, lane adjustment, overtaking, braking and parking under the control of the central control module, so as to realize the driver's driving assistance to the vehicle during the driving process;
警示模块,在所述中央控制模块控制下实现报警提醒;a warning module, which realizes an alarm reminder under the control of the central control module;
通讯模块,用于中央控制模块与远程云端的通讯;The communication module is used for the communication between the central control module and the remote cloud;
终端模块,与所述远程云端电连接,用于实现与所述远程云端之间的交互通讯。The terminal module is electrically connected with the remote cloud, and is used for realizing interactive communication with the remote cloud.
作为优选地,所述周围环境监测模块包括大气监测单元、毫米波雷达模块、摄像头模块和补光灯,所述大气监测单元设置在车辆上,用于监测当前大气环境状况,并反馈给所述中央控制模块,所述毫米波雷达模块设置在车辆的顶部,且用于实时监测障碍物与本车辆之间的距离,所述毫米波雷达模块与所述中央控制模块电连接,所述摄像头模块用于检测车辆周围的路况,并反馈给所述中央控制模块,所述补光灯设在车辆上,与所述中央控制模块电连接,以提高对目标区域的亮度。该结构中,大气监测单元用于监测当前车辆所处环境的大气环境,大气环境包括空气温湿度、光照强度、雨量信息、PM2.5等,从而更好通过中央控制模块来控制车辆内的设备;毫米波雷达模块以及摄像头模块配合使用从而可以实时识别出车辆周侧路况的行人、路况、目标车辆以及障碍物等的图像信息,并配合驾驶辅助模块,使得在驾驶时,根据现场情况针对性做出调节,并且对接收的实时路况信息及报警信息还可以进行播放,实时提醒驾驶员,对探测到较近的目标距离发出报警,进一步提高驾驶的安全性。Preferably, the surrounding environment monitoring module includes an atmospheric monitoring unit, a millimeter-wave radar module, a camera module and a fill light, and the atmospheric monitoring unit is provided on the vehicle and is used to monitor the current atmospheric environment and feed back to the a central control module, the millimeter-wave radar module is arranged on the top of the vehicle and is used to monitor the distance between obstacles and the vehicle in real time, the millimeter-wave radar module is electrically connected to the central control module, and the camera module It is used to detect the road conditions around the vehicle and feed it back to the central control module. The supplementary light is arranged on the vehicle and is electrically connected to the central control module to improve the brightness of the target area. In this structure, the atmospheric monitoring unit is used to monitor the atmospheric environment of the current vehicle environment. The atmospheric environment includes air temperature and humidity, light intensity, rainfall information, PM2.5, etc., so as to better control the equipment in the vehicle through the central control module ;The millimeter wave radar module and the camera module can be used together to identify the image information of pedestrians, road conditions, target vehicles and obstacles in real time around the vehicle. Make adjustments, and can also play the received real-time road condition information and alarm information, remind the driver in real time, and issue an alarm when the target distance is detected to further improve the safety of driving.
作为优选地,当所述大气监测单元监测当前车辆所处环境较暗时,发送第一指令给所述中央控制模块,所收到述中央控制模块收到第一指令后生成补光指令,并发送给所述补光灯,所述补光灯收到补光指令后对目标区域进行补光处理。该结构中,在光线不足情况下,中央控制模块发出补光指令启动补光灯来提高对目标区域的亮度而进行补光,并保持其他区域原有亮度,能因此在夜间、雨雪雾霾等照明条件不佳情况下,有效的改善采集图像模糊的不足,通过目标区域的补光,能提高成像质量和探测距离,减少天气环境对驾驶员的影响,减少事故的发生。Preferably, when the atmospheric monitoring unit monitors that the current environment where the vehicle is located is dark, it sends a first instruction to the central control module, and the received central control module generates a fill light instruction after receiving the first instruction, and It is sent to the supplementary light, and the supplementary light performs supplementary light processing on the target area after receiving the supplementary light instruction. In this structure, in the case of insufficient light, the central control module sends a supplementary light command to start the supplementary light to increase the brightness of the target area to supplement the light, and maintain the original brightness of other areas. When the lighting conditions are not good, it can effectively improve the lack of blurring of the collected images. By supplementing the light in the target area, it can improve the imaging quality and detection distance, reduce the impact of the weather and environment on the driver, and reduce the occurrence of accidents.
作为优选地,所述大气监测单元包括雨量传感器、光照传感器、PM2.5传感器、风速传感器和温湿度传感器,所述雨量传感器、所述光照传感器、所述PM2.5传感器、所述风速传感器和所述温湿度传感器分别与所述中央控制模块电连接。该结构中,雨量传感器用于检测雨量大小,一旦超过阈值,则会开启雨刮器;光照传感器用于检测当前环境的光照强度,一旦超过阈值,则开启补光灯和探照灯;PM2.5传感器用于检测当前环境的PM2.5值,一旦超过阈值,则启动空气净化设备,以保证车内人员的健康;风速传感器用于检测当前环境的风量大小,一旦超过阈值,则会介入驾驶辅助模块,以加强驾驶安全性;温湿度传感器用于检测当前环境的温湿度,以利于车内空调温度调节。Preferably, the atmospheric monitoring unit includes a rain sensor, a light sensor, a PM2.5 sensor, a wind speed sensor and a temperature and humidity sensor, the rain sensor, the light sensor, the PM2.5 sensor, the wind speed sensor and The temperature and humidity sensors are respectively electrically connected to the central control module. In this structure, the rain sensor is used to detect the amount of rain, and once it exceeds the threshold, the wiper will be turned on; the light sensor is used to detect the light intensity of the current environment, and once the threshold is exceeded, the fill light and searchlight will be turned on; the PM2.5 sensor is used for Detect the PM2.5 value of the current environment. Once the value exceeds the threshold, the air purification equipment will be activated to ensure the health of the people in the car; the wind speed sensor is used to detect the air volume of the current environment. Once the threshold value is exceeded, the driving assistance module will be involved to Enhance driving safety; the temperature and humidity sensor is used to detect the temperature and humidity of the current environment, so as to facilitate the temperature adjustment of the air conditioner in the car.
作为优选地,所述车内环境监测模块包括高清摄像头,所述高清摄像头设置在车辆内,并与所述中央控制模块电连接,以当车内出现紧急情况时,由所述中央控制模块控制警示模块发出报警提醒,其具体步骤如下,Preferably, the in-vehicle environment monitoring module includes a high-definition camera, and the high-definition camera is arranged in the vehicle and is electrically connected to the central control module, so that when an emergency occurs in the vehicle, the central control module controls the camera. The warning module sends out an alarm reminder, and the specific steps are as follows:
S1:向用户推送是否打开高清摄像头的指令,如用户选择打开则进入S2,如用户不同意,则高清摄像头处于静默状态;S1: Push the instruction of whether to open the high-definition camera to the user. If the user chooses to open it, it will enter S2. If the user does not agree, the high-definition camera will be in a silent state;
S2:高清摄像头开始工作,实时拍摄车辆内的情况,并将采集到的视频信息并发送到图像处理模块进行存储;S2: The high-definition camera starts to work, shoots the situation in the vehicle in real time, and sends the collected video information to the image processing module for storage;
S3:图像处理模块用于存储高清摄像头发送的视频信息并转发给深度学习判断模块进行行为分析;S3: The image processing module is used to store the video information sent by the high-definition camera and forward it to the deep learning judgment module for behavior analysis;
S4:深度学习判断模块预先训练有异常行为判断模型,根据异常行为判断模型对接收到的视频信息进行行为判断,并将判断结果反馈给中央控制模块;S4: The deep learning judgment module is pre-trained with an abnormal behavior judgment model, conducts behavior judgment on the received video information according to the abnormal behavior judgment model, and feeds back the judgment result to the central control module;
S5:如判断结果为异常,中央控制模块控制警示模块发出报警提醒,并通过通讯模块向与远程云端报备,同时将视频信息输送到车载存储介质中进行备份;如判断结果为正常,则将视频信息直接输入到车载存储介质中进行备份。S5: If the judgment result is abnormal, the central control module controls the warning module to issue an alarm reminder, and reports to the remote cloud through the communication module, and transmits the video information to the vehicle storage medium for backup; if the judgment result is normal, the Video information is directly input to the vehicle storage medium for backup.
在该结构中,在进行车内摄像时,会征得用户同意,以保护车内人员的隐私,本识别方法动作识别准确,利用深度学习判断模块进行人体动作检测,具有较强的泛化能力,而动作模型经过离线数据的分析与建模,非常精准地捕捉了动作的特定规律和运动范围,从而可以精确地匹配人员的动作,一旦出现异常行为,如抢劫、落水、发生车祸、驾驶人员意识不清等情况,可以迅速报警,同时驾驶辅助模块介入工作。In this structure, the user's consent will be obtained when the in-vehicle camera is performed to protect the privacy of the occupants in the vehicle. The recognition method is accurate in action recognition, and the deep learning judgment module is used for human action detection, which has strong generalization ability. , and the action model, through the analysis and modeling of offline data, very accurately captures the specific law and range of motion of the action, so that it can accurately match the action of the person. Once abnormal behavior occurs, such as robbery, falling into the water, car accident, driver In the case of unconsciousness, etc., it can quickly alarm, and at the same time, the driving assistance module will intervene.
作为优选地,所述车辆状态监测模块包括车速监测单元、胎压监测单元、水温监测单元、油量监测单元以及电路监测单元,所述车速监测单元、胎压监测单元、水温监测单元、油量监测单元以及电路监测单元分别与所述中央控制模块电连接。Preferably, the vehicle state monitoring module includes a vehicle speed monitoring unit, a tire pressure monitoring unit, a water temperature monitoring unit, an oil quantity monitoring unit and a circuit monitoring unit, the vehicle speed monitoring unit, the tire pressure monitoring unit, the water temperature monitoring unit, the fuel quantity monitoring unit The monitoring unit and the circuit monitoring unit are respectively electrically connected with the central control module.
作为优选地,所述驾驶人状态监测模块是通过设置在车辆内的面部采集单元来实现的,具体步骤如下,Preferably, the driver state monitoring module is implemented by a face acquisition unit arranged in the vehicle, and the specific steps are as follows:
步骤一:定时通过面部采集单元采集驾驶员脸部图像;Step 1: periodically collect the driver's face image through the face acquisition unit;
步骤二:对获取的驾驶员脸部图像进行归一化、灰度化处理,获取人脸区域;Step 2: normalize and grayscale the obtained driver's face image to obtain the face area;
步骤三:在人脸区域内定位人眼瞳孔质心和瞳孔区域,获取人眼状态参数并对人眼进行跟踪;Step 3: locate the centroid and pupil area of the pupil of the human eye in the face area, obtain the state parameters of the human eye and track the human eye;
步骤四:将人眼状态参数放入到预先训练好的疲劳特征状态判断模型中,判断驾驶人是否属于疲劳状态,若是,则执行步骤五;否则,返回执行步骤一;Step 4: Put the human eye state parameters into the pre-trained fatigue feature state judgment model to determine whether the driver is in a fatigue state, if so, go to Step 5; otherwise, return to
步骤五:中央控制模块控制警示模块发出报警提醒,并通过通讯模块向与远程云端报备。Step 5: The central control module controls the warning module to issue an alarm reminder, and reports to the remote cloud through the communication module.
该结构中,无需和驾驶员直接接触,并通过驾驶员脸部图像进行有效去除环境噪声的干扰,且拥有高的实时性,将人眼瞳孔质心和瞳孔区域结合起来,提高了关键特征对结果影响的比重,进一步提高了对驾驶员驾驶状态的检测精度,并且拥有更好的使用价值。In this structure, there is no need for direct contact with the driver, and the interference of environmental noise is effectively removed through the driver's face image, and it has high real-time performance. It combines the centroid of the pupil and the pupil area of the human eye to improve the key feature pairing results. The proportion of influence further improves the detection accuracy of the driver's driving state, and has better use value.
作为优选地,所述终端模块为智能手机,所述中央控制模块具有唯一序列号,所述远程云端具有一存储列表,所述存储列表中的唯一序列号对应一个手机注册号,当车内环境监测模块监测到当前驾驶人为陌生人时,中央控制模块通过通讯模块发送确认指令给远程云端,远程云端收到确认指令后推送消息给该中央控制模块所对应的手机注册号,当手机注册号所对应的终端模块收到推送消息后,如同意启动,则该车辆可正常驾驶;如拒绝启动,则该车辆拒绝启动,并发出报警提醒。在该结构中,由于存在陌生人驾驶车辆的行为发生,为方便对这类人群进行识别,一旦有陌生人位于驾驶位,远程云端会立刻推送消息给对应的终端模块,如该终端模块同意启动车辆,那么在无钥匙情况下车子也可以正常发送,如该终端模块拒绝启动车辆,则视为非法闯入,发出报警提醒,以保证车辆安全。Preferably, the terminal module is a smart phone, the central control module has a unique serial number, the remote cloud has a storage list, and the unique serial number in the storage list corresponds to a mobile phone registration number. When the monitoring module detects that the current driver is a stranger, the central control module sends a confirmation instruction to the remote cloud through the communication module. After receiving the confirmation instruction, the remote cloud pushes a message to the mobile phone registration number corresponding to the central control module. After the corresponding terminal module receives the push message, if it agrees to start, the vehicle can drive normally; if it refuses to start, the vehicle refuses to start, and an alarm reminder is issued. In this structure, since there are strangers driving the vehicle, in order to facilitate the identification of such groups of people, once a stranger is in the driving position, the remote cloud will immediately push a message to the corresponding terminal module, if the terminal module agrees to start If the terminal module refuses to start the vehicle, it will be regarded as an illegal intrusion, and an alarm reminder will be issued to ensure the safety of the vehicle.
与现有技术相比,本发明的优点在于:周围环境监测模块,用于监测车辆周围的环境情况,车内环境监测模块,用于监测车辆内部的环境情况,车辆状态监测模块,用于监测车辆本体的运行状况,驾驶人状态监测模块,用于监测当前驾驶人员的疲劳状态,从而进行多方位全面监测,以获得更多的外部以及内部数据,以便于中央控制模块更好进行判断分析,提醒驾驶员规范操作,规避安全道路安全风险,保障人员和车辆安全,减少交通事故的发生。Compared with the prior art, the present invention has the advantages of: a surrounding environment monitoring module for monitoring the environmental conditions around the vehicle, an in-vehicle environment monitoring module for monitoring the environmental conditions inside the vehicle, and a vehicle state monitoring module for monitoring The running status of the vehicle body and the driver status monitoring module are used to monitor the fatigue status of the current driver, so as to conduct multi-directional comprehensive monitoring to obtain more external and internal data, so that the central control module can better judge and analyze, Remind drivers to operate properly, avoid road safety risks, ensure the safety of people and vehicles, and reduce the occurrence of traffic accidents.
附图说明Description of drawings
图1为本发明的原理框图;Fig. 1 is the principle block diagram of the present invention;
图2为本发明中周围环境监测模块的原理框图;Fig. 2 is the principle block diagram of the surrounding environment monitoring module in the present invention;
图3为本发明中车辆状态监测模块的原理框图;Fig. 3 is the principle block diagram of the vehicle state monitoring module in the present invention;
图4为本发明中车内环境监测模块工作时的流程示意图。FIG. 4 is a schematic flow chart of the in-vehicle environment monitoring module in the present invention when working.
具体实施方式Detailed ways
以下结合附图和实施例对本发明作进一步详细说明,但不作为对本发明的限定。The present invention will be described in further detail below with reference to the accompanying drawings and embodiments, but it is not intended to limit the present invention.
实施例一:如图所示,一种基于人工智能的辅助驾驶系统,包括Embodiment 1: As shown in the figure, an assisted driving system based on artificial intelligence, including
中央控制模块1;
周围环境监测模块2,用于监测车辆周围的环境情况,并反馈给中央控制模块1;The surrounding environment monitoring module 2 is used to monitor the environmental conditions around the vehicle and feed it back to the
车内环境监测模块3,用于监测车辆内部的环境情况,并反馈给中央控制模块1;The in-vehicle environment monitoring module 3 is used to monitor the environmental conditions inside the vehicle and feed it back to the
车辆状态监测模块4,用于监测车辆本体的运行状况,并反馈给中央控制模块1;The vehicle status monitoring module 4 is used to monitor the running status of the vehicle body and feed it back to the
驾驶人状态监测模块5,用于监测当前驾驶人员的疲劳状态,并反馈给中央控制模块1;The driver state monitoring module 5 is used to monitor the fatigue state of the current driver and feed it back to the
驾驶辅助模块6,在中央控制模块1控制下实现车速调节、车道调节、超车、刹车、泊车功能,以实现驾驶员在驾驶过程中对车辆驾驶辅助;The driving assistance module 6 realizes the functions of vehicle speed adjustment, lane adjustment, overtaking, braking and parking under the control of the
警示模块7,在中央控制模块1控制下实现报警提醒;The warning module 7 realizes the alarm reminder under the control of the
通讯模块8,用于中央控制模块1与远程云端10的通讯;The communication module 8 is used for the communication between the
终端模块9,与远程云端10电连接,用于实现与远程云端10之间的交互通讯。The terminal module 9 is electrically connected to the
作为优选地,周围环境监测模块2包括大气监测单元21、毫米波雷达模块22、摄像头模块23和补光灯24,大气监测单元21设置在车辆上,用于监测当前大气环境状况,并反馈给中央控制模块1,毫米波雷达模块22设置在车辆的顶部,且用于实时监测障碍物与本车辆之间的距离,毫米波雷达模块22与中央控制模块1电连接,摄像头模块23用于检测车辆周围的路况,并反馈给中央控制模块1,补光灯24设在车辆上,与中央控制模块1电连接,以提高对目标区域的亮度。该结构中,大气监测单元21用于监测当前车辆所处环境的大气环境,大气环境包括空气温湿度、光照强度、雨量信息、PM2.5等,从而更好通过中央控制模块1来控制车辆内的设备;毫米波雷达模块22以及摄像头模块23配合使用从而可以实时识别出车辆周侧路况的行人、路况、目标车辆以及障碍物等的图像信息,并配合驾驶辅助模块6,使得在驾驶时,根据现场情况针对性做出调节,并且对接收的实时路况信息及报警信息还可以进行播放,实时提醒驾驶员,对探测到较近的目标距离发出报警,进一步提高驾驶的安全性。Preferably, the surrounding environment monitoring module 2 includes an
实施例二:如图所示,与实施例一不同的是,当大气监测单元21监测当前车辆所处环境较暗时,发送第一指令给中央控制模块1,所收到述中央控制模块1收到第一指令后生成补光指令,并发送给补光灯24,补光灯24收到补光指令后对目标区域进行补光处理。该结构中,在光线不足情况下,中央控制模块1发出补光指令启动补光灯24来提高对目标区域的亮度而进行补光,并保持其他区域原有亮度,能因此在夜间、雨雪雾霾等照明条件不佳情况下,有效的改善采集图像模糊的不足,通过目标区域的补光,能提高成像质量和探测距离,减少天气环境对驾驶员的影响,减少事故的发生。Embodiment 2: As shown in the figure, the difference from
作为优选地,大气监测单元21包括雨量传感器、光照传感器、PM2.5传感器、风速传感器和温湿度传感器,雨量传感器、光照传感器、PM2.5传感器、风速传感器和温湿度传感器分别与中央控制模块1电连接。该结构中,雨量传感器用于检测雨量大小,一旦超过阈值,则会开启雨刮器;光照传感器用于检测当前环境的光照强度,一旦超过阈值,则开启补光灯24和探照灯;PM2.5传感器用于检测当前环境的PM2.5值,一旦超过阈值,则启动空气净化设备,以保证车内人员的健康;风速传感器用于检测当前环境的风量大小,一旦超过阈值,则会介入驾驶辅助模块6,以加强驾驶安全性;温湿度传感器用于检测当前环境的温湿度,以利于车内空调温度调节。Preferably, the
作为优选地,车内环境监测模块3包括高清摄像头,高清摄像头设置在车辆内,并与中央控制模块1电连接,以当车内出现紧急情况时,由中央控制模块1控制警示模块7发出报警提醒,其具体步骤如下,Preferably, the in-vehicle environment monitoring module 3 includes a high-definition camera, and the high-definition camera is arranged in the vehicle and is electrically connected to the
S1:向用户推送是否打开高清摄像头的指令,如用户选择打开则进入S2,如用户不同意,则高清摄像头处于静默状态;S1: Push the instruction of whether to open the high-definition camera to the user. If the user chooses to open it, it will enter S2. If the user does not agree, the high-definition camera will be in a silent state;
S2:高清摄像头开始工作,实时拍摄车辆内的情况,并将采集到的视频信息并发送到图像处理模块进行存储;S2: The high-definition camera starts to work, shoots the situation in the vehicle in real time, and sends the collected video information to the image processing module for storage;
S3:图像处理模块用于存储高清摄像头发送的视频信息并转发给深度学习判断模块进行行为分析;S3: The image processing module is used to store the video information sent by the high-definition camera and forward it to the deep learning judgment module for behavior analysis;
S4:深度学习判断模块预先训练有异常行为判断模型,根据异常行为判断模型对接收到的视频信息进行行为判断,并将判断结果反馈给中央控制模块1;S4: The deep learning judgment module is pre-trained with an abnormal behavior judgment model, conducts behavior judgment on the received video information according to the abnormal behavior judgment model, and feeds back the judgment result to the
S5:如判断结果为异常,中央控制模块1控制警示模块7发出报警提醒,并通过通讯模块8向与远程云端报备,同时将视频信息输送到车载存储介质中进行备份;如判断结果为正常,则将视频信息直接输入到车载存储介质中进行备份。S5: If the judgment result is abnormal, the
在该结构中,在进行车内摄像时,会征得用户同意,以保护车内人员的隐私,本识别方法动作识别准确,利用深度学习判断模块进行人体动作检测,具有较强的泛化能力,而动作模型经过离线数据的分析与建模,非常精准地捕捉了动作的特定规律和运动范围,从而可以精确地匹配人员的动作,一旦出现异常行为,如抢劫、落水、发生车祸、驾驶人员意识不清等情况,可以迅速报警,同时驾驶辅助模块6介入工作。In this structure, the user's consent will be obtained when the in-vehicle camera is performed to protect the privacy of the occupants in the vehicle. The recognition method is accurate in action recognition, and the deep learning judgment module is used for human action detection, which has strong generalization ability. , and the action model, through the analysis and modeling of offline data, very accurately captures the specific law and range of motion of the action, so that it can accurately match the action of the person. Once abnormal behavior occurs, such as robbery, falling into the water, car accident, driver In the case of unconsciousness, etc., the alarm can be quickly alerted, and the driving assistance module 6 will intervene in the work at the same time.
实施例三:如图所示,与实施例二不同的是,车辆状态监测模块4包括车速监测单元41、胎压监测单元42、水温监测单元43、油量监测单元44以及电路监测单元45,车速监测单元41、胎压监测单元42、水温监测单元43、油量监测单元44以及电路监测单元45分别与中央控制模块1电连接。Embodiment 3: As shown in the figure, different from Embodiment 2, the vehicle state monitoring module 4 includes a vehicle
作为优选地,驾驶人状态监测模块5是通过设置在车辆内的面部采集单元来实现的,具体步骤如下,Preferably, the driver state monitoring module 5 is implemented by a face acquisition unit arranged in the vehicle, and the specific steps are as follows:
步骤一:定时通过面部采集单元采集驾驶员脸部图像;Step 1: periodically collect the driver's face image through the face collection unit;
步骤二:对获取的驾驶员脸部图像进行归一化、灰度化处理,获取人脸区域;Step 2: normalize and grayscale the obtained driver's face image to obtain the face area;
步骤三:在人脸区域内定位人眼瞳孔质心和瞳孔区域,获取人眼状态参数并对人眼进行跟踪;Step 3: locate the centroid and pupil area of the pupil of the human eye in the face area, obtain the state parameters of the human eye and track the human eye;
步骤四:将人眼状态参数放入到预先训练好的疲劳特征状态判断模型中,判断驾驶人是否属于疲劳状态,若是,则执行步骤五;否则,返回执行步骤一;Step 4: Put the human eye state parameters into the pre-trained fatigue feature state judgment model to determine whether the driver is in a fatigue state, if so, go to Step 5; otherwise, return to
步骤五:中央控制模块1控制警示模块7发出报警提醒,并通过通讯模块8向与远程云端报备。Step 5: The
该结构中,无需和驾驶员直接接触,并通过驾驶员脸部图像进行有效去除环境噪声的干扰,且拥有高的实时性,将人眼瞳孔质心和瞳孔区域结合起来,提高了关键特征对结果影响的比重,进一步提高了对驾驶员驾驶状态的检测精度,并且拥有更好的使用价值。In this structure, there is no need for direct contact with the driver, and the interference of environmental noise is effectively removed through the driver's face image, and it has high real-time performance. It combines the centroid of the pupil and the pupil area of the human eye to improve the key feature pairing results. The proportion of influence further improves the detection accuracy of the driver's driving state, and has better use value.
作为优选地,终端模块9为智能手机,中央控制模块1具有唯一序列号,远程云端具有一存储列表,存储列表中的唯一序列号对应一个手机注册号,当车内环境监测模块3监测到当前驾驶人为陌生人时,中央控制模块1通过通讯模块8发送确认指令给远程云端,远程云端收到确认指令后推送消息给该中央控制模块1所对应的手机注册号,当手机注册号所对应的终端模块9收到推送消息后,如同意启动,则该车辆可正常驾驶;如拒绝启动,则该车辆拒绝启动,并发出报警提醒。在该结构中,由于存在陌生人驾驶车辆的行为发生,为方便对这类人群进行识别,一旦有陌生人位于驾驶位,远程云端会立刻推送消息给对应的终端模块9,如该终端模块9同意启动车辆,那么在无钥匙情况下车子也可以正常发送,如该终端模块9拒绝启动车辆,则视为非法闯入,发出报警提醒,以保证车辆安全。Preferably, the terminal module 9 is a smart phone, the
值得注意的是,以上仅为本发明的较佳实施例,并非因此限定本发明的专利保护范围,本发明还可以对上述各种零部件的构造进行材料和结构的改进,或者是采用技术等同物进行替换。故凡运用本发明的说明书及图示内容所作的等效结构变化,或直接或间接运用于其他相关技术领域均同理皆包含于本发明所涵盖的范围内。It is worth noting that the above are only the preferred embodiments of the present invention, which do not limit the scope of patent protection of the present invention. The present invention can also improve the materials and structures of the above-mentioned various parts and components, or adopt technical equivalents. things are replaced. Therefore, all equivalent structural changes made by using the descriptions and illustrations of the present invention, or directly or indirectly applied to other related technical fields, are all included within the scope of the present invention.
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210848230.8A CN114954307A (en) | 2022-07-19 | 2022-07-19 | Driving assistance system based on artificial intelligence |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210848230.8A CN114954307A (en) | 2022-07-19 | 2022-07-19 | Driving assistance system based on artificial intelligence |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114954307A true CN114954307A (en) | 2022-08-30 |
Family
ID=82968733
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210848230.8A Pending CN114954307A (en) | 2022-07-19 | 2022-07-19 | Driving assistance system based on artificial intelligence |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114954307A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116684142A (en) * | 2023-06-06 | 2023-09-01 | 深圳华石供应链科技有限公司 | Auxiliary driving system and method based on Internet of things |
CN117622177A (en) * | 2024-01-23 | 2024-03-01 | 青岛创新奇智科技集团股份有限公司 | Vehicle data processing method and device based on industrial large model |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108986400A (en) * | 2018-09-03 | 2018-12-11 | 深圳市尼欧科技有限公司 | A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method |
CN211765391U (en) * | 2019-12-10 | 2020-10-27 | 浙江吉利汽车研究院有限公司 | Early warning system and car in car |
CN112428952A (en) * | 2020-11-04 | 2021-03-02 | 守门狗(杭州)科技服务有限公司 | Vehicle safety early warning system based on Internet of things |
CN113380063A (en) * | 2021-06-17 | 2021-09-10 | 郑州财经学院 | Automobile driving auxiliary system based on artificial intelligence |
CN113997897A (en) * | 2021-10-29 | 2022-02-01 | 延锋伟世通电子科技(南京)有限公司 | In-vehicle personnel state monitoring and abnormity alarming device and using method |
CN114537427A (en) * | 2022-03-06 | 2022-05-27 | 石家庄骐畅电子科技有限公司 | Safe driving protection system based on artificial intelligence |
-
2022
- 2022-07-19 CN CN202210848230.8A patent/CN114954307A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108986400A (en) * | 2018-09-03 | 2018-12-11 | 深圳市尼欧科技有限公司 | A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method |
CN211765391U (en) * | 2019-12-10 | 2020-10-27 | 浙江吉利汽车研究院有限公司 | Early warning system and car in car |
CN112428952A (en) * | 2020-11-04 | 2021-03-02 | 守门狗(杭州)科技服务有限公司 | Vehicle safety early warning system based on Internet of things |
CN113380063A (en) * | 2021-06-17 | 2021-09-10 | 郑州财经学院 | Automobile driving auxiliary system based on artificial intelligence |
CN113997897A (en) * | 2021-10-29 | 2022-02-01 | 延锋伟世通电子科技(南京)有限公司 | In-vehicle personnel state monitoring and abnormity alarming device and using method |
CN114537427A (en) * | 2022-03-06 | 2022-05-27 | 石家庄骐畅电子科技有限公司 | Safe driving protection system based on artificial intelligence |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116684142A (en) * | 2023-06-06 | 2023-09-01 | 深圳华石供应链科技有限公司 | Auxiliary driving system and method based on Internet of things |
CN116684142B (en) * | 2023-06-06 | 2024-03-08 | 深圳华石供应链科技有限公司 | Auxiliary driving system and method based on Internet of things |
CN117622177A (en) * | 2024-01-23 | 2024-03-01 | 青岛创新奇智科技集团股份有限公司 | Vehicle data processing method and device based on industrial large model |
CN117622177B (en) * | 2024-01-23 | 2024-05-14 | 青岛创新奇智科技集团股份有限公司 | Vehicle data processing method and device based on industrial large model |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018058957A1 (en) | Intelligent vehicle-road cooperation traffic control system | |
CN104627076A (en) | Automobile and anti-collision pre-warning system for same | |
US20200070848A1 (en) | Method and System for Initiating Autonomous Drive of a Vehicle | |
CN205930481U (en) | Auto steering lamp controlgear and car | |
CN106114502A (en) | A kind of intelligent automobile aid system | |
CN114954307A (en) | Driving assistance system based on artificial intelligence | |
CN205601701U (en) | Freight train bend pedestrian detects warning system | |
CN109367540A (en) | A driver response recognition system based on risk warning | |
CN114360210A (en) | Vehicle fatigue driving early warning system | |
CN204526997U (en) | A kind of vehicle anti-collision early warning system and automobile | |
CN110682907A (en) | A vehicle rear-end collision control system and method | |
CN109969195A (en) | An alarm system and method for abnormal driver facial behavior and a vehicle based thereon | |
CN103832380A (en) | Dead zone automobile detection and warning system and method based on machine vision | |
CN109541600A (en) | A kind of heavy type commercial automobile safe and intelligent driving assistance system | |
CN114446010A (en) | A vehicle-mounted robot system and its driving management method | |
CN113870618A (en) | Driving safety early warning system and method | |
CN115427268A (en) | AI-enabled alarm to detect locked occupants | |
CN115424471A (en) | Highway vehicle safety driving radar monitoring and early warning system | |
CN111445669B (en) | Safety monitoring system of bus | |
CN113470432A (en) | Vehicle inner wheel difference region danger early warning method and system based on V2V and vehicle | |
CN110356323A (en) | A kind of active safety intelligent driving system | |
CN206282368U (en) | A multifunctional driving recorder | |
CN111845560B (en) | A warning system for a vehicle head overrunning an object | |
CN109501786A (en) | Active safety control system and the automobile for using the system | |
CN115892029A (en) | Automobile intelligent blind area monitoring and early warning system based on driver attention assessment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |