[go: up one dir, main page]

CN114954307A - Driving assistance system based on artificial intelligence - Google Patents

Driving assistance system based on artificial intelligence Download PDF

Info

Publication number
CN114954307A
CN114954307A CN202210848230.8A CN202210848230A CN114954307A CN 114954307 A CN114954307 A CN 114954307A CN 202210848230 A CN202210848230 A CN 202210848230A CN 114954307 A CN114954307 A CN 114954307A
Authority
CN
China
Prior art keywords
module
vehicle
central control
control module
monitoring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210848230.8A
Other languages
Chinese (zh)
Inventor
张鸿
王谆
吉泉仲
黄镱
欧阳文凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hohai University HHU
Original Assignee
Hohai University HHU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hohai University HHU filed Critical Hohai University HHU
Priority to CN202210848230.8A priority Critical patent/CN114954307A/en
Publication of CN114954307A publication Critical patent/CN114954307A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60HARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
    • B60H3/00Other air-treating devices
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/008Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/20Means to switch the anti-theft system on or off
    • B60R25/2018Central base unlocks or authorises unlocking
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60SSERVICING, CLEANING, REPAIRING, SUPPORTING, LIFTING, OR MANOEUVRING OF VEHICLES, NOT OTHERWISE PROVIDED FOR
    • B60S1/00Cleaning of vehicles
    • B60S1/02Cleaning windscreens, windows or optical devices
    • B60S1/04Wipers or the like, e.g. scrapers
    • B60S1/06Wipers or the like, e.g. scrapers characterised by the drive
    • B60S1/08Wipers or the like, e.g. scrapers characterised by the drive electrically driven
    • B60S1/0818Wipers or the like, e.g. scrapers characterised by the drive electrically driven including control systems responsive to external conditions, e.g. by detection of moisture, dirt or the like
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2300/00Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
    • B60Q2300/30Indexing codes relating to the vehicle environment
    • B60Q2300/31Atmospheric conditions
    • B60Q2300/314Ambient light

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Automation & Control Theory (AREA)
  • Traffic Control Systems (AREA)

Abstract

本发明公开了一种基于人工智能的辅助驾驶系统,包括中央控制模块;周围环境监测模块,用于监测车辆周围的环境情况,并反馈给中央控制模块;车内环境监测模块,用于监测车辆内部的环境情况,并反馈给中央控制模块;车辆状态监测模块,用于监测车辆本体的运行状况,并反馈给中央控制模块;驾驶人状态监测模块,用于监测当前驾驶人员的疲劳状态,并反馈给中央控制模块;驾驶辅助模块,在中央控制模块控制下实现车速调节、车道调节、超车、刹车、泊车功能,以实现驾驶员在驾驶过程中对车辆驾驶辅助;优点是能够提高安全驾驶系数,提醒驾驶员规范操作,规避安全道路安全风险,保障人员和车辆安全,减少交通事故的发生。

Figure 202210848230

The invention discloses an assisted driving system based on artificial intelligence, comprising a central control module; a surrounding environment monitoring module for monitoring the environmental conditions around the vehicle and feeding back to the central control module; and an in-vehicle environment monitoring module for monitoring the vehicle The internal environmental conditions are fed back to the central control module; the vehicle status monitoring module is used to monitor the running status of the vehicle body and fed back to the central control module; the driver status monitoring module is used to monitor the current driver's fatigue status and Feedback to the central control module; the driving assistance module, under the control of the central control module, realizes the functions of speed adjustment, lane adjustment, overtaking, braking and parking, so as to realize the driver's driving assistance to the vehicle during the driving process; the advantage is that it can improve safe driving. coefficient, reminding drivers to operate properly, avoid road safety risks, ensure the safety of people and vehicles, and reduce the occurrence of traffic accidents.

Figure 202210848230

Description

一种基于人工智能的辅助驾驶系统An artificial intelligence-based assisted driving system

技术领域technical field

本发明涉及领域,尤其涉及一种基于人工智能的辅助驾驶系统。The present invention relates to the field, in particular to an assisted driving system based on artificial intelligence.

背景技术Background technique

随着社会经济的发展和人们生活水平的提高,人们对汽车的使用越来越多,汽车也逐渐融入到人们的生活中去,安全驾驶问题变得尤为重要,人工智能驾驶辅助技术成为社会研究的热点。目前辅助驾驶系统一般基于摄像头和雷达的技术,通过提供车辆前方、侧面及后方的环境数据并采取相应操作,针对即将发生的风险向驾驶员发出警告,为驾驶员提供辅助,它们还能够提供制动和转向输入等直观的提示或操作,帮助“引导”驾驶员保持在车道内行驶,或是提供自适应巡航控制系统等便利功能。With the development of social economy and the improvement of people's living standards, people use more and more cars, and cars are gradually integrated into people's lives. The issue of safe driving has become particularly important, and artificial intelligence driving assistance technology has become a social research hot spot. At present, assisted driving systems are generally based on camera and radar technology. By providing environmental data in front, side and rear of the vehicle and taking corresponding actions, it can warn the driver of imminent risks and provide assistance to the driver. They can also provide control. Intuitive prompts or actions, such as motion and steering inputs, help “guide” the driver to stay in the lane, or provide convenience features such as adaptive cruise control.

但传统的辅助驾驶系统功能有限,不具有车内环境监测以及驾驶员监测分析功能,特别是近年来,交通事故率越来越高,并且多数交通事故是由于人为因素导致的,例如驾驶员疲劳驾驶、酒驾、醉驾等;数据表明,不专心驾驶是导致车祸的重要因素之一;因此,迫切需要在现有的辅助驾驶系统上增加对驾驶员的监测功能,以提高安全驾驶系数,提醒驾驶员规范操作,规避安全道路安全风险,保障人员和车辆安全,减少交通事故的发生。However, the traditional assisted driving system has limited functions, and does not have the functions of in-vehicle environment monitoring and driver monitoring and analysis. Especially in recent years, the traffic accident rate is getting higher and higher, and most traffic accidents are caused by human factors, such as driver fatigue. Driving, drunk driving, drunk driving, etc.; data shows that inattentive driving is one of the important factors leading to car accidents; therefore, it is urgent to increase the driver monitoring function on the existing assisted driving system to improve the safe driving factor and remind driving Operators should operate in a standardized manner, avoid road safety risks, ensure the safety of personnel and vehicles, and reduce the occurrence of traffic accidents.

发明内容SUMMARY OF THE INVENTION

为了解决上述现有技术中存在的不足,本发明提供一种基于人工智能的辅助驾驶系统,其能够提高安全驾驶系数,提醒驾驶员规范操作,规避安全道路安全风险,保障人员和车辆安全,减少交通事故的发生。In order to solve the above-mentioned deficiencies in the prior art, the present invention provides an assisted driving system based on artificial intelligence, which can improve the safe driving factor, remind drivers to operate in a standardized manner, avoid safe road safety risks, ensure the safety of personnel and vehicles, reduce the occurrence of traffic accidents.

本发明解决上述技术问题所采用的技术方案为:一种基于人工智能的辅助驾驶系统,包括The technical solution adopted by the present invention to solve the above technical problems is as follows: an assisted driving system based on artificial intelligence, comprising:

中央控制模块;Central control module;

周围环境监测模块,用于监测车辆周围的环境情况,并反馈给所述中央控制模块;a surrounding environment monitoring module for monitoring the environmental conditions around the vehicle and feeding back to the central control module;

车内环境监测模块,用于监测车辆内部的环境情况,并反馈给所述中央控制模块;an in-vehicle environment monitoring module, which is used to monitor the environmental conditions inside the vehicle and feed it back to the central control module;

车辆状态监测模块,用于监测车辆本体的运行状况,并反馈给所述中央控制模块;a vehicle state monitoring module for monitoring the running state of the vehicle body and feeding back to the central control module;

驾驶人状态监测模块,用于监测当前驾驶人员的疲劳状态,并反馈给所述中央控制模块;a driver state monitoring module, which is used to monitor the fatigue state of the current driver and feed it back to the central control module;

驾驶辅助模块,在所述中央控制模块控制下实现车速调节、车道调节、超车、刹车、泊车功能,以实现驾驶员在驾驶过程中对车辆驾驶辅助;A driving assistance module, which realizes the functions of vehicle speed adjustment, lane adjustment, overtaking, braking and parking under the control of the central control module, so as to realize the driver's driving assistance to the vehicle during the driving process;

警示模块,在所述中央控制模块控制下实现报警提醒;a warning module, which realizes an alarm reminder under the control of the central control module;

通讯模块,用于中央控制模块与远程云端的通讯;The communication module is used for the communication between the central control module and the remote cloud;

终端模块,与所述远程云端电连接,用于实现与所述远程云端之间的交互通讯。The terminal module is electrically connected with the remote cloud, and is used for realizing interactive communication with the remote cloud.

作为优选地,所述周围环境监测模块包括大气监测单元、毫米波雷达模块、摄像头模块和补光灯,所述大气监测单元设置在车辆上,用于监测当前大气环境状况,并反馈给所述中央控制模块,所述毫米波雷达模块设置在车辆的顶部,且用于实时监测障碍物与本车辆之间的距离,所述毫米波雷达模块与所述中央控制模块电连接,所述摄像头模块用于检测车辆周围的路况,并反馈给所述中央控制模块,所述补光灯设在车辆上,与所述中央控制模块电连接,以提高对目标区域的亮度。该结构中,大气监测单元用于监测当前车辆所处环境的大气环境,大气环境包括空气温湿度、光照强度、雨量信息、PM2.5等,从而更好通过中央控制模块来控制车辆内的设备;毫米波雷达模块以及摄像头模块配合使用从而可以实时识别出车辆周侧路况的行人、路况、目标车辆以及障碍物等的图像信息,并配合驾驶辅助模块,使得在驾驶时,根据现场情况针对性做出调节,并且对接收的实时路况信息及报警信息还可以进行播放,实时提醒驾驶员,对探测到较近的目标距离发出报警,进一步提高驾驶的安全性。Preferably, the surrounding environment monitoring module includes an atmospheric monitoring unit, a millimeter-wave radar module, a camera module and a fill light, and the atmospheric monitoring unit is provided on the vehicle and is used to monitor the current atmospheric environment and feed back to the a central control module, the millimeter-wave radar module is arranged on the top of the vehicle and is used to monitor the distance between obstacles and the vehicle in real time, the millimeter-wave radar module is electrically connected to the central control module, and the camera module It is used to detect the road conditions around the vehicle and feed it back to the central control module. The supplementary light is arranged on the vehicle and is electrically connected to the central control module to improve the brightness of the target area. In this structure, the atmospheric monitoring unit is used to monitor the atmospheric environment of the current vehicle environment. The atmospheric environment includes air temperature and humidity, light intensity, rainfall information, PM2.5, etc., so as to better control the equipment in the vehicle through the central control module ;The millimeter wave radar module and the camera module can be used together to identify the image information of pedestrians, road conditions, target vehicles and obstacles in real time around the vehicle. Make adjustments, and can also play the received real-time road condition information and alarm information, remind the driver in real time, and issue an alarm when the target distance is detected to further improve the safety of driving.

作为优选地,当所述大气监测单元监测当前车辆所处环境较暗时,发送第一指令给所述中央控制模块,所收到述中央控制模块收到第一指令后生成补光指令,并发送给所述补光灯,所述补光灯收到补光指令后对目标区域进行补光处理。该结构中,在光线不足情况下,中央控制模块发出补光指令启动补光灯来提高对目标区域的亮度而进行补光,并保持其他区域原有亮度,能因此在夜间、雨雪雾霾等照明条件不佳情况下,有效的改善采集图像模糊的不足,通过目标区域的补光,能提高成像质量和探测距离,减少天气环境对驾驶员的影响,减少事故的发生。Preferably, when the atmospheric monitoring unit monitors that the current environment where the vehicle is located is dark, it sends a first instruction to the central control module, and the received central control module generates a fill light instruction after receiving the first instruction, and It is sent to the supplementary light, and the supplementary light performs supplementary light processing on the target area after receiving the supplementary light instruction. In this structure, in the case of insufficient light, the central control module sends a supplementary light command to start the supplementary light to increase the brightness of the target area to supplement the light, and maintain the original brightness of other areas. When the lighting conditions are not good, it can effectively improve the lack of blurring of the collected images. By supplementing the light in the target area, it can improve the imaging quality and detection distance, reduce the impact of the weather and environment on the driver, and reduce the occurrence of accidents.

作为优选地,所述大气监测单元包括雨量传感器、光照传感器、PM2.5传感器、风速传感器和温湿度传感器,所述雨量传感器、所述光照传感器、所述PM2.5传感器、所述风速传感器和所述温湿度传感器分别与所述中央控制模块电连接。该结构中,雨量传感器用于检测雨量大小,一旦超过阈值,则会开启雨刮器;光照传感器用于检测当前环境的光照强度,一旦超过阈值,则开启补光灯和探照灯;PM2.5传感器用于检测当前环境的PM2.5值,一旦超过阈值,则启动空气净化设备,以保证车内人员的健康;风速传感器用于检测当前环境的风量大小,一旦超过阈值,则会介入驾驶辅助模块,以加强驾驶安全性;温湿度传感器用于检测当前环境的温湿度,以利于车内空调温度调节。Preferably, the atmospheric monitoring unit includes a rain sensor, a light sensor, a PM2.5 sensor, a wind speed sensor and a temperature and humidity sensor, the rain sensor, the light sensor, the PM2.5 sensor, the wind speed sensor and The temperature and humidity sensors are respectively electrically connected to the central control module. In this structure, the rain sensor is used to detect the amount of rain, and once it exceeds the threshold, the wiper will be turned on; the light sensor is used to detect the light intensity of the current environment, and once the threshold is exceeded, the fill light and searchlight will be turned on; the PM2.5 sensor is used for Detect the PM2.5 value of the current environment. Once the value exceeds the threshold, the air purification equipment will be activated to ensure the health of the people in the car; the wind speed sensor is used to detect the air volume of the current environment. Once the threshold value is exceeded, the driving assistance module will be involved to Enhance driving safety; the temperature and humidity sensor is used to detect the temperature and humidity of the current environment, so as to facilitate the temperature adjustment of the air conditioner in the car.

作为优选地,所述车内环境监测模块包括高清摄像头,所述高清摄像头设置在车辆内,并与所述中央控制模块电连接,以当车内出现紧急情况时,由所述中央控制模块控制警示模块发出报警提醒,其具体步骤如下,Preferably, the in-vehicle environment monitoring module includes a high-definition camera, and the high-definition camera is arranged in the vehicle and is electrically connected to the central control module, so that when an emergency occurs in the vehicle, the central control module controls the camera. The warning module sends out an alarm reminder, and the specific steps are as follows:

S1:向用户推送是否打开高清摄像头的指令,如用户选择打开则进入S2,如用户不同意,则高清摄像头处于静默状态;S1: Push the instruction of whether to open the high-definition camera to the user. If the user chooses to open it, it will enter S2. If the user does not agree, the high-definition camera will be in a silent state;

S2:高清摄像头开始工作,实时拍摄车辆内的情况,并将采集到的视频信息并发送到图像处理模块进行存储;S2: The high-definition camera starts to work, shoots the situation in the vehicle in real time, and sends the collected video information to the image processing module for storage;

S3:图像处理模块用于存储高清摄像头发送的视频信息并转发给深度学习判断模块进行行为分析;S3: The image processing module is used to store the video information sent by the high-definition camera and forward it to the deep learning judgment module for behavior analysis;

S4:深度学习判断模块预先训练有异常行为判断模型,根据异常行为判断模型对接收到的视频信息进行行为判断,并将判断结果反馈给中央控制模块;S4: The deep learning judgment module is pre-trained with an abnormal behavior judgment model, conducts behavior judgment on the received video information according to the abnormal behavior judgment model, and feeds back the judgment result to the central control module;

S5:如判断结果为异常,中央控制模块控制警示模块发出报警提醒,并通过通讯模块向与远程云端报备,同时将视频信息输送到车载存储介质中进行备份;如判断结果为正常,则将视频信息直接输入到车载存储介质中进行备份。S5: If the judgment result is abnormal, the central control module controls the warning module to issue an alarm reminder, and reports to the remote cloud through the communication module, and transmits the video information to the vehicle storage medium for backup; if the judgment result is normal, the Video information is directly input to the vehicle storage medium for backup.

在该结构中,在进行车内摄像时,会征得用户同意,以保护车内人员的隐私,本识别方法动作识别准确,利用深度学习判断模块进行人体动作检测,具有较强的泛化能力,而动作模型经过离线数据的分析与建模,非常精准地捕捉了动作的特定规律和运动范围,从而可以精确地匹配人员的动作,一旦出现异常行为,如抢劫、落水、发生车祸、驾驶人员意识不清等情况,可以迅速报警,同时驾驶辅助模块介入工作。In this structure, the user's consent will be obtained when the in-vehicle camera is performed to protect the privacy of the occupants in the vehicle. The recognition method is accurate in action recognition, and the deep learning judgment module is used for human action detection, which has strong generalization ability. , and the action model, through the analysis and modeling of offline data, very accurately captures the specific law and range of motion of the action, so that it can accurately match the action of the person. Once abnormal behavior occurs, such as robbery, falling into the water, car accident, driver In the case of unconsciousness, etc., it can quickly alarm, and at the same time, the driving assistance module will intervene.

作为优选地,所述车辆状态监测模块包括车速监测单元、胎压监测单元、水温监测单元、油量监测单元以及电路监测单元,所述车速监测单元、胎压监测单元、水温监测单元、油量监测单元以及电路监测单元分别与所述中央控制模块电连接。Preferably, the vehicle state monitoring module includes a vehicle speed monitoring unit, a tire pressure monitoring unit, a water temperature monitoring unit, an oil quantity monitoring unit and a circuit monitoring unit, the vehicle speed monitoring unit, the tire pressure monitoring unit, the water temperature monitoring unit, the fuel quantity monitoring unit The monitoring unit and the circuit monitoring unit are respectively electrically connected with the central control module.

作为优选地,所述驾驶人状态监测模块是通过设置在车辆内的面部采集单元来实现的,具体步骤如下,Preferably, the driver state monitoring module is implemented by a face acquisition unit arranged in the vehicle, and the specific steps are as follows:

步骤一:定时通过面部采集单元采集驾驶员脸部图像;Step 1: periodically collect the driver's face image through the face acquisition unit;

步骤二:对获取的驾驶员脸部图像进行归一化、灰度化处理,获取人脸区域;Step 2: normalize and grayscale the obtained driver's face image to obtain the face area;

步骤三:在人脸区域内定位人眼瞳孔质心和瞳孔区域,获取人眼状态参数并对人眼进行跟踪;Step 3: locate the centroid and pupil area of the pupil of the human eye in the face area, obtain the state parameters of the human eye and track the human eye;

步骤四:将人眼状态参数放入到预先训练好的疲劳特征状态判断模型中,判断驾驶人是否属于疲劳状态,若是,则执行步骤五;否则,返回执行步骤一;Step 4: Put the human eye state parameters into the pre-trained fatigue feature state judgment model to determine whether the driver is in a fatigue state, if so, go to Step 5; otherwise, return to Step 1;

步骤五:中央控制模块控制警示模块发出报警提醒,并通过通讯模块向与远程云端报备。Step 5: The central control module controls the warning module to issue an alarm reminder, and reports to the remote cloud through the communication module.

该结构中,无需和驾驶员直接接触,并通过驾驶员脸部图像进行有效去除环境噪声的干扰,且拥有高的实时性,将人眼瞳孔质心和瞳孔区域结合起来,提高了关键特征对结果影响的比重,进一步提高了对驾驶员驾驶状态的检测精度,并且拥有更好的使用价值。In this structure, there is no need for direct contact with the driver, and the interference of environmental noise is effectively removed through the driver's face image, and it has high real-time performance. It combines the centroid of the pupil and the pupil area of the human eye to improve the key feature pairing results. The proportion of influence further improves the detection accuracy of the driver's driving state, and has better use value.

作为优选地,所述终端模块为智能手机,所述中央控制模块具有唯一序列号,所述远程云端具有一存储列表,所述存储列表中的唯一序列号对应一个手机注册号,当车内环境监测模块监测到当前驾驶人为陌生人时,中央控制模块通过通讯模块发送确认指令给远程云端,远程云端收到确认指令后推送消息给该中央控制模块所对应的手机注册号,当手机注册号所对应的终端模块收到推送消息后,如同意启动,则该车辆可正常驾驶;如拒绝启动,则该车辆拒绝启动,并发出报警提醒。在该结构中,由于存在陌生人驾驶车辆的行为发生,为方便对这类人群进行识别,一旦有陌生人位于驾驶位,远程云端会立刻推送消息给对应的终端模块,如该终端模块同意启动车辆,那么在无钥匙情况下车子也可以正常发送,如该终端模块拒绝启动车辆,则视为非法闯入,发出报警提醒,以保证车辆安全。Preferably, the terminal module is a smart phone, the central control module has a unique serial number, the remote cloud has a storage list, and the unique serial number in the storage list corresponds to a mobile phone registration number. When the monitoring module detects that the current driver is a stranger, the central control module sends a confirmation instruction to the remote cloud through the communication module. After receiving the confirmation instruction, the remote cloud pushes a message to the mobile phone registration number corresponding to the central control module. After the corresponding terminal module receives the push message, if it agrees to start, the vehicle can drive normally; if it refuses to start, the vehicle refuses to start, and an alarm reminder is issued. In this structure, since there are strangers driving the vehicle, in order to facilitate the identification of such groups of people, once a stranger is in the driving position, the remote cloud will immediately push a message to the corresponding terminal module, if the terminal module agrees to start If the terminal module refuses to start the vehicle, it will be regarded as an illegal intrusion, and an alarm reminder will be issued to ensure the safety of the vehicle.

与现有技术相比,本发明的优点在于:周围环境监测模块,用于监测车辆周围的环境情况,车内环境监测模块,用于监测车辆内部的环境情况,车辆状态监测模块,用于监测车辆本体的运行状况,驾驶人状态监测模块,用于监测当前驾驶人员的疲劳状态,从而进行多方位全面监测,以获得更多的外部以及内部数据,以便于中央控制模块更好进行判断分析,提醒驾驶员规范操作,规避安全道路安全风险,保障人员和车辆安全,减少交通事故的发生。Compared with the prior art, the present invention has the advantages of: a surrounding environment monitoring module for monitoring the environmental conditions around the vehicle, an in-vehicle environment monitoring module for monitoring the environmental conditions inside the vehicle, and a vehicle state monitoring module for monitoring The running status of the vehicle body and the driver status monitoring module are used to monitor the fatigue status of the current driver, so as to conduct multi-directional comprehensive monitoring to obtain more external and internal data, so that the central control module can better judge and analyze, Remind drivers to operate properly, avoid road safety risks, ensure the safety of people and vehicles, and reduce the occurrence of traffic accidents.

附图说明Description of drawings

图1为本发明的原理框图;Fig. 1 is the principle block diagram of the present invention;

图2为本发明中周围环境监测模块的原理框图;Fig. 2 is the principle block diagram of the surrounding environment monitoring module in the present invention;

图3为本发明中车辆状态监测模块的原理框图;Fig. 3 is the principle block diagram of the vehicle state monitoring module in the present invention;

图4为本发明中车内环境监测模块工作时的流程示意图。FIG. 4 is a schematic flow chart of the in-vehicle environment monitoring module in the present invention when working.

具体实施方式Detailed ways

以下结合附图和实施例对本发明作进一步详细说明,但不作为对本发明的限定。The present invention will be described in further detail below with reference to the accompanying drawings and embodiments, but it is not intended to limit the present invention.

实施例一:如图所示,一种基于人工智能的辅助驾驶系统,包括Embodiment 1: As shown in the figure, an assisted driving system based on artificial intelligence, including

中央控制模块1;Central control module 1;

周围环境监测模块2,用于监测车辆周围的环境情况,并反馈给中央控制模块1;The surrounding environment monitoring module 2 is used to monitor the environmental conditions around the vehicle and feed it back to the central control module 1;

车内环境监测模块3,用于监测车辆内部的环境情况,并反馈给中央控制模块1;The in-vehicle environment monitoring module 3 is used to monitor the environmental conditions inside the vehicle and feed it back to the central control module 1;

车辆状态监测模块4,用于监测车辆本体的运行状况,并反馈给中央控制模块1;The vehicle status monitoring module 4 is used to monitor the running status of the vehicle body and feed it back to the central control module 1;

驾驶人状态监测模块5,用于监测当前驾驶人员的疲劳状态,并反馈给中央控制模块1;The driver state monitoring module 5 is used to monitor the fatigue state of the current driver and feed it back to the central control module 1;

驾驶辅助模块6,在中央控制模块1控制下实现车速调节、车道调节、超车、刹车、泊车功能,以实现驾驶员在驾驶过程中对车辆驾驶辅助;The driving assistance module 6 realizes the functions of vehicle speed adjustment, lane adjustment, overtaking, braking and parking under the control of the central control module 1, so as to realize the driving assistance of the driver to the vehicle during the driving process;

警示模块7,在中央控制模块1控制下实现报警提醒;The warning module 7 realizes the alarm reminder under the control of the central control module 1;

通讯模块8,用于中央控制模块1与远程云端10的通讯;The communication module 8 is used for the communication between the central control module 1 and the remote cloud 10;

终端模块9,与远程云端10电连接,用于实现与远程云端10之间的交互通讯。The terminal module 9 is electrically connected to the remote cloud 10 for realizing interactive communication with the remote cloud 10 .

作为优选地,周围环境监测模块2包括大气监测单元21、毫米波雷达模块22、摄像头模块23和补光灯24,大气监测单元21设置在车辆上,用于监测当前大气环境状况,并反馈给中央控制模块1,毫米波雷达模块22设置在车辆的顶部,且用于实时监测障碍物与本车辆之间的距离,毫米波雷达模块22与中央控制模块1电连接,摄像头模块23用于检测车辆周围的路况,并反馈给中央控制模块1,补光灯24设在车辆上,与中央控制模块1电连接,以提高对目标区域的亮度。该结构中,大气监测单元21用于监测当前车辆所处环境的大气环境,大气环境包括空气温湿度、光照强度、雨量信息、PM2.5等,从而更好通过中央控制模块1来控制车辆内的设备;毫米波雷达模块22以及摄像头模块23配合使用从而可以实时识别出车辆周侧路况的行人、路况、目标车辆以及障碍物等的图像信息,并配合驾驶辅助模块6,使得在驾驶时,根据现场情况针对性做出调节,并且对接收的实时路况信息及报警信息还可以进行播放,实时提醒驾驶员,对探测到较近的目标距离发出报警,进一步提高驾驶的安全性。Preferably, the surrounding environment monitoring module 2 includes an atmospheric monitoring unit 21, a millimeter-wave radar module 22, a camera module 23 and a fill light 24. The atmospheric monitoring unit 21 is arranged on the vehicle and is used to monitor the current atmospheric environment and feed back to the The central control module 1, the millimeter-wave radar module 22 is arranged on the top of the vehicle, and is used to monitor the distance between the obstacle and the vehicle in real time, the millimeter-wave radar module 22 is electrically connected to the central control module 1, and the camera module 23 is used to detect The road conditions around the vehicle are fed back to the central control module 1. The fill light 24 is provided on the vehicle and is electrically connected to the central control module 1 to improve the brightness of the target area. In this structure, the atmospheric monitoring unit 21 is used to monitor the atmospheric environment of the current environment where the vehicle is located. The atmospheric environment includes air temperature and humidity, light intensity, rainfall information, PM2.5, etc., so that the central control module 1 can better control the interior of the vehicle. The millimeter wave radar module 22 and the camera module 23 are used together to identify the image information of pedestrians, road conditions, target vehicles and obstacles in the surrounding road conditions of the vehicle in real time, and cooperate with the driving assistance module 6, so that when driving, Targeted adjustments are made according to the on-site situation, and the received real-time road condition information and alarm information can also be played, reminding the driver in real time, and issuing an alarm for the detected target distance to further improve driving safety.

实施例二:如图所示,与实施例一不同的是,当大气监测单元21监测当前车辆所处环境较暗时,发送第一指令给中央控制模块1,所收到述中央控制模块1收到第一指令后生成补光指令,并发送给补光灯24,补光灯24收到补光指令后对目标区域进行补光处理。该结构中,在光线不足情况下,中央控制模块1发出补光指令启动补光灯24来提高对目标区域的亮度而进行补光,并保持其他区域原有亮度,能因此在夜间、雨雪雾霾等照明条件不佳情况下,有效的改善采集图像模糊的不足,通过目标区域的补光,能提高成像质量和探测距离,减少天气环境对驾驶员的影响,减少事故的发生。Embodiment 2: As shown in the figure, the difference from Embodiment 1 is that when the atmosphere monitoring unit 21 monitors that the current environment where the vehicle is located is dark, it sends a first instruction to the central control module 1, and the central control module 1 receives the first instruction. After receiving the first instruction, a fill light instruction is generated and sent to the fill light lamp 24, and the fill light lamp 24 performs fill light processing on the target area after receiving the fill light instruction. In this structure, in the case of insufficient light, the central control module 1 sends a supplementary light command to activate the supplementary light 24 to increase the brightness of the target area to perform supplementary light, and maintain the original brightness of other areas, so that it can be used at night, rain and snow. In the case of poor lighting conditions such as haze, it can effectively improve the lack of blurring of captured images. By supplementing the light in the target area, it can improve the imaging quality and detection distance, reduce the impact of the weather environment on the driver, and reduce the occurrence of accidents.

作为优选地,大气监测单元21包括雨量传感器、光照传感器、PM2.5传感器、风速传感器和温湿度传感器,雨量传感器、光照传感器、PM2.5传感器、风速传感器和温湿度传感器分别与中央控制模块1电连接。该结构中,雨量传感器用于检测雨量大小,一旦超过阈值,则会开启雨刮器;光照传感器用于检测当前环境的光照强度,一旦超过阈值,则开启补光灯24和探照灯;PM2.5传感器用于检测当前环境的PM2.5值,一旦超过阈值,则启动空气净化设备,以保证车内人员的健康;风速传感器用于检测当前环境的风量大小,一旦超过阈值,则会介入驾驶辅助模块6,以加强驾驶安全性;温湿度传感器用于检测当前环境的温湿度,以利于车内空调温度调节。Preferably, the atmospheric monitoring unit 21 includes a rain sensor, a light sensor, a PM2.5 sensor, a wind speed sensor and a temperature and humidity sensor, and the rain sensor, light sensor, PM2.5 sensor, wind speed sensor and temperature and humidity sensor are respectively connected with the central control module 1 electrical connection. In this structure, the rain sensor is used to detect the amount of rain, and once it exceeds the threshold, the wiper will be turned on; the light sensor is used to detect the light intensity of the current environment, and once the threshold is exceeded, the fill light 24 and searchlight will be turned on; the PM2.5 sensor is used for It is used to detect the PM2.5 value of the current environment. Once the threshold value is exceeded, the air purification equipment will be activated to ensure the health of the people in the car; the wind speed sensor is used to detect the air volume of the current environment. Once the threshold value is exceeded, the driving assistance module 6 will be involved. , to enhance driving safety; the temperature and humidity sensor is used to detect the temperature and humidity of the current environment to facilitate the temperature adjustment of the air conditioner in the car.

作为优选地,车内环境监测模块3包括高清摄像头,高清摄像头设置在车辆内,并与中央控制模块1电连接,以当车内出现紧急情况时,由中央控制模块1控制警示模块7发出报警提醒,其具体步骤如下,Preferably, the in-vehicle environment monitoring module 3 includes a high-definition camera, and the high-definition camera is arranged in the vehicle and is electrically connected to the central control module 1, so that when an emergency occurs in the vehicle, the central control module 1 controls the warning module 7 to issue an alarm Reminder, the specific steps are as follows:

S1:向用户推送是否打开高清摄像头的指令,如用户选择打开则进入S2,如用户不同意,则高清摄像头处于静默状态;S1: Push the instruction of whether to open the high-definition camera to the user. If the user chooses to open it, it will enter S2. If the user does not agree, the high-definition camera will be in a silent state;

S2:高清摄像头开始工作,实时拍摄车辆内的情况,并将采集到的视频信息并发送到图像处理模块进行存储;S2: The high-definition camera starts to work, shoots the situation in the vehicle in real time, and sends the collected video information to the image processing module for storage;

S3:图像处理模块用于存储高清摄像头发送的视频信息并转发给深度学习判断模块进行行为分析;S3: The image processing module is used to store the video information sent by the high-definition camera and forward it to the deep learning judgment module for behavior analysis;

S4:深度学习判断模块预先训练有异常行为判断模型,根据异常行为判断模型对接收到的视频信息进行行为判断,并将判断结果反馈给中央控制模块1;S4: The deep learning judgment module is pre-trained with an abnormal behavior judgment model, conducts behavior judgment on the received video information according to the abnormal behavior judgment model, and feeds back the judgment result to the central control module 1;

S5:如判断结果为异常,中央控制模块1控制警示模块7发出报警提醒,并通过通讯模块8向与远程云端报备,同时将视频信息输送到车载存储介质中进行备份;如判断结果为正常,则将视频信息直接输入到车载存储介质中进行备份。S5: If the judgment result is abnormal, the central control module 1 controls the warning module 7 to issue an alarm reminder, and reports to the remote cloud through the communication module 8, and simultaneously transmits the video information to the vehicle-mounted storage medium for backup; if the judgment result is normal , the video information is directly input into the vehicle storage medium for backup.

在该结构中,在进行车内摄像时,会征得用户同意,以保护车内人员的隐私,本识别方法动作识别准确,利用深度学习判断模块进行人体动作检测,具有较强的泛化能力,而动作模型经过离线数据的分析与建模,非常精准地捕捉了动作的特定规律和运动范围,从而可以精确地匹配人员的动作,一旦出现异常行为,如抢劫、落水、发生车祸、驾驶人员意识不清等情况,可以迅速报警,同时驾驶辅助模块6介入工作。In this structure, the user's consent will be obtained when the in-vehicle camera is performed to protect the privacy of the occupants in the vehicle. The recognition method is accurate in action recognition, and the deep learning judgment module is used for human action detection, which has strong generalization ability. , and the action model, through the analysis and modeling of offline data, very accurately captures the specific law and range of motion of the action, so that it can accurately match the action of the person. Once abnormal behavior occurs, such as robbery, falling into the water, car accident, driver In the case of unconsciousness, etc., the alarm can be quickly alerted, and the driving assistance module 6 will intervene in the work at the same time.

实施例三:如图所示,与实施例二不同的是,车辆状态监测模块4包括车速监测单元41、胎压监测单元42、水温监测单元43、油量监测单元44以及电路监测单元45,车速监测单元41、胎压监测单元42、水温监测单元43、油量监测单元44以及电路监测单元45分别与中央控制模块1电连接。Embodiment 3: As shown in the figure, different from Embodiment 2, the vehicle state monitoring module 4 includes a vehicle speed monitoring unit 41, a tire pressure monitoring unit 42, a water temperature monitoring unit 43, an oil quantity monitoring unit 44 and a circuit monitoring unit 45, The vehicle speed monitoring unit 41 , the tire pressure monitoring unit 42 , the water temperature monitoring unit 43 , the fuel quantity monitoring unit 44 and the circuit monitoring unit 45 are respectively electrically connected to the central control module 1 .

作为优选地,驾驶人状态监测模块5是通过设置在车辆内的面部采集单元来实现的,具体步骤如下,Preferably, the driver state monitoring module 5 is implemented by a face acquisition unit arranged in the vehicle, and the specific steps are as follows:

步骤一:定时通过面部采集单元采集驾驶员脸部图像;Step 1: periodically collect the driver's face image through the face collection unit;

步骤二:对获取的驾驶员脸部图像进行归一化、灰度化处理,获取人脸区域;Step 2: normalize and grayscale the obtained driver's face image to obtain the face area;

步骤三:在人脸区域内定位人眼瞳孔质心和瞳孔区域,获取人眼状态参数并对人眼进行跟踪;Step 3: locate the centroid and pupil area of the pupil of the human eye in the face area, obtain the state parameters of the human eye and track the human eye;

步骤四:将人眼状态参数放入到预先训练好的疲劳特征状态判断模型中,判断驾驶人是否属于疲劳状态,若是,则执行步骤五;否则,返回执行步骤一;Step 4: Put the human eye state parameters into the pre-trained fatigue feature state judgment model to determine whether the driver is in a fatigue state, if so, go to Step 5; otherwise, return to Step 1;

步骤五:中央控制模块1控制警示模块7发出报警提醒,并通过通讯模块8向与远程云端报备。Step 5: The central control module 1 controls the warning module 7 to issue an alarm reminder, and reports to the remote cloud through the communication module 8 .

该结构中,无需和驾驶员直接接触,并通过驾驶员脸部图像进行有效去除环境噪声的干扰,且拥有高的实时性,将人眼瞳孔质心和瞳孔区域结合起来,提高了关键特征对结果影响的比重,进一步提高了对驾驶员驾驶状态的检测精度,并且拥有更好的使用价值。In this structure, there is no need for direct contact with the driver, and the interference of environmental noise is effectively removed through the driver's face image, and it has high real-time performance. It combines the centroid of the pupil and the pupil area of the human eye to improve the key feature pairing results. The proportion of influence further improves the detection accuracy of the driver's driving state, and has better use value.

作为优选地,终端模块9为智能手机,中央控制模块1具有唯一序列号,远程云端具有一存储列表,存储列表中的唯一序列号对应一个手机注册号,当车内环境监测模块3监测到当前驾驶人为陌生人时,中央控制模块1通过通讯模块8发送确认指令给远程云端,远程云端收到确认指令后推送消息给该中央控制模块1所对应的手机注册号,当手机注册号所对应的终端模块9收到推送消息后,如同意启动,则该车辆可正常驾驶;如拒绝启动,则该车辆拒绝启动,并发出报警提醒。在该结构中,由于存在陌生人驾驶车辆的行为发生,为方便对这类人群进行识别,一旦有陌生人位于驾驶位,远程云端会立刻推送消息给对应的终端模块9,如该终端模块9同意启动车辆,那么在无钥匙情况下车子也可以正常发送,如该终端模块9拒绝启动车辆,则视为非法闯入,发出报警提醒,以保证车辆安全。Preferably, the terminal module 9 is a smart phone, the central control module 1 has a unique serial number, the remote cloud has a storage list, and the unique serial number in the storage list corresponds to a mobile phone registration number. When the in-vehicle environment monitoring module 3 monitors the current When the driver is a stranger, the central control module 1 sends a confirmation instruction to the remote cloud through the communication module 8. After receiving the confirmation instruction, the remote cloud pushes a message to the mobile phone registration number corresponding to the central control module 1. After the terminal module 9 receives the push message, if it agrees to start, the vehicle can drive normally; if it refuses to start, the vehicle refuses to start, and sends out an alarm reminder. In this structure, since there are strangers driving the vehicle, in order to facilitate the identification of such groups of people, once a stranger is in the driving position, the remote cloud will immediately push a message to the corresponding terminal module 9, such as the terminal module 9 If the terminal module 9 refuses to start the vehicle, it will be regarded as an illegal intrusion, and an alarm reminder will be issued to ensure the safety of the vehicle.

值得注意的是,以上仅为本发明的较佳实施例,并非因此限定本发明的专利保护范围,本发明还可以对上述各种零部件的构造进行材料和结构的改进,或者是采用技术等同物进行替换。故凡运用本发明的说明书及图示内容所作的等效结构变化,或直接或间接运用于其他相关技术领域均同理皆包含于本发明所涵盖的范围内。It is worth noting that the above are only the preferred embodiments of the present invention, which do not limit the scope of patent protection of the present invention. The present invention can also improve the materials and structures of the above-mentioned various parts and components, or adopt technical equivalents. things are replaced. Therefore, all equivalent structural changes made by using the descriptions and illustrations of the present invention, or directly or indirectly applied to other related technical fields, are all included within the scope of the present invention.

Claims (8)

1.一种基于人工智能的辅助驾驶系统,其特征在于:包括1. an assisted driving system based on artificial intelligence, is characterized in that: comprising: 中央控制模块;Central control module; 周围环境监测模块,用于监测车辆周围的环境情况,并反馈给所述中央控制模块;a surrounding environment monitoring module for monitoring the environmental conditions around the vehicle and feeding back to the central control module; 车内环境监测模块,用于监测车辆内部的环境情况,并反馈给所述中央控制模块;an in-vehicle environment monitoring module, which is used to monitor the environmental conditions inside the vehicle and feed it back to the central control module; 车辆状态监测模块,用于监测车辆本体的运行状况,并反馈给所述中央控制模块;a vehicle state monitoring module for monitoring the running state of the vehicle body and feeding back to the central control module; 驾驶人状态监测模块,用于监测当前驾驶人员的疲劳状态,并反馈给所述中央控制模块;a driver state monitoring module, which is used to monitor the fatigue state of the current driver and feed it back to the central control module; 驾驶辅助模块,在所述中央控制模块控制下实现车速调节、车道调节、超车、刹车、泊车功能,以实现驾驶员在驾驶过程中对车辆驾驶辅助;A driving assistance module, which realizes the functions of vehicle speed adjustment, lane adjustment, overtaking, braking and parking under the control of the central control module, so as to realize the driver's driving assistance to the vehicle during the driving process; 警示模块,在所述中央控制模块控制下实现报警提醒;a warning module, which realizes an alarm reminder under the control of the central control module; 通讯模块,用于中央控制模块与远程云端的通讯;The communication module is used for the communication between the central control module and the remote cloud; 终端模块,与所述远程云端电连接,用于实现与所述远程云端之间的交互通讯。The terminal module is electrically connected with the remote cloud, and is used for realizing interactive communication with the remote cloud. 2.根据权利要求1所述的一种基于人工智能的辅助驾驶系统,其特征在于:所述周围环境监测模块包括大气监测单元、毫米波雷达模块、摄像头模块和补光灯,所述大气监测单元设置在车辆上,用于监测当前大气环境状况,并反馈给所述中央控制模块,所述毫米波雷达模块设置在车辆的顶部,且用于实时监测障碍物与本车辆之间的距离,所述毫米波雷达模块与所述中央控制模块电连接,所述摄像头模块用于检测车辆周围的路况,并反馈给所述中央控制模块,所述补光灯设在车辆上,与所述中央控制模块电连接,以提高对目标区域的亮度。2. The artificial intelligence-based assisted driving system according to claim 1, wherein the surrounding environment monitoring module comprises an atmospheric monitoring unit, a millimeter-wave radar module, a camera module and a fill light, and the atmospheric monitoring module The unit is arranged on the vehicle to monitor the current atmospheric environment and feedback to the central control module, the millimeter wave radar module is arranged on the top of the vehicle, and is used to monitor the distance between the obstacle and the vehicle in real time, The millimeter-wave radar module is electrically connected to the central control module, the camera module is used to detect road conditions around the vehicle, and feed back to the central control module, the fill light is provided on the vehicle, and is connected to the central control module. The control module is electrically connected to improve the brightness of the target area. 3.根据权利要求2所述的一种基于人工智能的辅助驾驶系统,其特征在于:当所述大气监测单元监测当前车辆所处环境较暗时,发送第一指令给所述中央控制模块,所收到述中央控制模块收到第一指令后生成补光指令,并发送给所述补光灯,所述补光灯收到补光指令后对目标区域进行补光处理。3. An artificial intelligence-based assisted driving system according to claim 2, characterized in that: when the atmospheric monitoring unit monitors that the environment where the current vehicle is located is dark, it sends a first instruction to the central control module, The received central control module generates a supplementary light instruction after receiving the first instruction, and sends it to the supplementary light, and the supplementary light performs supplementary light processing on the target area after receiving the supplementary light instruction. 4.根据权利要求2所述的一种基于人工智能的辅助驾驶系统,其特征在于:所述大气监测单元包括雨量传感器、光照传感器、PM2.5传感器、风速传感器和温湿度传感器,所述雨量传感器、所述光照传感器、所述PM2.5传感器、所述风速传感器和所述温湿度传感器分别与所述中央控制模块电连接。4. a kind of artificial intelligence-based assisted driving system according to claim 2, is characterized in that: described atmospheric monitoring unit comprises rain sensor, light sensor, PM2.5 sensor, wind speed sensor and temperature and humidity sensor, described rainfall The sensor, the light sensor, the PM2.5 sensor, the wind speed sensor and the temperature and humidity sensor are respectively electrically connected to the central control module. 5.根据权利要求1所述的一种基于人工智能的辅助驾驶系统,其特征在于:所述车内环境监测模块包括高清摄像头,所述高清摄像头设置在车辆内,并与所述中央控制模块电连接,以当车内出现紧急情况时,由所述中央控制模块控制警示模块发出报警提醒,其具体步骤如下,5 . The artificial intelligence-based assisted driving system according to claim 1 , wherein the in-vehicle environment monitoring module comprises a high-definition camera, and the high-definition camera is arranged in the vehicle and is connected with the central control module. 6 . It is electrically connected, so that when an emergency occurs in the vehicle, the central control module controls the warning module to issue an alarm reminder. The specific steps are as follows: S1:向用户推送是否打开高清摄像头的指令,如用户选择打开则进入S2,如用户不同意,则高清摄像头处于静默状态;S1: Push the instruction of whether to open the high-definition camera to the user. If the user chooses to open it, it will enter S2. If the user does not agree, the high-definition camera will be in a silent state; S2:高清摄像头开始工作,实时拍摄车辆内的情况,并将采集到的视频信息并发送到图像处理模块进行存储;S2: The high-definition camera starts to work, shoots the situation in the vehicle in real time, and sends the collected video information to the image processing module for storage; S3:图像处理模块用于存储高清摄像头发送的视频信息并转发给深度学习判断模块进行行为分析;S3: The image processing module is used to store the video information sent by the high-definition camera and forward it to the deep learning judgment module for behavior analysis; S4:深度学习判断模块预先训练有异常行为判断模型,根据异常行为判断模型对接收到的视频信息进行行为判断,并将判断结果反馈给中央控制模块;S4: The deep learning judgment module is pre-trained with an abnormal behavior judgment model, conducts behavior judgment on the received video information according to the abnormal behavior judgment model, and feeds back the judgment result to the central control module; S5:如判断结果为异常,中央控制模块控制警示模块发出报警提醒,并通过通讯模块向与远程云端报备,同时将视频信息输送到车载存储介质中进行备份;如判断结果为正常,则将视频信息直接输入到车载存储介质中进行备份。S5: If the judgment result is abnormal, the central control module controls the warning module to issue an alarm reminder, and reports to the remote cloud through the communication module, and transmits the video information to the vehicle storage medium for backup; if the judgment result is normal, the Video information is directly input to the vehicle storage medium for backup. 6.根据权利要求1所述的一种基于人工智能的辅助驾驶系统,其特征在于:所述车辆状态监测模块包括车速监测单元、胎压监测单元、水温监测单元、油量监测单元以及电路监测单元,所述车速监测单元、胎压监测单元、水温监测单元、油量监测单元以及电路监测单元分别与所述中央控制模块电连接。6 . The artificial intelligence-based assisted driving system according to claim 1 , wherein the vehicle state monitoring module comprises a vehicle speed monitoring unit, a tire pressure monitoring unit, a water temperature monitoring unit, an oil quantity monitoring unit and a circuit monitoring unit. 7 . The vehicle speed monitoring unit, the tire pressure monitoring unit, the water temperature monitoring unit, the fuel quantity monitoring unit and the circuit monitoring unit are respectively electrically connected to the central control module. 7.根据权利要求1所述的一种基于人工智能的辅助驾驶系统,其特征在于:所述驾驶人状态监测模块是通过设置在车辆内的面部采集单元来实现的,具体步骤如下,7. a kind of assisted driving system based on artificial intelligence according to claim 1, is characterized in that: described driver state monitoring module is realized by the face acquisition unit that is arranged in the vehicle, and concrete steps are as follows, 步骤一:定时通过面部采集单元采集驾驶员脸部图像;Step 1: periodically collect the driver's face image through the face acquisition unit; 步骤二:对获取的驾驶员脸部图像进行归一化、灰度化处理,获取人脸区域;Step 2: normalize and grayscale the obtained driver's face image to obtain the face area; 步骤三:在人脸区域内定位人眼瞳孔质心和瞳孔区域,获取人眼状态参数并对人眼进行跟踪;Step 3: locate the centroid and pupil area of the pupil of the human eye in the face area, obtain the state parameters of the human eye and track the human eye; 步骤四:将人眼状态参数放入到预先训练好的疲劳特征状态判断模型中,判断驾驶人是否属于疲劳状态,若是,则执行步骤五;否则,返回执行步骤一;Step 4: Put the human eye state parameters into the pre-trained fatigue feature state judgment model to determine whether the driver is in a fatigue state, if so, go to Step 5; otherwise, return to Step 1; 步骤五:中央控制模块控制警示模块发出报警提醒,并通过通讯模块向与远程云端报备。Step 5: The central control module controls the warning module to issue an alarm reminder, and reports to the remote cloud through the communication module. 8.根据权利要求1所述的一种基于人工智能的辅助驾驶系统,其特征在于:所述终端模块为智能手机,所述中央控制模块具有唯一序列号,所述远程云端具有一存储列表,所述存储列表中的唯一序列号对应一个手机注册号,当车内环境监测模块监测到当前驾驶人为陌生人时,中央控制模块通过通讯模块发送确认指令给远程云端,远程云端收到确认指令后推送消息给该中央控制模块所对应的手机注册号,当手机注册号所对应的终端模块收到推送消息后,如同意启动,则该车辆可正常驾驶;如拒绝启动,则该车辆拒绝启动,并发出报警提醒。8. The artificial intelligence-based assisted driving system according to claim 1, wherein the terminal module is a smart phone, the central control module has a unique serial number, and the remote cloud has a storage list, The unique serial number in the storage list corresponds to a mobile phone registration number. When the in-vehicle environment monitoring module detects that the current driver is a stranger, the central control module sends a confirmation instruction to the remote cloud through the communication module. After the remote cloud receives the confirmation instruction Push the message to the mobile phone registration number corresponding to the central control module. When the terminal module corresponding to the mobile phone registration number receives the push message, if it agrees to start, the vehicle can drive normally; if it refuses to start, the vehicle refuses to start. and issue an alarm reminder.
CN202210848230.8A 2022-07-19 2022-07-19 Driving assistance system based on artificial intelligence Pending CN114954307A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210848230.8A CN114954307A (en) 2022-07-19 2022-07-19 Driving assistance system based on artificial intelligence

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210848230.8A CN114954307A (en) 2022-07-19 2022-07-19 Driving assistance system based on artificial intelligence

Publications (1)

Publication Number Publication Date
CN114954307A true CN114954307A (en) 2022-08-30

Family

ID=82968733

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210848230.8A Pending CN114954307A (en) 2022-07-19 2022-07-19 Driving assistance system based on artificial intelligence

Country Status (1)

Country Link
CN (1) CN114954307A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116684142A (en) * 2023-06-06 2023-09-01 深圳华石供应链科技有限公司 Auxiliary driving system and method based on Internet of things
CN117622177A (en) * 2024-01-23 2024-03-01 青岛创新奇智科技集团股份有限公司 Vehicle data processing method and device based on industrial large model

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108986400A (en) * 2018-09-03 2018-12-11 深圳市尼欧科技有限公司 A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method
CN211765391U (en) * 2019-12-10 2020-10-27 浙江吉利汽车研究院有限公司 Early warning system and car in car
CN112428952A (en) * 2020-11-04 2021-03-02 守门狗(杭州)科技服务有限公司 Vehicle safety early warning system based on Internet of things
CN113380063A (en) * 2021-06-17 2021-09-10 郑州财经学院 Automobile driving auxiliary system based on artificial intelligence
CN113997897A (en) * 2021-10-29 2022-02-01 延锋伟世通电子科技(南京)有限公司 In-vehicle personnel state monitoring and abnormity alarming device and using method
CN114537427A (en) * 2022-03-06 2022-05-27 石家庄骐畅电子科技有限公司 Safe driving protection system based on artificial intelligence

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108986400A (en) * 2018-09-03 2018-12-11 深圳市尼欧科技有限公司 A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method
CN211765391U (en) * 2019-12-10 2020-10-27 浙江吉利汽车研究院有限公司 Early warning system and car in car
CN112428952A (en) * 2020-11-04 2021-03-02 守门狗(杭州)科技服务有限公司 Vehicle safety early warning system based on Internet of things
CN113380063A (en) * 2021-06-17 2021-09-10 郑州财经学院 Automobile driving auxiliary system based on artificial intelligence
CN113997897A (en) * 2021-10-29 2022-02-01 延锋伟世通电子科技(南京)有限公司 In-vehicle personnel state monitoring and abnormity alarming device and using method
CN114537427A (en) * 2022-03-06 2022-05-27 石家庄骐畅电子科技有限公司 Safe driving protection system based on artificial intelligence

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116684142A (en) * 2023-06-06 2023-09-01 深圳华石供应链科技有限公司 Auxiliary driving system and method based on Internet of things
CN116684142B (en) * 2023-06-06 2024-03-08 深圳华石供应链科技有限公司 Auxiliary driving system and method based on Internet of things
CN117622177A (en) * 2024-01-23 2024-03-01 青岛创新奇智科技集团股份有限公司 Vehicle data processing method and device based on industrial large model
CN117622177B (en) * 2024-01-23 2024-05-14 青岛创新奇智科技集团股份有限公司 Vehicle data processing method and device based on industrial large model

Similar Documents

Publication Publication Date Title
WO2018058957A1 (en) Intelligent vehicle-road cooperation traffic control system
CN104627076A (en) Automobile and anti-collision pre-warning system for same
US20200070848A1 (en) Method and System for Initiating Autonomous Drive of a Vehicle
CN205930481U (en) Auto steering lamp controlgear and car
CN106114502A (en) A kind of intelligent automobile aid system
CN114954307A (en) Driving assistance system based on artificial intelligence
CN205601701U (en) Freight train bend pedestrian detects warning system
CN109367540A (en) A driver response recognition system based on risk warning
CN114360210A (en) Vehicle fatigue driving early warning system
CN204526997U (en) A kind of vehicle anti-collision early warning system and automobile
CN110682907A (en) A vehicle rear-end collision control system and method
CN109969195A (en) An alarm system and method for abnormal driver facial behavior and a vehicle based thereon
CN103832380A (en) Dead zone automobile detection and warning system and method based on machine vision
CN109541600A (en) A kind of heavy type commercial automobile safe and intelligent driving assistance system
CN114446010A (en) A vehicle-mounted robot system and its driving management method
CN113870618A (en) Driving safety early warning system and method
CN115427268A (en) AI-enabled alarm to detect locked occupants
CN115424471A (en) Highway vehicle safety driving radar monitoring and early warning system
CN111445669B (en) Safety monitoring system of bus
CN113470432A (en) Vehicle inner wheel difference region danger early warning method and system based on V2V and vehicle
CN110356323A (en) A kind of active safety intelligent driving system
CN206282368U (en) A multifunctional driving recorder
CN111845560B (en) A warning system for a vehicle head overrunning an object
CN109501786A (en) Active safety control system and the automobile for using the system
CN115892029A (en) Automobile intelligent blind area monitoring and early warning system based on driver attention assessment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination