JP7369775B2 - Driving incident notification system, method and program - Google Patents

Description

The present invention relates to a driving incident notification system, method, and program for notifying a manager of incidents that take into account the physical condition of a driver while driving. The present invention relates to IoT (Internet of Things), and the technical field falls under G06Q etc. in the IPC classification.

In recent years, IT technology for preventing accidents has been attracting attention. For example, in order to call attention to the location where an incident that is likely to occur occurs, it is determined from the driver's biometric information whether the driver has encountered an incident or not, and if the driver has encountered an incident, the current location is It is counted once as an incident point, and if the count of the point where the current location is approaching within a predetermined distance is registered as an incident point is a predetermined value or more, it corresponds to the incident point of the existing incident data on the map. A technique is provided for displaying a caution mark at a location where the warning mark is displayed.

Japanese Patent Application Publication No. 2017-037359

In order to prevent accidents, it is important to notify managers of incidents that take into account the physical condition of the driver while driving. However, with the technique disclosed in Patent Document 1, it is not possible to notify the administrator of an incident that takes into consideration the physical condition of the driver while driving.

In view of the above problems, it is an object of the present invention to provide a driving incident notification system, method, and program for notifying a manager of incidents that take into account the physical condition of the driver while driving.

The present invention includes a first acquisition means for acquiring biological information of a driver while driving, a first detection means for analyzing the acquired biological information to detect the physical condition of the driver, and a first detection means for detecting the physical condition of the driver by analyzing the acquired biological information. a first determination means for determining a first incident when a predetermined condition is met; a second acquisition means for acquiring behavior information of the driver; and a second acquisition means for acquiring behavior information of the driver; a second detection means for detecting a second incident, a second determination means for determining a second incident when the detected motion satisfies a predetermined condition, and acquiring behavior information of a vehicle being driven by the driver. a third acquisition means, a third detection means for analyzing the acquired vehicle behavior information to detect the vehicle behavior, and comparing the detected behavior with road sign information to ensure compliance with laws and regulations. If the combination of the first incident, the second incident, and/or the third incident satisfies a predetermined condition, a serious incident occurs. the predetermined conditions for determining the first incident, the predetermined conditions for determining the second incident, and the serious incident according to the driver's physical condition before departure; learning means for optimizing one or more of the predetermined conditions when determining the condition; and related information regarding the occurrence of the serious incident determined by optimizing the one or more conditions. A driving incident notification system (the system may be a single computer) is provided, which includes a notification means for notifying a manager.

The present invention also provides a step of acquiring biometric information of a driver while driving, a step of analyzing the acquired biometric information to detect the physical condition of the driver, and a step in which the detected physical condition meets a predetermined condition. If the incident is satisfied, the incident is determined to be a first incident; a step of acquiring behavior information of the driver; a step of analyzing the acquired behavior information to detect the behavior of the driver; a step of determining a second incident when the motion satisfies a predetermined condition; a step of acquiring behavior information of the vehicle being driven by the driver; and a step of analyzing the acquired behavior information of the vehicle. a step of detecting the behavior of the vehicle; a step of comparing the detected behavior with road sign information and determining that the incident is a third incident when the law is not compliant; the first incident; and the second incident. and/or a third incident, determining that a serious incident has occurred when a combination of the above satisfies a predetermined condition, and determining the first incident according to the physical condition of the driver before departure. optimizing one or more of the predetermined conditions for determining the second incident, the predetermined conditions for determining the serious incident, and the predetermined conditions for determining the serious incident; Provided is a driving incident notification method comprising the step of notifying a manager of relevant information regarding the occurrence of the serious incident determined by optimizing two or more conditions .

Furthermore, the present invention provides a computer with the steps of acquiring biological information of the driver while driving, analyzing the acquired biological information to detect the physical condition of the driver, and determining whether the detected physical condition is a predetermined condition. determining that the incident is a first incident if the above conditions are met; acquiring behavior information of the driver; analyzing the acquired behavior information to detect the driver's behavior; determining a second incident when the detected motion satisfies a predetermined condition; acquiring behavior information of the vehicle being driven by the driver; and analyzing the acquired behavior information of the vehicle. a step of detecting the behavior of the vehicle; a step of comparing the detected behavior with road sign information and determining a third incident if the law is not compliant; and the first incident; a step of determining that a serious incident has occurred when a combination of the second incident and/or the third incident satisfies a predetermined condition; optimizing one or more of the predetermined conditions for determining the second incident, the predetermined conditions for determining the serious incident, and the predetermined conditions for determining the serious incident; , a step of notifying a manager of relevant information regarding the occurrence of the serious incident determined by optimizing the one or more conditions .

According to the present invention, the biometric information of the driver while driving is acquired, the biometric information is analyzed, the physical condition is detected, and when the detected physical condition satisfies a predetermined condition, it is determined as a first incident and the driver's physical condition is detected. Obtain motion information, analyze motion information, detect motion, and if the detected motion satisfies predetermined conditions, determine it as a second incident, obtain vehicle behavior information, and analyze the behavior information. , detects the behavior, compares the detected behavior with road sign information, and if the law is not compliant, it is determined to be a third incident, and the combination of the first incident, second incident, and/or third incident is determined. When predetermined conditions are met, it is determined that a serious incident has occurred, and information related to the serious incident is notified to the administrator. Therefore, it is possible to notify the administrator of incidents that take into consideration the physical condition of the driver while driving. When a dangerous situation (serious incident) that should be followed up by the administrator is detected, a notification is sent to the administrator's terminal, allowing the administrator 90 to carry out appropriate follow-up and prevent accidents. Helpful.

1 is a conceptual diagram showing an overall configuration using a driving incident notification system according to an embodiment of the present invention. FIG. 2 is a block diagram showing the configuration of the vehicle of the embodiment. It is a block diagram showing the hardware configuration of the server of the embodiment. It is a block diagram showing the functional configuration of the server of the embodiment. It is a block diagram showing the composition of the administrator terminal of the above-mentioned embodiment. It is a flowchart which shows an example of the driving incident notification process of the said embodiment. FIG. 3 is a diagram illustrating a display example of serious incident related information displayed on an administrator terminal.

The present invention acquires biometric information of a driver while driving, analyzes the biometric information, detects the physical condition, and when the detected physical condition meets predetermined conditions, it is determined as a first incident and the driver's actions Acquire information, analyze motion information, detect motion, and when the detected motion satisfies predetermined conditions, determine it as a second incident, acquire vehicle behavior information, analyze the behavior information, The behavior is detected, and the detected behavior is compared with the road sign information. If the law is not compliant, it is determined to be a third incident, and a combination of the first incident, second incident, and/or third incident is determined. When the above conditions are met, it is determined that a serious incident has occurred, and information related to the serious incident is notified to the administrator.

<Overall Configuration> FIG. 1 is a conceptual diagram showing an overview of the driving incident notification system according to the present embodiment. The driving incident notification system 100 (hereinafter referred to as the "system") 100 includes a server 50, a terminal 20 mounted on the vehicle 10, and an administrator's 90 terminal (preferably a mobile terminal such as a smartphone or tablet) connected to the Internet. Mutual data communication is possible via a network that includes. The vehicle 10 is equipped with a driver biological information sensing section 40, a vehicle information sensing section 42, and a driver motion sensing section 44. Information detected by these is transmitted to the terminal 20 by short-range wireless communication. transmits the received information to the server 50 via the communication unit and the network.

The driver biological information sensing unit 40 includes, for example, a steering wheel cover type electrocardiograph 22 and a seat cover type electrocardiograph 24, and an electrocardiographic waveform that is biological information of the driver 12 is obtained by these. Further, the driver biological information sensing 40 may acquire biological information such as pulse waves, brain waves, blood pressure, and body temperature in addition to electrocardiographic waveforms. The acquired biometric information of the driver while driving is transmitted to the server 50 via the terminal 20, for example (step S1). The server 50 analyzes the acquired biological information to detect the physical condition of the driver 12 (for example, fatigue level, sleepiness, dementia, depression, concentration, possibility of sudden change, allergic symptoms, etc.), and determines whether the detected physical condition is If a predetermined condition is met (for example, it is better not to drive due to high fatigue level), it is determined that the incident is the first incident.

The driver motion sensing unit 44 includes, for example, IoT (Internet of Things) drive recorders 30A and 30B that include a camera facing outside the vehicle and a camera facing inside the vehicle, and can obtain an image of the camera facing inside the vehicle, which is motion information of the driver 12. In addition to the in-vehicle image, the driver motion sensing unit 44 may also acquire motion information of the driver 12 from a steering wheel sensor, a motion sensor, etc. (not shown). The acquired operation information of the driver 12 may be transmitted to the server 50 via the communication units of the IoT drive recorders 30A and 30B, or may be transmitted to the server 50 via the terminal 20 (step S2). ). The server 50 analyzes the acquired motion information to detect the motion of the driver 12, and if the detected motion satisfies a predetermined condition (for example, if the detected motion meets a predetermined condition (e.g., distracted driving, driving while operating a mobile terminal, etc.) 2 seconds or more, sleepy behavior, etc.), this is determined to be a 2nd incident. Note that the IoT drive recorders 30A and 30B are also used to detect vehicle behavior, as will be described later, and also perform constant recording, video clipping, and the like.

The vehicle information sensing unit 42 includes, for example, a drive recorder 26 facing outside the vehicle, a danger notification button 28, and the IoT drive recorders 30A and 30B, and uses these to record the following distance, lane deviation, press date and time, constant recording, video clipping, etc. At the same time, behavior information (for example, speed, acceleration, brake, position information, etc.) of the vehicle 10 is acquired (step S3). The acquired behavior information of the vehicle 10 may be transmitted to the server 50 via the terminal 20, for example, or may be transmitted directly from the sensors to the server 50 if the sensors are equipped with a communication function. good. The server 50 analyzes the acquired behavior information, detects the behavior of the vehicle 10, and compares the detected behavior with road sign information (for example, image analysis of the external cameras of the IoT drive recorders 30A and 30B). road sign identification from map information, road sign identification from map information, etc.), and if the law is not complied with, it is determined to be a third incident.

The server 50 determines that a serious incident has occurred when the combination of the first incident, the second incident, and/or the third incident satisfies a predetermined condition, and provides related information regarding the occurrence of the serious incident. (Time of occurrence, place of occurrence, driver of occurrence, vehicle of occurrence, details of the incident, drive recorder image (video or still image), etc.) are notified to the administrator 90 (Step S4). The notification to the administrator 90 is preferably sent to a mobile terminal such as a smartphone or a tablet. Thereby, the administrator 90 can quickly obtain information on the occurrence of an incident with the driver 12 and can take the next action. Note that notification may also be sent to the administrator's 90 PC.

Further, the server 50 analyzes the vehicle behavior information acquired in step S3 to detect the degree of dangerous driving (for example, sudden start, sudden braking, sudden steering, etc.), and the detected degree of dangerous driving is determined to be a predetermined level. If the following conditions are met, the incident may be determined as the fourth incident. In this case, if the combination of the first indentation, the second incident and/or the third incident, and the fourth incident satisfies a predetermined condition, it is determined that it is a serious incident, and a serious incident has occurred. The administrator 90 is notified of relevant information regarding the above.

Further, the server 50 may learn the individual differences among the drivers 12 and optimize the predetermined conditions for determining each incident for each driver 12, or may optimize the predetermined conditions for determining each incident for each driver 12. Predetermined conditions may be optimized.

The server 50 described above may be a single computer, or may be a terminal, for example. Moreover, a computer system (cloud) may be used in which the functional configurations described below are executed on different computers. Furthermore, in the present embodiment, many processes are executed by the server 50, but information acquisition, analysis/detection, and incident determination may be performed on the edge (sensors, etc.) side. By performing more processing on the edge side, the amount of data sent to the server 50 can be reduced.

<Vehicle Configuration> Next, the configuration of the vehicle 10 will be described with reference to FIG. 2. The vehicle 10 includes a driver biometric information sensing section 40 for obtaining biometric information of the driver 12 , a vehicle information sensing section 42 for obtaining behavior information of the vehicle 10 being driven by the driver 12 , and a vehicle information sensing section 42 for obtaining behavioral information of the driver 12 . A driver operation sensing section 44 is provided to obtain the driver operation. The driver biological information sensing section 40 includes a handle-type electrocardiograph 22, a seat cover-type electrocardiograph 24, and the like. The vehicle information sensing unit 42 includes an external drive recorder 26, a danger notification button 28, and the like. The danger notification button 28 is a button that can be pressed when an incident occurs that the driver 12 notices inside or outside the vehicle, regardless of various sensing devices, and is used to obtain incident information based on the driver's 12 judgment. For example, the driver 12 makes a judgment and presses the button when there is an event that is likely to lead to danger that cannot be detected by the on-vehicle device, such as when there is an interruption in front of the driving vehicle, or when there is a falling or flying object. When the danger notification button 28 is pressed, the time and position are recorded as incident occurrence information, and, for example, an image (moving image or still image) captured by a drive recorder is cut out and transmitted to the server 50. Note that the IoT drive recorders 30A and 30B also sense the behavior of the vehicle 10. The driver motion sensing unit 44 includes IoT drive recorders 30A, 30B, etc., which are equipped with a camera facing outside the vehicle and a camera facing inside the vehicle. The communication unit 46 transmits and provides information obtained by various sensors and images (moving images or still images) captured by a drive recorder to the server 50 via the network. Of course, other information may be provided as necessary.

<Hardware Configuration of Server> Next, the functional configuration of the server 50 will be described with reference to FIG. 3. The server 50 includes a processor 52, a memory 54, a storage 56, and a communication unit 68, which are connected by a bus (not shown). The processor 52 is configured by, for example, a CPU (Central Processing Unit), and performs various processes by reading and executing various programs stored in the memory 54 . The memory 54 stores a program to be executed by the processor 52, and includes, for example, a ROM (Read Only Memory) or a RAM (Random Access Memory). For example, various means shown in FIG. 4 are stored. The storage 56 includes acquired information 58, first incident determination conditions 50, second incident determination conditions 62, road sign information 63, fourth incident determination conditions 64, serious incident determination conditions 65, incident related information 66, map information 67, and It stores control programs (not shown) and the like.

The acquired information 58 includes, for example, biological information of the driver 12 while driving (electrocardiogram, pulse wave, brain wave, blood pressure, body temperature, etc.), operational information of the driver 12 (in-vehicle camera image, steering wheel sensor information, motion sensor information, etc.). ), and behavior information (speed, acceleration, brake, position information, etc.) of the vehicle 10 being driven by the driver 12. Of course, the information is not limited to the information listed here.

The first incident determination condition 60 is a criterion for detecting the physical condition of the driver 12 by analyzing the acquired biological information and determining whether the detected physical condition corresponds to the first incident. For example, there is a criterion that if the driver 12 is highly fatigued, it is better not to drive.

The second incident determination condition 62 is a criterion for analyzing the acquired behavior information of the driver 12 to detect the behavior of the driver 12 and determining whether or not the detected behavior corresponds to the second incident. be. For example, standards have been established such that if a driver loses his or her line of sight for more than two seconds due to distracted driving or while driving while using a mobile device, or if the driver acts in a drowsy manner, the incident falls under the second incident.

The road sign information 63 analyzes the acquired behavior information of the driver 12 to detect the behavior of the vehicle 10, and determines whether the detected behavior corresponds to the third incident based on whether or not it complies with the law. This is the standard for For example, it is determined whether the behavior of the vehicle 10 complies with laws and regulations by identifying road signs by image analysis of an external camera or by identifying road signs from map information.

The fourth incident determination condition 64 is a criterion for analyzing the acquired behavior information of the vehicle 10, detecting the degree of dangerous driving, and determining whether the degree of dangerous driving corresponds to the fourth incident. . For example, the determination can be made using a criterion in which the behavior information of the vehicle 10 and the driving details are associated, and specifically, by analyzing the behavior information, it is possible to determine whether the vehicle 10 will collide with the vehicle in front when traveling at the same speed. If there is a high possibility that an accident will occur if the vehicle continues to drive, such as if the G force is extremely large either vertically, horizontally, or longitudinally, or if it is determined that the vehicle is in a dangerous situation. Criteria have been established such that if an incident occurs, it falls under the fourth incident.

The serious incident determination condition 65 is a criterion for determining whether the combination of the first incident, the second incident, and/or the third incident corresponds to a serious incident. In addition, when determining the fourth incident, to determine whether the combination of the first incident, the second incident and/or the third incident, and the fourth incident corresponds to a serious incident. This is the standard.

The incident-related information 67 is information related to the occurrence of a serious incident (for example, time of occurrence, location of occurrence, driver of occurrence, vehicle of occurrence, incident details, drive recorder image (video or still image), etc.).

The map information 67 is information used to display, on the terminal of the administrator 90, information related to the occurrence of a serious incident using a map. Further, as described above, the map information 67 may also be used to specify the road sign information 63. Furthermore, if information on traffic, such as locations where accidents and traffic jams are likely to occur, is used, it can also be used when selecting a route.

Next, the communication unit 68 receives and acquires information obtained by various sensors of the vehicle 10 and images (moving images or still images) captured by the drive recorder via the network. Of course, other information may be acquired as necessary.

<Functional configuration of server> Next, the functional configuration of the server 50 will be described with reference to FIG. 4. The server 50 includes a first acquisition means 70, a first detection means 71, a first determination means 72, a second acquisition means 73, a second detection means 74, a second determination means 76, and a third acquisition means. 77, a third detection means 78, a third determination means 80, a fourth detection means 81, a fourth determination means 82, a determination means 84, a notification means 86, and a learning means 88.

The first acquisition means 70 acquires biological information (electrocardiogram, pulse wave, brain wave, blood pressure, body temperature, etc.) of the driver 12 while driving. For example, biometric information obtained by the driver biometric information sensing unit 40 of the vehicle 10 is transmitted to the server 50 via the terminal 20, and the server 50 acquires the biometric information by receiving the transmitted information. The acquired biometric information is stored in the acquired information 58 of the storage 56.

The first detection means 71 analyzes the biological information acquired by the first acquisition means 70 and detects the physical condition of the driver 12 (degree of fatigue, sleepiness, dementia, depression, concentration, possibility of sudden change, allergy determination, etc.) It is something to do.

The first determining means 72 determines that a first incident has occurred when the physical condition detected by the first detecting means 71 satisfies a predetermined condition (eg, the degree of fatigue is high and it is better not to drive). A determination as to whether or not it is a first incident is made based on whether or not the first incident determination condition 60 is satisfied.

The second acquisition means 73 acquires operation information of the driver 12 (images from an in-vehicle camera, steering wheel sensor information, motion sensor information, etc.). For example, the motion information of the driver 12 obtained by the driver motion sensing unit 44 of the vehicle 10 is transmitted to the server 50 directly by the IoT drive recorders 30A, 30B or via the terminal 20, and the server 50 receives the transmitted information. By receiving the information, the operation information of the driver 12 is acquired. The acquired operation information is stored in the acquired information 58 of the storage 56.

The second detection means 74 analyzes the motion information acquired by the second acquisition means 73 and detects the motion of the driver 12.

The second determining means 76 determines that when the motion detected by the second detecting means 74 satisfies a predetermined condition (i.e., when the user's eyes are off track for more than 2 seconds due to distracted driving or driving while operating a mobile terminal), 2), the incident is determined to be a second incident. A determination as to whether or not it is a second incident is made based on whether or not the second incident determination condition 62 is satisfied.

The third acquisition means 77 acquires behavior information (speed, acceleration, brake, position information, etc.) of the vehicle 10 being driven by the driver 12. For example, behavior information of the vehicle 10 obtained by the vehicle information sensing section 42 of the vehicle 10 is transmitted to the server 50 via the terminal 20. Alternatively, if the sensors are equipped with a communication function, the behavior information of the vehicle 10 may be transmitted directly from the edge side to the server 50. The server 50 acquires behavior information of the vehicle 10 by receiving the transmitted information. The acquired behavior information is stored in the acquired information of the storage 56.

The third detection means 78 analyzes the behavior information acquired by the third acquisition means 77 and detects the behavior of the vehicle 10.

The third determination means 80 compares the behavior detected by the third detection means 78 with the road sign information 63 (road sign identification by image analysis of a vehicle external camera, road sign identification from map information, etc.), and complies with the law. If this is not the case, it is determined to be a third incident.

The fourth detection means 81 analyzes the behavior information of the vehicle 10 acquired by the third acquisition means 77 and detects the degree of dangerous driving (sudden start, sudden braking, sudden steering, etc.).

The fourth determining means 82 determines that a fourth incident has occurred when the degree of dangerous driving detected by the fourth detecting means 81 satisfies a predetermined condition. A determination as to whether or not it is a fourth incident is made based on whether or not the fourth incident determination condition 64 is satisfied.

The determining means 84 determines that a serious incident has occurred when a combination of the first incident, the second incident, and/or the third incident satisfies a predetermined condition. A determination as to whether or not it is a serious incident is made based on whether or not serious incident determination conditions 65 are satisfied. In addition, when a fourth incident is determined, if the combination of the first incident, the second incident and/or the third incident, and the fourth incident satisfies a predetermined condition (serious incident determination condition 65). The incident is determined to be a serious incident.

The notification means 86 is for notifying the administrator 90 of related information regarding the occurrence of a serious incident (occurrence time, occurrence location, incident driver, incident vehicle, incident details, drive recorder image (video or still image), etc.). be. For example, the incident-related information 66 is sent to the administrator terminal 92 via the communication unit 68 and displayed on the display unit 94 of the administrator terminal 92 to notify. Note that the means of notification is not limited to this.

The learning means 88 learns individual differences among the drivers 12 and sets predetermined conditions (among the first incident determination condition 60, second incident determination condition 62, fourth incident determination condition 64, and serious incident determination condition 65) for each driver. one or more conditions). By reflecting the individual differences of the drivers 12 in the incident determination conditions, more accurate incident determination can be performed. Further, the learning means 88 determines the predetermined conditions (among the first incident determination condition 60, the second incident determination condition 62, the fourth incident determination condition 64, and the serious incident determination condition 65) according to the physical condition of the driver 12 before departure. (one or more conditions) may be optimized. By reflecting the physical condition of the driver 12 before departure in the incident determination conditions, it is possible to more accurately determine an incident by taking into account the physical condition of the driver 12 on the day.

<Configuration of administrator terminal> Next, the configuration of the administrator terminal 92 of the administrator 90 will be described with reference to FIG. The administrator terminal 92 is preferably a mobile terminal such as a smartphone or a tablet. This is to make it easier for the administrator 90 to obtain information about the occurrence of an incident involving the driver 12 and take the next action. The administrator terminal 92 includes a display section 94, an input section 96, and a communication section 98. The display section 94 and the input section 96 are, for example, touch panels, but are not limited thereto. The communication unit 98 receives incident-related information 66 from the server 50 via the network. Of course, other information may be received, or information may be provided (transmitted) to the server 50. Note that this does not preclude the use of a PC or the like as the administrator terminal 92 in conjunction with the aforementioned mobile terminals such as smartphones and tablets.

<Driving Incident Notification Process> Next, an example of the driving incident notification process by the present system 100 will be described with reference to FIG. 6. First, the first acquisition means 70 of the server 50 acquires biological information (electrocardiogram, pulse wave, brain wave, blood pressure, body temperature, etc.) of the driver 12 while driving (step S10). For example, biometric information obtained by the driver biometric information sensing unit 40 of the vehicle 10 is transmitted to the server 50 via the terminal 20, and the server 50 acquires the biometric information by receiving the transmitted information. The acquired biometric information is stored in the acquired information 58 of the storage 56.

Next, the first detection means 71 of the server 50 analyzes the biological information acquired by the first acquisition means 70 and determines the physical condition of the driver 12 (degree of fatigue, sleepiness, dementia, depression, ability to concentrate, possibility of sudden change, (allergy determination, etc.) is detected (step S12).

Next, the first determining means 72 of the server 50 determines that it is a first incident when the physical condition detected by the first detecting means 71 satisfies a predetermined condition (for example, the degree of fatigue is high and it is better not to drive). (Step S14). A determination as to whether or not it is a first incident is made based on whether or not the first incident determination condition 60 is satisfied.

On the other hand, in the server 50, in parallel with steps S10 to S12, the second acquisition means 73 acquires operation information of the driver 12 (in-vehicle camera image, steering wheel sensor information, motion sensor information, etc.) (step S20). ). For example, the motion information of the driver 12 obtained by the driver motion sensing unit 44 of the vehicle 10 is transmitted to the server 50 directly or via the terminal 20 by the IoT drive recorders 30A and 30B, and the server 50 receives the transmitted information. By receiving the information, the operation information of the driver 12 is acquired. The acquired operation information is stored in the acquired information 58 of the storage 56.

Next, the second detection means 74 of the server 50 analyzes the operation information acquired by the second acquisition means 73 and detects the operation of the driver 12 (step S22).

Next, the second determining means 76 determines whether the motion detected by the second detecting means 74 satisfies predetermined conditions (distracted driving, driving while operating a mobile terminal and loses one's line of sight for more than two seconds, drowsy driving). If the incident occurs (such as when the incident occurs), the incident is determined to be a second incident (step S24). A determination as to whether or not it is a second incident is made based on whether or not the second incident determination condition 62 is satisfied.

Further, in parallel with steps S10 to S14 and steps S20 to S24, the third acquisition means 77 of the server 50 obtains behavior information (speed, acceleration, brake, position information, etc.) of the vehicle 10 being driven by the driver 12. (Step S30). For example, behavior information of the vehicle 10 obtained by the vehicle information sensing section 42 of the vehicle 10 is transmitted to the server 50 via the terminal 20. Alternatively, if the sensors are equipped with a communication function, the behavior information of the vehicle 10 may be transmitted directly from the edge side to the server 50. The server 50 acquires behavior information of the vehicle 10 by receiving the transmitted information. The acquired behavior information is stored in the acquired information 58 of the storage 56.

Next, the third detection means 78 of the server 50 analyzes the behavior information acquired by the third acquisition means 77 and detects the behavior of the vehicle 10 (step S32).

Next, the third determining means 80 of the server 50 compares the behavior detected by the third detecting means 78 with the road sign information 63 (road sign identification by image analysis of the vehicle external camera, road sign identification from map information). (identification, etc.), the incident is determined to be a third incident (step S34).

Next, the determining means 84 of the server 50 determines that a serious incident has occurred when the combination of the first incident, the second incident, and/or the third incident satisfies a predetermined condition (step S40 ). A determination as to whether or not it is a serious incident is made based on whether or not serious incident determination conditions 65 are satisfied.

Then, the notification means 86 of the server 50 sends related information regarding the occurrence of a serious incident (time of occurrence, place of occurrence, driver of occurrence, vehicle of occurrence, details of the incident, drive recorder image (video or still image), etc.) to administrator 90. (Step S42). For example, the incident-related information 66 is sent to the administrator terminal 92 via the communication unit 68 and displayed on the display unit 94 of the administrator terminal 92 to notify. Note that the means of notification is not limited to this.

FIG. 7 shows a display example of serious incident related information displayed on the administrator terminal 92. As shown in FIG. 7, the display section 94 of the administrator terminal 92 displays "serious event notification" as "car number: A111", "employee number: BB123456", "occurred event: forward collision warning", " A map 101 is displayed along with text information such as "Time of occurrence: 2019/04/19 13:27:30".

On the map 101, icons 102 are shown at points where important events have occurred. Further, a screen for playing a video is displayed below the map 101, and when the play button 104 is tapped, an image 106 shown on the right side of FIG. A car interior image 106B is shown at 106B, and the situation outside the car and the situation inside the car (driver's situation) can be confirmed. Note that these images may be still images or moving images. As a result, when a dangerous situation (serious incident) that should be followed up by the administrator 90 is detected, a notification is sent to the terminal owned by the administrator 90, which helps prevent accidents by conducting appropriate follow-up. . In particular, by using a mobile terminal such as a smartphone or a tablet as the administrator terminal 92, the administrator 90 can quickly obtain information on the occurrence of an incident with the driver 12 and take the next action.

In this embodiment, when the occurrence of the fourth incident is taken into consideration in determining a serious incident, the fourth incident of the server 50 is The detection means 81 analyzes the behavior information of the vehicle 10 acquired by the third acquisition means 77 and detects the degree of dangerous driving (sudden start, sudden braking, sudden steering, etc.).

Next, the fourth determining means 82 of the server 50 determines that a fourth incident has occurred when the degree of dangerous driving detected by the fourth detecting means 81 satisfies a predetermined condition. A determination as to whether or not it is a fourth incident is made based on whether or not the fourth incident determination condition 64 is satisfied.

Then, when the fourth incident is determined, the determining means of the server 50 determines that the combination of the first incident, the second incident and/or the third incident, and the fourth incident is determined based on predetermined conditions (serious incident determination). If condition 65) is satisfied, the incident is determined to be a serious incident.

In the present embodiment, the learning means 88 learns the individual differences of the drivers 12 and sets predetermined conditions for each driver (first incident determination condition 60, second incident determination condition 62, fourth incident determination condition 64, serious incident determination condition 64, (one or more of the incident determination conditions 65) may be optimized. By reflecting the individual differences of the drivers 12 in the incident determination conditions, more accurate incident determination can be performed.

Further, the learning means 88 determines the predetermined conditions (among the first incident determination condition 60, the second incident determination condition 62, the fourth incident determination condition 64, and the serious incident determination condition 65) according to the physical condition of the driver 12 before departure. (one or more conditions) may be optimized. By reflecting the physical condition of the driver 12 before departure in the incident determination conditions, it is possible to more accurately determine an incident by taking into account the physical condition of the driver 12 on the day.

<Effects> According to the embodiment described above, biometric information of a driver while driving is acquired, biometric information is analyzed, physical condition is detected, and when the detected physical condition satisfies predetermined conditions, If the incident is determined to be the first incident, the driver's movement information is acquired, the movement information is analyzed, the movement is detected, and the detected movement satisfies the predetermined conditions, the incident is determined to be the second incident and the vehicle's behavior is determined to be the first incident. Acquire information, analyze behavior information, detect behavior, compare the detected behavior with road sign information, and if the law is not compliant, it will be determined as a third incident, and the first incident and second incident will be classified as a third incident. When the combination of the incident and/or the third incident satisfies a predetermined condition, it is determined that a serious incident has occurred, and information related to the serious incident is notified to the administrator. Therefore, it is possible to notify the administrator of incidents that take into account the physical condition of the driver while driving, and when a dangerous situation (serious incident) that the administrator 90 should follow up is detected, Notification will help prevent accidents by conducting appropriate follow-up.

Note that the above-described embodiment is an example, and changes can be made as appropriate within a range that provides similar effects. Further, the server 50 may be a single computer, for example, a terminal. Further, the above functional configuration may be a computer system (cloud) executed on different computers. Furthermore, in the present embodiment, many processes are executed by the server 50, but information acquisition, analysis/detection, and incident determination may be performed on the edge (sensors, etc.) side. By performing more processing on the edge side, the amount of data sent to the server 50 can be reduced. Further, the present invention may be provided as a program executed by the server 50. This program may be provided in a state recorded on a computer-readable recording medium, or may be downloaded via a network. Further, the present invention may be provided as a method invention.

According to the present invention, the biometric information of the driver while driving is acquired, the biometric information is analyzed, the physical condition is detected, and when the detected physical condition satisfies a predetermined condition, it is determined that it is the first incident, and the driver acquires vehicle behavior information, analyzes the behavior information, detects the behavior, and if the detected behavior meets predetermined conditions, determines it as a second incident, acquires vehicle behavior information, and analyzes the behavior information If the detected behavior is not compliant with the road sign information, it is determined to be a third incident, and the first incident is combined with the second incident and/or the third incident. If a predetermined condition is met, it is determined that a serious incident has occurred, and information related to the serious incident is notified to the administrator. This makes it possible to notify the administrator of incidents that take into account the physical condition of the driver while driving, which is suitable as a driving incident notification system.

10: Vehicle 12: Driver 20: Terminal 22: Steering wheel cover electrocardiograph 24: Seat cover electrocardiograph 26: External drive recorder 28: Danger notification button 30A, 30B: IoT drive recorder 40: Driver biological information sensing unit 42: Vehicle information sensing section 44: Driver motion sensing section 46: Communication section 50: Server 52: Processor 54: Memory 56: Storage 58: Acquired information 60: First incident judgment condition 62: Second incident judgment condition 63: Road sign Information 64: Fourth incident determination condition 65: Serious incident determination condition 66: Incident related information 67: Map information 68: Communication department 70: First acquisition means 71: First detection means 72: First determination means 73: Second acquisition Means 74: Second detection means 76: Second determination means 77: Third acquisition means 78: Third detection means 80: Third determination means 81: Fourth detection means 82: Fourth determination means 84: Determination means 86: Notification Means 88: Learning means 90: Administrator 92: Administrator terminal 94: Display unit 96: Input unit 98: Communication unit 100: Driving incident notification system 101: Map 102: Icon 104: Play button 106: Image 106A: Image outside the vehicle 106B: Car interior image

Claims (6)

a first acquisition means for acquiring biometric information of a driver while driving;
a first detection means for detecting the physical condition of the driver by analyzing the acquired biological information;
a first determination means for determining a first incident when the detected physical condition satisfies a predetermined condition;
a second acquisition means for acquiring operation information of the driver;
a second detection means for analyzing the acquired motion information and detecting the motion of the driver;
a second determination means for determining a second incident when the detected motion satisfies a predetermined condition;
third acquisition means for acquiring behavior information of a vehicle being driven by the driver;
a third detection means for analyzing the acquired vehicle behavior information to detect the behavior of the vehicle;
a third determining means that compares the detected behavior with road sign information and determines that it is a third incident if the law is not compliant;
determining means for determining that a serious incident has occurred when a combination of the first incident, the second incident and/or the third incident satisfies a predetermined condition;
Depending on the physical condition of the driver before departure, the predetermined conditions for determining the first incident, the predetermined conditions for determining the second incident, and the predetermined conditions for determining the serious incident. a learning means for optimizing one or more of the conditions;
notification means for notifying an administrator of relevant information regarding the occurrence of the serious incident determined by optimizing the one or more conditions ;
A driving incident notification system equipped with fourth detection means for analyzing the acquired vehicle behavior information to detect a degree of dangerous driving;
and fourth determining means for determining a fourth incident when the dangerous driving degree satisfies a predetermined condition,
Claim: The determining means determines that a serious incident has occurred when a combination of the first incident, the second incident and/or the third incident, and the fourth incident satisfies a predetermined condition. The driving incident notification system described in 1. learning means for learning individual differences among the drivers and optimizing the predetermined conditions for each driver;
The driving incident notification system according to claim 1 or 2, comprising: The predetermined condition when determining the first incident is the fatigue level of the driver,
The predetermined conditions for determining the second incident are inattentive driving, driving while operating a mobile terminal, and sleepy behavior;
The driving incident notification system according to claim 1 or 2, wherein the road sign information is based on a result of identifying road signs existing on the road when the behavior of the vehicle is detected. a step of acquiring biometric information of the driver while driving;
analyzing the acquired biological information to detect the physical condition of the driver;
determining a first incident if the detected physical condition satisfies a predetermined condition;
obtaining operation information of the driver;
analyzing the acquired motion information to detect motion of the driver;
determining a second incident if the detected motion satisfies a predetermined condition;
acquiring behavior information of a vehicle being driven by the driver;
analyzing the acquired vehicle behavior information to detect the vehicle behavior;
comparing the detected behavior with road sign information and determining it as a third incident if the law is not compliant;
determining that a serious incident has occurred when a combination of the first incident, the second incident and/or the third incident satisfies a predetermined condition;
Depending on the physical condition of the driver before departure, the predetermined conditions for determining the first incident, the predetermined conditions for determining the second incident, and the predetermined conditions for determining the serious incident. optimizing one or more of the conditions;
Notifying an administrator of relevant information regarding the occurrence of the serious incident determined by optimizing the one or more conditions ;
A method for notifying incidents while driving. to the computer,
a step of acquiring biometric information of the driver while driving;
analyzing the acquired biological information to detect the physical condition of the driver;
determining a first incident if the detected physical condition satisfies a predetermined condition;
obtaining operation information of the driver;
analyzing the acquired motion information to detect motion of the driver;
determining a second incident if the detected motion satisfies a predetermined condition;
acquiring behavior information of a vehicle being driven by the driver;
analyzing the acquired vehicle behavior information to detect the vehicle behavior;
comparing the detected behavior with road sign information and determining it as a third incident if the law is not compliant;
determining that a serious incident has occurred when a combination of the first incident, the second incident and/or the third incident satisfies a predetermined condition;
Depending on the physical condition of the driver before departure, the predetermined conditions for determining the first incident, the predetermined conditions for determining the second incident, and the predetermined conditions for determining the serious incident. optimizing one or more of the conditions;
Notifying an administrator of relevant information regarding the occurrence of the serious incident determined by optimizing the one or more conditions ;
Driving incident notification program to run.

Images