JP2021135218A - Vehicle control device, information processing device, and vehicle control system - Google Patents

Abstract

To provide a vehicle control device, an information processing device, and a vehicle control system which are capable of notifying in advance an occupant of deterioration in detection accuracy of biological information in a planned travel route.SOLUTION: A vehicle control device comprises: a detection part for detecting biological information on an occupant of a vehicle; a destination setting part for setting a destination of the vehicle; an acquisition part for acquiring other vehicle accuracy information related to detection accuracy of the biological information in other vehicles in a planned travel route of the vehicle to the destination; and a notification part which performs notification that the detection accuracy drops before the vehicle passes a section where the detection accuracy is estimated to drop in the planned travel route on the basis of the other vehicle accuracy information.SELECTED DRAWING: Figure 6

Description

The present invention relates to a vehicle control device, an information processing device, and a vehicle control system.

Conventionally, various techniques for measuring biological information such as heartbeat, respiration, and body temperature of a driver who operates a vehicle have been proposed. When measuring the biological information of the driver, it is conceivable to use a contact-type detector mounted on the human body of the driver as represented by a wearable device. For example, Patent Document 1 discloses a technique of measuring a user's biological information using a wearable device worn by the user and using it for predetermined control in a vehicle.

However, when the wearable device is always used, the power of the wearable device is consumed and the usage time is limited. Further, in the human body type detector, it is desirable to use the detector provided in the vehicle because the driver may feel the troublesomeness of the mounting work and the troublesomeness during mounting. For example, Patent Document 2 describes a technique for detecting a driver's pulse using a non-contact radio wave type pulse sensor built in a backrest of a driver's seat and a technique for detecting a driver's body temperature using an in-vehicle camera. Is disclosed. Further, Patent Document 3 discloses a technique for detecting a driver's heartbeat using a radio wave type unmodulated Doppler sensor. Further, Patent Document 4 discloses a technique for extracting a change in complexion corresponding to a pulse wave by using an in-vehicle camera.

JP-A-2017-131445 Japanese Unexamined Patent Publication No. 2018-019882 Japanese Unexamined Patent Publication No. 2010-20493 JP-A-2018-127112

However, the detection accuracy of the detector provided in the vehicle may decrease due to factors such as the traveling state of the vehicle and the light environment in the vehicle interior. When the detection accuracy of the biometric information is lowered, the accuracy of the control performed using the biometric information is lowered. Therefore, if it is possible to notify the occupant in advance that the detection accuracy of the detector provided in the vehicle will decrease, the occupant will not be forced to take a sudden action when the detection accuracy decreases, and the occupant will feel at ease. Can be given.

The present invention has been made in view of the above problems, and an object of the present invention is a vehicle control device capable of notifying an occupant in advance of a decrease in detection accuracy of biological information on a planned travel route. , To provide an information processing device and a vehicle control system.

In order to solve the above problems, according to a certain viewpoint of the present invention, a detection unit that detects biological information of a vehicle occupant, a destination setting unit that sets a destination of the vehicle, and traveling of the vehicle to the destination. Before the vehicle passes through the acquisition unit that acquires other vehicle accuracy information regarding the detection accuracy of biometric information in other vehicles on the planned route and the section where the detection accuracy on the planned travel route is estimated to decrease based on the other vehicle accuracy information. Is provided with a vehicle control device including a notification unit for notifying the decrease.

In addition, the vehicle control device is collected by an estimation unit that estimates the detection accuracy of biometric information by the detection unit, and a data collection unit that collects accuracy reduction information including information on a section where the detection accuracy of biometric information has decreased. A transmission control unit that transmits accuracy reduction information to the information processing device may be provided.

Further, the accuracy reduction information may include information on the traveling environment of the vehicle when the detection accuracy is reduced, together with the information on the section where the detection accuracy of the biological information is reduced.

Further, the transmission control unit may transmit the collected accuracy reduction information to the information processing device when the number of times the detection accuracy is reduced in the same section is equal to or more than a predetermined number of times.

Further, the acquisition unit may acquire other vehicle accuracy information related to the entire section of the planned travel route when the destination is set and the planned travel route is set.

In addition, the acquisition unit may acquire other vehicle accuracy information related to the assumed travel schedule route while the vehicle travels toward the set destination.

Further, the accuracy information of the other vehicle may include information on the detection accuracy of biological information in the other vehicle in a traveling environment similar to the traveling environment of the vehicle scheduled to travel on the planned traveling route.

In addition, the detection unit detects biological information based on the face image of the occupant, the vehicle control device includes a face information calculation unit that calculates predetermined face information regarding the occupant's face, and the other vehicle accuracy information is the occupant. It may include information on the detection accuracy of the biometric information in another vehicle that detects the biometric information of the occupant having similar face information.

Further, the biological information may be information on the heartbeat of the occupant, and the face information may include at least one information of the occupant's skin color, the change in skin color, or the size of the cheek area.

Further, the biological information may be information on the line of sight of the occupant, and the face information may include information on at least one of the size of the occupant's eyes, the size of the eyelids, and the length of the eyelashes.

Further, the notification unit may change the content of the notification according to the ratio of the vehicles whose detection accuracy has decreased to the total number of vehicles traveling in the section where the detection accuracy has decreased.

In addition, the notification unit may notify in advance that the detection accuracy may decrease based on the number of times the detection accuracy decreases in the same section.

In addition, the control unit executes predetermined control based on the biological information detected based on the information acquired by the first detector provided in the vehicle, and at least the planned travel route based on the accuracy information of the other vehicle. While the vehicle passes through the section where the detection accuracy is estimated to decrease, the predetermined control may be executed based on the biometric information acquired by the second detector mounted on the occupant.

Further, in order to solve the above problem, according to another viewpoint of the present invention, the information of the section where the detection accuracy of the biological information is lowered from the vehicle control device having the function of detecting the biological information of the occupant of the vehicle is included. An information processing device including a data processing unit that receives and stores accuracy deterioration information, and an output control unit that transmits other vehicle accuracy information regarding the detection accuracy of biometric information to a vehicle scheduled to travel in a section where the detection accuracy has decreased. Is provided.

Further, the accuracy reduction information includes information on the driving environment of the vehicle when the detection accuracy is lowered together with the information on the section where the detection accuracy of the biological information is lowered, and the data processing unit runs the information on the section where the detection accuracy is lowered. It may be classified and accumulated based on environmental information.

In addition, the output control unit transmits the section with reduced detection accuracy to the vehicle scheduled to travel based on the ratio of the vehicles with reduced detection accuracy to the total number of vehicles traveling in the section with reduced detection accuracy. The content of the vehicle accuracy information may be different.

Further, in order to solve the above problems, according to still another viewpoint of the present invention, information processing for communicating with a vehicle control device having a function of detecting biological information of a vehicle occupant and a plurality of vehicle control devices. In a vehicle control system including the device, the vehicle control device includes a detection unit that detects biometric information of an occupant, a destination setting unit that sets the destination of the vehicle, and a travel schedule of the vehicle to the destination. Before the vehicle passes through the acquisition unit that acquires other vehicle accuracy information regarding the detection accuracy of biometric information in other vehicles on the route and the section where the detection accuracy on the planned travel route is estimated to decrease based on the other vehicle accuracy information. The information processing device includes a notification unit for notifying the decrease, and a data processing unit that receives and stores accuracy reduction information including information of a section in which the detection accuracy of biological information has decreased from a vehicle control device. A vehicle control system including an output control unit for transmitting other vehicle accuracy information regarding the detection accuracy of biometric information to a vehicle scheduled to travel in a section where the detection accuracy has deteriorated is provided.

As described above, according to the present invention, it is possible to notify the occupant in advance of a decrease in the detection accuracy of biometric information on the planned travel route.

It is a schematic diagram which shows an example of the schematic structure of the control system for a vehicle which concerns on 1st Embodiment of this invention. It is a block diagram which shows the structural example of the control device for a vehicle which concerns on this embodiment. It is explanatory drawing which shows an example of the estimation method of the detection accuracy of biological information. It is a block diagram which shows the structural example of the information processing apparatus which concerns on this embodiment. It is explanatory drawing which shows three sections A, B, and C in which the detection accuracy of biometric information was lowered in the planned travel route. It is explanatory drawing which shows the example of the action which is executed by the control device for a vehicle according to the accuracy information of another vehicle. It is a flowchart which shows an example of the data collection transmission processing executed by the control device for a vehicle. It is a flowchart which shows an example of the data storage output processing executed by an information processing apparatus. It is a flowchart which shows an example of the notification processing executed by the control device for a vehicle. It is a flowchart which shows another example of the notification processing executed by the vehicle control device. It is a schematic diagram which shows an example of the schematic structure of the control system for a vehicle which concerns on 2nd Embodiment of this invention. It is a flowchart which shows an example of the process executed by the control device for a vehicle.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

<< First Embodiment >>
<1. Outline configuration of vehicle control system>
First, a schematic configuration of a vehicle control system according to the first embodiment of the present invention will be described. FIG. 1 is a schematic view showing an example of a schematic configuration of a vehicle control system 100 according to the present embodiment.

The vehicle control system 100 includes vehicle control devices (hereinafter, also simply referred to as “control devices”) 50a and 50b, and an information processing device 10 configured to be able to communicate with the control devices 50a and 50b. Hereinafter, when no particular distinction is required, they are collectively referred to as "vehicle 1" or "control device 50" and the like. Although the two vehicles 1A and 1B will be illustrated and described in order to facilitate the understanding of the invention, the number of vehicles that can be connected to the information processing device 10 is not limited to two, and the number of the vehicles is not limited. ..

In the vehicle control system 100 according to the present embodiment, the information processing device 10 collects accuracy reduction information regarding a section in which the detection accuracy of biological information has decreased from the control device 50 mounted on each vehicle 1, and performs the section. The other vehicle accuracy information regarding the detection accuracy is transmitted in advance to the vehicle 1 scheduled to be traveled, and the occupants are notified. As a result, the occupant does not have to deal with a sudden decrease in the detection accuracy of the biological information, and can use a vehicle that can execute the control based on the biological information with peace of mind.

The control device 50 is mounted on the vehicle 1 and is configured to detect the biometric information of the occupant and execute a predetermined control using the detected biometric information. In the present embodiment, an example will be described in which the occupant's heartbeat is detected as the occupant's biological information and predetermined control is executed based on the detected heartbeat information. The control device 50 includes a communication unit 51 and an arithmetic processing unit 53, and is configured to be able to communicate with the information processing device 10 via a wireless communication network 5 such as mobile communication.

The information processing device 10 is configured to accumulate detection accuracy data of biological information transmitted from the control device 50 and notify an occupant of a decrease in detection accuracy via the control device 50. The information processing device 10 includes a communication unit 11, an arithmetic processing unit 13, and a storage unit 15, and is an information processing device capable of communicating with the control device 50 of each vehicle 1 via the wireless communication network 5. The information processing device 10 may be, for example, a cloud server.

<2. Configuration example of vehicle control device>
Next, a configuration example of the control device 50 according to the present embodiment will be specifically described. FIG. 2 is a block diagram showing a configuration example of the control device 50 according to the present embodiment.

The control device 50 includes, for example, an arithmetic processing device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage element such as a RAM (Random Access Memory) or a ROM (Read Only Memory). .. A part or all of the control device 50 may be configured by an updatable device such as firmware, or may be a program module or the like executed by a command from a CPU or the like.

In the present embodiment, the control device 50 includes a communication unit 51, an arithmetic processing unit 53, and a storage unit 55. The communication unit 51 includes an interface for transmitting and receiving signals between the control device 50 and the information processing device 10. In the present embodiment, the communication unit 51 is configured to be able to communicate with the information processing device 10 via the wireless communication network 5.

The arithmetic processing device 53 is composed of at least one CPU or MPU as described above, and executes various arithmetic processing by executing a program stored in the storage unit 55. The storage unit 55 may be used in addition to a storage element such as a RAM or ROM, or instead of a storage element, an HDD (Hard Disk Drive), a CD (Compact Disc), a DVD (Digital Versatile Disc), an SSD (Solid State Drive), or the like. A storage medium such as a USB (Universal Serial Bus) flash or a storage device may be provided.

The control device 50 is a occupant camera 41, an optical sensor 43, an acceleration sensor 45, and a GPS (Global Positioning System) directly or via a communication line such as CAN (Controller Area Network) or LIN (Local Inter-Net). ) It is connected to the antenna 47. The occupant camera 41 is a detector installed in the vehicle interior and used to detect the biological information of the occupant. The occupant camera 41 is a non-contact detector that does not come into direct contact with the occupant's human body, and is installed so that at least the driver's face can be photographed. The occupant camera 41 includes an image pickup element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and the image pickup information acquired by the occupant camera 41 is transmitted to the control device 50. The control device 50 detects the heartbeat of the occupant based on the change in the color information of the face detected based on the image pickup information of the occupant camera 41.

The detector provided in the vehicle 1 is not attached to the occupant of the vehicle 1 such as a driver, but is a sensor device installed in the vehicle 1 to detect the occupant's biological information, and the biological information is detected. It is preferable that the sensor device has a low sensation. The detector operates by receiving electric power from, for example, the power source of the vehicle 1.

The detector provided in the vehicle 1 is not limited to the occupant camera 41 for detecting the heartbeat of the occupant. For example, the occupant camera 41 may be used to detect the body temperature of the occupant. Further, the detector may be a radio wave type Doppler sensor for detecting the heartbeat of the occupant, or may be a non-contact type pulse sensor for detecting the pulse of the occupant. Further, the detector may be a set of electrodes embedded in the steering wheel for measuring the occupant's heartbeat or electrocardiogram. Further, the detector may be a pressure measuring instrument embedded in the driver's seat in order to measure the seating pressure distribution in the seated state in which the occupant is seated in the driver's seat. Further, the detector may be a displacement sensor that detects a change in the position of the seat belt in order to measure the heartbeat or respiration of the occupant. Further, the detector may be a TOF (Time of Flight) sensor for detecting information on the position (living body position) of the occupant. The detector may also be a thermography for measuring the surface temperature of the occupant's skin.

The optical sensor 43 is installed in the vehicle interior and is used to measure an index value related to light and darkness in the vehicle. In particular, the optical sensor 43 is installed so as to be able to measure the brightness around the face of the occupant in the driver's seat. The index value of lightness and darkness may be, for example, either brightness, brightness or illuminance. The type of the optical sensor 43 is not particularly limited, and a known optical sensor can be used as appropriate. The sensor signal of the optical sensor 43 is transmitted to the control device 50. The control device 50 estimates the detection accuracy of the occupant's heartbeat based on the sensor signal of the optical sensor 43.

The acceleration sensor 45 is provided in the vehicle 1 and is used to measure the vibration of the vehicle 1. The acceleration sensor 45 may be an acceleration sensor provided for use in driving control of the vehicle 1. The sensor signal of the acceleration sensor 45 is transmitted to the control device 50. The control device 50 detects the vibration of the vehicle 1 based on the sensor signal of the acceleration sensor 45. When another control device detects the vibration of the vehicle 1 based on the sensor signal of the acceleration sensor, the control device 50 may acquire the vibration information of the vehicle 1 from the other control device.

The GPS antenna 47 receives a satellite signal including the position information of the vehicle 1 transmitted from the GPS satellite. The GPS antenna 47 may be the GPS antenna of the navigation system. Instead of the GPS antenna 47, it may be an antenna device capable of receiving a satellite signal including the position information of the vehicle 1 from another satellite system.

Further, the control device 50 is directly connected to the input unit 31, the display unit 33, and the vehicle drive control device 37 via a communication line such as CAN or LIN. The input unit 31 receives an operation input of a user (for example, an occupant) to the control device 50. The input unit 31 may be, for example, a touch panel type display or a dial type operation device.

The display unit 33 is, for example, a display panel provided on the dashboard or a HUD (Head Up Display) projected on the front window, and presents information so that the occupant can see it. The display unit 33 may be a meter display device in an instrument panel, a display device of a navigation system, or a multifunction display that presents various information. However, the display unit 33 is not limited to the above-mentioned display panel and HUD. Further, the display unit 33 may be integrated with the input unit 31.

The vehicle drive control device 37 is a control unit that executes drive control of the vehicle 1, and is a control unit that controls the drive of an engine (not shown), one or more drive motors, a steering system, a brake system, and the like. It is composed of a control device. The vehicle drive control device 37 basically executes the drive control of the vehicle 1 based on the driving operation of the occupant. Further, the vehicle drive control device 37 executes a control for urgently stopping the vehicle 1 based on a command from the control device 50.

The arithmetic processing unit 53 includes a detection unit 61, an estimation unit 63, a control unit 65, a data collection unit 71, a transmission control unit 73, a destination setting unit 75, an acquisition unit 77, a notification unit 79, and a face information calculation unit 81. There is. The control unit 65 has a functional configuration for executing control based on the detected biological information, and includes an emergency stop control unit 67 and a warning control unit 69. Each of these parts of the arithmetic processing unit 53 is, specifically, a function realized by executing a program by the arithmetic processing unit 53.

(Detection unit)
The detection unit 61 detects the biological information of the occupant of the vehicle 1. In the present embodiment, the detection unit 61 detects the heartbeat of the occupant based on the imaging information transmitted from the occupant camera 41. Specifically, the detection unit 61 executes image processing based on the image pickup information transmitted from the occupant camera 41, and measures the occupant's heartbeat based on the change in the color information of the face.

(Estimation part)
The estimation unit 63 estimates the detection accuracy of the biological information by the occupant camera 41. In the present embodiment, the estimation unit 63 estimates the heartbeat detection accuracy based on the information that can affect the detection accuracy of the occupant's face color information by the occupant camera 41. FIG. 3 is an explanatory diagram showing an example of a method of estimating the heartbeat detection accuracy by the estimation unit 63. In the present embodiment, the estimation unit 63 estimates the accuracy of heartbeat detection by the occupant camera 41 based on the brightness and darkness in the vehicle interior, the amount of shadows generated on the occupant's face by light, and the magnitude of vibration of the vehicle 1. do. In the present embodiment, the estimation unit 63 estimates the level of heartbeat detection accuracy by the occupant camera 41 in three stages of a first level (level 1) to a third level (level 3).

The brightness and darkness in the vehicle interior can be detected based on the sensor signal of the optical sensor 43. For example, the estimation unit 63 determines whether or not the detected light / dark index value is within an appropriate range. Further, the magnitude of vibration of the vehicle 1 can be detected based on the sensor signal of the acceleration sensor 45. For example, the estimation unit 63 specifies the magnitude of the vibration cycle or amplitude of the vehicle 1 in a predetermined direction based on the sensor signal of the acceleration sensor 45, and determines whether the vibration of the vehicle 1 is large or small. Further, the amount of shadows generated on the occupant's face by the light can be detected by performing image processing on the image pickup information of the occupant's face captured by the occupant camera 41. For example, the estimation unit 63 uses light shadows based on the ratio of pixels or pixel groups whose brightness and darkness index values are less than a predetermined value to the pixels or pixel groups of the entire region corresponding to the occupant's face recognized by image processing. It may be determined whether the occurrence of is high or low.

In the example shown in FIG. 3, when the index value of light and darkness in the vehicle interior is out of the appropriate range, the estimation unit 63 sets the level of the heartbeat detection accuracy by the occupant camera 41 to the first level (level 1). .. For example, when the index value of light and darkness in the passenger compartment is too high (when it is too bright), such as when the west sun is dazzling, the occupant's face image taken by the occupant camera 41 becomes too bright and the occupant's face color information is displayed. It may be difficult to detect accurately. On the other hand, when the index value of lightness and darkness in the vehicle interior is too low (when it is too dark), the occupant's face image taken by the occupant camera 41 becomes too dark and the color information of the occupant's face can be detected accurately. It can be difficult. Therefore, when the index value of the light and darkness in the vehicle interior is out of the appropriate range, the estimation unit 63 determines the level of the heartbeat detection accuracy by the occupant camera 41 regardless of the amount of shadow generated by the light and the magnitude of the vibration of the vehicle 1. Is set to the first level (level 1).

When the index value of light and darkness in the vehicle interior is within an appropriate range, the estimation unit 63 uses the occupant camera 41 based on the amount of shadows generated on the occupant's face by light and the magnitude of vibration of the vehicle 1. The heartbeat detection accuracy level is set to one of the first level (level 1) to the third level (level 3). In this case, the estimation unit 63 raises the level of heartbeat detection accuracy by the occupant camera 41 (higher detection accuracy) as the amount of shadow generated on the occupant's face by light decreases, and the smaller the vibration of the vehicle 1, the higher the heartbeat. Increase the level of detection accuracy of. The level of the accuracy of detecting the heartbeat by the occupant camera 41 may not be three stages, may be two stages, or may be four or more stages. The higher the level of the heartbeat detection accuracy level, the higher the accuracy of the heartbeat after the correction process described later. Further, the estimation unit 63 may further estimate the detection accuracy of the heartbeat based on the movement of the occupant's face. For example, when traveling on a curve or an intersection, the occupant may turn his / her face in the direction of travel, and in such a case, the detection accuracy of the occupant's face color information may decrease. Therefore, the estimation unit 63 may determine that the heartbeat detection accuracy is lowered when the direction of the occupant's face imaged by the occupant camera 41 is outside the predetermined range.

(Control unit)
The control unit 65 executes a predetermined control based on the biological information. For example, the emergency stop control unit 67 of the control unit 65 executes control to make the vehicle 1 emergency stop when an abnormality in the body of the occupant is detected based on the detected heartbeat of the occupant. Specifically, the emergency stop control unit 67 transmits an emergency stop command to the vehicle drive control device 37 so as to stop the vehicle 1 safely and promptly. For example, the vehicle 1 is provided with a detection device such as a camera or a radar that detects the surrounding environment of the vehicle 1, and the vehicle drive control device 37 that has received the emergency stop command is an engine, one or more drive motors, and steering. By controlling the system and the braking system, the vehicle 1 is stopped in a roadside zone where space is secured so that the vehicle 1 does not collide with a person, another vehicle 1, or other obstacles.

Further, the warning control unit 69 of the control unit 65 executes control to warn the occupant's physical abnormality when the occupant's physical abnormality is detected based on the detected occupant's heartbeat. Specifically, when the warning control unit 69 detects an abnormality in the body of the occupant, the warning control unit 69 transmits a warning command to the warning device 35 to warn the abnormality of the body. Upon receiving the warning command, the warning device 35 performs a warning operation for an abnormality in the occupant's body by means such as a warning sound, a voice, lighting of a warning lamp, and generation of vibration.

(Data collection department)
The data collection unit 71 collects accuracy reduction information including information of a section in which the detection accuracy of the biological information estimated by the estimation unit 63 has decreased. The data collection unit 71 stores the collected accuracy reduction information in the storage unit 55. In the present embodiment, the accuracy reduction information includes information of a section in which the detection accuracy of the biological information is reduced. The data collection unit 71 identifies the section in which the vehicle 1 is traveling during the period estimated by the estimation unit 63 that the detection accuracy of the biological information is low, based on the satellite signal received by the GPS antenna 47. Appropriate information for specifying the position of the vehicle 1 may be used together with the position information obtained based on the satellite signal received by the GPS antenna 47.

Further, the accuracy reduction information may include information on the traveling environment of the vehicle 1 during the period when the detection accuracy of the biological information is reduced. The information on the traveling environment of the vehicle 1 includes at least one of the time, weather, or seasonal information during the period when the detection accuracy of the biological information is lowered. Since the brightness in the vehicle interior changes depending on the time when the vehicle 1 travels, it is preferable that the information on the traveling environment of the vehicle 1 includes the time information. The time information may be the time information of the clock provided in the vehicle 1 or the control device 50. Further, since the light and darkness in the vehicle interior and the vibration of the vehicle 1 change depending on the weather, it is preferable that the information on the traveling environment of the vehicle 1 includes the information on the weather. The weather information may be, for example, local weather data obtained from an out-of-vehicle telematics service connected via a communication means (not shown). Further, since the irradiation angle of sunlight into the vehicle interior differs depending on the season, it is preferable that the information on the traveling environment of the vehicle 1 includes the seasonal information.

In addition, the information on the traveling environment of the vehicle 1 may include information on the traveling environment that affects the accuracy of detecting the heartbeat by the occupant camera 41. For example, as the information on the traveling environment of the vehicle 1, various information such as the operating status of the wiper, the lighting status of the headlights, and the lighting status of the lighting in the vehicle interior may be included. Information on the operating status of the wiper can be used, for example, to estimate the weather, and can also be used to estimate the effect of changes in facial color that are not caused by the heartbeat. In addition, the information on the lighting status of the headlights can be used to estimate the brightness outside the vehicle. In addition, the information on the lighting status of the lighting inside the vehicle can be used for estimating the brightness outside the vehicle, and can also be used for estimating the effect of the change in face color not caused by the heartbeat.

When the information whose detection accuracy of the biological information has decreased is transmitted in real time from the control device 50 of the vehicle 1 to the information processing device 10 together with the information of the current position of the vehicle 1, the period during which the detection accuracy of the biological information has decreased The time, weather, or season information does not have to be transmitted from the control device 50 to the information processing device 10. In this case, the information processing device 10 identifies the time, season, or weather based on the time when the information whose detection accuracy has deteriorated is received from the control device 50 and the information of the current position of the vehicle 1, and adds it to the accuracy reduction information. can do.

(Transmission control unit)
The transmission control unit 73 transmits the collected accuracy reduction information to the information processing device 10. The transmission control unit 73 may transmit all the collected accuracy reduction information to the information processing device 10, and collects the information when the number of times the detection accuracy is reduced in the same section becomes equal to or more than a preset predetermined number of times. The accuracy reduction information may be transmitted to the information processing device 10. By transmitting the accuracy reduction information to the information processing device 10 after the number of times the detection accuracy has decreased reaches a predetermined number or more, it is possible to prevent the accuracy reduction information at the time of erroneous detection from being accumulated in the information processing device 10. Can be done.

Further, the transmission control unit 73 transmits the information of the current position of the vehicle 1 acquired via the GPS antenna 47 to the information processing device 10 while the vehicle 1 is traveling. When the planned travel route is set by the navigation system or the automatic driving control in the vehicle 1, the transmission control unit 73 may transmit the information of the planned travel route together with the information of the current position. As a result, the information processing device 10 can grasp the current position of each vehicle 1 and estimate the route that each vehicle 1 will travel from now on.

Further, the transmission control unit 73 may transmit the weather information of the current location acquired from the telematics service or the like outside the vehicle together with the information of the current position while the vehicle 1 is traveling. As a result, the information processing device 10 extracts the information whose heartbeat detection accuracy has decreased in similar weather from the accumulated accuracy reduction information, and estimates the section in which the heartbeat detection accuracy in each vehicle 1 decreases. can do. Therefore, regarding the detection accuracy of the heartbeat by the occupant camera 41, which is easily affected by the light and darkness in the vehicle interior, the accuracy of the estimation result of the section where the detection accuracy decreases can be improved.

(Destination setting section)
The destination setting unit 75 sets the destination of the vehicle 1. For example, the destination setting unit 75 sets the destination based on the information of the destination input by the occupant such as the driver via the input unit 31. Alternatively, the destination setting unit 75 may set the destination of the vehicle 1 based on the destination information transmitted from another control device or the like that controls automatic driving. When the vehicle 1 is equipped with a navigation system, the destination setting unit 75 may be a function of the navigation system. In this case, the navigation system generates a planned travel route according to the set destination.

(Acquisition department)
The acquisition unit 77 acquires the other vehicle accuracy information regarding the detection accuracy of the biological information in the other vehicle in the planned travel route of the vehicle 1 to the destination from the information processing device 10. The other vehicle accuracy information acquired by the acquisition unit 77 includes information on the detection accuracy of the biological information in the other vehicle provided with the occupant camera for detecting the heartbeat as in the detector provided in the own vehicle 1. For example, the accuracy information of the other vehicle may be information generated based on the detection accuracy information of the heartbeat information estimated in the vehicle 1 having at least the occupant camera 41, the detection unit 61, and the estimation unit 63 described above. good. Preferably, the information is generated based on the detection accuracy information of the heartbeat information estimated in another vehicle provided with the control device having the same configuration as the control device 50 provided in the own vehicle 1 and the occupant camera 41. You may.

That is, the acquired accuracy information of other vehicles includes information on a section in which the detection accuracy of biometric information has decreased in a vehicle equipped with a biometric information detector having the same function in the past, and is used for notification processing by the notification unit 79. Be done. As a result, it is possible to notify the occupant in advance that the detection accuracy of the biological information may be lowered in the section in which the own vehicle 1 is going to travel. Further, the accuracy information of the other vehicle may include information about a factor that lowers the detection accuracy estimated by the information processing apparatus 10. As a result, the processing by the control device 50 can be different depending on the factor that reduces the detection accuracy.

For example, when the destination is set by the destination setting unit 75 and the planned travel route to the destination is set, the acquisition unit 77 acquires the accuracy information of other vehicles related to the entire section of the planned travel route. You may. Alternatively, the acquisition unit 77 may acquire other vehicle accuracy information related to the assumed travel schedule route sequentially or at appropriate time intervals while the vehicle 1 travels toward the set destination.

The other vehicle that has provided the information processing device 10 with the accuracy reduction information used for generating the accuracy information of the other vehicle may include the own vehicle 1 in the past.

(Notification section)
The notification unit 79 informs the occupants before the vehicle 1 passes through the section where the detection accuracy of the biological information on the planned travel route of the vehicle 1 is estimated to decrease based on the accuracy information of the other vehicle acquired by the acquisition unit 77. Controls to notify that the detection accuracy is reduced. In the present embodiment, the notification unit 79 makes the content of the notification different according to the ratio of the vehicle whose detection accuracy has decreased to the total number of other vehicles that have traveled in the section where the detection accuracy has decreased in the past. Specifically, the other vehicle accuracy information acquired by the acquisition unit 77 from the information processing device 10 includes the above-mentioned ratio information. For example, the notification unit 79 notifies that when the ratio is high, the detection accuracy of biometric information decreases in the relevant section, and when the ratio is low, the detection accuracy of biometric information decreases in the relevant section. You may notify that it is likely.

For example, the notification unit 79 may display information indicating a section in which the detection accuracy is lowered in the map data displayed on the display unit 33. At that time, the display notifying that the detection accuracy is likely to decrease in the corresponding section may be different from the display notifying that the detection accuracy is likely to decrease. Further, the notification unit 79 may perform a warning operation when a section in which the detection accuracy is lowered approaches. The warning operation may be at least one of, for example, a warning display, a warning sound, lighting of a warning lamp, or generation of vibration of the seat. In addition, the notification unit 79 may also notify the reason for the warning when performing the warning operation. The notification of the reason for the warning may be a display on the display unit 33 or a voice notification.

Further, the notification unit 79 performs a predetermined notification process before traveling in a section where the detection accuracy is lowered based on the other vehicle accuracy information transmitted from the information processing device 10, and the own vehicle 1 is in the same section. In, it may be notified that the detection accuracy may decrease based on the number of times the detection accuracy of the biological information has decreased. Thereby, based on the past performance of the own vehicle 1, it is possible to notify the occupant before traveling in the section where the detection accuracy of the biological information is lowered.

(Face information calculation department)
Further, the control device 50 according to the present embodiment includes a face information calculation unit 81. The face information calculation unit 81 calculates predetermined face information regarding the face of the occupant. The facial information includes at least one of the skin color of the occupant's face, the way the skin color changes due to the change in light and darkness in the passenger compartment, or the size of the cheek area. The accuracy of heartbeat detection by the occupant camera 41 is affected by the facial features of the person. For example, when the face information calculation unit 81 calculates the face information of the occupant based on the information captured by the occupant camera 41 at the start of the operation of the vehicle 1, and subsequently transmits the predetermined information to the information processing device 10. The current occupant's face information may be transmitted. As a result, the information processing device 10 extracts from the accumulated accuracy reduction information that the heartbeat detection accuracy is reduced when an occupant with similar facial features is driving, and in each vehicle 1. It is possible to estimate the section in which the heartbeat detection accuracy decreases.

<3. Information processing device configuration example>
Next, a configuration example of the information processing device 10 according to the present embodiment will be specifically described. FIG. 4 is a block diagram showing a configuration example of the information processing device 10 according to the present embodiment.

The information processing device 10 stores the accuracy reduction information transmitted from the control device 50 of each vehicle 1 as data in a section where the detection accuracy of the biological information is reduced. The information processing device 10 includes a communication unit 11, an arithmetic processing unit 13, and a storage unit 15. The communication unit 11 includes an interface for communicating with the wireless communication network 5. The information processing device 10 is configured to be able to communicate with the control devices 50 of a plurality of vehicles 1 via the communication unit 11.

The storage unit 15 includes storage media such as an HDD (Hard Disk Drive), a CD (Compact Disc), a DVD (Digital Versatile Disc), an SSD (Solid State Drive), a USB (Universal Serial Bus) flash, and a storage device. The storage unit 15 stores accuracy reduction information transmitted from the control devices 50 of the plurality of vehicles 1.

The arithmetic processing device 13 is configured to include a processor such as a CPU. A part or all of the arithmetic processing device 13 may be configured by an updatable device such as firmware, or may be a program module or the like executed by a command from a CPU or the like. The arithmetic processing unit 13 includes a data processing unit 21 and an output control unit 23. Each of these parts may be a function realized by executing a program by a processor.

(Data processing unit)
Of these, the data processing unit 21 receives the accuracy reduction information transmitted from the control device 50 of each vehicle 1 and stores it in the storage unit 15. In the present embodiment, the data processing unit 21 classifies and stores the information of the section in which the detection accuracy of the biological information has deteriorated according to the time, weather, or seasonal information included in the information of the traveling environment of the vehicle. The time may be, for example, every 30 minutes, every 1 hour or 2 hours, or may be classified by an appropriate time interval. Further, the weather is classified into, for example, sunny, cloudy, rainy, snowy and the like. In addition, the seasons may be classified according to the four seasons, or may be classified by month.

In the present embodiment, when the data processing unit 21 receives the face information of the occupant together with the accuracy reduction information from the control device 50 of each vehicle 1, the information of the section where the detection accuracy of the bioaccuracy is lowered is obtained by the face information. Classify and accumulate.

(Output control unit)
Further, the output control unit 23 identifies the vehicle 1 scheduled to travel in the section where the detection accuracy of the biometric information has deteriorated based on the position information transmitted from each vehicle 1, and detects the biometric information for the vehicle 1. Send other vehicle accuracy information regarding accuracy. The control device 50 that has received the other vehicle accuracy information performs control based on the other vehicle accuracy information to notify that the detection accuracy is lowered before the vehicle 1 passes through the section where the detection accuracy is lowered.

In the present embodiment, the output control unit 23 sets the current time, season, and the current location of each vehicle 1 among the accuracy reduction information stored in the storage unit 15 based on the driving environment information transmitted from each vehicle 1. The accuracy reduction information classified by the weather is extracted, and the detection accuracy of the biometric information on the route on which each vehicle 1 is scheduled to travel is statistically calculated. The output control unit 23 transmits the other vehicle accuracy information regarding the calculated detection accuracy of the biological information to the control device 50 of the corresponding vehicle 1. The other vehicle accuracy information includes information on the ratio of vehicles with reduced detection accuracy to the total number of vehicles traveling in a section with reduced detection accuracy. That is, the content of the accuracy information of other vehicles differs depending on the proportion of vehicles whose detection accuracy has deteriorated.

The current time, season, and the weather at the current location of each vehicle 1 may be specified by the information processing device 10 based on the information of the current position of each vehicle 1 instead of being transmitted from each vehicle 1. For example, the information processing device 10 may acquire weather information corresponding to the current position of the vehicle 1 from a telematics service connected via a communication means (not shown). When the information processing device 10 has functions of a clock and a calendar, information on the time and season may be acquired by using the functions of the clock and the calendar.

Further, in the present embodiment, when the face information of the occupant is transmitted from each vehicle 1, the output control unit 23 is similar to the face information of the occupant of each vehicle 1 among the accuracy reduction information stored in the storage unit 15. The accuracy reduction information classified into the face information may be extracted, and the detection accuracy of the biological information on the route on which each vehicle 1 is scheduled to travel may be statistically calculated. As a result, it is possible to improve the accuracy of calculating the section in which the detection accuracy of the heartbeat in the planned travel route of each vehicle 1 decreases according to the facial features of the occupants of each vehicle 1.

<4. Overall operation example of vehicle control system>
Next, an example of the overall operation of the vehicle control system 100 according to the present embodiment will be described.

FIG. 5 shows three accuracy-reduced information transmitted to the information processing device 10 including information on which the detection accuracy of biological information has decreased from a plurality of other vehicles in the past on the planned travel route from the current location to the destination of the vehicle 1. The sections A, B, and C are shown. For example, it is possible to classify a range in which a decrease in the detection accuracy of biological information occurs within a predetermined range (within Xm) a predetermined number of times or more (N0 or more) as one section. In FIG. 5, the position indicated by the X mark indicates the position where the decrease in the detection accuracy of the biological information occurs more than a predetermined number of times, and the range in which each X mark is within X m is divided as one section. Alternatively, the range subdivided in advance on the map data may be divided into one section.

FIG. 6 is an explanatory diagram showing an example of a countermeasure executed by the control device 50 of the vehicle 1 according to the accuracy information of another vehicle calculated based on the accuracy reduction information stored in the information processing device 10. For example, the control device 50 of the vehicle 1 and the information processing device 10 communicate in real time, and based on the accuracy reduction information classified into the conditions matching the information of the current position of the vehicle 1, the planned travel route, and the travel environment. The section where the detection accuracy of the biological information decreases is determined. At this time, the accuracy reduction information accumulated within a predetermined period in the past set in advance may be used, or the accuracy reduction information accumulated within several hours may be used.

In the example shown in FIG. 6, the contents of the determination and the countermeasure for the decrease in the detection accuracy of the biological information are set as follows.
(A) Deterioration rate of past detection function (P1) ≧ 70%
→ Judgment of decrease in detection accuracy = High → Details of countermeasures = Notification on map data, forced stop of detection function 100 m before (B) 70%> Deterioration rate of past detection function (P1) ≧ 30%
→ Judgment of decrease in detection accuracy = Medium → Details of countermeasures = Notification on map data, warning display / warning sound (C) 30%> Deterioration rate of past detection function (P1)
→ Judgment of decrease in detection accuracy = Low → Details of countermeasures = Do nothing

Specifically, in section A, the rate at which the detection accuracy of biological information is reduced (detection accuracy reduction rate) P1 is 70% or more regardless of daytime or nighttime, and regardless of the weather, and the detection accuracy is reduced. The judgment is high. In section A, the detection accuracy is reduced regardless of daytime and nighttime, and regardless of the weather, so it is estimated that the detection accuracy is reduced due to vibration due to the road shape. Therefore, the notification unit 79 of the control device 50 notifies the occupants in advance by a method of reflecting the information indicating that the detection accuracy is lowered due to the road shape in the section A in the map data. Further, regardless of whether the current time is daytime or nighttime, or regardless of the current weather, the control unit 65 of the control device 50 warns of control and physical abnormality to stop the vehicle 1 in an emergency based on biometric information. Pause control. In order to prevent the detection information with low accuracy from being recorded, the detection unit 61 may suspend the detection function of the biological information.

Further, in the section B, the detection accuracy reduction rate P1 is 90% or more when the weather is fine, regardless of daytime or nighttime, and the detection accuracy reduction determination is high. On the other hand, in the section B, the detection accuracy reduction rate P1 is 2% or less when the weather is rainy or cloudy regardless of daytime or nighttime, and the detection accuracy reduction determination is low. In section B, it is estimated that the detection accuracy decreases when the weather is fine, regardless of daytime or nighttime. Therefore, the notification unit 79 notifies the occupant in advance by a method of reflecting the information indicating that the detection accuracy is lowered in the section B in the case of fine weather in the map data. Further, regardless of whether the current time is daytime or nighttime, when the current weather is fine, the control unit 65 suspends the control for urgently stopping the vehicle 1 based on the biological information and the control for warning of a physical abnormality. .. When the current weather is fine, the detection unit 61 may suspend the detection function of the biological information in order to prevent the detection information having low accuracy from being recorded. On the other hand, when the current weather is rainy or cloudy, the control unit 65 continues to execute the predetermined control based on the biological information regardless of whether the current time is daytime or nighttime.

Further, in the section C, the detection accuracy reduction rate P1 is 40 to 60% regardless of the daytime and nighttime and the weather, and the detection accuracy reduction determination is medium. Therefore, in the section C, the notification unit 79 displays a warning display or sounds in the section C without performing processing to reflect the current time in the map data regardless of whether the current time is daytime or nighttime or the current weather. Only operate. Further, regardless of whether the current time is daytime or nighttime, or regardless of the current weather, the control unit 65 continues to execute predetermined control based on biometric information.

In the vehicle control system 100 according to the present embodiment, the information processing device 10 calculates the detection accuracy reduction rate P1 and the detection accuracy reduction determination result in the past other vehicles in each section (A / B / C). Then, the accuracy information of the other vehicle including the information of the detection accuracy reduction determination result is transmitted to the control device 50 of the vehicle 1 scheduled to travel in each section (A / B / C). Further, the control device 50 of the vehicle 1 that has received the other vehicle accuracy information including the detection accuracy deterioration determination result information is configured to select and execute the content of the countermeasure based on the detection accuracy reduction determination result. .. That is, the content of "countermeasure" in the table shown in FIG. 6 is set in the control device 50 of the vehicle 1. The content of the "countermeasure" may differ for each vehicle 1.

However, the information processing device 10 sets up to the content of the "countermeasure" according to the detection accuracy deterioration determination result, and transmits the other vehicle accuracy information including the information of the content of the "countermeasure" to the control device 50 of the vehicle 1. You may. In this case, the control device 50 of the vehicle 1 stops the notification or detection function before the vehicle 1 travels in each section (A / B / C) according to the content of the "countermeasure" included in the accuracy information of the other vehicle. ..

Alternatively, the information processing device 10 may perform up to the calculation of the "detection accuracy reduction rate P1" and transmit the other vehicle accuracy information including the information of the "detection accuracy reduction rate P1" to the control device 50 of the vehicle 1. .. In this case, the control device 50 of the vehicle 1 requests the contents of the "detection accuracy reduction determination result" and the "countermeasure" based on the information of the detection accuracy reduction rate P1 included in the accuracy information of the other vehicle, and the content of the "countermeasure". According to this, the notification or detection function is stopped before the vehicle 1 travels in each section (A / B / C). In addition, a part of the functions of the control device 50 of the vehicle 1 described above may be executed by the information processing device 10, and a part of the functions of the information processing device 10 may be executed by the control device 50 of the vehicle 1. ..

<5. Flowchart of operation example of vehicle control system>
Next, an example of the operation of the control device 50 and the information processing device 10 constituting the vehicle control system 100 according to the present embodiment will be specifically described.

(Data collection and transmission processing by vehicle control device)
FIG. 7 is a flowchart showing an example of the accuracy reduction information collection / transmission process executed by the control device 50 of the vehicle 1.
First, the estimation unit 63 of the control device 50 calculates the information used for estimating the detection accuracy of the biological information by the detector (step S11). As described above, in the present embodiment, the estimation unit 63 obtains the image pickup information of the occupant camera 41 based on the brightness and darkness in the vehicle interior, the amount of shadows generated on the occupant's face by the light, and the magnitude of the vibration of the vehicle. Estimate the detection accuracy of the heartbeat based on. Specifically, the estimation unit 63 calculates an index value of light and darkness in the vehicle interior, particularly an index value of light and darkness near the face of the occupant, based on the sensor signal of the optical sensor 43. In addition, the estimation unit 63 calculates the amount of shadows generated on the occupant's face by light by performing image processing on the imaged information of the occupant's face captured by the occupant camera 41. Further, the estimation unit 63 calculates the magnitude of vibration of the vehicle based on the sensor signal of the acceleration sensor 45.

Next, the estimation unit 63 estimates the detection accuracy of the biological information by the detector (step S12). In the present embodiment, the estimation unit 63 sets the level of the heartbeat detection accuracy by the occupant camera 41 according to a preset detection accuracy estimation method (see FIG. 3) from the first level (level 1) to the first level. Estimate is divided into 3 levels (level 3). Next, the control unit 65 determines whether or not the estimated heartbeat detection accuracy is low (step S13). For example, the control unit 65 determines that the detection accuracy is low when the heartbeat detection accuracy level is the first level (level 1) and 2, and the detection accuracy when the level is the third level (level 3). Is determined to be high.

When the heartbeat detection accuracy by the occupant camera 41 is high (S13 / No), the data collection unit 71 ends this routine without collecting the accuracy reduction information and returns to step S11. On the other hand, when the accuracy of detecting the heartbeat by the occupant camera 41 is low (S13 / Yes), the data collection unit 71 collects the accuracy reduction information (step S14). Specifically, the data collecting unit 71 collects information on the position where the heartbeat detection accuracy has deteriorated and information on the traveling environment of the vehicle at that time.

Next, the data collecting unit 71 determines whether or not the number of times N determined to have decreased the heartbeat detection accuracy has reached a predetermined number or more (N0 or more) at the position where the heartbeat detection accuracy has decreased (step). S15). When the number of times N determined that the heartbeat detection accuracy has deteriorated has not reached the predetermined number of times (S15 / No), the data collecting unit 71 ends this routine and returns to step S11. On the other hand, when the number of times N determined that the heartbeat detection accuracy has deteriorated is equal to or greater than a predetermined number of times (S15 / Yes), the transmission control unit 73 of the control device 50 transmits the collected accuracy reduction information to the information processing device 10. (Step S16). At this time, the transmission control unit 73 may also transmit the face information of the occupant, whose heartbeat is detected by the occupant camera 41, to the information processing device 10.

The control device 50 of each vehicle 1 repeatedly executes the above-mentioned data collection and transmission process, so that the number N of times the heartbeat detection accuracy has decreased becomes the predetermined number of times N0 or more, and the information of the traveling section and the traveling environment at that time. It is possible to transmit the accuracy reduction information including the information of the above to the information processing device 10 and store the accuracy reduction information in the information processing device 10.

When the number of times N of which the heartbeat detection accuracy has decreased in the same section becomes a predetermined number of times N0 or more, the notification unit 79 corresponds to the notification process based on the other vehicle accuracy information transmitted from the information processing device 10. The occupants such as occupants may be notified in advance that the detection accuracy of the heartbeat may decrease in the section. As a result, the occupant can know that the heartbeat detection accuracy may decrease before traveling in the section where the biometric information detection accuracy decreases, based on the past performance of the own vehicle 1.

(Data storage and output processing by information processing equipment)
FIG. 8 is a flowchart showing an example of data storage output processing executed by the information processing apparatus 10.
The data processing unit 21 of the information processing device 10 receives the accuracy reduction information from the control device 50 of the vehicle 1 (step S31). Next, the data processing unit 21 classifies the section in which the heartbeat detection accuracy has decreased based on the accuracy reduction information according to the information on the traveling environment and stores it in the storage unit 15 (step S33). As described above, the data processing unit 21 classifies and stores the section in which the heartbeat detection accuracy has decreased by at least one of time, season, and weather. In addition, the data processing unit 21 may classify and store the section in which the heartbeat detection accuracy is lowered according to the operation status of the wiper, the lighting status of the headlight, the lighting status of the lighting in the vehicle interior, and the like.

Next, the output control unit 23 calculates the detection accuracy reduction rate P1 including the other vehicle in the section where the heartbeat detection accuracy has decreased, based on the stored accuracy reduction information (step S35). For example, the output control unit 23 obtains the ratio of the number of vehicles 1 whose detection accuracy has decreased to the total number of vehicles 1 which have traveled in the section where the heartbeat detection accuracy has decreased in the preset predetermined period in the past.

Next, the output control unit 23 determines whether or not the calculated detection accuracy reduction rate P1 is equal to or higher than the preset first threshold value α (step S37). The first threshold value α is a threshold value for determining whether or not the heartbeat detection accuracy is likely to decrease in the relevant section, and is set to 70% in the above-mentioned example of FIG. When the detection accuracy reduction rate P1 is equal to or higher than the first threshold value α (S37 / Yes), the output control unit 23 provides other vehicle accuracy information including information indicating that the detection accuracy is likely to decrease in the corresponding section. , The section is transmitted to the vehicle 1 scheduled to be traveled (step S39).

On the other hand, when the detection accuracy reduction rate P1 is less than the first threshold value α (S37 / No), the output control unit 23 has the detection accuracy reduction rate P1 less than the first threshold value α and greater than or equal to the second threshold value β. It is determined whether or not there is (step S41). The second threshold value β is a threshold value for determining whether or not the heartbeat detection accuracy is unlikely to decrease in the corresponding section, and is set to 30% in the above-mentioned example of FIG. When the detection accuracy reduction rate P1 is less than the first threshold value α and equal to or higher than the second threshold value β (S41 / Yes), the output control unit 23 has a moderate possibility that the detection accuracy will decrease in the corresponding section. The accuracy information of the other vehicle including the information indicating the existence is transmitted to the vehicle 1 scheduled to travel in the section (step S43).

On the other hand, when the detection accuracy reduction rate P1 is less than the second threshold value β (S41 / No), the output control unit 23 includes information indicating that the detection accuracy is unlikely to decrease in the corresponding section. Is transmitted to the vehicle 1 scheduled to travel in the section.

The information processing device 10 repeatedly executes the above-mentioned data storage / output processing with respect to the vehicle 1 scheduled to travel in the section where the heartbeat detection accuracy is estimated to decrease, before the vehicle 1 passes through the section. , Transmits other vehicle accuracy information, including information that may reduce detection accuracy. As a result, the control device 50 of the vehicle 1 can take a predetermined measure before passing through the section.

In the example of the flowchart shown in FIG. 8, the information processing device 10 constantly transmits the accuracy information of the other vehicle to the control devices 50 of all the vehicles 1, but the control device 50 of the vehicle 1 and others together with the information of the current position. When a request for providing vehicle accuracy information is received, other vehicle accuracy information may be transmitted.

(Notification processing by vehicle control device)
FIG. 9 is a flowchart showing an example of notification processing executed by the control device 50 of the vehicle 1. The flowchart shown in FIG. 9 is a flowchart showing a notification process applicable to the vehicle 1 equipped with the navigation system or the automatic driving control. In the example shown in FIG. 9, when the planned travel route to the destination is set, the control device 50 acquires other vehicle accuracy information related to the entire section of the planned travel route and executes a predetermined notification process. ..

First, the destination setting unit 75 of the control device 50 sets the destination of the vehicle 1 based on the input of an occupant such as a driver or a command from the control device that controls automatic driving control (step S21). Next, the destination setting unit 75 sets a planned travel route from the current location to the set destination (step S23). The destination setting unit 75 may present a plurality of planned travel routes to an occupant such as a driver, and set a route selected by the occupant as a planned travel route.

Next, the acquisition unit 77 acquires other vehicle accuracy information from the information processing device 10 (step S25). Specifically, the transmission control unit 73 transmits the information of the set destination and the planned travel route and the information of the current position of the vehicle 1 to the information processing device 10, and the acquisition unit 77 is transmitted from the information processing device 10 to the information processing device 10. Acquires other vehicle accuracy information related to all sections of the planned travel route to be transmitted. In addition to this, the vehicle accuracy information includes information on a section in which the heartbeat detection accuracy decreases in all sections of the planned travel route.

Next, the notification unit 79 determines whether or not there is a section on the planned travel route in which the accuracy of detecting the heartbeat decreases, based on the acquired accuracy information of the other vehicle (step S27). When there is no section in which the heartbeat detection accuracy is lowered (S27 / No), the notification unit 79 ends this routine and returns to step S21. On the other hand, when there is a section in which the heartbeat detection accuracy is lowered (S27 / Yes), the notification unit 79 executes a predetermined notification process based on the accuracy information of the other vehicle (step S29).

Specifically, as described with reference to FIGS. 5 and 6, the notification unit 79 is displayed on the display unit 33 for sections where the detection accuracy reduction rate P1 included in the accuracy information of other vehicles is high and medium. Notify the occupants of the section where the detection accuracy is reduced by reflecting it in the map data. Further, the notification unit 79 forcibly stops the heartbeat detection function by the detection unit 61 100 m before the corresponding section in the section where the detection accuracy reduction rate P1 is high. Further, the notification unit 79 notifies the occupant that the heartbeat detection function is deteriorated in the section in which the detection accuracy reduction rate P1 is medium by an appropriate warning operation such as a warning display or a warning sound.

In the section where the detection accuracy reduction rate P1 is high, the time for forcibly stopping the heartbeat detection function does not have to be 100 m before the section, and may be set as appropriate. Further, the content of the countermeasure based on the detection accuracy reduction rate P1 may be appropriately set.

As described above, according to the example of the flowchart shown in FIG. 9, when the planned travel route to the set destination is preset, the control device 50 detects the heartbeat on the planned travel route with the accuracy of detecting the heartbeat. Information indicating that there is a section in which the value decreases can be acquired in advance, and a predetermined notification process can be performed in advance for the occupant. As a result, the occupant is not forced to take a sudden response due to the sudden decrease in the detection accuracy of the heartbeat, and the occupant can be given a sense of security.

FIG. 10 is a flowchart showing another example of the notification process executed by the control device 50 of the vehicle 1. In the example shown in FIG. 10, while the vehicle 1 travels toward the destination, the control device 50 acquires other vehicle accuracy information related to the assumed travel schedule route and executes a predetermined notification process.

First, the destination setting unit 75 sets the destination in the same manner as in step S21 in the flowchart of FIG. 9 (step S21). Next, the notification unit 79 determines whether or not the accuracy information of the other vehicle is received from the information processing device 10 (step S26). Specifically, the transmission control unit 73 transmits the set destination information and the information on the current position of the vehicle 1 to the information processing device 10 at an appropriate timing, and the information processing device 10 sends the information on the current position of the vehicle 1 to the information processing device 10. When there is a section where the heartbeat detection function is reduced on the planned travel route assumed to go from the position to the destination, the control device controls the accuracy information of other vehicles including the information of the detection accuracy reduction rate P1 in the section. Send to 50. The notification unit 79 may confirm whether or not the received other vehicle accuracy information exists at predetermined intervals, and detects that the other vehicle accuracy information has been received each time the other vehicle accuracy information is received. May be good.

If the other vehicle accuracy information has not been received (S26 / No), the notification unit 79 ends this routine and returns to step S21. On the other hand, when the other vehicle accuracy information is received (S26 / Yes), the notification unit 79 executes a predetermined notification process based on the other vehicle accuracy information as in step S29 in the flowchart of FIG. 9 (step). S29).

As described above, according to the example of the flowchart shown in FIG. 10, the control device 50 has information indicating that there is a section in which the heartbeat detection accuracy is lowered on the assumed travel schedule route to the set destination. Can be obtained and a predetermined notification process can be performed in advance for the occupants. As a result, the occupant is not forced to take a sudden response due to the sudden decrease in the detection accuracy of the heartbeat, and the occupant can be given a sense of security.

<< Second Embodiment >>
Next, the vehicle control system according to the second embodiment of the present invention will be described. In the vehicle control system according to the present embodiment, when the heartbeat is detected by using the first detector provided in the vehicle such as the occupant camera and the predetermined control is performed, the detection accuracy of the heartbeat by the first detector is high. Prior to passing through the declining section, a predetermined notification process is performed in advance as in the first embodiment, and in the section, a heartbeat is detected by a second detector mounted on the occupant and predetermined. It is configured to perform control of. Hereinafter, the vehicle control system according to the present embodiment will be described mainly different from the vehicle control system according to the first embodiment.

FIG. 11 is a block diagram showing a configuration example of the vehicle control device 50A applied to the vehicle control system according to the present embodiment. Also in this embodiment, an example in which a heartbeat is detected as biological information of an occupant and a predetermined control is executed based on the detected heartbeat will be described.

The control device 50A is connected to the occupant camera 41 as the first detector provided in the vehicle and the wearable device 20 as the second detector mounted on the occupant. The occupant camera 41 as the first detector may be configured in the same manner as the occupant camera described in the first embodiment.

Also in this embodiment, the first detector provided in the vehicle 1 is not limited to the occupant camera 41, but is a radio wave type Doppler sensor, a non-contact type pulse sensor, an electrode embedded in the steering wheel, and the like. A pressure measuring instrument embedded in the driver's seat, a device that detects changes in the position of the seat belt, a TOF (Time of Flight) sensor for detecting information on the position of the occupant (living body position), or the surface of the occupant's skin. It may be a thermography for measuring the temperature.

The wearable device 20 as a second detector mounted on the occupant is connected to the control device 50A via a wired or wireless communication means. For example, the wearable device 20 is communicably connected to the control device 50A via a communication unit 52 having an interface function for transmitting and receiving signals. For example, the communication unit 52 can communicate with the wearable device 20 via wireless communication means such as Bluetooth (registered trademark), NFC (Near Field Communication), wifi (wireless fidelity), and wireless LAN (Local Area Network). It is configured.

The wearable device 20 is an aspect of a second detector that is attached to the occupant and used to detect the occupant's biological information. For example, the wearable device 20 has a function of being worn on the occupant's wrist, arm, or the like to measure the occupant's heartbeat. The biometric information detected by the wearable device 20 includes at least the same biometric information as the biometric information detected by the occupant camera 41. The biometric information detected by the wearable device 20 is configured to be transmitted to the control device 50A. Further, among the functions of the wearable device 20, at least the function of detecting the heartbeat is configured so that the start or stop can be switched by remote control from the control device 50A.

The non-contact type first detector is not a device attached to a vehicle occupant such as a driver, but a sensor device installed in the vehicle to detect the occupant's biological information, and detects the biological information. It is preferable that the sensor device has a low sensation of being used. The first detector operates by receiving electric power from the power source of the vehicle. The second contact-type detector is a sensor device that is attached to a vehicle occupant such as a driver to detect the occupant's biological information, and is a wristwatch-type device or a head- or arm-mounted device. Is exemplified. The second detector is operated by the charging power of the built-in battery.

Here, the control unit 65 of the control device 50 according to the present embodiment provides heartbeat information (hereinafter, first) detected by the occupant camera 41 when it is estimated that the heartbeat detection accuracy by the occupant camera 41 is high. The biometric information detected by the detector is also referred to as "first biometric information") to perform control to warn of an abnormality in the body and control to stop the vehicle in an emergency. Further, when the accuracy of heartbeat detection by the occupant camera 41 is estimated to be low, the control unit 65 uses the heartbeat information detected by the wearable device 20 (hereinafter, the biological information detected by the second detector as "biological information". (Also referred to as "second biological information") is used to perform control to warn of physical abnormalities and control to stop the vehicle in an emergency.

When the heartbeat detection accuracy by the occupant camera 41 is high or low, it can be set in advance according to the level of the heartbeat detection accuracy estimated by the estimation unit 63. For example, when the heartbeat detection accuracy level of the occupant camera 41 is the third level (level 3), it is determined that the heartbeat detection accuracy is high, while the heartbeat detection accuracy level of the occupant camera 41 is the second level. When it is the level (level 2) or the first level (level 1), it may be determined that the heartbeat detection accuracy is low.

When the accuracy of heartbeat detection by the occupant camera 41 is high, the control unit 65 executes predetermined control using the first biological information detected by the occupant camera 41, so that at least the heartbeat is detected by the wearable device 20. Send a command to stop the function. Further, when the heartbeat detection function of the wearable device 20 is stopped and the heartbeat detection accuracy by the occupant camera 41 becomes low, the control unit 65 determines the determination using the second biometric information detected by the wearable device 20. In order to execute the control of, at least a command to activate the heart rate detection function is transmitted to the wearable device 20. As a result, predetermined control can be executed using the heartbeat information with high detection accuracy, and the power consumption by at least the heartbeat detection function of the wearable device 20 during the period when the heartbeat detection accuracy by the occupant camera 41 is high. Is suppressed.

Further, the control unit 65 transmits the first biological information detected by the occupant camera 41 to the wearable device 20 during the period when the heartbeat detection function of the wearable device 20 is stopped. As a result, the heartbeat detection data stored in the wearable device 20 is complemented, and the biological information detection function of the wearable device 20 alone is guaranteed. When the wearable device 20 is switched from the stopped state to the activated state, the control unit 65 transmits all the first biometric information detected and stored in the wearable device 20 during the stopped state to the wearable device 20. Alternatively, the first biometric information detected and stored at predetermined time intervals during the period when the wearable device 20 is stopped may be transmitted to the wearable device 20. Further, the control unit 65 may transmit the first biometric information to the wearable device 20 each time the first biometric information is detected during the period in which the wearable device 20 is stopped, but the power of the wearable device 20 From the viewpoint of suppressing consumption, it is preferable to collectively transmit the first biometric information detected and stored during a predetermined period to the wearable device 20.

FIG. 12 is a flowchart schematically showing an operation example of control by the control device 50A according to the present embodiment, and is executed following step S29 in the flowchart of FIG. 9 or FIG.

In step S29, after the notification unit 79 executes a predetermined notification process according to the detection accuracy reduction rate P1, the control unit 65 is in the activated state of the heartbeat detection function of the wearable device 20 which is the second detector. Whether or not it is determined (step S51). For example, when the wearable device 20 is configured to transmit a signal indicating that the start or stop is switched to the control device 50A when the start or stop of the heartbeat detection function is switched, the control unit 65 Can determine whether or not the heartbeat detection function of the wearable device 20 is in the activated state based on the information stored in the storage unit 55. Further, when the control unit 65 transmits a command to the wearable device 20 to switch the heartbeat detection function by starting or stopping, the control unit 65 stores the transmitted record in the storage unit 55. Based on the information stored in the storage unit 55, it is possible to determine whether or not the heartbeat detection function of the wearable device 20 is in the activated state. Further, the control unit 65 may inquire of the wearable device 20 each time whether the heartbeat detection function is activated.

When the heartbeat detection function of the wearable device 20 is in the stopped state (S51 / No), the control unit 65 transmits a command to the wearable device 20 to at least activate the heartbeat detection function (step S53). , Step S55. On the other hand, when the heartbeat detection function of the wearable device 20 is in the activated state (S51 / Yes), the process proceeds to step S55 as it is.

In step S55, the control unit 65 is set to execute the control for warning the abnormality of the body and the control for urgently stopping the vehicle by using the heartbeat information detected by the wearable device 20 (step S55). As a result, the emergency stop control unit 67 and the warning control unit 69 receive highly reliable heartbeat information detected by the wearable device 20 instead of the heartbeat information detected by the occupant camera 41 whose detection accuracy may decrease. It can be used to perform a given control.

Next, the control unit 65 determines whether or not the vehicle 1 has passed a section in which the accuracy of detecting the heartbeat by the occupant camera 41 is reduced (step S57). When the vehicle 1 does not pass through the section (S57 / No), the control unit 65 continues a predetermined control using the heartbeat information detected by the wearable device 20. On the other hand, when the vehicle 1 passes through the section (S57 / Yes), the control unit 65 is set to execute a predetermined control using the heartbeat information detected by the occupant camera 41 (step S59), and the step. Return to S21.

As described above, according to the vehicle control system according to the second embodiment, when the detection accuracy of the heartbeat information detected by the occupant camera 41 provided in the vehicle 1 is high, the heartbeat information Predetermined control is executed based on. On the other hand, when the detection accuracy of the heartbeat information detected by the occupant camera 41 is low, a predetermined control is executed based on the heartbeat information detected by the wearable device 20 as the second contact-type detector. NS. Therefore, the predetermined control can be continued by using the heartbeat information with high detection accuracy.

Further, in the vehicle control system according to the present embodiment, when the detection accuracy of the heartbeat information detected by the occupant camera 41 installed in the vehicle and receiving the power supply from the vehicle power supply is high, the heartbeat of the wearable device 20 is detected. The function may be stopped. As a result, it is possible to suppress the power consumption of the wearable device 20 that is operated by the charging power of the built-in battery.

Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person having ordinary knowledge in the field of technology to which the present invention belongs can come up with various modifications or modifications within the scope of the technical idea described in the claims. , These are also naturally understood to belong to the technical scope of the present invention.

As described above, the biometric information detector provided in the vehicle is not limited to the occupant camera that measures the heartbeat. For example, when the occupant camera measures the line of sight of an occupant such as a driver, the face information calculated by the above-mentioned face information calculation unit 81 is among the size of the occupant's eyes, the size of the eyelids, or the length of the eyelashes. It may contain at least one piece of information.

Further, in the above embodiment, as the notification process by the notification unit 79, a process of reflecting on the map data and a warning operation such as a warning display or a warning sound are illustrated, but the notification process is not limited to such an example. , The occupants may be notified by other appropriate methods.

Further, the method for calculating the detection accuracy reduction rate P1 of the biological information and the method for determining the detection accuracy reduction based on the detection accuracy reduction rate P1 described in the above embodiment are not limited to the above examples, and are not limited to the above examples. The detection accuracy of biometric information in other vehicles in the past may be statistically calculated by an appropriate method.

Further, in the above embodiment, when it is determined that there is an abnormality in the body of the occupant, the control for stopping the vehicle safely and promptly is performed, but the control for urgently stopping the vehicle is used. Alternatively, it may be configured to provide automated driving control that guides the vehicle to an appropriate nearby hospital.

10 ... Information processing device, 11 ... Communication unit, 13 ... Arithmetic processing device, 15 ... Storage unit, 21 ... Data processing unit, 23 ... Output control unit, 41 ... Crew camera, 43 ... Optical sensor, 45 ... Acceleration sensor, 47 ... GPS antenna, 50 ... vehicle control device, 51 ... communication unit, 53 ... arithmetic processing device, 55 ... storage unit, 61 ... detection unit, 63 ... estimation unit, 65 ... control unit, 67 ... emergency stop control unit, 69 ... Warning control unit, 71 ... Data collection unit, 73 ... Transmission control unit, 75 ... Destination setting unit, 77 ... Acquisition unit, 79 ... Display control unit, 81 ... Face information calculation unit, 100 ... Vehicle control system

Claims (17)

A detector that detects the biological information of the occupants of the vehicle,
A destination setting unit that sets the destination of the vehicle, and
An acquisition unit that acquires other vehicle accuracy information regarding the detection accuracy of the biological information in another vehicle on the planned travel route of the vehicle to the destination, and an acquisition unit.
A notification unit that notifies that the detection accuracy of the planned travel route is reduced before the vehicle passes through a section estimated to be reduced based on the accuracy information of the other vehicle.
A vehicle control device. The vehicle control device is
An estimation unit that estimates the detection accuracy of the biological information by the detection unit, and an estimation unit.
A data collection unit that collects accuracy reduction information including information on sections where the detection accuracy of biometric information has decreased, and
The vehicle control device according to claim 1, further comprising a transmission control unit that transmits the collected accuracy reduction information to the information processing device. The vehicle control device according to claim 2, wherein the accuracy reduction information includes information on the traveling environment of the vehicle when the detection accuracy is reduced, together with information on a section in which the detection accuracy of the biological information is reduced. The vehicle according to claim 2 or 3, wherein the transmission control unit transmits the collected accuracy reduction information to the information processing apparatus when the number of times the detection accuracy is reduced is equal to or greater than a predetermined number of times in the same section. Control device for. Any one of claims 1 to 4, wherein the acquisition unit acquires the accuracy information of the other vehicle related to the entire section of the planned travel route when the destination is set and the planned travel route is set. The vehicle control device according to item 1. Any one of claims 1 to 4, wherein the acquisition unit acquires the accuracy information of the other vehicle related to the assumed travel schedule route while the vehicle travels toward the set destination. The vehicle control device according to item 1. The accuracy information of the other vehicle includes any of claims 1 to 6 including information on the detection accuracy of the biological information in the other vehicle in a traveling environment similar to the traveling environment of the vehicle scheduled to travel on the planned traveling route. The vehicle control device according to item 1. The detection unit detects the biological information based on the face image of the occupant, and then
The vehicle control device includes a face information calculation unit that calculates predetermined face information regarding the face of the occupant.
6. The vehicle control device described. The biological information is information on the heartbeat of the occupant.
The vehicle control device according to claim 8, wherein the face information includes at least one information of the skin color of the occupant, the change in the skin color, or the size of the cheek area. The biological information is information on the line of sight of the occupant.
The vehicle control device according to claim 8, wherein the face information includes at least one of the occupant's pupil size, eyelid size, and eyelash length. Any one of claims 1 to 10, wherein the notification unit makes the content of the notification different according to the ratio of the vehicles whose detection accuracy has decreased to the total number of vehicles traveling in the section where the detection accuracy has decreased. The vehicle control device according to the section. The vehicle according to any one of claims 1 to 11, wherein the notification unit notifies in advance that the detection accuracy may decrease based on the number of times the detection accuracy decreases in the same section. Control device for. The vehicle control device is
The predetermined control is executed based on the biological information detected based on the information acquired by the first detector provided in the vehicle, and the said in the planned travel route based on at least the accuracy information of the other vehicle. The control unit further includes a control unit that executes the predetermined control based on the biological information acquired by the second detector mounted on the occupant while the vehicle passes through the section where the detection accuracy is estimated to decrease. ,
The vehicle control device according to any one of claims 1 to 12. A data processing unit that receives and stores accuracy reduction information including information on a section in which the detection accuracy of the biometric information has deteriorated from a vehicle control device having a function of detecting the biometric information of a vehicle occupant.
An information processing device including an output control unit that transmits other vehicle accuracy information regarding the detection accuracy of the biological information to a vehicle scheduled to travel in a section where the detection accuracy has decreased. The accuracy reduction information includes information on the traveling environment of the vehicle when the detection accuracy is reduced, together with information on a section in which the detection accuracy of the biological information is reduced.
The information processing device according to claim 14, wherein the data processing unit classifies and stores information on a section in which the detection accuracy has deteriorated based on the information on the traveling environment. The output control unit transmits the section with reduced detection accuracy to the vehicle scheduled to travel based on the ratio of the vehicles with reduced detection accuracy to the total number of vehicles traveling in the section with reduced detection accuracy. The information processing device according to claim 14 or 15, wherein the content of the accuracy information of the other vehicle is different. In a vehicle control system including a vehicle control device having a function of detecting biological information of a vehicle occupant and an information processing device that communicates with a plurality of the vehicle control devices.
The vehicle control device is
A detection unit that detects the biological information of the occupant,
A destination setting unit that sets the destination of the vehicle, and
An acquisition unit that acquires other vehicle accuracy information regarding the detection accuracy of the biological information in another vehicle on the planned travel route of the vehicle to the destination, and an acquisition unit.
It is provided with a notification unit for notifying that the detection accuracy of the planned travel route is reduced before the vehicle passes through a section estimated to be reduced based on the accuracy information of the other vehicle.
The information processing device
A data processing unit that receives and stores accuracy reduction information including information on a section in which the detection accuracy of the biological information has decreased from the vehicle control device.
An output control unit that transmits other vehicle accuracy information related to the detection accuracy of the biometric information to a vehicle scheduled to travel in the section where the detection accuracy has deteriorated.
A vehicle control system.

Images