CN109080640A - For providing the method for lethargic sleep alarm in vehicle - Google Patents
For providing the method for lethargic sleep alarm in vehicle Download PDFInfo
- Publication number
- CN109080640A CN109080640A CN201810567425.9A CN201810567425A CN109080640A CN 109080640 A CN109080640 A CN 109080640A CN 201810567425 A CN201810567425 A CN 201810567425A CN 109080640 A CN109080640 A CN 109080640A
- Authority
- CN
- China
- Prior art keywords
- lethargic sleep
- vehicle
- data
- lethargic
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0137—Measuring and analyzing of parameters relative to traffic conditions for specific applications
- G08G1/0141—Measuring and analyzing of parameters relative to traffic conditions for specific applications for traffic information dissemination
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
- B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
- B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
- B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Automation & Control Theory (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Combustion & Propulsion (AREA)
- Human Computer Interaction (AREA)
- Mathematical Physics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Traffic Control Systems (AREA)
Abstract
The present invention relates to a kind of for providing the method for lethargic sleep alarm to vehicle (100) driver.Lethargic sleep estimated data group (115) is compared with the history lethargic sleep data (116) from multiple vehicles.Lethargic sleep estimated data group includes the traffic conditions data and vehicle location of current driving background data, current traffic situation of the instruction for vehicle.The lethargic sleep estimated data group for the history lethargic sleep data formerly collected is associated with the determination lethargic sleep degree of driver each when collecting first lethargic sleep estimated data group.Lethargic sleep degree is determined by the lethargic sleep detection system in each vehicle.It is later determined that lethargic sleep risk measure, and the current driving background based on lethargic sleep risk measure and based on vehicle can provide lethargic sleep alarm to driver.
Description
Technical field
The present invention relates to a kind of for providing the method and system of lethargic sleep alarm to the driver of vehicle and including this
The vehicle of system.
Background technique
The tired driver of vehicle may become absent minded, this is not only for driver and Vehicular occupant and right
Also danger close for pedestrian near the driver of other vehicles and vehicle.It is often the case that expectation arrives at the destination as early as possible,
Therefore driver takes more times to drive, and in terms of lethargic sleep angle, this is unsafe.
Current many vehicles are equipped with the lethargic sleep detection system that can be warned to driver's offer when detecting lethargic sleep sign
System.This system may for example analyze head and/or the eye movement of driver to detect lethargic sleep sign.Other systems are based on
Analyze the steering of vehicle location and vehicle relative to lane markings.
But, it can be common that driver ignores warning from lethargic sleep detection system.Such as the opportunity of warning signal is not smart
It is wrong for really or briefly warning.
EP 3002557 describes a system for preventing driver attention from not concentrating.The system is based on determination
Whether the road segments that will occur are unchanged.If it is determined that the road segments that will occur are unchanged, then can be caused in vehicle
Some movements are moved to avoid the potential scatterbrained situation of the driver as caused by lethargic sleep.However, even if attempting when providing
When the movement for keeping driver to regain consciousness, there is also the relatively high risks that driver always falls asleep.For example, driver may neglect
It may ignore depending on this movement and in an identical manner and warn.
Therefore, it is necessary to be further improved the lethargic sleep detection for vehicle.
Summary of the invention
In view of above, an object of the invention is the lethargic sleep detection improved in vehicle and warns.
According to the first aspect of the invention, it provides a kind of for providing the method for lethargic sleep alarm, institute to vehicle driver
The method of stating includes: that collect for vehicle include hold for the driving behavior data of driver and the driving for driver
Current driving background (current drive context) data of continuous time；Collect instruction vehicle current traffic situation and one
The traffic conditions data of time in it, determine the position of vehicle, wherein currently driving background data, traffic conditions data and position
It sets to form lethargic sleep estimated data's group, provides lethargic sleep estimated data group to remote server, lethargic sleep risk measure is received by vehicle,
Based on comparing lethargic sleep estimated data group and include the lethargic sleep estimated data group formerly collected from multiple vehicles and when in multiple vehicles
The correlation of each driver determines the history lethargic sleep data of lethargic sleep degree to determine when collecting first lethargic sleep estimated data group in
The lethargic sleep risk measure determines the determining lethargic sleep degree by the lethargic sleep detection system in each vehicle, is at least based on lethargic sleep
Risk measure provides lethargic sleep alarm to driver.
The present invention is based on the recognition that: it is associated with vehicular traffic situation, position and current driving background by comparing
Data provide more accurate lethargic sleep alarm with the data formerly collected.The historical data is additionally associated with by being collected history
The lethargic sleep data that lethargic sleep detection system in each vehicle of data determines.Hence, it is recognised that being possibly based on from other vehicles
Or statistics that selectively data from other information source are formed provide lethargic sleep alarm to vehicle driver.For example,
When the driving that data may relate to for driver under some traffic conditions (such as highway of low-density traffic) continues
Between, and may determine whether warning signal should be provided based on the time in this and current driving background such as one day.
Therefore, present invention provide the advantage that possibly improving the lethargic sleep alarm time for being provided to driver to make alarm become
It obtains more effectively.Particularly, driver may be using the behavior not ignoring alarm but should taking seriously.
Traffic conditions data may indicate that time in one day, traffic density horizontal (such as instruction low-density rural traffic
Or high density urban transit system), road stretch characteristics (such as the level of dull road, height change, bend quantity, road width,
Road speeds limitation, road type such as gravel or pitch).Time (The time of the day) in one day may include
In other type traffic conditions data, such as the time in one day with traffic conditions level.
It is current drive background can further comprise road type, the time in one day, current driving trip length, for working as
At least one of driving degree etc. is assisted in preceding driving stroke.
Driving behavior data indicate how driver shows when driving.For example, driver is on the way able to maintain one
Cause path traveling in currently drive continued how long etc..
Such as vehicle location can be determined based on the GPS data collected by GPS in vehicle.
Lethargic sleep can be compared based on the mode found in the historical data that may have led to first driver's lethargic sleep behavior
Estimated data's group and history lethargic sleep data.It thus collects and is mapped in for lethargic sleep estimated data's group of current vehicle from other vehicles
Historical data to determine the behavior of current vehicle and whether the traffic conditions for current vehicle indicate lethargic sleep driver's
Risk increases.For current vehicle data (i.e. lethargic sleep estimated data group) can also with the data from other sources for example from
The data of weather station or road management office compare.
Lethargic sleep estimated data group can be completed in " cloud " on the remote server compared with history lethargic sleep data.Cause
And lethargic sleep estimated data's group is uploaded to remote server.Lethargic sleep risk is determined based on the comparison step executed on the server
Measured value, wherein receiving lethargic sleep risk measure from server (or from intermediate server) by vehicle.It is measured based on lethargic sleep risk
It is worth and provides lethargic sleep alarm to driver based on the current lethargic sleep degree of identified driver.
Further, since it is preferred that execute the evaluation of lethargic sleep risk measure in cloud on the server, therefore work as lethargic sleep risk
Measured value indicates that advantageously only lethargic sleep risk measure can be received from cloud when lethargic sleep risk level increases.In other words, if sentenced
It is disconnected that without or there is only lesser lethargic sleep risk, then server can not provide any alarm to vehicle.Under this situation, in vehicle
Lethargic sleep detection system independently of lethargic sleep risk measure execute lethargic sleep risk estimation.
Therefore, in an embodiment of the present invention, compare lethargic sleep estimated data group and the history lethargic sleep number from multiple vehicles
It can execute on the server accordingly and the step of determining lethargic sleep risk measure.
Lethargic sleep degree can be determined by the lethargic sleep detection system in vehicle.This system can be based on analysis for detecting lethargic sleep
The head movement of sign and/or eye movement are worked.The detection can be based further on the expected driving path of analysis and reality
Border driving path.Lethargic sleep determines that system itself is known to the skilled in the art.It may include several lethargic sleep inspections in one vehicle
Examining system.For example, the first lethargic sleep detection system is potentially based on analysis eye movement, the second lethargic sleep detection system is potentially based on for example
Expected driving path and practical driving path are analyzed by lane markings.
In one embodiment, when in vehicle driver lethargic sleep degree indicate driver's lethargic sleep when, can by vehicle from
Server requests lethargic sleep risk measure.Thus vehicle may request lethargic sleep risk measure from server.
According to an embodiment of the invention, the method may include comparing vehicle location and being indicated as wrong lethargic sleep roadway area
The road segments position of section, wherein based on wrong lethargic sleep road segments identified below, that is, indicated based on determined lethargic sleep degree
Watchful driver simultaneously driving behavior data and at least one of traffic conditions data history lethargic sleep data in weighed
Lethargic sleep is indicated again.
Therefore, the method advantageously considers the probability for having been detected by wrong lethargic sleep, this can be further improved and be mentioned
Opportunity and efficiency for alarm.Such as road segments during daytime driving are it has been reported that excessive lethargic sleep driver, and
No other data (driving background data, behavioral data or traffic conditions data) are supported to speculate the lethargic sleep detected.Due to too
Driving behavior caused by sun reflection or lane markings inferior etc., may cause the driving behavior of deviation and non-driver is confused
It sleeps, so that these drivers are for example mistakenly considered lethargic sleep.
If it is determined that road segments are wrong lethargic sleep road segments, then can not be provided to driver associated with road segments
Lethargic sleep alarm.Road segments may be the road segments that vehicle front will occur or the current present road area advanced thereon
Section.
For example, if known road segments are lane markings inferior, it may cause road segments and be identified as wrong lethargic sleep road
Road section can then pass through several data identifing source wrong way sections.This poor quality lane markings may cause lethargic sleep detection system
System has falsely detected the lethargic sleep driver of in fact not lethargic sleep.The distribution of the lethargic sleep determined by multiple vehicles, which can be formed, to be used for
Identify the basis of wrong lethargic sleep road segments.For example, if distribution of the identified lethargic sleep situation relative to traffic conditions data
The normal distribution of reported lethargic sleep situation is excessively deviated from, then road segments can be indicated as wrong lethargic sleep road segments.
According to one embodiment, driver's lethargic sleep degree instruction lethargic sleep that lethargic sleep detection system determines in through vehicle is driven
When the person of sailing, the determination of wrong lethargic sleep road segments may be overthrown and provide lethargic sleep to driver by lethargic sleep detection system
Alarm.In other words, if the lethargic sleep detection system in vehicle indicates driver's lethargic sleep, wrong lethargic sleep roadway area may be ignored
Section instruction and anyway all to driver provide lethargic sleep alarm.Therefore, it does not damage and is examined by the lethargic sleep in single unit vehicle
The safety that examining system provides.
For example, it may be possible to which following situation occurs, that is, the first lethargic sleep detection system based on such as eyeball and/or head movement
Indicate driver's lethargic sleep, and based on from based on detection Road lane markings operation the second lethargic sleep detection system data, when
Preceding road segments are indicated as wrong lethargic sleep detection path.In this case i.e. when lethargic sleep detection system is based on different analyses
When operation, ignores indicated wrong lethargic sleep road segments and all provide lethargic sleep alarm to driver anyway.
According to the second aspect of the invention, it provides for providing the system of lethargic sleep alarm, the system to vehicle driver
System include: for determination include for driver driving the duration driving behavior data driving background data collect
Unit；For collecting the traffic conditions data collection module of the traffic conditions data of instruction vehicle current traffic situation, for true
The position determination unit for determining vehicle location, the wireless communication unit for communicating with remote server are used for remote server
The lethargic sleep estimated data system control unit of group is provided, it includes for comparing that lethargic sleep estimated data group, which includes its remote server,
Lethargic sleep estimated data organizes and include that ought collect from the lethargic sleep estimated data group that multiple vehicles are formerly collected and in multiple vehicles
It is single to determine that the server of the history lethargic sleep data of lethargic sleep degree controls for the correlation of each driver when first lethargic sleep estimated data group
Member determines determined lethargic sleep degree by the lethargic sleep detection system in each vehicle, and determines lethargic sleep risk based on this comparison
Measured value, wherein system control unit is configured as: receiving lethargic sleep risk measure from remote server and at least based on dusk
It sleeps risk measure and provides lethargic sleep alarm to driver.
The system can further comprise the lethargic sleep detection system for detecting vehicle driver's lethargic sleep.
Driving behavior data are potentially based on the user interaction patterns for example with vehicle HMI (man-machine interface), in vehicle
The use pattern of button, entertainment systems use, eye movement, steering wheel control, the operation mode of Vehicular actuator etc..Cause
And driving behavior data may be collected by various sensors provided in a vehicle and/or video camera.
Driving background data collector unit can be with traffic conditions data collection module and the shared sensing of lethargic sleep detection system
Device and component.Thus, driving background data collector unit may include control unit itself, video camera, actuator, sensor etc.
Deng.
Traffic conditions data collection module may include external camera, the thunder that may for example capture vehicle periphery image data
It reaches, laser radar etc..
The second aspect of the invention provides is related to the similar advantage of previously aspect of the invention as described above.
According to the third aspect of the invention we, provide it is a kind of including control unit and be wirelessly connected in the channel radio of server
Believe the vehicle of unit, wherein control unit is configured as: what collection was used for vehicle includes the driving behavior number for driver
The current driving background data of driving duration accordingly and for driver；Collect the Current traffic feelings that instruction is used for vehicle
Condition and in one day the time traffic conditions data, determine vehicle location, driving behavior data, traffic conditions data and institute's rheme
It sets to form lethargic sleep estimated data's group, provides lethargic sleep estimated data group to remote server, wherein in the server, number is estimated in lethargic sleep
According to group compared with history lethargic sleep estimated data's group from multiple vehicles, wherein based on the comparison and based on when in multiple vehicles
The correlation of each driver determines that lethargic sleep degree determines lethargic sleep risk measure when collecting first lethargic sleep estimated data group in, by
Lethargic sleep detection system in each vehicle determines the determining lethargic sleep degree, is based on lethargic sleep risk measure, and control unit is matched
It is set to driver and lethargic sleep alarm is provided.
Advantageously, lethargic sleep risk measure can be received from remote server by vehicle.
The vehicle can further comprise the global positioning system for determining vehicle location, and wherein control unit is from the whole world
The data of positioning system reception indicating positions.
The third aspect of the invention provides is related to the similar advantage of previously aspect of the invention as described above.
Control unit may include microprocessor, microcontroller, programmable digital signal processor or other programmable devices.
Control unit can also or alternatively be patrolled including specific integrated circuit, programmable gate array or programmable logic array, programmable
Collect device or digital signal processor.Wherein control unit includes programmable device such as microprocessor, microcontroller as described above
Device or programmable digital signal processor, processor can further comprise the computer executable generation for controlling programmable device operation
Code.
In short, the present invention relates to a kind of for providing the method for lethargic sleep alarm to vehicle driver.Lethargic sleep estimated data's group
Compared with the history lethargic sleep data from multiple vehicles.Lethargic sleep estimated data group includes current driving background data, indicates to use
In the traffic conditions data and vehicle location of the current traffic situation of vehicle.The lethargic sleep of history lethargic sleep data formerly collected is estimated
It is associated with the determination lethargic sleep degree of driver each when collecting first lethargic sleep estimated data group to calculate data group.By each
Lethargic sleep detection system in vehicle determines lethargic sleep degree.It is later determined that lethargic sleep risk measure and be based on lethargic sleep risk measure
Lethargic sleep alarm is provided to driver with the current driving background based on vehicle.
When studying appended claims and subsequent description, other features and advantages of the present invention be will become apparent.This
Field technical staff recognizes, the reality that different characteristic of the invention may be combined to be formed other than those of hereinafter describing
Example is applied without departing from the scope of the present invention.
Detailed description of the invention
Now with reference to the attached drawing these and other sides that the present invention will be described in more detail for showing illustrated embodiments of the invention
Face, in which:
Fig. 1 is conceptive to show the embodiment of the present invention；
Fig. 2 is the flow chart of step according to the method for the embodiment of the present invention；
Fig. 3 is the flow chart of step according to the method for the embodiment of the present invention；And
Fig. 4 is conceptually shown according to the system in the embodiment of the present invention；
Specific embodiment
In the detailed description, the vehicle referring especially to car form describes the various of system and a method according to the invention
Embodiment.However, present invention can equally be used in vehicle such as bus, truck of any other type etc..Thus, this hair
It is bright however may be presented as many different forms and should not be construed as being confined to embodiments set forth herein；On the contrary
Ground, in order to which penetrability and integrality provide these embodiments, and it fully conveyed the present invention to those skilled in the art
Range.Identical appended drawing reference refers to same element from beginning to end.
Fig. 1 is conceptive to show the multiple of car (100,102,103,104,105) form driven along road segments 106
Vehicle.Each car can be communicated with remote server 108, i.e., receive data from " cloud " 110 and transfer data to " cloud "
110.It can be via the connection of such as mobile communication technology, Wi-Fi etc. offer and server 108.
In currently shown example, vehicle 102-105 has formerly uploaded history dusk related with its traffic conditions
Sleep data and the current driving background data including driving behavior in road segments 106.However, it is noted that can also be from other
Such as traffic of service equipment 112/road management office, online weather forecasting or other online service equipment provide traffic conditions number
According to.Vehicle 102-105 is also provided when the traffic conditions data and current driving background data for including in collection past data
The data of the lethargic sleep degree of each driver of Shi Youguan vehicle 102-105.It can be by the lethargic sleep detection system in each vehicle 102-105
System determines data related with lethargic sleep degree.
It is current in relation to current traffic situation and the current data 115 for driving background and instruction vehicle that vehicle 100 uploads it
The data of position.It can be by including that the global positioning system (GPS is not shown) in vehicle 100 determines current location.It certainly can also
The position of vehicle 102-105 is determined by the corresponding GPS in vehicle 102-105.
Including traffic conditions data, the current lethargic sleep estimated data group 115 for driving background and position data in cloud with packet
Include from other vehicle 102-105 collect first collection lethargic sleep data group history lethargic sleep data 116 (being only marked one) and/
Or it is compared by other traffic conditions data that other service equipments 112 provide.In addition, history lethargic sleep data include when collection exists
The driver's lethargic sleep degree determined in corresponding vehicle (102-105) when first lethargic sleep estimated data.
Although multiple vehicles can it should be noted that showing historical data herein is only collected in four vehicles (102-105)
Including and typically comprise significantly more than four vehicles to form statistically accurate history data set.It is thus illustrated that
Four vehicles (102-105) are only used for representing multiple vehicles.
It (is wrapped based on the lethargic sleep estimated data from vehicle 100 with the history lethargic sleep data collected from multiple vehicle 102-105
Include the lethargic sleep estimated data formerly collected and relevant determining lethargic sleep degree) comparison, in cloud determine lethargic sleep risk measure.
By from finding mode in similar history lethargic sleep data in the data that vehicle 100 receives (for determining lethargic sleep risk measure)
Mode determines lethargic sleep risk measure.For example, if from the received data of vehicle 100 at least partly be associated with lethargic sleep drive
The history lethargic sleep data of member are related, then lethargic sleep risk measure can indicate the driver of vehicle 100 there are lethargic sleep risks.This
Under situation, vehicle may determine to provide lethargic sleep alarm to driver.
The current background that drives may include having road type, the time in one day, current driving trip length, being used for currently
Drive at least one on the non-exhaustive list for assisting driving degree in stroke.
By for sample data professor machine learning algorithm execute lethargic sleep risk measure determination to identify from
Mode in the received data associated with the risk of lethargic sleep driver for determining lethargic sleep risk measure of current vehicle.
This machine learning algorithm can run the learning algorithm being subjected to supervision.
The lethargic sleep detection system of vehicle may provide false correctness, i.e., indicate driver when in fact driver's not lethargic sleep
Lethargic sleep.On the contrary, the detection of lethargic sleep driver may be triggered by other events.For example, undesirable lane markings may cause and drive
The person of sailing seems to drive in less straight mode or the sun reflection in windshield or from other light sources such as road
Reflection of lamp or notice board, urban lighting etc. may influence the behavior of driver.This interference can lead in usual and lethargic sleep
Report that lethargic sleep driver is (i.e. confused the daytime of the incoherent traffic conditions of driver (such as very intensive traffic) in relatively large quantities
Sleep strong), conclude that the road segments are the lethargic sleep road segments of mistake whereby.
In addition, the lethargic sleep road segments of the frequency identification mistake by the report lethargic sleep driver of specific duration.For example,
If (being more than threshold value) report lethargic sleep drives in relatively large quantities on same link section within the relatively short periodical time limit
Member, then also can determine that road segments are the wrong lethargic sleep road segments of the period.More specifically, if on such as 2 hours daytimes
Time interval during the quantity of lethargic sleep driver is unworthily very big for some road segments, then suspect other factors
The detection and non-driver actually lethargic sleep of triggered lethargic sleep driver.If it is determined that vehicle location and wrong lethargic sleep roadway area
Duan Chonghe, then vehicle lethargic sleep detection system, which may determine to ignore to the driver of vehicle 100, provides lethargic sleep alarm.
Vehicle can advantageously comprise be adapted to determine that driver whether the lethargic sleep detection system of lethargic sleep.This system itself is this
Known to the technical staff of field, and operated by analysis head movement, eye movement etc..If lethargic sleep detection system is true
Determine driver's lethargic sleep, such as lethargic sleep degree is higher than threshold value, then is whether that wrong way section all may be from lethargic sleep detection system
It unites and provides alarm to driver.Vehicle advantageously comprises multiple lethargic sleep detection systems.For example, the first lethargic sleep detection system may base
It is operated and the second lethargic sleep detection system is potentially based on detection Road lane markings and grasps in analysis head and/or eye movement
Make.
Fig. 2 is the flow chart of step according to the method for the embodiment of the present invention.In first step S202, collecting includes being used for
The current driving background data of the driving behavior data of driver, the data further comprise for driver driving continue
Time.Further, the traffic conditions data of S204 instruction current vehicle traffic conditions are collected, and also determine S205 vehicle
Position.In step S206, currently drives background data, traffic conditions data and position and form the lethargic sleep for being supplied to remote server
Estimated data's group.Lethargic sleep estimated data organizes and include that the lethargic sleep estimated data that formerly collects from multiple vehicles organizes and relevant determination
The history lethargic sleep data of lethargic sleep degree compare.Identified lethargic sleep journey is determined by the lethargic sleep detection system in each vehicle
Degree.Lethargic sleep risk measure is determined compared with history lethargic sleep data based on lethargic sleep estimated data group, wherein being connect by the vehicle
Receive S208 lethargic sleep risk measure.
(step S207 in Fig. 3) can be advantageously compared with history lethargic sleep data by lethargic sleep estimated data from current vehicle
It is executed in cloud, that is, from the server 108 that vehicle uploads that lethargic sleep estimated data organizes.In addition, on server 108 really
Determine lethargic sleep risk measure 114 and lethargic sleep risk measure 114 is then supplied to vehicle 100.
Based on lethargic sleep risk measure S210 lethargic sleep alarm can be provided to driver.Lethargic sleep risk measure 114 by together with
Identified vehicle driver's lethargic sleep degree is evaluated together, determines lethargic sleep degree by the lethargic sleep detection system in vehicle.Based on this
Evaluation determines whether that driver provides lethargic sleep alarm.
Fig. 3 is the flow chart of another embodiment according to the present invention.In Fig. 3, there is additional step S207 to compare vehicle
The position of position and wrong lethargic sleep road segments.If it is determined that the current location of vehicle or the position that will be in are located at mistake dusk
It sleeps in road segments, then can be determined from vehicle lethargic sleep detection system and not provide S213 lethargic sleep alarm to 100 driver of vehicle.If
Wrong lethargic sleep road segments will not occur or current, then the method continues referring to shown in Fig. 2.
Conceptive show of Fig. 4 is used to provide the system 400 of lethargic sleep alarm to vehicle driver according to the embodiment of vehicle.It mentions
For wireless communication unit 402 so that the system can be communicated with cloud 110 (i.e. remote server).The system comprises for determining
The driving background data collector unit 404 of driving behavior data for example including the driving duration for driver, with
And the traffic conditions data collection module 406 of the traffic conditions data for collecting instruction vehicle current traffic situation.System into
One step includes the position determination unit 408 for determining vehicle location.Position determination unit for example may include GPS.
Control unit 410 is configured as providing lethargic sleep estimated data group to remote server (such as to cloud 110).It is servicing
In device, server control unit (not shown) is configurable for comparing lethargic sleep estimated data group and includes first from multiple vehicles
The history lethargic sleep data of the lethargic sleep estimated data group of collection.History lethargic sleep data further include collecting when from multiple vehicles
The relevant determining lethargic sleep degree of first lethargic sleep estimated data each driver when organizing.
Server control unit is configured to organize based on lethargic sleep estimated data true compared with history lethargic sleep data
Determine lethargic sleep risk measure.System control unit 410 is configured as receiving lethargic sleep risk measure from cloud 110.Control unit 410
Hereafter it can be mentioned based on lethargic sleep risk measure and based on the lethargic sleep degree determined from lethargic sleep detection system 414 in vehicle to driver
For lethargic sleep alarm.
Driving behavior data can be based on the user interaction patterns for example with vehicle HMI (man-machine interface), press in vehicle
The use pattern of button, entertainment systems use, eye movement, steering wheel control, the operation mode of Vehicular actuator etc..Thus,
Driving behavior data may be collected by various sensors provided in a vehicle and/or video camera.
Traffic conditions data collection module may include external camera, the thunder that may for example capture vehicle periphery image data
Up to (radia), laser radar (LIDAR) etc..
Lethargic sleep detection system can be used the interior video cameras for for example capturing eyes and/or head movement, analysis vehicle opposite
In surrounding such as Road lane markings mobile external camera and/or radar system.
It should be appreciated that driving background data collector unit 404, traffic conditions data collection module 406 and lethargic sleep detection system
System can shared sensor, video camera, radar or other components.
Person of ordinary skill in the field recognizes that the present invention is not limited to preferred embodiment as described above.Phase
Instead, many improvements and changes may be within the scope of the appended claims.
In the claims, word " comprising " is not excluded for other element or steps, indefinite article "one" be not excluded for it is multiple.
Single processor or other units may complete the function of some projects of claim record.Certain measured values are documented in mutually
The combination that the pure fact of this in different dependent claims is not offered as these measured values cannot be used for getting profit.Claim
In any appended drawing reference should not be construed as limiting the range.
Claims (15)
1. one kind is for providing the method for lethargic sleep alarm to the driver of vehicle (100), which comprises
Collection (S202) includes driving for the driving behavior data of the driver and for described for the vehicle
The current driving background data of the driving duration for the person of sailing；
The traffic conditions data of collection (S204) instruction time for the current traffic situation of the vehicle and in one day,
Determine the position of (S205) described vehicle,
Wherein the current driving background data, the traffic conditions data and the position form lethargic sleep estimated data group
(115),
(S206) described lethargic sleep estimated data group is provided to remote server (108),
(S208) lethargic sleep risk measure is received by the vehicle, the lethargic sleep risk measure is to be based on estimating the lethargic sleep
Calculate data group and include from the lethargic sleep estimated data group that multiple vehicles are formerly collected and when in multiple vehicles collect formerly dusk
The history lethargic sleep data (116) of the relevant determining lethargic sleep degree of each driver are compared to determine when sleeping estimated data's group
, the determining lethargic sleep degree is determined by the lethargic sleep detection system in each vehicle,
At least (S210) lethargic sleep alarm is provided to the driver based on the lethargic sleep risk measure.
2. according to the method described in claim 1, including:
The lethargic sleep estimated data group is uploaded from the vehicle to remote server,
The lethargic sleep risk measure (114) is received from the server, wherein
Described in being provided based on the lethargic sleep risk measure and based on the current lethargic sleep degree of identified driver to driver
Lethargic sleep alarm.
3. according to the method described in claim 2, wherein only rising when lethargic sleep risk measure instruction lethargic sleep risk is in
The lethargic sleep risk measure is received when horizontal.
4. according to the method in claim 2 or 3, wherein on the server execute by the lethargic sleep estimated data group with
The step of history lethargic sleep data from multiple vehicles are compared and determine lethargic sleep risk measure.
5. according to method described in preceding claims any one, wherein the lethargic sleep degree as driver in vehicle indicates lethargic sleep
Driver when,
Lethargic sleep risk measure is requested from the server.
6. according to method described in preceding claims any one, wherein the comparison includes:
The vehicle location is compared (S207) with the road segments position for being indicated as wrong lethargic sleep road segments,
In, wrong lethargic sleep road segments are identified based on following: indicating watchful driver simultaneously based on the determining lethargic sleep degree
Driving behavior data and at least one of traffic conditions data history lethargic sleep data in repeatedly indicate lethargic sleep.
7. according to the method described in claim 6, wherein when it is wrong lethargic sleep road segments that road segments, which have been determined, not to vehicle
Driver the lethargic sleep alarm is provided.
8. according to the method described in claim 7, wherein when the driver's dusk determined by the lethargic sleep detection system in the vehicle
When sleeping degree instruction lethargic sleep driver, the determination of the wrong lethargic sleep road segments is overthrown and by the lethargic sleep detection system
It unites and provides lethargic sleep alarm to driver.
9. according to method described in preceding claims any one, wherein the traffic conditions data further comprise being related to handing over
The data of flux density level.
10. according to method described in preceding claims any one, wherein the current driving background is road type, one day
In time, current driving trip length, at least one of auxiliary driving degree in current driving trip.
11. it is a kind of for providing the system of lethargic sleep alarm to the driver of vehicle, the system comprises:
It drives background data collector unit (404), includes the driving with the driving duration for driver for collecting
The driving background data of member's behavioral data；
Traffic conditions data collection module (406), for collecting traffic feelings of the instruction for the current traffic situation of the vehicle
Condition data,
For determining the position determination unit (408) of vehicle location,
Wireless communication unit (402) for being communicated with remote server (108),
For providing the lethargic sleep estimated data system control unit (410) organized to the remote server, number is estimated in the lethargic sleep
It include driving the position of background data and the vehicle according to group,
Wherein the remote server includes server control unit, and the server control unit is for estimating the lethargic sleep
Data group and include from the lethargic sleep estimated data group that multiple vehicles are formerly collected and when collecting first lethargic sleep in multiple vehicles
The history lethargic sleep data of the relevant determining lethargic sleep degree of each driver when estimated data organizes are compared, the determining dusk
It sleeps degree to be determined by the lethargic sleep detection system in each vehicle, and is used for
Lethargic sleep risk measure is determined based on the comparison,
Wherein the system control unit is configured as:
The lethargic sleep risk measure is received from the remote server, and
At least lethargic sleep alarm is provided to the driver based on the lethargic sleep risk measure.
12. system according to claim 11 further comprises the dusk for the lethargic sleep for detecting the driver of the vehicle
Sleep detection system.
13. a kind of vehicle of the wireless communication unit including control unit and wireless connection in server, wherein the control is single
Member is configured as:
Collecting for the vehicle includes for the driving behavior data of the driver and for the driver
Drive the current driving background data of duration；
The traffic conditions data of collection instruction time for the current traffic situation of the vehicle and in one day,
Determine that the position of the vehicle, the driving behavior data, the traffic conditions data and the position form lethargic sleep
Estimated data's group,
The lethargic sleep estimated data group is provided to remote server,
Wherein, in the server, the lethargic sleep estimated data group and history lethargic sleep estimated data's group from multiple vehicles
It is compared, wherein based on the comparison and based on driving each when collecting first lethargic sleep estimated data group in multiple vehicles
The relevant determining lethargic sleep degree of member determines lethargic sleep risk measure, determined as the lethargic sleep detection system in each vehicle described in
Determine lethargic sleep degree,
It is based on the lethargic sleep risk measure, described control unit is configured as providing lethargic sleep alarm to the driver.
14. vehicle according to claim 13, wherein receiving the lethargic sleep wind from the remote server by the vehicle
Dangerous measured value.
15. vehicle described in 3 or 14 any one according to claim 1, including the whole world for determining the position of vehicle
Positioning system, wherein described control unit receives the data for indicating the position from the global positioning system.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP17175740.4 | 2017-06-13 | ||
| EP17175740.4A EP3416147B1 (en) | 2017-06-13 | 2017-06-13 | Method for providing drowsiness alerts in vehicles |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109080640A true CN109080640A (en) | 2018-12-25 |
| CN109080640B CN109080640B (en) | 2021-06-01 |
Family
ID=59055100
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810567425.9A Active CN109080640B (en) | 2017-06-13 | 2018-06-05 | Method for providing a comatose alert in a vehicle |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US10825339B2 (en) |
| EP (1) | EP3416147B1 (en) |
| CN (1) | CN109080640B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113425299A (en) * | 2020-03-23 | 2021-09-24 | 安波福技术有限公司 | Driver alertness monitoring including predictive sleep risk factors |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8698639B2 (en) * | 2011-02-18 | 2014-04-15 | Honda Motor Co., Ltd. | System and method for responding to driver behavior |
| US9751534B2 (en) | 2013-03-15 | 2017-09-05 | Honda Motor Co., Ltd. | System and method for responding to driver state |
| JP6977589B2 (en) * | 2018-01-31 | 2021-12-08 | 株式会社デンソー | Vehicle alarm device |
| JP7243101B2 (en) * | 2018-09-25 | 2023-03-22 | トヨタ自動車株式会社 | Server, vehicle and charger guide method |
| JP7232094B2 (en) * | 2019-03-25 | 2023-03-02 | 株式会社Subaru | VEHICLE CONTROL DEVICE, VEHICLE CONTROL METHOD AND PROGRAM |
| CN111210620B (en) * | 2019-12-19 | 2022-06-03 | 广州航天海特系统工程有限公司 | Method, device and equipment for generating driver portrait and storage medium |
| JP7107329B2 (en) * | 2020-02-12 | 2022-07-27 | トヨタ自動車株式会社 | driving support system |
| US12073332B2 (en) | 2020-08-20 | 2024-08-27 | Toyota Motor Engineering & Manufacturing North America, Inc. | Rest stop recommendation system |
| DE102021201459B3 (en) * | 2021-02-16 | 2022-06-15 | Volkswagen Aktiengesellschaft | Method for supporting a driver of a vehicle when driving the vehicle, and electronic driver support system and vehicle |
| EP4303848A1 (en) * | 2022-07-04 | 2024-01-10 | Harman Becker Automotive Systems GmbH | Driver assistance system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040183685A1 (en) * | 2003-03-18 | 2004-09-23 | Ford Global Technologies, Llc | Drowsy driver monitoring and prevention system |
| EP1900589B1 (en) * | 2006-09-18 | 2012-06-27 | Robert Bosch GmbH | Driver assistance system with warning function |
| CN103770733A (en) * | 2014-01-15 | 2014-05-07 | 中国人民解放军国防科学技术大学 | Method and device for detecting safety driving states of driver |
| CN105966405A (en) * | 2015-03-13 | 2016-09-28 | 哈曼国际工业有限公司 | Driver distraction detection system |
| CN106564501A (en) * | 2016-08-16 | 2017-04-19 | 成都市和平科技有限责任公司 | Intelligent automobile assisting system and method based on cloud technology |
Family Cites Families (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6191694B1 (en) * | 1998-08-18 | 2001-02-20 | David W. Brownlee | Oxygen enrichment system for vehicles |
| US6380859B1 (en) * | 1998-08-18 | 2002-04-30 | David W. Brownlee | Hyperbaric oxygen enrichment system for vehicles |
| US8323025B2 (en) * | 2005-07-12 | 2012-12-04 | Eastern Virginia Medical School | System and method for automatic driver evaluation |
| US8297977B2 (en) * | 2005-07-12 | 2012-10-30 | Eastern Virginia Medical School | System and method for automatic driver evaluation |
| WO2007113809A2 (en) * | 2006-03-30 | 2007-10-11 | Saban Asher S | Protecting children and passengers with respect to a vehicle |
| US8849501B2 (en) * | 2009-01-26 | 2014-09-30 | Lytx, Inc. | Driver risk assessment system and method employing selectively automatic event scoring |
| US9024764B2 (en) * | 2007-01-25 | 2015-05-05 | Honda Motor Co., Ltd. | Method and apparatus for manipulating driver core temperature to enhance driver alertness |
| US20110106442A1 (en) * | 2009-10-30 | 2011-05-05 | Indian Institute Of Technology Bombay | Collision avoidance system and method |
| US10897650B2 (en) * | 2010-06-07 | 2021-01-19 | Affectiva, Inc. | Vehicle content recommendation using cognitive states |
| US11067405B2 (en) * | 2010-06-07 | 2021-07-20 | Affectiva, Inc. | Cognitive state vehicle navigation based on image processing |
| US8825304B2 (en) * | 2010-06-30 | 2014-09-02 | Microsoft Corporation | Mediation of tasks based on assessments of competing cognitive loads and needs |
| WO2014064095A1 (en) * | 2012-10-22 | 2014-05-01 | Takata AG | Method and assistance system for assisting a driver of a motor vehicle, and measuring method and measuring system for determining a mental state of a driver of a motor vehicle |
| US11254209B2 (en) * | 2013-03-15 | 2022-02-22 | Honda Motor Co., Ltd. | System and method for controlling vehicle systems in a vehicle |
| US10037689B2 (en) * | 2015-03-24 | 2018-07-31 | Donald Warren Taylor | Apparatus and system to manage monitored vehicular flow rate |
| WO2015026352A1 (en) * | 2013-08-22 | 2015-02-26 | Intel Corporation | Locality adapted computerized assisted or autonomous driving of vehicles |
| US10692370B2 (en) * | 2014-03-03 | 2020-06-23 | Inrix, Inc. | Traffic obstruction detection |
| US9296396B2 (en) * | 2014-06-13 | 2016-03-29 | International Business Machines Corporation | Mitigating driver fatigue |
| WO2016033587A1 (en) * | 2014-08-29 | 2016-03-03 | Ims Solutions Inc. | Driver readiness and integrated performance assessment |
| EP3002557B1 (en) | 2014-10-03 | 2019-09-25 | Volvo Car Corporation | Method and system for identifying a situation with a potentially inalert driver |
| US9959756B2 (en) * | 2015-10-01 | 2018-05-01 | Here Global B.V. | Transmission of targeted roadway alerts |
| US9955925B2 (en) * | 2015-12-18 | 2018-05-01 | Microsoft Technology Licensing, Llc | Drowsiness onset detection |
| US10467488B2 (en) * | 2016-11-21 | 2019-11-05 | TeleLingo | Method to analyze attention margin and to prevent inattentive and unsafe driving |
| US11249544B2 (en) * | 2016-11-21 | 2022-02-15 | TeleLingo | Methods and systems for using artificial intelligence to evaluate, correct, and monitor user attentiveness |
| US9965951B1 (en) * | 2017-01-23 | 2018-05-08 | International Business Machines Corporation | Cognitive traffic signal control |
| US10121084B2 (en) * | 2017-03-07 | 2018-11-06 | Wipro Limited | Method and a system for detecting drowsiness state of a vehicle user |
-
2017
- 2017-06-13 EP EP17175740.4A patent/EP3416147B1/en active Active
-
2018
- 2018-06-05 CN CN201810567425.9A patent/CN109080640B/en active Active
- 2018-06-06 US US16/001,103 patent/US10825339B2/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040183685A1 (en) * | 2003-03-18 | 2004-09-23 | Ford Global Technologies, Llc | Drowsy driver monitoring and prevention system |
| EP1900589B1 (en) * | 2006-09-18 | 2012-06-27 | Robert Bosch GmbH | Driver assistance system with warning function |
| CN103770733A (en) * | 2014-01-15 | 2014-05-07 | 中国人民解放军国防科学技术大学 | Method and device for detecting safety driving states of driver |
| CN105966405A (en) * | 2015-03-13 | 2016-09-28 | 哈曼国际工业有限公司 | Driver distraction detection system |
| CN106564501A (en) * | 2016-08-16 | 2017-04-19 | 成都市和平科技有限责任公司 | Intelligent automobile assisting system and method based on cloud technology |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113425299A (en) * | 2020-03-23 | 2021-09-24 | 安波福技术有限公司 | Driver alertness monitoring including predictive sleep risk factors |
Also Published As
| Publication number | Publication date |
|---|---|
| US10825339B2 (en) | 2020-11-03 |
| CN109080640B (en) | 2021-06-01 |
| EP3416147B1 (en) | 2020-01-15 |
| US20180357894A1 (en) | 2018-12-13 |
| EP3416147A1 (en) | 2018-12-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109080640A (en) | For providing the method for lethargic sleep alarm in vehicle | |
| JP7499256B2 (en) | System and method for classifying driver behavior - Patents.com | |
| JP7466396B2 (en) | Vehicle control device | |
| US10957201B2 (en) | System and method for relative positioning based safe autonomous driving | |
| WO2018058958A1 (en) | Road vehicle traffic alarm system and method therefor | |
| US12183205B2 (en) | Obstacle information management device, obstacle information management method, and device for vehicle | |
| CN108932869A (en) | Vehicular system, information of vehicles processing method, recording medium, traffic system, infrastructure system and information processing method | |
| CN105620489A (en) | Driving assistance system and real-time warning and prompting method for vehicle | |
| CN104260723B (en) | A kind of front vehicle motion state tracking prediction meanss and Forecasting Methodology | |
| WO2017123665A1 (en) | Driver behavior monitoring | |
| US10369995B2 (en) | Information processing device, information processing method, control device for vehicle, and control method for vehicle | |
| CN106781697A (en) | Vehicular adverse weather real-time perception and anticollision method for early warning | |
| JP2015022499A (en) | Driving feature judgment system | |
| US8791806B2 (en) | Real-time detection of hazardous driving | |
| KR20140112171A (en) | Display system of vehicle information based on the position | |
| JP2012123625A (en) | Vehicle driving estimation system | |
| CN112606831A (en) | Anti-collision warning information external interaction method and system for passenger car | |
| US11034293B2 (en) | System for generating warnings for road users | |
| CN114387785A (en) | Safety management and control method and system based on intelligent highway and storable medium | |
| JP7419667B2 (en) | Route prediction device, in-vehicle device equipped with the same, route prediction system, route prediction method, and computer program | |
| CN112241004A (en) | Object recognition device | |
| CN102927964A (en) | Distance measuring device and method and vehicle | |
| JP2024045531A (en) | Information processing device, server device, information processing method, and program | |
| KR101788219B1 (en) | System and method for gathering weather information using vehicle | |
| CN204124126U (en) | A kind of front vehicle state of kinematic motion follows the trail of prediction unit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |