[go: up one dir, main page]

CN109747649A - 基于驾驶者状态的车辆控制系统及方法 - Google Patents

基于驾驶者状态的车辆控制系统及方法 Download PDF

Info

Publication number
CN109747649A
CN109747649A CN201811294808.XA CN201811294808A CN109747649A CN 109747649 A CN109747649 A CN 109747649A CN 201811294808 A CN201811294808 A CN 201811294808A CN 109747649 A CN109747649 A CN 109747649A
Authority
CN
China
Prior art keywords
vehicle
driver
road shoulder
lane
eyeball
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811294808.XA
Other languages
English (en)
Other versions
CN109747649B (zh
Inventor
沈相均
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Halla Creedong Electronics Co ltd
Original Assignee
Mando Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mando Corp filed Critical Mando Corp
Publication of CN109747649A publication Critical patent/CN109747649A/zh
Application granted granted Critical
Publication of CN109747649B publication Critical patent/CN109747649B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/18—Propelling the vehicle
    • B60W30/18009—Propelling the vehicle related to particular drive situations
    • B60W30/18163—Lane change; Overtaking manoeuvres
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1112—Global tracking of patients, e.g. by using GPS
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4806—Sleep evaluation
    • A61B5/4809—Sleep detection, i.e. determining whether a subject is asleep or not
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6893—Cars
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
    • B60Q1/50—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking
    • B60Q1/52—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating other intentions or conditions, e.g. request for waiting or overtaking for indicating emergencies
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00—Conjoint control of vehicle sub-units of different type or different function
    • B60W10/18—Conjoint control of vehicle sub-units of different type or different function including control of braking systems
    • B60W10/184—Conjoint control of vehicle sub-units of different type or different function including control of braking systems with wheel brakes
    • B60W10/188—Conjoint control of vehicle sub-units of different type or different function including control of braking systems with wheel brakes hydraulic brakes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00—Conjoint control of vehicle sub-units of different type or different function
    • B60W10/20—Conjoint control of vehicle sub-units of different type or different function including control of steering systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/10—Path keeping
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/14—Adaptive cruise control
    • B60W30/143—Speed control
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/18—Propelling the vehicle
    • B60W30/182—Selecting between different operative modes, e.g. comfort and performance modes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/10—Interpretation of driver requests or demands
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0055—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots with safety arrangements
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0088—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
    • A61B2560/02—Operational features
    • A61B2560/0242—Operational features adapted to measure environmental factors, e.g. temperature, pollution
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/04—Arrangements of multiple sensors of the same type
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1121—Determining geometric values, e.g. centre of rotation or angular range of movement
    • A61B5/1122—Determining geometric values, e.g. centre of rotation or angular range of movement of movement trajectories
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143—Alarm means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/221—Physiology, e.g. weight, heartbeat, health or special needs
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/26—Incapacity
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00—Input parameters relating to objects
    • B60W2554/40—Dynamic objects, e.g. animals, windblown objects
    • B60W2554/404—Characteristics
    • B60W2554/4041—Position
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00—Input parameters relating to data
    • B60W2556/45—External transmission of data to or from the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00—Input parameters relating to data
    • B60W2556/45—External transmission of data to or from the vehicle
    • B60W2556/50—External transmission of data to or from the vehicle of positioning data, e.g. GPS [Global Positioning System] data
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2900/00—Indexing codes relating to the purpose of, or problem solved of road vehicle drive control systems not otherwise provided for in groups B60W30/00
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Psychiatry (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Psychology (AREA)
  • Hospice & Palliative Care (AREA)
  • Educational Technology (AREA)
  • Developmental Disabilities (AREA)
  • Child & Adolescent Psychology (AREA)
  • Social Psychology (AREA)
  • Remote Sensing (AREA)
  • Multimedia (AREA)
  • Mathematical Physics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Anesthesiology (AREA)
  • Dentistry (AREA)
  • Physiology (AREA)

Abstract

本发明涉及基于驾驶者状态的车辆控制系统及方法，该车辆控制系统具备：检测装置，其包括照相机、车辆动力学传感器、车辆全方位监视照相机、车辆周边监视传感器及导航仪；及电子控制装置，通过接收从所述检测装置输入的检测信号而识别的驾驶者的脸部及眼球来分析驾驶者状态，并在判断为驾驶者没有行驶意志的情况下，将车辆控制为停放到路肩，从而能够引导更安全的车辆行驶。

Description

基于驾驶者状态的车辆控制系统及方法
技术领域
本发明涉及基于驾驶者状态的车辆控制系统及方法，更具体地，涉及如下的基于驾驶者状态的车辆控制系统及方法：在行驶中通过驾驶者的脸部及眼球而分析驾驶者状态，并在判断为驾驶者没有行驶意志的情况下，将车辆控制为停放到路肩，从而引导更安全的车辆行驶。
背景技术
通常，先进驾驶辅助系统(Advanced Driver Assistance System，ADAS)是由车辆主动识别驾驶中可发生的诸多情况中的一部分状况并判断状况来控制机械装置的系统。该系统是为了在复杂的车辆控制过程中帮助并辅助驾驶者，最终完成自主行驶技术而研发的。
这样的ADAS包括：在具有冲撞危险时，即便驾驶者未踩下制动装置而也能够自动减小速度或停止的‘自动紧急制动系统(Autonomous Emergency Braking，AEB)’、在脱离车道时调节行驶方向而保持车道的‘行驶转向辅助系统(Lane Keep Assist System，LKAS)’、以事先规定的速度行驶的同时主动与前车之间保持间隔的‘先进智能巡航控制器(Advanced Smart Cruise Control，ASCC)’、检测盲区冲撞危险而帮助变更到安全的车道的‘后侧方冲撞回避协助系统(Active Blind Spot Detection，ABSD)’、视觉性地显示出车辆周边状况的‘环视显示系统(Around View Monitor，AVM)’等。
现有技术文献
专利文献
韩国公开专利公报第2013-0023535号(2013.03.08)
韩国公开专利公报第2014-0050424号(2014.04.29)
日本公开专利公报第2015-210734号(2015.11.24)
发明内容
发明要解决的课题
因此，本发明是为了解决如上述的问题而研发的，本发明的目的在于，提供一种如下的基于驾驶者状态的车辆控制系统及方法：行驶中通过驾驶者的脸部及眼球而分析驾驶者状态，并在判断为驾驶者没有行驶意志的情况下，将车辆控制为停放到路肩，从而引导更安全的车辆行驶。
解决课题的手段
为了达到如上述的目的，本发明的基于驾驶者状态的车辆控制系统包括；检测装置，其包括照相机、车辆动力学传感器、车辆全方位监视照相机、车辆周边监视传感器及导航仪；及电子控制装置，其通过接收从所述检测装置输入的检测信号而识别的驾驶者的脸部及眼球而分析驾驶者状态，并在判断为驾驶者没有行驶意志的情况下，控制为将车辆停放到路肩。
所述电子控制装置可在所分析的驾驶者状态为正常的情况下，分析驾驶者眼球，并基于驾驶者眼球的移动来控制车辆。
发明效果
如上述，根据本发明的基于驾驶者状态的车辆控制系统及方法，行驶中通过驾驶者的脸部及眼球而分析驾驶者状态，并在判断为驾驶者没有行驶意志的情况下，将车辆控制为停放到路肩，从而那个引导更安全的车辆行驶。
另外，可在所分析的驾驶者状态为正常的情况下，分析驾驶者眼球，并基于驾驶者眼球的移动来控制车辆。
附图说明
图1是概略性地示出本发明的优选实施例的车辆控制系统的整体结构的框图。
图2是概略性地示出本发明的优选实施例的车辆控制方法的整体过程的流程图。
图3是概略性地示出本发明的优选实施例的将车辆控制为移动到路肩之后停车的方法的过程的流程图。
图4中以图像来示出根据本发明的优选实施例而将车辆移动到路肩的方法。
图5是概略性地示出本发明的优选实施例的分析驾驶者眼球的方法的过程的流程图。
标号说明
10：检测装置
11：驾驶者监视照相机
12：车辆动力学传感器
13：车辆全方位监视照相机
14：车辆周边监视传感器
15：导航仪
20：电子控制装置
30：驾驶员不注意警报装置
40：加速/减速控制装置
50：转向控制装置
具体实施方式
通过参照后述的参照附图而说明的实施例，能够清楚地了解本发明的优点、特征及达到它们的方法。但本发明不限于以下公开的实施例，而是可以通过其他的各种形态实现，实施例仅为了将本发明完整地公开，并向本领域的技术人员完整地介绍发明的范围而提供，本发明应当仅通过权利要求书的范围来定义。在整个说明书中，相同的参考标号表示相同的构成要件。
下面，参照附图，对本发明的基于驾驶者状态的车辆控制系统及方法进行详细说明。
图1是概略性地示出本发明的优选实施例的车辆控制系统的整体结构的框图。
如图1所示，应用本发明的车辆控制系统包括驾驶者监视照相机11、车辆动力学传感器12、车辆全方位监视照相机13、车辆周边监视传感器14及导航仪15等检测装置10、电子控制装置(Electronic Control Unit，ECU)20、驾驶员不注意警报装置30、制动控制装置40及转向控制装置50。
驾驶者监视照相机11作为FIR照相机等各种公知的图像传感器，设于车辆的内部而将获得驾驶者的脸部及眼球的影像来识别的驾驶者脸部表情、驾驶者睁眼/闭眼、驾驶者眼球的移动及注视位置等驾驶者监视信息传送到电子控制装置20。
车辆动力学传感器12作为轮速传感器、加速度传感器、偏航率传感器，转向角传感器等各种公知的传感器，配置于车辆的车轮、方向盘等适当的位置而将检测本车辆的行驶速度、加速度、偏航角速度、转向角度等来识别的车辆动力学信息传送到电子控制单元20。
车辆全方位监视照相机13作为FIR照相机、CMOS照相机(或CCD照相机)等各种公知的图像传感器，设于车辆的前面玻璃的上端而将在车辆前方的一定角度及距离以内检测紫外线频带、可见光区域等各种频带的光并进行投射，从而获得车辆前方的外部对象、车道线(lane)、指示牌等影像来识别的车辆前方位信息传送到电子控制装置20。
车辆周边监视传感器14作为雷达传感器等各种公知的传感器，位于车辆的前后面中央及角落而将以一定角度以内的范围向传感器前方发射电磁波之后接收从位于车辆周边的物体反射过来的电磁波，从而检测本车辆与周边物体之间的角度、距离、相对速度、相对加速度等而识别的车辆周边信息传送到电子控制单元20。
导航仪15作为通过GPS(Global Positioning System：全球定位系统)而确认车辆的目前位置来显示地图或确认至目的地为止的距离及所需时间而引导至目的地为止的路径来帮助车辆驾驶，并在紧急情况下或因车辆故障而需要紧急派遣服务或因事故而需要救援的情况下，能够告知车辆的目前位置的装置或程序，本发明的导航仪15将本车辆的目前行驶道路信息及路肩信息等传送到电子控制装置20。
电子控制装置20通过从检测装置10接收检测信号而识别的驾驶者脸部及眼球来分析驾驶者状态，并在判断为驾驶者没有行驶意志的情况下，控制车辆停放到路肩，由此引导更安全的车辆行驶。
另外，电子控制装置20可在所分析的驾驶者状态为正常的情况下，分析驾驶者眼球，基于驾驶者眼球的移动来控制车辆。
驾驶员不注意警报装置30是接收电子控制装置20的控制信号而对驾驶者的不注意发出警报的装置，加速/减速控制装置30接收电子控制装置20的控制信号而增加车辆的发动机输出或生成制动压力，转向控制装置40接收电子控制装置20的控制信号而生成车辆的方向盘的转向角度。
本发明提供如下的方法：通过驾驶者的脸部及眼球而分析驾驶者状态，并在判断为驾驶者没有行驶意志的情况下，控制为将车辆停放到路肩，由此引导更安全的车辆行驶。
另外，本发明还提供如下的方法：在分析的驾驶者状态为正常的情况下，分析驾驶者眼球，并基于驾驶者眼球的移动来控制车辆。
下面，参照图2至图4，对利用这样构成的系统而执行本发明中的基于驾驶者状态的车辆控制的方法进行说明。
图2是概略性地示出本发明的优选实施例的车辆控制方法的整体过程的流程图。
如图2所示，本发明中的基于驾驶者状态的车辆控制系统通过驾驶者监视照相机11而获得驾驶者的脸部及眼球的影像，来识别驾驶者监视信息(例如，驾驶者的脸部表情、驾驶者的睁眼/闭眼、驾驶者眼球的移动及注视位置等)(S210)。
并且，利用所识别的驾驶者监视信息来分析驾驶者状态(S220)。例如，在驾驶者的脸部皱眉或扭曲的情况下，分析为驾驶者的健康发生异常，或可通过驾驶者眼球的移动、眨眼、闭眼而分析驾驶者的困倦状态。具体地，在驾驶者眼球上下左右频繁地移动的情况下，分析为困倦状态，在驾驶者的眨眼缓慢的情况下，分析为打盹状态，在驾驶者闭上眼睛的情况下，分析为睡眠状态。
在步骤S220中分析的驾驶者状态不是正常时，通过驾驶员不注意警报装置30而对驾驶者的不注意发出警报(S232)。此时，驾驶员不注意警报装置30接收电子控制装置20的控制信号而随着时间的经过，分阶段地执行通过视觉的1次警报、通过视觉及听觉的2次警报、通过视觉、听觉及触觉(例如，转向轮振动)的3次警报。
即便发出了步骤S232的警报，但还继续检测不到驾驶者的行驶意志的情况下(例如，在一定时间期间未发生驾驶者眼球的移动，未检测到驾驶者的转向操作、加速操作、制动操作的情况下)，通过车辆动力学传感器12、车辆全方位监视照相机13、车辆周边监视传感器14及导航仪15而识别车辆后侧方及车辆周边对象信息，并分析前方行驶路径来判断能否移动到路肩，在能够移动的情况下，控制车辆移动到路肩之后停车，在无法移动的情况下，在判断车辆后方冲撞危险之后，将车辆控制为进行减速及停车(S234)。关于将车辆控制为移动到路肩之后停车的方法，将参照图3及图4而进行更详细的说明。
在步骤S220中分析的驾驶者状态为正常的情况下，分析驾驶者眼球(S242)，并基于驾驶者眼球的移动来控制车辆(S244)。关于分析驾驶者眼球的方法，将参照图5而进行详细的说明。
图3是概略性地示出本发明的优选实施例的将车辆控制为移动到路肩之后停车的方法的过程的流程图，图4以图像来示出根据本发明的优选实施例来将车辆移动到路肩的方法。
如图3所示，在即便执行了驾驶者不注意警报，但还继续检测不到驾驶者的行驶意志的情况下，检测要将车辆移动的路肩(S310)。关于此，当从导航仪15接收到前方路肩存在信息，从本车辆到路肩开始地点为止的纵向/横向的距离、从本车辆到路肩末端地点为止的纵向/横向的距离或通过车辆全方位监视照相机13而识别到右侧实线车道线及旁边车道的道路的边缘时，视为存在路肩。
之后，掌握本车辆的目前位置(S320)。关于此，利用从导航仪15接收的从本车辆到路肩开始地点为止的横向距离而确认本车辆的目前位置是否为路肩旁边车道，在从本车辆到路肩开始地点为止的横向距离为一定距离以下的情况下，将本车辆的目前位置视为路肩旁边车道。或者当通过车辆全方位监视照相机13的识别信息而识别到旁边车道的道路边缘时，可判断为本车辆在路肩旁边车道行驶。
并且，在步骤S320中判断为本车辆未在路肩旁边车道行驶时，通过车辆动力学传感器12、车辆全方位监视照相机13及车辆周边监视传感器14而识别车辆后方及车辆周边对象信息来判断能否变更车道，在能够变更车道的情况下，将车道变更为旁边车道(S322)。
在通过步骤S320或步骤S322而本车辆在路肩旁边车道行驶时，计算路肩车道的宽度而确认路肩车道的宽度是否为能够进行车辆停放的程度(例如，最小2.8m以上)(S330)。
在步骤S330中路肩车道宽度为能够进行车辆停放的程度的情况下，利用车辆动力学传感器12、车辆全方位监视照相机13及车辆周边监视传感器14而检测是否存在路肩行驶车辆(S340)。
根据步骤S340的结果，利用从导航仪15接收的从本车辆到路肩末端地点为止的距离或车辆全方位监视照相机13所识别的道路边缘末端地点而计算停车地点(S350)。
最后，使车辆移动到在步骤S350中计算出的停车地点之后进行停车(S360)。
追加地，在S360之后点亮应急灯或将车辆信息、驾驶者信息、驾驶者状态信息传送到中央控制中心而请求调动控制中心救护车或警车。此时，确认驾驶者的健康信息之后，如果是具有健康病史的驾驶者，则可请求调动急救车，如果驾驶者在一定时间不站起，则可请求调动警车。
图5是概略性地示出根据本发明的优选实施例而分析驾驶者眼球的方法的过程的流程图。
如图5所示，当分析的驾驶者状态为正常时，首先在初期校正1次眼球零点(S510)。在此，存储左侧旁边车道、本车道、右侧旁边车道的前方注视时的照相机中的眼球位置。
之后，过滤驾驶者眼球的移动中的与车辆控制无关的单纯移动(S520)。关于此，通过如下步骤而实现：向车辆全方位监视照相机13发送驾驶者目前注视位置信息(S522)，并通过车辆全方位监视照相机13而检测驾驶者注视区域内的对象之后(S524)，在检测出的对象不是车道线或车道的情况下，判断为与车辆控制无关的单纯移动(S526)。
最后，从驾驶者眼球的移动中检测车辆控制请求移动(S530)。关于此，在步骤S520中，在判断为并非与车辆控制无关的单纯移动，并在驾驶者注视区域内检测出车道，并且当驾驶者眼球在一定时间注视移动车道线区域时，判断为车辆控制请求移动，可执行车道变更控制。或者通过驾驶者眼球的瞳孔扩大等驾驶者眼球的移动而检测到驾驶者的惊吓的情况下，可执行车辆制动控制。
以上通过几个实施例来对本发明进行了更详细的说明，但本发明不限于这样的实施例，在不脱离本发明的技术思想的范围内可进行各种变形实施。

Claims (14)

1.一种车辆控制方法，包括如下步骤：
通过驾驶者监视照相机而获得驾驶者的脸部及眼球的影像来识别驾驶者监视信息；
利用所识别的所述驾驶者监视信息来分析驾驶者状态；及
在判断为所分析的所述驾驶者状态不正常、且驾驶者没有行驶意志的情况下，将车辆控制为移动到路肩并停车。
2.根据权利要求1所述的车辆控制方法，其中，
将所述车辆控制为移动到路肩并停车的步骤包括如下步骤：
在所分析的所述驾驶者状态不正常时对驾驶者的不注意发出警报；
在即便发出了所述警报也未检测到驾驶者的行驶意志的情况下，判断能否向路肩移动；及
在能够向路肩移动的情况下，将车辆控制为移动到路肩之后进行停车，在不能向路肩移动的情况下，将车辆控制为进行减速及停车。
3.根据权利要求2所述的车辆控制方法，其中，
将所述车辆控制为移动到路肩之后进行停车的步骤包括如下步骤：
检测能够供所述车辆移动的路肩；
掌握所述车辆的目前位置是否为路肩旁边车道：
确认路肩车道的宽度是否为能够进行车辆停放的程度；
检测是否存在路肩行驶车辆；
在未检测到路肩行驶车辆时计算路肩停车地点；及
使车辆移动到计算出的所述路肩停车地点之后进行停车。
4.根据权利要求3所述的车辆控制方法，其中，
所述车辆控制方法还包括如下步骤：
在掌握到所述车辆的目前位置不是路肩旁边车道时，使所述车辆将车道变更为所述路肩旁边车道。
5.根据权利要求3或4所述的车辆控制方法，其中，
检测能够供所述车辆移动的路肩的步骤包括：
当从导航仪接收到前方路肩存在信息、自所述车辆到路肩开始地点为止的纵向/横向距离或自所述车辆到路肩末端地点为止的纵向/横向距离时检测路肩的步骤；或
当通过车辆全方位监视照相机而识别右侧实线车道线及旁边车道道路边缘时检测路肩的步骤。
6.根据权利要求3或4所述的车辆控制方法，其中，
掌握所述车辆的目前位置是否为路肩旁边车道的步骤包括如下步骤：
从导航仪接收自所述车辆到路肩开始地点为止的横向距离；及
在接收的自所述车辆到路肩开始地点为止的横向距离为一定距离以下的情况下，掌握为所述车辆的目前位置是路肩旁边车道。
7.根据权利要求3或4所述的车辆控制方法，其中，
将车道变更为所述路肩旁边车道的步骤包括如下步骤：
通过车辆动力学传感器、车辆全方位监视照相机及车辆周边监视传感器而识别车辆后方及车辆周边对象信息来判断能否变更车道；及
在能够变更车道的情况下，将车道变更为所述路肩旁边车道。
8.根据权利要求3或4所述的车辆控制方法，其中，
计算所述路肩停车地点的步骤包括如下步骤：
利用自所述车辆到路肩末端地点为止的距离或道路边缘末端地点而计算所述路肩停车地点。
9.根据权利要求1至4中的任一项所述的车辆控制方法，其中，
所述车辆控制方法还包括：
点亮应急灯的步骤；或
将车辆信息、驾驶者信息及驾驶者状态信息传送到中央控制中心而请求调动控制中心救护车或警车的步骤。
10.根据权利要求1所述的车辆控制方法，其中，
所述车辆控制方法包括如下步骤：
在所分析的所述驾驶者状态为正常的情况下，分析驾驶者眼球而基于驾驶者眼球的移动来控制车辆。
11.根据权利要求10所述的车辆控制方法，其中，
分析所述驾驶者眼球的步骤包括如下步骤：
校正驾驶者眼球的零点；
过滤驾驶者眼球的移动中的与车辆控制无关的单纯移动；及
从所述驾驶者眼球的移动中检测车辆控制请求移动。
12.根据权利要求11所述的车辆控制方法，其中，
校正所述驾驶者眼球的零点的步骤包括如下步骤：
在注视左侧旁边车道、本车道、右侧旁边车道的前方时，存储照相机中的驾驶者眼球的位置。
13.根据权利要求11或12所述的车辆控制方法，其中，
过滤所述单纯移动的步骤包括如下步骤：
向车辆全方位监视照相机发送驾驶者目前注视位置信息；
通过所述车辆全方位监视照相机而在驾驶者注视区域内检测对象；及
在检测出的所述对象不是车道线或车道的情况下，判断为所述单纯移动。
14.根据权利要求11所述的车辆控制方法，其中，
检测所述车辆控制请求移动的步骤包括：
当判断为不是所述单纯移动、并在驾驶者注视区域内检测出车道、并且驾驶者眼球在一定时间注视移动车道线区域时，判断为车辆控制请求移动的步骤；或
在驾驶者眼球的瞳孔被扩大的情况下，判断为车辆控制请求移动的步骤。
CN201811294808.XA 2017-11-03 2018-11-01 基于驾驶者状态的车辆控制系统及方法 Active CN109747649B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2017-0146215 2017-11-03
KR1020170146215A KR20190050633A (ko) 2017-11-03 2017-11-03 운전자 상태 기반 차량 제어 시스템 및 방법

Publications (2)

Publication Number Publication Date
CN109747649A true CN109747649A (zh) 2019-05-14
CN109747649B CN109747649B (zh) 2023-05-23

Family

ID=64172248

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811294808.XA Active CN109747649B (zh) 2017-11-03 2018-11-01 基于驾驶者状态的车辆控制系统及方法

Country Status (4)

Country Link
US (1) US11787408B2 (zh)
EP (1) EP3489066B1 (zh)
KR (1) KR20190050633A (zh)
CN (1) CN109747649B (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111976559A (zh) * 2020-07-08 2020-11-24 好孩子儿童用品有限公司 一种基于机器感知的儿童安全乘坐系统
CN112758094A (zh) * 2021-01-04 2021-05-07 重庆长安汽车股份有限公司 一种驾驶辅助系统安全停车装置及方法
CN113879331A (zh) * 2020-07-01 2022-01-04 丰田自动车株式会社 驾驶计划装置、存储介质以及驾驶计划方法
CN114103960A (zh) * 2020-07-29 2022-03-01 现代摩比斯株式会社 用于监视驾驶员的系统和方法

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6926957B2 (ja) * 2017-11-02 2021-08-25 トヨタ自動車株式会社 車線変更支援装置
JP7158655B2 (ja) * 2018-08-28 2022-10-24 マツダ株式会社 停車支援装置
EP3654311B1 (en) * 2018-11-16 2023-11-15 Honda Research Institute Europe GmbH Method for assisting a driver of an ego-vehicle in making use of a gap between vehicles, corresponding driver assistance system and vehicle equipped with such driver assistance system
DE102019209283A1 (de) * 2019-06-26 2020-12-31 Robert Bosch Gmbh Verfahren zum Aktivieren zumindest einer sicherheitsrelevanten Funktion für ein Fahrzeug
US20200139991A1 (en) * 2019-08-23 2020-05-07 Lg Electronics Inc. Electronic device for vehicle and operating method of electronic device for vehicle
KR20210042188A (ko) * 2019-10-08 2021-04-19 현대자동차주식회사 차량 및 그 제어방법
JP7470510B2 (ja) * 2019-12-02 2024-04-18 ダイムラー トラック エージー 車両制御装置、車両制御方法、及び車両制御プログラム
CN111016902B (zh) * 2019-12-30 2021-07-06 重庆长安汽车股份有限公司 一种车辆换道时的车速辅助控制方法、系统及汽车
US11511576B2 (en) * 2020-01-24 2022-11-29 Ford Global Technologies, Llc Remote trailer maneuver assist system
US11745733B2 (en) * 2020-01-27 2023-09-05 Mazda Motor Corporation Travel control apparatus for vehicle, vehicle controlling method and computer program therefor
KR20210124603A (ko) * 2020-04-06 2021-10-15 현대자동차주식회사 차량의 자율 주행 제어 장치, 그를 포함한 시스템 및 그 방법
CN111557673A (zh) * 2020-04-22 2020-08-21 五邑大学 一种汽车驾驶监控方法、系统及存储介质
KR20220002800A (ko) 2020-06-30 2022-01-07 현대모비스 주식회사 운전자 부주의 경고 장치 및 방법
KR102440255B1 (ko) * 2020-08-14 2022-09-07 주식회사 에이치엘클레무브 운전자 보조 시스템 및 그 제어 방법
KR20230056134A (ko) * 2021-10-19 2023-04-27 현대모비스 주식회사 운전자를 이중으로 보호하기 위한 방법 및 장치
KR20230072580A (ko) 2021-11-17 2023-05-25 현대모비스 주식회사 운전자의 생물학적 상태 분석에 기반한 부주의 판단방식 및 이를 활용한 스마트 크루즈 컨트롤 연계 시스템, 운전자의 생물학적 상태 분석에 기반한 부주의 판단방식 및 이를 활용한 스마트 크루즈 컨트롤 연계 방법
FR3129342B1 (fr) * 2021-11-19 2023-10-06 Psa Automobiles Sa Procédé de sécurisation de l’immobilisation d’un véhicule automobile à la suite d’une commande de freinage du véhicule.
JP7610039B2 (ja) * 2021-12-15 2025-01-07 株式会社Subaru 運転支援装置及びコンピュータプログラム並びにコンピュータプログラムを記録した記録媒体
CN114228734B (zh) * 2021-12-29 2022-08-19 慧之安信息技术股份有限公司 一种基于深度学习的自动提醒方法和装置
US11541910B1 (en) * 2022-01-07 2023-01-03 Plusai, Inc. Methods and apparatus for navigation of an autonomous vehicle based on a location of the autonomous vehicle relative to shouldered objects
JP7537450B2 (ja) * 2022-02-04 2024-08-21 トヨタ自動車株式会社 車両制御装置、車両制御方法及び車両制御用コンピュータプログラム
JP7589703B2 (ja) * 2022-03-14 2024-11-26 トヨタ自動車株式会社 車両制御装置
US11840257B2 (en) * 2022-03-25 2023-12-12 Embark Trucks Inc. Lane change determination for vehicle on shoulder
JP7441258B2 (ja) * 2022-03-25 2024-02-29 本田技研工業株式会社 制御装置
CN114743184A (zh) * 2022-06-10 2022-07-12 航天科技控股集团股份有限公司 一种驾驶员驾驶状态预警系统

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19803158C1 (de) * 1998-01-28 1999-05-06 Daimler Chrysler Ag Vorrichtung zur Vigilanzzustandsbestimmung
US20030229447A1 (en) * 2002-06-11 2003-12-11 Motorola, Inc. Lane position maintenance apparatus and method
JP2007331652A (ja) * 2006-06-16 2007-12-27 Toyota Motor Corp 車両停止装置
US20110178680A1 (en) * 2009-09-09 2011-07-21 Yumiko Kato Vehicle control device and vehicle control method
DE102011086241A1 (de) * 2011-11-14 2013-05-16 Robert Bosch Gmbh Verfahren zum sicheren Abstellen eines Fahrzeuges
EP2657921A1 (de) * 2012-04-21 2013-10-30 Volkswagen Aktiengesellschaft Verfahren und Vorrichtung zum Nothalt eines Kraftfahrzeugs
US20140078282A1 (en) * 2012-09-14 2014-03-20 Fujitsu Limited Gaze point detection device and gaze point detection method
US20150158427A1 (en) * 2013-12-09 2015-06-11 Kyungpook National University Industry-Academic Cooperation Foundation Vehicle control system for providing warning message and method thereof
JP2015207163A (ja) * 2014-04-21 2015-11-19 株式会社デンソー 状態推定装置、および状態推定プログラム
US20170088165A1 (en) * 2015-09-29 2017-03-30 GM Global Technology Operations LLC Driver monitoring
DE102015220356A1 (de) * 2015-10-20 2017-04-20 Robert Bosch Gmbh Verfahren zur Auswahl einer optimierten Fahrtrajektorie
US20170158054A1 (en) * 2014-08-22 2017-06-08 Denso Corporation In-vehicle control apparatus
CN107209999A (zh) * 2015-02-10 2017-09-26 株式会社电装 退避控制装置以及退避控制方法
US20170285741A1 (en) * 2016-04-01 2017-10-05 Lg Electronics Inc. Vehicle control apparatus and method thereof

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4337131B2 (ja) * 1999-06-10 2009-09-30 マツダ株式会社 移動体制御装置
JP4564320B2 (ja) * 2004-09-29 2010-10-20 アイシン精機株式会社 ドライバモニタシステム
JP4798127B2 (ja) * 2007-12-20 2011-10-19 トヨタ自動車株式会社 緊急退避システム、緊急退避方法
JP2009280015A (ja) 2008-05-20 2009-12-03 Toyota Motor Corp 操舵制御装置
US8618922B2 (en) * 2010-03-30 2013-12-31 GM Global Technology Operations LLC Method and system for ensuring operation of limited-ability autonomous driving vehicles
KR101901417B1 (ko) 2011-08-29 2018-09-27 한국전자통신연구원 감성기반 안전운전 자동차 서비스 시스템, 안전운전 서비스를 위한 감성인지 처리 장치 및 안전운전 서비스 장치, 감성기반 차량용 안전운전 서비스 방법
KR101927155B1 (ko) * 2012-10-19 2018-12-10 현대자동차 주식회사 도로 갓길의 공간 인지 방법 및 시스템
US9751534B2 (en) * 2013-03-15 2017-09-05 Honda Motor Co., Ltd. System and method for responding to driver state
KR101470190B1 (ko) 2013-07-09 2014-12-05 현대자동차주식회사 자율주행 시스템의 고장 처리 장치 및 그 방법
US9523984B1 (en) * 2013-07-12 2016-12-20 Google Inc. Methods and systems for determining instructions for pulling over an autonomous vehicle
DE102013012122B4 (de) * 2013-07-19 2015-02-05 Audi Ag Verfahren zum Betreiben eines Fahrerassistenzsystems eines Kraftwagens und Fahrerassistenzsystem für einen Kraftwagen
JP6136714B2 (ja) 2013-07-30 2017-05-31 トヨタ自動車株式会社 車両制御装置
JP6374695B2 (ja) 2014-04-28 2018-08-15 日立建機株式会社 路肩検出システムおよび鉱山用運搬車両
DE102014225383A1 (de) * 2014-12-10 2016-06-16 Robert Bosch Gmbh Verfahren zum Betreiben eines Kraftfahrzeugs, Kraftfahrzeug
KR101895485B1 (ko) * 2015-08-26 2018-09-05 엘지전자 주식회사 운전 보조 장치 및 그 제어 방법
JP6256433B2 (ja) 2015-08-31 2018-01-10 マツダ株式会社 運転者状態検出装置
US20180208209A1 (en) * 2015-09-08 2018-07-26 Apple Inc. Comfort profiles
JP6641916B2 (ja) * 2015-11-20 2020-02-05 オムロン株式会社 自動運転支援装置、自動運転支援システム、自動運転支援方法および自動運転支援プログラム
KR101806631B1 (ko) 2015-12-02 2017-12-07 현대자동차주식회사 혈류량 신호 기반 운전자 상태 판단 장치 및 방법
US10246086B2 (en) * 2016-09-08 2019-04-02 Ford Global Technologies, Llc Echelon parking
US20180093675A1 (en) * 2016-09-30 2018-04-05 Ford Global Technologies, Llc Wake Alarm For Vehicles With An Autonomous Mode
US10241511B2 (en) * 2016-11-03 2019-03-26 Ford Global Technologies, Llc Emergency evacuation using autonomous driving
CN109923597A (zh) * 2016-11-18 2019-06-21 三菱电机株式会社 驾驶辅助装置及驾驶辅助方法
EP3549525A4 (en) * 2016-11-30 2019-12-18 Sony Corporation INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING PROCESS AND PROGRAM
KR20180091357A (ko) * 2017-02-06 2018-08-16 한국전자통신연구원 추측 항법을 이용한 자율주행 차량의 제어 방법 및 장치
US10139831B2 (en) * 2017-03-17 2018-11-27 Denso International America, Inc. Vehicle system and vehicle controller for controlling vehicle
TWI653170B (zh) * 2017-11-01 2019-03-11 宏碁股份有限公司 駕駛提示方法與系統
JP6926957B2 (ja) * 2017-11-02 2021-08-25 トヨタ自動車株式会社 車線変更支援装置

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19803158C1 (de) * 1998-01-28 1999-05-06 Daimler Chrysler Ag Vorrichtung zur Vigilanzzustandsbestimmung
US20030229447A1 (en) * 2002-06-11 2003-12-11 Motorola, Inc. Lane position maintenance apparatus and method
JP2007331652A (ja) * 2006-06-16 2007-12-27 Toyota Motor Corp 車両停止装置
US20110178680A1 (en) * 2009-09-09 2011-07-21 Yumiko Kato Vehicle control device and vehicle control method
US20150006012A1 (en) * 2011-11-14 2015-01-01 Robert Bosch Gmbh Method for Safely Parking a METHOD FOR SAFELY PARKING A VEHICLE IN AN EMERGENCY SITUATION
DE102011086241A1 (de) * 2011-11-14 2013-05-16 Robert Bosch Gmbh Verfahren zum sicheren Abstellen eines Fahrzeuges
EP2657921A1 (de) * 2012-04-21 2013-10-30 Volkswagen Aktiengesellschaft Verfahren und Vorrichtung zum Nothalt eines Kraftfahrzeugs
US20140078282A1 (en) * 2012-09-14 2014-03-20 Fujitsu Limited Gaze point detection device and gaze point detection method
US20150158427A1 (en) * 2013-12-09 2015-06-11 Kyungpook National University Industry-Academic Cooperation Foundation Vehicle control system for providing warning message and method thereof
JP2015207163A (ja) * 2014-04-21 2015-11-19 株式会社デンソー 状態推定装置、および状態推定プログラム
US20170158054A1 (en) * 2014-08-22 2017-06-08 Denso Corporation In-vehicle control apparatus
CN107209999A (zh) * 2015-02-10 2017-09-26 株式会社电装 退避控制装置以及退避控制方法
US20170088165A1 (en) * 2015-09-29 2017-03-30 GM Global Technology Operations LLC Driver monitoring
DE102015220356A1 (de) * 2015-10-20 2017-04-20 Robert Bosch Gmbh Verfahren zur Auswahl einer optimierten Fahrtrajektorie
US20170285741A1 (en) * 2016-04-01 2017-10-05 Lg Electronics Inc. Vehicle control apparatus and method thereof

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113879331A (zh) * 2020-07-01 2022-01-04 丰田自动车株式会社 驾驶计划装置、存储介质以及驾驶计划方法
CN111976559A (zh) * 2020-07-08 2020-11-24 好孩子儿童用品有限公司 一种基于机器感知的儿童安全乘坐系统
CN114103960A (zh) * 2020-07-29 2022-03-01 现代摩比斯株式会社 用于监视驾驶员的系统和方法
CN112758094A (zh) * 2021-01-04 2021-05-07 重庆长安汽车股份有限公司 一种驾驶辅助系统安全停车装置及方法
CN112758094B (zh) * 2021-01-04 2023-01-06 重庆长安汽车股份有限公司 一种驾驶辅助系统安全停车装置及方法

Also Published As

Publication number Publication date
KR20190050633A (ko) 2019-05-13
EP3489066A2 (en) 2019-05-29
US20190135291A1 (en) 2019-05-09
EP3489066A3 (en) 2019-09-04
EP3489066B1 (en) 2024-07-17
US11787408B2 (en) 2023-10-17
CN109747649B (zh) 2023-05-23

Similar Documents

Publication Publication Date Title
CN109747649A (zh) 基于驾驶者状态的车辆控制系统及方法
US12077192B2 (en) Automatic driving control device and automatic driving control method, and program
JP6641916B2 (ja) 自動運転支援装置、自動運転支援システム、自動運転支援方法および自動運転支援プログラム
US8666644B2 (en) Drive assistance apparatus
WO2014148025A1 (ja) 走行制御装置
KR20150143139A (ko) 차량용 운전자 위험 지수 관리 시스템 및 그 방법
CN104599530A (zh) 用于机动车的驾驶员辅助系统
CN111976594B (zh) 用于控制无人车的方法和装置
US12080082B2 (en) Act-of-looking-aside determination device
US20240075960A1 (en) Device and method for notifying vehicle arrival to respond to transportation vulnerable
JP2018022330A (ja) 公共車両制御装置
KR20230130949A (ko) 고속 도로 톨게이트를 주행하는 차량 및 그 제어 방법
KR20230133994A (ko) 표지판 정보를 인식하는 차량 및 그 제어 방법
KR20230087671A (ko) 오브젝트 충돌 방지 방법 및 장치

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20211202

Address after: Gyeonggi Do, South Korea

Applicant after: Wandu Mobile System Co.,Ltd.

Address before: Gyeonggi Do, South Korea

Applicant before: MANDO Corp.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220929

Address after: Inchon, Korea

Applicant after: Halla Creedong Electronics Co.,Ltd.

Address before: Gyeonggi Do, South Korea

Applicant before: Wandu Mobile System Co.,Ltd.

GR01 Patent grant
GR01 Patent grant