[go: up one dir, main page]

US20170253237A1 - Vehicle vision system with automatic parking function - Google Patents

Vehicle vision system with automatic parking function Download PDF

Info

Publication number
US20170253237A1
US20170253237A1 US15/446,218 US201715446218A US2017253237A1 US 20170253237 A1 US20170253237 A1 US 20170253237A1 US 201715446218 A US201715446218 A US 201715446218A US 2017253237 A1 US2017253237 A1 US 2017253237A1
Authority
US
United States
Prior art keywords
vehicle
parking
location
control
responsive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/446,218
Inventor
Horst D. Diessner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magna Electronics Inc
Original Assignee
Magna Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magna Electronics Inc filed Critical Magna Electronics Inc
Priority to US15/446,218 priority Critical patent/US20170253237A1/en
Assigned to MAGNA ELECTRONICS INC. reassignment MAGNA ELECTRONICS INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DIESSNER, Horst D.
Publication of US20170253237A1 publication Critical patent/US20170253237A1/en
Priority to US15/929,843 priority patent/US11400919B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/06Automatic manoeuvring for parking
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/02Conjoint control of vehicle sub-units of different type or different function including control of driveline clutches
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/04Conjoint control of vehicle sub-units of different type or different function including control of propulsion units
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/18Conjoint control of vehicle sub-units of different type or different function including control of braking systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/20Conjoint control of vehicle sub-units of different type or different function including control of steering systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0011Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement
    • G05D1/0033Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots associated with a remote control arrangement by having the operator tracking the vehicle either by direct line of sight or via one or more cameras located remotely from the vehicle
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0221Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving a learning process
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • B60W2550/10
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/20Static objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/40Dynamic objects, e.g. animals, windblown objects
    • B60W2554/402Type
    • B60W2554/4029Pedestrians
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/80Spatial relation or speed relative to objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00Input parameters relating to data
    • B60W2600/00

Definitions

  • the present invention relates generally to a vehicle vision system for a vehicle and, more particularly, to a vehicle vision system that utilizes one or more cameras at a vehicle.
  • the present invention provides a driver assistance system or vision system or imaging system for a vehicle that utilizes one or more exterior sensors, such as cameras and/or ultrasonic sensors and/or radar sensors or the like to capture data representative of the vehicle surroundings, and provides an autonomous parking feature that controls the vehicle to park the vehicle at a targeted parking location.
  • the system may provide a home parking function, where the system can record or learn a path for the vehicle to travel from a drop off location (such as by a front door of a house) to a parking location (such as in a garage of the house). The system can then follow the recorded path to park the vehicle after the driver has exited the vehicle at the drop off location.
  • the system may provide a valet parking feature, where the system may autonomously control the vehicle to drive the vehicle through a parking structure to a parking space or zone.
  • FIG. 1 is a plan view of a vehicle with a vehicle parking system that incorporates cameras and/or other exterior sensors in accordance with the present invention
  • FIG. 2 is a schematic showing system architecture of the parking system of the present invention
  • FIG. 3 is another schematic showing system architecture of the parking system of the present invention, shown using cameras and image processing;
  • FIG. 4 is a block diagram of a remote control system for controlling the parking system of the present invention, showing a display screen that shows the vehicle as it is being automatically or remotely driven in accordance with the present invention;
  • FIGS. 5-8 are plan views of a parking scenario for a home parking system of the present invention.
  • FIGS. 9-12 are plan views of a parking scenario for a valet parking system of the present invention.
  • FIG. 13 is a schematic showing system architecture of the parking system of the present invention.
  • FIG. 14 is another schematic showing system architecture of the parking system of the present invention.
  • a vehicle vision system and/or parking system and/or driver assist system and/or object detection system and/or alert system operates to capture images exterior of the vehicle and may process the captured image data to display images and to detect objects at or near the vehicle and in the predicted path of the vehicle, such as to assist a driver of the vehicle in maneuvering the vehicle in a rearward direction.
  • the vision system includes an image processor or image processing system that is operable to receive image data from one or more cameras and provide an output to a display device for displaying images representative of the captured image data.
  • the vision system may provide display, such as a rearview display or a top down or bird's eye or surround view display or the like.
  • a vehicle 10 includes a vehicle parking system 12 that includes at least one exterior facing sensor or imaging sensor or camera, such as a rearward facing imaging sensor or camera 14 a (and the system may optionally include multiple exterior facing imaging sensors or cameras, such as a forward facing camera 14 b at the front (or at the windshield) of the vehicle, and a sideward/rearward facing camera 14 c, 14 d at respective sides of the vehicle), which captures images exterior of the vehicle, with the camera having a lens for focusing images at or onto an imaging array or imaging plane or imager of the camera ( FIG. 1 ).
  • a rearward facing imaging sensor or camera 14 a and the system may optionally include multiple exterior facing imaging sensors or cameras, such as a forward facing camera 14 b at the front (or at the windshield) of the vehicle, and a sideward/rearward facing camera 14 c, 14 d at respective sides of the vehicle
  • the camera having a lens for focusing images at or onto an imaging array or imaging plane or imager of the camera ( FIG. 1 ).
  • a forward viewing camera may be disposed at the windshield of the vehicle and view through the windshield and forward of the vehicle, such as for a machine vision system (such as for traffic sign recognition, headlamp control, pedestrian detection, collision avoidance, lane marker detection and/or the like).
  • the parking system 12 includes a control or electronic control unit (ECU) or processor 18 that is operable to process image data captured by the camera or cameras and may detect objects or the like and/or provide displayed images at a display device 16 for viewing by the driver of the vehicle (although shown in FIG. 1 as being part of or incorporated in or at an interior rearview mirror assembly 20 of the vehicle, the control and/or the display device may be disposed elsewhere at or in the vehicle).
  • the data transfer or signal communication from the camera to the ECU may comprise any suitable data or communication link, such as a vehicle network bus or the like of the equipped vehicle.
  • the present invention provides an automatic parking system that will “valet park” a vehicle by driving or controlling the vehicle from a location where the driver and passenger may be dropped off to a parking space a relatively short distance away.
  • the system includes a plurality of sensors, such as multiple (e.g., about 12 ) ultrasonic sensors or the like, and an embedded ECU for ultrasonic park assist (UPA) functions and for ultrasonic park space detection (UPSD) functions (see FIG. 2 ).
  • the system may include CarPC using AppControl for evaluation of UPA and UPSD data for collision detection, free space detection and free space detection manager functions, and may include CarPC using AppControl for CAN based EgoMotion functions.
  • the system may include Microautobox for path planner and vehicle control functions, and may include Microautobox for all application functions such as reference time generator and human-machine interface (HMI) control, and may include Microautobox for communication with the vehicle using Flexray or the like.
  • the embedded ECU, CarPC and Microautobox may communicate using a local CAN bus of the vehicle.
  • the vehicle parking system may include or utilize cameras and machine vision algorithm blocks for surround view systems (SVS) or rear vision camera (RVC) systems and ultrasonic autopark, and may include motion estimation, image classifier, contrast+block entropy, line detection, structure from motion and/or object detection (see FIG. 3 ).
  • SVS surround view systems
  • RVC rear vision camera
  • ultrasonic autopark may include motion estimation, image classifier, contrast+block entropy, line detection, structure from motion and/or object detection (see FIG. 3 ).
  • the parking system of the present invention may use a remote control application running on mobile device (see FIG. 4 ).
  • the remote control app should allow the user to execute an automated vehicle maneuver by holding down a button while the driver is outside the vehicle, and to maneuver the vehicle manually forward/backward, left/right (like a remote control car).
  • the system may display the system status/obstacle information, distances to objects on the app display and/or images captured by one or more cameras of the vehicle or of the structure where the vehicle is being parked (such as via a vehicle-to-infrastructure communication or the like).
  • the remote control app may be generic in order to support re-use in various projects such as an auto-park system and/or a home zone parking system and/or a trailer backup assist system or the like.
  • the parking system of the present invention may be operable as a home zone parking system that allows a user or driver to get out of the vehicle (such as at a driveway near the front door of the house), whereby the system will autonomously drive the vehicle from the drop off location to the parking location, such as into the garage or the like (see FIGS. 5-8 ).
  • the system allows for learning or recording of a parking maneuver while the driver is controlling the vehicle (such as responsive to the driver actuating a user input to commence the learning function when the vehicle is at a start or drop off location), for example driving and parking of a vehicle from the entrance door of a house to a designated parking location, and then replaying or re-enacting the parking maneuver without a driver in the vehicle, where the parking system controls the vehicle during the maneuver.
  • the driver when the vehicle is positioned at a drop off location (such as at or near the door of a house), may actuate the learning feature of the system (via actuation of a first user input when the vehicle is at a start or drop off location), and then the driver may drive the vehicle from the drop off location to the parking location (such as at or in a garage).
  • a drop off location such as at or near the door of a house
  • the driver may actuate the learning feature of the system (via actuation of a first user input when the vehicle is at a start or drop off location), and then the driver may drive the vehicle from the drop off location to the parking location (such as at or in a garage).
  • the driver may exit the vehicle and actuate the parking feature (such as via actuation of a second user input of the vehicle when the driver is exiting the vehicle at a start or drop off location or via actuation of a remote device or key fob or the like when the vehicle is at a start or drop off location), whereby the control drives the vehicle (following the previously learned path) from the drop off location to the parking location.
  • the parking feature such as via actuation of a second user input of the vehicle when the driver is exiting the vehicle at a start or drop off location or via actuation of a remote device or key fob or the like when the vehicle is at a start or drop off location
  • the system utilizes object detection using cameras, UPA (and radar) sensors during the replay or autonomous parking/driving maneuver in order to avoid collisions and control the vehicle along the learned path (see FIGS. 6-8 ).
  • the system allows for dynamic adjustment of the recorded path in order adjust for variation of the vehicle start position and to reach the exact end position ( FIGS. 7 and 8 ).
  • the system allows for dynamic adjustment of the recorded path in order for the vehicle to maneuver around temporary objects on the path (see FIG. 8 ).
  • the system thus may provide a static record and replay without object detection and dynamic path adjustment, such as for a controlled environment, with only static objects present (no other moving vehicles), no pedestrians present ( FIG. 5 ).
  • FIG. 5 there are no objects present on the path (path is clear), so the system can record path data while the driver is maneuvering the vehicle to the parking position, with the vehicle control limited to maneuvering in one direction (such as only forward maneuvers), with a targeted maximum path length of less than 50 m, preferably less than about 30 m, and a maximum speed of less than about 10 km/h during the recording phase.
  • the maximum speed may be further reduced, such as less than about 5 km/h during the replay.
  • the system may provide enhanced control of the vehicle by providing for static record and replay with object detection and without dynamic path adjustment ( FIG. 6 ).
  • the vehicle is in a controlled environment, with only static objects present (no other moving vehicles), no pedestrians present.
  • the system may record path data while the driver is maneuvering to the parking position, and may limit the maneuvering to forward and reverse maneuvers (such as 3 sweeps), with a maximum path length of less than 50 m, preferably less than about 30 m, and with a maximum speed of less than about 10 km/h during recording.
  • the system may perform object detection during the maneuver using cameras/UPA/Radar or the like, and will stop the vehicle if an object is detected in the path of travel of the vehicle. Upon detection of such an object, the system may stop or pause the vehicle maneuver until the object is removed, and then may resume the parking maneuver.
  • the system may provide for static record and replay with object detection and with dynamic path adjustment at the end of the path ( FIG. 7 ).
  • the vehicle is in a controlled environment, with only static objects present (no other moving vehicles), no pedestrians present.
  • the system may record path data while the driver is maneuvering to the parking position, and may limit the maneuvering to forward and reverse maneuvers (such as 3 sweeps), with a maximum path length of less than 50 m, preferably less than about 30 m, and with a maximum speed of less than about 10 km/h during recording.
  • the system records landmarks while the driver is maneuvering the vehicle (for example, the system may determine distances to edges of the driveway at certain points, or distances to the garage walls at the final parking position), such as at or near the end of the path (for example, the last five meters or thereabouts of the path).
  • the system may perform object detection during the maneuver using cameras/UPA/Radar and may stop the vehicle if an object is detected on the path of travel of the vehicle, whereby the system may stop or pause the vehicle maneuver until the determined object is removed, and then may resume the maneuver.
  • the system may dynamically adjust the maneuver at the end of the path in order to park the vehicle consistently in the same parking position.
  • the system may provide for static record and replay with object detection and with dynamic path adjustment during the entire maneuver ( FIG. 8 ).
  • the system may record landmarks in an environment map while the driver is maneuvering the vehicle (such as, for example, determining and recording distances to edges of the driveway at certain points, or distances to the garage walls at final parking position).
  • the system may perform object detection during the maneuver using cameras/UPA/Radar or the like and may stop the vehicle if an object is detected on the path of travel. If an obstacle is detected, the system may determine if the vehicle can maneuver around the object and may adjust the path if such maneuvering around is possible. The system may stop or pause the maneuver if maneuvering around is not possible, and then may resume the maneuver after the object is removed from the path.
  • the system may compare the recorded environment map and the current environment map and may modify the path in order to move the vehicle on the exact same path, and to compensate for differences in the start position of the vehicle (when the system commences control of the vehicle).
  • the end position shall be the same for every replay.
  • the system of the present invention may provide a valet parking function, where the system may park a vehicle at a public parking space after the driver has dropped himself or herself off at a desired location.
  • the desired location may be remote from the parking structure and the system may control the vehicle to follow a learned or predetermined path from the drop off location to an entrance of the parking structure (such as in a similar manner as discussed above).
  • the system allows for autonomous maneuvering of the vehicle from any point inside or in the vicinity of a parking structure (such as at an entrance to the parking structure) to a designated parking location inside the parking structure.
  • the system may include detection of available parking spaces in the vicinity of the designated parking location inside the parking structure using an autopark system that detects available parking spaces (such as by utilizing aspects of the systems described in U.S. Pat. No. 8,874,317 and/or U.S. Publication Nos. US-2017-0015312; US-2015-0158499; US-2015-0251599; US-2015-0124096; US-2015-0344028; US-2014-0375476 and/or US-2013-0116859, which are all hereby incorporated herein by reference in their entireties).
  • the system provides autonomous parking of the vehicle in the detected parking space.
  • the system provides predetermined static path maneuvers from a defined point inside a parking structure to a desired parking zone inside the parking structure on the same floor level followed by automated parking (see FIGS. 9-12 ).
  • the vehicle is in a controlled environment, with only static objects present (no other moving vehicles), no pedestrians present.
  • the system may include detection of static objects (parked vehicles, structural elements, guard rails, posts, and/or the like) using cameras and ultrasonic sensors.
  • the system may abort the maneuver if the system determines that the vehicle would collide with any static object, and may provide emergency braking in case the vehicle would collide with any static object.
  • the system may include a parking structure fingerprinting system to locate the vehicle during maneuver.
  • An autopark system of the vehicle may be activated as the vehicle approaches the end of the predetermined static path (the parking zone) and searches for open parking spaces.
  • the system stops the vehicle when the autopark system finds a parking space, and vehicle control is turned over to the autopark system, which parks the vehicle in the detected parking space.
  • the system may perform a predetermined static path maneuver from a defined point outside the parking structure to a desired parking zone inside the parking structure on the same floor level, followed by automated parking ( FIG. 10 ).
  • the system may function in a similar manner as described above, and may use GPS data for maneuvering the vehicle from its location outside the parking structure and then may switch to BLUETOOTH/Wi-Fi fingerprinting for vehicle localization and maneuvering inside the parking structure.
  • the path length outside the structure may be limited to a relatively short distance, such as less than about 100 meters, preferably less than about 50 meters or thereabouts.
  • the system may perform a predetermined static path maneuver with path adjustments from a defined point outside the parking structure to a desired area inside the parking structure on the same floor level followed by automated parking ( FIG. 11 ).
  • the system may function in a similar manner as described above, and may detect the drivable area while the vehicle is moving using machine vision (and radar sensors).
  • the valet parking system detects objects along the drivable area using ultrasonic sensors and detects lines using line detection algorithms. All of the detected and determined information is entered into an environment map, which is used to adjust or fine tune the predetermined vehicle path in order to maneuver the vehicle centered on the lane, with a constant distance from limits at the right vehicle side.
  • the system may perform a planned path maneuver with path adjustments from a defined point outside the parking structure to a desired area inside the parking structure on the same floor level followed by automated parking ( FIG. 12 ).
  • the system defines a layout of the parking structure (parking structure map), and the “smart parking structure” defines the area with free parking spaces (parking zone).
  • the valet parking system plans a path from the current vehicle position outside the parking structure to the parking zone using the parking structure map. This system adds the functionality of path planning to maneuver the vehicle to the parking zone, but the rest of the functionality is similar to that discussed above.
  • the system may learn a path from a common drop off location to a location inside a parking structure (such as described above) and then, when the vehicle is autonomously positioned at the location inside the parking structure, the system switches from following the learned path to being responsive to the parking structure layout/zones.
  • the system may utilize an indoor positioning system for underground (or not outside) parking structures.
  • the system may utilize absolute positioning via Bluetooth LE or WLAN or the like and relative positioning with vehicle sensors and optionally a navigation map.
  • the position fingerprinting system or function determines position of the vehicle by comparing the measured signal patterns with previously measured signal patterns in reference points.
  • the parking garage may have WLAN access points and/or 60 Bluetooth access points and a plurality of fingerprints, whereby the system can determine the vehicle's position within the garage via processing of signals from the access points.
  • the system may combine this information with data captured by vehicle sensors (and processed by a vehicle-based processor) to enhance the determination of the position of the vehicle.
  • the system may use CAN data and Kalman Filtering and/or Particle Filtering to enhance the position or location determination to enhance the vehicle's controlled path of travel when the system is autonomously controlling and parking the vehicle.
  • the system may extract map information for further enhancement.
  • the system may be adaptable to park a vehicle pulling a trailer, such as by utilizing various trailer angle detection systems and trailer assist systems of the types described in U.S. Pat. No. 9,085,261 and/or U.S. Publication Nos. US-2017-0050672; US-2015-0002670; US-2014-0160276; US-2012-0265416; US-2014-0085472 and/or US-2015-0217693, which are hereby incorporated herein by reference in their entireties.
  • the system may comprise simplified system architecture as shown in FIG. 14 . Additional signals/data flows may be required, and the system may utilize a sensor fusion map generation in CarPC or the like, and path planning in Microautobox (MAB) or the like.
  • MAB Microautobox
  • the camera or sensor may comprise any suitable camera or sensor.
  • the camera may comprise a “smart camera” that includes the imaging sensor array and associated circuitry and image processing circuitry and electrical connectors and the like as part of a camera module, such as by utilizing aspects of the vision systems described in International Publication Nos. WO 2013/081984 and/or WO 2013/081985, which are hereby incorporated herein by reference in their entireties.
  • the system includes an image processor operable to process image data captured by the camera or cameras, such as for detecting objects or other vehicles or pedestrians or the like in the field of view of one or more of the cameras.
  • the image processor may comprise an image processing chip selected from the EyeQ family of image processing chips available from Mobileye Vision Technologies Ltd. of Jerusalem, Israel, and may include object detection software (such as the types described in U.S. Pat. Nos. 7,855,755; 7,720,580 and/or 7,038,577, which are hereby incorporated herein by reference in their entireties), and may analyze image data to detect vehicles and/or other objects.
  • the system may generate an alert to the driver of the vehicle and/or may generate an overlay at the displayed image to highlight or enhance display of the detected object or vehicle, in order to enhance the driver's awareness of the detected object or vehicle or hazardous condition during a driving maneuver of the equipped vehicle.
  • the vehicle may include any type of sensor or sensors, such as imaging sensors or radar sensors or lidar sensors or ladar sensors or ultrasonic sensors or the like.
  • the imaging sensor or camera may capture image data for image processing and may comprise any suitable camera or sensing device, such as, for example, a two dimensional array of a plurality of photosensor elements arranged in at least 640 columns and 480 rows (at least a 640 ⁇ 480 imaging array, such as a megapixel imaging array or the like), with a respective lens focusing images onto respective portions of the array.
  • the photosensor array may comprise a plurality of photosensor elements arranged in a photosensor array having rows and columns.
  • the imaging array has at least 300,000 photosensor elements or pixels, more preferably at least 500,000 photosensor elements or pixels and more preferably at least 1 million photosensor elements or pixels.
  • the imaging array may capture color image data, such as via spectral filtering at the array, such as via an RGB (red, green and blue) filter or via a red/red complement filter or such as via an RCC (red, clear, clear) filter or the like.
  • the logic and control circuit of the imaging sensor may function in any known manner, and the image processing and algorithmic processing may comprise any suitable means for processing the images and/or image data.
  • the vision system and/or processing and/or camera and/or circuitry may utilize aspects described in U.S. Pat. Nos. 9,233,641; 9,146,898; 9,174,574; 9,090,234; 9,077,098; 8,818,042; 8,886,401; 9,077,962; 9,068,390; 9,140,789; 9,092,986; 9,205,776; 8,917,169; 8,694,224; 7,005,974; 5,760,962; 5,877,897; 5,796,094; 5,949,331; 6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978; 7,859,565; 5,550,677; 5,670,935
  • the system may communicate with other communication systems via any suitable means, such as by utilizing aspects of the systems described in International Publication Nos. WO/2010/144900; WO 2013/043661 and/or WO 2013/081985, and/or U.S. Pat. No. 9,126,525, which are hereby incorporated herein by reference in their entireties.
  • the system may also communicate with other systems, such as via a vehicle-to-vehicle communication system or a vehicle-to-infrastructure communication system or the like.
  • vehicle-to-vehicle communication system or a vehicle-to-infrastructure communication system or the like.
  • vehicle-to-vehicle communication system or a vehicle-to-infrastructure communication system or the like.
  • vehicle-to-vehicle communication system such as via a vehicle-to-vehicle communication system or a vehicle-to-infrastructure communication system or the like.
  • vehicle-to-vehicle communication system such as via a vehicle-to-vehicle communication system or a vehicle-to-infrastructure communication system or the like.
  • vehicle communication systems may utilize aspects of the systems described in U.S. Pat. Nos. 6,690,268; 6,693,517 and/or 7,580,795, and/or U.S. Publication Nos.
  • the system may utilize aspects of the parking assist systems described in U.S. Pat. No. 8,874,317 and/or U.S. Publication Nos. US-2017-0050672; US-2017-0017848; US-2017-0015312 and/or US-2015-0344028, and/or U.S. provisional applications, Ser. No. 62/335,248, filed May 12, 2016, and/or Ser. No. 62/330,558, filed May 2, 2016, which are hereby incorporated herein by reference in their entireties.
  • the vision system may include a display for displaying images captured by one or more of the imaging sensors for viewing by the driver of the vehicle while the driver is normally operating the vehicle.
  • the vision system may include a video display device, such as by utilizing aspects of the video display systems described in U.S. Pat. Nos.
  • the vision system (utilizing the forward facing camera and a rearward facing camera and other cameras disposed at the vehicle with exterior fields of view) may be part of or may provide a display of a top-down view or bird's-eye view system of the vehicle or a surround view at the vehicle, such as by utilizing aspects of the vision systems described in International Publication Nos.

Landscapes

  • Engineering & Computer Science (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Electromagnetism (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)

Abstract

A vehicle parking system of a vehicle includes a plurality of exterior viewing cameras and a control having an image processor operable to process image data captured by the cameras. The vehicle parking system learns a path of travel from a drop off location to a parking location during a learning maneuver that includes a driver driving the vehicle from the drop off location to the parking location. The control, upon the driver exiting the vehicle when the vehicle is positioned at the drop off location and at least in part responsive to the learned path of travel, controls the vehicle to autonomously drive the vehicle from the drop off location to the parking location. The control, responsive at least in part to image processing by the image processor of image data captured by at least one of the cameras, parks the vehicle at the parking location.

Description

    CROSS REFERENCE TO RELATED APPLICATION
  • The present application claims the filing benefits of U.S. provisional application Ser. No. 62/302,346, filed Mar. 2, 2016, which is hereby incorporated herein by reference in its entirety.
  • FIELD OF THE INVENTION
  • The present invention relates generally to a vehicle vision system for a vehicle and, more particularly, to a vehicle vision system that utilizes one or more cameras at a vehicle.
  • BACKGROUND OF THE INVENTION
  • Use of imaging sensors in vehicle imaging systems is common and known.
  • Examples of such known systems are described in U.S. Pat. Nos. 5,949,331; 5,670,935 and/or 5,550,677, which are hereby incorporated herein by reference in their entireties.
  • SUMMARY OF THE INVENTION
  • The present invention provides a driver assistance system or vision system or imaging system for a vehicle that utilizes one or more exterior sensors, such as cameras and/or ultrasonic sensors and/or radar sensors or the like to capture data representative of the vehicle surroundings, and provides an autonomous parking feature that controls the vehicle to park the vehicle at a targeted parking location. The system may provide a home parking function, where the system can record or learn a path for the vehicle to travel from a drop off location (such as by a front door of a house) to a parking location (such as in a garage of the house). The system can then follow the recorded path to park the vehicle after the driver has exited the vehicle at the drop off location. Optionally, the system may provide a valet parking feature, where the system may autonomously control the vehicle to drive the vehicle through a parking structure to a parking space or zone.
  • These and other objects, advantages, purposes and features of the present invention will become apparent upon review of the following specification in conjunction with the drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a plan view of a vehicle with a vehicle parking system that incorporates cameras and/or other exterior sensors in accordance with the present invention;
  • FIG. 2 is a schematic showing system architecture of the parking system of the present invention;
  • FIG. 3 is another schematic showing system architecture of the parking system of the present invention, shown using cameras and image processing;
  • FIG. 4 is a block diagram of a remote control system for controlling the parking system of the present invention, showing a display screen that shows the vehicle as it is being automatically or remotely driven in accordance with the present invention;
  • FIGS. 5-8 are plan views of a parking scenario for a home parking system of the present invention;
  • FIGS. 9-12 are plan views of a parking scenario for a valet parking system of the present invention;
  • FIG. 13 is a schematic showing system architecture of the parking system of the present invention; and
  • FIG. 14 is another schematic showing system architecture of the parking system of the present invention.
  • DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • A vehicle vision system and/or parking system and/or driver assist system and/or object detection system and/or alert system operates to capture images exterior of the vehicle and may process the captured image data to display images and to detect objects at or near the vehicle and in the predicted path of the vehicle, such as to assist a driver of the vehicle in maneuvering the vehicle in a rearward direction. The vision system includes an image processor or image processing system that is operable to receive image data from one or more cameras and provide an output to a display device for displaying images representative of the captured image data. Optionally, the vision system may provide display, such as a rearview display or a top down or bird's eye or surround view display or the like.
  • Referring now to the drawings and the illustrative embodiments depicted therein, a vehicle 10 includes a vehicle parking system 12 that includes at least one exterior facing sensor or imaging sensor or camera, such as a rearward facing imaging sensor or camera 14 a (and the system may optionally include multiple exterior facing imaging sensors or cameras, such as a forward facing camera 14 b at the front (or at the windshield) of the vehicle, and a sideward/rearward facing camera 14 c, 14 d at respective sides of the vehicle), which captures images exterior of the vehicle, with the camera having a lens for focusing images at or onto an imaging array or imaging plane or imager of the camera (FIG. 1). Optionally, a forward viewing camera may be disposed at the windshield of the vehicle and view through the windshield and forward of the vehicle, such as for a machine vision system (such as for traffic sign recognition, headlamp control, pedestrian detection, collision avoidance, lane marker detection and/or the like). The parking system 12 includes a control or electronic control unit (ECU) or processor 18 that is operable to process image data captured by the camera or cameras and may detect objects or the like and/or provide displayed images at a display device 16 for viewing by the driver of the vehicle (although shown in FIG. 1 as being part of or incorporated in or at an interior rearview mirror assembly 20 of the vehicle, the control and/or the display device may be disposed elsewhere at or in the vehicle). The data transfer or signal communication from the camera to the ECU may comprise any suitable data or communication link, such as a vehicle network bus or the like of the equipped vehicle.
  • The present invention provides an automatic parking system that will “valet park” a vehicle by driving or controlling the vehicle from a location where the driver and passenger may be dropped off to a parking space a relatively short distance away.
  • The system includes a plurality of sensors, such as multiple (e.g., about 12) ultrasonic sensors or the like, and an embedded ECU for ultrasonic park assist (UPA) functions and for ultrasonic park space detection (UPSD) functions (see FIG. 2). The system may include CarPC using AppControl for evaluation of UPA and UPSD data for collision detection, free space detection and free space detection manager functions, and may include CarPC using AppControl for CAN based EgoMotion functions. The system may include Microautobox for path planner and vehicle control functions, and may include Microautobox for all application functions such as reference time generator and human-machine interface (HMI) control, and may include Microautobox for communication with the vehicle using Flexray or the like. The embedded ECU, CarPC and Microautobox may communicate using a local CAN bus of the vehicle.
  • Optionally, the vehicle parking system may include or utilize cameras and machine vision algorithm blocks for surround view systems (SVS) or rear vision camera (RVC) systems and ultrasonic autopark, and may include motion estimation, image classifier, contrast+block entropy, line detection, structure from motion and/or object detection (see FIG. 3).
  • Optionally, the parking system of the present invention may use a remote control application running on mobile device (see FIG. 4). The remote control app should allow the user to execute an automated vehicle maneuver by holding down a button while the driver is outside the vehicle, and to maneuver the vehicle manually forward/backward, left/right (like a remote control car). The system may display the system status/obstacle information, distances to objects on the app display and/or images captured by one or more cameras of the vehicle or of the structure where the vehicle is being parked (such as via a vehicle-to-infrastructure communication or the like). The remote control app may be generic in order to support re-use in various projects such as an auto-park system and/or a home zone parking system and/or a trailer backup assist system or the like.
  • Optionally, the parking system of the present invention may be operable as a home zone parking system that allows a user or driver to get out of the vehicle (such as at a driveway near the front door of the house), whereby the system will autonomously drive the vehicle from the drop off location to the parking location, such as into the garage or the like (see FIGS. 5-8). The system allows for learning or recording of a parking maneuver while the driver is controlling the vehicle (such as responsive to the driver actuating a user input to commence the learning function when the vehicle is at a start or drop off location), for example driving and parking of a vehicle from the entrance door of a house to a designated parking location, and then replaying or re-enacting the parking maneuver without a driver in the vehicle, where the parking system controls the vehicle during the maneuver. For example, the driver, when the vehicle is positioned at a drop off location (such as at or near the door of a house), may actuate the learning feature of the system (via actuation of a first user input when the vehicle is at a start or drop off location), and then the driver may drive the vehicle from the drop off location to the parking location (such as at or in a garage). After the path of travel (between the drop off location and the parking location) has been learned by the system, the next time the driver positions the vehicle at the drop off location, the driver may exit the vehicle and actuate the parking feature (such as via actuation of a second user input of the vehicle when the driver is exiting the vehicle at a start or drop off location or via actuation of a remote device or key fob or the like when the vehicle is at a start or drop off location), whereby the control drives the vehicle (following the previously learned path) from the drop off location to the parking location.
  • The system utilizes object detection using cameras, UPA (and radar) sensors during the replay or autonomous parking/driving maneuver in order to avoid collisions and control the vehicle along the learned path (see FIGS. 6-8). The system allows for dynamic adjustment of the recorded path in order adjust for variation of the vehicle start position and to reach the exact end position (FIGS. 7 and 8). The system allows for dynamic adjustment of the recorded path in order for the vehicle to maneuver around temporary objects on the path (see FIG. 8).
  • The system thus may provide a static record and replay without object detection and dynamic path adjustment, such as for a controlled environment, with only static objects present (no other moving vehicles), no pedestrians present (FIG. 5). As shown in FIG. 5, there are no objects present on the path (path is clear), so the system can record path data while the driver is maneuvering the vehicle to the parking position, with the vehicle control limited to maneuvering in one direction (such as only forward maneuvers), with a targeted maximum path length of less than 50 m, preferably less than about 30 m, and a maximum speed of less than about 10 km/h during the recording phase. During static replay of the path data and maneuvering of vehicle on and along the pre-recorded path without using camera/UPA/radar data, the maximum speed may be further reduced, such as less than about 5 km/h during the replay.
  • The system may provide enhanced control of the vehicle by providing for static record and replay with object detection and without dynamic path adjustment (FIG. 6). As shown in FIG. 6, the vehicle is in a controlled environment, with only static objects present (no other moving vehicles), no pedestrians present. The system may record path data while the driver is maneuvering to the parking position, and may limit the maneuvering to forward and reverse maneuvers (such as 3 sweeps), with a maximum path length of less than 50 m, preferably less than about 30 m, and with a maximum speed of less than about 10 km/h during recording. During controlled parking, the system may perform object detection during the maneuver using cameras/UPA/Radar or the like, and will stop the vehicle if an object is detected in the path of travel of the vehicle. Upon detection of such an object, the system may stop or pause the vehicle maneuver until the object is removed, and then may resume the parking maneuver.
  • Optionally, the system may provide for static record and replay with object detection and with dynamic path adjustment at the end of the path (FIG. 7). As shown in FIG. 7, the vehicle is in a controlled environment, with only static objects present (no other moving vehicles), no pedestrians present. The system may record path data while the driver is maneuvering to the parking position, and may limit the maneuvering to forward and reverse maneuvers (such as 3 sweeps), with a maximum path length of less than 50 m, preferably less than about 30 m, and with a maximum speed of less than about 10 km/h during recording. The system records landmarks while the driver is maneuvering the vehicle (for example, the system may determine distances to edges of the driveway at certain points, or distances to the garage walls at the final parking position), such as at or near the end of the path (for example, the last five meters or thereabouts of the path). The system may perform object detection during the maneuver using cameras/UPA/Radar and may stop the vehicle if an object is detected on the path of travel of the vehicle, whereby the system may stop or pause the vehicle maneuver until the determined object is removed, and then may resume the maneuver. As shown in FIG. 7, the system may dynamically adjust the maneuver at the end of the path in order to park the vehicle consistently in the same parking position.
  • Optionally, the system may provide for static record and replay with object detection and with dynamic path adjustment during the entire maneuver (FIG. 8). The system may record landmarks in an environment map while the driver is maneuvering the vehicle (such as, for example, determining and recording distances to edges of the driveway at certain points, or distances to the garage walls at final parking position). The system may perform object detection during the maneuver using cameras/UPA/Radar or the like and may stop the vehicle if an object is detected on the path of travel. If an obstacle is detected, the system may determine if the vehicle can maneuver around the object and may adjust the path if such maneuvering around is possible. The system may stop or pause the maneuver if maneuvering around is not possible, and then may resume the maneuver after the object is removed from the path. The system may compare the recorded environment map and the current environment map and may modify the path in order to move the vehicle on the exact same path, and to compensate for differences in the start position of the vehicle (when the system commences control of the vehicle). The end position shall be the same for every replay.
  • Optionally, the system of the present invention may provide a valet parking function, where the system may park a vehicle at a public parking space after the driver has dropped himself or herself off at a desired location. Optionally, the desired location may be remote from the parking structure and the system may control the vehicle to follow a learned or predetermined path from the drop off location to an entrance of the parking structure (such as in a similar manner as discussed above). The system allows for autonomous maneuvering of the vehicle from any point inside or in the vicinity of a parking structure (such as at an entrance to the parking structure) to a designated parking location inside the parking structure. The system may include detection of available parking spaces in the vicinity of the designated parking location inside the parking structure using an autopark system that detects available parking spaces (such as by utilizing aspects of the systems described in U.S. Pat. No. 8,874,317 and/or U.S. Publication Nos. US-2017-0015312; US-2015-0158499; US-2015-0251599; US-2015-0124096; US-2015-0344028; US-2014-0375476 and/or US-2013-0116859, which are all hereby incorporated herein by reference in their entireties). The system provides autonomous parking of the vehicle in the detected parking space.
  • The system provides predetermined static path maneuvers from a defined point inside a parking structure to a desired parking zone inside the parking structure on the same floor level followed by automated parking (see FIGS. 9-12). As shown in FIG. 9, the vehicle is in a controlled environment, with only static objects present (no other moving vehicles), no pedestrians present. The system may include detection of static objects (parked vehicles, structural elements, guard rails, posts, and/or the like) using cameras and ultrasonic sensors. The system may abort the maneuver if the system determines that the vehicle would collide with any static object, and may provide emergency braking in case the vehicle would collide with any static object. The system may include a parking structure fingerprinting system to locate the vehicle during maneuver. An autopark system of the vehicle may be activated as the vehicle approaches the end of the predetermined static path (the parking zone) and searches for open parking spaces. The system stops the vehicle when the autopark system finds a parking space, and vehicle control is turned over to the autopark system, which parks the vehicle in the detected parking space.
  • Optionally, the system may perform a predetermined static path maneuver from a defined point outside the parking structure to a desired parking zone inside the parking structure on the same floor level, followed by automated parking (FIG. 10). The system may function in a similar manner as described above, and may use GPS data for maneuvering the vehicle from its location outside the parking structure and then may switch to BLUETOOTH/Wi-Fi fingerprinting for vehicle localization and maneuvering inside the parking structure. The path length outside the structure may be limited to a relatively short distance, such as less than about 100 meters, preferably less than about 50 meters or thereabouts.
  • Optionally, the system may perform a predetermined static path maneuver with path adjustments from a defined point outside the parking structure to a desired area inside the parking structure on the same floor level followed by automated parking (FIG. 11). The system may function in a similar manner as described above, and may detect the drivable area while the vehicle is moving using machine vision (and radar sensors). The valet parking system detects objects along the drivable area using ultrasonic sensors and detects lines using line detection algorithms. All of the detected and determined information is entered into an environment map, which is used to adjust or fine tune the predetermined vehicle path in order to maneuver the vehicle centered on the lane, with a constant distance from limits at the right vehicle side.
  • Optionally, the system may perform a planned path maneuver with path adjustments from a defined point outside the parking structure to a desired area inside the parking structure on the same floor level followed by automated parking (FIG. 12). The system defines a layout of the parking structure (parking structure map), and the “smart parking structure” defines the area with free parking spaces (parking zone). The valet parking system plans a path from the current vehicle position outside the parking structure to the parking zone using the parking structure map. This system adds the functionality of path planning to maneuver the vehicle to the parking zone, but the rest of the functionality is similar to that discussed above. Optionally, for example, the system may learn a path from a common drop off location to a location inside a parking structure (such as described above) and then, when the vehicle is autonomously positioned at the location inside the parking structure, the system switches from following the learned path to being responsive to the parking structure layout/zones.
  • For applications where the system parks the vehicle within a parking structure, the system may utilize an indoor positioning system for underground (or not outside) parking structures. The system may utilize absolute positioning via Bluetooth LE or WLAN or the like and relative positioning with vehicle sensors and optionally a navigation map. The position fingerprinting system or function determines position of the vehicle by comparing the measured signal patterns with previously measured signal patterns in reference points. Optionally, and desirably, the parking garage may have WLAN access points and/or 60 Bluetooth access points and a plurality of fingerprints, whereby the system can determine the vehicle's position within the garage via processing of signals from the access points. The system may combine this information with data captured by vehicle sensors (and processed by a vehicle-based processor) to enhance the determination of the position of the vehicle. The system may use CAN data and Kalman Filtering and/or Particle Filtering to enhance the position or location determination to enhance the vehicle's controlled path of travel when the system is autonomously controlling and parking the vehicle. Optionally, the system may extract map information for further enhancement.
  • As shown in FIG. 13, the system may be adaptable to park a vehicle pulling a trailer, such as by utilizing various trailer angle detection systems and trailer assist systems of the types described in U.S. Pat. No. 9,085,261 and/or U.S. Publication Nos. US-2017-0050672; US-2015-0002670; US-2014-0160276; US-2012-0265416; US-2014-0085472 and/or US-2015-0217693, which are hereby incorporated herein by reference in their entireties.
  • Optionally, the system may comprise simplified system architecture as shown in FIG. 14. Additional signals/data flows may be required, and the system may utilize a sensor fusion map generation in CarPC or the like, and path planning in Microautobox (MAB) or the like.
  • The camera or sensor may comprise any suitable camera or sensor. Optionally, the camera may comprise a “smart camera” that includes the imaging sensor array and associated circuitry and image processing circuitry and electrical connectors and the like as part of a camera module, such as by utilizing aspects of the vision systems described in International Publication Nos. WO 2013/081984 and/or WO 2013/081985, which are hereby incorporated herein by reference in their entireties.
  • The system includes an image processor operable to process image data captured by the camera or cameras, such as for detecting objects or other vehicles or pedestrians or the like in the field of view of one or more of the cameras. For example, the image processor may comprise an image processing chip selected from the EyeQ family of image processing chips available from Mobileye Vision Technologies Ltd. of Jerusalem, Israel, and may include object detection software (such as the types described in U.S. Pat. Nos. 7,855,755; 7,720,580 and/or 7,038,577, which are hereby incorporated herein by reference in their entireties), and may analyze image data to detect vehicles and/or other objects. Responsive to such image processing, and when an object or other vehicle is detected, the system may generate an alert to the driver of the vehicle and/or may generate an overlay at the displayed image to highlight or enhance display of the detected object or vehicle, in order to enhance the driver's awareness of the detected object or vehicle or hazardous condition during a driving maneuver of the equipped vehicle.
  • The vehicle may include any type of sensor or sensors, such as imaging sensors or radar sensors or lidar sensors or ladar sensors or ultrasonic sensors or the like. The imaging sensor or camera may capture image data for image processing and may comprise any suitable camera or sensing device, such as, for example, a two dimensional array of a plurality of photosensor elements arranged in at least 640 columns and 480 rows (at least a 640×480 imaging array, such as a megapixel imaging array or the like), with a respective lens focusing images onto respective portions of the array. The photosensor array may comprise a plurality of photosensor elements arranged in a photosensor array having rows and columns. Preferably, the imaging array has at least 300,000 photosensor elements or pixels, more preferably at least 500,000 photosensor elements or pixels and more preferably at least 1 million photosensor elements or pixels. The imaging array may capture color image data, such as via spectral filtering at the array, such as via an RGB (red, green and blue) filter or via a red/red complement filter or such as via an RCC (red, clear, clear) filter or the like. The logic and control circuit of the imaging sensor may function in any known manner, and the image processing and algorithmic processing may comprise any suitable means for processing the images and/or image data.
  • For example, the vision system and/or processing and/or camera and/or circuitry may utilize aspects described in U.S. Pat. Nos. 9,233,641; 9,146,898; 9,174,574; 9,090,234; 9,077,098; 8,818,042; 8,886,401; 9,077,962; 9,068,390; 9,140,789; 9,092,986; 9,205,776; 8,917,169; 8,694,224; 7,005,974; 5,760,962; 5,877,897; 5,796,094; 5,949,331; 6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978; 7,859,565; 5,550,677; 5,670,935; 6,636,258; 7,145,519; 7,161,616; 7,230,640; 7,248,283; 7,295,229; 7,301,466; 7,592,928; 7,881,496; 7,720,580; 7,038,577; 6,882,287; 5,929,786 and/or 5,786,772, and/or U.S. Publication Nos. US-2014-0340510; US-2014-0313339; US-2014-0347486; US-2014-0320658; US-2014-0336876; US-2014-0307095; US-2014-0327774; US-2014-0327772; US-2014-0320636; US-2014-0293057; US-2014-0309884; US-2014-0226012; US-2014-0293042; US-2014-0218535; US-2014-0218535; US-2014-0247354; US-2014-0247355; US-2014-0247352; US-2014-0232869; US-2014-0211009; US-2014-0160276; US-2014-0168437; US-2014-0168415; US-2014-0160291; US-2014-0152825; US-2014-0139676; US-2014-0138140; US-2014-0104426; US-2014-0098229; US-2014-0085472; US-2014-0067206; US-2014-0049646; US-2014-0052340; US-2014-0025240; US-2014-0028852; US-2014-005907; US-2013-0314503; US-2013-0298866; US-2013-0222593; US-2013-0300869; US-2013-0278769; US-2013-0258077; US-2013-0258077; US-2013-0242099; US-2013-0215271; US-2013-0141578 and/or US-2013-0002873, which are all hereby incorporated herein by reference in their entireties. The system may communicate with other communication systems via any suitable means, such as by utilizing aspects of the systems described in International Publication Nos. WO/2010/144900; WO 2013/043661 and/or WO 2013/081985, and/or U.S. Pat. No. 9,126,525, which are hereby incorporated herein by reference in their entireties.
  • The system may also communicate with other systems, such as via a vehicle-to-vehicle communication system or a vehicle-to-infrastructure communication system or the like. Such car2car or vehicle to vehicle (V2V) and vehicle-to-infrastructure (car2X or V2X or V2I or 4G or 5G) technology provides for communication between vehicles and/or infrastructure based on information provided by one or more vehicles and/or information provided by a remote server or the like. Such vehicle communication systems may utilize aspects of the systems described in U.S. Pat. Nos. 6,690,268; 6,693,517 and/or 7,580,795, and/or U.S. Publication Nos. US-2014-0375476; US-2014-0218529; US-2013-0222592; US-2012-0218412; US-2012-0062743; US-2015-0251599; US-2015-0158499; US-2015-0124096; US-2015-0352953; US-2016-0036917 and/or US-2016-0210853, which are hereby incorporated herein by reference in their entireties.
  • The system may utilize aspects of the parking assist systems described in U.S. Pat. No. 8,874,317 and/or U.S. Publication Nos. US-2017-0050672; US-2017-0017848; US-2017-0015312 and/or US-2015-0344028, and/or U.S. provisional applications, Ser. No. 62/335,248, filed May 12, 2016, and/or Ser. No. 62/330,558, filed May 2, 2016, which are hereby incorporated herein by reference in their entireties.
  • Optionally, the vision system may include a display for displaying images captured by one or more of the imaging sensors for viewing by the driver of the vehicle while the driver is normally operating the vehicle. Optionally, for example, the vision system may include a video display device, such as by utilizing aspects of the video display systems described in U.S. Pat. Nos. 5,530,240; 6,329,925; 7,855,755; 7,626,749; 7,581,859; 7,446,650; 7,338,177; 7,274,501; 7,255,451; 7,195,381; 7,184,190; 5,668,663; 5,724,187; 6,690,268; 7,370,983; 7,329,013; 7,308,341; 7,289,037; 7,249,860; 7,004,593; 4,546,551; 5,699,044; 4,953,305; 5,576,687; 5,632,092; 5,677,851; 5,708,410; 5,737,226; 5,802,727; 5,878,370; 6,087,953; 6,173,508; 6,222,460; 6,513,252 and/or 6,642,851, and/or U.S. Publication Nos. US-2012-0162427; US-2006-0050018 and/or US-2006-0061008, which are all hereby incorporated herein by reference in their entireties. Optionally, the vision system (utilizing the forward facing camera and a rearward facing camera and other cameras disposed at the vehicle with exterior fields of view) may be part of or may provide a display of a top-down view or bird's-eye view system of the vehicle or a surround view at the vehicle, such as by utilizing aspects of the vision systems described in International Publication Nos. WO 2010/099416; WO 2011/028686; WO 2012/075250; WO 2013/019795; WO 2012/075250; WO 2012/145822; WO 2013/081985; WO 2013/086249 and/or WO 2013/109869, and/or U.S. Publication No. US-2012-0162427, which are hereby incorporated herein by reference in their entireties.
  • Changes and modifications in the specifically described embodiments can be carried out without departing from the principles of the invention, which is intended to be limited only by the scope of the appended claims, as interpreted according to the principles of patent law including the doctrine of equivalents.

Claims (20)

1. A vehicle parking system for a vehicle, said vehicle parking system comprising:
a plurality of exterior viewing cameras disposed at a vehicle, each camera of said plurality of exterior viewing cameras having a respective field of view exterior of the vehicle;
a control comprising an image processor operable to process image data captured by said cameras;
wherein said vehicle parking system learns a path of travel from a drop off location to a parking location during a learning maneuver that comprises a driver driving the vehicle from the drop off location to the parking location; and
wherein said control, upon the driver exiting the vehicle when the vehicle is positioned at the drop off location and at least in part responsive to the learned path of travel, controls the vehicle to autonomously drive the vehicle from the drop off location to the parking location, and wherein said control, responsive at least in part to image processing by said image processor of image data captured by at least one of said cameras, parks the vehicle at the parking location.
2. The vehicle parking system of claim 1, wherein said vehicle parking system learns the path of travel from the drop off location to the parking location responsive to a user input that, when actuated by a user when the vehicle is at the drop off location, actuates a learning function of said vehicle parking system.
3. The vehicle parking system of claim 1, wherein said control, after said vehicle parking system learns the path of travel and responsive to actuation of a user input when the vehicle is at the drop off location, autonomously drives the vehicle from the drop off location to the parking location.
4. The vehicle parking system of claim 1, wherein, responsive at least in part to processing by said image processor of captured image data while said control autonomously drives the vehicle from the drop off location to the parking location, said vehicle parking system determines the presence of an object in the path of travel and, responsive to determination of the object, said control adjusts steering or braking of the vehicle as said control autonomously drives the vehicle along the learned path of travel.
5. The vehicle parking system of claim 1, wherein, responsive to a determination of a variation in the location of the vehicle along the learned path of travel, said control adjusts steering or braking of the vehicle as the vehicle is autonomously driven towards the parking location.
6. The vehicle parking system of claim 5, wherein said control determines the variation via image processing by said image processor of captured image data.
7. The vehicle parking system of claim 1, wherein the parking location is at an entrance of a parking structure and wherein, after the vehicle is autonomously driven to the parking location at the parking structure, said control parks the vehicle at a parking space of the parking structure responsive at least in part to signals from beacons at the parking structure.
8. The vehicle parking system of claim 7, wherein, responsive at least in part to signals from beacons, said vehicle parking system determines the current location of the vehicle at the parking structure.
9. The vehicle parking system of claim 8, wherein said control autonomously drives the vehicle from the parking location at the parking structure to a selected parking space of the parking structure responsive at least in part to the determined current location of the vehicle at the parking structure.
10. The vehicle parking system of claim 9, wherein said vehicle parking system is operable to determine, at least in part via image processing by said image processor of image data captured by at least some of said cameras, the presence of an object in the path of travel of the vehicle and, responsive to determination of the object, said control adjusts steering or braking of the vehicle as said control autonomously drives the vehicle toward the selected parking space of the parking structure.
11. The vehicle parking system of claim 1, wherein said vehicle parking system is operable at least in part responsive to a remote control device, whereby a user controls steering and braking of the vehicle via the remote control device remote from the vehicle.
12. The vehicle parking system of claim 1, wherein said control controls the vehicle to autonomously drive the vehicle from the drop off location to the parking location responsive at least in part to image processing by said image processor of image data captured by at least some of said cameras.
13. The vehicle parking system of claim 1, wherein said control controls the vehicle to autonomously drive the vehicle from the drop off location to the parking location responsive at least in part to a plurality of non-imaging sensors of the vehicle.
14. A vehicle parking system for a vehicle, said vehicle parking system comprising:
a plurality of exterior viewing cameras disposed at a vehicle, each camera of said plurality of exterior viewing cameras having a respective field of view exterior of the vehicle;
a control comprising an image processor operable to process image data captured by said cameras;
wherein, responsive at least in part to actuation of a first user input, said vehicle parking system learns a path of travel from a drop off location to a parking location during a learning maneuver that comprises a driver, after actuating the first user input, driving the vehicle from the drop off location to the parking location; and
wherein said control, responsive to the driver actuating a second user input when the vehicle is positioned at the drop off location, controls the vehicle to follow the learned path of travel to autonomously drive the vehicle from the drop off location to the parking location, and wherein said control, responsive at least in part to image processing by said image processor of image data captured by at least one of said cameras, parks the vehicle at the parking location.
15. The vehicle parking system of claim 14, wherein, responsive at least in part to processing by said image processor of captured image data while said control autonomously drives the vehicle from the drop off location to the parking location, said vehicle parking system determines the presence of an object in the path of travel and, responsive to determination of the object, said control adjusts steering or braking of the vehicle as said control autonomously drives the vehicle along the learned path of travel.
16. The vehicle parking system of claim 14, wherein the parking location is at an entrance of a parking structure and wherein, after the vehicle is autonomously driven to the parking location at the parking structure, said control parks the vehicle at a parking space of the parking structure responsive at least in part to signals from a parking system of the parking structure.
17. The vehicle parking system of claim 14, wherein said control controls the vehicle to autonomously drive the vehicle from the drop off location to the parking location responsive at least in part to (i) image processing by said image processor of image data captured by at least some of said cameras and (ii) a plurality of non-imaging sensors of the vehicle.
18. A vehicle parking system for a vehicle, said vehicle parking system comprising:
a plurality of exterior viewing cameras disposed at a vehicle, each camera of said plurality of exterior viewing cameras having a respective field of view exterior of the vehicle;
a control comprising an image processor operable to process image data captured by said cameras;
wherein said vehicle parking system learns a path of travel from a drop off location to a parking structure during a learning maneuver that comprises a driver driving the vehicle from the drop off location to the parking structure; and
wherein said control, upon the driver exiting the vehicle when the vehicle is positioned at the drop off location and at least in part responsive to the learned path of travel, controls the vehicle to autonomously drive the vehicle from the drop off location to the parking structure;
wherein, after the vehicle is autonomously driven to the parking structure, said control parks the vehicle at a parking space of the parking structure responsive at least in part to signals from a parking system of the parking structure; and
wherein, responsive at least in part to signals from the parking system of the parking structure, said vehicle parking system determines the current location of the vehicle at the parking structure and said control autonomously drives the vehicle to the parking space of the parking structure responsive at least in part to the determined current location of the vehicle at the parking structure.
19. The vehicle parking system of claim 18, wherein said vehicle parking system is operable to determine, at least in part via image processing by said image processor of image data captured by at least some of said cameras, the presence of an object in the path of travel of the vehicle and, responsive to determination of the object, said control adjusts steering or braking of the vehicle as said control autonomously drives the vehicle toward the selected parking space of the parking structure.
20. The vehicle parking system of claim 18, wherein said control controls the vehicle to autonomously drive the vehicle from the drop off location to the parking structure responsive at least in part to (i) image processing by said image processor of image data captured by at least some of said cameras and (ii) a plurality of non-imaging sensors of the vehicle.
US15/446,218 2016-03-02 2017-03-01 Vehicle vision system with automatic parking function Abandoned US20170253237A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/446,218 US20170253237A1 (en) 2016-03-02 2017-03-01 Vehicle vision system with automatic parking function
US15/929,843 US11400919B2 (en) 2016-03-02 2020-05-26 Vehicle vision system with autonomous parking function

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662302346P 2016-03-02 2016-03-02
US15/446,218 US20170253237A1 (en) 2016-03-02 2017-03-01 Vehicle vision system with automatic parking function

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/929,843 Continuation US11400919B2 (en) 2016-03-02 2020-05-26 Vehicle vision system with autonomous parking function

Publications (1)

Publication Number Publication Date
US20170253237A1 true US20170253237A1 (en) 2017-09-07

Family

ID=59722614

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/446,218 Abandoned US20170253237A1 (en) 2016-03-02 2017-03-01 Vehicle vision system with automatic parking function
US15/929,843 Active 2037-03-28 US11400919B2 (en) 2016-03-02 2020-05-26 Vehicle vision system with autonomous parking function

Family Applications After (1)

Application Number Title Priority Date Filing Date
US15/929,843 Active 2037-03-28 US11400919B2 (en) 2016-03-02 2020-05-26 Vehicle vision system with autonomous parking function

Country Status (1)

Country Link
US (2) US20170253237A1 (en)

Cited By (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10078789B2 (en) 2015-07-17 2018-09-18 Magna Electronics Inc. Vehicle parking assist system with vision-based parking space detection
US20180297588A1 (en) * 2017-04-18 2018-10-18 International Business Machines Corporation Delayed parking optimization of autonomous vehicles
CN108860139A (en) * 2018-04-11 2018-11-23 浙江零跑科技有限公司 A kind of automatic parking method for planning track based on depth enhancing study
CN109067925A (en) * 2018-10-09 2018-12-21 北京智行者科技有限公司 A kind of method and system of parking of remote control
US10160437B2 (en) 2016-02-29 2018-12-25 Magna Electronics Inc. Vehicle control system with reverse assist
WO2019056872A1 (en) * 2017-09-19 2019-03-28 广州汽车集团股份有限公司 Fully automated parking method, and fully automated parking system
US20190094025A1 (en) * 2017-09-27 2019-03-28 Jaguar Land Rover Limited Apparatus and method for localising a vehicle
GB2571152A (en) * 2018-02-15 2019-08-21 Jaguar Land Rover Ltd Vehicle Control System and Control Method
US20190258245A1 (en) * 2018-02-19 2019-08-22 Denso Ten Limited Vehicle remote operation device, vehicle remote operation system and vehicle remote operation method
JP2019142286A (en) * 2018-02-16 2019-08-29 トヨタ自動車株式会社 Parking assistance device
US10486742B2 (en) 2016-08-01 2019-11-26 Magna Electronics Inc. Parking assist system using light projections
US10583779B2 (en) 2017-10-02 2020-03-10 Magna Electronics Inc. Parking assist system using backup camera
US20200192352A1 (en) * 2018-12-14 2020-06-18 Valeo Schalter Und Sensoren Gmbh Remote operation of vehicles in close-quarter environments
CN111301403A (en) * 2018-12-06 2020-06-19 现代自动车株式会社 System, method, infrastructure and vehicle for automated valet parking
CN111344215A (en) * 2017-11-14 2020-06-26 大陆汽车有限责任公司 Method for controlling a parking process of a vehicle
US20200207333A1 (en) * 2018-12-31 2020-07-02 Robert Bosch Gmbh Autonomously guiding a vehicle to a desired parking location selected with a remote device
US10744941B2 (en) 2017-10-12 2020-08-18 Magna Electronics Inc. Vehicle vision system with bird's eye view display
CN111796591A (en) * 2019-03-19 2020-10-20 本田技研工业株式会社 Vehicle control device, monitoring system, vehicle control method, and storage medium
US10845807B2 (en) * 2017-10-02 2020-11-24 Toyota Jidosha Kabushiki Kaisha Managing apparatus
US10899385B2 (en) 2017-10-23 2021-01-26 Magna Electronics Inc. Vehicle and trailer backup guidance system
US20210107561A1 (en) * 2015-08-18 2021-04-15 Magna Electronics Inc. Vehicular driving assist system
US11014561B2 (en) 2017-02-01 2021-05-25 Magna Electronics Inc. Vehicle trailer hitch assist system
US20210166562A1 (en) * 2019-06-14 2021-06-03 Toyota Motor North America, Inc. Parking monitoring and assistance for transports
US11034295B2 (en) 2017-02-02 2021-06-15 Magna Electronics Inc. Vehicle vision system using at least two cameras
US11067993B2 (en) 2017-08-25 2021-07-20 Magna Electronics Inc. Vehicle and trailer maneuver assist system
US11091155B2 (en) * 2017-08-10 2021-08-17 Nissan Motor Co., Ltd. Parking control method and parking control device
US11126184B1 (en) * 2016-01-22 2021-09-21 State Farm Mutual Automobile Insurance Company Autonomous vehicle parking
US11136034B2 (en) * 2017-06-20 2021-10-05 Nissan Motor Co., Ltd. Travel control method and travel control device
CN113753029A (en) * 2021-08-27 2021-12-07 惠州华阳通用智慧车载系统开发有限公司 Automatic parking method and system based on optical flow method
US11242051B1 (en) 2016-01-22 2022-02-08 State Farm Mutual Automobile Insurance Company Autonomous vehicle action communications
US20220041184A1 (en) * 2018-10-18 2022-02-10 Caratica Ai Ltd. Method and system for obstacle detection
US20220060654A1 (en) * 2020-08-18 2022-02-24 Toyota Jidosha Kabushiki Kaisha Image recording device for a vehicle and image recording method for a vehicle
US11273868B2 (en) 2018-07-16 2022-03-15 Magna Electronics Inc. Vehicular trailer assist system
US11332124B2 (en) 2019-01-10 2022-05-17 Magna Electronics Inc. Vehicular control system
US11353865B2 (en) 2018-11-13 2022-06-07 Robotic Research Opco, Llc Coordination of mining and construction vehicles via scripting control
US11377096B2 (en) * 2018-05-11 2022-07-05 Guangzhou Automobile Group Co., Ltd. Automatic parking method and device
CN114715102A (en) * 2021-01-05 2022-07-08 广州汽车集团股份有限公司 Vehicle redundant braking method and vehicle
US11383738B2 (en) * 2018-02-08 2022-07-12 Valeo Schalter Und Sensoren Gmbh Method for operating a driving assistance system of a motor vehicle with remote-controlled manoeuvring of the motor vehicle at different automation levels and driving assistance system
US11390270B2 (en) * 2018-08-06 2022-07-19 Panasonic Intellectual Property Management Co., Ltd. Parking assistance apparatus
US11400919B2 (en) * 2016-03-02 2022-08-02 Magna Electronics Inc. Vehicle vision system with autonomous parking function
US11414069B1 (en) * 2021-03-18 2022-08-16 Pixart Imaging Inc. Method for parking guidance and parking guidance system
JP2022133181A (en) * 2021-03-01 2022-09-13 パナソニックIpマネジメント株式会社 Parking support device and parking support method
US11441916B1 (en) 2016-01-22 2022-09-13 State Farm Mutual Automobile Insurance Company Autonomous vehicle trip routing
EP4091910A3 (en) * 2021-05-19 2022-11-30 Guangzhou Xiaopeng Motors Technology Co., Ltd. Learning method and apparatus for parking function in autonomous driving
US11560143B2 (en) 2020-05-26 2023-01-24 Magna Electronics Inc. Vehicular autonomous parking system using short range communication protocols
US20230087202A1 (en) * 2021-09-17 2023-03-23 Ford Global Technologies, Llc Augmented Reality And Touch-Based User Engagement Parking Assist
US20230138610A1 (en) * 2021-11-02 2023-05-04 Robert Bosch Gmbh Customizing Operational Design Domain of an Autonomous Driving System for a Vehicle Based on Driver's Behavior
US11644843B2 (en) * 2018-11-12 2023-05-09 Robotic Research Opco, Llc Learning mechanism for autonomous trucks for mining and construction applications
US11656626B2 (en) 2018-11-12 2023-05-23 Robotic Research Opco, Llc Autonomous truck loading for mining and construction applications
US11721113B2 (en) 2020-10-09 2023-08-08 Magna Electronics Inc. Vehicular driving assist system with lane detection using rear camera
US11719545B2 (en) 2016-01-22 2023-08-08 Hyundai Motor Company Autonomous vehicle component damage and salvage assessment
US11820395B2 (en) 2021-06-28 2023-11-21 Magna Electronics Inc. Vehicular driving assist system with unparking alert
JP2024015752A (en) * 2022-07-25 2024-02-06 日産自動車株式会社 Parking support method and parking support device
US11987287B2 (en) 2019-04-12 2024-05-21 Continental Autonomous Mobility US, LLC Autonomous truck-trailer maneuvering and parking
US12030513B2 (en) 2021-10-04 2024-07-09 Magna Electronics Inc. Vehicular door opening warning system
US12146754B2 (en) 2021-03-19 2024-11-19 Ford Global Technologies, Llc User trained map for valet parking feature
US12194923B2 (en) 2020-11-04 2025-01-14 Magna Electronics Inc. Vehicular trailer hitching assist system with hitch ball location estimation
US12252172B2 (en) 2021-09-21 2025-03-18 Magna Electronics Inc. Vehicular intelligent remote parking assist system
US12366653B2 (en) 2021-10-26 2025-07-22 Magna Electronics Inc. Radar-based vehicular exterior mirror collision avoidance system
US12503043B2 (en) 2017-11-09 2025-12-23 Magna Electronics Inc. Vehicle communication system using projected light
US12526506B2 (en) 2023-01-30 2026-01-13 Magna Electronics Inc. Vehicular vision system with underbody object detection
US12539819B2 (en) 2022-04-07 2026-02-03 Magna Electronics Inc. Vehicular vision system with tailgate control
US12545239B2 (en) 2021-03-01 2026-02-10 Panasonic Automotive Systems Co., Ltd. Parking assistance device, parking assistance method, and computer-readable medium

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3048557B1 (en) * 2016-03-07 2018-03-30 Valeo Comfort And Driving Assistance ELECTRONIC PARKING AID EQUIPMENT FOR MOTOR VEHICLE
JP7040098B2 (en) * 2018-02-15 2022-03-23 トヨタ自動車株式会社 Steering support device
KR102775622B1 (en) * 2018-10-16 2025-03-05 주식회사 에이치엘클레무브 Vehicle control system and vehicle control method
US20210114586A1 (en) * 2020-12-23 2021-04-22 Ralf Graefe Autonomous driving vehicle parking detection

Citations (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6476730B2 (en) * 2000-02-29 2002-11-05 Aisin Seiki Kabushiki Kaisha Assistant apparatus and method for a vehicle in reverse motion
US6704621B1 (en) * 1999-11-26 2004-03-09 Gideon P. Stein System and method for estimating ego-motion of a moving vehicle using successive images recorded along the vehicle's path of motion
US20050171654A1 (en) * 2004-01-29 2005-08-04 Nichols William M. Automatic taxi manager
US20050285758A1 (en) * 2004-06-23 2005-12-29 Denso Corporation Parking assistance system
US20070198145A1 (en) * 2005-10-21 2007-08-23 Norris William R Systems and methods for switching between autonomous and manual operation of a vehicle
US20080032706A1 (en) * 2006-08-01 2008-02-07 Leonid Sheynblat System And/Or Method For Providing Information Updates To A Location Server
US20100013670A1 (en) * 2005-07-26 2010-01-21 Martin Hueppauff Parking apparatus
US20100222925A1 (en) * 2004-12-03 2010-09-02 Takashi Anezaki Robot control apparatus
US20110080304A1 (en) * 2009-10-07 2011-04-07 Ford Global Technologies, Llc Vehicle Park Assist System and Method for Parking a Vehicle Using Such System
US20120239224A1 (en) * 2011-03-18 2012-09-20 Mccabe Paul P Integration of an autonomous industrial vehicle into an asset management system
US20120239238A1 (en) * 2011-03-18 2012-09-20 Harvey Dean S Communication technique by which an autonomous guidance system controls an industrial vehicle
US8285479B2 (en) * 2007-03-08 2012-10-09 Toyota Jidosha Kabushiki Kaisha Parking assist apparatus
US20130231824A1 (en) * 2012-03-05 2013-09-05 Florida A&M University Artificial Intelligence Valet Systems and Methods
US20130278769A1 (en) * 2012-03-23 2013-10-24 Magna Electronics Inc. Vehicle vision system with accelerated object confirmation
US20140052336A1 (en) * 2012-08-15 2014-02-20 GM Global Technology Operations LLC Directing vehicle into feasible region for autonomous and semi-autonomous parking
US20140180523A1 (en) * 2012-12-22 2014-06-26 Audi Ag Driver assistance system and method for authorizing an autonomous or piloted garage parking
US20140267608A1 (en) * 2011-10-10 2014-09-18 Universite Blaise Pasca-Clermont Ii Method of calibrating a computer-based vision system onboard a craft
US20140270345A1 (en) * 2013-03-12 2014-09-18 Qualcomm Incorporated Method and apparatus for movement estimation
US20140343830A1 (en) * 2013-05-20 2014-11-20 Ford Global Technologies, Llc Stop/start control based on repeated driving patterns
US20140365032A1 (en) * 2013-06-05 2014-12-11 Hyundai Motor Company Apparatus, method, and system for assisting remote parking
US9002581B2 (en) * 2009-08-18 2015-04-07 Crown Equipment Corporation Object tracking and steer maneuvers for materials handling vehicles
US20150203111A1 (en) * 2012-08-10 2015-07-23 Daimler Ag Method for Carrying Out a Process of Parking a Vehicle by Means of a Driver Assistance System
US20150217763A1 (en) * 2012-08-23 2015-08-06 Audi Ag Method for controlling an autonomous vehicle system and motor vehicle
US20150226146A1 (en) * 2014-02-07 2015-08-13 Ford Global Technologies, Llc Walk-away vehicle shutdown
US20150241241A1 (en) * 2014-02-27 2015-08-27 International Business Machines Corporation Identifying cost-effective parking for an autonomous vehicle
US20150346727A1 (en) * 2015-08-12 2015-12-03 Madhusoodhan Ramanujam Parking Autonomous Vehicles
US20160115702A1 (en) * 2014-10-27 2016-04-28 Robert Bosch Gmbh Method for operating a towing robot
US20160274588A1 (en) * 2013-11-11 2016-09-22 Murata Machinery, Ltd. Autonomous traveling vehicle and reproduction travel method
US20170008490A1 (en) * 2014-04-01 2017-01-12 Mico Latta Inc. Vehicle and program for vehicle
US20170123423A1 (en) * 2014-04-30 2017-05-04 Mico Latta Inc. Automatic driving vehicle and program for automatic driving vehicle
US20170200321A1 (en) * 2016-01-07 2017-07-13 Google Inc. Reputation Systems in Ride Share Platforms
US20170232891A1 (en) * 2014-10-27 2017-08-17 Robert Bosch Gmbh Method and device for operating a vehicle and a parking lot
US20170308095A1 (en) * 2014-10-27 2017-10-26 Robert Bosch Gmbh Method and device for guiding a vehicle in a parking lot
US20170309177A1 (en) * 2014-10-27 2017-10-26 Robert Bosch Gmbh Method and device for operating a parking lot
US20170305467A1 (en) * 2014-11-26 2017-10-26 Robert Bosch Gmbh Method and apparatus for the assisted guidance of a vehicle
US20170313307A1 (en) * 2014-11-26 2017-11-02 Robert Bosch Gmbh Server for operating a parking facility
US20170313305A1 (en) * 2014-10-27 2017-11-02 Robert Bosch Gmbh Method for carrying out an automatic parking process of a vehicle
US20170323565A1 (en) * 2014-11-26 2017-11-09 Robert Bosch Gmbh Parking facility management server for a parking facility
US20170329331A1 (en) * 2016-05-16 2017-11-16 Magna Electronics Inc. Control system for semi-autonomous control of vehicle along learned route
US20180037136A1 (en) * 2016-08-02 2018-02-08 Here Global B.V. Vehicle charging lanes
US20180063285A1 (en) * 2015-03-11 2018-03-01 Robert Bosch Gmbh Method for operating a server
US20180056504A1 (en) * 2016-08-25 2018-03-01 Industrial Technology Research Institute Teaching apparatus for manipulator
US9944282B1 (en) * 2014-11-13 2018-04-17 State Farm Mutual Automobile Insurance Company Autonomous vehicle automatic parking
US20180194344A1 (en) * 2016-07-29 2018-07-12 Faraday&Future Inc. System and method for autonomous vehicle navigation
US20180304887A1 (en) * 2015-10-22 2018-10-25 Robert Bosch Gmbh Method and device for reducing a risk of a collision of a motor vehicle with an object
US20180315393A1 (en) * 2015-12-21 2018-11-01 Bayerische Motoren Werke Aktiengesellschaft Display Device and Method for Controlling a Display Device
US20180328750A1 (en) * 2017-05-12 2018-11-15 Lg Electronics Inc. Autonomous vehicle and method of controlling the same
US10133273B2 (en) * 2016-09-20 2018-11-20 2236008 Ontario Inc. Location specific assistance for autonomous vehicle control system
US20190016331A1 (en) * 2017-07-14 2019-01-17 Nio Usa, Inc. Programming complex parking maneuvers for driverless vehicles
US20190016384A1 (en) * 2017-07-14 2019-01-17 Nio Usa, Inc Control of complex parking maneuvers and autonomous fuel replenishment of driverless vehicles
US20190080482A1 (en) * 2017-09-14 2019-03-14 Robert Bosch Gmbh Method and apparatus for data reduction of feature-based environment information of a driver assistance system
US20190105960A1 (en) * 2017-10-11 2019-04-11 Ford Global Technologies, Llc System and method for evaporative emissions detection
US20190347934A1 (en) * 2018-05-14 2019-11-14 Denso Corporation Parking system

Family Cites Families (207)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6735506B2 (en) 1992-05-05 2004-05-11 Automotive Technologies International, Inc. Telematics system
US5845000A (en) 1992-05-05 1998-12-01 Automotive Technologies International, Inc. Optical identification and monitoring system using pattern recognition for use with vehicles
US6442465B2 (en) 1992-05-05 2002-08-27 Automotive Technologies International, Inc. Vehicular component control systems and methods
US5303205A (en) 1990-02-26 1994-04-12 Trend Tec Inc. Vehicular distance measuring system with integral mirror display
US5451822A (en) 1991-03-15 1995-09-19 Gentex Corporation Electronic control system
JP2782990B2 (en) 1991-07-11 1998-08-06 日産自動車株式会社 Vehicle approach determination device
US5469298A (en) 1991-08-14 1995-11-21 Prince Corporation Reflective display at infinity
US5535314A (en) 1991-11-04 1996-07-09 Hughes Aircraft Company Video image processor and method for detecting vehicles
US5461357A (en) 1992-01-29 1995-10-24 Mazda Motor Corporation Obstacle detection device for vehicle
JP2973695B2 (en) 1992-03-12 1999-11-08 船井電機株式会社 In-vehicle navigation system
DE59205359D1 (en) 1992-04-21 1996-03-28 Pietzsch Ibp Gmbh Device for driving vehicles
GB2267341B (en) 1992-05-27 1996-02-21 Koito Mfg Co Ltd Glare sensor for a vehicle
US5515448A (en) 1992-07-28 1996-05-07 Yazaki Corporation Distance measuring apparatus of a target tracking type
JPH0785280B2 (en) 1992-08-04 1995-09-13 タカタ株式会社 Collision prediction judgment system by neural network
US5521633A (en) 1992-09-25 1996-05-28 Yazaki Corporation Motor vehicle obstacle monitoring system using optical flow processing
JP3462227B2 (en) 1992-11-13 2003-11-05 矢崎総業株式会社 Display device for vehicles
DE69333759T2 (en) 1992-12-14 2005-12-29 Denso Corp., Kariya IMAGE DISPLAY UNIT
US5285060A (en) 1992-12-15 1994-02-08 Donnelly Corporation Display for automatic rearview mirror
JP3263699B2 (en) 1992-12-22 2002-03-04 三菱電機株式会社 Driving environment monitoring device
DE69324224T2 (en) 1992-12-29 1999-10-28 Koninklijke Philips Electronics N.V., Eindhoven Image processing method and apparatus for generating an image from a plurality of adjacent images
US5529138A (en) 1993-01-22 1996-06-25 Shaw; David C. H. Vehicle collision avoidance system
US5796094A (en) 1993-02-26 1998-08-18 Donnelly Corporation Vehicle headlight control using imaging sensor
US6498620B2 (en) 1993-02-26 2002-12-24 Donnelly Corporation Vision system for a vehicle including an image capture device and a display system having a long focal length
US5877897A (en) 1993-02-26 1999-03-02 Donnelly Corporation Automatic rearview mirror, vehicle lighting control and vehicle interior monitoring system using a photosensor array
US6396397B1 (en) 1993-02-26 2002-05-28 Donnelly Corporation Vehicle imaging system with stereo imaging
US5670935A (en) 1993-02-26 1997-09-23 Donnelly Corporation Rearview vision system for vehicle including panoramic view
US6822563B2 (en) 1997-09-22 2004-11-23 Donnelly Corporation Vehicle imaging system with accessory control
US5550677A (en) 1993-02-26 1996-08-27 Donnelly Corporation Automatic rearview mirror system using a photosensor array
DE4408745C2 (en) 1993-03-26 1997-02-27 Honda Motor Co Ltd Driving control device for vehicles
JP2887039B2 (en) 1993-03-26 1999-04-26 三菱電機株式会社 Vehicle periphery monitoring device
US6430303B1 (en) 1993-03-31 2002-08-06 Fujitsu Limited Image processing apparatus
WO1994022693A1 (en) 1993-03-31 1994-10-13 Automotive Technologies International, Inc. Vehicle occupant position and velocity sensor
US6084519A (en) 1993-05-07 2000-07-04 Control Devices, Inc. Multi-function light sensor for vehicle
DE4318114C2 (en) 1993-06-01 1998-07-16 Kostal Leopold Gmbh & Co Kg Sensor device
US6553130B1 (en) 1993-08-11 2003-04-22 Jerome H. Lemelson Motor vehicle warning and control system and method
US5434407A (en) 1993-08-23 1995-07-18 Gentex Corporation Automatic rearview mirror incorporating light pipe
GB9317983D0 (en) 1993-08-28 1993-10-13 Lucas Ind Plc A driver assistance system for a vehicle
US5638116A (en) 1993-09-08 1997-06-10 Sumitomo Electric Industries, Ltd. Object recognition apparatus and method
US5457493A (en) 1993-09-15 1995-10-10 Texas Instruments Incorporated Digital micro-mirror based image simulation system
US5440428A (en) 1993-09-30 1995-08-08 Hughes Aircraft Company Automotive instrument 3-D virtual image display
US5883739A (en) 1993-10-04 1999-03-16 Honda Giken Kogyo Kabushiki Kaisha Information display device for vehicle
JP3522317B2 (en) 1993-12-27 2004-04-26 富士重工業株式会社 Travel guide device for vehicles
US5430431A (en) 1994-01-19 1995-07-04 Nelson; Louis J. Vehicle protection system and method
US5471515A (en) 1994-01-28 1995-11-28 California Institute Of Technology Active pixel sensor with intra-pixel charge transfer
US5461361A (en) 1994-03-11 1995-10-24 Chrysler Corporation Automotive instrument panel apparatus
JP3358099B2 (en) 1994-03-25 2002-12-16 オムロン株式会社 Optical sensor device
US5537003A (en) 1994-04-08 1996-07-16 Gentex Corporation Control system for automotive vehicle headlamps and other vehicle equipment
FR2718874B1 (en) 1994-04-15 1996-05-15 Thomson Csf Traffic monitoring method for automatic detection of vehicle incidents.
US5963247A (en) 1994-05-31 1999-10-05 Banitt; Shmuel Visual display systems and a system for producing recordings for visualization thereon and methods therefor
ES1028357Y (en) 1994-06-03 1995-06-16 Cortes Luis Leon Lamata RECEIVING DEVICE FOR REAR VIEW SCREEN.
JP3287117B2 (en) 1994-07-05 2002-05-27 株式会社日立製作所 Environment recognition device for vehicles using imaging device
JP3357749B2 (en) 1994-07-12 2002-12-16 本田技研工業株式会社 Vehicle road image processing device
US6001486A (en) 1994-07-29 1999-12-14 Donnelly Corporation Transparent substrate with diffuser surface
US5793420A (en) 1994-10-28 1998-08-11 Schmidt; William P. Video recording system for vehicle
US5671996A (en) 1994-12-30 1997-09-30 Donnelly Corporation Vehicle instrumentation/console lighting
US5528698A (en) 1995-03-27 1996-06-18 Rockwell International Corporation Automotive occupant sensing device
JP3539788B2 (en) 1995-04-21 2004-07-07 パナソニック モバイルコミュニケーションズ株式会社 Image matching method
US5500766A (en) 1995-05-04 1996-03-19 Stonecypher; Bob Blind spot side mirror
US5737226A (en) 1995-06-05 1998-04-07 Prince Corporation Vehicle compass system with automatic calibration
US7085637B2 (en) 1997-10-22 2006-08-01 Intelligent Technologies International, Inc. Method and system for controlling a vehicle
US7202776B2 (en) 1997-10-22 2007-04-10 Intelligent Technologies International, Inc. Method and system for detecting objects external to a vehicle
JP3546600B2 (en) 1995-09-07 2004-07-28 トヨタ自動車株式会社 Light distribution control device for headlamp
US5724316A (en) 1995-09-26 1998-03-03 Delco Electronics Corporation GPS based time determining system and method
US5940120A (en) 1995-10-20 1999-08-17 Prince Corporation Vanity console
AU1084397A (en) 1995-12-01 1997-06-19 Southwest Research Institute Methods and apparatus for traffic incident detection
US5878370A (en) 1995-12-01 1999-03-02 Prince Corporation Vehicle compass system with variable resolution
US5971552A (en) 1995-12-08 1999-10-26 Donnelly Corporation Vehicle global positioning system
US6266082B1 (en) 1995-12-19 2001-07-24 Canon Kabushiki Kaisha Communication apparatus image processing apparatus communication method and image processing method
US5790973A (en) 1995-12-19 1998-08-04 Prince Corporation Last exit warning system
US5761094A (en) 1996-01-18 1998-06-02 Prince Corporation Vehicle compass system
US5786772A (en) 1996-03-22 1998-07-28 Donnelly Corporation Vehicle blind spot detection display system
US5760826A (en) 1996-05-10 1998-06-02 The Trustees Of Columbia University Omnidirectional imaging apparatus
JP3805832B2 (en) 1996-07-10 2006-08-09 富士重工業株式会社 Vehicle driving support device
US5798575A (en) 1996-07-11 1998-08-25 Donnelly Corporation Vehicle mirror digital network and dynamically interactive mirror system
JPH1059068A (en) 1996-08-23 1998-03-03 Yoshihisa Furuta Dead angle confirmation device for vehicle
JPH10161013A (en) 1996-12-05 1998-06-19 Canon Inc Environment recognition device and camera equipped with environment recognition device
WO1998026506A1 (en) 1996-12-10 1998-06-18 Caldwell David W Differential touch sensors and control circuit therefor
US5877707A (en) 1997-01-17 1999-03-02 Kowalick; Thomas M. GPS based seat belt monitoring system & method for using same
US5844505A (en) 1997-04-01 1998-12-01 Sony Corporation Automobile navigation system
US5923027A (en) 1997-09-16 1999-07-13 Gentex Corporation Moisture sensor and windshield fog detector using an image sensor
US6049171A (en) 1998-09-18 2000-04-11 Gentex Corporation Continuously variable headlamp control
US6631316B2 (en) 2001-03-05 2003-10-07 Gentex Corporation Image processing system to control vehicle headlamps or other vehicle equipment
US5990469A (en) 1997-04-02 1999-11-23 Gentex Corporation Control circuit for image array sensors
US6611610B1 (en) 1997-04-02 2003-08-26 Gentex Corporation Vehicle lamp control
US5837994C1 (en) 1997-04-02 2001-10-16 Gentex Corp Control system to automatically dim vehicle head lamps
JP3508909B2 (en) 1997-07-01 2004-03-22 株式会社村上開明堂 Rearview mirror quick deflection controller
US5956181A (en) 1997-07-18 1999-09-21 Lin; William Two way mirror with dual functions of rear view mirror and video displayer
US6172613B1 (en) 1998-02-18 2001-01-09 Donnelly Corporation Rearview mirror assembly incorporating vehicle information display
US6124886A (en) 1997-08-25 2000-09-26 Donnelly Corporation Modular rearview mirror assembly
US6250148B1 (en) 1998-01-07 2001-06-26 Donnelly Corporation Rain sensor mount for use in a vehicle
US6087953A (en) 1998-02-18 2000-07-11 Donnelly Corporation Rearview mirror support incorporating vehicle information display
US6326613B1 (en) 1998-01-07 2001-12-04 Donnelly Corporation Vehicle interior mirror assembly adapted for containing a rain sensor
US5914815A (en) 1997-08-29 1999-06-22 Donnelly Corporation Optical rearview system for vehicle
US6313454B1 (en) 1999-07-02 2001-11-06 Donnelly Corporation Rain sensor
DE69836344T2 (en) 1997-10-30 2007-05-31 Donnelly Corp., Holland RAIN SENSOR WITH FOG IDENTIFICATION
US6020704A (en) 1997-12-02 2000-02-01 Valeo Electrical Systems, Inc. Windscreen sensing and wiper control system
US6124647A (en) 1998-12-16 2000-09-26 Donnelly Corporation Information display in a rearview mirror
US6243003B1 (en) 1999-08-25 2001-06-05 Donnelly Corporation Accessory module for vehicle
US6294989B1 (en) 1998-12-16 2001-09-25 Donnelly Corporation Tire inflation assistance monitoring system
US5899956A (en) 1998-03-31 1999-05-04 Advanced Future Technologies, Inc. Vehicle mounted navigation device
US6477464B2 (en) 2000-03-09 2002-11-05 Donnelly Corporation Complete mirror-based global-positioning system (GPS) navigation solution
US6329925B1 (en) 1999-11-24 2001-12-11 Donnelly Corporation Rearview mirror assembly with added feature modular display
US6420975B1 (en) 1999-08-25 2002-07-16 Donnelly Corporation Interior rearview mirror sound processing system
US6428172B1 (en) 1999-11-24 2002-08-06 Donnelly Corporation Rearview mirror assembly with utility functions
US6158655A (en) 1998-04-08 2000-12-12 Donnelly Corporation Vehicle mounted remote transaction interface system
JPH11331822A (en) 1998-05-15 1999-11-30 Matsushita Electric Ind Co Ltd Surveillance camera device
US6175300B1 (en) 1998-09-03 2001-01-16 Byron K. Kendrick Blind spot viewing system
GB9820622D0 (en) 1998-09-23 1998-11-18 Britax Geco Sa Vehicle exterior mirror with antenna
US6066933A (en) 1998-10-02 2000-05-23 Ponziana; Richard L. Rain sensing system and method having automatically registered and oriented rain sensor
US6266442B1 (en) 1998-10-23 2001-07-24 Facet Technology Corp. Method and apparatus for identifying objects depicted in a videostream
US6201642B1 (en) 1999-07-27 2001-03-13 Donnelly Corporation Vehicular vision system with a wide angle lens including a diffractive element
US6717610B1 (en) 1998-11-25 2004-04-06 Donnelly Corporation Wide angle image capture system for vehicle
JP3183284B2 (en) 1999-01-19 2001-07-09 株式会社豊田自動織機製作所 Steering support device for reversing a vehicle
US6320282B1 (en) 1999-01-19 2001-11-20 Touchsensor Technologies, Llc Touch switch with integral control circuit
DE19902081A1 (en) 1999-01-20 2000-07-27 Zeiss Carl Fa Stabilized camera
US6166698A (en) 1999-02-16 2000-12-26 Gentex Corporation Rearview mirror with integrated microwave receiver
US6144022A (en) 1999-03-15 2000-11-07 Valeo Electrical Systems, Inc. Rain sensor using statistical analysis
US6333759B1 (en) 1999-03-16 2001-12-25 Joseph J. Mazzilli 360 ° automobile video camera system
US6513252B1 (en) 1999-04-08 2003-02-04 Donnelly Corporation Vehicle compass compensation
US7366595B1 (en) 1999-06-25 2008-04-29 Seiko Epson Corporation Vehicle drive assist system
US6757109B2 (en) 1999-07-27 2004-06-29 Donnelly Corporation Plastic lens system for vehicle imaging system
US6515781B2 (en) 1999-08-05 2003-02-04 Microvision, Inc. Scanned imaging apparatus with switched feeds
US6433907B1 (en) 1999-08-05 2002-08-13 Microvision, Inc. Scanned display with plurality of scanning assemblies
US6795221B1 (en) 1999-08-05 2004-09-21 Microvision, Inc. Scanned display with switched feeds and distortion correction
DE19940723A1 (en) 1999-08-27 2001-03-08 Daimler Chrysler Ag Method for displaying a perspective image and display device for at least one occupant of a vehicle
US6116743A (en) 1999-09-20 2000-09-12 Donnelly Corporation Extendable exterior rearview mirror assembly for vehicles
US6483429B1 (en) 1999-10-21 2002-11-19 Matsushita Electric Industrial Co., Ltd. Parking assistance system
US6411204B1 (en) 1999-11-15 2002-06-25 Donnelly Corporation Deceleration based anti-collision safety light control for vehicle
SE520360C2 (en) 1999-12-15 2003-07-01 Goeran Sjoenell Warning device for vehicles
JP3575364B2 (en) 1999-12-28 2004-10-13 株式会社豊田自動織機 Steering support device
US6526335B1 (en) 2000-01-24 2003-02-25 G. Victor Treyz Automobile personal computer systems
DE10003643A1 (en) 2000-01-28 2001-08-02 Reitter & Schefenacker Gmbh Surveillance device for automobile uses camera behind mirror glass which reflects light in visible wavelength spectrum
JP2001213254A (en) 2000-01-31 2001-08-07 Yazaki Corp Vehicle side monitoring system
US7370983B2 (en) 2000-03-02 2008-05-13 Donnelly Corporation Interior mirror assembly with display
WO2001064481A2 (en) 2000-03-02 2001-09-07 Donnelly Corporation Video mirror systems incorporating an accessory module
US7167796B2 (en) 2000-03-09 2007-01-23 Donnelly Corporation Vehicle navigation system for use with a telematics system
WO2004058540A2 (en) 2002-12-20 2004-07-15 Donnelly Corporation Accessory system for vehicle
KR100373002B1 (en) 2000-04-03 2003-02-25 현대자동차주식회사 Method for judgment out of lane of vehicle
US6648477B2 (en) 2000-07-06 2003-11-18 Donnelly Corporation Rearview mirror assembly with information display
GB2369451B (en) 2000-07-27 2002-07-17 Michael John Downs Jamin-type interferometers
US6627918B2 (en) 2000-09-22 2003-09-30 Donnelly Corporation Spacer elements for interactive information devices and method for making same
JP3521860B2 (en) 2000-10-02 2004-04-26 日産自動車株式会社 Vehicle travel path recognition device
US7062300B1 (en) 2000-11-09 2006-06-13 Ki Il Kim Cellular phone holder with charger mounted to vehicle dashboard
US6672731B2 (en) 2000-11-20 2004-01-06 Donnelly Corporation Vehicular rearview mirror with blind spot viewing system
AU2002251807A1 (en) 2001-01-23 2002-08-19 Donnelly Corporation Improved vehicular lighting system for a mirror assembly
US20020113873A1 (en) 2001-02-20 2002-08-22 Williams Michael R. Rear vision system for large vehicles
US6424273B1 (en) 2001-03-30 2002-07-23 Koninklijke Philips Electronics N.V. System to aid a driver to determine whether to change lanes
DE10118265A1 (en) 2001-04-12 2002-10-17 Bosch Gmbh Robert Detecting vehicle lane change, involves forming track change indicating signal by comparing measured angular rate of preceding vehicle(s) with vehicle's own yaw rate
US6539306B2 (en) 2001-06-15 2003-03-25 Gentex Corporation Automotive mirror with integrated Loran components
US6497503B1 (en) 2001-06-21 2002-12-24 Ford Global Technologies, Inc. Headlamp system with selectable beam pattern
US6485155B1 (en) 2001-07-06 2002-11-26 Bernard Duroux Multiplexing mirror
US6882287B2 (en) 2001-07-31 2005-04-19 Donnelly Corporation Automotive lane change aid
US6589625B1 (en) 2001-08-01 2003-07-08 Iridigm Display Corporation Hermetic seal and method to create the same
US6847487B2 (en) 2001-08-23 2005-01-25 Donnelly Corporation Vehicle information display
JP3947375B2 (en) 2001-08-24 2007-07-18 アイシン精機株式会社 Parking assistance device
WO2003029046A1 (en) 2001-10-03 2003-04-10 Maryann Winter Apparatus and method for sensing the occupancy status of parking spaces in a parking lot
US6636258B2 (en) 2001-10-19 2003-10-21 Ford Global Technologies, Llc 360° vision system for a vehicle
JP4108314B2 (en) 2001-10-31 2008-06-25 トヨタ自動車株式会社 Vehicle periphery monitoring device
US6909753B2 (en) 2001-12-05 2005-06-21 Koninklijke Philips Electronics, N.V. Combined MPEG-4 FGS and modulation algorithm for wireless video transmission
US20030137586A1 (en) 2002-01-22 2003-07-24 Infinite Innovations, Inc. Vehicle video switching system and method
WO2003065084A1 (en) 2002-01-31 2003-08-07 Donnelly Corporation Vehicle accessory module
US6574033B1 (en) 2002-02-27 2003-06-03 Iridigm Display Corporation Microelectromechanical systems device and method for fabricating same
US6975775B2 (en) 2002-03-06 2005-12-13 Radiant Imaging, Inc. Stray light correction method for imaging light and color measurement system
US20030222982A1 (en) 2002-03-28 2003-12-04 Hamdan Majil M. Integrated video/data information system and method for application to commercial vehicles to enhance driver awareness
US7005974B2 (en) 2002-04-19 2006-02-28 Donnelly Corporation Vehicle imaging system
US7004606B2 (en) 2002-04-23 2006-02-28 Donnelly Corporation Automatic headlamp control
US7123168B2 (en) 2002-04-25 2006-10-17 Donnelly Corporation Driving separation distance indicator
US6946978B2 (en) 2002-04-25 2005-09-20 Donnelly Corporation Imaging system for vehicle
ES2391556T3 (en) 2002-05-03 2012-11-27 Donnelly Corporation Object detection system for vehicles
EP1514246A4 (en) 2002-06-06 2008-04-16 Donnelly Corp INNER RETRIEVER SYSTEM WITH COMPASS
DE10250021A1 (en) 2002-10-25 2004-05-13 Donnelly Hohe Gmbh & Co. Kg Operating method for automobile visual representation system for locating parking bay evaluating images from onboard camera
JP4427953B2 (en) 2003-01-29 2010-03-10 株式会社豊田自動織機 Parking assistance device
DE10346508B4 (en) 2003-10-02 2007-10-11 Daimlerchrysler Ag Device for improving the visibility in a motor vehicle
DE102004012604B4 (en) 2004-03-12 2006-10-12 Donnelly Hohe Gmbh & Co. Kg Method for operating a display system in a vehicle for starting a parking space
US7526103B2 (en) 2004-04-15 2009-04-28 Donnelly Corporation Imaging system for vehicle
US7227611B2 (en) 2004-08-23 2007-06-05 The Boeing Company Adaptive and interactive scene illumination
US20060103727A1 (en) 2004-11-17 2006-05-18 Huan-Chin Tseng Vehicle back up camera
US7720580B2 (en) 2004-12-23 2010-05-18 Donnelly Corporation Object detection system for vehicle
US20060250501A1 (en) 2005-05-06 2006-11-09 Widmann Glenn R Vehicle security monitor system and method
JP2007030630A (en) 2005-07-25 2007-02-08 Aisin Aw Co Ltd Parking assist method and parking assist device
JP2007129525A (en) 2005-11-04 2007-05-24 Konica Minolta Photo Imaging Inc Camera system and controller
JP2007176324A (en) 2005-12-28 2007-07-12 Aisin Seiki Co Ltd Parking assistance device
JP4462231B2 (en) 2006-05-09 2010-05-12 株式会社デンソー Auto light device for vehicle
JP2008143430A (en) 2006-12-12 2008-06-26 Toyota Motor Corp Parking assistance device
US7914187B2 (en) 2007-07-12 2011-03-29 Magna Electronics Inc. Automatic lighting system with adaptive alignment function
US8451107B2 (en) 2007-09-11 2013-05-28 Magna Electronics, Inc. Imaging system for vehicle
TWI372564B (en) 2007-10-30 2012-09-11 Av Tech Corp Video system, image emission apparatus, video receiver apparatus and control method
JP4433060B2 (en) 2008-02-18 2010-03-17 トヨタ自動車株式会社 Parking assistance device
US8874317B2 (en) 2009-07-27 2014-10-28 Magna Electronics Inc. Parking assist system
US9146898B2 (en) 2011-10-27 2015-09-29 Magna Electronics Inc. Driver assist system with algorithm switching
US20150022664A1 (en) 2012-01-20 2015-01-22 Magna Electronics Inc. Vehicle vision system with positionable virtual viewpoint
DE102013217430A1 (en) 2012-09-04 2014-03-06 Magna Electronics, Inc. Driver assistance system for a motor vehicle
US9800794B2 (en) * 2013-06-03 2017-10-24 Magna Electronics Inc. Vehicle vision system with enhanced low light capabilities
US20140375476A1 (en) 2013-06-24 2014-12-25 Magna Electronics Inc. Vehicle alert system
US9619716B2 (en) 2013-08-12 2017-04-11 Magna Electronics Inc. Vehicle vision system with image classification
US9881220B2 (en) 2013-10-25 2018-01-30 Magna Electronics Inc. Vehicle vision system utilizing communication system
US9499139B2 (en) 2013-12-05 2016-11-22 Magna Electronics Inc. Vehicle monitoring system
US9688199B2 (en) 2014-03-04 2017-06-27 Magna Electronics Inc. Vehicle alert system utilizing communication system
US10328932B2 (en) 2014-06-02 2019-06-25 Magna Electronics Inc. Parking assist system with annotated map generation
US10356337B2 (en) 2014-10-07 2019-07-16 Magna Electronics Inc. Vehicle vision system with gray level transition sensitive pixels
US10043091B2 (en) 2014-12-05 2018-08-07 Magna Electronics Inc. Vehicle vision system with retroreflector pattern recognition
US10214206B2 (en) 2015-07-13 2019-02-26 Magna Electronics Inc. Parking assist system for vehicle
US10078789B2 (en) 2015-07-17 2018-09-18 Magna Electronics Inc. Vehicle parking assist system with vision-based parking space detection
US10086870B2 (en) 2015-08-18 2018-10-02 Magna Electronics Inc. Trailer parking assist system for vehicle
US10331956B2 (en) * 2015-09-23 2019-06-25 Magna Electronics Inc. Vehicle vision system with detection enhancement using light control
US10160437B2 (en) 2016-02-29 2018-12-25 Magna Electronics Inc. Vehicle control system with reverse assist
US20170253237A1 (en) * 2016-03-02 2017-09-07 Magna Electronics Inc. Vehicle vision system with automatic parking function

Patent Citations (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6704621B1 (en) * 1999-11-26 2004-03-09 Gideon P. Stein System and method for estimating ego-motion of a moving vehicle using successive images recorded along the vehicle's path of motion
US6476730B2 (en) * 2000-02-29 2002-11-05 Aisin Seiki Kabushiki Kaisha Assistant apparatus and method for a vehicle in reverse motion
US20050171654A1 (en) * 2004-01-29 2005-08-04 Nichols William M. Automatic taxi manager
US20050285758A1 (en) * 2004-06-23 2005-12-29 Denso Corporation Parking assistance system
US20100222925A1 (en) * 2004-12-03 2010-09-02 Takashi Anezaki Robot control apparatus
US20100013670A1 (en) * 2005-07-26 2010-01-21 Martin Hueppauff Parking apparatus
US20070198145A1 (en) * 2005-10-21 2007-08-23 Norris William R Systems and methods for switching between autonomous and manual operation of a vehicle
US20080032706A1 (en) * 2006-08-01 2008-02-07 Leonid Sheynblat System And/Or Method For Providing Information Updates To A Location Server
US8285479B2 (en) * 2007-03-08 2012-10-09 Toyota Jidosha Kabushiki Kaisha Parking assist apparatus
US9002581B2 (en) * 2009-08-18 2015-04-07 Crown Equipment Corporation Object tracking and steer maneuvers for materials handling vehicles
US20110080304A1 (en) * 2009-10-07 2011-04-07 Ford Global Technologies, Llc Vehicle Park Assist System and Method for Parking a Vehicle Using Such System
US20120239238A1 (en) * 2011-03-18 2012-09-20 Harvey Dean S Communication technique by which an autonomous guidance system controls an industrial vehicle
US20120239224A1 (en) * 2011-03-18 2012-09-20 Mccabe Paul P Integration of an autonomous industrial vehicle into an asset management system
US20140267608A1 (en) * 2011-10-10 2014-09-18 Universite Blaise Pasca-Clermont Ii Method of calibrating a computer-based vision system onboard a craft
US20130231824A1 (en) * 2012-03-05 2013-09-05 Florida A&M University Artificial Intelligence Valet Systems and Methods
US20130278769A1 (en) * 2012-03-23 2013-10-24 Magna Electronics Inc. Vehicle vision system with accelerated object confirmation
US20150203111A1 (en) * 2012-08-10 2015-07-23 Daimler Ag Method for Carrying Out a Process of Parking a Vehicle by Means of a Driver Assistance System
US20140052336A1 (en) * 2012-08-15 2014-02-20 GM Global Technology Operations LLC Directing vehicle into feasible region for autonomous and semi-autonomous parking
US20150217763A1 (en) * 2012-08-23 2015-08-06 Audi Ag Method for controlling an autonomous vehicle system and motor vehicle
US20140180523A1 (en) * 2012-12-22 2014-06-26 Audi Ag Driver assistance system and method for authorizing an autonomous or piloted garage parking
US20140270345A1 (en) * 2013-03-12 2014-09-18 Qualcomm Incorporated Method and apparatus for movement estimation
US20140343830A1 (en) * 2013-05-20 2014-11-20 Ford Global Technologies, Llc Stop/start control based on repeated driving patterns
US20140365032A1 (en) * 2013-06-05 2014-12-11 Hyundai Motor Company Apparatus, method, and system for assisting remote parking
US20160274588A1 (en) * 2013-11-11 2016-09-22 Murata Machinery, Ltd. Autonomous traveling vehicle and reproduction travel method
US20150226146A1 (en) * 2014-02-07 2015-08-13 Ford Global Technologies, Llc Walk-away vehicle shutdown
US9739226B2 (en) * 2014-02-07 2017-08-22 Ford Global Technologies, Llc Walk-away vehicle shutdown
US20150241241A1 (en) * 2014-02-27 2015-08-27 International Business Machines Corporation Identifying cost-effective parking for an autonomous vehicle
US20170008490A1 (en) * 2014-04-01 2017-01-12 Mico Latta Inc. Vehicle and program for vehicle
US20170123423A1 (en) * 2014-04-30 2017-05-04 Mico Latta Inc. Automatic driving vehicle and program for automatic driving vehicle
US20160115702A1 (en) * 2014-10-27 2016-04-28 Robert Bosch Gmbh Method for operating a towing robot
US20170313305A1 (en) * 2014-10-27 2017-11-02 Robert Bosch Gmbh Method for carrying out an automatic parking process of a vehicle
US20170232891A1 (en) * 2014-10-27 2017-08-17 Robert Bosch Gmbh Method and device for operating a vehicle and a parking lot
US20170308095A1 (en) * 2014-10-27 2017-10-26 Robert Bosch Gmbh Method and device for guiding a vehicle in a parking lot
US20170309177A1 (en) * 2014-10-27 2017-10-26 Robert Bosch Gmbh Method and device for operating a parking lot
US9944282B1 (en) * 2014-11-13 2018-04-17 State Farm Mutual Automobile Insurance Company Autonomous vehicle automatic parking
US20170323565A1 (en) * 2014-11-26 2017-11-09 Robert Bosch Gmbh Parking facility management server for a parking facility
US20170313307A1 (en) * 2014-11-26 2017-11-02 Robert Bosch Gmbh Server for operating a parking facility
US20170305467A1 (en) * 2014-11-26 2017-10-26 Robert Bosch Gmbh Method and apparatus for the assisted guidance of a vehicle
US20180063285A1 (en) * 2015-03-11 2018-03-01 Robert Bosch Gmbh Method for operating a server
US20150346727A1 (en) * 2015-08-12 2015-12-03 Madhusoodhan Ramanujam Parking Autonomous Vehicles
US20180304887A1 (en) * 2015-10-22 2018-10-25 Robert Bosch Gmbh Method and device for reducing a risk of a collision of a motor vehicle with an object
US20180315393A1 (en) * 2015-12-21 2018-11-01 Bayerische Motoren Werke Aktiengesellschaft Display Device and Method for Controlling a Display Device
US20170200321A1 (en) * 2016-01-07 2017-07-13 Google Inc. Reputation Systems in Ride Share Platforms
US20170329331A1 (en) * 2016-05-16 2017-11-16 Magna Electronics Inc. Control system for semi-autonomous control of vehicle along learned route
US20180194344A1 (en) * 2016-07-29 2018-07-12 Faraday&Future Inc. System and method for autonomous vehicle navigation
US20180037136A1 (en) * 2016-08-02 2018-02-08 Here Global B.V. Vehicle charging lanes
US20180056504A1 (en) * 2016-08-25 2018-03-01 Industrial Technology Research Institute Teaching apparatus for manipulator
US10133273B2 (en) * 2016-09-20 2018-11-20 2236008 Ontario Inc. Location specific assistance for autonomous vehicle control system
US20180328750A1 (en) * 2017-05-12 2018-11-15 Lg Electronics Inc. Autonomous vehicle and method of controlling the same
US20190016331A1 (en) * 2017-07-14 2019-01-17 Nio Usa, Inc. Programming complex parking maneuvers for driverless vehicles
US20190016384A1 (en) * 2017-07-14 2019-01-17 Nio Usa, Inc Control of complex parking maneuvers and autonomous fuel replenishment of driverless vehicles
US20190080482A1 (en) * 2017-09-14 2019-03-14 Robert Bosch Gmbh Method and apparatus for data reduction of feature-based environment information of a driver assistance system
US20190105960A1 (en) * 2017-10-11 2019-04-11 Ford Global Technologies, Llc System and method for evaporative emissions detection
US20190347934A1 (en) * 2018-05-14 2019-11-14 Denso Corporation Parking system

Cited By (120)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10078789B2 (en) 2015-07-17 2018-09-18 Magna Electronics Inc. Vehicle parking assist system with vision-based parking space detection
US20210107561A1 (en) * 2015-08-18 2021-04-15 Magna Electronics Inc. Vehicular driving assist system
US11673605B2 (en) * 2015-08-18 2023-06-13 Magna Electronics Inc. Vehicular driving assist system
US11625802B1 (en) 2016-01-22 2023-04-11 State Farm Mutual Automobile Insurance Company Coordinated autonomous vehicle automatic area scanning
US12055399B2 (en) 2016-01-22 2024-08-06 State Farm Mutual Automobile Insurance Company Autonomous vehicle trip routing
US11719545B2 (en) 2016-01-22 2023-08-08 Hyundai Motor Company Autonomous vehicle component damage and salvage assessment
US12345536B2 (en) 2016-01-22 2025-07-01 State Farm Mutual Automobile Insurance Company Smart home sensor malfunction detection
US11682244B1 (en) 2016-01-22 2023-06-20 State Farm Mutual Automobile Insurance Company Smart home sensor malfunction detection
US11879742B2 (en) 2016-01-22 2024-01-23 State Farm Mutual Automobile Insurance Company Autonomous vehicle application
US11656978B1 (en) 2016-01-22 2023-05-23 State Farm Mutual Automobile Insurance Company Virtual testing of autonomous environment control system
US11920938B2 (en) 2016-01-22 2024-03-05 Hyundai Motor Company Autonomous electric vehicle charging
US12359927B2 (en) 2016-01-22 2025-07-15 State Farm Mutual Automobile Insurance Company Autonomous vehicle component maintenance and repair
US11440494B1 (en) 2016-01-22 2022-09-13 State Farm Mutual Automobile Insurance Company Detecting and responding to autonomous vehicle incidents
US12313414B2 (en) 2016-01-22 2025-05-27 State Farm Mutual Automobile Insurance Company Autonomous vehicle application
US11126184B1 (en) * 2016-01-22 2021-09-21 State Farm Mutual Automobile Insurance Company Autonomous vehicle parking
US11242051B1 (en) 2016-01-22 2022-02-08 State Farm Mutual Automobile Insurance Company Autonomous vehicle action communications
US11189112B1 (en) 2016-01-22 2021-11-30 State Farm Mutual Automobile Insurance Company Autonomous vehicle sensor malfunction detection
US11600177B1 (en) 2016-01-22 2023-03-07 State Farm Mutual Automobile Insurance Company Autonomous vehicle application
US12104912B2 (en) 2016-01-22 2024-10-01 State Farm Mutual Automobile Insurance Company Coordinated autonomous vehicle automatic area scanning
US11526167B1 (en) 2016-01-22 2022-12-13 State Farm Mutual Automobile Insurance Company Autonomous vehicle component maintenance and repair
US11348193B1 (en) 2016-01-22 2022-05-31 State Farm Mutual Automobile Insurance Company Component damage and salvage assessment
US12111165B2 (en) 2016-01-22 2024-10-08 State Farm Mutual Automobile Insurance Company Autonomous vehicle retrieval
US11511736B1 (en) 2016-01-22 2022-11-29 State Farm Mutual Automobile Insurance Company Autonomous vehicle retrieval
US11513521B1 (en) 2016-01-22 2022-11-29 State Farm Mutual Automobile Insurance Copmany Autonomous vehicle refueling
US11441916B1 (en) 2016-01-22 2022-09-13 State Farm Mutual Automobile Insurance Company Autonomous vehicle trip routing
US12174027B2 (en) 2016-01-22 2024-12-24 State Farm Mutual Automobile Insurance Company Detecting and responding to autonomous vehicle incidents and unusual conditions
US10773707B2 (en) 2016-02-29 2020-09-15 Magna Electronics Inc. Vehicle control system with reverse assist
US10160437B2 (en) 2016-02-29 2018-12-25 Magna Electronics Inc. Vehicle control system with reverse assist
US11400919B2 (en) * 2016-03-02 2022-08-02 Magna Electronics Inc. Vehicle vision system with autonomous parking function
US10486742B2 (en) 2016-08-01 2019-11-26 Magna Electronics Inc. Parking assist system using light projections
US11613308B2 (en) 2016-08-01 2023-03-28 Magna Electronics Inc. Vehicular lighting system using light projections
US11014561B2 (en) 2017-02-01 2021-05-25 Magna Electronics Inc. Vehicle trailer hitch assist system
US11634136B2 (en) 2017-02-01 2023-04-25 Magna Electronics Inc. Vehicular trailer hitching assist system
US11034295B2 (en) 2017-02-02 2021-06-15 Magna Electronics Inc. Vehicle vision system using at least two cameras
US11648877B2 (en) 2017-02-02 2023-05-16 Magna Electronics Inc. Method for detecting an object via a vehicular vision system
US10625733B2 (en) * 2017-04-18 2020-04-21 International Business Machines Corporation Delayed parking optimization of autonomous vehicles
US20180297588A1 (en) * 2017-04-18 2018-10-18 International Business Machines Corporation Delayed parking optimization of autonomous vehicles
US11136034B2 (en) * 2017-06-20 2021-10-05 Nissan Motor Co., Ltd. Travel control method and travel control device
US11091155B2 (en) * 2017-08-10 2021-08-17 Nissan Motor Co., Ltd. Parking control method and parking control device
US11067993B2 (en) 2017-08-25 2021-07-20 Magna Electronics Inc. Vehicle and trailer maneuver assist system
US12397857B2 (en) 2017-08-25 2025-08-26 Magna Electronics Inc. Vehicle and trailer maneuver assist system
US12001213B2 (en) 2017-08-25 2024-06-04 Magna Electronics Inc. Vehicle and trailer maneuver assist system
US11338798B2 (en) 2017-09-19 2022-05-24 Guangzhou Automobile Group Co., Ltd. Full-automatic parking method and system
WO2019056872A1 (en) * 2017-09-19 2019-03-28 广州汽车集团股份有限公司 Fully automated parking method, and fully automated parking system
US20190094025A1 (en) * 2017-09-27 2019-03-28 Jaguar Land Rover Limited Apparatus and method for localising a vehicle
US11614738B2 (en) 2017-10-02 2023-03-28 Toyota Jidosha Kabushiki Kaisha Managing apparatus
US11782441B2 (en) 2017-10-02 2023-10-10 Toyota Jidosha Kabushiki Kaisha Managing apparatus
US10583779B2 (en) 2017-10-02 2020-03-10 Magna Electronics Inc. Parking assist system using backup camera
US12045053B2 (en) 2017-10-02 2024-07-23 Toyota Jidosha Kabushiki Kaisha Managing apparatus
US10974649B2 (en) 2017-10-02 2021-04-13 Magna Electronics Inc. Vehicular parking assist system using backup camera
US10845807B2 (en) * 2017-10-02 2020-11-24 Toyota Jidosha Kabushiki Kaisha Managing apparatus
US11618383B2 (en) 2017-10-12 2023-04-04 Magna Electronics Inc. Vehicular vision system with display of combined images
US11242004B2 (en) 2017-10-12 2022-02-08 Magna Electronics Inc. Method of generating images for display for vehicular vision system
US10744941B2 (en) 2017-10-12 2020-08-18 Magna Electronics Inc. Vehicle vision system with bird's eye view display
US12049253B2 (en) 2017-10-23 2024-07-30 Magna Electronics Inc. Vehicular trailer guidance system
US11584439B2 (en) 2017-10-23 2023-02-21 Magna Electronics Inc. Vehicular trailer guidance system
US10899385B2 (en) 2017-10-23 2021-01-26 Magna Electronics Inc. Vehicle and trailer backup guidance system
US12503043B2 (en) 2017-11-09 2025-12-23 Magna Electronics Inc. Vehicle communication system using projected light
CN111344215A (en) * 2017-11-14 2020-06-26 大陆汽车有限责任公司 Method for controlling a parking process of a vehicle
US11423784B2 (en) * 2017-11-14 2022-08-23 Continental Automotive Gmbh Method for controlling a parking operation of a motor vehicle
CN111344215B (en) * 2017-11-14 2023-03-03 大陆智行德国有限公司 Method for controlling a parking process of a vehicle
US11383738B2 (en) * 2018-02-08 2022-07-12 Valeo Schalter Und Sensoren Gmbh Method for operating a driving assistance system of a motor vehicle with remote-controlled manoeuvring of the motor vehicle at different automation levels and driving assistance system
GB2571152A (en) * 2018-02-15 2019-08-21 Jaguar Land Rover Ltd Vehicle Control System and Control Method
GB2571152B (en) * 2018-02-15 2020-04-22 Jaguar Land Rover Ltd Vehicle Control System and Control Method
JP2019142286A (en) * 2018-02-16 2019-08-29 トヨタ自動車株式会社 Parking assistance device
US20190258245A1 (en) * 2018-02-19 2019-08-22 Denso Ten Limited Vehicle remote operation device, vehicle remote operation system and vehicle remote operation method
CN108860139A (en) * 2018-04-11 2018-11-23 浙江零跑科技有限公司 A kind of automatic parking method for planning track based on depth enhancing study
US11377096B2 (en) * 2018-05-11 2022-07-05 Guangzhou Automobile Group Co., Ltd. Automatic parking method and device
US11273868B2 (en) 2018-07-16 2022-03-15 Magna Electronics Inc. Vehicular trailer assist system
US11708111B2 (en) 2018-07-16 2023-07-25 Magna Electronics Inc. Vehicular trailer assist system
US11390270B2 (en) * 2018-08-06 2022-07-19 Panasonic Intellectual Property Management Co., Ltd. Parking assistance apparatus
US11807226B2 (en) 2018-08-06 2023-11-07 Panasonic Intellectual Property Management Co., Ltd. Parking assistance apparatus
CN109067925A (en) * 2018-10-09 2018-12-21 北京智行者科技有限公司 A kind of method and system of parking of remote control
US20220041184A1 (en) * 2018-10-18 2022-02-10 Caratica Ai Ltd. Method and system for obstacle detection
US12085940B2 (en) 2018-11-12 2024-09-10 Robotic Research Opco, Llc Autonomous truck loading for mining and construction applications
US11644843B2 (en) * 2018-11-12 2023-05-09 Robotic Research Opco, Llc Learning mechanism for autonomous trucks for mining and construction applications
US11656626B2 (en) 2018-11-12 2023-05-23 Robotic Research Opco, Llc Autonomous truck loading for mining and construction applications
US11353865B2 (en) 2018-11-13 2022-06-07 Robotic Research Opco, Llc Coordination of mining and construction vehicles via scripting control
CN111301403A (en) * 2018-12-06 2020-06-19 现代自动车株式会社 System, method, infrastructure and vehicle for automated valet parking
US11267459B2 (en) * 2018-12-06 2022-03-08 Hyundai Motor Company System, method, infrastructure, and vehicle for automated valet parking
US20200192352A1 (en) * 2018-12-14 2020-06-18 Valeo Schalter Und Sensoren Gmbh Remote operation of vehicles in close-quarter environments
US10908604B2 (en) * 2018-12-14 2021-02-02 Valeo Schalter Und Sensoren Gmbh Remote operation of vehicles in close-quarter environments
US10745002B2 (en) * 2018-12-31 2020-08-18 Robert Bosch Gmbh Autonomously guiding a vehicle to a desired parking location selected with a remote device
US20200207333A1 (en) * 2018-12-31 2020-07-02 Robert Bosch Gmbh Autonomously guiding a vehicle to a desired parking location selected with a remote device
US12024161B2 (en) 2019-01-10 2024-07-02 Magna Electronics Inc. Vehicular control system
US11753002B2 (en) 2019-01-10 2023-09-12 Magna Electronics Inc. Vehicular control system
US11332124B2 (en) 2019-01-10 2022-05-17 Magna Electronics Inc. Vehicular control system
CN111796591A (en) * 2019-03-19 2020-10-20 本田技研工业株式会社 Vehicle control device, monitoring system, vehicle control method, and storage medium
US11987287B2 (en) 2019-04-12 2024-05-21 Continental Autonomous Mobility US, LLC Autonomous truck-trailer maneuvering and parking
US11948460B2 (en) * 2019-06-14 2024-04-02 Toyota Motor North America, Inc. Parking monitoring and assistance for transports
US20210166562A1 (en) * 2019-06-14 2021-06-03 Toyota Motor North America, Inc. Parking monitoring and assistance for transports
US20240194070A1 (en) * 2019-06-14 2024-06-13 Toyota Motor North America, Inc. Parking monitoring and assistance for transports
US20230245562A1 (en) * 2019-06-14 2023-08-03 Toyota Motor North America, Inc. Parking monitoring and assistance for transports
US11626019B2 (en) * 2019-06-14 2023-04-11 Toyota Motor North America, Inc. Parking monitoring and assistance for transports
US12293664B2 (en) * 2019-06-14 2025-05-06 Toyota Motor North America, Inc. Parking monitoring and assistance for transports
US11560143B2 (en) 2020-05-26 2023-01-24 Magna Electronics Inc. Vehicular autonomous parking system using short range communication protocols
US20220060654A1 (en) * 2020-08-18 2022-02-24 Toyota Jidosha Kabushiki Kaisha Image recording device for a vehicle and image recording method for a vehicle
US11546547B2 (en) * 2020-08-18 2023-01-03 Toyota Jidosha Kabushiki Kaisha Image recording device for a vehicle and image recording method for a vehicle
US11721113B2 (en) 2020-10-09 2023-08-08 Magna Electronics Inc. Vehicular driving assist system with lane detection using rear camera
US12194923B2 (en) 2020-11-04 2025-01-14 Magna Electronics Inc. Vehicular trailer hitching assist system with hitch ball location estimation
CN114715102A (en) * 2021-01-05 2022-07-08 广州汽车集团股份有限公司 Vehicle redundant braking method and vehicle
JP2022133181A (en) * 2021-03-01 2022-09-13 パナソニックIpマネジメント株式会社 Parking support device and parking support method
US12545239B2 (en) 2021-03-01 2026-02-10 Panasonic Automotive Systems Co., Ltd. Parking assistance device, parking assistance method, and computer-readable medium
JP7638586B2 (en) 2021-03-01 2025-03-04 パナソニックオートモーティブシステムズ株式会社 Parking assistance device and parking assistance method
US12515640B2 (en) 2021-03-01 2026-01-06 Panasonic Automotive Systems Co., Ltd. Parking assistance device, parking assistance method, and computer-readable medium
US11414069B1 (en) * 2021-03-18 2022-08-16 Pixart Imaging Inc. Method for parking guidance and parking guidance system
EP4059815B1 (en) * 2021-03-19 2025-07-30 Ford Global Technologies, LLC Method of providing driver assistance in a vehicle, and park assist system
US12146754B2 (en) 2021-03-19 2024-11-19 Ford Global Technologies, Llc User trained map for valet parking feature
EP4091910A3 (en) * 2021-05-19 2022-11-30 Guangzhou Xiaopeng Motors Technology Co., Ltd. Learning method and apparatus for parking function in autonomous driving
US11820395B2 (en) 2021-06-28 2023-11-21 Magna Electronics Inc. Vehicular driving assist system with unparking alert
CN113753029A (en) * 2021-08-27 2021-12-07 惠州华阳通用智慧车载系统开发有限公司 Automatic parking method and system based on optical flow method
US20230087202A1 (en) * 2021-09-17 2023-03-23 Ford Global Technologies, Llc Augmented Reality And Touch-Based User Engagement Parking Assist
US12252172B2 (en) 2021-09-21 2025-03-18 Magna Electronics Inc. Vehicular intelligent remote parking assist system
US12030513B2 (en) 2021-10-04 2024-07-09 Magna Electronics Inc. Vehicular door opening warning system
US12263862B2 (en) 2021-10-04 2025-04-01 Magna Electronics Inc. Vehicular parking assist system
US12366653B2 (en) 2021-10-26 2025-07-22 Magna Electronics Inc. Radar-based vehicular exterior mirror collision avoidance system
US20230138610A1 (en) * 2021-11-02 2023-05-04 Robert Bosch Gmbh Customizing Operational Design Domain of an Autonomous Driving System for a Vehicle Based on Driver's Behavior
US12539819B2 (en) 2022-04-07 2026-02-03 Magna Electronics Inc. Vehicular vision system with tailgate control
JP2024015752A (en) * 2022-07-25 2024-02-06 日産自動車株式会社 Parking support method and parking support device
US12526506B2 (en) 2023-01-30 2026-01-13 Magna Electronics Inc. Vehicular vision system with underbody object detection

Also Published As

Publication number Publication date
US20200282974A1 (en) 2020-09-10
US11400919B2 (en) 2022-08-02

Similar Documents

Publication Publication Date Title
US11400919B2 (en) Vehicle vision system with autonomous parking function
US11603041B2 (en) Vehicle hatch clearance determining system
US20200130676A1 (en) Autonomous vehicle parking system
US10803329B2 (en) Vehicular control system
US11104327B2 (en) Method for automated parking of a vehicle
US10852741B2 (en) Using cameras for detecting objects near a vehicle
US11067993B2 (en) Vehicle and trailer maneuver assist system
EP3343438B1 (en) Automatic parking system and automatic parking method
US10528829B2 (en) Apparatus for parking vehicle and vehicle
CN110562248B (en) Automatic parking system and automatic parking method based on unmanned aerial vehicle
US20170217372A1 (en) Wireless camera system for vehicle and trailer
CN108248602B (en) Information processing apparatus, information processing method, and recording medium
US20240367652A1 (en) Vehicular vision system with determination of right-of-way at intersection
US12503043B2 (en) Vehicle communication system using projected light
US11884265B1 (en) Parking assistance method and parking assistance device
US20220176960A1 (en) Vehicular control system with vehicle control based on stored target object position and heading information
US12337843B2 (en) Vehicular control system
CN108242182B (en) Information processing apparatus, information processing method, and recording medium
JP2018531175A (en) Method for identifying a parking area for parking an automatic vehicle, driver assistance system, and automatic vehicle
JP2018531175A6 (en) Method for identifying a parking area for parking an automatic vehicle, driver assistance system, and automatic vehicle
US12252172B2 (en) Vehicular intelligent remote parking assist system
US12515711B2 (en) Vehicular autonomous parking system with enhanced path planning
US20190111918A1 (en) Vehicle system with safety features
KR20210138192A (en) Control method of automatic parking device
US12319281B2 (en) Vehicular radar system for predicting lanes using smart camera input

Legal Events

Date Code Title Description
AS Assignment

Owner name: MAGNA ELECTRONICS INC., MICHIGAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DIESSNER, HORST D.;REEL/FRAME:041594/0937

Effective date: 20170308

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION