DE102020202629B4 - Method for displaying driver assistance information during a parking process of a motor vehicle, and parking assistance system - Google Patents

Abstract

Method for displaying driver assistance information (3, 4, 5) during a parking process (6) of a motor vehicle (1) by means of a parking assistance system (2) of the motor vehicle (1), in which the driver assistance information (3, 4, 5) is displayed on a side window (10) of the motor vehicle (1) as augmented reality (19) by means of a projection device (7) of the parking assistance system (2), wherein an environment (14) of the motor vehicle (1) is detected by means of an environment detection device (8) of the parking assistance system (2), wherein the detected environment (14) is evaluated by means of an electronic computing device (9) of the parking assistance system (2), and wherein the driver assistance information (3, 4, 5) relating to the parking process (6) of the motor vehicle (1) is projected onto the side window (10) by means of the projection device (7) as a function of the evaluated environment (14), characterized in that the driver assistance information (3, 4, 5) is displayed in an exterior rearview mirror region (12) of an exterior rearview mirror (13) of the motor vehicle (1) that is visually perceptible to a driver (11) of the motor vehicle (1), so that the driver assistance information (3, 4, 5) is perceived as augmented reality (19) of the exterior rearview mirror (13), wherein information characterizing an object and/or parking space (18) located in the environment (14) detected by the environment detection device (8) is generated by means of the electronic computing device (9), and the information characterizing the object and/or the parking space (18) is displayed as driver assistance information (3, 4, 5), wherein the detected object and/or the detected parking space (18) is provided as driver assistance information (3, 4, 5) with a marker that is visually perceptible to the driver (11), so that the object reflected in the exterior mirror (13) and/or the reflected parking space (18) with the marker is perceived as augmented reality (19) on the side window (10) is perceived by the driver (11).

Description

The invention relates to a method for displaying driver assistance information during a parking maneuver of a motor vehicle using a parking assistance system of the motor vehicle. The method comprises displaying the driver assistance information on a side window of the motor vehicle as augmented reality using a projection device of the parking assistance system. The driver assistance information is displayed in an exterior rearview mirror region of an exterior rearview mirror that is visually perceptible to a driver, so that the driver assistance information is perceived as augmented reality of the exterior rearview mirror. Furthermore, the invention relates to a parking assistance system.

It is already known that a motor vehicle driver may have a limited field of vision from the vehicle. Since the driver's gaze is usually directed in the direction of travel, it is not always possible to maintain a complete overview of the situation in other directions. This is particularly the case when parking. In such cases, the driver requires support, which a modern motor vehicle with sensors and cameras can provide. In order for the driver to receive this collected information without significant distraction, the information must be processed and presented in a way that allows the driver to absorb it quickly.

The DE 10 2011 084 618 A1 discloses a driver assistance system with an exterior mirror arrangement which has a partially transparent mirror and a display device for displaying at least one optical warning signal of the driver assistance system, wherein the display device has an optical system arranged behind the partially transparent mirror which is designed to make the optical warning signal visible in the form of a virtual image visible to a driver behind the partially transparent mirror.

The DE 10 2018 003 158 A1 relates to a driver assistance system for augmenting a rearview mirror image of a vehicle, comprising a rearview mirror with a display unit and a detection unit, wherein the display unit is designed to output an orientation aid superimposed on the rearview mirror image, and wherein the detection unit is designed to detect a position angle of the rearview mirror relative to a vehicle body. Furthermore, the driver assistance system has a camera designed to record a camera image, wherein the detection range of the camera is directed at a driver of the motor vehicle seated in the vehicle, and a computing unit connected to the camera, the display unit, and the detection unit, wherein the computing unit is designed to determine a viewing position of the driver's eyes and the driver's head based on the camera image, to determine a viewing angle of the driver's eyes or the driver's head relative to the rearview mirror based on the viewing position and the position angle, to generate an orientation aid based on the viewing angle, and to transmit the orientation aid to the display unit for outputting the orientation aid.

The WO 2008 / 022 623 A1 discloses an interior rearview mirror for arrangement in the interior of a motor vehicle with a mirror element for observing the following traffic, wherein a projection device is provided on the interior rearview mirror with which a light signal can be projected onto a projection surface on the vehicle.

Dier DE 10 2012 015 002 A1 relates to a method for assisted parking of a motor vehicle in a parking space, wherein the motor vehicle has a parking device for assisted or automatic parking with environmental recognition, wherein based on the information of the parking device an avatar in the form of a virtual parking guide is generated, which is projected into the driver's field of vision when parking and directs the driver into the parking space by means of virtual gestures adapted to the current driving situation, the driver's line of sight is determined and the avatar is displayed in the windscreen, rear window, side window and/or in the rearview mirror or side mirror depending on the determined line of sight, and the avatar is projected on the line of sight of the driver's current line of sight in the exterior area of the motor vehicle.

In the DE 10 2018 211 623 A1 A method for providing additional information to a user of a vehicle is described. The vehicle has a user position for the user and a mirror. Furthermore, a window of the vehicle is arranged between the mirror and the user position. The method comprises determining additional information to be displayed to the user. Furthermore, the method comprises projecting a projection image displaying the additional information onto the window such that the projection image is visible to the user on a mirror surface of the mirror.

The object of the present invention is to provide a method and a parking assistance system by means of which improved support for the driver during driving of the motor vehicle can be realized.

This object is achieved by a method and a parking assistance system according to the independent patent claims. Advantageous embodiments are specified in the subclaims.

One aspect of the invention relates to a method for displaying driver assistance information during a parking process of a motor vehicle by means of a parking assistance system of the motor vehicle, in which method the driver assistance information is displayed on a side window of the motor vehicle as augmented reality by means of a projection device of the parking assistance system, wherein the driver assistance information is displayed in an exterior rearview mirror region of an exterior rearview mirror of the motor vehicle that is visually perceptible to a driver of the motor vehicle, so that the driver assistance information is perceived as augmented reality of the exterior rearview mirror.

It is provided that an environment of the motor vehicle is detected by means of an environment detection device of the parking assistance system, wherein the detected environment is evaluated by means of an electronic computing device of the parking assistance system, and wherein the driver assistance information relating to the parking process of the motor vehicle is projected onto the side window by means of the projection device as a function of the evaluated environment.

This makes it possible for the driver to advantageously project the driver assistance information, which in particular contains information regarding the parking process, onto the side window so that the driver assistance information can be perceived as extended reality, which can also be referred to as augmented reality (AR).

In particular, the invention makes use of the fact that the projection device can be designed, for example, as a head-up display device, wherein the head-up display device can also be referred to as a head-up display. This can be arranged, for example, in a side area of the motor vehicle, for example in a door area of the motor vehicle, and display the driver assistance information on the side window. In particular, during a parking maneuver, the driver is provided to look in the exterior rearview mirror in order to be able to perceive traffic to the side and traffic behind, so that the parking maneuver can be carried out more effectively. The driver assistance information is now displayed in such a way that it represents an image superimposed on the exterior mirror. In other words, the driver looks through the side window at the exterior mirror and perceives the driver assistance information as augmented reality on the exterior mirror.

By displaying the driver assistance information on the side window, in particular on an inner side of the side window, it can be realized in particular that the driver assistance information can be displayed independently of environmental influences.

Alternatively, the augmented reality can also be projected and displayed directly on the exterior rearview mirror, in which case the projection device is arranged in particular on the exterior rearview mirror.

In particular, safety-relevant information for the parking process is bundled in relation to the surroundings to the side and rear of the vehicle. The information is displayed at a location where the driver is looking. In particular, the driver assistance information is thus in the driver's direct field of vision during the parking process.

In particular, it can be provided that the driver assistance information can be displayed as three-dimensional driver assistance information. In particular, this can display information that could pose a danger to the driver or the vehicle, for example, when parking. When parking, for example, a vehicle in the vehicle's blind spot could be displayed as driver assistance information. Furthermore, vehicles behind the vehicle can be displayed, along with the distance and speed difference. Furthermore, a recommended course of action during the parking process can be provided.

In particular, by displaying the driver assistance information in the exterior rearview mirror area, driving assistance can be provided that is intuitively perceptible to the driver, since as soon as the driver wants to carry out a parking maneuver, he or she looks into the exterior rearview mirror and sees this information displayed.

Additionally, the driver assistance information can be provided, for example, additionally on a vehicle instrument panel or on a head-up display in the windshield. This allows the driver assistance information to be intuitively perceived by the driver in different situations.

Information characterizing an object and/or parking space located in the surroundings, detected by the environment detection device, is generated, and the information characterizing the object and/or the parking space is displayed as driver assistance information. For example, rearward traffic or objects located in the rear area are of particular importance during a parking maneuver. In particular, information relating to this rearward traffic or the object, which in the present exemplary embodiment may be another motor vehicle, can then be displayed as driver assistance information. Furthermore, pedestrians or cyclists can be recognized as dynamic objects. Static objects can also be recognized. This makes it possible to evaluate rearward traffic and display corresponding driver assistance information relating to this traffic on the side window. This enables safe parking. Furthermore, the display of the parking space can be visually supported so that the driver intuitively knows where the parking space is located. Furthermore, the parking space can be measured, for example, and if the parking space is large enough, this can be displayed. Alternatively, if the parking space is not large enough, this can also be indicated visually.

The detected object and/or the detected parking space is provided with a visually perceptible marker as driver assistance information, so that the object reflected in the exterior rearview mirror and/or the parking space with the marker is perceived by the driver as an augmented reality on the side window. For example, the perceptible marker can have a U-shape and the reflected object and/or the parking space can be "bordered" with this U-shape. The U-shape can then be red, for example, so that the object and/or the parking space with the U-shape is easily perceptible for the driver. In particular, the marker is thus superimposed on the object and/or the parking space, which are reflected. This allows the object and/or the parking space to be displayed intuitively to the driver.

Furthermore, it has proven advantageous if the detected object and/or parking space is evaluated and displayed as driver assistance information depending on the parking maneuver. For example, the current speed of the object or the size of the parking space can be displayed. Furthermore, size information relating to the object can be displayed. For example, the relative speed can be displayed as a number. This allows the driver to reliably assess whether a safe parking maneuver is feasible.

It is also advantageous if a relative distance of the object and/or parking space relative to the motor vehicle is displayed as driver assistance information. In particular, the relative distance can be displayed as a numerical value. For example, the relative distance of 20 meters between the object and/or parking space and the motor vehicle can be displayed. This allows the driver to estimate whether a safe parking maneuver can be performed.

It is also advantageous if the vehicle's future path is displayed as driver assistance information and/or the future path is determined based on the vehicle's current steering angle. This allows the driver to intuitively see the future path during the parking maneuver. This allows the driver to estimate whether, for example, there are objects in the path that could lead to a collision. This allows the parking maneuver to be reliably monitored.

Furthermore, it can be provided that a steering recommendation for the parking maneuver is displayed on a steering device of the motor vehicle as driver assistance information. For example, a steering wheel symbol can be displayed, and direction arrows can be used to communicate to the driver which steering movement they should perform in order to park in the parking space. This can advantageously support the driver during the parking maneuver.

It is also advantageous if an eye position of the driver is detected by means of an optical detection device of the parking assistance system and the position of the displayed driver assistance information is adapted to the detected eye position.

For example, the optical detection device can be a camera located in the interior of the motor vehicle and capable of detecting the driver's eye position. Furthermore, the optical detection device can be designed as an infrared thermal camera and detect the driver's eye position. This makes it possible to reliably display the driver assistance information on the side window, adapted to the driver's eye position, even when the driver is moving or when different drivers are present. This allows for improved augmented reality.

It is also advantageous if at least the projection device is provided as a head-up display device and/or the projection device is provided in a side region of the motor vehicle, in particular in a door region of the motor vehicle. In particular, an advantageous augmented reality can be presented by the head-up display device. The head-up display device can also be referred to as a head-up display. Furthermore, in particular, the projection device can be provided, for example, in a door trim of the motor vehicle. In particular, the projection device can be provided such that it is arranged in the door region and can project the driver assistance information onto the side window. This makes it possible for the driver assistance information to be displayed more effectively on the side window, since interruptions in the light beam are prevented in particular.

A further aspect of the invention relates to a parking assistance system for a motor vehicle for displaying driver assistance information during a parking maneuver of a motor vehicle, comprising at least one projection device, an environment detection device, and an electronic computing device, wherein the parking assistance system is designed to carry out a method according to the preceding aspect. In particular, the method is carried out by means of the parking assistance system.

Yet another aspect of the invention relates to a motor vehicle with a parking assistance system according to the preceding aspect.

The invention also includes further developments of the parking assistance system according to the invention and of the motor vehicle that have features already described in connection with the further developments of the method according to the invention. For this reason, the corresponding further developments of the parking assistance system according to the invention are not described again here.

The invention also includes combinations of the features of the described embodiments.

• 1 eine schematische Seitenansicht einer Ausführungsform eines Kraftfahrzeugs mit einer Ausführungsform eines Parkassistenzsystems; und
• 2 eine schematische Perspektivansicht einer Ausführungsform des Parkassistenzsystems.

An embodiment of the invention is described below. It shows:

• 1 a schematic side view of an embodiment of a motor vehicle with an embodiment of a parking assistance system; and
• 2 a schematic perspective view of an embodiment of the parking assistance system.

The exemplary embodiment explained below is a preferred embodiment of the invention. In the exemplary embodiment, the described components of the embodiment each represent individual, independently considered features of the invention, which also further develop the invention independently of one another and are thus also to be considered as components of the invention, either individually or in a combination other than that shown. Furthermore, the described embodiment can also be supplemented by further features of the invention already described.

In the figures, functionally identical elements are provided with the same reference numerals.

1 shows a schematic side view of an embodiment of a motor vehicle 1 with an embodiment of a parking assistance system 2. The parking assistance system 2 is designed to display driver support information 3, 4, 5. The driver support information 3, 4, 5 ( 2 ) concerns in particular information concerning a parking process 6 ( 2 ) of the motor vehicle 1. The parking assistance system 2 has at least one projection device 7, an environment detection device 8 and an electronic computing device 9.

In the following exemplary embodiment, the parking assistance system 2 is described in particular on a left side of the motor vehicle 1. The same applies, of course, to a right side of a motor vehicle 1. The parking assistance system 2 is therefore not limited to the left side of the motor vehicle 1.

In the method for displaying the driver assistance information 3, 4, 5 during the parking process 6 of the motor vehicle 1 by means of the parking assistance system 2 of the motor vehicle 1, the driver assistance information 3, 4, 5 is displayed as augmented reality 19 on a side window 10 of the motor vehicle 1 by means of the projection device 7 of the parking assistance system 2, wherein the driver assistance information 3, 4, 5 is displayed in an exterior rearview mirror area 12 of an exterior rearview mirror 13 that is visually perceptible to a driver 11 of the motor vehicle 1, so that the driver assistance information 3, 4, 5 is perceived as augmented reality 19 of the exterior rearview mirror 13.

It is provided that an environment 14 of the motor vehicle 1 is detected by means of an environment detection device 8 of the parking assistance system 2, wherein the detected environment 14 is evaluated by means of an electronic computing device 9 of the parking assistance system 2, and wherein the driver support information 3, 4, 5 relating to the parking process 6 of the motor vehicle 1 is projected onto the side window 10 by means of the projection device 7 as a function of the evaluated environment 14.

In particular, it can be provided that at least the projection device 7 is provided as a head-up display device and/or the projection device 7 is provided in a side region of the motor vehicle 1, in particular in a door region 15 of the motor vehicle 1.

Furthermore, it can be provided that an eye position 17 of the driver 11 is detected by means of an optical detection device 16 and the position of the displayed driver support information 3, 4, 5 is adapted to the detected eye position 17.

2 shows a schematic perspective view of an embodiment of the parking assistance system 2. In particular, a view of the exterior rearview mirror 13 is shown. In particular, a view through the exterior rearview mirror area 12 of the driver 11 is shown. In the present case, in particular, a left exterior rearview mirror 13 is shown.

In particular, the 2 that, by means of the electronic computing device 9, information characterizing an object and/or parking space 18 located in the environment 14, which object and/or parking space 18 are detected by the environment detection device 8, is generated, and the information characterizing the object and/or the parking space 18 is displayed as driver assistance information 3, 4, 5. For example, a relative speed of the object or a relative distance of the object and/or the parking space 18 relative to the motor vehicle 1 can be displayed as driver assistance information 3, 4, 5.

In particular, the 2 that three driver assistance information items 3, 4, 5 can be displayed. In particular, the three driver assistance information items 3, 4, 5 can be displayed separately from one another. In particular, the three driver assistance information items 3, 4, 5 can be displayed in different areas of the exterior rearview mirror area 12. In the present case, in particular, a first driver assistance information item 3 is displayed as a driving path, a second driver assistance information item 4 is displayed as a marker, and a third driver assistance information item 5 can, for example, include a steering recommendation.

For example, in the present case, it can be provided that a control recommendation on a steering device of the motor vehicle 1 for the parking process 6 can be displayed as driver assistance information 3, 4, 5, in the present case as third driver assistance information 5 and in particular represented as a steering wheel. In the present case, a future driving path of the motor vehicle 1 can be displayed as the first driver assistance information 3. The future driving path can be determined, for example, depending on a current steering angle on the motor vehicle 1. The control recommendation can, for example, include a direction of rotation of the steering device.

If, for example, the object is located in the driving path, an exclamation mark can be displayed in a red triangle as additional driver support information, so that the driver 11 can intuitively perceive that a safe parking process 6 cannot be carried out.

Furthermore, the 2 that the detected object and/or the parking space 18 is provided as driver assistance information 3, 4, 5, in particular in the present case as second driver assistance information 4, with a marker that is visually perceptible to the driver 11, so that the further motor vehicle 18 reflected in the exterior rearview mirror 13 is perceived by the driver 11 with the marker as augmented reality 19 on the side window 10.

Overall, the invention thus shows an information display in a side mirror using a head-up display.

Claims (8)

Method for displaying driver assistance information (3, 4, 5) during a parking process (6) of a motor vehicle (1) by means of a parking assistance system (2) of the motor vehicle (1), in which the driver assistance information (3, 4, 5) is displayed on a side window (10) of the motor vehicle (1) as augmented reality (19) by means of a projection device (7) of the parking assistance system (2), wherein an environment (14) of the motor vehicle (1) is detected by means of an environment detection device (8) of the parking assistance system (2), wherein the detected environment (14) is evaluated by means of an electronic computing device (9) of the parking assistance system (2), and wherein the driver assistance information (3, 4, 5) relating to the parking process (6) of the motor vehicle (1) is displayed by means of the projection device (7) as a function of the evaluated environment (14). 4, 5) is projected onto the side window (10), characterized in that the driver assistance information (3, 4, 5) is displayed in an exterior rearview mirror region (12) of an exterior rearview mirror (13) of the motor vehicle (1), which is visually perceptible to a driver (11) of the motor vehicle (1), so that the driver assistance information (3, 4, 5) is perceived as an augmented reality (19) of the exterior rearview mirror (13), wherein by means of the electronic computing device (9) information characterizing an object and/or parking space (18) located in the environment (14) detected by means of the environment detection device (8) is generated and the information characterizing the object and/or the parking space (18) is displayed as driver assistance information (3, 4, 5), wherein the detected object and/or the detected parking space (18) is displayed as driver assistance information (3, 4, 5) with a display for the driver (11) is provided with an optically perceptible marker, so that the object reflected in the exterior mirror (13) and/or the mirrored parking space (18) with the marker is perceived by the driver (11) as an augmented reality (19) on the side window (10). Procedure according to Claim 1 , characterized in that the detected object and/or the detected parking space (18) is evaluated and displayed as driver support information (3, 4, 5) depending on the parking process (6). Procedure according to Claim 2 , characterized in that a relative distance of the object and/or the parking space (18) relative to the motor vehicle (1) is displayed as driver assistance information (3, 4, 5). Method according to one of the preceding claims, characterized in that a future driving path of the motor vehicle (1) is displayed as driver support information (3, 4, 5) and/or the future driving path is determined as a function of a current steering angle on the motor vehicle (1). Method according to one of the preceding claims, characterized in that a control recommendation is displayed on a steering device of the motor vehicle for the parking process (6) as driver support information (3, 4, 5). Method according to one of the preceding claims, characterized in that an eye position (17) of the driver (11) is detected by means of an optical detection device (16) of the parking assistance system (2) and the position of the displayed driver assistance information (3, 4, 5) is adapted to the detected eye position (17). Method according to one of the preceding claims, characterized in that at least the projection device (7) is provided as a head-up display device and/or the projection device (7) is provided in a side region of the motor vehicle (1), in particular in a door region (15) of the motor vehicle (1). Parking assistance system (2) for a motor vehicle (1) for displaying driver support information (3, 4, 5) during a parking process (6) of a motor vehicle (1), with at least one projection device (7), with an environment detection device (8) and with an electronic computing device (9), wherein the parking assistance system (2) is designed to carry out a method according to one of the Claims 1 until 7 is trained.

Images