DE102013011531B4 - Method for operating an assistance system of a motor vehicle and assistance system for a motor vehicle - Google Patents

Abstract

Method for operating an assistance system of a motor vehicle (10), in which a predetermined information (26) is output to an operating element (22) selected by a vehicle occupant (28) by means of an output device (20) of the assistance system (12), wherein whether the vehicle occupant (28) has selected the operating element (22) is detected by means of an optical detection device (14) of the assistance system (12), whether the vehicle occupant (28) with a finger (30) on the operating element (22); the predetermined information (26) relating to the operating element (22) is output as soon as it is detected that the vehicle occupant (28) points with his finger (30) to the operating element (22); characterized in that the predetermined information (26) is output only when it is detected by means of a gaze detection device (16) that the vehicle occupant (28) points his gaze to the control element (22) at least for a given gaze application time Has.

Description

The invention relates to a method for operating an assistance system of a motor vehicle and an assistance system for a motor vehicle of the kind specified in the preambles of the independent claims.

In motor vehicles, a greater variety of functions is increasingly being offered, for example in infotainment applications or driver assistance systems. This is partly accompanied by the fact that more and more different control elements for controlling the increasing variety of functions are required. In particular, in cases in which a driver or other vehicle occupants of such a motor vehicle are not yet familiar with the controls and their assignment to the corresponding functions of the motor vehicle, it may be difficult for these people to select the appropriate controls for operating according to desired functions.

The DE 10 2007 043 935 A1 shows a vehicle system with a help functionality. The vehicle system is configured to provide stored explanation information about respective controls.

The US 2009/0179855 A1 shows an operating device in a vehicle. There is an output of a help function as soon as a touch of a corresponding control element has been detected.

The DE 10 2006 040 655 A1 shows an electrical device with an instruction manual routine. Depending on a detected operating state of a vehicle navigation system, a help function is output.

The DE 10 2008 022 752 A1 shows a method for determining a touch position of a touch-sensitive device of a vehicle.

By means of a multi-touch gesture in which a touch point is first touched with one finger and then another touch point with a second finger simultaneously with the contact with the first finger, a context-related special function can be activated which is directly related to the first touch position such as activating a help function.

The DE 199 51 001 A1 shows a device for displaying information in a vehicle. By activating a particular field, a driver is allowed to retrieve a user manual, a user guide and / or a help function.

The generic DE 10 2009 058 146 A1 describes a method in which a vehicle occupant is explained a functional assignment of displayed by means of a touchscreen controls. As soon as the vehicle occupant points with one finger to one of the operating elements and expresses a given voice command, an acoustic output is made to explain the functional assignment of the relevant operating element.

It is the object of the present invention to provide a method for operating an assistance system of a motor vehicle and an assistance system for a motor vehicle of the aforementioned type, by means of which the provision of information relating to a control element selected by a vehicle occupant is simplified.

This object is achieved by a method for operating an assistance system of a motor vehicle and by an assistance system for a motor vehicle having the features of the independent patent claims. Advantageous embodiments with expedient and non-trivial developments of the invention are specified in the dependent claims.

In the method according to the invention for operating an assistance system of a motor vehicle, predetermined information about an operating element selected by a vehicle occupant is output by means of an output device of the assistance system, wherein the method according to the invention is characterized in that for determining whether the vehicle occupant has selected the operating element by means of a optical detection means of the assistance system is detected, whether the vehicle occupant points with a finger on the operating element, wherein the predetermined information is output with respect to the operating element as soon as it is detected that the vehicle occupant points with his finger on the operating element.

It is thus provided according to the invention that a vehicle occupant can select a specific operating element of the motor vehicle by a finger-pointing contact, wherein subsequently a predetermined information is output to the operating element. In further away from the vehicle occupant controls arranged this example, does not have to bend over to the control to select this. Furthermore, the vehicle occupant can particularly quickly by the detection of the finger pointer according to the invention a corresponding Select control element over which he would like to receive further information. In particular, if the vehicle occupant is a driver of the motor vehicle, the traffic safety can be considerably increased by the method according to the invention, since the driver is significantly less distracted from the traffic situation by a mere finger pointing than if, for example, he first touched the operating element would have to press to get the appropriate information about the control.

The invention also provides that the predetermined information is output only when it is detected by means of a gaze detection device that the vehicle occupant has directed his gaze while pointing to the operating element at least for a predefined gaze application period. For example, the vehicle occupant may just be gesturing at one point and inadvertently pointing his finger at one of the controls within the motor vehicle. By additionally monitoring whether the vehicle occupant has directed his view of the operating element during the pointing operation, such misinterpretations of a pointing gesture of the vehicle occupant can be prevented.

In an advantageous embodiment of the invention, it is provided that the predetermined information is output acoustically and / or optically. As a result, the vehicle occupant can be supplied in a particularly simple manner with the predetermined information about the control element selected by him.

A further advantageous embodiment of the invention provides that the predetermined information includes a description of at least one function of the motor vehicle, which is controllable by means of the operating element. Thus, the vehicle occupant can easily find out by a simple finger pointing to the corresponding control element, which function or which functions of the motor vehicle can be controlled by a corresponding operation of the control. In particular, persons not yet familiar with all the functions of the motor vehicle can thereby be provided in a particularly convenient manner with operating instructions for operating elements selected in each case with a finger pointer.

According to a further advantageous embodiment of the invention, it is provided that for monitoring whether the vehicle occupant points with his finger on the operating element, the position and / or posture of the vehicle occupant is detected by means of the optical detection device. Thus, it is only necessary that the subject vehicle occupant is observed even with the optical detection device, wherein not the entire vehicle interior of the motor vehicle must be monitored. For example, it is possible, via the detected position and / or posture of the vehicle occupant in the presence of a finger pointer of the vehicle occupant, to identify in a particularly simple manner the corresponding operating element to which the vehicle occupant points within the motor vehicle. For example, information about the respective positions of the controls within the motor vehicle may be provided, which information in combination with the detected position and / or posture of the vehicle occupant may be used to identify the corresponding control to which the vehicle occupant is pointing.

In a further advantageous embodiment of the invention, it is provided that the monitoring of whether the vehicle occupant points with a finger on the operating element, by means of at least one time-of-flight camera of the optical detection device. In other words, the optical detection device comprises at least one 3D camera system, which is operated by means of the transit time method. By means of such a time-of-flight camera, the relevant vehicle occupant is illuminated by means of a light pulse, the camera system measuring, for each pixel, the time required for the light to reach the vehicle occupant and back again. The time required is directly proportional to the distance of the respective pixel. The time-of-flight camera thus provides for each pixel of the vehicle occupant the distance of the object imaged thereon. The principle essentially corresponds to laser scanning, with the advantage that the area of the vehicle occupant essential for operating the method is recorded at once and does not have to be scanned separately. This allows a particularly fast and reliable detection of the position and / or posture of the vehicle occupant done.

According to a further advantageous embodiment of the invention, it is provided that the predetermined information is output only when it has been detected that the vehicle occupant has shown for at least a predetermined time on the control element. As a result, an unnecessary overstimulation of the vehicle occupant is prevented, since the latter first has to deliberately point to the corresponding operating element for the given time before the predetermined information is output. A distraction, in particular of a driver by unnecessarily displayed information is thereby avoided, whereby the traffic safety is increased when driving the motor vehicle.

According to a further advantageous embodiment of the invention, it is provided that the predetermined information is output only when it has been detected by means of a speech detection device that the vehicle occupant has made a predetermined voice command. This also helps to prevent inadvertent output of the predetermined information, since the vehicle occupant must first consciously utter a corresponding voice command after or while he has made the pointing gesture on the relevant control element.

A further advantageous embodiment of the invention provides that the predetermined information, in particular in the case of an optical output, is output only as long as it is detected that the vehicle occupant points with his finger to the operating element. As a result, it can be ensured that the predetermined information is output only as long as it is of interest to the relevant vehicle occupant.

A further advantageous embodiment of the invention provides that, depending on the detected position of the vehicle occupant in the motor vehicle, a display device of the motor vehicle assigned to the position is selected and by means of which the predetermined information is displayed.

As a result, it can be distinguished, for example, whether the predetermined information for a driver, a passenger or sitting on a back seat of the motor vehicle passengers should be displayed. As a result, the predetermined information can be read particularly well by the relevant vehicle occupant.

In a further advantageous embodiment of the invention, it is provided that the predetermined information is output only when it is detected that the vehicle occupant points with a predetermined finger on the operating element. Preferably, the predetermined finger is predetermined beforehand via a user interface of the assistance system. As a result, it can be determined, for example, by a driver of the motor vehicle or another vehicle occupant of the motor vehicle that the predetermined information is output only in the case of a pointing gesture with a specific finger, for example with an index finger. Unnecessary or unintentional information outputs with regard to the relevant control element can thus be reduced, since the relevant vehicle occupant must consciously execute the pointing gesture with the correspondingly predetermined finger, so that he can at all obtain appropriate information about the control element selected by him.

The assistance system according to the invention for a motor vehicle comprises an output device which is designed to output at least one predetermined information on a control element selected by a vehicle occupant. The assistance system according to the invention is characterized in that the assistance system for determining whether the vehicle occupant has selected the operating element comprises an optical detection device which is designed to monitor whether the vehicle occupant points with a finger to the operating element, wherein the output device is designed to output the predetermined information regarding the operating element as soon as it is detected that the vehicle occupant points with his finger on the operating element. The output device is furthermore designed to output the predetermined information only when it is detected by means of a gaze detection device that the vehicle occupant has directed his gaze onto the control element while pointing at the control element at least for a given gaze application period. Advantageous embodiments of the method according to the invention are to be regarded as advantageous embodiments of the assistance system, wherein the assistance system comprises in particular means for carrying out the method steps.

Further advantages, features and details of the invention will become apparent from the following description of preferred embodiments and from the drawing.

Embodiments of the invention will be explained in more detail with reference to the single figure, in which schematically a motor vehicle is shown, which comprises an assistance system, detected by means of which Zeigegesten a vehicle occupant and depending on corresponding information about arranged in the car controls can be issued.

In the single figure is a schematic representation of a motor vehicle 10 with an assistance system 12 shown. The assistance system 12 comprises an optical detection device 14 , a gaze detection device 16 , a voice detection device 18 and an output device 20 , Furthermore, the motor vehicle includes 10 two controls 22 . 24 , by means of which respective functions of the motor vehicle 10 can be controlled. The controls 22 . 24 are for example in the range of a center console of the motor vehicle, not shown here 10 arranged.

The output device 20 is designed to have at least a predetermined information 26 to one of a vehicle occupant 28 selected control element 22 . 24 to spend.

The assistance system 12 includes for determining which of the controls 22 . 24 the vehicle occupant 28 has selected, the optical detection device 14 , which is designed to monitor whether the vehicle occupant 28 with a finger 30 on the relevant control element 22 . 24 shows. The output device 20 is designed to be a predetermined information 26 with respect to the operating element 22 or 24 issue as soon as it is detected that the vehicle occupant 28 with his finger 30 on the control 22 or 24 shows.

The following is a procedure for operating the assistance system 12 of the motor vehicle 10 explained. First, by means of the optical detection device 14 determines if the vehicle occupant 28 by a corresponding finger pointer the operating element 22 has selected. Monitoring whether the vehicle occupant 28 with his finger 30 on the control 22 shows, takes place by means of a time-of-flight camera 32 of the detection device 14 , In this case, by means of the time-of-flight camera 32, the position and posture of the vehicle occupant 28 detected. This allows a corresponding pointer gesture with the index finger 30 be detected safely.

Furthermore, corresponding position information about the in the car 10 arranged controls 22 . 24 provided so that with knowledge of the position and posture of the vehicle occupant 28 can be detected on which of the controls 22 . 24 the vehicle occupant 28 straight with his finger 30 shows. In the present case, by means of the dashed line is a corresponding detected Zeigerichtung 34 of the index finger 30 shown, which on the operating element 22 is directed.

Once it has been detected that the vehicle occupant 28 with his index finger 30 on the control 22 shows, how long the vehicle occupant 28 with his index finger 30 on the control 22 shows. The correspondingly predetermined information 26 is issued only when it has been detected that the vehicle occupant 28 for at least a predetermined time, for example 1 second, 2 seconds or the like, on the control 22 showed. The predetermined information 26 can be output acoustically as well as optically.

The optical output of the predetermined information 26 takes place in the present case via a corresponding display device 36 which, for example, in the range of a combination instrument, not shown here, the center console of the motor vehicle 10 or at other positions within the motor vehicle 10 can be arranged. If additionally or alternatively, an acoustic output of the predetermined information 26 This is done through a speaker 38 or via other speakers, which are not shown here, issued.

At the predetermined information 26 it is a description of at least one function of the motor vehicle 10 , which by means of the operating element 22 is controllable. Furthermore, the predetermined information 26 Also include operating instructions or other similar information, so that the vehicle occupant information on how to use the control 22 or 24 can be provided.

Depending on the detected position of the vehicle occupant 28 in the car 10 In this case, a display device associated with the position, that is, for example, the display device 36 or another display device of the motor vehicle 10 selected, by means of which the predetermined information is displayed. Is it the vehicle occupants 28 for example, a driver of the motor vehicle 10 , the optical output of the predetermined information takes place 26 for example, within the instrument cluster of the motor vehicle or by means of a head-up display of the motor vehicle, not shown here. Should the vehicle occupant 28 For example, on a rear seat of the motor vehicle, not shown here 10 sit, the corresponding optical output of the information takes place 26 by means of a display device, not shown here, which, for example, on the back of a backrest of a front seat of the motor vehicle 10 is appropriate.

Furthermore, it can be provided that the predetermined information 26 is outputted only when by means of the gaze detection device 16 it is detected that the vehicle occupant 28 his eyes while looking at the control 22 shows, at least for a given Blickzuwendungsdauer, for example a second, has been directed to this. One by means of the gaze detection device 16 Corresponding detected direction is in the present case by the dashed line 40 characterized. In the present case, therefore, the vehicle occupant looks 28 on the control 22 while holding his index finger 30 on the control 22 shows, so that the predetermined information 26 is output accordingly.

Additionally or alternatively, it may also be provided that the predetermined information 26 is output only when using the speech detection device 18 has been detected that the vehicle occupant 28 has made a predetermined voice command. This will ensure that the information in question 26 with respect to the operating element 22 is issued only when the vehicle occupant 28 this should have been expressed by a corresponding voice command after a selection of the control 22 is done by a corresponding finger.

Furthermore, it is provided that the predetermined information 26 , in particular at an optical output, is issued only as long as it is detected that the vehicle occupant 28 with his finger 30 on the control 22 shows. An unnecessarily long edition of the relevant information 26 is avoided. For an acoustic output of the information 26 In contrast, it may be provided, for example, that this is at least once completely reproduced, even if the vehicle occupant 28 during the acoustic output of the information 26 not all the time on the control 22 should show.

Finally, it may also be provided in the course of the method that the predetermined information 26 is issued only when it is detected that the vehicle occupant 28 with a predetermined finger, in the present case with his forefinger 30 , on the control 22 shows. The selection of a predetermined finger, for example, previously via a user interface of the assistance system, not shown here 12 be specified. Alternatively, the predetermined finger can already be set at the factory.

The fact that a time-of-flight camera 32 is used can be done in a particularly reliable manner by a corresponding optical scanning of a hand 29 of the vehicle occupant 28 with which he makes the pointing gesture, are recorded in detail, whether the vehicle occupant 28 actually does the pointing motion with the predetermined finger.

Claims (13)

Method for operating an assistance system of a motor vehicle (10), in which a predetermined information (26) is output to a control element (22) selected by a vehicle occupant (28) by means of an output device (20) of the assistance system (12), wherein - for determining whether the vehicle occupant (28) has selected the operating element (22) is detected by means of an optical detection device (14) of the assistance system (12), whether the vehicle occupant (28) with a finger (30) on the operating element (22); the predetermined information (26) relating to the operating element (22) is output as soon as it is detected that the vehicle occupant (28) points with his finger (30) to the operating element (22); characterized in that the predetermined information (26) is output only when it is detected by means of a gaze detection device (16) that the vehicle occupant (28) points his gaze to the control element (22) at least for a given gaze application time Has. Method according to Claim 1 , characterized in that the predetermined information (26) is output acoustically and / or optically. Method according to Claim 1 or 2 , characterized in that the predetermined information (26) comprises a description of at least one function of the motor vehicle (10) which is controllable by means of the operating element (22). Method according to one of the preceding claims, characterized in that for monitoring whether the vehicle occupant (28) with his finger (30) points to the operating element (22), by means of the optical detection device (14), the position and / or posture of the vehicle occupant ( 28) is detected. Method according to one of the preceding claims, characterized in that the monitoring of whether the vehicle occupant (28) with a finger (30) on the operating element (22), by means of at least one time-of-flight camera (32) of the optical detection device (14). Method according to one of the preceding claims, characterized in that the predetermined information (26) is output only when it has been detected that the vehicle occupant (28) has shown the control element (22) for at least a predetermined duration of time. Method according to one of the preceding claims, characterized in that the predetermined information (26) is output only when it has been detected by means of a speech detection device (18) that the vehicle occupant (28) has made a predetermined voice command. Method according to one of the preceding claims, characterized in that predetermined information (26) is output only as long as it is detected that the vehicle occupant (28) points with his finger (30) to the operating element (22). Method according to Claim 8 , characterized in that the predetermined information (26) is output at an optical output only as long as it is detected that the vehicle occupant (28) points with his finger (30) on the operating element (22). Method according to one of Claims 4 to 9 , characterized in that depending on the detected position of the vehicle occupant (28) in the motor vehicle (10) one of the position associated display device (36) of the motor vehicle (10) selected and by means of this the predetermined information (26) is displayed. Method according to one of the preceding claims, characterized in that the predetermined information (26) is output only when it is detected that the vehicle occupant (28) with a predetermined finger (30) points to the operating element (22). Method according to Claim 11 , characterized in that the predetermined finger (30) is predetermined beforehand via a user interface of the assistance system (12). An assistance system (12) for a motor vehicle (10), having an output device (20) which is designed to output at least one predetermined information (26) to an operating element (22) selected by a vehicle occupant (28), wherein - the assistance system ( 12) for determining whether the vehicle occupant (28) has selected the operating element (22), an optical detection device (14) which is adapted to monitor whether the vehicle occupant (28) with a finger (30) on the operating element (22) shows; - The output device (20) is adapted to output the predetermined information (26) with respect to the operating element (22) as soon as it is detected that the vehicle occupant (28) points with its finger (30) on the operating element (22); characterized in that the output device (20) is adapted to output the predetermined information (26) only when it is detected by means of a gaze detection device (16) that the vehicle occupant (28) shows his gaze while pointing to the operating element (22) at least for a given Blickzuwendungsdauer has addressed this.

Images