[go: up one dir, main page]

WO2002088824A2 - Device for controlling equipment by means of a line of vision - Google Patents

Device for controlling equipment by means of a line of vision Download PDF

Info

Publication number
WO2002088824A2
WO2002088824A2 PCT/DE2002/001423 DE0201423W WO02088824A2 WO 2002088824 A2 WO2002088824 A2 WO 2002088824A2 DE 0201423 W DE0201423 W DE 0201423W WO 02088824 A2 WO02088824 A2 WO 02088824A2
Authority
WO
WIPO (PCT)
Prior art keywords
line
display
control
control function
processor
Prior art date
Application number
PCT/DE2002/001423
Other languages
German (de)
French (fr)
Other versions
WO2002088824A3 (en
Inventor
Werner Poechmueller
Original Assignee
Robert Bosch Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch Gmbh filed Critical Robert Bosch Gmbh
Publication of WO2002088824A2 publication Critical patent/WO2002088824A2/en
Publication of WO2002088824A3 publication Critical patent/WO2002088824A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23—Head-up displays [HUD]
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B60K35/81—Arrangements for controlling instruments for controlling displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/77—Instrument locations other than the dashboard
    • B60K2360/782—Instrument locations other than the dashboard on the steering wheel

Definitions

  • the invention relates to a device for controlling devices by means of a viewing direction according to the type of the independent claim.
  • a field is opened on a display and then by further information, for example by language or selection menus, which are also controlled by the direction of view, a driver then uses the possibilities of a device selected by the field, such as a navigation device.
  • the device according to the invention for controlling devices by means of a line of sight with the features of the independent claim has the advantage that a control of complex control functions in a motor vehicle is possible without the driver having to take his hands off the steering wheel. The operation is without previous learning process possible, the view may need to be taken only briefly from the traffic scene.
  • the haptic control element is arranged on the steering wheel of a vehicle, so that the driver can activate the selected control function without taking his hand off the steering wheel. This increases the safety of driving behavior while simultaneously actuating the device according to the invention.
  • the display highlights the control function selected by the viewing direction, so that an immediate visual feedback is presented to the operator. He sees the success of his selection immediately.
  • Control element is designed as a push button that is easy and safe to use.
  • optical image pickup of the direction of view detection is one
  • FIG. 1 shows a schematic Representation of the device according to the invention in the vehicle
  • Figure 2 is a block diagram of the device according to the invention.
  • Devices in a motor vehicle are mainly operated using haptic controls.
  • haptic controls Especially with complex infotainment devices such as a car radio and / or navigation, problems are increasingly encountered.
  • the inputs required for haptic operation increase in scope and thus the driver's distraction from traffic. This can lead to safety-critical situations.
  • New operating technologies such as voice-based control help to enable operation without the driver having to take his eyes off the traffic scene or take his hands off the steering wheel.
  • voice-based control help to enable operation without the driver having to take his eyes off the traffic scene or take his hands off the steering wheel.
  • only limited command words can be recognized, which the driver must also learn.
  • an operating concept is proposed in which a control function is selected by means of a direction of view detection and the selected control function is then activated with a haptic control element, which is preferably arranged on the steering wheel.
  • FIG. 1 shows schematically how the device according to the invention is arranged and works in the motor vehicle.
  • a driver 2 receives a selection of actions or commands to be carried out on a display 3. These can be labeled with radio, navigation or climate, for example. These control functions' are to be shown spatially separated on the output element, the display 3.
  • the display 3 can be designed as a screen or as a retinal projector or as a head-up display.
  • the driver looks to select one of the control functions 2 only on it and activates the function via a haptic control element 4, which is arranged here as a push button on the steering wheel.
  • a direction of sight detection 1 detects the movements of the eyes of the driver 2, so that the position on the display 3 at which the driver is looking can be measured.
  • Direction of view detection 1 is designed here as an optical sensor and in particular as a video sensor, i.e. the direction of view detection 1 has an optical image sensor.
  • This sensor 1 has an increase in the converter characteristic, which decreases with increasing incidence of light.
  • the sensor 1 can also have a different characteristic.
  • a processor evaluates the data of the line of sight detection 1 and then displays the selected functions on the display 3.
  • the selected functions are highlighted. This can be done by spatial highlighting, i.e. a perspective representation of the selected control function, by color coding, by optical effects such as flashing or by other markings.
  • the processor releases the haptic control element 4 as soon as a control function has been selected on the display by means of the viewing direction.
  • FIG. 2 shows the device according to the invention as a block diagram.
  • a display 3 is controlled by a control 6, which in turn is supplied with data by a processor 7. There are two on display 3
  • Control functions are shown, which are designated on the one hand by radio and on the other hand by navigation system, the control function navigation system being selected by the driver's line of sight 2 and then by processor 7 via control 6 by ticking a circle after Word Navi was visually highlighted, so that it can be seen that this control function was selected, the processor 7 is connected to a control 9 for the haptic control element 4 via a data input / output.
  • the haptic control element 4 generates according to the
  • Operation by the driver 2 Signals which the control 9 passes on to the processor 7, which processes them and carries out corresponding actions.
  • the processor 7 releases the pushbutton 4 for operation for the selected control function. If the pushbutton 4 is not released by the processor 7, actuating the haptic control element 4 does not result in any action or execution.
  • the processor 7 is connected via a data input to a control 9, which prepares the data for the processor 7 from a line of sight detection 1, which is designed here as a video sensor. This preparation involves converting the data formats and, if necessary, digitizing and amplifying them.
  • the processor 7 receives the line of sight detection 1
  • the processor 7 releases the haptic control element 4 for actuation, because otherwise an actuation of the haptic control element 4 does not lead to the execution of a control function.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Steering Controls (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention relates to a device for controlling equipment by means of a line of vision. According to the invention, a control function is selected using a line of vision and the selected function is then carried out using a haptic operating element (4) that is preferably located on a steering wheel.

Description

Vorrichtung zur Steuerung von Geräten mittels BlickrichtungDevice for controlling devices by viewing direction

Stand der TechnikState of the art

Die Erfindung geht aus von einer Vorrichtung zur Steuerung von Geräten mittels einer Blickrichtung nach der Gattung des unabhängigen Patentanspruchs .The invention relates to a device for controlling devices by means of a viewing direction according to the type of the independent claim.

Aus der nicht vorveröffentlichten deutschen Patentanmeldung DE 199 51 001 ist eine Vorrichtung zur Darstellung von Informationen in einem Fahrzeug bekannt, wobei durch eineFrom the unpublished German patent application DE 199 51 001 a device for displaying information in a vehicle is known, whereby by a

Blickrichtung ein Feld auf einer Anzeige geöffnet wird, und dann durch weitere Angaben, beispielsweise durch Sprache oder Auswahlmenüs, die auch durch die Blickrichtung gesteuert werden, nutzt ein Fahrer dann die Möglichkeiten eines durch das Feld angewählten Geräts, wie beispielsweise einem Navigationsgerät.A field is opened on a display and then by further information, for example by language or selection menus, which are also controlled by the direction of view, a driver then uses the possibilities of a device selected by the field, such as a navigation device.

Vorteile der ErfindungAdvantages of the invention

Die erfindungsgemäße Vorrichtung zur Steuerung von Geräten mittels einer Blickrichtung mit den Merkmalen des unabhängigen Patentanspruchs hat demgegenüber den Vorteil, dass eine Steuerung komplexer Steuerfunktionen in einem Kraftfahrzeug möglich wird, ohne dass der Fahrer die Hände vom Lenkrad nehmen muß. Die Bedienung ist dabei ohne vorherigen Lernvorgang möglich, der Blick ist gegebenenfalls nur kurz von der Verkehrsszene abzuwenden.The device according to the invention for controlling devices by means of a line of sight with the features of the independent claim has the advantage that a control of complex control functions in a motor vehicle is possible without the driver having to take his hands off the steering wheel. The operation is without previous learning process possible, the view may need to be taken only briefly from the traffic scene.

Mit den in den abhängigen Ansprüchen aufgeführten Maßnahmen und Weiterbildungen sind vorteilhafte Verbesserungen der im unabhängigen Patentanspruch angegebenen Vorrichtung zur Steuerung von Geräten mittels einer Blickrichtung möglich.With the measures and further developments listed in the dependent claims, advantageous improvements of the device for controlling devices specified in the independent claim are possible by looking in one direction.

Besonders vorteilhaft ist, dass das haptische Bedienelement am Lenkrad eines Fahrzeugs angeordnet ist, so dass der Fahrer ohne seine Hand vom Lenkrad zu nehmen, die ausgewählte Steuerfunktion aktivieren kann. Dies erhöht die Sicherheit des Fahrverhaltens bei gleichzeitiger Betätigung der erfindungsgemäßen Vorrichtung. Darüber hinaus ist es vorteilhaft, dass die Anzeige die mittels der Blickrichtung ausgewählte Steuerfunktion hervorhebt, so dass eine sofortige optische Rückmeldung dem Bediener dargeboten wird. Damit sieht er unmittelbar den Erfolg .seiner Auswahl.It is particularly advantageous that the haptic control element is arranged on the steering wheel of a vehicle, so that the driver can activate the selected control function without taking his hand off the steering wheel. This increases the safety of driving behavior while simultaneously actuating the device according to the invention. In addition, it is advantageous that the display highlights the control function selected by the viewing direction, so that an immediate visual feedback is presented to the operator. He sees the success of his selection immediately.

Desweiteren ist es von Vorteil, dass das haptischeFurthermore, it is advantageous that the haptic

Bedienelement als Drucktaster ausgebildet ist, der einfach und sicher zu bedienen ist.Control element is designed as a push button that is easy and safe to use.

Schließlich ist es auch von Vorteil, dass der optische Bildaufnehmer der Blickrichtungserkennung eineFinally, it is also advantageous that the optical image pickup of the direction of view detection is one

Wandlercharakteristik aufweist, bei der die Steigung der Wandlerkennlinie mit zunehmendem Lichteinfall abnimmt, so dass die Blickrichtungserkennung automatisch auf ein hohes Maß an Helligkeit reagieren kann.Has transducer characteristics in which the gradient of the transducer characteristic decreases with increasing incidence of light, so that the direction of view detection can automatically react to a high degree of brightness.

Zeichnungdrawing

Ausführungsbeispiele der Erfindung sind in der Zeichnung dargestellt und werden in der nachfolgenden Beschreibung näher erläutert. Es zeigt Figur 1 eine schematische Darstellung der erfindungsgemäßen Vorrichtung im Fahrzeug und Figur 2 ein Blockschaltbild der erfindungsgemäßen Vorrichtung.Exemplary embodiments of the invention are shown in the drawing and are explained in more detail in the following description. 1 shows a schematic Representation of the device according to the invention in the vehicle and Figure 2 is a block diagram of the device according to the invention.

Beschreibungdescription

Geräte in einem Kraftfahrzeug werden überwiegend mittels haptischer Bedienelemente bedient. Insbesondere bei komplexen Infotainmentgeräten wie ein Autoradio und/oder Navigation stößt man dabei zunehmend auf Probleme. Die zur haptischen Bedienung nötigen Eingaben steigen in ihrem Umfang und damit auch die Ablenkung des Fahrers vom Verkehr. Dies kann zur sicherheitskritischen Situationen führen. Neue Bedientechniken wie sprachbasierte Steuerung helfen, eine Bedienung zu ermöglichen, ohne dass der Fahrer den Blick von der Verkehrsszene bzw. die Hände vom Lenkrad abnehmen muß. Dabei können aber nur beschränkte Befehlsworte erkannt werden, die der Fahrer auch erlernen muß.Devices in a motor vehicle are mainly operated using haptic controls. Especially with complex infotainment devices such as a car radio and / or navigation, problems are increasingly encountered. The inputs required for haptic operation increase in scope and thus the driver's distraction from traffic. This can lead to safety-critical situations. New operating technologies such as voice-based control help to enable operation without the driver having to take his eyes off the traffic scene or take his hands off the steering wheel. However, only limited command words can be recognized, which the driver must also learn.

Erfindungsgemäß wird daher ein Bedienkonzept vorgeschlagen, bei dem mittels einer Blickrichtungserkennung eine Steuerfunktion ausgewählt wird und mit einem haptischen Bedienelement, das vorzugsweise am Lenkrad angeordnet ist, die ausgewählte Steuerfunktion dann aktiviert wird.According to the invention, therefore, an operating concept is proposed in which a control function is selected by means of a direction of view detection and the selected control function is then activated with a haptic control element, which is preferably arranged on the steering wheel.

In Figur 1 ist schematisch dargestellt, wie die erfindungsgemäße Vorrichtung im Kraftfahrzeug angeordnet ist und funktioniert. Ein Fahrer 2 erhält auf einer Anzeige 3 eine Auswahl durchzuführender Aktionen bzw. Befehle. Diese können beispielsweise mit Radio, Navigation oder Klima bezeichnet sein. Diese Steuerfunktionen 'sind auf dem Ausgabeelement, der Anzeige 3, räumlich getrennt darzustellen. Die Anzeige 3 kann dabei als Bildschirm oder als Netzhautprojektor oder als- Headup-Display ausgebildet sein. Zur Wahl einer der Steuerfunktionen blickt der Fahrer 2 lediglich darauf und aktiviert die Funktion über ein haptisches Bedienelement 4, welches hier als Drucktaster am Lenkrad angeordnet ist. Eine Blickrichtungserkennung 1 detektiert die Bewegungen der Augen des Fahrers 2, so dass hierüber die Position auf der Anzeige 3 gemessen werden kann, auf die der Fahrer gerade blickt. DieFIG. 1 shows schematically how the device according to the invention is arranged and works in the motor vehicle. A driver 2 receives a selection of actions or commands to be carried out on a display 3. These can be labeled with radio, navigation or climate, for example. These control functions' are to be shown spatially separated on the output element, the display 3. The display 3 can be designed as a screen or as a retinal projector or as a head-up display. The driver looks to select one of the control functions 2 only on it and activates the function via a haptic control element 4, which is arranged here as a push button on the steering wheel. A direction of sight detection 1 detects the movements of the eyes of the driver 2, so that the position on the display 3 at which the driver is looking can be measured. The

Blickrichtungserkennung 1 ist hier als ein optischer Sensor und dabei insbesondere als Videosensor ausgebildet, d.h. die Blickrichtungserkennung 1 weist einen optischen Bildaufnehmer auf. Dieser Sensor 1 weist dabei eine Steigung der Wandlerkennlinie auf, die mit zunehmendem Lichteinfall abnimmt. Der Sensor 1 kann alternativ auch eine andere Kennlinie aufweisen.Direction of view detection 1 is designed here as an optical sensor and in particular as a video sensor, i.e. the direction of view detection 1 has an optical image sensor. This sensor 1 has an increase in the converter characteristic, which decreases with increasing incidence of light. Alternatively, the sensor 1 can also have a different characteristic.

Ein Prozessor wertet die Daten der Blickrichtungerkennung 1 aus und stellt dann auf der Anzeige 3 die ausgewählten Funktionen dar. Dabei werden die ausgewählten Funktionen optisch hervorgehoben. Dies kann durch eine räumliche Hervorhebung geschehen, also eine perspektivische Darstellung der ausgewählten Steuerfunktion, durch eine farbliche Kennzeichnung, durch optische Effekte wie Blinken oder durch andere Markierungen. Weiterhin gibt der Prozessor das haptische Bedienelement 4 frei, sobald eine Steuerfunktion auf der Anzeige mittels der Blickrichtung ausgewählt wurde.A processor evaluates the data of the line of sight detection 1 and then displays the selected functions on the display 3. The selected functions are highlighted. This can be done by spatial highlighting, i.e. a perspective representation of the selected control function, by color coding, by optical effects such as flashing or by other markings. Furthermore, the processor releases the haptic control element 4 as soon as a control function has been selected on the display by means of the viewing direction.

Figur 2 zeigt als Blockschaltbild die erfindungsgemäße Vorrichtung. Eine Anzeige 3 wird von einer Ansteuerung 6 angesteuert, die wiederum von einem Prozessor 7 mit Daten versorgt wird. Auf der Anzeige 3 sind hier zweiFIG. 2 shows the device according to the invention as a block diagram. A display 3 is controlled by a control 6, which in turn is supplied with data by a processor 7. There are two on display 3

Steuerfunktionen dargestellt, die einerseits mit Radio und andererseits mit Navi bezeichnet sind, wobei die Steuerfunktion Navi durch die Blickrichtung des Fahrers 2 ausgewählt wurde und dann entsprechend vom Prozessor 7 über die Ansteuerung 6 durch ein Ankreuzen eines Kreises nach dem Wort Navi optisch hervorgehoben wurde, so dass es ersichtlich ist, dass diese Steuerfunktion ausgewählt wurde, über einen Datenein-/-ausgang ist der Prozessor 7 mit einer Ansteuerung 9 für das haptische Bedienelement 4 verbunden. Das haptische Bedienelement 4 generiert entsprechend derControl functions are shown, which are designated on the one hand by radio and on the other hand by navigation system, the control function navigation system being selected by the driver's line of sight 2 and then by processor 7 via control 6 by ticking a circle after Word Navi was visually highlighted, so that it can be seen that this control function was selected, the processor 7 is connected to a control 9 for the haptic control element 4 via a data input / output. The haptic control element 4 generates according to the

Bedienung durch den Fahrer 2 Signale, die die Ansteuerung 9 zum Prozessor 7 weitergibt, der diese verarbeitet und entsprechende Aktionen ausführt. Der Prozessor 7 gibt bei einer Auswahl einer Steuerfunktion den Drucktaster 4 zur Bedienung für die ausgewählte Steuerfunktion frei. Ist der Drucktaster 4 von dem Prozessor 7 nicht freigegeben, dann bewirkt ein Betätigen des haptischen Bedienelements 4 keine Aktion oder Ausführung. Über einen Dateneingang ist der Prozessor 7 mit einer Ansteuerung 9 verbunden, die Daten von einer Blickrichtungserkennung 1, die hier als Videosensor ausgebildet ist, für den Prozessor 7 vorbereitet. Zu dieser Vorbereitung gehört eine Umwandlung der Datenformate und gegebenenfalls eine Digitalisierung und Verstärkung.Operation by the driver 2 Signals which the control 9 passes on to the processor 7, which processes them and carries out corresponding actions. When a control function is selected, the processor 7 releases the pushbutton 4 for operation for the selected control function. If the pushbutton 4 is not released by the processor 7, actuating the haptic control element 4 does not result in any action or execution. The processor 7 is connected via a data input to a control 9, which prepares the data for the processor 7 from a line of sight detection 1, which is designed here as a video sensor. This preparation involves converting the data formats and, if necessary, digitizing and amplifying them.

Der Prozessor 7 erhält über die Blickrichtungserkennung 1The processor 7 receives the line of sight detection 1

Daten, welche Steuerfunktionen auf der Anzeige 3 ausgewählt wurden. Diese Steuerfunktion hebt dann der Prozessor 7 mit der Ansteuerung 6 und der Anzeige 3 optisch hervor, hier durch ein Ankreuzen eines Kreises nach dem Wort, das die entsprechende Steuerfunktion repräsentiert. Ist eineData on which control functions have been selected on display 3. This control function is then highlighted by the processor 7 with the control 6 and the display 3, here by ticking a circle after the word that represents the corresponding control function. Is a

Steuerfunktion ausgewählt, dann gibt der Prozessor 7 das haptische Bedienelement 4 zur Betätigung frei, denn ansonsten führt eine Betätigung des haptischen Bedienelements 4 zu keiner Ausführung einer Steuerfunktion. If the control function is selected, the processor 7 releases the haptic control element 4 for actuation, because otherwise an actuation of the haptic control element 4 does not lead to the execution of a control function.

Claims

Ansprüche Expectations 1. Vorrichtung zur Steuerung von Geräten mittels einer Blickrichtung, wobei die Vorrichtung eine Anzeige (3) zur Darstellung von Steuerungsfunktionen, eine Blickrichtungserkennung (1) und einen Prozessor (7) zur Auswertung der Blickrichtungserkennung und Ansteuerung der Anzeige (3) aufweist, dadurch gekennzeichnet, dass die Vorrichtung mit einem haptischen Bedienelement (4) verbindbar ist, mittels dessen eine Steuerfunktion aktivierbar ist, die mit der Blickrichtung auswählbar ist.1. Device for controlling devices by means of a line of sight, the device having a display (3) for displaying control functions, a line of sight detection (1) and a processor (7) for evaluating the line of sight detection and actuating the display (3) that the device can be connected to a haptic control element (4) by means of which a control function can be activated, which can be selected with the viewing direction. 2. Vorrichtung nach Anspruch 1, dadurch gekennzeichnet, dass das haptische Bediene'lement (4) am Lenkrad eines Fahrzeugs angeordnet ist.2. Device according to claim 1, characterized in that the haptic control element (4) is arranged on the steering wheel of a vehicle. 3. Vorrichtung nach Anspruch 1 oder 2, dadurch gekennzeichnet, dass die Anzeige (3) die mit der Blickrichtung ausgewählte Steuerfunktion hervorhebt.3. Device according to claim 1 or 2, characterized in that the display (3) highlights the control function selected with the viewing direction. 4. Vorrichtung nach Anspruch 2, dadurch gekennzeichnet, dass das haptische Bedienelement (4) als Drucktaster ausgebildet ist.4. The device according to claim 2, characterized in that the haptic control element (4) is designed as a push button. 5. Vorrichtung nach einem der vorhergehenden Ansprüche, dadurch gekennzeichnet, dass die Blickrichtungserkennung (1) einen optischen Bildaufnehmer mit einer Wandlercharakteristik aufweist, bei der die Steigung mit zunehmendem Lichteinfall abnimmt. 5. Device according to one of the preceding claims, characterized in that the line of sight detection (1) has an optical image sensor with a transducer characteristic in which the slope decreases with increasing incidence of light.
PCT/DE2002/001423 2001-05-02 2002-04-17 Device for controlling equipment by means of a line of vision WO2002088824A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE10121392A DE10121392A1 (en) 2001-05-02 2001-05-02 Device for controlling devices by viewing direction
DE10121392.1 2001-05-02

Publications (2)

Publication Number Publication Date
WO2002088824A2 true WO2002088824A2 (en) 2002-11-07
WO2002088824A3 WO2002088824A3 (en) 2003-04-10

Family

ID=7683411

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE2002/001423 WO2002088824A2 (en) 2001-05-02 2002-04-17 Device for controlling equipment by means of a line of vision

Country Status (2)

Country Link
DE (1) DE10121392A1 (en)
WO (1) WO2002088824A2 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005003535A1 (en) * 2005-01-25 2006-08-03 Daimlerchrysler Ag Providing information by optical or acoustic signaling apparatus e.g. in a vehicle which can be activated by detecting the direction in which the user is looking
EP1997667A1 (en) * 2007-05-31 2008-12-03 Volkswagen AG Device and method for showing information
CN102887121A (en) * 2011-07-19 2013-01-23 通用汽车环球科技运作有限责任公司 Method to map gaze position to information display in vehicle
WO2014033042A1 (en) * 2012-08-30 2014-03-06 Bayerische Motoren Werke Aktiengesellschaft Providing an input for an operating element
WO2015090485A1 (en) * 2013-12-20 2015-06-25 Audi Ag Operating device that can be operated without keys
WO2016012597A3 (en) * 2014-07-25 2016-04-07 Bayerische Motoren Werke Aktiengesellschaft User interface and operating method for view-based operation of a speed-regulating system
EP3001289A4 (en) * 2013-05-23 2017-01-18 Pioneer Corporation Display controller
US9598070B2 (en) 2010-03-02 2017-03-21 GM Global Technology Operations LLC Infotainment system control
ITUB20154786A1 (en) * 2015-11-03 2017-05-03 Ferrari Spa UNIT AND METHOD OF CONTROL OF AT LEAST ONE VEHICLE DEVICE
WO2020249298A1 (en) * 2019-06-12 2020-12-17 Daimler Ag Method for optimising the operation of an optical display
CN113165516A (en) * 2018-12-03 2021-07-23 戴姆勒股份公司 Method and device for adjusting vehicle components

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10319565A1 (en) * 2003-04-30 2004-11-25 Fendt, Günter Car audio installation allows recall of radio traffic news without distracting driver by use of contactless speech recognition infrared or capacitive man machine interface
DE10339314B3 (en) * 2003-08-27 2005-04-21 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method for display control of different information in a vehicle and opto-acoustic information unit
DE102004005816B4 (en) * 2004-02-06 2007-02-08 Audi Ag motor vehicle
WO2005106575A1 (en) * 2004-05-04 2005-11-10 Koninklijke Philips Electronics N.V. Multiview display device and apparatus
DE102006011288A1 (en) * 2006-03-10 2007-09-13 Siemens Ag Method for selecting functions using a user interface and user interface
DE102007025531B4 (en) 2007-05-31 2022-02-10 Volkswagen Ag Line of sight controlled display system and line of sight controlled display method for a motor vehicle
DE102007049710A1 (en) * 2007-10-17 2009-04-23 Robert Bosch Gmbh Visual triggering of operations in a motor vehicle
DE102012010757A1 (en) 2012-05-31 2012-12-06 Daimler Ag Lighting device for vehicle, has eye-tracking system for detecting eye position and viewing direction, where lighting device is divided into multiple pre-defined positioning areas
DE102012025032B4 (en) * 2012-12-19 2015-03-05 Audi Ag Display device for a motor vehicle and method for operating such a display device
DE102013000744A1 (en) 2013-01-17 2014-07-17 Audi Ag Method and system for controlling at least one functional unit and motor vehicle and mobile terminal with such a system
DE102013001384A1 (en) 2013-01-26 2014-07-31 Audi Ag Method and system for viewing direction-dependent control of a plurality of functional units and motor vehicles and mobile terminal with such a system
DE102013001380B4 (en) 2013-01-26 2018-04-26 Audi Ag Method for operating at least one display device of a motor vehicle and system having at least one display device and motor vehicles
DE102013001383B4 (en) 2013-01-26 2016-03-03 Audi Ag Method and system for operating a rear window wiper of a motor vehicle
DE102013003059A1 (en) 2013-02-22 2014-08-28 Audi Ag Method for controlling functional unit of motor vehicle, involves automatically detecting whether view of vehicle occupant to given area is directed by view detection unit
DE102013006086A1 (en) 2013-04-09 2014-01-02 Daimler Ag System for performing eye-movement controlled authentication of vehicle driver/user, outputs control signal based on sequence comparison result of detected sequence of eye movements of vehicle driver/user with pre-stored eye sequence
DE102013015204B4 (en) 2013-09-13 2015-06-18 Audi Ag Method and system for operating at least one display device of a motor vehicle and motor vehicles with a system for operating at least one display device
DE102013015205B3 (en) * 2013-09-13 2015-02-05 Audi Ag Method and system for operating a plurality of display devices of a motor vehicle and motor vehicle with a system for operating a plurality of display devices
DE102013218917A1 (en) 2013-09-20 2015-03-26 Bayerische Motoren Werke Aktiengesellschaft Device for controlling devices in vehicles by means of a viewing direction detection
DE102013019572B4 (en) 2013-11-22 2025-02-06 Audi Ag Method for operating an infotainment system of a motor vehicle and motor vehicle with an infotainment system
DE102013021814A1 (en) 2013-12-20 2015-06-25 Audi Ag Control device with eyetracker
DE102013022035B4 (en) 2013-12-20 2015-11-12 Audi Ag Motor vehicle operating device with graphical user interface, and motor vehicle and method
DE102014002493B4 (en) 2014-02-22 2018-08-16 Audi Ag System with and method for automatically switching on / off a setting device for a head-up display device
DE102014203981B4 (en) * 2014-03-05 2021-03-04 Bayerische Motoren Werke Aktiengesellschaft Device for simplifying the operation of an adjustable component in vehicles
DE102014014602A1 (en) * 2014-10-07 2016-04-07 Audi Ag Method for operating a motor vehicle and motor vehicle
DE102014222195A1 (en) 2014-10-30 2016-05-04 Bayerische Motoren Werke Aktiengesellschaft Vehicle operation depending on the driving mode
DE102015007498A1 (en) * 2015-06-10 2016-12-15 Cuma Kilic Information system for persons who are in particular on the back seats of a motor vehicle
DE102015212850A1 (en) * 2015-07-09 2017-01-12 Volkswagen Aktiengesellschaft User interface and method for assisting a user in interacting with a user interface
ES2718429B2 (en) 2017-12-29 2019-11-18 Seat Sa Method and associated device to control at least one parameter of a vehicle
DE102023123103A1 (en) * 2023-08-28 2025-03-06 Bayerische Motoren Werke Aktiengesellschaft Control element arrangement for a vehicle and method for configuring at least one control element

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4827520A (en) * 1987-01-16 1989-05-02 Prince Corporation Voice actuated control system for use in a vehicle
US5239700A (en) * 1988-12-16 1993-08-24 Robert Bosch Gmbh Multi-choice information system for a motor vehicle
DE19631414A1 (en) * 1996-08-05 1998-02-19 Daimler Benz Ag Device for recording the retinal reflex image and superimposing additional images in the eye
US5689619A (en) * 1996-08-09 1997-11-18 The United States Of America As Represented By The Secretary Of The Army Eyetracker control of heads-up displays
EP0933720A3 (en) * 1998-01-29 1999-11-10 Shimadzu Corporation Input apparatus for the physically handicapped

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005003535A1 (en) * 2005-01-25 2006-08-03 Daimlerchrysler Ag Providing information by optical or acoustic signaling apparatus e.g. in a vehicle which can be activated by detecting the direction in which the user is looking
EP1997667A1 (en) * 2007-05-31 2008-12-03 Volkswagen AG Device and method for showing information
US9598070B2 (en) 2010-03-02 2017-03-21 GM Global Technology Operations LLC Infotainment system control
CN102887121A (en) * 2011-07-19 2013-01-23 通用汽车环球科技运作有限责任公司 Method to map gaze position to information display in vehicle
WO2014033042A1 (en) * 2012-08-30 2014-03-06 Bayerische Motoren Werke Aktiengesellschaft Providing an input for an operating element
EP3001289A4 (en) * 2013-05-23 2017-01-18 Pioneer Corporation Display controller
WO2015090485A1 (en) * 2013-12-20 2015-06-25 Audi Ag Operating device that can be operated without keys
CN105683869A (en) * 2013-12-20 2016-06-15 奥迪股份公司 Operating device that can be operated without keys
US9703375B2 (en) 2013-12-20 2017-07-11 Audi Ag Operating device that can be operated without keys
WO2016012597A3 (en) * 2014-07-25 2016-04-07 Bayerische Motoren Werke Aktiengesellschaft User interface and operating method for view-based operation of a speed-regulating system
ITUB20154786A1 (en) * 2015-11-03 2017-05-03 Ferrari Spa UNIT AND METHOD OF CONTROL OF AT LEAST ONE VEHICLE DEVICE
CN113165516A (en) * 2018-12-03 2021-07-23 戴姆勒股份公司 Method and device for adjusting vehicle components
CN113165516B (en) * 2018-12-03 2024-12-10 梅赛德斯-奔驰集团股份公司 Method and device for adjusting vehicle components
US12291100B2 (en) 2018-12-03 2025-05-06 Mercedes-Benz Group AG Method and device for adjusting a vehicle component
WO2020249298A1 (en) * 2019-06-12 2020-12-17 Daimler Ag Method for optimising the operation of an optical display
CN113966581A (en) * 2019-06-12 2022-01-21 戴姆勒股份公司 Method for optimizing operation of optical display device

Also Published As

Publication number Publication date
DE10121392A1 (en) 2002-11-21
WO2002088824A3 (en) 2003-04-10

Similar Documents

Publication Publication Date Title
WO2002088824A2 (en) Device for controlling equipment by means of a line of vision
EP2200858B9 (en) Vehicle system comprising an assistance functionality
EP1342605B1 (en) Device for controlling a screen display
EP2870430B1 (en) Method and control system for operating a vehicle
DE102013021834B4 (en) Device and method for navigating within a menu for vehicle control and selecting a menu entry from the menu
EP1853465B1 (en) Method and device for voice controlling a device or system in a motor vehicle
DE102007049710A1 (en) Visual triggering of operations in a motor vehicle
DE102006028046A1 (en) Combined display and control device for motor vehicle, has screen for displaying and selecting functions, and detecting device detecting control unit, where screen is switchable from information mode into control mode by control unit
DE102016120999B4 (en) User interface and method for inputting and outputting information in a vehicle
DE102014222195A1 (en) Vehicle operation depending on the driving mode
EP3243688B1 (en) Method and device for the allocation of control commands in a vehicle, as well as vehicle
DE102013003059A1 (en) Method for controlling functional unit of motor vehicle, involves automatically detecting whether view of vehicle occupant to given area is directed by view detection unit
DE102016217821A1 (en) Method for interacting with display and / or operating devices in a vehicle
DE69710815T2 (en) Touch control system for in-vehicle electronic devices
DE102009056014A1 (en) Method and device for providing a user interface for a device detachably mounted in a vehicle
DE102017206312A1 (en) Support handling of an object located within a passenger compartment and motor vehicle
WO2022028892A1 (en) Intelligent head-up display
DE102004033480A1 (en) Device for monitoring a vehicle operation
WO2023174595A1 (en) Means of transportation, and device and method for outputting information to a user of a means of transportation
WO2019115340A1 (en) Method for operating an assistance system, and an assistance system for a motor vehicle
WO2015090528A1 (en) Motor vehicle operating apparatus having a graphical user interface
DE102013216126A1 (en) Method and device for activating a function
DE102020001658B3 (en) Procedure for securing the takeover of control of a vehicle
DE102019127183A1 (en) Display system for displaying an operating instruction for an operating element in a motor vehicle
EP1529989A2 (en) Transmission control mechanism with several changeble transmission functions and corresponding transmisson control methods

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): JP KR US

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP