WO2009144206A1 - Information and assistance system as well as a method for controlling the latter - Google Patents
Information and assistance system as well as a method for controlling the latter Download PDFInfo
- Publication number
- WO2009144206A1 WO2009144206A1 PCT/EP2009/056340 EP2009056340W WO2009144206A1 WO 2009144206 A1 WO2009144206 A1 WO 2009144206A1 EP 2009056340 W EP2009056340 W EP 2009056340W WO 2009144206 A1 WO2009144206 A1 WO 2009144206A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- avatar
- information
- user
- size
- touch screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/22—Display screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/26—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/143—Touch sensitive instrument input devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/143—Touch sensitive instrument input devices
- B60K2360/1438—Touch screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/148—Instrument input by voice
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/161—Explanation of functions, e.g. instructions
Definitions
- the invention relates to an information and assistance system, in particular for automobiles, and to a method for controlling the system, the system having a virtual figure (avatar) that can be controlled by a user.
- avatar virtual figure
- the document WO 2007/041223 A2 discloses an automated dialog system which contains a virtual dialog partner (avatar).
- avatar virtual dialog partner
- the user can communicate with the avatar by means of various sensors, audio, pressure, temperature or chemical sensor.
- the avatar is tunable to the attributes of the user.
- DE 601 22 298 T2 shows a technical implementation for the input of data into an information system. In doing so, the method relies on a virtual environment in which a user can be presented by an avatar, who can conduct this by means of touching processes through the environment.
- an avatar is controlled in real time by gestures.
- the known devices and methods have the disadvantage that the avatars are often not sufficiently adapted to the needs of users.
- Experienced users of information and assistance systems could be annoyed, for example, by too large or frequent avatars, while inexperienced users might find too little information to be of little help.
- the invention is therefore based on the object to provide a control device that adapts the information content and the information output to the user, whereby quality and quantity are dependent on the use of the system.
- the user is to be given assistance and information about the respective operating situation by an avatar.
- the claimed control device for information and assistance systems has a display device for displaying an avatar for data output, in particular for touchscreen applications.
- the avatar is controllable by a user. By changing the size and / or position of the avatar by a user, the information content is determined and adjusted. This behavior is called adaptive. The quality and quantity of the information given varies according to usage. If the avatar is taken to a position on a monitor, he will output the information for that position. Depending on the size of the avatar, the information is in expert mode, i. little and precise, or in beginner mode, i. detailed, available.
- the user can directly influence the type of assistance via various input modalities. Changing the position and / or size can be done by acoustic, visual and / or mechanical signals.
- the system is thus multimodal.
- the multimodal Possibility of an ergonomically particularly advantageous and intuitive dialogue control.
- control of the system can be carried out via a touch screen, which can be integrated into an assistance system in the dashboard of an automobile. Control over other monitors is also possible.
- the application of the claimed system does not only relate to automobiles. Applications in other areas such. As in the use of accessible equipment, in the field of trade and tourism are also conceivable.
- a custom monitor may be connected to the system so that it can be controlled by mouse, keyboard or other sensors. The user has the opportunity, for example by means of hand and finger gestures as well as by means of
- Voice input or touch operations to control the interaction with the avatar and thus directly influence the formal and content representation of the avatar and its mediated content.
- An embodiment of the invention provides to use the distance of the user from the display for the interaction.
- the system has an approach detection and can thus reduce the distance, e.g. detect the user's hand.
- the avatar looks smaller when approaching the display; as the distance gets smaller, the avatar is shown enlarged.
- the avatar can also be operated via voice input or other controls in the vehicle, for example by integrated in the steering wheel buttons.
- the avatar provides intuitive assistance and information about the respective operating situation.
- the control of the avatar is adaptive and multimodal.
- the way, the position and the behavior of the avatar are determined by the nature of the user's interaction with the avatar.
- the position and / or size of the avatar is changed according to the invention by means of finger pressure or tension on the touch screen.
- An embodiment of the invention provides that the information is updated throughout the system-user interaction and automatically adjusted to the position and / or size of the avatar. For example, if the avatar is positioned over an area indicating the weather, the user will be provided with the appropriate weather information. Moving the avatar to another screen area will output the corresponding information stored in that area. The size of the avatar determines the amount of information output or the quality of the help. If the avatar is reduced by the user, the number of information is minimized. If it is enlarged, the information is detailed. This has the advantage that the user can freely choose the amount of information depending on the level of knowledge.
- the graphical representation of the avatar e.g. As the representation of gender or hair color, also selectable by the user.
- the system may have a user recognition.
- a user When a user first uses the system for the first time, it is recognized and the avatar has different, more comprehensive information and assistance than with repeated use.
- user-based recognition is possible.
- the information to be output is adapted, that is, the avatar is user-controllable.
- the activation of the avatar takes place depending on the driving context, ie preferably at standstill or in situations with low consumption. chung.
- corresponding systems for example cameras in the vehicle, may be installed.
- the avatar provides assistance depending on the context of use. If, for example, a user is in a navigation menu, the user receives the
- User Information about targeting For example, if the user is in a multimedia menu, the user obtains information for retrieving songs from a mobile terminal.
- the avatar can be activated or deactivated by the system itself, for example when restarting or changing users, or directly by the user, for example by pressing on a touch screen.
- the data output of the avatar is multimedia, so that the user can select the right channel for him.
- information such as: To read travel information.
- Another possibility is an optical output of the information z. B. in the form of flashing or color change.
- Fig. 1 Information and assistance system inserted in the dashboard of an automobile. At the push of a button (i) an avatar appears.
- FIG. 1 shows an information and assistance system 1 built into the dashboard 6 of an automobile, in particular for automobiles, the system having a display device 2 for displaying an avatar 3 for data output and control of the avatar 3 by the user.
- a display device 2 for displaying an avatar 3 for data output and control of the avatar 3 by the user.
- By touching the marked input area (i-field) 7 on the touch screen 2 appears the avatar 3.
- a appearance of the avatar 3 can also by approaching a user to the system 1, a voice command (eg "Information") or a hand gesture done.
- the avatar can be directly activated or deactivated by the system itself, for example at reboot or by a user.
- the control of the avatar 3 includes not only the activation and deactivation but also the change of the position 4 and / or size 5 on the monitor 2.
- FIG. 2 shows as a method of the system control a position change 4 of FIG
- FIG. 3 shows a further method for controlling a system size change 5 of the avatar 3. This can also be done by finger pressure on the touch screen 2. Position 4 and size changes 5 can alternatively be used in combination.
- the avatar 3 can be controlled in this regard by means of hand or finger gesture via a Gestikerkennung or via a direct touch screen touch. The control can be carried out by acoustic, visual or mechanical signals or by combining the signals with each other.
- the information and assistance system has a central control unit which contains, on the one hand, different sensors for controlling and, on the other hand, multimodal output channels. Sensors and output channels can work acoustically, optically and / or mechanically.
- the system is designed to update the information throughout the system-user interaction.
- the information adapts adaptively in context to the position and / or size of the avatar. If the avatar is small, then the amount of information is low, with an increased avatar the quantity of information increases.
- the system has a controller with a device for storing user-based information. This makes it possible for the user to be recognized, so that the knowledge stored in the system and the usage preferences do not have to be reentered.
- the system thus works with application-based recognition.
- the data output by the avatar is multimedia and occurs for example by means of acoustic, written and optical signals.
- the output information and assistance changes depending on the user's changed position 4 of the avatar. For example, as shown in FIG. 4, a position on the edge area 8 leads to the reduction of information and assistance. A position in the central display area 9 leads to an increase in the quantity of information. In the central area 9, the avatar 3 appears partially transparent, so that underlying buttons and information are not obscured obscured.
- the appearance and / or the size of the avatar can be manipulated by the user by means of the intensity of the finger pressure on the touch screen on the position of the avatar.
- a firm finger pressure on the avatar can lead to the fact that the avatar is switched off or to that the appearance changes and the avatar, for example, enlarged or reduced displayed.
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Combustion & Propulsion (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Beschreibungdescription
Informations- und Assistenzsystem sowie ein Verfahren zu dessen SteuerungInformation and assistance system and a method for its control
Die Erfindung betrifft ein Informations- und Assistenzsystem, insbesondere für Automobile, und ein Verfahren zur Steuerung des Systems, wobei das System eine virtuelle Figur (Avatar) aufweist, die durch einen Nutzer steuerbar ist.The invention relates to an information and assistance system, in particular for automobiles, and to a method for controlling the system, the system having a virtual figure (avatar) that can be controlled by a user.
Bei der Interaktion eines Anwenders mit Informations- und Assistenzsystemen kann der Anwender mit Hilfestellungen, die über einen Avatar vermittelt werden, interagieren . Zur Unterstützung des Interaktionsverlaufs zwischen Nutzer und Infor- mationssystem sind Avatare mit unterschiedlichen Steuermöglichkeiten bekannt.When a user interacts with information and assistance systems, the user can interact with assistance conveyed through an avatar. To support the interaction between the user and the information system, avatars with different control options are known.
Aus der Druckschrift WO 2007/041223 A2 ist ein automatisiertes Dialogsystem bekannt, welches einen virtuellen Dialog- partner (Avatar) enthält. Der Nutzer kann mittels verschiedener Sensoren, Audio-, Druck-, Temperatur- oder chemischer Sensor, mit dem Avatar kommunizieren. Dabei ist der Avatar auf die Attribute des Nutzers abstimmbar. DE 601 22 298 T2 zeigt eine technische Umsetzung zur Eingabe von Daten in ein Informationssystem. Dabei stützt sich das Verfahren auf eine virtuelle Umgebung in der ein Anwender durch einen Avatar präsentiert, diesen mittels Berührvorgänge durch die Umgebung führen kann. In WO 99/19788 wird ein Avatar in Echtzeit durch Gesten gesteuert.The document WO 2007/041223 A2 discloses an automated dialog system which contains a virtual dialog partner (avatar). The user can communicate with the avatar by means of various sensors, audio, pressure, temperature or chemical sensor. The avatar is tunable to the attributes of the user. DE 601 22 298 T2 shows a technical implementation for the input of data into an information system. In doing so, the method relies on a virtual environment in which a user can be presented by an avatar, who can conduct this by means of touching processes through the environment. In WO 99/19788 an avatar is controlled in real time by gestures.
Die bekannten Vorrichtungen und Verfahren haben den Nachteil, dass die Avatare oft nicht genügend auf die Bedürfnisse der Nutzer abgestimmt sind. Versierte Nutzer von Informationsund Assistenzsystemen könnten so beispielsweise von zu großen oder häufig auftretenden Avataren genervt sein, während ungeübte Nutzer eine zu geringe Informationsmenge als wenig hilfreich empfinden könnten. Der Erfindung liegt daher die Aufgabe zugrunde, eine Steuerungseinrichtung zu schaffen, die den Informationsgehalt und die Informationsausgabe an den Nutzer anpasst, wobei Qualität und Quantität dabei von der Benutzung des Systems abhängig sind. Dabei sollen dem Nutzer in Abhängigkeit von der Nutzungssituation, dem Fahrkontext, den persönlichen Vorlieben und dem individuellem Übungsgrad durch eine Avatar Hilfestellungen und Informationen zur jeweiligen Bediensituation vermittelt werden.The known devices and methods have the disadvantage that the avatars are often not sufficiently adapted to the needs of users. Experienced users of information and assistance systems could be annoyed, for example, by too large or frequent avatars, while inexperienced users might find too little information to be of little help. The invention is therefore based on the object to provide a control device that adapts the information content and the information output to the user, whereby quality and quantity are dependent on the use of the system. Depending on the usage situation, the driving context, the personal preferences and the individual degree of exertion, the user is to be given assistance and information about the respective operating situation by an avatar.
Diese Aufgabe wird erfindungsgemäß durch die kennzeichnenden Merkmale der unabhängigen Ansprüche in Verbindung mit den Merkmalen der Oberbegriffe gelöst.This object is achieved by the characterizing features of the independent claims in conjunction with the features of the preambles.
Die beanspruchte Steuerungseinrichtung für Informations- und Assistenzsysteme weist eine Anzeigevorrichtung zur Darstellung eines Avatars zur Datenausgabe insbesondere für Touch- Screen-Anwendungen auf. Der Avatar ist durch einen Nutzer steuerbar. Durch Änderung der Größe und/oder der Position des Avatars durch einen Nutzer wird der Informationsgehalt bestimmt und angepasst. Dieses Verhalten nennt man adaptiv. Es ändern sich Qualität und Quantität der ausgegebenen Informationen je nach Nutzung. Wird der Avatar zu einer Position auf einem Monitor geführt, so gibt er die Informationen für diese Position aus. Je nach Größe des Avatars sind die Informationen im Expertenmodus, d.h. wenig und präzise, oder im Anfängermodus, d.h. ausführlich, verfügbar.The claimed control device for information and assistance systems has a display device for displaying an avatar for data output, in particular for touchscreen applications. The avatar is controllable by a user. By changing the size and / or position of the avatar by a user, the information content is determined and adjusted. This behavior is called adaptive. The quality and quantity of the information given varies according to usage. If the avatar is taken to a position on a monitor, he will output the information for that position. Depending on the size of the avatar, the information is in expert mode, i. little and precise, or in beginner mode, i. detailed, available.
Durch die in den Unteransprüchen angegebenen Maßnahmen sind vorteilhaft Weiterbildungen und Verbesserungen möglich.The measures specified in the dependent claims advantageous refinements and improvements are possible.
Erfindungsgemäß kann der Nutzer über verschiedene Eingabemodalitäten die Art und Weise der Hilfestellungen unmittelbar beeinflussen. Das Ändern der Position und/oder Größe kann durch akustische, visuelle und/oder mechanische Signale erfolgen. Das System ist somit multimodal. Die multimodale Be- dienmöglichkeit erlaubt eine ergonomisch besonders vorteilhafte und intuitive Dialogsteuerung.According to the invention, the user can directly influence the type of assistance via various input modalities. Changing the position and / or size can be done by acoustic, visual and / or mechanical signals. The system is thus multimodal. The multimodal Possibility of an ergonomically particularly advantageous and intuitive dialogue control.
Erfindungsgemäß kann die Steuerung des Systems über einen Touch-Screen erfolgen, der in ein Assistenzsystem in der Armaturentafel eines Automobils integriert sein kann. Ein Steuern über andere Monitore ist ebenfalls möglich. Dabei bezieht sich die Anwendung des beanspruchten Systems nicht nur auf Automobile. Anwendungen in anderen Bereichen wie z. B. bei der Benutzung von behindertengerechten Geräten, im Bereich des Handels und im Tourismus sind ebenfalls denkbar. Ein je nach Bereich angepasster Monitor kann mit dem System so verbunden sein, dass eine Steuerung über Maus, Tastatur oder andere Sensoren möglich ist. Der Nutzer hat die Möglichkeit, beispielsweise mittels Hand- und Fingergestik sowie mittelsAccording to the invention, the control of the system can be carried out via a touch screen, which can be integrated into an assistance system in the dashboard of an automobile. Control over other monitors is also possible. The application of the claimed system does not only relate to automobiles. Applications in other areas such. As in the use of accessible equipment, in the field of trade and tourism are also conceivable. A custom monitor may be connected to the system so that it can be controlled by mouse, keyboard or other sensors. The user has the opportunity, for example by means of hand and finger gestures as well as by means of
Spracheingabe oder Berührungsvorgänge die Interaktion mit dem Avatar zu steuern und damit unmittelbar die formale und inhaltliche Repräsentation des Avatars und seiner vermittelten Inhalte zu beeinflussen.Voice input or touch operations to control the interaction with the avatar and thus directly influence the formal and content representation of the avatar and its mediated content.
Eine erfindungsgemäße Ausführung sieht vor, den Abstand des Nutzers vom Display für die Interaktion zu nutzen.An embodiment of the invention provides to use the distance of the user from the display for the interaction.
Erfindungsgemäß verfügt das System über eine Annäherungsdete- ketion und kann so die Entfernung z.B. der Hand des Nutzers detektieren. Dabei erscheint der Avatars bei Annäherung zum Display zunächst verkleinert, mit geringer werdender Distanz wird der Avatar vergrößert dargestellt. Wahlweise lässt sich der Avatar auch über Spracheingabe oder andere Bedienelemente im Fahrzeug, beispielsweise durch im Lenkrad integrierte Tasten bedienen.According to the invention, the system has an approach detection and can thus reduce the distance, e.g. detect the user's hand. At the same time, the avatar looks smaller when approaching the display; as the distance gets smaller, the avatar is shown enlarged. Optionally, the avatar can also be operated via voice input or other controls in the vehicle, for example by integrated in the steering wheel buttons.
In Abhängigkeit von Nutzungssituation, Übungsgrad und persönlichen Vorlieben gibt der Avatar intuitive Hilfestellungen und Informationen zur jeweiligen Bediensituation. Dabei erfolgt die Steuerung des Avatar adaptiv und multimodal. Die Art und Weise, die Position und das Verhalten des Avatars werden von der Art der Interaktion des Nutzers mit dem Avatar bestimmt. Die Position und/oder Größe des Avatars wird erfindungsgemäß mittels Fingerdruck oder -zug auf dem Touch-Screen geändert .Depending on the usage situation, the level of exercise and personal preferences, the avatar provides intuitive assistance and information about the respective operating situation. The control of the avatar is adaptive and multimodal. The way, the position and the behavior of the avatar are determined by the nature of the user's interaction with the avatar. The position and / or size of the avatar is changed according to the invention by means of finger pressure or tension on the touch screen.
Eine Ausführung der Erfindung sieht vor, dass die Informationen während der gesamten System-Benutzer-Interaktion aktualisiert werden und der Position und/oder Größe des Avatars automatisch angepasst werden. Wird der Avatar beispielsweise über einem Bereich, der das Wetter angibt positioniert, so erhält der Nutzer die entsprechenden Wetterinformationen. Bei einem Verschieben des Avatars in einen anderen Bildschirmbereich, werden die entsprechenden Informationen ausgegeben, die in diesem Bereich hinterlegt sind. Die Größe des Avatars bestimmt dabei die Menge der ausgegebenen Informationen oder die Qualität der Hilfestellungen. Wird der Avatar vom Nutzer verkleinert, so wird die Anzahl der Informationen minimiert. Wird er vergrößert, so erfolgen die Informationen ausführlich. Dies hat den Vorteil, dass der Nutzer die Informations- menge je nach Kenntnisstand frei wählen kann.An embodiment of the invention provides that the information is updated throughout the system-user interaction and automatically adjusted to the position and / or size of the avatar. For example, if the avatar is positioned over an area indicating the weather, the user will be provided with the appropriate weather information. Moving the avatar to another screen area will output the corresponding information stored in that area. The size of the avatar determines the amount of information output or the quality of the help. If the avatar is reduced by the user, the number of information is minimized. If it is enlarged, the information is detailed. This has the advantage that the user can freely choose the amount of information depending on the level of knowledge.
In einer bevorzugten Ausführungsform ist die graphische Repräsentation des Avatars, z. B. die Darstellung von Geschlecht oder Haarfarbe, durch den Nutzer ebenfalls wählbar.In a preferred embodiment, the graphical representation of the avatar, e.g. As the representation of gender or hair color, also selectable by the user.
Erfindungsgemäß kann das System über eine Nutzererkennung verfügen. Bedient ein Nutzer das System zum ersten Mal, so wird dies erkannt und der Avatar hält andere, umfassendere Informationen und Hilfestellungen bereit als bei wiederholter Nutzung. Durch eine Speicherung von benutzerbasierten Informationen ist eine anwenderbasierte Wiedererkennung möglich. Die auszugebenden Informationen werden angepasst, dass heißt, der Avatar ist benutzerdefiniert steuerbar.According to the invention, the system may have a user recognition. When a user first uses the system for the first time, it is recognized and the avatar has different, more comprehensive information and assistance than with repeated use. By storing user-based information, user-based recognition is possible. The information to be output is adapted, that is, the avatar is user-controllable.
In einer bevorzugten Ausführungsform erfolgt die Aktivierung des Avatars in Abhängigkeit vom Fahrkontext, d.h. vorzugsweise im Stillstand oder in Situationen mit geringer Beanspru- chung. Zur Detektion einer Beanspruchung oder einer Ablenkung können entsprechende Systeme, beispielsweise Kameras im Fahrzeug verbaut sein. Der Avatar vermittelt abhängig vom jeweiligen Nutzungskontext Hilfestellungen. Befindet sich ein Nut- zer beispielsweise in einem Navigationsmenü, so erhält derIn a preferred embodiment, the activation of the avatar takes place depending on the driving context, ie preferably at standstill or in situations with low consumption. chung. To detect a stress or a deflection, corresponding systems, for example cameras in the vehicle, may be installed. The avatar provides assistance depending on the context of use. If, for example, a user is in a navigation menu, the user receives the
Nutzer Informationen zur Zielwunscheingabe. Befindet sich der Nutzer in einem Multimedia Menü, erhält der Nutzer beispielsweise Informationen zum Abrufen von Musiktiteln aus einem mobilen Endgerät.User Information about targeting. For example, if the user is in a multimedia menu, the user obtains information for retrieving songs from a mobile terminal.
In einer weiteren Ausführungsform kann der Avatar durch das System selbst, beispielsweise bei Neustart oder Benutzerwechsel, oder direkt durch den Nutzer, beispielsweise durch Druck auf einen Touch-Screen, aktiviert oder deaktiviert werden.In a further embodiment, the avatar can be activated or deactivated by the system itself, for example when restarting or changing users, or directly by the user, for example by pressing on a touch screen.
Erfindungsgemäß erfolgt die Datenausgabe des Avatars multimedial, sodass der Nutzer, den für ihn passenden Kanal auswählen kann. Beispielsweise ist es während einer Autofahrt sinnvoll, den Audiokanal zu wählen, während es im Parkzustand vorteilhaft sein kann, Informationen, wie z.B. Reiseinformationen zu lesen. Eine weitere Möglichkeit ist eine optische Ausgabe der Informationen z. B. in Form von Blinken oder Farbwechsel .According to the data output of the avatar is multimedia, so that the user can select the right channel for him. For example, while driving it makes sense to choose the audio channel, while in the park state it may be beneficial to have information such as: To read travel information. Another possibility is an optical output of the information z. B. in the form of flashing or color change.
Das Informations- und Assistenzsystem soll anhand von einigen Ausführungsbeispielen näher erläutert werden.The information and assistance system will be explained in more detail with reference to some embodiments.
Es zeigen:Show it:
Fig. 1 Informations- und Assistenzsystem eingefügt in die Armaturentafel eines Automobils. Auf Knopfdruck (i) erscheint ein Avatar.Fig. 1 Information and assistance system inserted in the dashboard of an automobile. At the push of a button (i) an avatar appears.
Fig. 2 Positionsänderung eines AvatarsFig. 2 position change of an avatar
Fig. 3 Größenänderung eines Avatars Fig. 4 Abhängigkeit des Informationsgehaltes von der Position eines AvatarsFig. 3 resizing an avatar Fig. 4 dependence of the information content of the position of an avatar
Fig. 1 zeigt ein in die Armaturentafel 6 eines Automobils eingebautes Informations- und Assistenzsystem 1, insbesondere für Automobile, wobei das System eine Anzeigevorrichtung 2 zur Darstellung eines Avatars 3 zur Datenausgabe und Steuerung des Avatars 3 durch den Nutzer aufweist. Durch Berühren des markierten Eingabebereiches (i-Feld) 7 auf dem Touch- Screen 2 erscheint der Avatar 3. Ein Erscheinen des Avatars 3 kann auch durch Annäherung eines Nutzers an das System 1, einen Sprachbefehl (z. B. "Information") oder eine Handgeste erfolgen .1 shows an information and assistance system 1 built into the dashboard 6 of an automobile, in particular for automobiles, the system having a display device 2 for displaying an avatar 3 for data output and control of the avatar 3 by the user. By touching the marked input area (i-field) 7 on the touch screen 2 appears the avatar 3. A appearance of the avatar 3 can also by approaching a user to the system 1, a voice command (eg "Information") or a hand gesture done.
Der Avatar kann durch das System selbst, beispielsweise bei Neustart oder durch einen Nutzer direkt aktiviert oder deaktiviert werden. Die Steuerung des Avatars 3 umfasst neben dem Aktivieren und Deaktivieren auch die Änderung der Position 4 und/oder Größe 5 auf dem Monitor 2. Fig. 2 zeigt als eine Me- thode der Systemsteuerung eine Positionsveränderung 4 desThe avatar can be directly activated or deactivated by the system itself, for example at reboot or by a user. The control of the avatar 3 includes not only the activation and deactivation but also the change of the position 4 and / or size 5 on the monitor 2. FIG. 2 shows as a method of the system control a position change 4 of FIG
Avatars 3 auf dem Monitor 2 mittels Fingerdruck und -zug auf dem Touch-Screen 2. Fig. 3 zeigt als weitere Methode zur Systemsteuerung eine Größenveränderung 5 des Avatars 3. Dies kann ebenfalls mittels Fingerdruck auf den Touch-Screen 2 ausgeführt werden. Positions- 4 und Größenveränderungen 5 können alternativ kombiniert eingesetzt werden. Der Avatar 3 kann diesbezüglich mittels Hand- oder Fingergestik über eine Gestikerkennung oder über eine direkte Touch-Screen-Berührung gesteuert werden. Die Steuerung kann durch akustische, visu- eile oder mechanische Signale oder durch Kombination der Signale untereinander erfolgen.Avatars 3 on the monitor 2 by means of finger pressure and pull on the touch screen 2. Fig. 3 shows a further method for controlling a system size change 5 of the avatar 3. This can also be done by finger pressure on the touch screen 2. Position 4 and size changes 5 can alternatively be used in combination. The avatar 3 can be controlled in this regard by means of hand or finger gesture via a Gestikerkennung or via a direct touch screen touch. The control can be carried out by acoustic, visual or mechanical signals or by combining the signals with each other.
Das Informations- und Assistenzsystem weist eine zentrale Steuereinheit auf, die einerseits unterschiedliche Sensoren zur Steuerung und andererseits multimodale Ausgabekanäle enthält. Sensoren und Ausgabekanäle können akustisch, optisch und/oder mechanisch arbeiten. Das System ist so ausgebildet, dass die Informationen während der gesamten System-Benutzer-Interaktion aktualisiert werden. Dabei passen sich die Informationen adaptiv im Kontext zur Position und/oder Größe des Avatars an. Ist der Avatar klein, so ist auch die Informationsmenge gering, bei vergrößertem Avatar steigt die Quantität der Informationen.The information and assistance system has a central control unit which contains, on the one hand, different sensors for controlling and, on the other hand, multimodal output channels. Sensors and output channels can work acoustically, optically and / or mechanically. The system is designed to update the information throughout the system-user interaction. The information adapts adaptively in context to the position and / or size of the avatar. If the avatar is small, then the amount of information is low, with an increased avatar the quantity of information increases.
Das System weist eine Steuerungseinrichtung mit Vorrichtung zur Speicherung von benutzerbasierten Informationen auf. Da- durch ist eine Wiedererkennung des Nutzers möglich, sodass der im System gespeicherte Kenntnisstand und die Benutzungsvorlieben nicht erneut eingegeben werden müssen. Das System arbeitet somit mit einer anwendungsbasierten Wiedererkennung.The system has a controller with a device for storing user-based information. This makes it possible for the user to be recognized, so that the knowledge stored in the system and the usage preferences do not have to be reentered. The system thus works with application-based recognition.
Die Datenausgabe durch den Avatar erfolgt multimedial und erfolgt beispielsweise mittels akustischer, schriftlicher und optischer Signale.The data output by the avatar is multimedia and occurs for example by means of acoustic, written and optical signals.
Möchte ein Nutzer die Hilfestellungen beenden, so kann er da- zu den auf dem Touch-Screen 2 dargestellten Avatar 3 an den Rand 8 des Bildschirms 2 "schieben".If a user wishes to end the assistance, he can "push" the avatar 3 shown on the touch screen 2 to the edge 8 of the screen 2.
Die ausgegebenen Informationen und Hilfestellungen ändern sich in Abhängigkeit von der durch den Nutzer vorgenommenen Positionsveränderung 4 des Avatars. So führt beispielsweise wie in Fig. 4 dargestellt, eine Position am Randbereich 8 zur Reduktion von Informationen und Hilfestellungen. Eine Position im zentralen Displaybereich 9 führt zu einem Quantitätsanstieg der Informationen. Im zentralen Bereich 9 erscheint der Avatar 3 teiltransparent, so dass dahinter liegenden Schalt- flächen und Informationen nicht unkenntlich verdeckt sind.The output information and assistance changes depending on the user's changed position 4 of the avatar. For example, as shown in FIG. 4, a position on the edge area 8 leads to the reduction of information and assistance. A position in the central display area 9 leads to an increase in the quantity of information. In the central area 9, the avatar 3 appears partially transparent, so that underlying buttons and information are not obscured obscured.
Das Erscheinungsbild und/oder die Größe des Avatars kann durch den Nutzer mittels Intensität des Fingerdrucks über den Touch-Screen auf die Position des Avatars manipuliert werden. So kann ein fester Fingerdruck auf den Avatar dazu führen, dass der Avatar ausgeschalten wird oder aber dazu, dass sich das Erscheinungsbild ändert und der Avatar beispielsweise vergrößert oder verkleinert dargestellt wird. The appearance and / or the size of the avatar can be manipulated by the user by means of the intensity of the finger pressure on the touch screen on the position of the avatar. Thus, a firm finger pressure on the avatar can lead to the fact that the avatar is switched off or to that the appearance changes and the avatar, for example, enlarged or reduced displayed.
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102008026030A DE102008026030B4 (en) | 2008-05-30 | 2008-05-30 | Information and assistance system and a method for its control |
| DE102008026030.4 | 2008-05-30 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2009144206A1 true WO2009144206A1 (en) | 2009-12-03 |
Family
ID=41047361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2009/056340 Ceased WO2009144206A1 (en) | 2008-05-30 | 2009-05-26 | Information and assistance system as well as a method for controlling the latter |
Country Status (2)
| Country | Link |
|---|---|
| DE (1) | DE102008026030B4 (en) |
| WO (1) | WO2009144206A1 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102008028512A1 (en) | 2008-06-16 | 2009-12-17 | Audi Ag | Communication system and method for displaying information in a communication |
| DE102009058146B4 (en) | 2009-12-12 | 2024-07-11 | Volkswagen Ag | Method and device for multimodal context-sensitive operation |
| JP5994659B2 (en) * | 2012-05-07 | 2016-09-21 | 株式会社デンソー | VEHICLE DEVICE, INFORMATION DISPLAY PROGRAM, VEHICLE SYSTEM |
| DE102012214295B4 (en) * | 2012-08-10 | 2025-05-28 | Bayerische Motoren Werke Aktiengesellschaft | Operating device at least for setting a desired seating position in a motor vehicle |
| DE102012016110B4 (en) * | 2012-08-15 | 2026-01-29 | Volkswagen Aktiengesellschaft | Method for providing an operating device in a vehicle and operating device therefor |
| DE102024110153A1 (en) | 2024-04-11 | 2025-10-16 | Audi Aktiengesellschaft | Motor vehicle and method for feedback of driving behavior by an avatar in a motor vehicle |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5542039A (en) * | 1993-03-05 | 1996-07-30 | International Business Machines Corporation | Control for scaled parameters |
| WO2006092647A1 (en) * | 2005-03-04 | 2006-09-08 | Nokia Corporation | Offering menu items to a user |
| DE102006052898A1 (en) * | 2005-11-11 | 2007-05-16 | Volkswagen Ag | Information e.g. vehicle data, device for use in motor vehicle, has display device, and processing device attached to storage that stores vehicle data, where vehicle data are displayed in partially animated manner via display device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6072494A (en) | 1997-10-15 | 2000-06-06 | Electric Planet, Inc. | Method and apparatus for real-time gesture recognition |
| DE19952854C1 (en) * | 1999-11-03 | 2001-08-09 | Bosch Gmbh Robert | Assistance device in a vehicle |
| AU2001233946A1 (en) | 2000-03-20 | 2001-10-03 | British Telecommunications Public Limited Company | Data entry |
| US20070074114A1 (en) | 2005-09-29 | 2007-03-29 | Conopco, Inc., D/B/A Unilever | Automated dialogue interface |
| EP1948481B1 (en) * | 2005-11-11 | 2010-02-17 | Volkswagen AG | Information device, preferably in a motor vehicle, and method for providing information concerning vehicle data, particularly vehicle functions and the operation thereof |
| DE102006049965A1 (en) * | 2006-02-11 | 2007-10-18 | Volkswagen Ag | Device and method for interactive information output and / or assistance for the user of a motor vehicle |
-
2008
- 2008-05-30 DE DE102008026030A patent/DE102008026030B4/en not_active Expired - Fee Related
-
2009
- 2009-05-26 WO PCT/EP2009/056340 patent/WO2009144206A1/en not_active Ceased
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5542039A (en) * | 1993-03-05 | 1996-07-30 | International Business Machines Corporation | Control for scaled parameters |
| WO2006092647A1 (en) * | 2005-03-04 | 2006-09-08 | Nokia Corporation | Offering menu items to a user |
| DE102006052898A1 (en) * | 2005-11-11 | 2007-05-16 | Volkswagen Ag | Information e.g. vehicle data, device for use in motor vehicle, has display device, and processing device attached to storage that stores vehicle data, where vehicle data are displayed in partially animated manner via display device |
Also Published As
| Publication number | Publication date |
|---|---|
| DE102008026030A1 (en) | 2009-12-03 |
| DE102008026030B4 (en) | 2010-07-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2350799B1 (en) | Method and device for displaying information sorted into lists | |
| EP3508968A1 (en) | Human-machine interface and method for operating a human-machine interface | |
| DE102008051757A1 (en) | Multimodal user interface of a driver assistance system for entering and presenting information | |
| DE102010027915A1 (en) | User interface device for controlling a vehicle multimedia system | |
| EP2745218A1 (en) | Method for operating an electronic device or an application, and corresponding apparatus | |
| DE102009036371A1 (en) | Method for providing user interface in vehicle i.e. motor vehicle, involves displaying anchor object for graphical object in display region, where anchor object permits operation of graphical object by operating device | |
| DE102014016222A1 (en) | Method and system for operating a touch-sensitive display device of a motor vehicle | |
| EP3508967B1 (en) | Human-machine interface and method for operating a human-machine interface | |
| WO2009144206A1 (en) | Information and assistance system as well as a method for controlling the latter | |
| EP2930603B1 (en) | Method and device for providing a graphical user interface in a vehicle | |
| DE102012009429A1 (en) | Method for remote configuration of electric car, involves displaying visually perceptible connection between two graphic elements of two display modes, where one of modes corresponds to actual control arrangement in vehicle | |
| EP2941685B1 (en) | Operating method and operating system in a vehicle | |
| DE102007035379A1 (en) | Display and operating system for motor vehicle, has function control elements and context selection control elements provided with respective control options and/or vehicle functions and operating mode assigned to context | |
| EP2924551A1 (en) | Method and device for providing a graphical user interface in a vehicle | |
| DE102008061987A1 (en) | Operating method and operating device | |
| DE102013000744A1 (en) | Method and system for controlling at least one functional unit and motor vehicle and mobile terminal with such a system | |
| DE102013001382A1 (en) | Display system and method for viewing direction dependent operation of a display system | |
| DE102007040288A1 (en) | Multimodal operating system and method for operating components and functions in a motor vehicle | |
| DE102012020567A1 (en) | Operating device for actuating e.g. function units of motor car, has touchpad arranged in receiving space of trough-shaped recess, where function units are controllable by touchpad when another touchpad is removed from recess | |
| EP2917062A1 (en) | Method for displaying information in a vehicle, and a device for controlling the display | |
| DE102009033061A1 (en) | Method and device for controlling a user interface | |
| EP2703205B1 (en) | Method for displaying and operating functional groups and/or functions and a display and operating device | |
| WO2024046612A1 (en) | Controlling a function on board a motor vehicle | |
| WO2022171398A1 (en) | Method for operating an operating device for a motor vehicle, and motor vehicle having an operating device | |
| DE102011116312A1 (en) | Method for controlling electronic device such as multifunctional display device for motor vehicle, involves activating assigned functionality of electronic device based on recognized gesture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09753861 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 09753861 Country of ref document: EP Kind code of ref document: A1 |