JP2018032440A - Controllable headset computer displays - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a headset computer in which a user can grasp what voice commands are available.SOLUTION: A method includes: a step of providing user interfaces 202 and 302 in a headset computer 100; in response to user utterance of a cue toggle command, a step of displaying at least one cue in the user interfaces 202 and 302, where each cue corresponds to voice commands 304a to 304f associated with codes to be executed, respectively; and in response to user utterance of the voice command, a step of executing the code associated with the voice command.SELECTED DRAWING: Figure 4

Description

Related technology

  This application is a continuation of US Patent Application No. 13 / 799,790, filed March 13, 2013, claiming priority of US Patent Application No. 61 / 749,240, filed January 4, 2013. Note that U.S. Patent Application No. 13 / 799,790 claims U.S. Patent Application No. 61 / 384,586, filed September 20, 2010, and U.S. Patent Application No. 13 / 234,916, filed September 16, 2011. Is a continuation-in-part application. The entire contents of these US patent applications are hereby incorporated by reference.

  Currently, mobile computing devices such as notebook PCs, smartphones, and tablet computing terminals have become everyday tools for generating, analyzing, communicating and consuming data in both business and private life. Consumers continue to enjoy a mobile digital lifestyle against the backdrop of increasingly easy access to digital information as high-speed wireless communication technology becomes ubiquitous. A common use of mobile computing devices is to display large amounts of high-resolution computer graphics information and video content, often streaming wirelessly to the device for display. Although these devices typically include a display screen, the physical size of the devices themselves is limited to promote mobility. Therefore, it is difficult to reproduce a more favorable visual experience on these mobile devices, such as a high resolution large display. Another disadvantage of this type of device is that the user interface depends on the human hand (requires use of the human hand). Typically, a user is generally required to enter data or make some selection using a (physical or virtual) keyboard or touch screen display. Therefore, today's consumers want a hands-free (independent of human hand), high quality and portable color display solution that supplements or replaces mobile devices that rely on human hands. ing.

  Recently developed microdisplays can provide large format high resolution color images and streaming video with very small shaped components. An example of such a display application is the incorporation into a wireless headset computer worn on the user's head in a format similar to glasses, audio headsets or video eyewear so that the display fits within the user's field of view. It is done. A “wireless headset computing” device comprises at least one small high-resolution microdisplay and an optical system that magnifies an image. A WVGA microdisplay can provide Super Video Graphics Array (SVGA) (800 × 600) resolution or Extended Graphics Array (XGA) (1024 × 768) resolution or higher. In addition, the wireless computing headset has at least one wireless computing interface and a communication interface that enable data functions and video streaming functions, and has excellent convenience via a device that depends on human hands. And providing mobility. For detailed information on these devices, see co-pending US patent application Ser. No. 12 / 348,648, “Mobile Wireless Display Software Platform for Controlling Other Systems and Devices,” filed Jan. 5, 2009, March 2009. International Application No. PCT / US09 / 38601 filed on May 27, “Handheld Wireless Display Devices Having High Resolution Display Suitable For Use as a Mobile Internet Device” and US Patent Application No. 61 / 638,419 filed April 25, 2012, “ See “Improved Headset Computer”. Note that the entire contents of these patent applications are incorporated herein by reference.

  In accordance with an embodiment of the present invention, a method for providing a user interface to a headset computer and responsive to the utterance of a user cue / toggle command (a cue toggle command) at least one cue: A signal, an instruction, etc.) on the user interface. Each cue may correspond to a voice command associated with code to be executed. The method may also include executing the code associated with the voice command in response to the user speaking the voice command. In other embodiments, the method may further include displaying the interface without the queue at least one of before the queue toggle command and after the next queue toggle command. The step of displaying the cue may include displaying a word that activates (activates or activates) the voice command. Also, the step of displaying the cue may include displaying the cue corresponding to the voice command associated with the control displayed on the user interface on the user interface. The step of displaying the cue may include displaying the cue corresponding to the voice command associated with a control hidden from the user interface on the user interface. The process of displaying the cue includes the cue corresponding to the voice command associated with a control (a component of the UI, which will be described in detail later), which is a global (global) headset control. It may include displaying on the interface. The cue may be loaded from a control that indicates the cue and the voice command.

  In other embodiments, a system for displaying a user interface on a headset computer may comprise display means or display means for providing a user interface to the headset computer. The display means may further display at least one cue on the user interface in response to a user cue / toggle command utterance. Each cue may correspond to a voice command associated with code to be executed. The system may further comprise command means or command means for executing the code associated with the voice command in response to a user utterance of the voice command.

  In another embodiment, a method for deploying a user interface on a headset computer includes embedding cues and voice commands in the controls for the user interface. The method further includes providing the control to the user interface, the user interface displaying the queue in response to a queue toggle command.

  The foregoing will become apparent from the following detailed description of exemplary embodiments of the invention as illustrated in the accompanying drawings. In the drawings, like reference numerals refer to like elements / components throughout the different views. The drawings are not necessarily to scale, but rather focus on showing embodiments of the present invention.

1 is a schematic diagram of a host computer (eg, smartphone, laptop, etc.) and a headset computer that cooperates with the computer in accordance with the principles of the present invention. 2 is an enlarged perspective view of a headset computer cooperating with a host computer in accordance with the principles of the present invention. FIG. FIG. 2 is a block diagram showing a flow of control and data in the embodiment of FIGS. 1A and 1B. FIG. 4 illustrates an exemplary embodiment of a user interface used in HSC. FIG. 4 is a diagram illustrating an exemplary embodiment of a user interface after receiving a voice command of “Show command”. FIG. 3 is a flow diagram illustrating an exemplary embodiment of a method used in the present invention. FIG. 1 illustrates a computer network or similar digital processing environment in which the present invention may be implemented. It is a figure which shows the internal structure of the computer (For example, a client side processing apparatus / terminal, a server computer, etc.) included in the computer system of FIG.

  1A and 1B illustrate an exemplary embodiment of a wireless computing headset device 100 (sometimes referred to herein as a headset computer (HSC)). The HSC 100 incorporates a high-resolution (VGA or higher resolution) microdisplay element 1010 as well as other components described below. Specifically, the HSC 100 includes: an audio input and / or audio output device (which may include at least one microphone, at least one input speaker, and at least one output speaker); and / or a geolocation sensor (GPS). And / or orientation sensors with 3 to 9 degrees of freedom; and / or barometric sensors; and / or health sensors; and / or digital compass; and / or pressure sensors; and / or environmental sensors; and / or Energy sensor; and / or acceleration sensor; and / or position sensor; and / or attitude sensor; and / or motion sensor; and / or velocity sensor; and / or light sensor; and / or camera (visible light camera, infrared camera) Etc.); and / or Wireless radios; and / or auxiliary lighting; and / or rangefinder; and / or other; may comprise. HSC 100: an array of sensors embedded in the headset; and / or an array of sensors embedded in the headset; and / or at least one peripheral port (not shown in detail in FIG. 1B) An array of sensors attached to the device via Typically, various electronic circuits are disposed within the housing of headset computing device 100. Such electronic circuits include: microcomputers (single-core or multi-core processors); one or more wired and / or wireless communication interfaces; memory or storage devices; various sensors; and peripheral mounts or “hot” Mounts such as “shoe” can be included.

  Exemplary embodiments of HSC 100 may receive user input by detecting voice commands, head movements 110, 111, 112, hand gestures 113, or combinations thereof. Specifically, an utterance command or voice command may be captured using at least one microphone operatively connected to, or preferably incorporated in, the HSC 100. The captured voice command is digitized and processed using automatic speech recognition technology or automatic speech recognition technology. HSC 100 may also incorporate gyroscopes, accelerometers, and other sensors based on microelectromechanical systems. These sensors and the like track the movement of the user's head and provide input commands to the user. A camera or other motion tracking sensor may also be used to monitor the user's hand gestures and provide input commands to the user. User interfaces such as these can eliminate the need for human hand-dependent modalities like other mobile devices.

  The HSC 100 can be used in various ways. Specifically, the HSC 100 can be used as a remote display for streaming playback of video signals received from a remote host computing device 200 (shown in FIG. 1A). Examples of the host 200 include notebook PCs, smartphones, tablet terminals, or other computing devices (eg, cloud-based network resources, etc.) that have higher or lower computational complexity than the wireless computing headset device 100. ). The host can be further connected to other networks 210 (eg, the Internet, etc.). Headset computing device 100 and host 200 may include one or more wireless protocols (e.g., Bluetooth (R), Wi-Fi (R), WiMAX (R), 4G LTE, other wireless radio links, etc.) ) 150 can communicate with each other wirelessly (Bluetooth® is a registered trademark of Bluetooth Sig, Inc., located in 5209 Lake Washington Boulevard, Kirkland, Washington 98033). In an exemplary embodiment, the host 200 may be further connected to other networks (eg, further connected to the Internet or other cloud-based network resources via a wireless connection) so that it can function as a wireless relay. ). As some variations, exemplary embodiments of the HSC 100 can be wirelessly connected to the Internet or cloud-based network resources without using the host as a wireless relay.

  FIG. 1B is a perspective view showing some of the details of an exemplary embodiment of headset computer 100. The HSC 100 of this exemplary embodiment generally includes a frame 1000, a strap 1002, a rear housing 1004, a speaker 1006, a cantilever (also referred to as an arm or boom) 1008 incorporating a microphone, and a micro. A display subassembly 1010 is provided.

  The frame 1000 and strap 1002 that are worn on the head are generally configured to allow the user to wear the headset computing device 100 on their head. The housing 1004 is typically a short unit that houses electronic components (eg, a microprocessor, memory, other storage device, etc.) along with other associated circuitry. The speaker 1006 enables the user to listen to information by providing audio output to the user. The microdisplay subassembly 1010 displays visual information or visual information to the user. Microdisplay subassembly 1010 is coupled to arm 1008. The arm 1008 generally places the microdisplay subassembly in the user's field of view 300 (FIG. 1A), preferably in front of the user's eye, or in the user's peripheral field of view (preferably slightly below or slightly below the user's eye). Provide physical support so that it can be placed on top. The arm 1008 further provides an electrical or optical connection between the microdisplay subassembly 1010 and a control circuit housed in the housing unit 1004.

  According to aspects detailed below, the HSC display device 100 allows the user to select the field of view 300 from within a much wider area formed by the virtual display 400 than the field of view 300. A user can typically manipulate the position and / or range (eg, XY range, 3D range, etc.) and / or magnification of the field of view 300.

  FIG. 1A shows a monocular micro-display, which shows a single display element that is cantilevered and fixed to a user's face by a cantilever boom. It should be understood that other configurations may be employed as the mechanical configuration of the display device 100.

  FIG. 2 is a block diagram showing details of the HSC device 100, details of the host 200, and details of data passing between them. The HSC device 100 receives voice input from a user via a microphone, receives hand movements or body gestures via position and orientation sensors, a camera or at least one light sensor and receives input from head movement. It is received via a head tracking circuit such as azimuth sensing with 3 to 9 degrees of freedom. These are translated into keyboard commands and / or mouse commands by the HSC device 100 software and then sent to the host 200 via Bluetooth® or other wireless interface 150. The host 200 interprets these translated commands according to its own operating system / application software, and executes various functions. As one of such commands, there is a command for selecting the visual field 300 from the virtual display 400 and returning the selected screen data to the HSC device 100. That is, it should be understood that a very large format virtual display area can be associated with the application software or operating system running on the host 200. However, only a part of the large virtual display area 400 in the visual field 300 is returned and actually displayed on the micro display 1010 of the HSC device 100.

  In one embodiment, the HSC 100 may take the form of the HSC described in co-pending US Patent Application Publication No. 2011/0187640. The entire contents of this US patent application publication are incorporated herein by reference.

  In other embodiments, the present invention is hands free to the user by using a head mounted display (HMD) 1010 in conjunction with an external “smart” device 200 (eg, smartphone, tablet, etc.). It relates to the technical idea of providing information and control functions. The present invention requires only a small amount of data transmission and enables a highly reliable data transfer method to be executed in real time.

  That is, in this sense, depending on the amount of data transmitted over connection 150, how the screen is laid out, what text is displayed, and other style information (eg, drawing arrows, backgrounds, etc.) Short, simple commands about color, included images, etc.).

  If requested by the host 200, additional data (eg, a video stream, etc.) may be streamed via the same connection 150 or other connection and displayed on the screen 1010.

  The present invention further relates to a technique that allows a voice-controlled HSC 100 to view a context sensitive or context aware overlay within an application.

  Specifically, the idea is to present data on screen (over a visual) and on-demand, depending on context. The user can invoke the overlay with a voice command (typically a “Show command”). This voice command is a standard command of the system 100 and is always available. This command causes the HSC 100 to display applicable voice commands and other information in a context sensitive and intuitive manner.

  Those applicable voice commands are shown on the translucent overlay in the current screen view of the display unit 1010. With this configuration, the user can maintain the context of the screen for calling the overlay.

  These overlays and displayed applicable commands fade out after a short time. This is achieved by a timing mechanism that refreshes the screen view.

  These applicable voice commands are displayed in order of relevance. Specifically, the most relevant command is placed more prominently than the less relevant command. The HSC 100 determines the relevancy of the content of the display 1010 based on the current context.

  Each screen of the related system is composed of various components of a user interface (UI). Some of these components are “controls”. A control is a component of a UI that provides information to a user or enables some function. Examples of controls include buttons, radio buttons, text boxes, check boxes, drop-down menus, file menus, ribbon menus, live tiles, and the like. These exist in a variety of forms in the software developer's component library that can be used to customize a given function. As an example of such a control, a “button” simply allows the user to press the button by using a voice command existing on the button. Various controls, such as this “button” control, are available to the developer, for example, as part of the developer's component library or as part of another library. Specifically, developers can insert pre-coded controls and customize them to suit their preferences without having to code the controls themselves from the start.

  The “Show Command” function is built into the controls in the developer's library. For example, if a developer creates a button and specifies a text string that should be written on the button, the text string is the button unless the developer (or user) disables the voice command. Is the default voice command that activates (activates or activates). A control (for example, the above button) responds to the voice command “Show command” by overlaying a text string of a word that activates the control on or near the control. Configured.

  Each of the user interface screens that can be used in the HSC 100 can accept a voice command of “Show command” (for example, a system command that can be used by default). That is, when the screen is constructed using controls from the UI library, a Show command function is incorporated to guide what voice commands are available to the user. The voice commands available to these users are shown in the context of the content (screen view) currently displayed (by default).

  Other available voice commands that are not associated with the displayed or visible control may also be placed within the “Show Command” overlay. These voice commands are placed in the overlay by the developer and used to add voice command-only controls or hidden controls (usually hidden controls), specifically buttons or other Provides a displayed or visible cue of voice commands not associated with a control (cue).

  FIG. 3 is a diagram 250 illustrating an exemplary embodiment of a user interface 202 used in HSC. In this embodiment, the user interface 202 is an email application that displays the user's inbox. Each electronic mail is listed, and first to sixth electronic mail controls 204a to 204f are shown. The user can open each e-mail by selecting each control. Each email control 204a-204f is programmed to be selected by at least a corresponding voice command.

  FIG. 4 is a diagram 300 illustrating an exemplary embodiment of the user interface 302 after receiving a “Show command” voice command. The user interface displays voice commands corresponding to the respective email controls 204a to 204f in FIG. Specifically, the first to sixth voice commands 304a to 304f in FIG. 4 correspond to the first to sixth electronic mail controls 204a to 204f, respectively. As an example, by uttering the first voice command 304a (ie, uttering content such as “open first email”), the HSC 100 opens the first email in the list. Can do.

  The user interface 302 in the “Show command” mode further includes a plurality of first to ninth implicit or implicit voice commands 306a to 306i. These first through ninth implicit voice commands 306a-306i do not correspond to any particular control displayed or visible on the user interface (eg, corresponding to the email control). This is a voice command available to the user. To give some examples, the user can move to the previous page by speaking the first implicit voice command 306a and by speaking the second implicit voice command 306b. You can move to the next page. The user can also create an email by speaking the third implicit command 306c. The user can also manage his / her email account by issuing a fourth implicit command 306d. The user can also browse his / her account by speaking the fifth implicit command 306e. The user can also switch folders by speaking the sixth implicit voice command 306f. The user can also refresh the inbox by speaking the seventh implicit voice command 306g.

  The user can also return to the previous screen by speaking the eighth implicit voice command 306h. In addition, the user can return to the home screen by speaking the ninth implicit voice command 306i. The eighth and ninth implicit voice commands are universal (general purpose) or application-independent commands on any screen of the HSC 100. On the other hand, the first to sixth voice commands 304a to 304f and the first to seventh implicit voice commands 306a to 306g are local (local) within this specific application (here, mail application). Command. However, in other embodiments, the first and second implicit voice commands 306a, 306b are global commands for moving to the previous and next pages within the application. obtain.

  Such overlay by voice command organizes the options and buttons on the screen, which can assist the user. Further, the voice command can help the user to grasp how to use the system. This is particularly useful when the user learns how to use the device and voice commands.

  FIG. 5 is a flow diagram 500 illustrating an exemplary embodiment of a method used in the present invention. Initially, the method provides a user interface to the headset computer (step 502). Next, this method determines whether or not the toggle command to be the above queue has been received, for example, from the user's utterance via voice means (step 504). If the determination result is negative, the method continues to wait for input of a queue / toggle command (step 504). If the determination is affirmative, the method displays at least one queue on the user interface (step 506). Each cue is associated with a corresponding voice command. This voice command, when spoken, causes the system to execute a code or code.

  Next, the system determines whether a voice command (eg, a voice command indicated by one of the queues) has been received (step 508). If the determination is negative, the system continues to wait for input of a voice command (step 508). If the determination is positive, the system executes the code or program associated with the received voice command (step 510).

  FIG. 6 illustrates a computer network or similar digital processing environment in which the present invention may be implemented.

  At least one client-side computer / terminal 50 and at least one server computer can realize a processing device, a storage device, an input / output device, and the like that execute application programs and the like. At least one client-side computer / terminal 50 is connectable to another computing device (which may include another client-side terminal / processing device 50 and at least one other server computer 60) via a communication network 70. is there. The communication network 70 may be part of a remote access network, part of a global network (eg, the Internet, etc.), part of a global collection of computers, part of a local area network, part of a wide area network, or Generally, it can be part of a gateway that communicates with each other using various protocols (TCP / IP, Bluetooth (registered trademark), etc.). Other electronic device / computer network architectures can also be used.

  FIG. 7 is a diagram showing an internal structure of a computer (for example, the client side processing apparatus / terminal 50, the server computer 60, etc.) included in the computer system of FIG. Each computer 50, 60 includes a system bus 79. A bus consists of a set of hardware lines that are used to transfer data between components of a computer (or processing system). The bus 79 is essentially a shared pipe that connects different components (eg, processor, disk storage, memory, input / output port, network port, etc.) in the computer system. , Enabling the exchange of information between these components. An I / O device interface 82 for connecting various input / output devices (for example, a keyboard, a mouse, a display, a printer, a speaker, etc.) to the computers 50 and 60 is attached to the system bus 79. Network interface 86 allows the computer to connect to various other devices / terminals / devices attached to a network (eg, network 70 of FIG. 6). Memory 90 stores computer software instructions 92 and data 94 that are used to implement an embodiment of the present invention (eg, a context sensitive or context aware overlay in the user interface code described above). Volatile memory. Disk storage 95 is a non-volatile storage that stores computer software instructions 92 and data 94 used to implement one embodiment of the present invention. Also attached to the system bus 79 is a central processing unit 84 for executing computer instructions.

  In one embodiment, the processor routines 92 and data 94 are computer program products (generally designated 92) that provide at least some of the software instructions for the system according to the present invention. The computer program product 92 includes computer readable media (eg, removable storage media such as at least one DVD-ROM, at least one CD-ROM, at least one disk, at least one tape, etc.). . The computer program product 92 may be installable by any suitable software installation method known in the art. In other embodiments, at least some of the software instructions may be downloadable via a cable and / or communication connection and / or a wireless connection. In still another embodiment, the program according to the present invention is propagated by a propagation signal on a propagation medium (for example, a global network such as a radio wave, an infrared wave, a laser wave, a sound wave, and the Internet, or at least one other network) This is a computer program product 107 based on a propagation signal, which is realized by an electric wave or the like. Such a carrier medium or carrier signal provides at least part of the software instructions for the routine / program 92 according to the present invention.

  In yet another embodiment, the propagation signal is an analog carrier wave or digital signal carried on a propagation medium. For example, the propagated signal may be a digital signal carried over a global network (eg, the Internet, etc.), a telecommunications network, or other network. In one embodiment, the propagated signal is a signal transmitted over a propagation medium for a given period of time, for example, transmitted in packets over a network for a period of several milliseconds, seconds, minutes or more. Instructions for software applications, etc. In another embodiment, the computer readable medium of computer program product 92 is a propagation medium that can be received and read by computer system 50. For example, the computer system 50 receives a propagation medium and identifies the propagation signal embedded in the propagation medium, as in the case of the computer program product with propagation signals described above.

  Generally speaking, the term “carrier medium” or transient or temporary carrier is a term encompassing transient or transient signals, propagation signals, propagation media, storage media, and others as described above. It is.

While the invention has been illustrated and described with reference to illustrative embodiments, workers skilled in the art will recognize that the invention is capable of form and detail without departing from the scope of the invention as encompassed by the appended claims. It will be understood that detailed modifications of are possible.
In addition, this invention contains the following content as an aspect.
[Aspect 1]
Providing a user interface to the headset computer;
Displaying at least one cue on the user interface in response to a user cue / toggle command utterance, each cue corresponding to a voice command associated with a code to be executed; and ,
Executing the code associated with the voice command in response to an utterance of the voice command of the user;
Including a method.
[Aspect 2]
The method according to aspect 1, further comprising:
Displaying the interface without the queue before at least one of the queue-toggle command and after the next queue-toggle command;
Including a method.
[Aspect 3]
The method of aspect 1, wherein displaying the cue includes displaying a word that activates the voice command.
[Aspect 4]
The method of claim 1, wherein displaying the cue includes displaying the cue corresponding to the voice command associated with a control displayed on the user interface on the user interface. .
[Aspect 5]
The method of claim 1, wherein displaying the cue includes displaying the cue corresponding to the voice command associated with a control hidden from the user interface on the user interface.
[Aspect 6]
The method of aspect 1, wherein displaying the cue includes displaying the cue corresponding to the voice command associated with a global headset control on the user interface.
[Aspect 7]
The method of claim 1, wherein the cue is loaded from a control that indicates the cue and the voice command.
[Aspect 8]
A system for displaying a user interface on a headset computer,
Display means for providing a user interface to the headset computer and further displaying at least one cue on the user interface in response to a user cue / toggle command utterance, wherein each cue includes code to be executed Display means respectively corresponding to voice commands associated with
Command means for executing the code associated with the voice command in response to the utterance of the voice command of the user;
A system comprising:
[Aspect 9]
9. The system according to aspect 8, wherein the display means further displays the interface without the queue at least one of before the queue / toggle command and after the next queue / toggle command.
[Aspect 10]
9. The system according to aspect 8, wherein the display means further displays a word that activates the voice command.
[Aspect 11]
9. The system according to aspect 8, wherein the display means further displays a cue corresponding to a voice command associated with a control displayed on the user interface on the user interface.
[Aspect 12]
9. The system according to aspect 8, wherein the display means further displays the cue corresponding to the voice command associated with a control hidden from the user interface on the user interface.
[Aspect 13]
9. The system according to aspect 8, wherein the display means further displays the cue corresponding to the voice command associated with global headset control on the user interface.
[Aspect 14]
9. The system according to aspect 8, wherein the cue is loaded from a control indicating the cue and the voice command.
[Aspect 15]
A method of deploying a user interface on a headset computer,
Embedding cues and voice commands in the user interface controls;
Providing the control to the user interface, the user interface displaying the queue in response to a queue toggle command;
Including a method.
[Aspect 16]
16. The method of aspect 15, wherein the cue includes a word that activates the voice command.
[Aspect 17]
16. The method of aspect 15, wherein the cue corresponds to the voice command associated with a control displayed on the user interface.
[Aspect 18]
16. The method of aspect 15, wherein the cue corresponds to the voice command associated with a control hidden from the user interface.
[Aspect 19]
16. The method of aspect 15, wherein the cue corresponds to the voice command associated with a global headset control.
[Aspect 20]
16. The method of aspect 15, wherein the cue is loaded from a control that indicates the cue and the voice command.

Claims (20)

Providing a headset computer with a user interface having at least one control;
In response to the utterance of a user cue / toggle command, displaying a translucent overlay of at least one cue on the provided user interface, each cue being at least one control in the user interface Processes corresponding to each voice command with associated code
Executing the code associated with the voice command in response to an utterance of the voice command of the user;
Including a method. The method of claim 1, further comprising:
Displaying the interface without the queue before at least one of the queue-toggle command and after the next queue-toggle command;
Including a method.   2. The method of claim 1, wherein displaying the cue includes displaying a word that activates the voice command.   The method of claim 1, wherein displaying the cue includes displaying the cue corresponding to the voice command associated with a control displayed on the user interface on the user interface. Method.   The method of claim 1, wherein displaying the cue includes displaying the cue corresponding to the voice command associated with a control hidden from the user interface on the user interface. .   The method of claim 1, wherein displaying the cue includes displaying the cue corresponding to the voice command associated with a global headset control on the user interface.   The method of claim 1, wherein the cue is loaded from a control indicating the cue and the voice command. A system for displaying a user interface on a headset computer,
Providing a headset computer with a user interface having at least one control, and further displaying a translucent overlay of at least one cue on the provided user interface in response to the utterance of the user's cue / toggle command Display means, each queue corresponding to a voice command associated with a code for executing at least one control in the user interface;
Command means for executing the code associated with the voice command in response to the utterance of the voice command of the user;
A system comprising:   9. The system according to claim 8, wherein the display means further displays the interface without the queue at least one of before the queue toggle command and after the next queue toggle command. .   9. The system according to claim 8, wherein the display means further displays a word that activates the voice command.   9. The system according to claim 8, wherein the display means further displays a cue corresponding to a voice command associated with a control displayed on the user interface on the user interface.   9. The system according to claim 8, wherein the display means further displays the cue corresponding to the voice command associated with a control hidden from the user interface on the user interface.   9. The system of claim 8, wherein the display means further displays the cue corresponding to the voice command associated with global headset control on the user interface.   9. The system of claim 8, wherein the cue is loaded from a control that indicates the cue and the voice command. A method of deploying a user interface on a headset computer,
Embedding cues and voice commands in the user interface controls;
Providing the control to the user interface, the user interface displaying a translucent overlay of the cue in response to a cue toggle command;
Including a method.   16. The method of claim 15, wherein the cue includes a word that activates the voice command.   16. The method of claim 15, wherein the cue corresponds to the voice command associated with a control displayed on the user interface.   16. The method of claim 15, wherein the cue corresponds to the voice command associated with a control hidden from the user interface.   16. The method of claim 15, wherein the cue corresponds to the voice command associated with a global headset control.   16. The method of claim 15, wherein the cue is loaded from a control that indicates the cue and the voice command.

Images