CN101809651A

CN101809651A - The mobile wireless display of the incarnation of speech to speech translation and simulating human attribute is provided

Info

Publication number: CN101809651A
Application number: CN200880108344A
Authority: CN
Inventors: 杰佛瑞·J·贾寇伯森; 史帝芬·A·庞博
Original assignee: Kopin Corp
Current assignee: Kopin Corp
Priority date: 2007-07-31
Filing date: 2008-07-30
Publication date: 2010-08-18
Anticipated expiration: 2028-07-30
Also published as: CN101809651B

Abstract

A kind of equipment comprise have wireless communication interface, the simple eye display of user input apparatus, transmitter and controller, and can provide towards the video links of host apparatus and other device and to the control and the management of host apparatus and other device, described other device for example is mobile phone, computing machine, laptop computer or media player.Described equipment can receive voice and it is carried out digitizing.Described equipment can be first language described through digitize voice be comparing so that translation to be provided of second language through the digitize voice table, or alternatively can compare through digitize voice and control command table described.Described control command allows to carry out user interactions with vision and audio frequency mode and described equipment or other remote-control device.Described control signal control store in storer " identification personage " or incarnation simulated human attributes is provided to described equipment, network or third party's communicator.Described incarnation can be selected to change or upgrade according to the user.

Description

The mobile wireless display of the incarnation of speech to speech translation and simulating human attribute is provided

Related application

The application's case is the 12/152nd of application on May 14th, 2008, the part of No. 462 U.S. patent application case application case that continues, and advocate the 60/962nd of application on July 31st, 2007, the 60/966th of No. 686 U.S. Provisional Application cases, application on August 29th, 2007, the right of priority of the 60/994th, No. 989 U.S. Provisional Application case of No. 704 U.S. Provisional Application cases and application on September 24th, 2007.The application's case also relates to the 12/008th, No. 114 U.S. patent application case of application on January 8th, 2008 and the 12/008th, No. 104 U.S. patent application case of application on January 8th, 2008.Whole teachings of above application case are incorporated herein by reference.

Technical field

Do not have

Background technology

Also known mobile communications device in this technology.Technological incorporation recently between mobile honeycomb phone and the digital media player (iPhone for example ^TM) constantly bring the Miniature Portable Unit that can store multitude of video and other content to the consumer.Although these handheld apparatus generally include video screen, forever can't the visual experience (that is, giant display) of copying high-resolution in this type of device, only be because the physical size limitations that the handheld unit expection is had.In addition, the long-range individual who carries out in daily routines calculates constantly and increases sharply.The user for example will use personal digital assistant, smart phone or

Remote computing devices such as communicator come browsing internet, and will carry out commercial affairs with remote mode, will listen to the music and participate in other activity (take pictures, transmission and retrieving electronic mail, transmission and retrieval instant message or the like).

Usually, to move it communicator individualized many user effort plenty of time.The user of mobile communications device (for example mobile phone) will paste jewelry to described device, purchase has the device of certain color, and will download to communication device memories to particular software application so that particular ringtone to be provided when receiving the caller's (for example auntie or uncle) who likes calling.Usually because this is individualized, the user will dote in described handheld apparatus, and will prefer using described device owing to described unique individualization.

In addition, known head head mounted displays device in this technology.This class display comprises vision and audio devices.These devices provide the demonstration with sound and image to wearer.Usually, described display is for through arranging to present the small sized colour monitor of image to user's left eye, right eye or both.These devices surround user's face or head usually, and therefore not only heavy, and hinder in fact all user's visions.In other words, when dressing described display, the user can't easily watch other object that is in the normal peripheral vision of user usually, or loses the quite most of of normal peripheral vision during use.Other head mounted display can comprise two independent displays, and display of every eyes, described display also are supported on the heavy framework.

Thereby the consumer is now seeking high-quality portable color monitor and is strengthening its handheld video device.A kind of this class display is similar to face or the head that a pair of glasses or headphone are worn on the user.By the huge recently exploitation of optical technology, these devices can provide the appearance of large-scale high resolution display.An example of this type of device is given interior rattan people such as (Naito) and is transferred the 7th, 088, No. 234 United States Patent (USP)s of Matsushita Electric Industries (Matsushita Electrical Industries) referring to promulgation.Wearable massaging device described in the described patent can show that some information is to inform that user's (for example) is about receiving the information of Email etc.Another this type of unit describe is in issuing to Spitzer (Spitzer) and transferring in the 7th, 158, No. 096 United States Patent (USP) of MyVu company.Described device comprises projection type display, but it is attached to the end that head is installed support member.The eyepiece subassembly is attached to second end of described support member.Described support member is kept optical projection system and is aimed at along optical path with the eyepiece subassembly.

Although these devices can provide the high resolving power of image and sound to show that normally watch space or its major part that hinder the user may be problematic.The user will be usually only in the user feels safe minority select location (for example, in the parlor, at home other local place, in the operating room) when being seated or standing or being in the almost fixed position, use described display.The user can't carry out many other daily tasks effectively when dressing obstruction property display equipment.These tasks comprise in the participation needs the frequent depth perception adjustment of highly individual mobility by the time, needs, move through zone with irregular and uneven surface or needs initiatively collision avoid the activity of (that is, move through zone or incident in person, avoid the rapid moving object that may run into, the use of negotiation public transportation in the operation vehicles) or personal security's possibility owing to losing any situation that normal peripheral vision is sacrificed with changing barrier or crowd.

Secondly, this type of prior art head mounted display is restricted in some limited task.This generic task can comprise watches image, figure or the film with audio frequency.This can be for playing games purpose or watch image from television broadcasting or video entertainment.This type of prior art head mounted display is dailyly wanting strict limited in the combining of functional calculation task with other.For instance, the user may need to use display in conjunction with communication task, operation business applications, active homing task, move with real-time update, or uses display other device with wireless mode control regular use of user or daily contact.These devices can comprise for example personal digital assistant, notebook, desk-top computer, mobile phone, the vehicles, wireless network, wireless service focus, thin-client, other electronic installation or utensil.This type of prior art head mounted display often can't with this type of device interface or control automatically this type of device with initial and control working procedure, the functional change of initial real-time clock, change real-time clock operating parameter, enable and the Local or Remote radio communication of mobile device and/or participate in wireless network and service.

The 3rd, this type of prior-art devices can't be upgraded easily with other function that provides the user to need.The user may need to have some functional attributes of one or more software application or one or more particular hardware configuration in some positions, and the user may not need to have those software applications or hardware configuration in other position.In fact, the user may not use this type of heavy display equipment with a plurality of software applications or hardware configuration, but may wish to remove unnecessary software and hardware from described device, makes device keep extremely light.

In addition, but the user will like the access significant data than the close-coupled mobile device, described mobile device is light-duty and does not need the user to carry relatively large and heavy computing machine (for example, notebook, laptop computer, dull and stereotyped calculation element or relatively large media player).In addition, the user often must open described laptop computer and then start the machine this spended time when carrying laptop computer.This is unwelcome when wanting to obtain fast customizing messages (for example address, Email or from the related text of e-mail attachment) in especially in the user is advancing.

Microsoft Windows

Be the software program of the secondary screen on the support mobile personal computer (for example laptop computer) in the operating system (OS), described secondary screen is placed on the dorsal part that laptop computer renovates usually.By this additional secondary display, the user can insert Microsoft Windows

Software application be in park mode or unlatching at computing machine or when closing on described secondary display display image.Microsoft Windows

Use is called gadgety convenient small routine.These gadget programs will extend to other device from the information of laptop computer.Gadget can with Microsoft Windows

Move on the computing machine that compatible device is operated together, and use from the described device of the information updating of computing machine.Gadget can allow to watch the information from computing machine, and is that open, that close or is in park mode regardless of it.This has saved power and user time by not needing to start computing machine.These gadget software programs are restrictive, and the user need permit the software gadget of wireless access laptop computer under the situation that does not need to use any input media to come persistent surveillance.In addition, when laptop computer or PC were opened, closed or be in park mode, the user need be from the bulk information of computing machine.

Summary of the invention

The user often has to carry relatively large calculation element so that carry out these tasks.The user has a kind of ANTENN AUDIO vision head installing type communicator with needs, described device is unobtrusive and without hand, and described device can be in order to avoid be connected to the light-duty wireless format of heavy calculation element and come mutual with wireless mode and other calculation element.In addition, the user abandons keyboard, input media or touch-screen with needs, and will prefer and use voice to recognize to finish these input and output computer tasks.In addition, the user also has needs to like mode mutual or with highly individualized mode and the mutual ability of device with device.The personalized software application of height that the user will need to download in advance on the device or can wireless mode buy.Also need a kind of device that other function also is provided except watching image or figure in this technology, described device can be by customer upgrade, makes the user to select and selected user needs which hardware or component software to come and described device interface.

In addition, need in this technology to inquire that other calculation element is to form Radio Link and can receive data and the light-duty device of swap data between simple eye display equipment and calculation element.Also need a kind of simple eye display equipment in this technology, the auxiliary simple eye indicator screen of redundancy that it can serve as calculation element makes the user principal and subordinate's relation of networking to use input media from the data of redundant secondary monitor screen access from described calculation element.

According to the first example embodiment of the present invention, a kind of simple eye display equipment can comprise wave point, and it is configured to communicating by letter with host computing system with wireless mode.Host computing system has elementary display, and it is from the control signal of host computing system reception in order to display image.Described control signal is sent to the second main frame wave point.Described control signal is transmitted into wave point from the described second wireless host interface.Then described signal is transmitted into simple eye display with display image on described simple eye display.Simple eye display is positioned at away from the host computing system place.Described equipment has the controller that is connected to storer, and wherein said controller and described storer are connected to bus.Display, microphone and loudspeaker are connected to bus with mode of operation.Controling appliance is useful on from microphone and receives voice command and the programmed instruction that is used for voice command is converted to digital data packet.

In one embodiment, microphone receives the sound signal of the voice of the individual said first language that is adjacent to wearer or source.Microphone is connected to converter, and described converter is converted to sound signal the numeral of sound signal.Controller compares the numeral of sound signal with the language table that is stored in the storer, numeral is converted to second numeral.This of sound signal second numeral is the translation of first language to second language.Controller is converted to second numeral of sound signal the speech audio signal modulation of second language.The controller control loudspeaker, described loudspeaker outputs to wearer with the speech audio signal modulation of second language, makes wearer can understand the voice of first language and hears described translation with the speech modulation system.

In another embodiment, the speech audio signal modulation can aesthetic desirable mode outputs to wearer and is associated with prerecord speech in being stored in storer.Controller can be converted to videotex with sound signal in addition except described voice.Described text can show on the screen of display simultaneously and with second language with the speech audio signal modulation.The speech audio signal modulation can be associated with famous person's recording of voice, and the speech audio signal modulation of second language can be the translation of the foreign voice of real-time generation.

Controller also has and is used for receiving packet and packet and the look-up table that is stored in storer are compared packet is converted to the programmed instruction of control command.Controller outputs to assembly to permit carrying out alternately and supplying with the assembly of equipment the peripheral assembly of user control device with control command.Controling appliance is useful in response to control command with vision and audio frequency mode and the mutual programmed instruction of wearer.Controller be stored in storer in " identification personage " software format output Interactive control signal of being associated.Software outputs to display with control command so that show " personage " with the form of the simulated human video outward appearance that is associated with famous person or other " identification personage ".Also envision independent " audio frequency personage ", it comprises the programmed instruction that is used for reading aloud with specific recording of voice the menu option of voice command.The identification personage provides simulated human attributes carrying out mutual and opertaing device, and permits user and emulation video or audio frequency " personage " alternately with control device.

Description of drawings

To understand aforementioned content from following to more clearly the describing of example embodiment of the present invention, described example embodiment illustrates in the accompanying drawings, and the same reference character runs through different views and refers to same section all the time in the accompanying drawings.Described graphic may not the drafting in proportion, but focus on the explanation embodiments of the invention.

Fig. 1 is the skeleton view of the simple eye display equipment of explanation embodiment according to the present invention embodiment and the figure of the radio communication between simple eye display equipment of described example embodiment and the main frame calculation element.

Fig. 2 be the simple eye display equipment of illustrated example embodiment with the main frame calculation element between communicate by letter and main frame calculation element and other external data base and the Internet between in order to content of multimedia is delivered to the network chart of communicating by letter of simple eye display equipment.

Fig. 3 to 4 is the simple eye display equipments of illustrated example embodiment and is suitable for via the block diagram of two-way communication path with the rough schematic view of the intraware of the main frame calculation element of wireless mode emission data.

Fig. 5 is the process flow diagram of the operation of the simple eye display equipment of illustrated example embodiment.

Fig. 6 is how the simple eye display equipment of indication is can be in order to control and to manage the figure of high-level software of various main frames by user interface.

Fig. 7 is the figure of the example hardware interface of the simple eye display equipment of illustrated example embodiment.

Fig. 8 to 10 is that explanation is used for the block diagram via the bluetooth agency of two-way communication path carry data bag.

Figure 11 is the block diagram of explanation device driver.

Figure 12 is the block diagram of explanation device context.

Figure 13 to 15 shows the embodiment as the head installing type display of the translater device with speech modulation.

Figure 16 shows the synoptic diagram of head installing type radio communication device, and described device comprises the storer that is used for stored program instruction, and described programmed instruction can provide emulation video famous person human interface to be used for coming and user interactions with Voice ﹠ Video;

Figure 17 shows the synoptic diagram of the audio/visual head installing type radio communication device with audio frequency output;

Figure 18 shows the view of display, and its displaying comprises the identifiable desirable aesthetically human facial image of emulation and some menu options that displaying is used to use input media control audio/vision head installing type radio communication device;

Figure 19 shows the synoptic diagram of audio/visual head installing type radio communication device, and described communicator has wave point to be used to obtain to be used for the new software program with new " the software personage " of user interactions;

Figure 20 shows the synoptic diagram of head installing type display, and described displaying appliance has wave point to be used for buying new software program with the payable expense of payment provider of giving from software provider;

Figure 21 to 27 shows the wireless dummy personage serve as the assistant who is used to receive incoming call, and it can make the caller hang on to wait for the wearer of simple eye communicator, simultaneously for the caller on mobile device playing advertisements.

Embodiment

It hereinafter is description to example embodiment of the present invention.

Fig. 1 illustrates the simple eye display equipment 100 of embodiment according to the present invention embodiment, its playback content of multimedia and can wireless mode from being in the remote computing device operation business applications of principal and subordinate's relation of networking.This simple eye display equipment 100 is light-duty mobile devices, it comprises the main part 105 that is connected to display device 110 by telescopic arm 115, described main part 105 is taken in one or more intrawares of described device 100, comprises the assembly of hardware interface 120 and blue teeth wireless hardware (not shown).

In one embodiment, display device 110 be by this assignee make with trade mark " WVGA LV " wide Video Graphics Array (WVGA) display sold.It is 854 * 480 the wide type active matrix liquid crystal display of colour filter that display device 110 can be resolution.In this embodiment, display device 110 can be 0.58 inch on Diagonal Dimension.In another embodiment, display device 110 alternately comprise also by this assignee make with trade mark "

SVGA LVS " SVGA (SVGA) display sold.It is 800 * 600 colour filter active matrix liquid crystal display that display device 110 can be resolution.In this embodiment, display device 110 can be about 0.44 inch and light-duty on Diagonal Dimension.Expect other display device 110, for example the 12/008th of on January 8th, 2008 application the, the 12/007th of No. 114 U.S. patent application case and application on January 8th, 2008, the display device of describing in detail in No. 104 U.S. patent application case, the full text of described two application cases is incorporated herein by reference.This device 100 is not subjected to 110 restrictions of any particular display element, and can be in this technology known the being configured to any light-duty display that carries out move operation use.

Preferably, telescopic arm 115 is elasticity bar-like member of being made by two that are connected to pivot cylindrical flexible sections, described flexible section is adjustable, and the user can extend display device 110 and be pivoted to the comfortable viewing location with respect to main part 105, make display device 110 not in user's dead ahead or do not hinder user's vision, but be arranged in user's peripheral vision.Preferably, main part 105 is elastomeric elements and can comprises hook or similar connector and be connected to the glasses of wearer or be supported on the wearer.Display device 115 preferably is configured to remain on the outside of beholder's normal vision, and does not hinder beholder's eyes, but is positioned at the outside of beholder's peripheral vision.In this regard, the user can (for example during running, walking or participating in recreation) dress simple eye display equipment 100 in comfortable mode in user's daily routines.In one embodiment, main part 105 can comprise independent anchor clamps or separately connector with the glasses, clothes, cap or another stayed surface that are gripping into the user to support the display device 115 of the outside that is positioned at beholder's peripheral vision rightly.

The simple eye display equipment 100 of example embodiment preferably can be set up two-way or the two-way wireless communication link 135 with calculation element 125, and after this installs 100 and can send data and receive data from host apparatus 125 to host apparatus 125 with high data transfer rate via Radio Link 135.After this, monocular device 100 can be converted to via the data that Radio Link receives comprise the graphics video data multimedia with display image on simple eye display device 110, described data can originate from main frame calculation element 125 or alternatively originate from another remote data base or source, for example remote memory.

In one embodiment, wireless communication link 135 is using short range or remote radio frequency signal to transmit data to install 125,100 both known agreements between device on the specified channel.Preferably, radiofrequency signal be lower powered and in about 1.0 milliwatts in the scope of 100 milliwatts so that via want range transmission radiofrequency signal, described institute will be apart from can be some feet or greater than 20 feet on length.

In one embodiment, simple eye display equipment 100 uses

Communication standard is communicated by letter with main frame calculation element 125.In one embodiment,

Techniques permit uses the frequency of 2.4 kilo-mega cycles per seconds to carry out data communication with the data transfer rate of about 1Mbps and another about 10 meters far away calculation element.

In another embodiment, wireless communication link 135 can use institute of electrical and electronic engineers (IEEE) 802.11 (b) or IEEE 802.11 (g) or another standard.In another embodiment, wireless communication link 135 can comprise that data transfer rate is about 480Mbps's

3.0, known any other high-speed digital communication standard in ultra broadband (UWB), radio universal serial bus (WUSB), wireless high-definition degree (WirelessHD), wireless high-definition degree multimedia interface (WHDMI), WiFi or this technology.In another alternate embodiment, simple eye display equipment 100 can use wired connection (for example serial port or USB (universal serial bus) (USB) cable or other wired connection) but not link 135 is communicated by letter with host computing system 125.Perhaps, wireless communication link 135 can comprise that any other frequency hopping standard in the spread spectrum communication known in CDMA (CDMA) standard, time division multiple access (TDMA) (TDMA) standard or frequency division multiple access (FDMA) standard or this technology transmits data.Become known for wired in this technology and variety of protocol standard radio communication, and this device 100 is not limited to any particular link or radio frequency protocol.

This simple eye display equipment 100 uses two-way or two-way wireless communication link 135 playback of video and the audio frequency on simple eye display device 115 with calculation element 125.Simple eye display equipment 100 is gone back main frame calculation elements 125 such as control example such as wireless laptop computers 125a to move business applications, retrieving electronic mail and operation executable code or application program via Radio Link 135 from laptop computer 125a.In this, simple eye display equipment 100 can comprise input media 120 (for example, the input media 335 of Fig. 3), and it can be transferred to main frame calculation element 125 with wireless input signal.Input signal may command main frame calculation element 125 runs application on main frame calculation element 125 so that control signal to be provided.After this, main frame calculation element 125 outputs to display device 110 to be used for the long-range main frame calculation element 125 place's application program operating that are presented at simple eye display 100 places with figure, and described simple eye display 100 can be positioned at the distance away from main frame calculation element 125.The various types of contents 150 of main frame 125 supplies are for watching on display 110, the information that comprises video 150a, audio frequency 150b, computer data 150c and other type, for example calendar 150d, Email and with the data of the type of the regular any number that finds from main frame 125.

In addition, the application programming person can use software system development external member (SDK) 160 to specify the interface that is used for main frame 125, and then permits displaying contents 150 on display 110.For many reasons, device 100 may not show the content of existing webpage or other type simply.In particular, content 150 need and be implemented to cooperate display 110 through particular design.In order to encourage this situation, developer SDK 160 makes that the developer can be apace and easily develop the visuals of its application program.The rear end of these same application domain then is encoded as the programmer language of selecting at specific device 100, as hereinafter with more detailed description.

By using two-way wireless communication link 135, mobile device 100 can insert MicrosoftWindows To provide data via link 135 for mobile device 100 accesses.Preferably, Microsoft Windows

Program can be inserted by wireless blue tooth, 802.11 (b), 802.11 (c) or 802.11 (g) by mobile device, and mobile device 100 can be positioned on away from main frame calculation element 125 places.Preferably, mobile device 100 can be connected to main frame calculation element 125 with wireless mode via the Internet.Therefore, mobile device 100 can connect Anywhere from the world, and can be from be connected to the storage access data of distance host calculation element 125 with mode of operation.

In addition, the pc user can use Microsoft Windows

The PC that comes content, application program and the PC service of long-range driving, access and order PC or server and needn't contact dormancy or revive by RDP (RDP), virtual network computing (vnc), GoToMyPC (commercial long-range access PC order and control are served) etc.

Should be appreciated that simple eye display equipment 100 is not limited to use any particular host calculation element 125, and should be appreciated that, only is illustrative and nonrestrictive about the argumentation of laptop computer 125.This simple eye display equipment 100 can change into other mobile portable device or information database (for example mobile phone), PDA(Personal Digital Assistant) (for example

Compatible device), desktop PC, flat computer, mobile E-mail communicator are (for example

Device or Good Compatible device) or individual digital music or video player (Apple for example

Video and audio player, Microsoft

Multimedia player and other motion picture expert group (MPEG)-1 video layer 3 (MP3) music player, video frequency player or driver) communicate by letter.Main frame calculation element 125 also can comprise automotive system, global positioning system apparatus, satellite radio receiver or player, for example XM Satellite

Device or SiriusSatellite

Compatible device.Main frame calculation element 125 also can comprise principal computer calculation element, digital test device, diagnostic device,

Or known any other numeral or analogue means in other digital video recorder, machine top cable box or this technology.

Should be appreciated that, simple eye display equipment 100 should have suitable procedure, and to instruct from first format conversion be second form, the main frame calculation element 125 of wanting can receive and operate to transmit control signal rightly by described second form, and in this, simple eye display equipment 100 preferably includes converter (not shown), and it is changed between form according to the particular host calculation element.Various format configuration are possible and belong in the scope of the present invention, and the simple eye display 100 of this assist type is not limited to any particular host or communication format.

Main frame calculation element 125 can be communicated by letter with remote data base and can be served as intermediary between simple eye display equipment 100 and content of multimedia source or the website, make the user can the heavy calculation element that is not associated with obtain situation that network that content of multimedia is associated is connected under watch multimedia (in the peripheral vision at wearer).It is very light envisioning described device 100, about several ounces, and, make wearer unimpeded mode to move to participate in normal daily routines by the wearer support.

Main frame calculation element 125 can be personal computing device, for example comprises the desktop type or the laptop computer of operating system (OS), and described operating system (OS) for example is Microsoft Windows

OS, Microsoft Windows

Apple Mac

The compatible operating system of OS, Symbian OS, to associate compatible operating system, (SuSE) Linux OS, UNIX operating system or the Internet ready and be configured for use in the known proper operation of another of wireless move operation system.

Fig. 2 is the figure of explanation with the simple eye display equipment 100 of example embodiment of host computing system 125 interactions.Main frame 125 is along two-way communication path (for example cellular services 200a, Wi-Fi 200b, satellite service 200c, radio and television 200d and the closed-circuit signalling 200e) acquired information that leads to the Internet 250 or associated database 255, on the display device 115 of simple eye display equipment 100 at described the Internet 250 or associated database 255 displaying contents.

In one embodiment, communication path 200a can be the cellular mobile communication wireless path, and each path can be similar and different to 200e with respect to residue two-way communication path 200b.In one embodiment, host computer 125 can use

The EV-DO WiMAX connects to come acquired information, and then uses

Wireless connections 135 are communicated by letter with monocular device 100.

In another embodiment, communication path 200b can be Wi-Fi communication path or similar radiofrequency signal communication link.Host computer system 125 can use

path

200c, 200d or 200e to communicate by letter with satellite service supplier, digital video recorder, radio and television supplier or closed-circuit signalling device respectively.Path 200a also can be associated with public access hotspot to 200e.

Should be appreciated that, this simple eye display equipment 100 can with in order to the NASCAR Nextel Fan View of the closed-circuit television of watching sport event and/or be used to show the kangaroo.tv broadcaster compatibility of closed-circuit television incident.This simple eye display equipment 100 can be configured to receive Live Audio, can receive a plurality of different broadcasting view, statistical information and the voice datas of sport event (identical or different incident) in real time.

Host computer system 125 can be along enter the Internet Web server on 300 of

path

200a, 200b, and obtains that institute keeps and along the information of communication path 135 to display device 115 demonstrations.In one embodiment, data can have known data layout, and for example HTML(Hypertext Markup Language), extend markup language (XML), joint image expert group (JPEG), waveform (WAV), AIFF (AIFF), bitmap (BMP), picture (PICT), GIF(Graphic Interchange format) (GIF) and windows media video (WMV) or be suitable for comprises any other data layout of the content of multimedia of crossfire video and audio frequency.Data can be along path 200f from database 305 obtain from the Internet.The configuration of various communication paths is possible and belongs in the scope of the present invention.

Host computer 125 can use HTML to transmit and receive data along the wireless communications path 200b that leads to the Internet and other system's webpage or information database 300 along two-way communication path 200b.Host computer system 125 can comprise that (for example known web browser comprises MicrosoftInternet to internet browsing software Netscape

And Mozilla ) transmit and receive data along path 200a and 200b.Should be appreciated that host computer system 125 can be connected to the Internet by cellular telephone network and/or Internet service provider gateway server.

In addition, this simple eye display equipment 100 along path 200a to 200e from electronic mail account (for example can be configured to

Hotmail,

G-Mail,

Mail,

Known any other Email supplier or internet site in Mail or this technology) Email that receive push email, extracts Email or periodically transmit.In one embodiment, Radio Link 135 or communication path 200a can be compatible with and Staccato to 200e

Ultra broadband (UWB) USB uses together, described USB comprises radio frequency (RF) transceiver, digital baseband and in order to the interface up to the wireless connectivity of 480Mbps to be provided on single chip covering, described USB can be arranged in simple eye display equipment 100 or main frame calculation element 125.

Should be appreciated that in one embodiment, main frame calculation element 125 and simple eye display equipment 100 form master-slave relationship each other.Main frame calculation element 125 can comprise Microsoft

OS, it is recognized as secondary secondary monitor with respect to primary host computer calculation element 125 and elementary display with simple eye display equipment 100.Main frame 125 can use described operating system to control secondary simple eye display equipment 100 with wireless mode.

Should be appreciated that simple eye display equipment 100 roughly simultaneous system connects with wireless mode and two or more host apparatus 125 (for example first calculation element and second calculation element) Jie via at least two independent wireless communications paths 135.In this regard, simple eye display equipment 100 can be synchronous with first calculation element, second calculation element and other device, makes simple eye display equipment 100 serve as central hub.

In this regard, simple eye display equipment 100 can be initial and first wireless communications path of first device, and second wireless communications path also simultaneously initial and second device.First and second communication paths can be identical or different, and can via

Connect or modified form

Connection or another agreement dispose.In one aspect, communication path can be

2.0 or 3.0 connections, IEEE 802.11 or IEEE 802.15 wireless communication protocols, and described connection can be suitable for communicating by letter via some channels simultaneously with variable-digit speed and variable buffering device.In alternate embodiment, communication path can be

Connect, and described connection can be suitable for communicating by letter via all channels simultaneously with the variable buffering device with variable-digit speed.

First calculation element and second calculation element can be any previously mentioned calculation element, for example laptop computer, server, the Internet, desktop PC, smart phone, mobile phone, music player or any other move or non-moving device, and various calculation element is possible and belongs in the scope of the present invention.Preferably, by using simple eye display equipment 100, beholder's controllable device 100 wireless with via in order to the pairing of first calculation element Connect and remotely inquire first calculation element.After this, device 100 can output to the control program instruction first calculation element to carry out function at device 100 places.In one aspect, communication path can be

Connect, and described connection can be suitable for communicating by letter via some channels simultaneously with the variable buffering device with variable-digit speed.Described path can be suitable for transmitting video, audio frequency, figure or any data.

What after this, device 100 (when communicating by letter with first calculation element) also can be via in order to second calculation element pairing is wireless

Connect and inquire second calculation element.This can use similar and different wave point to finish.After this, device 100 can output to second calculation element with the control program instruction.In one aspect, communication path can be

Various compunications configuration is possible and belongs in the scope of the present invention, and installs 100 other calculation element and/or the peripheral unit that can be configured to control any number, for example wireless head-band receiver, radio memory, wireless speakers etc.For instance, device 100 can match with two mobile phones independently simultaneously.In this way, wearer can use from the programmed instruction of simple eye display equipment 100 transmission and use described two mobile phones to carry out independent call.

Perhaps, device 100 can use mobile phone to call out to use device 100 with mobile phone and the laptop computer pairing with radio modem, control the laptop computer displaying video simultaneously, described video is to connect transmission for showing via bluetooth on device 100.Various configurations are possible and belong in the scope of the present invention, and should be appreciated that, device 100 can be controlled device or more devices more than three or three by setting up an above wireless communication link.

Fig. 3 illustrates the simplified block diagram of the limiting examples embodiment of this monocular device 100 for purposes of illustration.Simple eye display equipment 100 comprises the display device 110 that is connected to display controller 300, and described display controller 300 can be served as reasons Freescale Or Advanced Micro-Devices The digital signal processor of being done, or be connected to another controller of bus 305 (for example periphery component interconnection (PCI) bus).In one embodiment, display 110 can be connected to video graphic card (not shown), and it is connected to bus 305.Video graphic card can be Accelerated Graphics Port (AGP) video card, and it is coupled to the AGP video card slot in the device 100.Monocular device 100 also comprises storer 310, random-access memory (ram) 315 and ROM (read-only memory) (ROM) 320 for example, and it preserves executable program instructions, and by bus 305 programmed instruction is sent to controller 300.Preferably, monocular device 100 further comprises transmitter 325 and receiver 330 and/or combined type transceiver (not shown), and both are connected to bus 305 with the wave point of formation with main frame calculation element 125 for it.Transmitter 325 and receiver 330 are also connected to display controller 300 and receive the instruction that is used for its control.

Simple eye display equipment 100 also comprises input media 335, it can be wireless mouse, tracking ball or keyboard or can be connected to other similar wireless device of pci bus 305 with wireless mode by Radio Link 340, and described Radio Link 340 is received by receiver 330.Perhaps, input media 335 can wired mode (not shown) be connected to bus 305 input signal is provided to controller 300.The simple eye display equipment 100 of input media 335 may command, host apparatus 125 or simple eye display equipment 100 and host apparatus 125 screen prompt on both, wherein 125 one-tenth master/slave networkings of monocular device 100 and main frame concern.

Monocular device 100 inquiry outsides or host apparatus 125 and being configured to set up the Radio Link 135 with host apparatus 125, makes host apparatus 125 in a bi-directional way up-link and down link data to be provided to monocular device 100 via Radio Link 135.In one embodiment, monocular device 100 can receive the uplink data that is suitable for display graphics multimedia messages on the display 110 of monocular device 100.

Main frame calculation element 125 comprises CPU (central processing unit) 345, has RAM 350, ROM 355 and also comprise the storer of cache memory 360.Calculation element 125 further comprises transmitter 365 and receiver 370 and/or combined type transceiver (not shown).Host apparatus 125 also can comprise elementary display 375 and input media 380, and it all is connected to bus 390, pci bus for example, as shown in the figure.Should be appreciated that bus 390 can be connected to cable broadband and connect (not shown) or WiMAX connection 385, DSL circuit, cable modem, media player, music or video player or any other appropriate link to receive data from database.

During initial activation phase, between the receiver of the transmitter of simple eye display equipment 325 and host apparatus 370, set up bidirectional wireless link 135, and proof procedures take place via wireless communications path 135.After this, monocular device 100 can be communicated by letter with main frame receiver 370 with wireless mode via wireless communication link 135, and main frame transmitter 365 can be transmitted into signal monocular device receiver 330.In one embodiment, simple eye display equipment 100 can use from its transmitter 325

2.0 or 3.0 less radio-frequency standards are communicated by letter with main frame receiver 370 with wireless mode.In another embodiment, monocular device 100 can use wireless ultra wideband communications link 135 or use short-range radio frequency signal 135 with wireless mode communication.

In a non-limiting example, central processing unit 345 execution of program instructions that are associated with host computing system 125, and use Microsoft Windows

Inquire that simple eye display equipment 100 is to allow the cache memory 360 of simple eye display equipment 100 transmitters 325 and receiver 330 access main frame calculation elements 125.The content of cache memory 360 then is sent to bus 390 and transmitter 365.Controller 345 output control signals with from transmitter 365 with data transmission to simple eye display equipment 100, and when main frame calculation element 125 cuts out or do not have power, on simple eye display 115, show multimedia.After being received by receiver 330, receiver 330 is communicated by letter with bus 305 and is arrived display controller 300 with the data transmission that will be received.

Display controller 300 outputs to display 110 with display image with control signal.The data that this allows simple eye display equipment 100 to receive on the cache memory 360 that is stored in main frame calculation element 125.When main frame counter 125 not in use or when being cut off, the data of watching on simple eye display equipment 100 are from cache memory 360 and are not updated.With compare when main frame calculation element 125 operation, these data may refresh to 200e by communication link 200a a little more always and not.Should be appreciated that simple eye display equipment 100 and main frame calculation element 125 also comprise audio devices 394,395, it receives control signal and in response to it and audio plays.

Microsoft Windows

Be configured to recognize separate with main frame calculation element 125 or away from a plurality of other secondary display 100.The display device 110 of simple eye display equipment 100 can be in order to watch multimedia, operation executable code, run application, watch Email, to watch calendar applications and other main frame computational data, it is transmitted into simple eye display equipment 100 via Radio Link 135, also is like this even main frame calculation element 125 cuts out or do not have power.

Perhaps, simple eye display equipment 100 can be configured in networked deployment as secondary display with host computer 125 and use simultaneously.Therefore, by input media 335 and the display device 115 that uses simple eye display equipment 100, but the processor 345 of data on user's access host computer storer 360 and use host computer 125 runs application, this all carries out from the secondary display element 110 of the simple eye display equipment 100 that becomes master-slave relationship, and described secondary display element 110 can show different demonstrations with respect to the elementary display of host computer 125.

Fig. 4 provide the electronic package that is incorporated in the wireless head-band receiver display equipment 100 than detailed view, described device 100 is connected to host computer system 125 to connect the receiving digital video signal via bluetooth.These assemblies are the 61/010th of being entitled as of on January 4th, 2008 application " agreement (PROTOCOL FOR TRANSPORTING VIDEO SIGNAL OVERBLUETOOTH WIRELESS INTERFACE) that is used for carrying via bluetooth wireless interface vision signal " the, more detailed description in No. 177 co-pending patent application cases (attorney docket is 0717.2082-000), the full text of described patent application case is incorporated herein by reference.

In a preferred embodiment, head phone 100 comprises that (it can be open type multimedia application platform (OMAP) 3500 series processors to advanced RISC machines (RISC) machine (ARM)/digital signal processor (DSP) 412, it can be from (the Texas Instruments of Dallas of Dallas, Texas city Texas Instruments, Texas) obtain), storer 414, (it can be by can be from (CambridgeSilicon Radio (CSR) of Cambridge of cambridge silicon radio (CSR) company of Britain Camb for blue tooth interface 416, England) 2 grades of blue tooth interfaces of Huo Deing provide), (it can for example be can be from Vista, Massachusetts Blang's cruel product companies (Kopin Corporation of Westborough, MA) the SSD1508 display driver of Huo Deing) to display driver 419, videl stage shifter circuit 420, power supply 422 by battery 424 supports, general receiver transmitter (UART) 426 (for example can be used for debugging) and storer 415.Secure digital (SD), extreme digital (xD), USB SD (uSD) storer 417 or other similar interface can be in order to application storing, kernel instruction file or configuration datas, and/or be connected to for example device such as digital camera.Some buttons 430 can be associated with device (for example, switch 1/ switch, 2/ switch 3 and the input that resets) and LED output 432 (led1).VGA or better quality display 110 and audio frequency input-output device 460 also are provided, and it can comprise microphone input 462 and stereo output 464.

Signal can connect to send to main frame 125 from installing 100 via the blue teeth wireless that uses serial port profile (SPP) to set up, this with use " senior " bluetooth mode in any one is opposite, its provide than this type of fine mode force be found this use in the high larger process amount of unwanted higher level protocol.In bluetooth radio 416, connect the vision signal that receives via bluetooth and come to send to ARM/DSP 412 from interface 416 via USB connection 418.

A design considers it is to optimize data packet format under the situation of given data buffer sizes.In CSR chip 416 inside is that default size is the bag impact damper of 1000 bytes.This can be through revising to force the crossfire vision signal only to use the buffer sizes of about 990 bytes.

Processor 412 can expect the video content that is received use so-called baseline profile or better profile come to format and encode with H.264 (motion picture expert group (MPEG)-4 part 10).

In a preferred embodiment, ARM/DSP processor 412 can use the multitask embedded OS.Processor 412 is following to be operated the vision signal that is received.Make that mpeg format container file (for example .MP4 file) is available.In a preferred embodiment, this can be the proprietary file form, but the specific detail of selected input .MP4 file layout is unimportant herein, as long as DSP 412 is through programming rightly it is handled.Processor 412 is then opened towards the communication port of host computer system 125 and via the bluetooth transceiver of USB interface 418 from CSR chip 416 and is received file.

MP4 demoder among the DSP 412 is separated into corresponding audio and video stream with file.More particularly, DSP 412 with input file H.264 compressed digital video signals be decoded as YCbCr base band component vision signal.ARM/DSP 412 also can be divided into the base band stereo audio with the compressed audio (being formatted as Advanced Audio Coding (AAC) format signal) that is associated.

ARM/DSP 412 can output to display driver 118 with video by any suitable form, and described form for example is that BT.656 or motion picture and 16 gradual scannings of YUV of the 293M of Television Engineer association (SMPTE) with independent synchronizing signal are advised by 8 wireless communication departments of International Telecommunications Union (ITU) (ITU-R).

Vision signal through decompressing can be transmitted via the inside ARM bus of processor 416.The ARM bus then directly sends to display driver 419 via SMPTE 293M interface with described content.Intelligence interface controller (I2C) interface 447 is in order to configuration display 110.

ARM 412 also outputs to base-band audio audio frequency output compression/de-compression module (codec) 460.It can adopt monophony or stereo audio to import and produce suitable stereo output signal.

Fig. 5 is the process flow diagram according to the method for operating 500 of the embodiment of simple eye display equipment.Described method begins (505).After this, simple eye display equipment waits for that (507) user imports request.This input can be any signal from input media output, for example from radio tracking ball, wireless mouse or wireless keypads or be positioned at the output of the button on the shell (for example, the shell 105 of Fig. 1) of simple eye display equipment.In one embodiment, by using operating system (for example, Microsoft Windows Operating system) and use wireless mouse, the icon that the user can double-click on the simple eye display equipment screen (for example, the screen 110 of Fig. 1) is opened email message or is opened application program with indication.After this, method 500 attempts in response to described request receiving data from content source, and described method will determine (510) content source whether be positioned on the simple eye display equipment storer (for example, the storer 310 of Fig. 3) in (for example, in camera output), or whether described source be positioned at another remote location, for example on host computer (for example, the main frame 125 of Fig. 1).If data are to be stored in this locality (512) and not need Radio Link really, access local storage (515) and described data are configured to be retrieved and load for showing on display device subsequently so.In case just returning, method 500 access local storages (515), method 500 wait for that new user imports request (507).

Yet,, begin (520) so if data are arranged on the remote memory or be not the storer (513) that is positioned on the simple eye display equipment The data of (507) are asked in connection or other previously described wireless connections to obtain.Should be appreciated that, also can use other wireless communication format, as discussed previously, and this method 500 only is used for illustration purpose.

The transmitter (for example, the transmitter 325 of Fig. 3) of device can be through activating with inquiry (525) main frame calculation element, and the initial configuration signal is sent to the receiver (for example, the receiver 370 of Fig. 3) of main frame calculation element.Main frame is determined

Whether signal is through fully charging and receiving (530) from simple eye display equipment 100.In case receive signal, main frame transmitter (for example, the transmitter 365 of Fig. 3) just will send to monocular device receiver (for example, the receiver 330 of Fig. 3) with confirmation signal by using second prearranged signals.If do not receive signal (532), so simple eye display equipment continues inquiry main frame (525).To send strong or than the signal of tool directivity.If the main frame calculation element receives signal (534) rightly, form (535) two-way communication data routing via Radio Link (for example, the Radio Link 135 of Fig. 3) so.Up-link can (for example be sent to device via the two-way data routing that is connected with down link signal, the simple eye display equipment 100 of Fig. 3 and main frame 125) and from described device transmission, this method only is illustrative, because except the non-limiting method of Fig. 5, can send various diagnostic utility application and signal along Radio Link.

In case form (535) two-way communication data routing, just multimedia data file can be sent to simple eye display equipment from the main frame calculation element.In a non-limiting example, the bandwidth of communication path is at the bits per second epipodium so that when at the operating Microsoft Windows of host computing system place

During operating system, the host display output screen (for example, the host display 375 of Fig. 3) figure output can be in real time at display device (for example, the display 110 of Fig. 3) locates to watch, if make two displays fixing side by side, cursor moves and will roughly take place so that can be at simple eye display equipment place's operated from a distance host computing system simultaneously on two screens so.

Display controller (for example, the controller 300 of Fig. 3) sends (540) to the request from the vision signal of calculation element.Described request is sent to bus 305 and transmitter, and then sends via link.After this, simple eye display equipment determines whether (545) vision signal receives from host computing system with wireless mode.If signal receives (547), so simple eye display equipment request audio frequency (550) with wireless mode.If signal does not receive (548) with wireless mode, so simple eye display equipment returns another request (540) that sends.

Display controller sends the request (550) from the sound signal of main frame calculation element.The Voice ﹠ Video signal can be used as a continuous signal and sends, and the present invention is not limited by any this type of dual signal embodiment.Described request is sent to bus (for example, the bus 305 of Fig. 3), is sent to transmitter and then sends via link.

Simple eye display equipment determines then whether (555) sound signal receives from host computing system with wireless mode.If sound signal receives (547), so simple eye display equipment display video (560) with wireless mode.If voice data or signal do not receive (548) with wireless mode, so simple eye display equipment returns another request (550) that sends.

Programmed instruction causes simple eye display equipment to pass through the preferably display video (560) on display of the display controller in user's peripheral vision, and uses audio devices (for example, the audio devices 395 of Fig. 3) audio plays (565).After this, transmission is to the request (570) of another input signal.Determine then whether (575) described process is finished.If described process is finished (577), method finishes (580) so.If described process is not finished (578), wait for that so another user imports request (507).Various controls configuration is possible and belongs in the scope of the present invention, and this configuration only is used for illustrative purposes, and envisions a plurality of steps that other is used to encrypt, and also anticipation cracks main frame calculating or other external computing device form.

How Fig. 6 can use simple eye display equipment 100 for indication to control and manage by user interface the figure of high-level software of various main frames 125.Software stack 600 comprises: device application program browser 601, and it can move on the core (for example the Linux core 602) of operating system (OS); Draw primitive, for example pile up 603 primitives that provide by direct FB (DirectFB); With graphical tool external member (for example Gimp suite of tools (GTK) window suite of tools 604).Device application program browser 601 allows the user to insert the application software that is used for wireless video head phone 100 by icon and menu interface.This is made up of the self-defined code of writing at described specific device 100 usually.

OS 602 goes up operation through the port setting with the processor in wireless video head phone 100 (OMAP 3500 series A RM/DSP for example shown in Figure 4).Core stage 602 provides the standard operation system function in addition.Draw primitive layer 603 and can be thinner a little shape library, it provides figure to quicken input media and disposes and the abstract integrated system of windowing.Net result is graphical user's display, and for example with the display of project 610 displayings, it has the obtainable various application programs of user, for example Bluetooth ^TMFind 611, counter 612, media player 613 and interface 614 is set.

The application program of moving in the context of device application program browser 601 can comprise phonetic entry 621, virtual (desktop) networking client 622 and web browser 623.Virtual network is the system that allows Long-distance Control personal computer (PC).By being outputed to another device with the form of bitmap, whole screen display carries out this operation.This bitmap is packed with procotol and is received and demonstration simply by described device.Similarly, the detected any mouse of local device is moved or key in data is directly delivered to long-range PC with according to its action.

Voice command interface 621 provides or allows the speech input command with controlling application program browser 601.Therefore, for instance, the user can say word " counter "---follow by voice device under the detected situation operating system 602 starting calculator application at this.In general, the text label indication that is next to button on the screen or icon display in the context of application program browser will activate the said word of corresponding button.

Numeral input (switch) also can be in order to navigation and choice menus function, comprehensive control of described menu function permission and editing application program and the data that are associated.

As understanding at once, find that application program 611 not only allows to find adjacent Bluetooth ^TMDevice, and allow to be connected to the application program browser level.What showed in the instance user display 610 for instance, is the fact of two institutes of current existence coupling arrangement (comprising desk-top computer 627 and Blackberry628).Find device 627,628 by the operation of finding application program 611.This is can be for example initial or by the manual initial Bluetooth of user when power on the first time of wireless head-band receiver device 100 ^TMDiscovery procedure comes initial.Bluetooth ^TMDevice is found according to Bluetooth ^TMStandard is carried out, at any new Bluetooth ^TMWhen being connected the Physical layer place, reports bed device described Bluetooth ^TMBed device.

Yet, in this, provide additional functionality to permit at network level place and Bluetooth ^TMDevice communication.In particular, client 627,628 is apprised of and opens particular port on local host: the address in this locality of wireless head-band receiver device.This device port is served as the agency, seeks this type of request all the time.When receiving when request, it is reported back that available network level address (that is, for example TCP/IP address) makes for individual device 627,628 and is used for carrying out network level communication.

The hardware interface that Fig. 7 explanation is also provided by the browser application 601 of Fig. 6 is functional 700, its can receive and/or control device 100 on various hardware capabilitys.This type of function can comprise head phone detection 701, battery status 702, output unit adjustment (for example head phone button 703, speaker volume 704, microphone volume 705), media stream function 706, frame buffer switch 707, device driver and similar functions.

The standard bluetooth protocol stack of being implemented in the Bluetooth link 137 of Fig. 8 key diagram 1 wherein is added with special agent functionality.Bluetooth ^TMLayer provides Bluetooth ^TMFind device 800, as at any standard Bluetooth ^TMIn the device.Yet, also will provide the protocol information of permitting carrying out exchanges data 812 with this type of device through connecting 810 head phone device 100.It also can be connected to the head phone device 820 of other type, phone head phone device for example, and it can provide disposes incoming call 822 and disposal and spreads out of and call out 824.

Fig. 9 A shows Bluetooth to 9B and Figure 10 ^TMThe more details of the proxy functionality that interface 137 is provided.

Fig. 9 A explanation relates to the classical pathway that is connected with a plurality of direct TCP layer of data source.For instance, each application program of moving in the context of the application program browser 601 of Fig. 6 (for example voice identification application program 621, virtual network client 622 and web browser client 623) may need one or more TCP of the data source that provides with main frame 125 ' to be connected separately.Legacy system relates to a plurality of direct TCP of data source and being connected.

Fig. 9 B explanation can be how be supported being connected between simple eye display equipment 100 and the Internet 250 by acting on behalf of 930 via the device 125 with Internet function, but Bluetooth ^TMItself do not provide with any of the Internet 250 or other upper layer network and directly be connected.Bluetooth can't be directly connected to the Internet; It must be acted on behalf of via the device with Internet function.Therefore, for instance, for example application program such as web browser 623 needs host apparatus 125 ' to serve as the networking agency usually.

The wherein single Bluetooth link 137 of Figure 10 explanation is supported the preferred arrangements of a plurality of application programs 621 to 623.A plurality of application programs 621 to 623 need single Bluetooth ^TMConnect 137 and support a plurality of sockets, for example transmission control protocol (TCP) connects.For instance, although each application program 621 to 623 may need a plurality of TCP to connect standard Bluetooth in addition ^TMThe Bluetooth that is added between layer and the rule T CP protocol layer ^TMAgent layer 1010 is sent to a plurality of TCP connections of asking on the single socket.Bluetooth ^TMThe single socket that link 137 is provided then is transported to main frame with described a plurality of connections.

Provide similar reverse function 1018 bag is taken apart its corresponding connection 621 ' to 623 ' on the host computer side 125.

Although Bluetooth ^TMItself allow a plurality of sockets that are connected between main frame and the client, but many mobile phone operators force single restriction that connects.Therefore, must observe single restriction that connects in many cases.This not only permits higher-security, and avoids making wireless device to be busy with Bluetooth ^TMThe possibility of connection request.

This approach is also permitted standard web browser application program 623 (for example) and is operated not needing its TCP socket used under the situation of making amendment.Therefore, the operation of the agent functionality 1018 that provides on bluetooth agency 1010 who provides on the client 100 and the main frame 125 makes the application program 621 to 623 and the functional isolation of this type of modified socket of operation in application program browser 601, and also makes the application program and the functional isolation of this type of modified socket of operation on main frame 125.For instance, the virtual network of operation does not need to revise now on main frame 125.

Figure 11 illustrates through providing so that install the device driver that application program browser 601 needn't be known the specific detail of the content format that is used for the particular host device.Therefore, for instance, 125b provides blackberry, blueberry server 1101 at the blackberry, blueberry main frame, and provides WindowsVista server 1102 at Windows machine main frame 125c.This allows the user interface specific detail of particular host 125 is presented to wireless head-band receiver device 100 as

generic interface.Server

1101,1102 provide at least two functional, comprise the Bluetooth of Figure 10 ^TMProxy functionality 1118 (that is, the TCP channel data is unpacked be a plurality of required channels) and content server.

Figure 12 illustrates the device context processing that

server

1101,1102 is done.These can comprise the content format sheet of the corresponding contents of each type that is used to comprise email INBOX 1201, contacts list 1202, stock ticker 1203, Media Browser 1204 etc.In these server functionalities 1201 to 1204 each uses the page marker language to come its content is carried out reformatting.The page marker language can be then by elements browser 601 deciphers on the video head phone device.Elements browser 601 now usually decipher page marker language to cooperate the various requirement of video head phone device 100.

In alternate embodiment, for example function such as Windows Sideshow server can be obtained through formatting component from the Windows device, and requires according to Sideshow it is formatd.WindowsSideshow be with

The technology that the Windows Vista version of operating system is introduced, it makes Windows PC to drive to be connected to the various secondary monitor devices of main PC.These devices can separate with display etc. on being embedded in the outside that laptop computer renovates with main PC (for example) or be integrated in the described device.

By virtual network and/or side display function, wireless head-band receiver device also can become " chameleon ", thereby in fact presents the same subscriber screen of host apparatus, identical graphical user interface and familiar user's control.Accept several host (that is, blackberry, blueberry, mobile phone and PC) simultaneously even install 100, also permit the user and between host apparatus, switch.Whenever the user carries out this type of when switching, the user can see and still recognize familiar slave unit or main frame and device users screen, identical graphical user interface (GUI) and is familiar with control and order with identical.

Therefore, understand portable video head phone 100 view content now how by different way, described mode all can be selected by the user, comprising:

-new the application program of being write at device itself; Device application program, Web page application program, web browser etc.; And

-

Sideshow application program or the native applications program that connects via virtual network.

Support impetus that can original trustship device GUI interface, screen, order and control interface are passed in support at multiple arrangement simultaneously by bluetooth agency.

Turn to Figure 13 now, show the alternate embodiment of multi-functional simple eye display equipment 100, the diagram of the assembly of its exhibiting device 100.The assembly of envisioning various assemblies and being showed forms the non-exhaustive tabulation of described assembly and is not restrictive.In this embodiment, simple eye display equipment 100 preferably can be used as and is used for the said a kind of foreign language 1300a of the first entity 1300b is translated as the second language that wearer W understands or the translater device of auxiliary described translation.Simple eye display equipment 100 can receive the audio frequency input 1300a from the first source 1300b (for example natural speaker, audio-source, communicator, Email, video source or phone).In response, simple eye display equipment 100 can be converted to this audio frequency 1300a the different second language of the form with wearer W understanding.This then launches with the text formatting demonstration or with audio format for the wearer W of simple eye display equipment 100 through the translation audio frequency through conversion.

In the another embodiment of this device 100, device 100 can not only be exported through cypher text from loudspeaker 1345 with the form that can listen voice, and installs 100 and also can export through cypher text from external device (ED).For instance, wearer W may arrive foreign country and need to use described device 100 as translation tool to speak with foreign taxi driver.Replacement is from installing 100 outputs through cypher text or voice, device 100 will be controlled second peripheral unit 1350 that is associated with the driver, and then from described second device 1350 (for example, taxi driver's the mobile phones 1350) but not device 100 outputs of being dressed through cypher text.

In this embodiment, device 100 can via radiofrequency signal communicate by letter with external device (ED) 1350 pairing, and will output to external device (ED) 1350 through cypher text in real time for foreign speaker 1300b.This second external device (ED) 1350 can be associated with foreign speaker 1300b.For instance, at the initial beginning place that uses, device 100 can comprise in order to the inquiry external device (ED) (for example monitor, personal digital assistant, notebook, portable music player, remote speaker, mobile phone, intelligent movable phone have transceiver or receiver and can carry out any other device of wireless data communications) programmed instruction.Device 100 can for example use

1.1,1.2 or this technology in known known protocol standards such as any other wireless communication protocol come and the external device (ED) pairing.After this, device 100 can then be delivered to radiofrequency signal external device (ED) and uses described peripheral unit 1350 with the control external device (ED) but not use loudspeaker 1345 to output to foreign speaker 1300b through translated speech (it is imported into device 100).

In another embodiment, device 100 can and then use described external device (ED) 1350 to handle or export through translated speech or text with the external device (ED) pairing.Device 100 can be with the reception voice output to remote-control device, and translation itself can externally be installed 1350 places and be taken place, and through translated speech can from the output of device 100 loudspeakers that are associated 1345, or can be from loudspeaker 1355 or the 3rd device (not shown) output that is associated with external device (ED) 1350 through translated speech.In this way, wearer W can utilize available peripheral unit to come to use with device 100, and can provide from one or more a plurality of peripheral units 100,1350 through translated speech.

In general, multi-functional simple eye display equipment 100 will be converted to data from the initial audio input 1300a of the foreign speaker or the first source 1300b.After this, device 100 uses the comparison between the reference data that calculation elements 1325 (long range positioning or directly be positioned in the device 100) carry out being stored in the voice data that received and the storer 310.

In one embodiment, use comparer 1320 to come query translation look-up table 1330.Comparer 1320 can be software program or discrete digital device.Translation look-up table 1330 has in order to audio input data is converted to the programmed instruction of second language from first language together with comparer 1320.This translation look-up table 1330 can be any translation software known in this technology, for example with Massachusetts Burlinton NUANCE COMMUNICATIONS,

BABEL FISH

Translation software that SOFTWARE is associated and GOOGLE WEBSPHERE

The software that is associated or have any other software translation that is used at the programmed instruction of translating between two or more language at least.

Corresponding to then preferably outputing to one or more peripheral units through interpretive language (it is through conversion) from the voice data of foreign speaker 1300b.These peripheral units are associated with simple eye display equipment 100.These peripheral units can be one or more devices of being configured for use in vision output (showing), data output in screen or are associated with the device (loudspeaker) that is configured for use in audio frequency output.Anticipation output can show by more than one forms.Randomly, output can use the storer 310 that is associated with simple eye display equipment 100 to write down for retrieving after a while and resetting.In another embodiment, the output of foreign language or translation can come concise and modulation with desirable audio format for the wearer of the simple eye display equipment 100 of multifunctionality.

Figure 13 shows the graphic explanatory view of some assemblies that device 100 is described, its median ocellus display equipment 100 preferably includes microphone 462 and loudspeaker 464, and both are connected to pci bus 305 with mode of operation for it.Controller 300 and storer 310 are operatively coupled to bus 305 to provide steering order to various assemblies.Preferably, install 100 accesses in order to suitable procedure instruction from microphone 462 received audio signal 1300a.Controller 300 uses A/D converter 1310 that sound signal 1300a is converted to numerical data.

Controller 300 further has the programmed instruction in order to control comparer 1320, and described comparer 1320 will compare with digital data conversion and translate into another kind of different language from the numerical data of converter 1310 and language look-up table 1330.Should be appreciated that language look-up table 1330 can be wide and comprises mass data being used for reference to one or more language, for example English to French, English to German, German to Japanese, Korean to Japanese etc.

From the translation look-up table 1330 then output to storer 310 through translation data.Controller 300 can further use audio converter 1340 to be converted to second sound signal through the code-switching data from what translation look-up table 1330 received.Second sound signal can then output to loudspeaker 464 by controller 300.Loudspeaker 464 can be then by using earphone or earplug or will outputing to the user through switching signal as Figure 13 displaying or discrete as previously described loudspeaker assembly.

In this regard, simple eye display equipment 100 can be used as the translater device, says that wherein first people 1300b of first language 1300a can be positioned at the position identical with wearer W, and is saying for example first language 1300a such as Japanese.In this embodiment, wearer W can be from loudspeaker 464 with different language (for example with English) and the preferred sound signal 1300a that hears in real time from foreign speaker 1300b.In another embodiment, sound signal 1300a is received by microphone 462, can be converted to digital document by A/D converter 1310, then is translated and also is stored in the storer 310 for retrieving after a while and checking.

Turn to Figure 14, in an embodiment again, can the described translation of Visual Display on the indicator screen 110 of simple eye display equipment 100.In this regard, translation can be as before taking place about the described similar fashion of Figure 13.Simple eye display equipment 100 comprises storer 310, and controller 300 can be then by using comparer 1320 that the digital document (corresponding to sound signal 1300a) that is received is compared with the translation look-up table.Controller 300 can use translation look-up table 1330 that digital document is converted to corresponding to second digital document through the translation digital document.

Then can will be stored in the storer 310 through the translation digital document.In case by controller 300 instruction, just can be with described file from storer 310 outputs, and further by converter 1440 be converted into have appropriate video/graphics form suitable digital file with display 110 display images to device 100.Be the known any acceptable form that is used for display image in this technology through the converting digital file.Show clear sight output to indicator screen 110, for example check for the beholder, as shown in figure 14 as English, German or Japanese character.

In another embodiment, can then export and further be converted to suitable digital document through the translation digital document from storer 310.This file is suitable for respectively from the video and the audio frequency of display 110 and loudspeaker 464 outputs.Therefore, the user can be acceptable through format translation and hear and see the translation of foreign language in real time.

In an embodiment more shown in Figure 15, the translation of the voice 1300a of foreign speaker 1300b can audio format but is carried out with the specific and desirable aesthetically record of being selected in advance by wearer.As above embodiment shown in Figure 13, simple eye display equipment 100 comprises microphone 462 and loudspeaker 464, and both are connected to storer 310 and controller 300 by peripheral component interface bus 305 with mode of operation as previously discussed for it.

Controller 300 has in order to from microphone 462 received audio signal 1300a and at converter 1310 suitable procedure that signal 1300a is converted to data is instructed.Then data are outputed to comparer 1330.Controller 300 further has the programmed instruction in order to control comparer 1320.Comparer 1320 will be translated look-up table 1330 from the numerical data of digital quantizer 1310 output and language and compare with described digital data conversion and translate into another kind of different language, for example from French to English.Then will be from table 1330 output to storer 310 through interpretive language through translation data corresponding to employed.Controller 300 can follow further will from language translate that look-up table 1330 receives described through the interpretive language data be converted to digital voice record 1550 through modulating audio frequency file 1550.This can use converter 1555 to create through modulation file 1550, and described converter 1555 can be and can or comprise the batch processing instruction of carrying out on another digital device of controller, software and storer at controller 4125.Converter 1555 is connected to controller 300 and storer 310 with mode of operation.

Data corresponding to second sound signal output to digital voice record converter 1555 by controller 300 from storer 310.Digital voice record converter 1555 is changed into the booking situation speech with digital audio file (it is suitable for from loudspeaker 464 emissions), and it is said through cypher text with emulation mode.In another embodiment, controller 300 can be converted to the data from comparer 1320 simply through modulation file 1550, and is not limited to any certain translation software or interpretation method.

In one embodiment, through translated speech can famous individual, famous actor's artificial voice or for example comfortable sounding speech such as movie star or professional announcer come from loudspeaker 464 outputs.In one embodiment, the speech of performer (for example well-known famous person) record can be in real time with exporting from loudspeaker 464 through translated speech from source 1300a.Storer 310 preferably includes the data that have corresponding to the audio format of speech modulation sound.Various storeies record voice configuration are possible and belong in the scope of the present invention, and this device 100 is not limited to any specific recording of voice.Should be appreciated that some recording of voice can be recorded in the storer, male sex's speech, women's speech, automatic voice maybe can use any other possible recording of voice of converter 1555 conversions.In another embodiment, device 100 can have an above recording of voice, and it can each in the default recording of voice obtain to realize accessibility after a while in storer 310.During initial start or configuration, the user can use input media or menu to select the speech of wanting.Digital-to-Voice Translator 1555 may optionally be converted to digital document one or more different artificial voices by using input media (not shown) and using display 110 to select simply.

This simple eye display equipment 100 is not limited to translation or shows translation, but can be configured to foreign voice are translated into can recognizing the text understood of language, and then writes down described translation for using in the future.Simple eye display equipment 100 can be configured to simply voiced translation be become text, and with described text entry in the storer 310 of simple eye display equipment 100.

In another embodiment, simple eye display equipment 100 also can be configured to for using with mobile phone (125b of Fig. 1) or other communicator.Simple eye display equipment 100 can comprise wireless communication interface and have transceiver (Fig. 3 327) with from mobile phone or other communicator (Fig. 1 125) but not microphone 462 receives the data that are associated with caller's speech.Herein, device 100 can will translate into from foreign caller's sound signal through the translation audio file, it can or can show at indicator screen 110 from loudspeaker 464 outputs, as shown in Figure 15.Various translations output configuration is possible and belongs in the scope of the present invention, and this simple eye display equipment 100 is not limited to any this type of face-to-face configuration.

In another example embodiment, simple eye display equipment 100 can adopt so-called computer program " software personage " or incarnation to carry out head installing type audio/visual radio communication.Incarnation is to permit carrying out the mutual two-dimensional character or the expression of model between the assembly of head installing type audio/visual Wireless Telecom Equipment and the wearer." software personage " be can form specific for to make the data of personalized set of diagrams picture of head installing type audio/visual Wireless Telecom Equipment and/or sound according to wearer interest.In one embodiment, " software personage " adopts immediately the form by the emulation personnel of wearer identification.In another embodiment, do not provide video, and " software personage " can only comprise audio element, for example read some orders or menu option with the audio frequency in the predetermined speech.By using this simulated human interface, its PDA of user's may command, mobile phone, desk-top computer or have any other remote-control device of wave point.This simulated human can be famous person, actor, actress, famous individual, notorious individual, statesman, world leader or imaginary role, cartoon, mythical personage or any other true or imaginary figure role or figure output.In addition, the software personage can receive and message playback, and forwarding telephone calls gives the alarm, and determines user's availability, distinguishes the priority of message, and carries out other automation function.

" software personage " but preferably emulation receive the control of voice command from wearer with emulation head installing type device assembly." software personage " but preferably emulation wearer is spoken with mutual with wearer.In addition, described personage or software are not permanent, and wearer can use the simple relatively automation process that can operate on described device to exchange new " software personage " with described personage easily.In another embodiment, " software personage " can be the software application that available less expense is bought, or can permit in batch and buy some " software personages ".

" software personage " can be rendered as speech, sing or with other mode emulation voice, and wearer can with display that head installing type display is associated on watch described personage, for example by watching high graphics with the form output of emulation individual or famous person's face.Preferably, " software personage " or simulated human voice and figure make the wearer happiness aesthetically, and wearer likes described mutual, and with through personalized personage or simulated human image and sound alternately with control device fast and easily.Anticipation replaces use to input or output device, head installing type display have voice identification capacity and software receive with process voice commands further providing control command to device, described control command is again in order to one or more peripheral assemblies of control head installing type device." software personage " can long-range or local storage, and software can be carried out on the processor of Local or Remote.In one embodiment, " software personage " can be rendered as imitation with famous person's speech (for example famous actor) read menus option.

Turn to Figure 16, show the synoptic diagram of the embodiment of audio/visual head installing type radio communication device 100.Audio/visual head installing type radio communication device 100 is through being shown as simple eye display equipment, but it is not limited thereto configuration, and can have different head installing type configuration (for example eyes etc.) and can be attached to secondary reading glasses or a sunglasses.Audio/visual head installing type radio communication device 100 is through being shown as general non-limiting computer configuration, but can have other configuration.In one embodiment, device 100 can have suspension rod, and it has the connector of snap-on on the part of cap or sunglasses etc.Audio/visual head installing type radio communication device 100 preferably includes supporting construction 5, and can comfortable mode be supported on around the head H of wearer W, be supported on around the E of ear of wearer W, or be supported on overcoat G (for example cap) that wearer W worn on every side.

Various monocular device supported configurations are possible and belong in the scope of the present invention, and some in these configurations are configured in the following patent application case to be described in detail: the gloomy people's such as (Jacobsen) of Jack's cloth of application on January 12nd, 2007 the 60/880th, No. 270 U.S. Provisional Patent Application case; The gloomy people's such as (Jacobsen) of Jack's cloth of application on May 14th, 2007 the 60/930th, No. 232 U.S. Provisional Patent Application case; The 60/930th, No. 275 U.S. Provisional Patent Application case of Jack's cloth gloomy (Jacobsen) of application on May 14th, 2007; And the gloomy people's such as (Jacobsen) of Jack's cloth of application on May 15th, 2007 the 60/930th, No. 242 U.S. Provisional Patent Application case.The full text of all these patent application cases all is incorporated herein by reference.

Figure 16 shows some assemblies of audio/visual head installing type radio communication device 100, and this device 100 can comprise different hardware or component software, and is not limited to any certain computer configuration, because this only shows for purpose of explanation.Audio/visual head installing type radio communication device 100 preferably includes controller 300, storer 310 (for example minimum 256 megabyte solid-state memories or more) and bus 305.Should be appreciated that, depend on the ability of device 100, storer 310 can comprise different amounts (1.5GB arrives greater than 10GB), and this depends on the complexity level of device 100.This device 100 is not limited to any particular memory tolerance, and can comprise be suitable for the look-up table function relatively than small memory, can comprise that maybe this depends on device 100 than multi-memory.In the assembly of computer equipment 100 each uses suitable lead-in wire to be connected to bus 305 with mode of operation.Audio/visual head installing type radio communication device 100 preferably also has display 110, and it is connected to bus 305 with mode of operation.Display 110 can have various configurations and can be suitable for VGA or high-resolution, high-definition television for example, or be suitable for the display of high resolution video image.Described display can be in this technology known or as the configuration of before having quoted described in any display, the full text of described configuration of before having quoted is incorporated herein by reference.Controller 300 is preferably CPU, and is connected to bus 305.Storer 310 is also connected to bus 305, and anticipation storer 310 can comprise the solid-state memory configuration and can further comprise long-range or the local hardware driver.In one embodiment, storer 310 can be enough greatly with keep supporting MP3, MP4, H.263, H.264, WAV, AAC, AIFF, apple harmless (Apple Lossless) and can listen (Audible) 2,3 and the digital document of 4 audio files and other form.

Preferably, audio/visual head installing type radio communication device 100 further comprises the audio devices 464 with Audio-Frequency Transformer, and it is connected to bus 305.Audio devices 464 can comprise Audio-Frequency Transformer element, tweeter, intermediate frequency or fundamental frequency loudspeaker or some groups of loudspeakers (THK, DOLBYDIGITAL etc.), and is suitable in ready-made mode from storer 310 emission sound and playback quality digital file, song, the tinkle of bells, stroke or other audio files.Audio devices 464 can further comprise earplug or headphone.

Audio/visual head installing type radio communication device 100 also has microphone 462, and it is connected to bus 305 with mode of operation.Microphone 462 preferably receives voice command and uses A/D converter 1310 that these data are converted to digital format.Then numerical data is sent to bus 305, and described data can be written to storer 310.Device 100 can further comprise input media 335, and for example button, wireless mouse, tracking ball, roller or keyboard are to select from some menu options.Yet input media 335 is optional, and installs 100 and preferably use voice identification order to control.

Audio/visual head installing type radio communication device 100 also comprises wave point 327, rf receiver and transmitter for example, its can use Wi-Fi,

The wireless format of (for example via Fig. 1 connection 135) or any other wireless format transmit and receive radio frequency signal numerical information be transmitted into remote-control device or network and receive numerical information from remote-control device or network.Interface 327 is suitable for 802.11b/g/n, Wi-Fi and Bluetooth 1.1,1.2,1.5,2.0 enhanced data rates and 3.0 wireless capabilities, yet interface 327 is not limited to these, and depend on the geographic position, interface 327 can comprise as other wireless format described in the following patent application case: the gloomy people's such as (Jacobsen) of Jack's cloth of application on January 12nd, 2007 the 60/880th, No. 270 U.S. Provisional Patent Application case; The gloomy people's such as (Jacobsen) of Jack's cloth of application on May 14th, 2007 the 60/930th, No. 232 U.S. Provisional Patent Application case; The gloomy people's such as (Jacobsen) of Jack's cloth of application on May 14th, 2007 the 60/930th, No. 275 U.S. Provisional Patent Application case; And the gloomy people's such as (Jacobsen) of Jack's cloth of application on May 15th, 2007 the 60/930th, No. 242 U.S. Provisional Patent Application case.

Preferably, use the voice recognition techniques (for example from the Massachusetts Burlinton

The voice recognition software) comes control audio/vision head installing type radio communication device 100.In operation, the voice command 1600 from wearer W is received by microphone 462 with analog format.Use A/D converter 1310 that simulated data is converted to numerical data.With the numerical data route by bus 305 and be stored on the storer 310 for access.Controller 300 comprises in order to this storer 310 of access and uses and is stored in the storer 310 or to be stored in storer outside or even install the programmed instruction that data that the look-up table 1610 of 100 outsides (by using wave point 327 and remote memory (for example, Fig. 1 remote-control device 125) communication) received microphone 462 are converted to control command.Control command can be through exporting with the software application of logout in storer 310 to open Email, to watch film etc.Various operation system of software are known in order to control various peripheral units, for example in this technology

MOBILE,

WINDOWS

Operating system,

APPLE

Or known any other operating system in this technology.In one embodiment, look-up table 1610 can be associated with voice recognition software program, and described software program for example is NUANCE DRAGON NATURALLY SPEAKING

Or any other suitable voice recognition software program.

Preferably, audio/visual head installing type radio communication device 100 comprises software program 1620, and it is provided to audio/visual head installing type radio communication device 100 with aesthetic desirable video and/or " audio frequency personage " or simulated human attributes.These attributes can be the form of image (for example on the display 110 shown simulated human face) or be the form of audio frequency emulation, modulation or the recording of voice of audio devices 464 emissions (for example from).This audio/visual head installing type radio communication device 100 also is not limited to simulated human appearance or simulated human speech, and software program 1620 preferably can provide other desirable stimulation to the user, for example also forms the musical recording or the desirable picture of desirable theme except " personage ".Software program 1620 also can provide " artificial personage " or theme during mutual.This provides highly individualized and desirable experience to the user, and the user likes using described audio/visual head installing type radio communication device 100.

In an embodiment of the present invention, audio/visual head installing type radio communication device 100 preferably provides the audio frequency personage and the non-video personage.In this, audio/visual head installing type radio communication device 100 comprises software program 1620, and its modulation is from the audio frequency of the device of one or more transducers (not shown) emission of audio devices 464.Preferably, audio frequency personage 1620 provides aesthetic desirable speech modulation record from audio devices 464 one or more menu options of output the time.This aesthetic desirable speech modulation record can be read some menu options to the user and use input media to select or select by the voice commands that uses the voice identification for the user.

For instance, audio/visual head installing type radio communication device 100 is exportable to be stored in record in the storer 310 to export some voice commands, for example " open Email, say Email, call out, say phone, watch video, say and watch video " etc.By using this simulated human interface, its PDA of user's may command, mobile phone, desk-top computer or have any other device (for example, the device 125 of Fig. 1) of wave point, and menu option can change according to there being which other peripheral device.All these menu options can specific prerecorded famous person's speech be exported and are no video by customization.This specific prerecorded speech or sound can have predetermined tone color, sequential and the sound of actor, actress, stress or other desirable entity (for example authoritative or pleasant speech pattern).In addition, being rendered as these records of reading some menu options can use wave point 327 and suitable computer program to install, exchange and replace with small expense by the user in an easy manner.Preferably, audio/visual head installing type radio communication device 100 can comprise the integrated chip that is used for this purpose.

In another embodiment of the present invention, audio/visual head installing type radio communication device 100 preferably provides the personage who comprises audio element and video elementary, and can comprise multimedia.In this, device 100 comprises software program 1620, and its modulation is from the audio frequency of the device of one or more transducers (not shown) emission of audio devices 464, and display image on video display 110 also.Preferably, the Voice ﹠ Video personage provides aesthetic desirable speech modulation record and video from audio devices 464 and video display 110 one or more menu options of output the time, to imitate mutual with the user of audio/visual head installing type radio communication device 100.But this aesthetic desirable speech modulating audio frequency digital recording and video emulation individual read the look and feels of some menu options to the user, and wherein the user can see and hear the video personage.This can impel the user to use video and audio frequency to imitate and described personage's voice are controlled described device for the user by the voice commands or the optional input media 335 that use the voice identification.By using this simulated human interface, the user can control its PDA, mobile phone, desk-top computer or have any other device of wave point by voice from shown personage to microphone 462 that say voice command and imitation and.

In addition, software personage 1620 can comprise in order to when with mobile phone or other communicator (for example

Peer-to-peer communications device, mobile phone, E-mail device, PDA etc. are shown in Figure 21 to 27) serve as the programmed instruction of digital assistants when being associated.In one embodiment, the user can receive call from mobile device (for example mobile phone or PDA, smart phone).Audio/visual head installing type radio communication device 100 can pick up described calling, makes described calling can use audio/visual head installing type radio communication device 100 to replace answering by picking up phone via bluetooth or the connection of similar radio frequency.In this, wearer may be busy with carrying out other function, for example verifies Email or uses finger-impu system 335 to participate in the word processing.Herein, personage's software program 1620 can provide some menu prompts to select (that is, staying message, wait etc.) for the caller under the situation of wearer absence to the caller with desirable audio or video image.In addition, prerecorded message can be rendered as roughly true to nature, and commutative or different at different callers, and the user can buy different software personages 1620 for this purpose.

In another embodiment, software personage 1620 can comprise the computational intelligence program, it allows controller 300 that formal analysis and/or statistical study from the user's input that is received are provided, and since from the video of video display 110 and/or from the form output reasoning conclusion of the audio frequency of audio devices 464.In one embodiment, " software personage " 1620 can comprise neural network or other artificial intelligence program.Suppose that storer 310 can comprise that computational intelligence program 1620 can be operated in every way so based on the restriction of the mobile character of audio/visual head installing type radio communication device 100.Program 1620 can this locality be stored on the storer 310 or be stored on the remote system (for example, the device 125 of Fig. 1), and program 1620 can be speciallyyed permit, buy, rent etc.Perhaps, program 1620 can be stored on the network, and moves on telecommunication network, and the output of wherein said network is to use wave point 327 to be sent to audio/visual head installing type radio communication device 100 with wireless mode.In addition, the computational intelligence program can be at the running background of audio/visual head installing type radio communication device 100.

Now turn to Figure 17 to 18, show an embodiment of the audio/visual head installing type radio communication device 100 with specific " personage ", described specific " personage " uses the software program 1620 that is stored in the storer 310 to originate from.In this embodiment, device 100 uses from audio devices 464 outputs and the audio frequency supported by the shell 5 of device 100 to come and user interactions.Herein, but the particular software application 1620 in controller 300 execute stores 310, and software program 1620 can comprise the digital audio file of emulation to wearer W read menus option selection 1705.Yet software program 1620 can comprise programmed instruction, makes to make desirable booking situation voice of wearer W or individualized tone 1705 read described audio frequency aesthetically.

In one embodiment, booking situation voice 1705 are emulation voice of famous person or famous individual's speech (for example performer (Silvester Shi Tailong (SYLVESTER STALLONE)), cartoon character, portrait, imaginary or true role or historical personage (for example former US President) etc.).In a non-limiting example, voice 1705 can be read options menu 1705 and select by use input media 335 or by the appropriate voice command that reception microphone 462 is received for the user.Preferably, " the software personage " 1620 who is stored in the storer 310 will comprise one or more digital documents, and it supports MP3 or WAV or another form.Audio file preferably is associated with famous individual's speech.With the 300 selected appropriate time intervals of controller from audio devices 464 emission records.For instance, famous individual software, role or incarnation can the recording of voice launching simulation voice of wanting, it comprises " selecting: open email application, say ' Email ', listen to the music, say ' music ', see a film, say ' film ' " or the like from the following option.Envision other menu option, and this does not form restriction to the present invention.

Now turn to Figure 18, show separate with display 110 for purpose of explanation and another example of " the software personage " that show with zoomed-in view.In this embodiment, audio/visual head installing type radio communication device 100 also uses and utilizes high graphics to show and come and user interactions at the video that the shell 5 of audio/visual head installing type radio communication device 100 shows from video display 110.Herein, but the software program 1620 in controller 300 run memories 310, and software program 1620 can comprise the data file that is associated with video.Video 110 shows the simulated human image 1815 of presenting to wearer W, described simulated human image 1815 is gone up output at display (zoomed-in view of wherein showing display 110), and in the peripheral vision of wearer and do not hinder wearer normally watch the space.

Software program 1620 comprises programmed instruction, makes shown video image be desirable aesthetically individualized famous person role's form.Role 1815 exports to wearer with graphic form.In one embodiment, predetermined image is the emulation face by regioselective famous person of wearer or famous individual's portrait (for example known any other true or imaginary individual or cartoon in actor or actress (for example Norma Jean Remix (MARILYN MONROE)) or this technology).Should be appreciated that, can use countless different performers or portrait.Certain actor, actress or famous individual are that warp individualizes arbitrarily and according to wearer W, and described image can be the desirable aesthetically image of any emulation, and it impels with wearer and carries out simulation interactive.In another embodiment, can use a plurality of performers or portrait according to particular task.

In a non-limiting example, shown video and graphic can further comprise instruction 1820, some options menus 1825 and cursor 1730.The user can click or select by the appropriate voice command that reception microphone 462 is received by using input media 335 (for example, wireless mouse).Preferably, show famous individual portrait 1815 with the 300 selected appropriate time intervals of controller.For instance, famous individual 1815 can show face or its part or whole simulation personnel.Together with individual's's 1815 (for example performer, famous person or famous/notorious personnel, cartoon or portraits) portrait, but videotex instruction 1820 " selecting from the following option " replace described image to come emulation to read described instruction.Also envision other instruction.This allowance impels the user to use input media 335 (for example wireless mouse) to select control command.Also can show control icon or hyperlink, it comprises " turning on email application ", " seeing TV " and " acquisition Weather information " etc.In another embodiment, audio/visual head installing type radio communication device 100 can comprise the video and the audio attribute of " artificial figure ", and artificial figure 1815 can be rendered as and reads described option to wearer and replace showing described option one 825.Preferably, personage 1815 can be the part of automated system, and its any other of paying close attention to notice, alarm, warning or wearer is indicated and pointed out the user.

Preferably, personage 1815 can to allow wearer be that it is own and stay speech information for playback after a while.In addition, incarnation 1815 can stay the prerecorded message at extraneous caller, and the system scope message of separating with computing machine maybe can be provided.Preferably, audio/visual head installing type radio communication device 100 will be provided to remote computing device or mobile phone to be linked to remote-control device in depositing synchronizing signal when needed.Preferably, during hanging up, the caller can receive interesting video messaging.Preferably, video messaging can be short commerce or animation montage, and can buy and sell from publisher or similar third party by move mode.In another embodiment, video messaging can comprise the advertisement or promotion that the third party initiates, and the payable expense of advertiser comes to show its advertisement during the caller hangs up mobile device or smart phone.Herein, can be during hanging up optionally with a certain cost by advertisement third party playing advertisements.Perhaps, incarnation 1815 can receive input information to pass to the individual who is associated with audio/visual head installing type radio communication device 100 from the caller.

Now turn to Figure 19, show another embodiment of this device 100.In this embodiment, audio/visual head installing type radio communication device 100 can preferably be communicated by letter so that obtain different " software personage " 1620a, 1620b, 1620c etc. with remote computing device 1900.In addition, audio/visual head installing type radio communication device 100 can with second device, network, the Internet or internal network or public arena network service.Wearer can provide control signal radiofrequency signal 1950a is transmitted into second wave point 1945 or the Internet to the wave point 1945 of audio/visual head installing type radio communication device 100.Control signal 1950a, 1950b are suitable for creating between audio/visual head installing type radio communication device 100 and another second device 1900 or lead to the bidirectional communication link of the Internet.Wearer uses one group of menucommand can be from the Internet or obtain second individualized " software personage " 1620b from remote computing device 1900 (for example server or have other calculation element of storer 1910).Wearer can be selected incarnation or two dimensional image from some options, or imports famous individual's name simply or select the audio frequency personage from some options.Wearer can use character 1815 to control wave point 1945 to be written to storer 310 from the wireless radio-frequency link 1950b received RF signal and the software program 1920b that will be derived from remote memory 1910.

In this way, wearer uses input media or voice identification can select new two dimension " personage " or incarnation 1620b mutual to be used for, and it is different from first " software personage " program 1620a.Second " software personage " 1620b can be stored and first " software personage " 1620a can be wiped.Equally, with payable expense of giving the third party subscriber, available the 3rd " software personage "

program

1620b, 1620c waits the second personage's program of replacing.Should be appreciated that some incarnation 1815 (it is desirable and depends on popularity) may be than other incarnation costliness.

In an embodiment again, storer 310 can comprise a plurality of hybrid " software personage " two-dimentional incarnation program, for example first performer's image, 1815, second different famous person's speeches and form the 3rd cartoon or the animated graphics of health.In this embodiment, by using wave point 327, the user can use input media 335 to control controller 330 provides steering order so that the program be associated with a plurality of or hybrid " software personages " to be installed, described " software personage " be different from install or first " software personage " program 1620a.Preferably, wave point 327 with high data rate communication so that in the mobile wireless environment, receive big video file and audio file with wireless mode.

Turn to Figure 20, show another embodiment of the present invention.In this embodiment, audio/visual head installing type radio communication device 100 can be used as the platform that is used for buying and selling the extra software programs that is associated with second " software personage " 1620b, and described second " software personage " 1620b is used for carrying out user interactions with audio/visual head installing type radio communication device 100.In this embodiment, audio/visual head installing type radio communication device 100 is configured to coming with new " software personage " 1620b exchange, replace or augment " software personage " program 1620a with a certain expense in the commercial electronic business transaction.Audio/visual head installing type radio communication device 100 can be preferably along link 1950a and remote computing device (not shown) or Internet traffic so that obtain different or second " software personage " 1620b.The second personage 1620b can be associated with digital document, and described digital document can use radio modem, wired or wireless interface to transmit and receive and maybe can be stored on the recordable media (for example Zip disk maybe can load and unload flash memory).

Wearer can be chosen in audio/visual head installing type radio communication device 100 associated operating system on the icon that moves, or otherwise control signal is provided to wave point 327 to obtain the second software program 1620b.Wearer uses input media 335 also can import the data that are associated with payment information, and described data can be delivered to payment provider 2005 in road 2007 encrypted and along the line.Controller 300 then will be controlled wave point 327 radiofrequency signal 1950a is transmitted into second wave point (not shown) or the Internet second software program 1620b that wanted to obtain to be associated with second " software personage ".Be suitable for creating between audio/visual head installing type radio communication device 100 and another second device (not shown) or lead to the bidirectional communication link of the Internet along the control signal of path 1950a.The data that are associated with payment information can be routed to payment provider 2005 with validation of payment by the Internet.In case 2009 couples of suppliers 2005 in road along the line have verified payment, just along link 1950a software program 1620b is delivered to the storer 310 of audio/visual head installing type radio communication device 100 from software provider 2011 with allowance to software provider 2011 transmission information.Envision this equipment 100 and comprise equity transaction and peer-to-peer communications network, for example Deng.Audio/visual head installing type radio communication device 100 can be configured to use wave point 327 and payment provider or service (PAY for example

Remote bank business, electronic banking account) buy, sell two-dimentional incarnation or exchange two-dimentional incarnation with another monocular device.

Now turn to Figure 21, show another embodiment of the present invention.Herein, the wave point of communicator 100 (for example, the interface 327 of Figure 18) is by Bluetooth communication protocol (bluetooth 137 via link 135 of Fig. 1) and the link of for example cellular phone remote communication devices (for example, the device 125 of Fig. 1) such as (not shown).Wearer W can use head installing type audio/visual radio communication device 100 to call out or receive from the calling that is positioned at a distance of the individual 2102 of use smart phone 2105, PDA or the mobile phone of certain segment distance or other calculation element.Preferably, in this embodiment, personage 1815 serves as the assistant and serves as intermediary between wearer W and the caller.

Personage 1815 preferably includes in order to answer the programmed instruction of call; Yet, because that wearer W is not in this example embodiment is free, so incarnation 1815 can be showed as the reference number on the amplifying display 2110 of smart phone 2,105 2115 to the some options of caller 2102 supply as intermediary.Incarnation 1815 can provide: the caller is hung on; (ii) work as the caller and play short-sighted frequency to the caller first-class the biding one's time of caller's device; (iii) request call person stays message; Or (iv) may make different definite.Preferably, equipment 100 comprises in order to carry out the computational intelligence of these tasks.

In addition, incarnation 1815 can be collected data and be comprised that one or more have the prerecord greeting about wearer W or caller's particular data.By using caller's recognition data, incarnation 1815 can be rendered as imitates the understanding caller, and the name of particular caller and the time that has passed since call caller's last time can be inserted in the pre-recorded message.For instance, incarnation 1815 can be at first following in response to the caller: " you are good for the Bob, since you made a phone call last time 4 days again 3 week ", and after this can state " I look at whether the take over party is free ".If it is free, incarnation 1815 will be imitated call, Email or instant message will be switched to wearer W so, if and wearer W is not free, incarnation 1815 can respond in a certain inquiry so, and for example " is this calling urgent? please answer and be or not." or, incarnation 1815 can be implored the input from caller's mobile device keypad.

Now turn to Figure 21, incarnation 1815 can be supplied some options 2120 to the caller.Option 2120 can comprise: (i) send SMS message to wearer W and have time determining whether; (ii) the calling that sends described caller to wearer W is urgent message; (iii) send the not urgent message of described calling to wearer W; Or some answer communications option (iv) are provided, make wearer W to wire back to the caller.Also envision other option 2120.

For instance, wearer W can be to communicator 100 input informations, wherein permit some call through immediately and disapprove other call through but change message or the video/audio/text message of reception from incarnation 1815 into, see below shown in Figure 22.Incarnation 1815 also can point out caller 2102 to watch video messaging or advertisement/commercial movie for caller 2108 or for the financial gain of wearer during hanging up on smart phone 2105.Incarnation 1815 can further receive about can be where by Email, to reach caller's contact details (seeing below Figure 27 shows) or described calling by phone and telephone number or e-mail address be urgent and can not be held the input information of hang-up.

In addition, incarnation 1815 can be in response to incoming call, affirmation and caller's agreement, or propose other call time, or whether free inform simply.Shown on the display 2110 of smart phone 2105, incarnation 1815 can receive the input that interrupts wearer W from the caller, and in this non-limiting example, incarnation 1815 can be instructed the caller to dial 1 and be interrupted, shown in reference number 2220.Also envision other order.

When incarnation 1815 sets about interrupting take over party W when (as shown in figure 23), incarnation 1815 can be for caller 2102 on the display 2110 of smart phone 2105 display ads 2322 or short film 2322.This can be interesting advertisement 2322, and it is individualized by wearer W.In addition, wearer W can obtain the payment (by third party promoter or advertiser) show from described third-party this series advertisements 2322.Perhaps, wearer W can download song, film editing or other message of liking.The configuration of various medium is possible and belongs in the scope of the present invention.

Now turn to Figure 24, because device 100 is multi-functional, so wearer W can use input media (for example keyboard (not shown)) to use word processing program application program 2423 to prepare letter, described application program 2423 goes up operation and demonstration on video display 110 at teleprocessing unit (not shown).As understanding, when wearer W was operating business software application program (for example word processor 2423, electrical form etc.), incarnation 1815 was minimized and is not demonstrated.Perhaps, device 100 can be closed.

Now turn to Figure 25, if urgent, incarnation 1815 will be pointed out wearer W, and " this calling is urgent, you want to answer described calling? "Can present some options 2525 to determine wearer W wants how to dispose incoming call to wearer W.These options can comprise that wearer W needs (1) answer that described calling is not answered in described calling, (2), (3) provide pre-recorded message and (4) to ignore the indication of described calling to the caller.

Turn to Figure 26, if wearer W does not want to answer the call, wearer W can import voice commands to incarnation 1815 so, and incarnation 1815 can then " please be quoted your number, because the take over party can not arrive by saying now." the next contact details that obtain the caller with the voice identification.Preferably, incarnation 1815 also can comprise the voice identification capacity, wherein audio/visual head installing type radio communication device 1000 can use verbal identification to receive telephone number information about caller's device, and will offer wearer W about caller's data.

Once more, during the stand-by period, incarnation 1815 can be play the second desirable audio or video file for the caller, and it is interesting or joyful.In an embodiment again, incarnation 1815 can exchange at some caller or at the different phase of the process of hang-up.Incarnation 1815 also can provide during latent period shown in Figure 23 alternately, data, program, recreation or other similar computer program.

As shown in figure 27, show Calls person 2102 contact details 2730 on video display 110, and wearer W after a while operative installations 100 call out the caller.Various other incarnation 1815 auxiliary configurations are possible and belong in the scope of the present invention, and previous mentioned configuration is used to illustrate an embodiment.

Although showed clearly referring to example embodiment of the present invention and described the present invention, but those skilled in the art will appreciate that, can under the situation that does not break away from the scope of the invention that appended claims contains, make the change on various forms and the details therein.

Claims

1. equipment is characterized in that it comprises:

Storer;

The portable minisize display, it is configured to show content of multimedia;

Wave point, it is configured to set up the wireless connections between described device and at least one the main frame calculation element, described wave point is configured to and will the request that become available at the host display interface content of multimedia be transmitted into described at least one main frame calculation element, and in response to described to content of multimedia request and from described at least one main frame calculation element receiving multimedia content;

Loudspeaker;

Microphone, it is configured to receive the sound signal that comprises voice;

Converter, it is configured to described sound signal is converted to first numeral of described sound signal; And

Controller, it is configured to the described numeral of described sound signal is compared with the look-up table that is stored in the described storer, based on described comparison described first numeral of described sound signal is converted to control output, and the assembly that described control is outputed to described equipment with realize with described equipment, described at least one main frame calculation element and external device (ED) at least one alternately.

2. equipment according to claim 1, it is characterized in that wherein said control output is second numeral of described sound signal, it comprises the language translation of voice included in the represented described sound signal of described first numeral to second language, and described controller further is configured to described second numeral of described sound signal is converted to the speech audio signal modulation that comprises the voice that are described second language.

3. equipment according to claim 2, the prerecord speech in it is characterized in that wherein said speech audio signal modulation and being stored in described storer is associated.

4. equipment according to claim 3, the described prerecord speech that it is characterized in that wherein being stored in the described storer is associated with famous person's speech.

5. equipment according to claim 2 is characterized in that wherein said controller further is configured to roughly carry out immediately described translation so that roughly real-time language translation to be provided after described microphone receives described sound signal.

6. equipment according to claim 2, it is characterized in that wherein said controller further is configured to described second numeral of described sound signal is converted to text, and synchronously described text is shown on the described display as content of multimedia with the described speech audio signal modulation that comprises the voice that are described second language.

7. equipment according to claim 1, it is characterized in that wherein said control is output as at least one the control command in the described assembly that makes it possible to control described equipment, described at least one main frame calculation element and the external device (ED), described controller is configured to further that to be used for vision and the mutual form of audio frequency mode steering order being provided to described display, described microphone and described loudspeaker, described form is associated with incarnation in response to described input voice command.

8. equipment according to claim 7 is characterized in that wherein said incarnation is configured to simulated human attributes is provided to described equipment, and described simulated human attributes comprises visual pattern element shown on the described display.

9. equipment according to claim 8 is characterized in that wherein said incarnation further is included in the audio element of playing on the described loudspeaker.

10. equipment according to claim 9 is characterized in that wherein said audio element comprises the human speech of record.

11. equipment according to claim 10 is characterized in that the speech of wherein said record comprises famous person's speech.

12. equipment according to claim 8 is characterized in that wherein said incarnation comprises content of multimedia.

13. equipment according to claim 7 is characterized in that wherein said incarnation further is configured to recognize voice and in response to user speech, in the voice included in the call at least one of importing into of described host apparatus or another device.

14. equipment according to claim 7 is characterized in that wherein said incarnation further is configured to the menu that explicit user can be selected option.

15. equipment according to claim 7 is characterized in that wherein said wave point further is configured to communicate by letter with at least one remote-control device and comprises the software application of at least one different incarnation with reception.

16. equipment according to claim 15 is characterized in that wherein said at least one different incarnation are in return to receive with a certain expense.

17. equipment according to claim 7 is characterized in that wherein said incarnation comprises the vision that is associated with the regioselective known famous person of identification of wearer and can listen element.

18. equipment according to claim 7 is characterized in that wherein said wave point further is configured to remote access and is used at least one mutual programmed instruction with wearer, the remote-control device that is associated with described wearer or the remote-control device that is not associated with described wearer.

19. equipment according to claim 18 is characterized in that wherein said programmed instruction comprises the instruction of the remote-control device that is used for that voice command is provided to described wearer or is associated with individual except described wearer or entity.

20. one kind with equipment, at least one main frame calculation element or external device (ED) at least one mutual method, it is characterized in that described method comprises:

Set up the wave point at described device place and the wireless connections between at least one main frame calculation element;

To be transmitted into described at least one main frame calculation element to the request that becomes available at the host display interface content of multimedia;

In response to described to content of multimedia request and from described at least one main frame calculation element receiving multimedia content;

Reception comprises the sound signal of voice;

Described sound signal is converted to first numeral of described sound signal;

The described numeral of described sound signal is compared with the look-up table that is stored in the storer;

Based on described comparison described first numeral of described sound signal is converted to control output; And

The assembly that described control is outputed to described equipment with realize with described equipment, described at least one main frame calculation element and external device (ED) at least one mutual.

21. method according to claim 20, it is characterized in that wherein said control output is second numeral of described audio frequency, it comprises the language translation of voice included in the represented described sound signal of described first numeral to second language, and described method further comprises:

Described second numeral of described sound signal is converted to the speech audio signal modulation that comprises the voice that are described second language; And

Play the described speech audio signal modulation that comprises the voice that are described second language at the loudspeaker place.

22. method according to claim 21, the prerecord speech in it is characterized in that wherein said speech audio signal modulation and being stored in described storer is associated.

23. method according to claim 22, the described prerecord speech that it is characterized in that wherein being stored in the described storer is associated with famous person's speech.

24. method according to claim 21 is characterized in that it further is included in to receive roughly to carry out described translation immediately after the described sound signal, and then roughly real-time language translation is provided.

25. method according to claim 21 is characterized in that it further comprises:

Described second numeral of described sound signal is converted to text; And

Synchronously described text is shown in as content of multimedia with the described speech audio signal modulation that comprises the voice that are described second language and is configured to show on the portable minisize display of content of multimedia.

26. method according to claim 20, it is characterized in that wherein said control is output as at least one the control command in the described assembly that makes it possible to control described equipment, described at least one main frame calculation element and the external device (ED), described method further comprises in response to the described voice command that receives mutual with vision and audio frequency mode with the form that is associated with incarnation.

27. method according to claim 26, it is characterized in that wherein further comprising alternately with vision and audio frequency mode with the described form that is associated with described incarnation in response to the described voice command that receives simulated human attributes is provided to described equipment, described simulated human attributes comprises visual pattern element shown on the described display.

28. method according to claim 27 is characterized in that wherein alternately further being included in loudspeaker on audio plays element with the described form that is associated with described incarnation with vision and audio frequency mode in response to the described voice command that receives.

29. method according to claim 28 is characterized in that wherein said audio element comprises the human speech of record.

30. method according to claim 29, the speech that it is characterized in that wherein said record are famous person's speeches.

31. method according to claim 27 is characterized in that wherein said incarnation comprises content of multimedia.

32. method according to claim 26 is characterized in that wherein in response to the described voice command that receives further to comprise the identification voice with the described described form that is associated alternately with vision and audio frequency mode and in response to user speech, in the voice included in the call at least one of importing into of described host apparatus or another device.

33. method according to claim 26 is characterized in that wherein further comprising that with vision and audio frequency mode explicit user can select the menu of option with the described form that is associated with described incarnation alternately in response to the described voice command that receives.

34. method according to claim 26 is characterized in that it further comprises to communicate by letter with at least one remote-control device and comprises the software application of at least one different incarnation with reception.

35. method according to claim 34 is characterized in that it further comprises defrayment to exchange described at least one different incarnation.

36. method according to claim 26 is characterized in that it further comprises the vision that is associated with the known famous person of identification at described incarnation selection and can listen element.

37. method according to claim 26 is characterized in that it further comprises remote access and is used at least one mutual programmed instruction with wearer, the remote-control device that is associated with described wearer or the remote-control device that is not associated with described wearer.

38., it is characterized in that wherein said programmed instruction comprises the instruction of the remote-control device that is used for that voice command is provided to described wearer or is associated with individual except described wearer or entity according to the described method of claim 37.

39. a system that is used for content of multimedia is offered the user is characterized in that described system comprises:

At least one main frame calculation element, it comprises the host display interface and first wave point, described first wave point is configured to set up the wireless connections between described at least one main frame calculation element and the external device (ED), described at least one main frame calculation element is configured to be provided at the content of multimedia that the described host display interface of described at least one main frame calculation element becomes available to described external device (ED), and described first wave point further be configured to from described external device (ED) receive to the request of content of multimedia and in response to described to content of multimedia request and content of multimedia is transmitted into described external device (ED); And

Equipment, it comprises: the portable minisize display, it is configured to show content of multimedia; Second wave point, it is configured to set up the wireless connections between described device and at least one the main frame calculation element, described second wave point further is configured to the described request that described host display interface at described at least one main frame calculation element is become available content of multimedia is transmitted into described at least one main frame calculation element, and in response to described to content of multimedia request and from described at least one main frame calculation element receiving multimedia content; Loudspeaker; Microphone, it is configured to receive the sound signal that comprises voice; Converter, it is configured to described sound signal is converted to first numeral of described sound signal; And controller, it is configured to the described numeral of described sound signal is compared with the look-up table that is stored in the storer, based on described comparison described first numeral of described sound signal is converted to control output, and the assembly that described control is outputed to described equipment with realize with described equipment, described at least one main frame calculation element and external device (ED) at least one alternately.

40. a computer-readable media is characterized in that it contains when being carried out by computing machine to cause described computing machine to carry out the computer-readable instruction of following operation:

Set up wireless connections with at least one main frame calculation element;

The sound signal that comprises voice that is received is converted to first numeral of described sound signal;

With described control output to described storer with realize with described computing machine, at least one main frame calculation element and external device (ED) at least one mutual.