TW201228332A - Mobile electronic device - Google Patents
Mobile electronic device Download PDFInfo
- Publication number
- TW201228332A TW201228332A TW99144676A TW99144676A TW201228332A TW 201228332 A TW201228332 A TW 201228332A TW 99144676 A TW99144676 A TW 99144676A TW 99144676 A TW99144676 A TW 99144676A TW 201228332 A TW201228332 A TW 201228332A
- Authority
- TW
- Taiwan
- Prior art keywords
- camera
- electronic device
- microphone
- mobile electronic
- smart mobile
- Prior art date
Links
- 238000004891 communication Methods 0.000 claims abstract description 20
- 238000005259 measurement Methods 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims description 27
- 210000000988 bone and bone Anatomy 0.000 claims description 25
- 230000006870 function Effects 0.000 claims description 24
- 230000009471 action Effects 0.000 claims description 23
- 238000000034 method Methods 0.000 claims description 18
- 239000000463 material Substances 0.000 claims description 13
- 230000003190 augmentative effect Effects 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 8
- 238000012937 correction Methods 0.000 claims description 6
- 230000008901 benefit Effects 0.000 claims description 5
- 230000003993 interaction Effects 0.000 claims description 5
- 238000013519 translation Methods 0.000 claims description 5
- 241000209140 Triticum Species 0.000 claims description 2
- 235000021307 Triticum Nutrition 0.000 claims description 2
- 230000000694 effects Effects 0.000 claims description 2
- 241000239290 Araneae Species 0.000 claims 1
- 230000008713 feedback mechanism Effects 0.000 claims 1
- 210000000232 gallbladder Anatomy 0.000 claims 1
- 230000002452 interceptive effect Effects 0.000 claims 1
- 210000003811 finger Anatomy 0.000 description 32
- 238000005516 engineering process Methods 0.000 description 9
- 230000007613 environmental effect Effects 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000009977 dual effect Effects 0.000 description 4
- 238000010295 mobile communication Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 210000004556 brain Anatomy 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 239000004744 fabric Substances 0.000 description 3
- 230000007774 longterm Effects 0.000 description 3
- 244000241257 Cucumis melo Species 0.000 description 2
- 235000015510 Cucumis melo subsp melo Nutrition 0.000 description 2
- 240000008620 Fagopyrum esculentum Species 0.000 description 2
- 235000009419 Fagopyrum esculentum Nutrition 0.000 description 2
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 2
- 241000282320 Panthera leo Species 0.000 description 2
- FJJCIZWZNKZHII-UHFFFAOYSA-N [4,6-bis(cyanoamino)-1,3,5-triazin-2-yl]cyanamide Chemical compound N#CNC1=NC(NC#N)=NC(NC#N)=N1 FJJCIZWZNKZHII-UHFFFAOYSA-N 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 230000003416 augmentation Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000005057 finger movement Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 210000003813 thumb Anatomy 0.000 description 2
- 244000025254 Cannabis sativa Species 0.000 description 1
- 206010011469 Crying Diseases 0.000 description 1
- 208000001613 Gambling Diseases 0.000 description 1
- WQZGKKKJIJFFOK-GASJEMHNSA-N Glucose Natural products OC[C@H]1OC(O)[C@H](O)[C@@H](O)[C@@H]1O WQZGKKKJIJFFOK-GASJEMHNSA-N 0.000 description 1
- 206010021703 Indifference Diseases 0.000 description 1
- 240000008042 Zea mays Species 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 238000007664 blowing Methods 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 210000000078 claw Anatomy 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 230000001351 cycling effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 235000013305 food Nutrition 0.000 description 1
- 210000005224 forefinger Anatomy 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 239000008103 glucose Substances 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 229910052742 iron Inorganic materials 0.000 description 1
- JEIPFZHSYJVQDO-UHFFFAOYSA-N iron(III) oxide Inorganic materials O=[Fe]O[Fe]=O JEIPFZHSYJVQDO-UHFFFAOYSA-N 0.000 description 1
- YOBAEOGBNPPUQV-UHFFFAOYSA-N iron;trihydrate Chemical compound O.O.O.[Fe].[Fe] YOBAEOGBNPPUQV-UHFFFAOYSA-N 0.000 description 1
- 210000004932 little finger Anatomy 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 208000001491 myopia Diseases 0.000 description 1
- 230000004379 myopia Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 208000011580 syndromic disease Diseases 0.000 description 1
- 230000035922 thirst Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
Description
201228332 cameras can conduct stereo recognition, measurement and capture of stereo image. Cloud, computing service is to support the smart phone for conducting real-time recording, searching, computing, and then giving back through the smart phone with the resulted answer to the user. 四、 指定代表圖: (一) 本案指定代表圖為:圖二 (二) 本代表圖之元件符號簡單說明: Φ 10行動電子裝置 101行動電子裝置上部 102行動電子裝置下部 11·微投影機 121,122,123.攝影機 131,132,133 麥克風 14·擴音器 • is·觸控螢幕 16.樞軸 五、 本案若有化學式時,請揭示最能顯示發明特徵的化學式: 六、發明說明: 【發明所屬之技術領域】 本發明為一種智慧型行動電子裝置’特別是指一具有 可上網的行動電話本體、並包含一微型投影機、至少三個攝 201228332 提供可攜帶的運算裝置以 影機、複數個麥克風、雲端運算, 及對人機介面提供更自然的方法。 【先前技術】 =好機的f及率不斷提高,聊軸提供了 =的顯不器,但大尺寸的外型還是讓許多講究時尚的1益法 接Γ何時歧驗巧㈣口敎能_大畫_新玩意兒201228332 cameras can conduct stereo recognition, measurement and capture of stereo image. Cloud, computing service is to support the smart phone for conducting real-time recording, searching, computing, and then giving back through the smart phone with the resulting answer to the user 4. Designation of representative drawings: (1) The representative representative of the case is as follows: Figure 2 (2) The symbol of the symbol of the representative figure is briefly described: Φ 10 mobile electronic device 101 mobile electronic device upper 102 mobile electronic device lower 11 · micro projector 121, 122, 123. Camera 131, 132, 133 Microphone 14 · Loudspeaker • is · Touch screen 16. Pivot 5. If there is a chemical formula in this case, please disclose the chemical formula that best shows the characteristics of the invention: 6. Invention Description: TECHNICAL FIELD The present invention relates to a smart mobile electronic device, in particular to a mobile phone body having an Internet access, and comprising a pico projector, at least three cameras 201228332 providing portable computing devices for video cameras, and a plurality of Microphone, cloud computing, and more for the human interface The method. [Prior technology] = the f-rate of the good machine is constantly improving, and the chat axis provides the display of the =, but the large size of the appearance still makes many fashion-conscious 1 Yifa methods when the difference is good (4) Painting_new gadgets
尼.二摺_軟性顯轉已是多年來期盼實現的技術,但是 仍有許多技術等待克服。 使用者需要比鍵盤、顯示器更好用的,能與各種行動裝 置互動的介面。縣細aekberry)提供的是—種「全大拇 指輸入」料.·發好郵件方f,洲咖職棄了迷你鍵 盤:端出觸控螢幕一但螢幕仍然太小,多晝面的觀賞讓人 眼目月感覺吃力。而包括3卿ties等廠商,則是在手機裡嵌 入加速度計,可讓使用者藉由傾斜裝置來啟㈣些功能…不 過14種方式辦讓人彳ϋ有更乡誤齡的產生。因此需要 對上述可攜帶的運算裝置以及人機介面提供更自然的方法, 例如投影晝面、擴增實境與語音控制介面(VQice interfaces) 等’也許可以解決以上問題。 【發明内容】 本發明在於提供一種任何人可以隨身攜帶的智慧型行動 電子I置(smart mobile electronic device),具有投射式 201228332 2的功ι ’在人付及之處,可投射於隨射取得的平面 或曲面顯現太絲;^ ^ , 立辨.例如至少24十藉由語音命令聯網與語 ’❹手指點選投射螢幕的選項鍵,攝影機擷取 地=:來’_者可以_ ;五〜:貝;:’、看電影、玩遊戲’與不同國家的人各自使用母 =吹,進行遠端視訊會議,進行股市看盤,電子商務、分Ni. Two folds - soft turnaround has been a technology that has been expected for many years, but there are still many technologies waiting to be overcome. Users need interfaces that are better than keyboards and monitors and that interact with various mobile devices. The county aekberry) provides a kind of "full thumb input" material. · Send a good mail party f, the state cafes abandoned the mini keyboard: the touch screen is one, but the screen is still too small, the multi-faceted viewing let The eyes of the people are struggling. Including the 3 ties and other manufacturers, the accelerometer is embedded in the mobile phone, which allows the user to activate (four) functions by tilting the device... However, 14 ways to make people have more generations. Therefore, it is necessary to provide a more natural method for the above-mentioned portable computing device and human-machine interface, such as projection surface, augmented reality and voice control interface (VQice interfaces), etc., which may solve the above problem. SUMMARY OF THE INVENTION The present invention is directed to a smart mobile electronic device that can be carried by anyone, and has the function of projecting 201228332 2, which can be projected by a person. The plane or surface appears to be too silky; ^ ^, stand-up. For example, at least 24 by the voice command networking and the language '❹ finger point to select the projection screen option button, the camera captures the ground =: to '_ can _; five ~: Bei;: ', watching movies, playing games' with people from different countries using the mother = blowing, conducting far-end video conferencing, stock market reading, e-commerce, points
接片、甚至隨時進行採訪報導。例如讓各種cps裝置都能 透過友善的語音識別介面,來回應駕駛人對地址、交通狀況 或是行進方向等方面的問題。 本發明在於提供—種每個人可以擁有的―台智,慧型行動 電子裝置,其魏絲,使岐也許財需㈣腦、不需要 手機、不需要投職m照相機、不需要攝影機、不需 要伴唱機(Kara-⑹、不需好„、不f要w、不需要遊 戲機、不需要電子書、不需要Gps導航、不需要敝、不需 要電視,只需要隨身多準備幾個_電池即可,既㈣又: 便。出外旅遊,隨時隨地’只要攜帶一台本發明的智慧型行 動電子裝置,有電源處只要_非接觸式充電裝置或插電裝 置供電,或無電源處’彻_電池,即可達成遠距軌運 算與娛樂等用途。其優點例如,隨時隨地可以透過網路以投 影大螢幕收看電視節目’家人不需要為了收看不同節目而爭 奪電視;有了本發明的智慧型行動電子裝置,所有人都可I 解放、個人化、個性化、有自己㈣訊空間與自由、擁有更 4 201228332 多隱私權。 本I月在於提供_台智慧型行動電子裝置具有連上固網 的力此不必透過無線基地台,造成跨國跨區的昂貴通訊費 用。也就是本發明的行動電子裝置配備-般桌上型或筆記型 電腦的有線網路插孔,例如乙太網路,可以透過_來連上 網際網路。Pick up the film and even report it at any time. For example, various cps devices can respond to drivers' questions about addresses, traffic conditions, or directions of travel through a friendly voice recognition interface. The invention provides a "Taizhi, Hui-type mobile electronic device" that everyone can possess, and Weisi, which may be a financial need (four) brain, does not need a mobile phone, does not need to invest in a m camera, does not need a camera, does not need A phonograph (Kara-(6), no need for „, no f, no need for a game console, no e-book, no GPS navigation, no need for a cymbal, no need for a TV, just need to prepare a few more _ batteries Yes, both (4) and: OK. Traveling abroad, anytime, anywhere, as long as you carry a smart mobile electronic device of the present invention, there is a power supply as long as the _ non-contact charging device or the plug-in device is powered, or there is no power supply. It can achieve long-distance orbital computing and entertainment, etc. Its advantages are, for example, the ability to watch TV programs on the big screen through the Internet anytime and anywhere. 'Family does not need to compete for TV to watch different programs; with the smart action of the present invention Electronic devices, everyone can liberate, personalize, personalize, have their own (four) information space and freedom, have more 4 201228332 multiple privacy rights. This I month is to provide _ Taiwan smart The mobile electronic device has the power to connect to the fixed network, so that it does not have to pass through the wireless base station, resulting in expensive communication costs across the transregion. That is, the mobile electronic device of the present invention is equipped with a wired network jack of a desktop or notebook computer. For example, Ethernet can connect to the Internet via _.
本發明在於提供一台智慧型行動電子裝置給小孩子或 老人使他們不會走失,只要到達設定位置(必要時可拍攝 田時週的照>{,透職增實境賴識所在地,以彌補 =的定位精度)即可回報,利用速度訊息,可判斷是走路, 遇疋私車,若是偏離設定路徑,即可進人監控狀況,以免走 ^利用這個方法,學童攜帶一台智慧型行動電子聚置到學 枚,其女全性可以大為提升,校園安全可以由家長完全掌 握,大幅減輕學校的負擔。 【實施方式】 如圖-所示,上述的智慧型行動電子裝置,包含一具有 可上網的行動電話本體卜—微紐影機2、至少三個攝影機 3、至少-個無線麥克風/耳機4、雲端運算5,上網較佳是使 用3G以上⑽,Long Term Ev〇luti〇n技術)具有高速與多 媒體之傳送能力,該微型投韻可以投射至少二維與3維的 影像,並搭配其中-台攝職,對投像進行回饋控制,、 201228332 至少-個無線麥克風可具有語音辨識的功能,至少—個耳機 可用來產生立體聲,其中兩個攝影機可用於立體辨識與量測 以及拍攝立體影像,雲端運算可用來將行動電子裝置無法儲 存搜尋或運算的·與工作加以完成,並畴結果於軸電 子襄置端給使用者。本發明在於提供—台智慧型行動電子裝 置具有連上固_魏必透過麟基料,造成跨國跨 區的昂貴通訊㈣。行動電話連上_的魏其實現的方 式’可以是本發明的行動電子裝置也配備一般桌上型或筆記 型電腦的乙太鹏控制晶片與有_路插孔,可以透過乙^ 網路來連上網際網路。另外可以是行動電話的作業系統具有 與筆記型或平板電腦的作業系統有相同連上固網的功能,例 如讓A_ID作業系統可以透過固網來進行連上Int⑽t的 功旎,當然也同時可直接連上雲端服務系統。 如圖二所示’本發明行動電子裝置1Q的外觀示意圖,行 動電子裳置10結構上分成上部1()1與下部1〇2,其間以樞轴 16聯接,該枢軸16可以讓上部1〇1相對於行動電子裝置下部 1〇2進行偏轉(YAW)至少⑽度,如圖三(A)與⑻所示,也可 =有180度俯仰角(PITai),上部1Q1可折疊朗於下部,或 7L王展開與下部夾角度,或是介於㈣的夾角。攝影機 v有一 σ帛攝影機121設置於行動電子裝置上部 101,第一攝影機122與第三攝影機123職置於行動電子裝 置10下。卩102 ’ Μ投影機11設置於行動電子裝置上部則 201228332 並置於第〆攝影機121之旁。第—攝影機1121可以捕捉微投 影機投射的晝面,判別是否需要進行明亮度的調整,或是利 用亮度感測H(未顯示於B巾)來伽環境亮度;是否要進行 梯度補彳I ’疋否要進行投景场的材質或紋理校正。第一攝景; 機/照相機121的視野比微投频u的視収,所以可以自 動修正,避免扭曲或歪斜等。The invention provides a smart mobile electronic device for a child or an elderly person so that they will not be lost, as long as they reach the set position (if necessary, they can take a picture of the time of the week). Make up = the positioning accuracy) can return, use the speed message, you can judge the walk, encounter the private car, if you deviate from the set path, you can enter the monitoring situation, so as not to take this method, the schoolchild carries a smart action The electronic aggregation to the school, the female fullness can be greatly improved, the campus security can be fully mastered by the parents, greatly reducing the burden on the school. [Embodiment] As shown in the figure, the smart mobile electronic device includes a mobile phone body with internet access, a micro-camera, at least three cameras 3, at least one wireless microphone/headset 4, Cloud computing 5, the Internet is better to use 3G or more (10), Long Term Ev〇luti〇n technology) with high-speed and multimedia transmission capabilities, the micro-sound can project at least two-dimensional and 3-dimensional images, with Responsible for feedback control, 201228332 At least one wireless microphone can have voice recognition function, at least one earphone can be used to generate stereo, two cameras can be used for stereo recognition and measurement and shooting stereo image, cloud The operation can be used to complete the search and operation of the mobile electronic device and the work is completed, and the result is given to the user at the axis electronic device. The present invention is to provide a smart mobile electronic device with a connection to the solid _Wei will pass through the lining material, resulting in expensive communication across regions (4). The mobile phone connected to the _ Wei Qi implementation of the way 'can be the mobile electronic device of the present invention is also equipped with a general desktop or notebook computer Etheron control chip and has a _ way jack, can be through the network Connected to the Internet. In addition, the operating system of the mobile phone has the same function as the fixed-screen or tablet operating system, for example, the A_ID operating system can connect to the Int(10)t through the fixed network, and of course, directly Connect to the cloud service system. As shown in FIG. 2, a schematic diagram of the appearance of the mobile electronic device 1Q of the present invention, the mobile electronic device 10 is structurally divided into an upper portion 1()1 and a lower portion 1〇2, which are coupled by a pivot 16 therebetween, and the pivot 16 can make the upper portion 1〇 1 Deflection (YAW) with respect to the lower part 1〇2 of the mobile electronic device is at least (10) degrees, as shown in Fig. 3 (A) and (8), it can also be = 180 degree pitch angle (PITai), and the upper 1Q1 can be folded to the lower part. Or 7L King expands the angle with the lower part, or the angle between (4). The camera v has a σ帛 camera 121 disposed on the upper portion 101 of the mobile electronic device, and the first camera 122 and the third camera 123 are placed under the mobile electronic device 10. The 卩102' Μ projector 11 is disposed on the upper portion of the mobile electronic device 201283032 and placed beside the second camera 121. The first camera 1121 can capture the pupil plane projected by the micro projector, determine whether it is necessary to adjust the brightness, or use the brightness sensing H (not shown in the B towel) to illuminate the ambient brightness; whether to perform the gradient compensation I'要 Do you want to make material or texture corrections for the shooting field. The first scene; the field of view of the camera/camera 121 is smaller than the field of the micro-frequency, so it can be automatically corrected to avoid distortion or skew.
该攝影機12卜122、123收到的輸入,例如,光、一個 場景,肖像’人臉等’可能通過攝影機鏡職其他機制,如 光導7L件,纖維光器件等,抵達—個光敏感时,數個元件, 等。攝影機輸人可以是可見光或某些其他形式的光,如紅外 光’光敏—件可能是只射見絲感,和/或其他波長的電 磁能量也敏感。 該行動電子裝置的攝影機m、122、123及電路和/或軟 體或邏輯可祕檢_戶的手與行動電子裝置的距離,例 如,從各自的攝影鏡頭接收光學輸入代表各自的手、及其運 動運動方向’手勢、和速度。上述檢測所得的信息,如速 度’方向’位置’姿態等’可能會用於控制操作的行動電子 裝置和其内容顯示和/或使用的方式。 仃動電子裝置10上部101除了微投影機n、第一攝影機 121之外’另有擴音器14。而在行動電子裝置的下部⑽,則 有二組麥克風’分別是第—麥克風131設置於中間,第;麥 克風132 15:置於左邊’第三麥克風133設置於右邊。第〆麥 201228332 克風131具有至少—正面全向式麥克風或另加—背面全向式 麥克風;第二麥克風132與第三麥克風132各具有一骨傳導 麥克風以及至少—正面全向式麥克風或另加—背面全向式麥 克風’左手持行㈣子裝近左臉鱗,第三麥克風133 的骨傳導麥歧可_講話時產生㈣震動,再加上所有三 組麥克風的全向式麥克風所組成的陣顺集到錢傳遞的聲 音’可以透過消除噪音的演算法獲得清晰的語音,以作為進 # 一步經語音辨識軟體,轉成高辨識率的文字。很明顯的,當 使用者利財手持雜電子裝置貼近右臉_,則由第二麥 克風132的骨傳導麥克風負責制講話時產生的骨震動。夕 進-步可轉藍牙耳機也設置至少兩組麥克風,—_ 第二麥克風132或133相同,另一組則與第-麥克風131相 同。如此-來,骨料麥克風可⑽緊用戶的臉頰,有 戶講話時產生的骨震動,再加上所有另-組麥克風的入 • 向式麥克風所組成的_收制空氣傳遞的聲音,甚至: 行動電子裝置上的三組麥克風所組成的多麥克風陣列,可^ 透過消除噪音的演算法獲得清晰的語音,以作為進—步一 音辨識軟體,轉成高辨識率的文字。 '&°σ 本發明的智慧型行動電子裝置使擴增實境更可以大 揮’微投影機11往前投射’第一攝影機121也往前拍攝^ 圖王⑻所示,第一攝影機121把背景拍下,投射出影像後0 第-攝影機121又拍下投射影像與背景的結合,加以運算盘 201228332 種回精機制可以產生很有價值的功能。例如將自己 等實物’直接放入第-攝影機内與投射的遊戲内 H將背景娜進行辨識之後,將資訊投射至背景, 第二二1如圖三⑷所示’可以將微投影機11往前投射, 一:衫M22與第三攝影機123往後拍攝,如此可以使玩The input received by the camera 12 122, 123, for example, light, a scene, a portrait 'human face, etc.' may arrive through a camera mirroring other mechanism, such as a light guide 7L piece, a fiber optic device, etc., when a light is sensitive, Several components, etc. The camera input can be visible or some other form of light, such as infrared light. The photosensitive element may be only visible, and/or other wavelengths of electromagnetic energy are also sensitive. The cameras m, 122, 123 of the mobile electronic device and/or the software or logic may detect the distance between the hand of the mobile device and the mobile electronic device, for example, receiving optical inputs from respective photographic lenses representing their respective hands, and Movement direction 'gesture, and speed. The information obtained by the above detection, such as the speed 'direction' position 'or posture', may be used to control the operation of the mobile electronic device and the manner in which its content is displayed and/or used. The upper portion 101 of the tilting electronic device 10 has a microphone 14 in addition to the micro projector n and the first camera 121. In the lower portion (10) of the mobile electronic device, there are two sets of microphones 'the first microphone 131 is disposed in the middle, the first microphone 13 15: placed on the left side', and the third microphone 133 is disposed on the right side. The second buckwheat 201228332 g-zeer 131 has at least a front-facing omnidirectional microphone or an additional-back omnidirectional microphone; the second microphone 132 and the third microphone 132 each have a bone conduction microphone and at least a front omnidirectional microphone or another Plus-back omnidirectional microphone 'left hand row (four) sub-loaded near left face scale, third microphone 133 bone conduction maiqi can _ speak when (four) vibration, plus all three microphones of omnidirectional microphone The sound of the sequel to the money transmission can be obtained through the algorithm of eliminating noise, as a step-by-step speech recognition software, which turns into a high recognition rate text. Obviously, when the user's wealthy handheld electronic device is close to the right face, the bone conduction microphone of the second microphone 132 is responsible for the bone vibration generated during the speech. The incoming-to-step convertible Bluetooth headset also sets at least two sets of microphones, - the second microphone 132 or 133 is the same, and the other group is the same as the first microphone 131. In this way, the aggregate microphone can (10) hold the user's cheeks, the bone vibration generated by the household's speech, and the sound of the air that is made up of all the other microphones, even the following: The multi-microphone array consisting of three sets of microphones on the mobile electronic device can obtain clear speech through the noise-removing algorithm, and can be converted into a high-recognition text as a step-by-step recognition software. '&°σ The smart mobile electronic device of the present invention makes the augmented reality more powerful. 'The micro projector 11 projects forward'. The first camera 121 also shoots forward. ^The king camera (8) shows the first camera 121. The background is photographed, and after the image is projected, the first camera camera takes a combination of the projected image and the background, and the 201228332 refinement mechanism can generate valuable functions. For example, if you put yourself and other physical objects directly into the camera and the projected game, H will recognize the background and then project the information to the background. The second and second ones are shown in Figure 3 (4). Front projection, one: the shirt M22 and the third camera 123 are shot backwards, so that you can make play
作紅㈣容結合互動,符合各«增實境遊戲的硬 體而求’例如SONY的AR遊戲模式。 、仃動電子|置的輸_容可能是圖像,例如照片;—個 '、圖也用戶界面(GUI); 一個清單數據或信息,如聯繫 (從行動電⑦通訊錄存財間取出的文件);可攜式文 件才。式(PDF格式)等’·鍵盤,如-個QWERTY英文或一些其 母數字鍵盤或其他—些鍵盤或鍵盤等;音頻輸 出或成乎任何其他内容。 電子Θ之仃動電子裝置的三台攝影機分別設於行動 由\ 、上下部分’因此可以將行動電子農置旋轉九十 X使第攝影機121與第二攝影機122成為左右各一,发 距離可設計成六到八公分,符合人躺雙眼距離,如_ 於一維攝衫的㈣’可以取得三維影像,啊透勒建的三 角量測校正參數,π,、,θ 一 了从I測影像中物體的尺寸長度並估算去 時拍攝的距離。 ® 仃動電子裝置雖然有觸控螢幕,但是其晝面小,究竟與 人的手指概仍然不容易點選,為此透過語音辨識的技術,、 201228332 進行命令鏡擇’並由_,_需要_。另外也可 ΓΓ勢的觸進行縣放大_,點鮮各種類似的功 二’⑼也可峨射_,直接料指闕難進行文字的 的辨識,可以採用—般手指操控觸控螢幕的 白用手勢絲騎人。大投f彡畫面、語音_、手勢命令, 1寺Γ於老人而言是料有幫_,可喃鬆進行各種手機 f腦的魏爾⑽㈣_t。传命令因為是 =於如圖一(A)所不,在投影晝面距離約手臂伸長的距離,也 Γ是九十公分以内,行動電子裝置可固定放置於桌上,投 =牆面19 ’因為畫面大’毋須更替老花眼鏡或摘下近視眼 手勢或林18可直接細投射畫面的某物體,進行點選。 _對於手指做為點選投影晝面的方法,如圖四與圖六所 =智慧型行動電子裝置1G,使_方法是放置於桌面,行 7子裝置上部旋轉180度,使微投影機朝前,行動電子裝 P置放於桌面’㈣第二攝影機122與第三攝影機⑵ 自:維量測與運算’可以確認手勢或手指的空間圖案,成為 …、、的輸入與人機介面。此處的第二攝影機122與第三攝影 ^23可加裝廣域,或是原本就配上有廣角鏡的攝影機, 或疋攝影機可以變焦至廣角視野。 有關手指的追縱’可以五個手指的長短以及寬度或 ’進行姆指、食指、中指、無名指、小指的辨識;而 工手人右+也可辨識出來。例如利用膚色將手與背景分離, 10 201228332 影像處職術_態運算與_ _可麟尖位置找 如圖四所示’利用本發明之行動電子裝置的兩個攝 行高速運算’即時得出其三維空間的座標,亦即手指 果21 ’然後可以進行手勢 左右移输若”丰:作,以及是上下捲動或 縮放、:271,、右疋夕手指指尖三維位置操作,則判斷是The red (four) capacity combined with the interaction, in line with the "real life of the game", such as SONY's AR game mode. The input and output of the electronic device may be an image, such as a photo; a ', a graphical user interface (GUI); a list of data or information, such as a contact (taken from the mobile phone 7 File); portable file only. (PDF format), etc. Keyboard, such as - QWERTY English or some of its parent numeric keypad or other - some keyboard or keyboard, etc.; audio output or any other content. The three cameras of the electronic smashing electronic device are respectively set in the action and the upper and lower parts. Therefore, the mobile electronic farm can be rotated by ninety X to make the first camera 121 and the second camera 122 one by one. In the case of six to eight centimeters, it fits the distance between the eyes of the person, such as _ in the one-dimensional camera (four) 'can obtain three-dimensional image, ah, through the triangle measurement calibration parameters, π,,, θ one from the I image The length of the object in the middle and estimate the distance to be taken when going. ® Although the electronic device has a touch screen, its face is small, and it is still not easy to click on the finger. For this reason, through the technology of voice recognition, 201228332, the command mirror is selected and used by _, _ _. In addition, you can also zoom in on the county to make a magnified _, and a variety of similar gong 2' (9) can also be shot _, directly refers to the difficulty of text recognition, you can use the same finger to control the white screen of the touch screen Gesture silk rider. Big shot f彡 screen, voice _, gesture command, 1 temple is for the elderly, it is expected to help _, can be used to carry out a variety of mobile phones f Weier (10) (four) _t. Because the command is = as shown in Figure 1 (A), the distance from the projection surface is about 90 cm, and the mobile electronic device can be fixed on the table. Because the picture is large, there is no need to replace the reading glasses or take off the myopia gesture or the forest 18 can directly project an object of the picture and click on it. _ For the finger as a method of selecting the projection surface, as shown in Figure 4 and Figure 6 = Smart Mobile Electronic Device 1G, so that the _ method is placed on the desktop, the upper 7 sub-devices are rotated 180 degrees, so that the micro-projector is facing In the front, the mobile electronic device P is placed on the desktop. (4) The second camera 122 and the third camera (2) From: the dimension measurement and calculation 'can confirm the gesture or the space pattern of the finger, and become the input of the ..., , and the human-machine interface. Here, the second camera 122 and the third camera ^23 can be equipped with a wide area, or a camera originally equipped with a wide-angle lens, or the camera can be zoomed to a wide-angle field of view. The finger-following can be used to identify the thumb, forefinger, middle finger, ring finger, and little finger with the length and width of five fingers. The right hand + can also be recognized. For example, using the skin color to separate the hand from the background, 10 201228332 image service _ state operation and _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ The coordinates of the three-dimensional space, that is, the finger fruit 21' can then be moved left and right if the gesture is "funded, and the scrolling or zooming up and down, 271, and the right-handed fingertip three-dimensional position operation, then the judgment is
則宽疋轉、或二維績圖261 ;若選擇敲鍵盤262輸入文字, 以勸Γ與第三攝影機擷取使用者敲鍵盤的手指尖,使用者可 =影内容中的_,並且自行移動手指尖到達對應的 4位置,進行按壓的動作。 面三維空_手指細料放大料晝面,或是旋轉圭 辨識捲動晝面等常見於觸控式螢幕的手指動作,更可以^ ㈣不會州手指與觸控f幕細的電容或電阻是否因手 或賴程度而影響。透過至少—根手指的點選與比 手機 圍更尚,特別疋因為筆記型電容或 以因、^ ’吊會發生誤點選到目標點附近的功能,這%可 的機^投影晝面擴大與擴增實境的結合喊手财更多確點 如圖 辨熾29。 四所示’手勢模柄擇22的結果若麟辅號手勢 ,則繼續觸衫騎財勢職28,或是手寫文字 201228332 攝:如圖三⑻所示,也可藉由朝前第〜攝影機的拍 攝,觸使用者在空中的手勢或手指頭18的動作是否成功與 =内容達成互動’例如將手細按壓的鍵盤,加以顯示於 投影幕^19上,也就是說例如在視窗文字編輯軟體_桑作 中’就能料在正顧難上的字母或魏輪人於文件中。 做為人機介面的輸出入,這部分主要是擴增實境⑽的展 現。如果由手背方向來判識指尖,可以彻指甲的形狀做為 • 追縱的標的圖案。由於投影内容的干擾,判斷的方法主要是 利用動作是否發生以及是否有停留,是否特定按鍵位置的= 像特财因為手指或手勢18的侵人而改變,例如利用_的 平均值改變等影像處理的技術,可以判斷該特定按鍵已經鍵 〇。另外手指端部也可貼附特定顏色的標記,以利辨識。或 疋指T塗上AR的圖案,例如十個手指頭都畫上不同編碼的 从圖案。也可以在指頭套上或貼附一個鐵擴增實境)的圖 案’也可以在五個手指甚至十個手指,分別貼附不同編號的 AR圖案。 由於攝々機的視野與距離成正比,一般鏡頭的攝影機其行 動電子裝置與手指頭的距離應大於編以上,為使使用場合 較不受_ ’攝影機的角魏夠旋轉。對於加裝廣角鏡頭的 暴。機〃行動电子裝置與手指頭的距離可以在5長爪之内。 就溝通的層次而言, ’手勢4傳達簡單的人機介面、或是概念、或是符號, 201228332 而語言才是深度溝通的主要工具; 2. 即使不透過語言、也是可以透過投影内容的圖像來溝通; 3. 若是啊透·像與語言來溝通,則是目前最有效的方 法,例如常見·的簡報模式。 所以語音賴可⑽是最重钱,_後的學習,尤其個人 化的語音觸無譯,最符合每個人需求的,透過大量學習 (人a慧)與疏資料庫的儲存與快速搜尋,辨識準確率應 能達到95%以上,借助於雲端運算所提供超大量的記憶體與快 速搜尋即可有效達成。Then, if you choose to type the text on the keyboard 262 to exhort the third camera to capture the fingertip of the user's keyboard, the user can = _ in the content and move by himself. The fingertip reaches the corresponding four positions and the pressing action is performed. Face 3D empty _ finger fine material enlarges the material surface, or rotates the key to identify the scrolling surface and other common finger movements of the touch screen, and can also (4) not the state of the finger and touch screen fine capacitance or resistance Whether it is affected by the hand or the degree of dependence. The selection of at least the finger is better than that of the mobile phone. In particular, because of the function of the notebook capacitor or the cause of the accident, the function of the camera can be expanded. The combination of augmented reality and shouting money is more accurate as shown in Figure 29. The result of the four gestures of the gestures is 22, if the gesture is used, then continue to touch the shirt, riding the financial position 28, or handwritten text 201228332. As shown in Figure 3 (8), it can also be used by the front camera. Shooting, touching the user's gesture in the air or the action of the finger 18 is successful in interacting with the content. For example, the keyboard that is pressed by the hand is displayed on the projection screen ^19, that is, for example, in the window text editing software _ In the Sang Zuozhong, you can expect the letters or Wei Lun people in the documents. As the input and output of the human-machine interface, this part is mainly the augmentation of reality (10). If you recognize the fingertip from the direction of the back of your hand, you can use the shape of the nail as the target pattern for tracking. Due to the interference of the projected content, the method of judging mainly uses whether the action occurs and whether there is a stop, whether the specific button position = like the special money changes due to the intrusion of the finger or the gesture 18, for example, the image processing using the average value of _ The technology can determine that the particular button has been keyed. In addition, the end of the finger can also be attached with a mark of a specific color for identification. Or 疋 refers to the pattern of the AR painted on the AR, for example, ten fingers are drawn with different coded slave patterns. It is also possible to attach a pattern of iron augmentation on the finger cot or attach a different number of AR patterns to five fingers or even ten fingers. Since the field of view of the camera is proportional to the distance, the distance between the moving electronic device and the finger of the camera of the general lens should be greater than the above, so that the use of the camera is less than the angle of the camera. For a storm with a wide-angle lens. The distance between the mobile electronic device and the finger can be within 5 long claws. In terms of communication level, 'gesture 4 conveys a simple human-machine interface, or concept, or symbol, 201228332 and language is the main tool for deep communication; 2. Even if you don't speak language, you can use the projected content. Like to communicate; 3. If it is communicated with the language, it is the most effective method at present, such as the common briefing mode. Therefore, voice Lai Ke (10) is the most important money, after _ learning, especially personalized voice touch without translation, the most suitable for everyone's needs, through a large number of learning (people a Hui) and sparse database storage and fast search, identification The accuracy rate should be more than 95%, which can be effectively achieved by providing a huge amount of memory and fast search by cloud computing.
a在語音觸上,翁—個㈣訊社要語音訊號輸 入疋很重要的’可以讓用戶語音辨識的正確率提升,會敗壞 主要語音職讓語音_無法做出正確觸㈣訊可以分成 兩種類型’環境魏與背景語音雜訊,環境雜訊已有許多人 有不錯的研究成果,但是如果環境中多出背景語音雜訊,在 訊號處理上會有比較多的_,因為制除背景語音雜訊, 很谷易連主要語音峨赌斜—_除,㈣本發明將全 向性麥克風、指向性麥錢再加上骨傳導麥核,讓麥克風 具有多感官侧方式’氣動式麥克風具有高錢與不失直的 優點’但是會獅訊的_ ;㈣導麥克顺環麟背p 音雜机具有低敏感度的優點,再者不必_複_抑法來 做語音_祕’但骨料麥歧具有失真射轉的問 201228332 通,氣動式與骨傳導麥克風可以利用訊號處理來達到互補的 效果’讓輸出訊號不管在任何環境下都具有低雜訊。此處的 骨傳導麥克風是由至少一軸的加速度計所構成,其頻寬通常 要在10ΚΗζ-30ΚΗζ ’較佳的狀況是使用三軸加速度計。指向 性麥克風是指一種全向式麥克風,但利用封裝方式使聲音的 來源可以不是從正面而來,可以是側向或是背向而來。在製 造與封裝上,全向性麥克風、指向性麥克風與骨傳導麥克風 可以利用半導體微機電(CM〇S_MEMS)製程或純微機電製程 成為單石(m〇n〇lithlc)結構’或是分開製作,再加以組裝成一體。 而在後續訊號處理部分,如圖五所示,主要分成兩個部 伤來處理帛一部分結合全向性麥克風和指向性麥克風來處 里月傳V麥克風頻寬無法達到之部分’也就是高頻訊號;第二 扎結合全向性麥克風及指向性麥克風與骨傳導麥克風。第 一部分域麥克風收集主要鱗音訊號,參考麥克風作為收 集雜訊目的’彻將參考麥克風訊號輸人適應⑽波器處理 =後。主要錢風訊號械,產生輸出訊號,輸出訊號與希 純語音訊號㈣,因此赶誤差訊號,誤差訊號利 句根屬异法,即可調整適應性濾波器的係數,隨著 ==^入,誤差訊號及最小方均根演算法不斷的調整適 的:錄,係數會不斷的變動,最後達到某個穩定 接近,咖嫩伽純語音訊號就會非常 处過私甲會使用到語音偵測來得知是否有語音 201228332 信號的產生,可使用骨傳導式麥克風加以偵測,這也是使用 骨傳導式麥克風的好處之一,可以有效的偵測是否有用戶主 要語音存在。第二部分主要是利用骨傳導式麥克風當作主要 收集純語音訊號,但因為骨傳導麥克風會有失真的問題,也 就是說骨傳導麥克風雖然在語音中沒有雜訊的產生,但是會 有失真的問題,而氣傳導麥克風雖然沒有失真的問題,但是 會有雜訊的問題’所以將另外兩顆麥克風應用第一部份的方 φ 法’兩種訊號再利用 SPLICE (stereo piecewise linear compensation for environment)技術可以達到互補的效果。 讓處理後的語音清晰不失真符合語音辨識軟體所需的語音勳 號輸入。如圖五所示的語音訊號前處理通常需要數位訊號處 理!§、(DSP)84的協助,不然就是需要具有Dsp功能的微處理器 (CPU)。 硬體上’要達成語音觸,除了具有語音觸軟體可以 • 將清晰的語音轉換成文字之外,更需要具有對環境噪音不敏 感的麥克風,本發明的行動電子裝置可以具有三組麥克風, 如圖一所不’可以敲語音辨識㈣麥克風需要有多個獨立 的通道’所以能讓發話者自己說出的語音能夠被收集,然後 經過快速處理去除環境噪音,這個處理需要即時性,才能交 —日處if軟體進行語音觸。對於語音觸⑽就資料 庫安裝於行動電子裝置的要求,可以分成兩部份:=是命 令型態的語音辨識與執行,可以内建語音庫於行動電子裝置 15 201228332 的記憶體内’第二是躲大量對触及跨語言_話,也許 需要雲端運算服務來進行語音辨識,甚至進行線上翻譯,同 時加以記錄’做為絲敎的魏。制是通魏錄,或是 情緒的監控’或是食衣住行的紀錄。 疋 語音命令可鄉倾鼠或_,例如人機細,無線耳 機採用陣列式麥克風。酉己合手勢點選,例如_編輯,可以 更有效選取某一段文章。 進-步可㈣語音觸魏進行設定:例如從事職業領 域、或專業領域等’如此可以預先將這些領域列為行動電子 裝置内建賴庫貨運端資料賴域尋輯的對象,當然具 有從錯誤巾„的魏,奴最符合人性的。例如將使用者 所講的語音触賴’若其錯料在5%_,通常就可以接 受。 如圖六,顯示-個電子裝置形式的行動電話3〇的内部電 路方塊圖。行動電話3G包括無線連接、通信功能和消息功 能,如短信,82。這個配置是開展無線電子裝置已知的各種 連接’通信和短信功能。通信功能82可能是體現為可執行代 ^ ’常駐於和轉行於行動電話30。在一實施例中,通訊功 能82可能是,個或更多的程式存儲在微處理機或微處理機 可處中。通訊魏82可能是—獨立的軟體應用程序或作 為其纪成部分的軟體應用程序執行其他與行動電話3M目關 的任務。 16 201228332a in the voice touch, Weng-a (four) news agency to voice signal input 疋 very important 'can make the user's voice recognition correct rate increase, will ruin the main voice job voice _ can not make the correct touch (four) can be divided into two categories Type 'environment Wei and background speech noise, environmental noise has many people have good research results, but if there are more background speech noise in the environment, there will be more signal processing in the signal processing, because the background voice is eliminated. Noise, very Gu Yilian main voice gambling oblique _ _, (4) The invention will be omnidirectional microphone, directional wheat and bone conduction micronucleus, so that the microphone has a multi-sensory side way 'pneumatic microphone has high money and The advantage of not losing straightness is 'but the lion's _; (4) guiding the microphone to the ring-back phoning machine has the advantage of low sensitivity, and then there is no need to _re- _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ With the distortion of the rotation of the 201228332 pass, pneumatic and bone conduction microphones can use signal processing to achieve complementary effects 'allow the output signal with low noise in any environment. The bone conduction microphone here is composed of at least one axis accelerometer, and its bandwidth is usually 10 ΚΗζ 30 ΚΗζ ′. The preferred condition is to use a three-axis accelerometer. A directional microphone is an omnidirectional microphone, but the packaging can be used to make the source of the sound not from the front, but from the side or from the back. In manufacturing and packaging, omnidirectional microphones, directional microphones, and bone conduction microphones can be fabricated as monolithic (m〇n〇lithlc) structures using semiconductor microelectromechanical (CM〇S_MEMS) processes or pure microelectromechanical processes. And then assembled into one. In the subsequent signal processing part, as shown in Figure 5, it is mainly divided into two parts to deal with the part that combines the omnidirectional microphone and the directional microphone to the part where the V-microphone bandwidth cannot be reached. Signal; the second tie combines an omnidirectional microphone with a directional microphone and a bone conduction microphone. The first part of the domain microphone collects the main scale sound signal, and the reference microphone is used as the purpose of collecting the noise. The reference microphone signal is input to the (10) waver processing = after. The main money wind signal device produces the output signal, the output signal and the pure voice signal (4). Therefore, the error signal and the error signal are different, and the coefficient of the adaptive filter can be adjusted, with ==^, The error signal and the minimum square root algorithm are constantly adjusted: the recording, the coefficient will continue to change, and finally reach a certain stable proximity, the gamma gamma pure voice signal will be very private, will use the voice detection to know whether The generation of the voice 201228332 signal can be detected using a bone conduction microphone, which is one of the benefits of using a bone conduction microphone, which can effectively detect whether there is a user's main voice. The second part mainly uses the bone conduction microphone as the main collection of pure voice signals, but because the bone conduction microphone has distortion problem, that is, the bone conduction microphone has no noise generated in the voice, but there is distortion. The problem, while the gas-conducting microphone has no distortion problem, but there will be noise problems. So the other two microphones will be applied to the first part of the square φ method. Then use SPLICE (stereo piecewise linear compensation for environment) Technology can achieve complementary results. Make the processed speech clear and undistorted to match the voice honour input required by the speech recognition software. The pre-processing of voice signals as shown in Figure 5 usually requires digital signal processing! §, (DSP) 84 assistance, otherwise it is necessary to have a Dsp-enabled microprocessor (CPU). On the hardware side, in order to achieve a voice touch, in addition to having a voice touch software, it is necessary to convert a clear voice into a text, and a microphone that is insensitive to environmental noise is required. The mobile electronic device of the present invention can have three sets of microphones, such as Figure 1 does not 'can knock the voice recognition (four) the microphone needs to have multiple independent channels' so that the voice spoken by the speaker can be collected, and then quickly processed to remove the environmental noise, this process needs immediacy, can be handed over - The daily if software performs a voice touch. For the voice touch (10), the requirement that the database is installed on the mobile electronic device can be divided into two parts: = is the command type speech recognition and execution, and the built-in voice library can be built in the memory of the mobile electronic device 15 201228332 'second It is to hide a lot of touches of cross-language _ words, perhaps need cloud computing services for speech recognition, and even online translation, while recording 'as a silky Wei. The system is a record of Wei Wei, or emotional monitoring, or a record of food and clothing.语音 Voice commands can be used for squatting or _, for example, human-machine thin, wireless headsets use array microphones. You can select a certain section of the article more effectively by clicking on the gesture, such as _Edit. Step-by-step (4) Voice touch Wei set: for example, in the professional field, or in the professional field, etc., so that these fields can be listed in advance as the object of the mobile electronic device built-in Laiku cargo terminal data search, of course, from the error The Wei, the slave of the towel is the most human. For example, the voice of the user is touched. If it is wrong at 5%, it is usually acceptable. As shown in Figure 6, a mobile phone in the form of an electronic device is displayed.内部The internal circuit block diagram. The mobile phone 3G includes wireless connection, communication function and message function, such as short message, 82. This configuration is to carry out various connection 'communication and short message functions' known to the wireless electronic device. The communication function 82 may be embodied as The executable 2 'lives and switches to the mobile phone 30. In an embodiment, the communication function 82 may be that one or more programs are stored in the microprocessor or microprocessor. The communication Wei 82 may be - A stand-alone software application or a software application that is part of its implementation performs other tasks related to the mobile phone 3M. 16 201228332
行動電話30的微投影機51與顯示器52用來顯示给 信息,如運行狀態,時間,電話號碼,聯繫信息’各種菜卯 專,這使用戶能夠利用行動電話3G的各種功能。顯示= 也可以用來直觀地顯示接收的内容,和/或由行動電㈣ 輸出’和/或從行動電話3__ 4G檢索的結果的 ㈣與顯示器52被用來表示圖像,視頻和其他圖形給用7 行動電視内容,互聯網網頁,和遊戲相關的視頻。’ /為了擺脫行動電子裝置顯示螢幕小的問題,行 的系統可以自動調整顯示輸出的解析度,如同小筆 腦,雖然書面小,可卜 d i電 卜接大尺寸的顯示器,產生高解Μ 同樣的行動電子健的晝面更小,但是可以透過t 投衫機的輸出產生高晝質與大畫面。 于鍵兄讀入子母數字信息(例 清單,聯繫信息,己,文㈣電。舌號碼’電話 雷钟、、,#社 丨4)’特殊功能鍵(例如,—個 朴=Γ鍵’多媒體播放控制鍵’照相機快門按紐 等)‘航和遠擇鍵或指向庐罟,笙莖 還可能體現為-個_幕 =按鍵式的功能 、 料…1不$52。此外,顯示器52和 ’’瓜2可以—起使用以實現軟鍵的功能。 Z⑽紐,蝴詞咖。通信電路 可此包括電話,數據傳輸,及類似品,包括提供内容和/或里 他信號_示賴52。触也可能包括鱗通賴域區域 201228332 網或其它網絡等。雷, d 了 ^採取任何適當的形式,包括但不 限於聲t、電話和視_話。這些電話可藉由行動電子裝置 的電路又換、罔、、’。進仃或可能以聲音形式經由互聯網語音協議 (VoIP)呼叫,建立在一個封& 一種封包交換網絡(例如,—個網絡兼容於臓齡u, 也就是通常所指作為W1F1或與臟觀16網路兼容,這 通常被稱為·ΑΧ)。數據傳輸可能包括但不限於接收流内 合(例如U頻,視頻流等),接受數據饋入(例如, 推數據’播客(podcasts),很簡單聚合⑽,响蜂 syndicate)數據輸入數據輸入),下載和/或上傳數據(例 如,圖像文件,視敝件,音敝件,環鈴聲,互聯網内容 等),接收或發送信息(例如’短信,即時消息,電子郵件 信息’多媒體信息),料。這錄據可缺行純話洲處 理的其中包括存儲數據在記憶體4(),執行朝程序,允許 用戶交互數據,顯示視頻和/或圖像内容相關的數據,輸出與 數據相關的音頻聲音,等等。 在示範性的實關巾,龍電路可能包括加上—個天線 60連接射頻電路6卜該射頻電路6〗包括—個射頻發射器和 接收器通過天線6〇發射和接收錢。射頻電路Μ可配置為 操作於-移動通信系統。射頻電路61 _的互動與移動通 訊網路和/或廣義路包括但不限於全球移動通信系統 (_ ’分碼多工擷取(⑽A)、寬頻分碼多卫擷取⑽圓)、The micro projector 51 and the display 52 of the mobile phone 30 are used to display information such as running status, time, telephone number, and contact information, which enable the user to utilize various functions of the mobile phone 3G. Display = can also be used to visually display the received content, and / or output by the mobile power (four) 'and / or the result of the retrieval from the mobile phone 3__ 4G (four) and the display 52 is used to represent images, videos and other graphics to Use 7 mobile TV content, internet pages, and game related videos. ' / In order to get rid of the small problem of the mobile electronic display screen, the line system can automatically adjust the resolution of the display output, just like a small pen brain, although the writing is small, can be connected to a large-sized display, resulting in a high resolution The mobile electronic camera has a smaller face, but it can produce high quality and large picture through the output of the t-shirt. Yu Jianxiong reads the digital information of the child (example list, contact information, hex, text (four) electricity. Tongue number 'phone Lei Zhong,,, #社丨4) 'special function keys (for example, - a simple = Γ key) Multimedia playback control button 'camera shutter button, etc.' 'Air and far-select key or point to 庐罟, stolon can also be embodied as a - _ curtain = button-type function, material ... 1 not $ 52. In addition, display 52 and '' melon 2 can be used together to implement the function of soft keys. Z (10) New Zealand, the word coffee. Communication circuitry may include telephone, data transmission, and the like, including providing content and/or other signals. Touch may also include the scale of the domain area 201228332 network or other networks. Ray, d ^ Take any appropriate form, including but not limited to voice t, phone and video. These phones can be replaced by the circuit of the mobile electronic device. Entering or possibly making a voice over a Voice over Internet Protocol (VoIP) call, based on a packet & a packet switched network (eg, a network compatible with 臓 u u, which is commonly referred to as W1F1 or with a view of the dirty 16 Network compatible, which is often referred to as "ΑΧ". Data transmission may include, but is not limited to, receiving stream internals (eg, U-frequency, video stream, etc.), accepting data feeds (eg, pushing data 'podcasts, very simple aggregation (10), bee syndrome) data input data input) , downloading and/or uploading data (eg image files, visuals, audio components, ringtones, internet content, etc.), receiving or sending information (eg 'sms, instant messages, email messages' multimedia information), material. This document can be used to store data in memory 4(), execute program, allow user interaction data, display video and/or image content related data, and output data related audio sounds. ,and many more. In an exemplary real towel, the dragon circuit may include an antenna 60 connected to the radio frequency circuit 6 and the radio frequency circuit 6 includes a radio frequency transmitter and a receiver for transmitting and receiving money through the antenna 6 . The RF circuit can be configured to operate in a mobile communication system. The interaction of the radio frequency circuit 61_ with the mobile communication network and/or the generalized path includes, but is not limited to, the global mobile communication system (_'s code division multiplexing ((10)A), wideband code division multi-guard (10) circle),
移動媒體,揮發性記憶體,非揮發性記憶體,隨機存取記憶 體(RAM) ’或其他合翻設備。在—個典型的行動電話別安 排,記憶It 40可包括非揮發性記憶體用於長期數據儲存和揮 《性5己憶體’其功能為控制電路8〇的系統記憶體。記憶體 可透過數據匯流排與控制電_交換數據。記憶體4()和控制 電路80之間的配合的控制線和地址匯流排也可能存在。 控制電路80 ’處理裝置8卜連接/通訊魏82和比較器 201228332 通用封包峨務⑽S)、_,軸技術,手持數位 ::二⑽,、LTE長期演進技術 lvoIutiGn)、⑽瞧位廣播()·封包存取⑽A) ,以及糊佩進版本,或任何其他物標 明顯的是,行動電話3G可能使用超過_個標準。因此,天線 6〇和射頻電路61可代表—個或一個以上的射頻收發器。、 仃動電柳包括電路’軟體和邏輯部分,例如,主^制 電路8〇 ’被配置為進行行動細睡面控制的魏和精。 控制電_可包括處理裝置8丨,如t央處理衫⑽、),微 控制域微處理器。其中’處理設備81執行代碼存放在一記 憶體(未顯示)在控姆_和/或在翔的記缝,如記憶 體40,為了進行行動電話3〇的運作。例如,處理設執行 的代碼’實現了無線連接和通訊功能,包括例如,短信或其 他信息功能,以及影響和/或控辦接。記憶體術能是, 例如’ 一個或更多的緩衝區,快閃記憶體,更碟驅動器,可 19 201228332 /控制功能(圖型加速處理器)83的配置,在於合作性和適應性 的開展本發明的各項步驟,讓行_糊得以執行非接觸式 控制顯示的内容。Mobile media, volatile memory, non-volatile memory, random access memory (RAM) or other devices. In a typical mobile phone, the memory It 40 can include non-volatile memory for long-term data storage and system memory that functions as a control circuit. The memory can exchange data with the control bus. Control lines and address busses for the cooperation between the memory 4() and the control circuit 80 may also be present. Control circuit 80 'processing device 8 connection / communication Wei 82 and comparator 201228332 general packet service (10) S), _, axis technology, handheld digital:: two (10), LTE long-term evolution technology lvoIutiGn), (10) digital broadcast () · Packet Access (10) A), as well as the paste into the version, or any other object is obvious, the mobile phone 3G may use more than _ standards. Thus, antenna 6 and RF circuit 61 can represent one or more radio frequency transceivers. The swaying circuit includes a circuit 'software and a logic portion. For example, the main circuit 8 〇 ' is configured to perform Wei and Jing of the action of the sleeping face control. Control electronics may include processing means 8 such as a central processing shirt (10), a micro-control domain microprocessor. Wherein the processing device 81 executes the code stored in a memory (not shown) in the control and/or in the slot, such as the memory 40, for the operation of the mobile phone. For example, the process of executing the code 'implements wireless connection and communication functions, including, for example, text messaging or other information functions, as well as affecting and/or controlling the connection. Memory can be, for example, 'one or more buffers, flash memory, more disc drives, can be configured with 2012 201232 / control function (pattern acceleration processor) 83, in cooperation and adaptability The steps of the present invention allow the line to perform the content of the contactless control display.
仃力電話3G還包括-個聲音信號處理電路7Q用於處理透 過射頻電_傳播與接收的音齡號。耗合到聲音處理電路 7〇包括麥克風72、73、74與揚聲洲,使用戶能夠通過行動 電話30聽與說。射頻電賴和聲音處理電襲_合到控制 電路I以進行整體運作。音頻數據可以通過從控制電_ 到聲音信號處理電路7〇播放給用戶。音頻數據可能包括,例 如,音頻數據從-_存在記憶體_音敝件和控制電路 _索而得’或接收的音頻如語音通信的形式或從移動益線 數據服務麵流式音頻。聲音㈣處義電路可能包括任何 衝區:解碼器’放大器等。Dsp處理晶⑽:通過 = 組與通诚站通信,並且將_麥克風H 得的聲音錄傳輸至微處㈣;陣列麥克風72、73、74. ^ =有指向性的聲音信號;_陣列指 和: 丨麥她、73、74侧聲音錄他= 並相應的她_克風72、73、74的額._:將二 源始終排除在外;麥克_舰組HU 器提供解歧,馳麥歧騎财向性 ==信號’在該模組和^模組中的自適應方嶋 糾作用下,遽波器可以實現對目標語音信號的 20 201228332 自動追蹤和分析 目榡。 向性波束,從而實現提升信噪比的 _示器52藉由+ 8〇,規頻處理電路5G將^順5G_合到控制電路 顯示哭S9 ^ 將硯頻數據轉換成視頻信號,用於驅動 當的'^Γ影機51)。視頻處理電路50可包括任何適 由控制轉J2器’視頻數據處理等等。視頻數據可能會The power telephone 3G further includes a sound signal processing circuit 7Q for processing the sound age number transmitted and received through the radio frequency. The audio processing circuit 7 includes microphones 72, 73, 74 and Yangshengzhou, enabling the user to listen and speak through the mobile phone 30. The radio frequency and sound processing are combined with the control circuit I for overall operation. The audio data can be played to the user by controlling from the control signal to the sound signal processing circuit 7. The audio data may include, for example, audio data from -_present memory_sound and control circuitry - or received audio in the form of voice communication or from mobile line data service surface streaming audio. The sound (4) circuit can include any punch: decoder 'amplifier, etc. Dsp processing crystal (10): communicates with the Tongcheng station through the = group, and transmits the sound recording of the microphone H to the micro (4); array microphone 72, 73, 74. ^ = directional sound signal; : Buckwheat, she, 73, 74 side voice recorded him = and corresponding her _ gram wind 72, 73, 74 amount. _: the two sources are always excluded; Mike _ ship HU device provides disambiguation, Chi Maiqi Cycling==Signal' Under the adaptive square correction of the module and the ^ module, the chopper can achieve automatic tracking and analysis of the target speech signal 20 201228332. The directional beam, thereby realizing the signal-to-noise ratio _ 52 52 by + 8 〇, the frequency processing circuit 5G combines the 5G_ into the control circuit to display the crying S9 ^ converts the 砚 frequency data into a video signal for Drive the '^ camera 51). Video processing circuitry 50 may include any suitable control device, video data processing, and the like. Video data may be
來自傳入的視頻數記憶體40的-個視頻文件, 適的枝獲得。接收’由射頻電路61或任何其他合 八仃動電4 3G還可以包括—個或更多的輸人/輸出([/〇) w面64。該I/O介面64可叹典型的行動電話議介面, 並可能包括一個或更多的電連接器。該I/O介面64可能形成 —個或多個雜端口 ’用於連接行動電話30至其他設備(如 電腦)或附件(例如,個人免持⑽)設備、乙太網路線、 各種感測器)。此外,操作電源可能來自ί/〇的介面制和行 動電話30内的供電單元⑽)65的充電電池。當缺乏外部 電源時,PSU 65可供電操作行動電話3〇。行動電子裝置連上 固網的功能其實現的方式,可以是行動電話3〇也配備一般桌 上变戒筆記型電腦的乙太網路控制晶片63與有線網路插孔 64,因此就能透過乙太網路來連上網際網路。 行動電活30的電路,軟體和邏輯還可能包括各種其 他組件。例如,一個系統時鐘41可提供時脈給一些組件,如 201228332 控制電路80 ’記憶體4〇。也包括攝影機/相機53、54、沾 用於拍攝數片和/或視訊影片,和取得代表光學輸入的影 像’用於輸出到微投影機52。圖像和/或視頻文件所對應的圖 片和/或視訊可能存儲在記憶體4〇。本發明的行動電子裝置,A video file from the incoming video number memory 40 is obtained from the appropriate branch. The receiving 'by radio frequency circuit 61 or any other singular power 4 3G may also include one or more input/output ([/〇) w-plane 64. The I/O interface 64 sighs a typical mobile phone interface and may include one or more electrical connectors. The I/O interface 64 may form one or more miscellaneous ports 'for connecting the mobile phone 30 to other devices (such as a computer) or accessories (eg, personal hands-free (10)) devices, Ethernet routes, various sensors. ). In addition, the operating power source may come from a rechargeable battery of the power supply unit (10) 65 in the interface of the ί/〇 and the mobile phone 30. In the absence of an external power source, the PSU 65 can be powered to operate the mobile phone. The function of the mobile electronic device connected to the fixed network can be realized by the mobile phone 3 and the Ethernet control chip 63 and the wired network jack 64 of the general desktop change notebook computer. Ethernet is connected to the Internet. The circuits, software and logic of the mobile circuit 30 may also include various other components. For example, a system clock 41 can provide a clock to some components, such as 201228332 control circuit 80 'memory 4'. Also included are cameras/cameras 53, 54 that are used to take a few pictures and/or video movies, and take an image representing the optical input for output to the micro projector 52. Pictures and/or video corresponding to images and/or video files may be stored in memory. The mobile electronic device of the present invention,
可以内建具有高速影像處_圖型加速處理器83,以便進行 高速影像處理’例如使用n_vidia,⑽A程式語言,使得手 勢或手指闕與投影鍵盤的輸人可赠過攝職/相機Μ、 54、55所娜的影像加以運算處理,即時有效完成。一個位 置數據接收器8G,如全球定位系統(Gps)接收機,伽利略衛 星系統接H馳,可能涉及行動電話3Q的定位。本地無 線"面62 ’如紅外收發器和/或一個射頻收發器(例如,藍 牙晶片組’ ZigBee模組)可祕建立與附近設備的溝通^ •個午待裝置),另一移動通信終端 附仵〔例如 • 腦, -台電視機台電腦監視器,一個顯示設備,或其他設備 等。本地無線介面62,別於或任何部分的連接。行動電話 3〇内建藍牙通訊模組’例如藍牙4 ()等,可以接收且有莊牙 通訊介____的訊號,例如使用者身上也根基於 ^牙通訊模組的穿戴式感測器如心率、血氧計、血壓計、血 糖計、體溫等。 行動電子裝置㈣舰也可以成為環境監_的-個節 f並不需要特騎求,額者自動將其行動電子裝置 上的附加於晴面64的環境感所測得的資訊包括溫 22 201228332 度、濕度、風速1音值、氣味與 ^ 與漠度等,透過雲端加以記錄=及物微粒種類 屯/'叱ύ μ及環堉影僮笙 :Γ:有f訊以空間座標為基礎來達成環境資料網的 Γ而::Γ疋有人所在之處’都可以建構成無線感測器 ...罔’而且廷些網的節點雖然是流 刻意去佈魅·f,也鱗 0但心卩疋不用 一 U維4。又錢源補充的問題。A high-speed image processing _ graphics acceleration processor 83 can be built in for high-speed image processing 'for example, using n_vidia, (10) A programming language, so that the gesture or finger 阙 and the input of the projection keyboard can be given a photo/camera Μ, 54 The image of 55 Gena is processed and processed in real time. A location data receiver 8G, such as a Global Positioning System (Gps) receiver, the Galileo satellite system, may involve the location of the mobile phone 3Q. Local wireless "face 62' such as an infrared transceiver and / or a radio frequency transceiver (for example, the Bluetooth chipset 'ZigBee module') can establish communication with nearby devices ^ • a lunch device, another mobile communication terminal Attachment [eg • brain, - TV monitor, computer monitor, a display device, or other device. The local wireless interface 62 is different from or connected to any part. The mobile phone has a built-in Bluetooth communication module, such as Bluetooth 4 (), which can receive and have a signal of ZZ, such as a wearable sensor based on the user's communication module. Such as heart rate, oximeter, sphygmomanometer, blood glucose meter, body temperature and so on. The mobile electronic device (4) can also be used as an environmental supervisor. The section of the mobile device does not require special rides. The amount of information measured by the environmental intelligence attached to the clear surface 64 of the mobile electronic device is automatically included in the temperature 22 201228332 Degree, humidity, wind speed 1 tone value, odor and ^ and indifference, record through the cloud = and particle type 屯 / '叱ύ μ and ring 堉 堉 笙 Γ: Γ: have f signal based on space coordinates Reaching the environmental information network: and: Wherever someone is located, they can all be built into wireless sensors...罔'and the nodes of the nets are deliberately going to the charms, f, but also scales 0 but the heart You don't need a U-dimensional 4. And the problem of money source supplement.
之^人的力量,所以每個人可以有效取得任何人們縱跡所 在之处周_環境狀況包含氣候狀態,因此可以查詢 提供目料速公_交通歧,_的細程度,就 整個雲端的意義而言,人們對即將前往的目的地,= 的活動,可以更有效提前獲悉,此舉非常有助於事前:;規割。 如果需要的話,甚至因為其所在位置的溫度、渴度吨自, =2空調系統是否開啟或關,兼顧人們舒適度二料 Γ’伽1’而舒姐與節能的標準或依據可以在雲端加以設The power of people, so everyone can effectively obtain the location of any people's whereabouts. _Environmental conditions include climate status, so you can query the availability of the target _ traffic, _ the degree of detail, the meaning of the entire cloud In other words, people can learn more about the upcoming destinations, = activities, which is very helpful in advance: ; If necessary, even because of the temperature and thirst of its location, =2 air conditioning system is turned on or off, taking into account people's comfort 二 伽 伽 伽 伽 而 而 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒 舒Assume
掠、ιτ足跡的s制可財常有效來推行,例如透過G〇〇aE 、擎’達成跨國的合作,既保有個別國家的存在,又可 以全球國家個別分享。 【實施例] 式、雷似電子農置ι〇可以操作於至少四種模式’包含手機模 :、㈣賦、觀會議或遊鋪模式、攝韻或照相機模 23 201228332 【貝她例一】正常的手機通話模式 如圖七所不’為正常的手機通話模式,行動電子裝置⑺ 的上4捕狀下。卩接近共平面,語音觸轉克風設置於 行動電子裝置下部的底端,至少可褒置兩個或三個,語音辨 識用麥克風是指能有料w噪音,提魏話者的語音, 〃更I”且成包3全向性麥克風數個背向性麥克風,以及一 Φ 個絲姐。若是為右手持的行動電子裝置可以在右 下角裝置—組’使用時讓骨傳導式麥克風緊_右下顎,以 接收骨傳導絲。耐_麥歧,酿少有—全向性麥克 風數個背向性麥歧,另外其左下角也裝置—組—全向性麥 克風數個㈣性麥克風’以及—鱗傳導式麥克風 。如此一 來,屯就工氣傳播的語音,就有三個分離至少兩公分的全向 性麥克風數個背向性麥克風,加上有一骨傳導式麥克風,應 • °亥足夠抓體來進行語音辨識。要注意,因為擴音器裝置於 行動電子衣置上部,因此其所產生的震動並不會傳遞至行動 電子裝置下部的骨傳導式麥克風。 另外對於監牙耳機麥克風也可以產生利用三組麥克風, 由於现牙耳機麥克風同樣可以將骨傳導式麥克風緊貼附右下 ' 、接收月傳導震動,加上二個分離至少兩公分的全向性 麥克風數個背向性麥克風,應該足夠雜體來進行語音辨識。 24 201228332 【實施例二】電腦模式/簡報分享模式 如圖八所示,智慧型 來使用,伽的方法是放置Z子/置1G可以做為一般電腦 180度,使微投影機朝前,行動=裝置上部旋轉 由第二盘第H 仃動電奸置下部置放於桌面’經 户心 麵三維量顺運算,可以確認手勢或手The s system of plucking and ιτ footprints can be implemented effectively, for example, through G〇〇aE and qing's cross-border cooperation, which preserves the existence of individual countries and can be shared by individual countries. [Embodiment] The type, the lightning-like electronic farm can be operated in at least four modes 'including the mobile phone model:, (4) Fu, the view meeting or the play mode, the rhyme or the camera mode 23 201228332 [Bei her case one] normal The mobile phone call mode is as shown in Figure 7. The normal mobile phone call mode, the mobile electronic device (7) on the top 4 catches.卩 Close to the common plane, the voice touch wind is set at the bottom of the lower part of the mobile electronic device, at least two or three can be set. The voice recognition microphone refers to the noise of the material w, the voice of the Wei, and the voice. I" and into a package of 3 omnidirectional microphones, a number of backward microphones, and a Φ silk sister. If the right hand-held mobile electronic device can be used in the lower right corner device - group 'use the bone conduction microphone tight _ right Squatting to receive bone conduction wire. Resistant to _McDi, brewing few - omnidirectional microphones, several back-oriented mais, and the lower left corner is also set - group - omnidirectional microphones (four) microphones - and Scalar-conducting microphone. As a result, there are three omnidirectional microphones with at least two centimeters separated by a back-illuminated microphone, and a bone-conducting microphone, which should be enough to catch The voice recognition is performed for the body. It should be noted that since the loudspeaker device is placed on the upper part of the mobile electronic device, the vibration generated by the loudspeaker is not transmitted to the bone conduction microphone in the lower part of the mobile electronic device. The headset microphone can also produce three sets of microphones. Since the current headset microphone can also attach the bone conduction microphone to the lower right', receive the monthly transmission vibration, plus two omnidirectional microphones separated by at least two centimeters. The back-facing microphone should be enough for the voice recognition. 24 201228332 [Embodiment 2] The computer mode/newsletter sharing mode is shown in Figure 8. The smart type is used. The method of gamma is to place Z/set 1G. For the general computer 180 degrees, so that the micro projector is facing forward, the action = the upper part of the device is rotated by the second disk, the H is moved, the lower part is placed on the desktop, and the three-dimensional amount is calculated by the user's heart surface, and the gesture or hand can be confirmed.
;三成為自然的輸入與人機介面。此處的第二與 機或9 =可加謂肖鏡’或是縣就配上有廣角鏡的攝影 使射以聽至廣角視野。第二與第三攝影機擷取 的手勢或手指頭動作,例如敲鍵盤的手指頭,使用者 = 看投影内容中的鍵盤’並且自行移動手指 =鍵盤位置,進行按壓_作。藉由崎第—攝影機的拍攝, ° 乂=斷使用者在空中的手勢或手指頭的動作是否成功與投 射内谷達成互動,例如將手細_鍵盤,加簡示於投 螢幕上’也就是說如果視敎字編輯軟體獅,就能將敲在 正確的鍵盤上的字母或符號輸人於文射,做為人機介面的 輸出入’ A部分主要是擴增實境⑽的展現。由於投影内容 ,干k ’酬的方法主要是利肋作衫發生以及是否有停 留’ 2否特定按鍵位置的影像特徵有因為手指或手勢的侵二 而改變’例如彻RGB的平均值改變等影像處理的技術,可 乂判斷4特定按鍵已經鍵入。另外手指端部也可貼附特定顏 色的標記’以利辨識。或是指甲塗上AR的.圖案’例如十個手 指頭都晝上不同編碼的AR圖案。 25 201228332 對於多數情況,行動電子震置下部可僅設置一台攝影 機’仍可將二維的運算用於處理手指的指尖位置定位,因為 物體的移動會產生光流動,可計算出較明_動作。 【實施例三】遠端視訊會議 π固几尸吓不’祝訊嘗 -------Μ从Ί文用監才斗; three become a natural input and man-machine interface. Here, the second machine or 9 = can be added to the mirror or the county is equipped with a wide-angle lens to make a wide-angle view. The gestures or finger movements captured by the second and third cameras, such as the finger on the keyboard, the user = seeing the keyboard in the projected content 'and moving the finger = keyboard position, pressing _. With the shooting of the Saki-camera, ° 乂 = break the user's gesture in the air or the action of the finger to successfully interact with the projected inner valley, for example, put the hand _ keyboard, simply on the screen 'that is It is said that if the software lion is edited by the 敎 word, the letters or symbols knocked on the correct keyboard can be input into the literary genre, and the output of the human-machine interface is mainly the display of the augmented reality (10). Due to the content of the projection, the method of paying for the pay is mainly the occurrence of the Ribs and whether there is a stop. 2 The image features of the specific button position are changed due to the intrusion of the finger or the gesture. For example, the image of the average value of the RGB changes. The processing technique can be used to determine that 4 specific keys have been typed. In addition, the end of the finger can also be attached with a mark of a specific color to facilitate identification. Or the nail is painted with an AR pattern. For example, ten fingers are attached to different coded AR patterns. 25 201228332 For most cases, only one camera can be set in the lower part of the action electronic shock. 'The two-dimensional operation can still be used to handle the fingertip position of the finger, because the movement of the object will produce light flow, which can be calculated _ action. [Embodiment 3] Far-end video conference π solid a few corpses scare no ‘ wish to taste the taste ------ Μ Ί Ί 用 用 用 用
機或是直接透過麥克顺音,來產生音訊。有_端視訊, 可以採用關或無線網,微投影機與第—攝影_前,第二 與第二攝影额麥克風朝後。行動電子製置W下部的第二 攝影機122可以將使用者的影像傳遞到對方的會議者行動: 子裝置f而對方的影像财以傳遞顺用者的行動電子^ 置上’並狀微投频投射出來。微投影機可投射對方來電 者的視訊晝面’使財較齡第二鮮彡顺奸 .風將自⑽與聲讀祕财。如果是多料話也可達 成二事貫上’行動電子襄置下部的第二與第三攝影機也可以 7成為三維攝频,如此就能傳送三維的影像給視訊會議 記錄保存。如 算服務提供翻 對於視軸料以透過魏運算服務加以 果視訊對象需要語言的_,則可以在雲端運 譯的服務模組。 智慧型行動電子裝置 器材前,投影機朝前,第 10另一使用的方法是敌置於健身 二與第三攝影機朝後,如圖三⑷ 26 201228332 所不,擷取使用者的臉以及手勢或動作,第—攝影機I。朝 前’獅投影内容以及使用者的代理虛擬人物·t㈣ Agent, VA),該VA的動作就是使用者的動作重現。藉由朝 前攝影機的拍攝,可以判斷使用者在空中的手勢是否成功與 投射内容達成互動,這部分主要是擴增實境(AR)的展現。這 個功能可來讓倾患者進行互動復健軸,加速其復 原。The machine can directly generate audio through the microphone. There is _ end video, you can use off or wireless network, micro projector and the first - photography _ before, the second and second photographic microphones are backwards. The second camera 122 in the lower part of the mobile electronic device can transmit the user's image to the opponent's conference participant action: the child device f and the other party's image is used to transmit the user's action electronic device. Projected. The micro-projector can project the video of the other party's caller's smuggling. The wind will be smuggled from the (10) and the secret reading. If there is more than one material, it can be reached. The second and third cameras in the lower part of the mobile electronic device can also be used as three-dimensional video, so that three-dimensional images can be transmitted to the video conference record. If the service provides a service that provides a language for the video object to be transmitted through the Wei operator, the service module can be translated in the cloud. In front of the smart mobile electronic device, the projector is facing forward, and the other 10th method is to enemies the fitness second and third cameras backwards, as shown in Figure 3(4) 26 201228332, to capture the user's face and gestures. Or action, the first camera. In front of the lion projection content and the user's proxy avatar t (four) Agent, VA), the action of the VA is the user's action reproduction. With the shooting of the front camera, it can be judged whether the user's gesture in the air is successful in interacting with the projected content, which is mainly the augmented reality (AR) presentation. This feature allows the patient to interact with the rehabilitation axis to speed up recovery.
【實施例四】雙攝影機或照相機模式 如圖十所示’本發明的智慧型行動電子裝置具有雙攝 影機,例如第-攝影機/照相機121,第二攝影機/照相機 122,他們之間的距離要在M公分,即可讓兩個攝影機用 於讀辨識與量測以及拍攝立體影像,這特财助於人物辨 ,,因為透過雙攝影機的拍攝,可以藉由運算得出該物體的 了’ 一方面又可以作為三維影像來觀賞。雙攝影機的 =右疋固定’根本不f «複校正,其校正參數可以在出 _就内建於該攝影機内。因此在拍攝後 :内Γ加以運算其三維尺寸,甚至透過雲端運算= 機:尺Γ可以拍攝後加以計算得出。因為只要雙攝影 械從不同面加以拍攝’即可拍揣 攝後5成,物體或人體的三 H的Γ利用三維攝影機隨時隨地進行量測。例如在實 1展不的東西’其外觀可以在展場於拍攝後 【實施例五】__爾询㈣她Γ 27 201228332 對於空間有_航,如何提 是如何岭行鱗切$ t 彻的平面,或 樣方便,可以住- 像平板電腦或筆記型電腦- 任轉勢觀看,其投射的对,描述如下: =Γ_裝置1◦上下部=: 面的換=她t物__裝置㈣[Embodiment 4] Dual camera or camera mode as shown in FIG. 10 'The smart mobile electronic device of the present invention has a dual camera, such as a camera-camera 121, a second camera/camera 122, and the distance between them is With a total of M centimeters, two cameras can be used for reading recognition and measurement, as well as for stereoscopic images. This is especially useful for character recognition, because through the shooting of a dual camera, the object can be obtained by operation. It can also be viewed as a 3D image. The double camera's = right 疋 fixed 'not at all « complex correction, its correction parameters can be built in the camera. Therefore, after the shooting: the internal Γ is calculated to its three-dimensional size, even through the cloud computing = machine: the ruler can be taken after shooting. Because as long as the two cameras are shot from different sides, you can take 50% of the shots, and the three H's of the object or the human body can be measured anytime and anywhere using a 3D camera. For example, the thing in the real exhibition is 'the appearance can be in the exhibition after the filming [Embodiment 5] __ Er inquiry (four) her Γ 27 201228332 For the space has _ voyage, how to mention how the ridge line cut $ t Plane, or convenient, can live - like a tablet or laptop - look at the trend, its projected pair, described as follows: = Γ _ device 1 ◦ upper and lower =: face change = her t _ _ device (4)
果能書桌r可朝牆壁投射,或是朝桌面投射,如 。午又手’取好是墊高行動電子裝置10 ,使Ρί岭; 射於桌面,使其成為桌上型電腦。由於是她的 ^以放置—懸掛式布幕’需要時將其拉下,其餘時問, =捲上’如此—來’可以將行動電子裝置咖置於書卓 顺影機11朝布幕投射,成為大螢幕的桌上型電填/If you can desk, you can project toward the wall or project toward the desktop, such as . In the afternoon, it is a high-powered mobile electronic device 10 that allows you to shoot on the desktop and make it a desktop computer. Because it is her ^ to put - hanging screen 'take it down when needed, the rest of the time, = roll on the 'so-to' can put the mobile electronic device on the book Zhuo Shun movie machine 11 to the curtain projection , become a large screen desktop type electric filling /
〜*在上課桌時,可以考慮朝上課桌投射,—气手拿 =仃動電子裝置1Q,另—隻手操作點選。也可以將行m 衣置1◦掛麵部’讓投影_上課桌投射,而行岭舰 2部的雙攝影機可以辨識手指尖的位置,產生類似觸控式 蛩幕的命令。 口口’坐瓜機、坐汽車、坐火車等,可以利用任何淺色或 ^色布料或紙張貼附前麵後背即可。—隻手拿著行勤電子 裝置10,另—隻手操作點選。這符合人性,即使平板,㈣, 也常常需要一隻手拿電腦,另一隻手操作。 28 201228332 5.在公園或空曠地方,可以朝地面投射,或是在草地 又大小的白紙或是白色的布即可,一售 動電子赉罢】η „ 旱者订 4置10,另—隻手操作點選。 6隹在任何地方,只要坐在椅子上,都可以投射到自己 又切上,只要麵隻賴上鋪上—張M大小的白紙或 疋色的布即可,—隻手拿著行動電子襄置10,另-隻手操 作’就像將筆電或是平板電腦放在兩隻大腿上—樣。這 相虽是閱讀電子書的模式,可以說是最普遍的操作型式。 —7. b果多人圍繞於客廳的矮桌上,可以由其中一人將 仃動電子裝置10投影機投射於矮桌上,參與者可以藉由手指 在桌面的點選或手勢產生類似觸控式螢幕的命令。 曰 〜對於上述的各種投射螢幕的方式,除了雙攝影機的擴增 實境操方式’也可以採用語音辨識的方法來進行操控。另外曰, 因為是投影機輸出,可以有多歸幕❹個畫面的同時輸 出’特別有助於觀看電視。 ⑴ 雖然本發明已以較佳實施例揭露如上,然其並非用γ 定本發明,任何熟習此技藝者,在不脫離本發明之精神和= 圍内’當可作些許之更動與潤飾’因此本發明之保護範圍= 視後附之申請專利範圍所界定者為準。 Θ 【圖式簡單說明】 圖一本發明之行動電子裝置架構圖 29 201228332 圖二本發明之行動電子裝置的元件配置圖 圖三本發明之行動電子裝置的兩種使用狀態圖 圖四手勢與手指作為本發明行動電子裝置的人機介 面流程圖 圖五本發明之多種麥克風整合運算架構圖,用於語 音辨識之語音輸入前處理 圖六本發明行動電子裝置的内部電路與電子方塊圖 • 圖七本發明行動電子裝置的手機通話模式實施例 圖八本發明行動電子裝置的電腦模式與簡報分享祺式實施 例 圖九本發明行動電子裝置的視訊會議模式/擴增實境澇敉Μ 式實施例 圖十本發明行動電子裝置的三維攝影機/照相機模式 【主要元件符號說明】 1行動電話本體 3三個攝影機 5雲端運算 101行動電子裝置上部 11.微投影機 131,132,133 麥克風 15.觸控螢幕 18.手指/擴增實境物品 21手指追縱結果 25符號手勢操作 2微型投影機 4無線麥克風/耳機 10行動電子裝置 102行動電子裝置下邻 121,122,123.攝影機 14.揚聲器 16.樞軸 19.投影幕/牆壁 22手勢模式選擇 26多手指指尖三維位艺 30 201228332 27單手指操作 271上下捲動或左右移動 28符號手勢辨識 29手寫文字辨識 30行動電話 31行動電話的電路,軟體和邏40記憶體 輯 41系統時鐘 52顯示器 53、54、55攝影機/相機 61射頻電路 6 3乙太網路控制晶片 65供電單元(PSU) 71揚聲器 80控制電路 82連接/通訊功能 42鍵盤 50視頻處理電路 51微投影機 60天線 62本地無線介面 64輸入/輸出(1/ 0)介面 70聲音信號處理電路 72、73、74麥克風 81處理裝置 83圖型加速處理器~ * When you are at the desk, you can consider projecting toward the desk, - take the hand = shake the electronic device 1Q, and the other hand-click. It is also possible to set the line m to 1 hang on the face to let the projection _ the table projection, while the two cameras of the slinger can recognize the position of the finger tip and produce a command similar to the touch screen. The mouth can be used to sit on a melon machine, take a car, take a train, etc., and you can attach the front back with any light or color cloth or paper. - Hand-held electronic device 10 is held in one hand, and the other hand is operated by clicking. This is in line with human nature. Even if the tablet, (4), it is often necessary to hold the computer with one hand and the other hand. 28 201228332 5. In the park or in an open place, you can project towards the ground, or white paper or white cloth in the grass. You can sell the electronic 赉 】 „ „ 旱 订 4 set 10, another - only 6 隹 anywhere, as long as you sit in a chair, you can project to yourself and cut it, as long as the face is only laid on a sheet of white-sized white paper or a ochre cloth. Holding the mobile electronic device 10, another - hand-operating 'like putting a laptop or a tablet on two laps. This is the most common mode of operation for reading e-books. —7. b. Many people surround the low table in the living room. One of them can project the projector of the tilting electronic device 10 on the low table. Participants can make similar touches by clicking or gestures on the desktop. The command of the control screen. 曰~ For the above-mentioned various projection screens, in addition to the dual camera's augmented reality operation mode, voice recognition can also be used for manipulation. In addition, because it is the projector output, there may be More than one screen At the same time, the output 'is particularly helpful for watching television. (1) Although the present invention has been disclosed in the preferred embodiments as above, it is not intended to be used in the present invention, and any person skilled in the art can do so without departing from the spirit and scope of the present invention. </ RTI> </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; FIG. 3 is a schematic diagram of two types of use of the mobile electronic device of the present invention. FIG. 4 is a flow chart of a human-machine interface of the mobile electronic device of the present invention. FIG. Figure 6 shows the internal circuit and electronic block diagram of the mobile electronic device of the present invention. FIG. 7 is a mobile phone call mode embodiment of the mobile electronic device of the present invention. FIG. 8 is a computer mode of the mobile electronic device of the present invention. Brief Introduction Sharing Example FIG. 9 Videoconferencing mode/Augmented reality of the mobile electronic device of the present invention涝敉Μ EMBODIMENT FIG. 10 Three-dimensional camera/camera mode of the mobile electronic device of the present invention [Description of main components] 1 mobile phone body 3 three cameras 5 cloud computing 101 mobile electronic device upper part 11. micro projector 131, 132, 133 microphone 15 Touch screen 18. Finger/Augmented reality item 21 Finger tracking result 25 symbol gesture operation 2 Micro projector 4 Wireless microphone/Headphone 10 Mobile electronic device 102 Mobile electronic device under the neighbor 121, 122, 123. Camera 14. Speaker 16. Pivot Axis 19. Projection screen / wall 22 gesture mode selection 26 multi-finger fingertips three-dimensional art 30 201228332 27 single-finger operation 271 up and down scrolling or left and right movement 28 symbol gesture recognition 29 handwritten text recognition 30 mobile phone 31 mobile phone circuit, software And logic 40 memory series 41 system clock 52 display 53, 54, 55 camera / camera 61 RF circuit 6 3 Ethernet control chip 65 power supply unit (PSU) 71 speaker 80 control circuit 82 connection / communication function 42 keyboard 50 video Processing circuit 51 micro projector 60 antenna 62 local wireless interface 64 input / output (1/ 0) interface 70 sound signal processing 73, 74 and 81 of the microphone apparatus accelerated graphics processor 83
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW99144676A TW201228332A (en) | 2010-12-20 | 2010-12-20 | Mobile electronic device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW99144676A TW201228332A (en) | 2010-12-20 | 2010-12-20 | Mobile electronic device |
Publications (1)
Publication Number | Publication Date |
---|---|
TW201228332A true TW201228332A (en) | 2012-07-01 |
Family
ID=46933594
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW99144676A TW201228332A (en) | 2010-12-20 | 2010-12-20 | Mobile electronic device |
Country Status (1)
Country | Link |
---|---|
TW (1) | TW201228332A (en) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103888699A (en) * | 2012-12-20 | 2014-06-25 | 中强光电股份有限公司 | Projection device with video function and method for video conference by using same |
CN104184961A (en) * | 2013-05-22 | 2014-12-03 | 辉达公司 | Mobile device and system used for generating panoramic video |
TWI499966B (en) * | 2013-10-08 | 2015-09-11 | Univ Nat Taiwan Science Tech | Interactive operation method of electronic apparatus |
TWI638566B (en) * | 2016-08-08 | 2018-10-11 | 魯班嫡系機器人 | A shooting method and that image forming method, apparatus and equipment |
TWI709322B (en) * | 2017-12-28 | 2020-11-01 | 仁寶電腦工業股份有限公司 | Opertation method of electonic system |
US10890653B2 (en) | 2018-08-22 | 2021-01-12 | Google Llc | Radar-based gesture enhancement for voice interfaces |
US10930251B2 (en) | 2018-08-22 | 2021-02-23 | Google Llc | Smartphone-based radar system for facilitating awareness of user presence and orientation |
US10936185B2 (en) | 2018-08-24 | 2021-03-02 | Google Llc | Smartphone-based radar system facilitating ease and accuracy of user interactions with displayed objects in an augmented-reality interface |
TWI722332B (en) * | 2018-11-13 | 2021-03-21 | 晶睿通訊股份有限公司 | Pedestrian detection method and related monitoring camera |
US11314312B2 (en) | 2018-10-22 | 2022-04-26 | Google Llc | Smartphone-based radar system for determining user intention in a lower-power mode |
TWI840916B (en) * | 2022-08-17 | 2024-05-01 | 圓展科技股份有限公司 | Output control system and method based on microphone array |
-
2010
- 2010-12-20 TW TW99144676A patent/TW201228332A/en unknown
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103888699A (en) * | 2012-12-20 | 2014-06-25 | 中强光电股份有限公司 | Projection device with video function and method for video conference by using same |
TWI629902B (en) * | 2012-12-20 | 2018-07-11 | 中強光電股份有限公司 | Projection apparatus with video conference function and method of performing video conference using projection apparatus |
CN104184961A (en) * | 2013-05-22 | 2014-12-03 | 辉达公司 | Mobile device and system used for generating panoramic video |
TWI503786B (en) * | 2013-05-22 | 2015-10-11 | Nvidia Corp | Mobile device and system for generating panoramic video |
TWI499966B (en) * | 2013-10-08 | 2015-09-11 | Univ Nat Taiwan Science Tech | Interactive operation method of electronic apparatus |
US9256324B2 (en) | 2013-10-08 | 2016-02-09 | National Taiwan University Of Science And Technology | Interactive operation method of electronic apparatus |
TWI638566B (en) * | 2016-08-08 | 2018-10-11 | 魯班嫡系機器人 | A shooting method and that image forming method, apparatus and equipment |
TWI709322B (en) * | 2017-12-28 | 2020-11-01 | 仁寶電腦工業股份有限公司 | Opertation method of electonic system |
US10890653B2 (en) | 2018-08-22 | 2021-01-12 | Google Llc | Radar-based gesture enhancement for voice interfaces |
US10930251B2 (en) | 2018-08-22 | 2021-02-23 | Google Llc | Smartphone-based radar system for facilitating awareness of user presence and orientation |
US11176910B2 (en) | 2018-08-22 | 2021-11-16 | Google Llc | Smartphone providing radar-based proxemic context |
US11435468B2 (en) | 2018-08-22 | 2022-09-06 | Google Llc | Radar-based gesture enhancement for voice interfaces |
US10936185B2 (en) | 2018-08-24 | 2021-03-02 | Google Llc | Smartphone-based radar system facilitating ease and accuracy of user interactions with displayed objects in an augmented-reality interface |
US11204694B2 (en) | 2018-08-24 | 2021-12-21 | Google Llc | Radar system facilitating ease and accuracy of user interactions with a user interface |
US11314312B2 (en) | 2018-10-22 | 2022-04-26 | Google Llc | Smartphone-based radar system for determining user intention in a lower-power mode |
US12111713B2 (en) | 2018-10-22 | 2024-10-08 | Google Llc | Smartphone-based radar system for determining user intention in a lower-power mode |
TWI722332B (en) * | 2018-11-13 | 2021-03-21 | 晶睿通訊股份有限公司 | Pedestrian detection method and related monitoring camera |
TWI840916B (en) * | 2022-08-17 | 2024-05-01 | 圓展科技股份有限公司 | Output control system and method based on microphone array |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TW201228332A (en) | Mobile electronic device | |
JP7468588B2 (en) | Information processing device, information processing system, and information processing method | |
CN110506249B (en) | Information processing apparatus, information processing method, and recording medium | |
US9792954B2 (en) | Information processing apparatus and recording medium | |
WO2021078116A1 (en) | Video processing method and electronic device | |
KR102184272B1 (en) | Glass type terminal and control method thereof | |
CN110460799A (en) | creative camera | |
US20180123813A1 (en) | Augmented Reality Conferencing System and Method | |
WO2014192552A1 (en) | Display controller, display control method, and computer program | |
KR20190013308A (en) | Mobile terminal and method for controlling the same | |
JP2014233035A (en) | Information processor, display control method and program | |
CN109600550A (en) | A kind of shooting reminding method and terminal device | |
CN107943275A (en) | Simulated environment display system and method | |
WO2018166081A1 (en) | Headset | |
WO2018000764A1 (en) | Method and device for automatic audio channel matching, and headphone | |
CN109819167A (en) | An image processing method, device and mobile terminal | |
CN111628925A (en) | Song interaction method and device, terminal and storage medium | |
US20230333850A1 (en) | Method and apparatus for generating control instruction | |
CN110086998A (en) | A kind of image pickup method and terminal | |
CN114466283B (en) | Audio acquisition method, device, electronic device and peripheral component method | |
CN110178159A (en) | Audio/video wearable computer system with integrated form projector | |
CN110134197A (en) | Wearable control equipment, virtual/augmented reality system and control method | |
CN109819188A (en) | Video processing method and terminal device | |
WO2023124972A1 (en) | Display state switching method, apparatus and system, electronic device and storage medium | |
CN113448432A (en) | Method for managing virtual conference, head-mounted display, and computer-readable storage medium |