[go: up one dir, main page]

TW200935164A - Dual-mode projection apparatus and method for locating a light spot in a projected image - Google Patents

Dual-mode projection apparatus and method for locating a light spot in a projected image

Info

Publication number
TW200935164A
TW200935164A TW097141444A TW97141444A TW200935164A TW 200935164 A TW200935164 A TW 200935164A TW 097141444 A TW097141444 A TW 097141444A TW 97141444 A TW97141444 A TW 97141444A TW 200935164 A TW200935164 A TW 200935164A
Authority
TW
Taiwan
Prior art keywords
projection
image
module
image sensor
projection surface
Prior art date
Application number
TW097141444A
Other languages
Chinese (zh)
Other versions
TWI400554B (en
Inventor
Ji-Zhang Shan
Jin Li
Original Assignee
Omnivision Tech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/936,746 external-priority patent/US7862179B2/en
Priority claimed from US11/936,737 external-priority patent/US8188973B2/en
Application filed by Omnivision Tech Inc filed Critical Omnivision Tech Inc
Publication of TW200935164A publication Critical patent/TW200935164A/en
Application granted granted Critical
Publication of TWI400554B publication Critical patent/TWI400554B/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0386—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry for light pen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/22—Setup operations, e.g. calibration, key configuration or button assignment
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/23—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
    • A63F13/235—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1018—Calibration; Key and button assignment
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1025—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection
    • A63F2300/1031—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection using a wireless connection, e.g. Bluetooth, infrared connections
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1043—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being characterized by constructional details
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A63F2300/1093—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6045—Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/18—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical projection, e.g. combination of mirror and condenser and objective
    • G02B27/20—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical projection, e.g. combination of mirror and condenser and objective for imaging minute objects, e.g. light-pointer

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Position Input By Displaying (AREA)
  • Projection Apparatus (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

A dual-mode projection apparatus has a projection module for projecting an image onto a projection surface. An image sensor module captures images of the projection surface and determines spatial and temporal characteristics of a visible light spot superimposed on the projection surface. A communications module transmits the spatial and temporal characteristics of the visible light spot to a remote device for remote control of the device based on the spatial and temporal characteristics of the visible light spot.

Description

200935164 六、發明說明： 【發明所屬之技術領域】 本發明大體上屬於一種數位影像投影機，係用以將一 數位影像投影至一顯示螢幕上。更具體言之，本發明係關 於一種雙模投影裝置與方法，係能投影暨擷取一影像以定 位所投影影像中之光點。 【先前技術】 數位影像投影機為一種可將數位影像投影至投影面呈 ❹ 現給觀眾之裝置。一般數位影像係於個人電腦或其他與投 影機連接之影像來源裝置處生成，如DVD播放器、 DVRs(Digital Video Recorder，數位錄放影機）、VCRs (Video Cassette Recorder，卡匣式錄放影機）、衛星接收器、 有線電視系統、或遊戲機等其他硬體。其投影面可能為一 顯示螢幕、顯示牆、或是其他可讓觀眾看到投影影像之表 面。 & 現今市面上有數種數位影像投影機，包括LCD投影機 (Liquid Crystal Display ’ 液晶顯示）、DLP 投影機（Digital Light Processing’數位影像處理）、以及LCoS投影機（Liquid Crystal on Silicon，矽基板液晶顯示）等。這類數位影像投 影機一般被用來將影像投影在大型屏幕上以供大群觀眾觀 看，像是在會議、演講、研討會、家庭劇院螢幕或是其他 需要大幅顯示區域的場合中。 於影像呈現期間，一般多會使用如雷射指標器類之指 向裝置將演說者或觀眾之注意吸引至投影面上特定的位置 3 200935164 或目標物處。雷射指標器為一種手持式的筆形裝置，其可 將-雷射光束投射至-表面區域上以在該表面產生可讓= 眾看見之雷射光點，其廣泛使用於將演說内容顯示在屏幕 上的場合中。最常見的雷射指標器至多發出i或5讀咖 之紅、綠、或藍光以避免傷害人眼。 雷射指標器上亦可能具有指令開關或按鍵以於影像呈 現期間啟動遠端控制（遙控）之基本電腦功能。舉例而言， 美國專利公開第2007/0030460號、第2006/0227107 ^、 第2006/0197756號、及美國專利公告第6,417 84〇號中皆 ，有描述其上裝設有開關之雷射指標器以遙控起始呈影主機 上各種的指令。其指令可能包含了 ：上一頁（page_up)與下 :頁（page-down)等指令以指示呈影電腦顯示新的影像内 容或頁面並將其投影在投影區域上。在一些例子中，雷射 指標器所生成之雷射光點可作為一控制游標。演說者可將 游標移至螢幕中的特定位置並藉由開關來仿真（e_叫各 ❹種位置相關之指令。 這類位置相關之指令須在雷射光點被偵測到且判定出 其於技影面上之位置的場合中才會作動。業界採用了多種 作法來疋位投影面上的雷射光點，包含了將影像感測器鱼 投影面或投影裝置整合。雷射光點之位置可為影像感測器 偵測到並藉一控制器或與影像感測器連接之電腦來判定其 位置。 舉例而言，美國專利公開第2004/0012565號中揭露了 一種互動拼接式有機發光二極體顯示器（tiled OLED)，其中 4 200935164 整合了光感冑器陣列來偵測給定顯示器區塊中的雷射光 點。一顯示控制器被連接至顯示螢幕以生成可代表該雷射 光點位置之訊號。該位置訊號會從控制器傳送至程式化過 的呈影電腦以回應該訊號並選擇性改變所顯示之影像。 再舉例而言，美國專利第6,〇5〇,69〇號與美國專利公 開第2007/0030460與2006/0170874號中有提出盘投夺裝 置整合之影像感測器，其影像感測器可用來谓測雷射指^ 器在投影面上所生成之雷射光點。該雷射光點之位置可^ 雷射指標上指令開關所生成之脈波訊號__起用來仿真 (emulate)滑鼠點擊之動作或其他投影裝置端或呈影電腦端 之指令。在-範例中，使用者可壓按雷射指標器上所裝設 之按紐來發出特定頻率之脈波。該脈波指示投影裝置監控 雷射指標器之位置變化以視為、、滑鼠拖曳夕之動作，直至 使用者再度壓下按鈕停止脈波發送。在此例中，不同的頻 率可用來作動不同的滑鼠動作。 ❹…這類型現有的投影裝置若非需要定製的投影面（如上 述之拼接式有機發光二極體顯示螢幕），就是需要具有指令 開關之雷射指標器來提供位置相關之指令給呈影裝置。使 用雷射指標器上的指令開關來仿真滑鼠指令對使用者操作 雷射指標器而言殊為不便，使用者還須分心來操作開關。 其開關於整個呈影期間容易發生錯誤或失效。 再者，現有的投影裝置與雷射指標器僅可用來協助遙 控呈影電腦。它們無法協助遙控其他裝置，像是遊戲機、 DVD播放器、衛星接收器等。 5 200935164 故此，吾人希望提出一種不使用指令開關即能夠仿真 遙控裝置（如無線滑鼠）之投影裝置，特別是—種用以定位 雷射指標器所生成雷射光點之位置的投影裝置及方法，並 使用該位置來控制一與該投影裝置連接之遠端裝置。 【發明内容】 本發明提出了一種雙模投影裝置，其具有一投影模組 用以將影像投影在投影面上。一影像感測器模組會擷取投 ❹影面之影像並判定重疊在該投影面上可見光點之時空= 徵。 本發明之一實施例中含有一光學裝置，其中的光指標 器具有電源開關（on/off)來開關光指標器。一投影裝置可將 影像投影在投影面上。該投影裝置具有—影像感測器模組 來擷取投影面之影像並判定光指標器所生成重疊在投影面 上可見光點之時空特徵。該投影裝置亦具有一通訊模組來 傳送該可見光點之時空特徵至遠端裝置並根據該可見光點 〇 之時空特徵來遙控該裝置。 ‘‘ 本發明之另一實施例中含有一種以雙模投影裝置與光 指標器控制遠端裝置之方法。雙模投影裝置中的投影模組 會將-第-影像投影在一投影面上。雙模投影裝置中所整 合之一影像感測器模組會從投影面上擷取一第二影像。影 像感測器模組會在該第二影像中偵測到一可見光點，料 見光點係由光指標器所生成。可見光點的時空特徵係藉由 影像感測器模組來判定並傳送至遠端裝置，以根據該可見 光點之時空特徵來控制該遠端裝置。 6 200935164 關於本發明之優點於精神，可以藉由以下的發明實施 例詳述及所附圖式得到進一步的暸解。 【實施方式】 下列描述係提供本發明特定的施行細節，俾使閱者徹 底瞭解這些實施例之實行方式。然該領域之熟習技藝者須 瞭解本發明亦可在不具備這些細節之條件下實行。此外， 本發明特定實施例細節描述中使用之術語將以最廣義的合 理方式解釋。 ❹ 本發明提出了一種雙模投影裝置。如一般所使用者， 投影裝置或投影機係為一種可將數位影像投影在投影面上 呈現給觀眾之裝置。舉例而言，其投影面可為一顯示螢幕、 顯示牆、或其他可像讓觀眾看到投影影像之表面。數位影 像可能於個人電腦或其他與投影裝置連接之影像來源裝置 處生成，如 DVD 播放器、DVRs (Digital Video Recorder， 數位錄放影機）、VCRs (Video Cassette Recorder，卡匣式 0 錄放影機）、衛星接收器、有線電視系統、及遊戲機等其他 硬體。 雙模投影裝置亦含有一影像感測器模組，其具有一影 像感測器與一選配之處理器。雙模投影裝置能夠將影像投 影在投影面上並從投影面上擷取影像。如一般所使用者， 影像感測器可為具有像素陣列之裝置與電路組以擷取並將 光學影像處理成電子訊號。該電子訊號可藉由影像感測器 或處理器來處理以判定其重疊在投影面數位影像上的可見 光點所對應之位置。可見光點可由一光指標器生成，其能 7 200935164 夠發送光束至一投影面上以強調投影面上之目標物與特定 位置。 圖一描繪了 一根據本發明實施例所建構之雙模投影裝 置。投影裝置100具有一投影模組105、一影像感測器模 組110、一通訊模組115、以及一校準模組12〇。投影模組 105含有特有的硬體與/或軟體例程以將數位影像投影至投 影面125上，如圖中的數位影像13〇。投影面125可為一 ❾顯示螢幕、顯示牆、或其他讓觀眾看到投影影像之表面。 數位影像130可於遠端裝置135處生成，其可能為個 .人電腦或任何其他與投影裝置1〇〇連接之影像來源裝置， =DVD 播放器、DVRs (Dighal vide〇 Ree〇rder，數位錄放 衫機）、VCRs (Video Cassette Recorder ’ 卡匣式錄放影機）、 衛星接收器、有線電視系統、以及遊戲主機等其他硬體。 數位影像130可透過無線裝置135中一無線模組（未表示） 與投影裝置100中通訊模、组115戶斤建立之無線鍵結從遠端 ❹裝置135傳至投影裝置ι〇〇。 通訊模組115可為一無線通訊模組，其包含了 一無線 接收器用以接收來自遠端裝置135之數位影像，以及一無 線發达器用以將資訊傳送至遠端裝置135。舉例而言，該 通訊模組115可為一 WiFi(Multiple Input軸响二卿二 多輸入多輸出系統）或藍芽無線模組（Bluetooth卜 須瞭解，在不偏離本發明的範疇與原則下， 與遠端裝置135間的通訊亦可藉由有線連結來實行。 例如，通訊模組115可用來提供投影裝置1〇〇與遠端裝置 8 200935164 135之間的乙太網路連結（Ethernet)。 ^舉例而言，上述傳送至遠端裝置135的資訊可包含投 衫面125上可見光點之時空特徵，如由光指標器所生 f之可見光點140。光指標器145可為任何含有光源之光 指標器，其可發出給定波長之光束，例如對應紅、綠、藍 光之波長以產生可見光點14〇。可見光點14〇可以不同的 圖樣與形狀顯現在投影面125上，如圓塊、蝴蝶形狀、游 ❹ 標形狀等等。 在實把例中，光扣標器Ϊ 45可為一含有一雷射光源 '之雷射才曰‘器，其可發出同調光束（coherent light)。在另- •實施例中，光指標器145可為一含有LED光源之光指標 器，可發出非同調光束（inc〇herentHght)。其他可發出光束 並在技〜面上產生可見光點之光源亦在本發明之範疇與原 則内。 一 ^ 根據本發明一實施例，當光指標器145面向投影面125 ©投射光束產生可見光.點14〇時，光會從投影面反射並 被投影裝置100中的影像感測器模組1〇〇感測到。影像感 2器模、组11〇可感測到其上之投影面125與可見光點_ 並操取投影面125之影像以判定可見光點⑽的時空特徵。 該時空特徵可能包含了投影面125上光點14〇之位 =、先•點140在投影面125上移動之速度與加速度、 感測器隨時間在影像上所掘取到之位置順序等其他特徵。 k些特徵可藉由所擷取影像的處理與分析來計算。 在一實施範例中，所偵測到之光點14〇位置可―且二 200935164 維座標（X，y) ’ I以投影面125之角落作為參考點（〇 〇)。抑 或’光點14〇之位置可為現時位置與_先前位置間之位 移，其初始位置係於光指標器初次開啟時決定。 ❹ ❹ 須瞭解光感測器模組110可調變來感;]光指標号⑷ 特定的波長光。舉例而言，影像感測器模組ιι〇可含有一 滤光器來擷取可見光點140之波長光並據除其他所有波長 之光資訊’包含數位影像130、投影面125、投影面125 周遭的自然光等等。在其他實施例中，影像感測器模組ιι〇 亦能夠感測所有的波長光。在此例中，影像感測器模也㈣ 1 會:。取可見光點140與投影面125上所顯示之數位影像 再者，須瞭解投影裝置100為一雙模投影裝置，其能 狗藉由投影模組105將影像投影在投影面125上並藉由影 像感測器模組11 〇擷取來自投影面之影像。 投影裝置100亦包含校準模組12〇來將影像感測器模 影模㈣及投影面125對齊，使得影像感測 β模組110可擷取到投影Φ 125上可見光點14〇之精確位 置。校準额12G可包含硬體與/或軟體例程來 測器模組UG之對準。該對準動作僅須啟動投影裝置= 將影像投影在投影面125上即可自動進行，不須要使用者 輸入任何指令。 校準模、组120亦可包含硬體與/或軟體例程來自動校 準投影模、组Η)5，以將要顯示在投影面125上的影像精確 定向’例如其可藉由進行梯形失真校正嶋咖ection) 200935164 與影像對準來將影像投入投影面125的水平與垂直 内。 您界 在-實施例中，投影模組105的自動校準可與 卿模組UG的自動校準—起進行。此功能可藉由影像^ 測器模組110擷取投影模組105在投影面125上所顯示之 影像來達成，其使用該所擷取之影像來將影樣感測器㈣ 與投影模組105對齊以將影像精確顯示在投影面125上。 ❹ 广校準模組m可判定投影模組1〇5、影像感測器模 、.且1〇及投影面125間的幾何對應以精確定位投影面⑵ 上可見光點14 0的位置性座標。 光點140的時空特徵會被藉由無線通訊模組115傳送 至遠端裝置135。遠端裝置135接收該光點14〇之時 性並使用它們來控制其一或多項功能。根據本發明之 施例，藉由光點140之位置可單獨控制遠端裝置135。在 ❹ 此例中，其運作不像現有與投影裝置一起使用來控 電^之光指標器，光指標器145上並未裳設任何開關即可 方」骨鼠壓按指令或可送出不同脈波訊號至遠端裝置以仿 真該滑鼠壓按指令。 能夠遠端襄置135可具有一無線模組（未表示），其 b=°/由模纽115傳送數位影像與接收來自投影裝置 °亦須瞭解遠端裝置135可包含控制例程來根據光 點140之位置控制其一或多項功能。 史在:實施範例中，遠端裝置135可為一電腦，所生成 之〜像係藉由投影襄置100顯示在投影面125_L，其可能 11 200935164 =於呈影期間將影像顯示給㈣的顯示螢幕，使用者可 點140照在顯示榮幕上來指示遠端電腦…執行认定 :指令’如調整投影面125上之數位影像。光點14〇:位 可被投Μ置_中的影像感測賴組〗㈣測到並科 由通訊模組115傳送至遠端電腦135。 曰 舉例而言，假使光點140位於投影面125所給定的位 f ’其指令可能代表切換至下—影像，例如對應圖示之區 ❹表了呈現特定的影像或頁面。或者，光指標器⑷ 亦可在投影面U5上進行連續的移動以指示遠端電腦135 顯示新的影像。 在此實施範例中，遠端電腦135可具有一調整例程 (咖Hng)來將投影面125上之位置調整成所顯示影像上之 位置。投影面125上之光點140位置係以投影面125尺度 之二維座標來表示。於接收到光點14〇的位置時，遠端電 腦135會使用調整例程將所接收之位置映射為表面125上 〇 所顯示影像尺度之二維座標。 ^須瞭解遠端電腦U5可能具有一從投影面映射至演說 衫像之預定映射值。亦須瞭解到，遠端電腦135與投影裝 置100連接時可判定該預定映射值並將影像投影在 幕上。 再者，須瞭解將光點丨40定位在圖示上或是使用光指 標器進行連續移動等動作可具有如同按下滑鼠按紐之相同 效果，其可能為指示與其連接之遠端電腦135顯示下一影 像。在此實施範例中，光指標器丨45可與投影裝置〗一 12 200935164 起運作當作-與遠端電腦135連接之無線滑鼠來使用。 由描實施範例令，遠端裝置135可為-遊戲機。藉 由根據所需之指令來蔣#赴τ ^ Λ 紅一 相7术將先點140定位，光指標器145可用 一：、，、-该遊戲機之遙控器。舉例而$，遊戲機US可為 二互=式遊戲，其光指標器145可用來^位投影面⑵上 測;當光點140的位置被投影裝置100中的影像感 135 m 藉 5傳送到遊戲主機 ❹ ❹ 、 主機會梵指不對目標物執行一對應該位置之 動乍，例如射擊或驅動該目標物。 f又：實施範例中’遠端裝置135可為一電視機，舉 [或5機=裝置135可為一衛星接收器、有線電視接收 視的…i(set-top box)等。光指標器145可用來作為電 、工态，其方式為藉由將光點140定位在投影面 ^一特W域中來選擇-電視頻道，例如投影面125上5 圖不可以對應投影裝置_所顯示之頻道。當光點 :::被投影裝置100中的影像感測器模組110偵測到並 2通_組115傳送到遊戲主機135時，f視機u 受扣示改變其頻道。 w 連接實施範例中’遠端裝置135可為一與電器網路 工制器。舉例而言，控制器135可為一呈 :用=影室中將投影螢幕125上的演說影像顯：給二 f以控制器135可與呈影室外的電腦網路連接。光指標 杰145可用來作為網路中電腦之遙控器，如用 電腦執行與呈影室中演說有關之動作。如其可藉兒 13 200935164 期間將光點140定位在一給定的影像上來執行電腦上的動 作。當光點140的位置被投影裝置1〇〇巾的影像感測器模 組110偵測到並藉由通訊模組115傳送到遊戲主機135 時’控制器135可送出指令至網路中的電腦以執行其動作。 ^須瞭解這些實施範例僅供作說明之目的，其他的實施 範例亦屬與本發明之範疇。亦須瞭解遠端裝置135可含有 控制例程來根據各實施範例中光點14〇之位置控制其一或 多項功能。亦須瞭解遠端裝置135可使用光點14〇之位置 來控制另-與遠端裝i 135連接之裝置，#同上面所述有 關控制器之各實施範例所示。 更須瞭解遠端裝置135可含有訓練與調變例程來將光 指標器145所生成不同的光點位置解譯成不㈣指令。舉 例而言，遠端裝置可將投影面125左上角之位置解譯為對 應下-頁之指令’將投影面125左下角之位置解譯為對應 上一頁之指令，將投影面125右上角之位置解譯為對應下 ❹一頁之指令，將投影面125左上角之位置解譯為對應一動 畫指令等等。 圖二描繪了使用雙模投影裝置之另一實施範例。在此 實施例中，投影裝置100可用來顯示影像來源裝置2〇〇所 生成之影像，該來源裝置200可藉由通訊模組115連接至 投影裝置100。可見光點140之位置同樣可藉由通訊模組 115用來與投影裝置100連接之控制遠端裝置2〇5。如同上 述圖一所示之遠端裝置135作法。 此實施例亦可用於所欲㈣之裝置非為纟成影像來讓 200935164 投影模組105顯示的場合中。舉例而言，舉例而言，遠端 裝置205可為一玩具、遊戲、或電器，其可受指示執行對 應該投影面125上可見光點14〇位置之指令。如飛行模擬 器或其他互動式遊戲，這類遊戲可根據投影面125上可見 光點140之位置執行位置相關之動作。 須瞭解遠端裝置135與遠端裝置2〇5之遠端概念係建 ^在兩者皆位於投影面125與光指標器145遠處之位置。 遂端裝置135與205可與一單一裝置中的投影裝置1〇〇整 s例如遊戲機與投影模組整合，此類設計並未悖離本 發明之範疇與原則。 〇 圖三描繪出這類型的雙模投影裝置。雙模投影裝置 300含有投影模組305、影像感測器模組31〇、通訊模组 315、以及校準模組32〇，其設置與圖一圖二中之雙模投影 4置類似。雙模投影裝置亦可含有控制模組奶來控 制裝置3GG之功能與運作來回應投影面34()所示數位影 3”上可見光點330之時空特徵。可見光點33〇係由光指 標器345所生成，係可作為裝置3〇〇之遙控器。 在，一實施範例中，裝4 300可為一整合^電腦/投影機 。光才曰標盗345可用作為-無線滑鼠來控制裝置3〇〇, 二如：數位影像在投影自340上之呈影期間控制裝置 施範例中，裝置鳩可為—整合式影像播放 穿置又光指標器345可用作為—遊戲平台來控制 =田1 行之電玩遊戲。舉例而言，光指標器⑷ 被用來將可見光點咖投射在投影面340上作為追縱或 15 200935164 射擊裝置300上所進行遊戲中之一特定物件。 須瞭解這些裝置300之使用範例係供作說明之目的。 裝置300亦可根據投影面中可見光點之時空特徵用於其他 用途中來進行控制其功能。 圖四表示了根據本發明實施例所建構一雙模投影裝置 更細部之方塊圖。雙模投影裝置100中的影像感測器模組 110包含一影像感測器400。影像感測器400可為一 CMOS(Complementary Metal Oxide Semiconductor，互補式 ❹金氧半導體）或CCD(charge couple device，電荷搞合元件） 影像感測器或其他任何能夠擷取光學影像之影像感測器類 型〇 在一實施範例中，影像感測器400可含有一用以擷取 可見光點之濾光器，如圖一中投影面125上之可見光點 140。在另一實施範例中，影像感測器400則可擷取所有的 波長光。 D 影像感測器400可具有嵌入式處理能力以於感測到投 影面125上可見光點140時判定該可見光點140之位置。 在此例中，不須設置額外的處理器來判定可見光點140之 位置，所有的處理都直接由影像感測器400進行。 圖五表示了根據本發明實施例所建構另一雙模投影裝 置之細部方塊圖。在此例中，影像感測器模組110含有影 像感測器500與處理器505。所示之影像感測器500與處 理器505可裝設在個別的晶片上。影像感測器500可為一 CMOS(Complementary Metal Oxide Semiconductor，互補式 16 200935164 金氧半導體）或CCD(charge couple device，電荷柄合元件） 影像感測器或其他任何能夠擷取光學影像之影像感測器類 型。處理器505可為一數位訊號處理器（DSP，Digital Signal Processor)、影像訊號處理器（ISP，Image Signal Processor) 或其他任何能夠與影像感測器500聯繫之處理器類型。 在一實施範例中，影像感測器500會擷取投影面125 上一可見光點140影像並將其傳送至處理器505進行分析 與處理。處理器505之後可執行影像處理例程來偵測並定 ® 位所擷取影像上之光點140。如上所述，投影面125上光 點140之二維座標或位移可由處理器505計算以遙控遠端 裝置，例如圖一中的遠端裝置135與圖二中的遠端裝置 205 ° 圖六描繪了根據本發明實施例所建構之一雙模投影裝 置更細部之方塊圖。雙模投影裝置100中的影像感測器模 組110含有整合式影像感測器/處理器晶片600。同一整合 Q 晶片600上具有一影像感測器與一處理器。其影像感測器 與處理器可能類似影像感測器500與處理器505，如圖五 中所示之兩者。在此實施範例中，單一的整合晶片600被 用來擷取顯示光點140之影像暨偵測所擷取影像中光點 140之位置。 現在請參照圖七，其中描述了根據本發明實施例一雙 模投影裝置與一光指標器控制一遠端裝置之流程圖。首先 於步驟700,雙模投影裝置中一投影模組會將影像投影在 一投影面上，如雙模投影裝置100中的投影模組105。雙 17 200935164 Γ:ΓΓ之一影像感測器模組亦會從投影面搁 = 圖一雙模投影裝置10”的影像感測器模組 二=:襄置中的投影模組與影像感測模…^ , 會又杈準以將影像與投影面精確對準。於步驟710 中，所獅影像上们貞_絲H㈣ 之光指標器所生成。200935164 VI. Description of the Invention: [Technical Field of the Invention] The present invention generally pertains to a digital image projector for projecting a digital image onto a display screen. More specifically, the present invention relates to a dual mode projection apparatus and method capable of projecting and capturing an image to locate a spot in a projected image. [Prior Art] A digital image projector is a device that projects a digital image onto a projection surface and presents it to the viewer. General digital images are generated on personal computers or other image source devices connected to the projector, such as DVD players, DVRs (Digital Video Recorder), VCRs (Video Cassette Recorder). Other hardware such as satellite receivers, cable TV systems, or game consoles. The projection surface may be a display screen, a display wall, or other surface that allows the viewer to see the projected image. & There are several digital image projectors available on the market today, including LCD projectors (Liquid Crystal Display 'liquid crystal display), DLP projectors (Digital Light Processing 'digital image processing), and LCoS projectors (Liquid Crystal on Silicon) LCD display) and so on. Such digital image projectors are typically used to project images onto large screens for viewing by a large audience, such as conferences, lectures, seminars, home theater screens, or other areas where large display areas are required. During the presentation of the image, the pointing device such as the laser indicator is generally used to attract the attention of the speaker or the viewer to a specific position on the projection surface 3 200935164 or the object. The laser pointer is a hand-held pen-shaped device that projects a laser beam onto a surface area to produce a laser spot on the surface that is visible to the public, which is widely used to display the speech content on the screen. On the occasion. The most common laser indicator emits at most i or 5 readings of red, green, or blue light to avoid harming the human eye. The laser indicator may also have command switches or buttons to initiate basic computer functions for remote control (remote control) during image presentation. For example, U.S. Patent Publication Nos. 2007/0030460, 2006/0227107^, 2006/0197756, and U.S. Patent Publication No. 6,417,84, the disclosure of which are incorporated herein by reference. Start the various instructions on the host by remote control. The instructions may include: page (page_up) and page: (page-down) commands to instruct the shadowing computer to display a new image content or page and project it onto the projected area. In some examples, the laser spot generated by the laser indicator can be used as a control cursor. The speaker can move the cursor to a specific position in the screen and simulate it by means of a switch (e_called each position-related command. Such position-related instructions must be detected at the laser spot and determined to be The position on the technical screen will be activated. The industry has adopted a variety of methods to clamp the laser spot on the projection surface, including integrating the image sensor fish projection surface or projection device. The position of the laser spot can be An image sensor detects and uses a controller or a computer connected to the image sensor to determine its position. For example, an interactive splicing organic light emitting diode is disclosed in US Patent Publication No. 2004/0012565. A body monitor (tiled OLED), in which 4 200935164 integrates a light sensor array to detect laser spots in a given display block. A display controller is connected to the display screen to generate a position representative of the laser spot. Signal. The location signal is transmitted from the controller to the stylized imaging computer to respond to the signal and selectively change the displayed image. For example, US Patent No. 6, 〇 5〇, 69〇 An image sensor integrated with a disc throwing device is disclosed in U.S. Patent Publication Nos. 2007/0030460 and 2006/0170874, the image sensor of which can be used to measure the thunder generated by the laser pointer on the projection surface. The position of the laser spot. The position of the laser spot can be used to emulate the click action of the mouse or other projection device or the computer terminal. - In the example, the user can press the button installed on the laser indicator to emit a pulse wave of a specific frequency. The pulse wave indicates that the projection device monitors the position change of the laser indicator to be regarded as, and the mouse is dragged. The action of the evening until the user presses the button again to stop the pulse wave transmission. In this example, different frequencies can be used to activate different mouse actions. ❹... This type of existing projection device does not require a customized projection surface (such as The above-mentioned spliced organic light-emitting diode display screen) requires a laser indexer with a command switch to provide a position-related command to the image forming device. The command switch on the laser indexer is used to simulate the slide. The mouse command is inconvenient for the user to operate the laser indexer, and the user must be distracted to operate the switch. The switch is prone to error or failure during the entire projection. Furthermore, the existing projection device and the laser index The device can only be used to assist remotely projecting computers. They cannot assist in remote control of other devices, such as game consoles, DVD players, satellite receivers, etc. 5 200935164 Therefore, we hope to propose a remote control device that can be simulated without using a command switch (eg A wireless mouse) projection device, in particular, a projection device and method for locating the position of a laser spot generated by a laser pointer, and using the position to control a remote device connected to the projection device. SUMMARY OF THE INVENTION The present invention provides a dual mode projection device having a projection module for projecting an image onto a projection surface. An image sensor module captures the image of the projected image and determines the time and space of the visible light spot on the projection surface. One embodiment of the invention includes an optical device in which the optical indicator has a power switch (on/off) to switch the optical indicator. A projection device projects the image onto the projection surface. The projection device has an image sensor module for capturing an image of the projection surface and determining a spatiotemporal feature of the visible light spot superimposed on the projection surface by the light indicator. The projection device also has a communication module for transmitting the spatiotemporal features of the visible light spot to the remote device and remotely controlling the device according to the spatiotemporal characteristics of the visible light spot. Another embodiment of the present invention includes a method of controlling a remote device with a dual mode projection device and a light index device. The projection module in the dual mode projection device projects the -th image onto a projection surface. An image sensor module integrated in the dual mode projection device captures a second image from the projection surface. The image sensor module detects a visible spot in the second image, and the spot is generated by the light indicator. The spatiotemporal characteristics of the visible light spot are determined by the image sensor module and transmitted to the remote device to control the remote device based on the temporal and spatial characteristics of the visible light spot. 6 200935164 The advantages of the present invention will be further understood from the following detailed description of the embodiments of the invention and the accompanying drawings. The following description provides specific implementation details of the invention, and is intended to provide a thorough understanding of the embodiments. Those skilled in the art will appreciate that the present invention may be practiced without these details. Furthermore, the terms used in the detailed description of the specific embodiments of the invention are to be construed in the ❹ The present invention proposes a dual mode projection device. As a general user, a projection device or projector is a device that projects a digital image onto a projection surface for presentation to a viewer. For example, the projection surface can be a display screen, a display wall, or other surface that allows the viewer to see the projected image. Digital images may be generated on a personal computer or other image source device connected to a projection device, such as a DVD player, DVRs (Digital Video Recorder, Digital Video Recorder), VCRs (Video Cassette Recorder, Video Cassette Recorder). Other hardware such as satellite receivers, cable TV systems, and game consoles. The dual mode projection device also includes an image sensor module having an image sensor and an optional processor. The dual mode projection device is capable of projecting an image onto a projection surface and capturing an image from the projection surface. As a general user, the image sensor can be a device and a circuit group having a pixel array to capture and process the optical image into an electronic signal. The electronic signal can be processed by an image sensor or processor to determine the position of the visible light spot that overlaps the digital image on the projection surface. The visible light spot can be generated by a light indexer, which can transmit the light beam onto a projection surface to emphasize the target and the specific position on the projection surface. Figure 1 depicts a dual mode projection device constructed in accordance with an embodiment of the present invention. The projection device 100 has a projection module 105, an image sensor module 110, a communication module 115, and a calibration module 12A. The projection module 105 contains a unique hardware and/or software routine to project a digital image onto the projection surface 125, such as the digital image 13 in the figure. The projection surface 125 can be a display screen, a display wall, or other surface that allows the viewer to see the projected image. The digital image 130 can be generated at the remote device 135, which may be a human computer or any other image source device connected to the projection device, = DVD player, DVRs (Dighal vide〇 Ree〇rder, digital recording and playback) Others, such as VCRs (Video Cassette Recorder), satellite receivers, cable TV systems, and game consoles. The digital image 130 can be transmitted from the remote device 135 to the projection device through a wireless module (not shown) in the wireless device 135 and a wireless bond established by the communication module and the group 115 in the projection device 100. The communication module 115 can be a wireless communication module that includes a wireless receiver for receiving digital images from the remote device 135 and a wireless developer for transmitting information to the remote device 135. For example, the communication module 115 can be a WiFi (Multiple Input System) or a Bluetooth wireless module (Bluetooth needs to be understood without departing from the scope and principles of the present invention. The communication with the remote device 135 can also be performed by a wired connection. For example, the communication module 115 can be used to provide an Ethernet connection between the projection device 1 and the remote device 8 200935164 135. For example, the information transmitted to the remote device 135 may include a spatiotemporal feature of the visible light spot on the shirting surface 125, such as the visible light spot 140 generated by the light indicator. The light indicator 145 may be any light source. A light indexer that emits a light beam of a given wavelength, for example, corresponding to wavelengths of red, green, and blue light to produce a visible light spot 14 〇. The visible light spot 14 〇 can appear on the projection surface 125 with different patterns and shapes, such as a circular block, The shape of the butterfly, the shape of the cursor, etc. In the example, the optical marker Ϊ 45 can be a laser device containing a laser source, which can emit a coherent light. Another - • real In an example, the light indicator 145 can be a light indicator containing an LED light source, and can emit a non-coherent light beam (inc〇herentHght). Other light sources that can emit light beams and generate visible light spots on the surface of the invention are also within the scope of the present invention. In accordance with an embodiment of the present invention, when the light director 145 faces the projection surface 125 © the projection beam to generate visible light. Point 14 ,, the light is reflected from the projection surface and is reflected by the image sensor in the projection device 100. The module 1 is sensed. The image sensor mode, the group 11 〇 can sense the projection surface 125 and the visible light point _ and take the image of the projection surface 125 to determine the spatiotemporal characteristics of the visible light spot (10). The spatiotemporal feature may include the position of the light spot 14〇 on the projection surface 125, the speed and acceleration of the movement of the point 140 on the projection surface 125, the order of the position of the sensor on the image over time, and the like. k features can be calculated by processing and analyzing the captured image. In an embodiment, the detected spot 14〇 position can be - and two 200935164 dimensional coordinates (X, y) 'I are projected The corner of face 125 serves as a reference point ( 〇). Or the position of the light spot 14〇 can be the displacement between the current position and the previous position. The initial position is determined when the light indicator is first turned on. ❹ 须 It is necessary to understand that the light sensor module 110 can be changed. Sense of light;] Light indicator number (4) Specific wavelength light. For example, the image sensor module ιι〇 can contain a filter to capture the wavelength of visible light 140 and remove all other wavelengths of light information' The digital image 130, the projection surface 125, the natural light surrounding the projection surface 125, etc. are included. In other embodiments, the image sensor module ιι〇 can also sense all wavelengths of light. In this case, the image sensor module is also (4) 1 will: Taking the visible image 140 and the digital image displayed on the projection surface 125, it should be understood that the projection device 100 is a dual-mode projection device capable of projecting the image on the projection surface 125 by the projection module 105 and by using the image. The sensor module 11 captures an image from the projection surface. The projection device 100 also includes a calibration module 12 to align the image sensor module (4) and the projection surface 125 such that the image sensing β module 110 can capture the precise position of the visible light spot 14 投影 on the projection Φ 125 . The calibration amount 12G may include the alignment of the hardware and/or software routines to the detector module UG. This alignment action only requires activation of the projection device = projection of the image onto the projection surface 125 is performed automatically, without requiring the user to enter any commands. The calibration mode, group 120 can also include hardware and/or software routines to automatically calibrate the projection mode, group 5) to accurately orient the image to be displayed on the projection surface 125, for example, by performing keystone correction. Coffee collection 200935164 Align with the image to place the image into the horizontal and vertical plane of the projection surface 125. In the embodiment, the automatic calibration of the projection module 105 can be performed in conjunction with the automatic calibration of the qing module UG. The function can be achieved by the image sensor module 110 capturing the image displayed on the projection surface 125 of the projection module 105, and using the captured image to image the sensor (4) and the projection module 105 is aligned to accurately display the image on the projection surface 125.广 The wide calibration module m can determine the geometrical correspondence between the projection module 1〇5, the image sensor module, and 1〇 and the projection surface 125 to accurately position the positional coordinates of the visible light point 140 on the projection surface (2). The spatiotemporal features of the spot 140 are transmitted to the remote unit 135 by the wireless communication module 115. The remote unit 135 receives the time of the spot 14 and uses them to control one or more of its functions. According to an embodiment of the invention, the remote unit 135 can be individually controlled by the position of the spot 140. In this case, its operation is not like the existing light fixture used with the projection device to control the light. The light indicator 145 does not have any switches on it. The bone mouse presses the command or can send different pulses. The wave signal to the remote device to simulate the mouse press command. The remote device 135 can have a wireless module (not shown), b = ° / digital image transmitted by the die 115 and received from the projection device. ° also know that the remote device 135 can contain control routines to The location of point 140 controls one or more of its functions. In the implementation example, the remote device 135 can be a computer, and the generated image is displayed on the projection surface 125_L by the projection device 100, which may be 11 200935164 = display the image to (4) during the shadowing On the screen, the user can point 140 on the display screen to indicate the remote computer... Execute the identification: the instruction 'such as adjusting the digital image on the projection surface 125. The light spot 14〇: the bit can be detected by the image sensing group in the _ _ _ (4) measured and transmitted by the communication module 115 to the remote computer 135. For example, if the spot 140 is located at a given position f ′ of the projection surface 125, the command may represent switching to the next-image, for example, corresponding to the region of the illustration to present a particular image or page. Alternatively, the light indicator (4) can also be continuously moved on the projection surface U5 to instruct the remote computer 135 to display a new image. In this embodiment, remote computer 135 can have an adjustment routine (Hng) to adjust the position on projection surface 125 to the position on the displayed image. The position of the spot 140 on the projection surface 125 is represented by a two-dimensional coordinate on the scale of the projection surface 125. Upon receiving the position of the spot 14 ,, the remote computer 135 will use the adjustment routine to map the received position to a two-dimensional coordinate of the displayed image scale on the surface 125. ^ It must be understood that the remote computer U5 may have a predetermined mapping value mapped from the projection surface to the speech shirt image. It should also be understood that the remote computer 135 can determine the predetermined mapping value and project the image onto the screen when connected to the projection device 100. Furthermore, it should be understood that the action of positioning the spot 40 on the icon or continuously moving using the light indicator may have the same effect as pressing the mouse button, which may be indicative of the remote computer 135 connected thereto. Next image. In this embodiment, the optical indicator 丨45 can be operated as a wireless mouse connected to the remote computer 135 from the projection device. By way of example, the remote device 135 can be a gaming machine. According to the required instructions, Jiang # goes to τ ^ Λ Red One Phase 7 will position 140 first, and the light indicator 145 can be used one:,,, - The remote control of the game machine. For example, the game machine US can be a two-in-one game, and the light indicator 145 can be used to measure the projection surface (2); when the position of the light spot 140 is transmitted by the image sense 135 m in the projection device 100 The game console ❹ 、 , the main opportunity van Gogh does not perform a pair of positions on the target, such as shooting or driving the target. f: In the embodiment, the remote device 135 can be a television set, or [5] = the device 135 can be a satellite receiver, a set-top box, or the like. The light indicator 145 can be used as an electric or working state by selecting the light spot 140 in the special surface of the projection surface to select a television channel, for example, on the projection surface 125, the image can not correspond to the projection device. The channel shown. When the spot:: is detected by the image sensor module 110 in the projection device 100 and the 2-way_group 115 is transmitted to the game console 135, the f-viewer u is instructed to change its channel. w In the connection example, the remote unit 135 can be an electrical network processor. For example, the controller 135 can display the speech on the projection screen 125 in the studio: the controller f can be connected to the computer network outside the presentation room. Light Indicators The Jie 145 can be used as a remote control for computers in the Internet, such as using a computer to perform actions related to speeches in the studio. If it can locate the spot 140 on a given image during 200935164, the action on the computer can be performed. When the position of the light spot 140 is detected by the image sensor module 110 of the projection device 1 and transmitted to the game host 135 by the communication module 115, the controller 135 can send an instruction to the computer in the network. To perform its actions. It is to be understood that these examples are for illustrative purposes only and that other embodiments are within the scope of the invention. It is also understood that the remote unit 135 can include control routines to control one or more of its functions in accordance with the position of the spot 14 in each embodiment. It is also to be understood that the remote unit 135 can use the position of the spot 14 to control the other device connected to the remote unit i 135, as shown in the various embodiments of the controller described above. It is further understood that the remote unit 135 can include training and modulation routines to interpret the different spot positions generated by the optical indicator 145 into no (four) instructions. For example, the remote device can interpret the position of the upper left corner of the projection surface 125 as a command corresponding to the lower page to interpret the position of the lower left corner of the projection surface 125 as an instruction corresponding to the previous page, and the upper right corner of the projection surface 125 The position is interpreted as an instruction corresponding to the next page, and the position of the upper left corner of the projection surface 125 is interpreted as corresponding to an animation instruction and the like. Figure 2 depicts another embodiment of the use of a dual mode projection device. In this embodiment, the projection device 100 can be used to display images generated by the image source device 2, and the source device 200 can be connected to the projection device 100 via the communication module 115. The position of the visible light spot 140 can also be used to control the remote device 2〇5 by the communication module 115 for connection with the projection device 100. The remote unit 135 operates as shown in Figure 1 above. This embodiment can also be used in the case where the device of the desired (4) is not an image to be displayed by the 200935164 projection module 105. For example, for example, the remote device 205 can be a toy, game, or appliance that can be instructed to execute an instruction to position the visible light spot 14 on the projection surface 125. Such as flight simulators or other interactive games, such games can perform position-dependent actions based on the position of visible spot 140 on projection surface 125. It is to be understood that the remote concept of the remote unit 135 and the remote unit 2〇5 is located at a location remote from the projection surface 125 and the optical indicator 145. The terminal devices 135 and 205 can be integrated with the projection device 1 in a single device, such as a game machine and a projection module, without departing from the scope and principles of the present invention. 〇 Figure 3 depicts this type of dual-mode projection device. The dual mode projection device 300 includes a projection module 305, an image sensor module 31, a communication module 315, and a calibration module 32A, which are similar to the dual mode projection 4 in FIG. The dual mode projection device may also include the function and operation of the control module milk to control the device 3GG in response to the spatiotemporal feature of the visible light spot 330 on the digital image 3" shown on the projection surface 34(). The visible light point 33 is controlled by the light indicator 345. The generated device can be used as a remote controller of the device. In an embodiment, the device 4 300 can be an integrated computer/projector. The light bar code 345 can be used as a wireless mouse to control the device 3 〇〇, 二如: Digital image in the example of the control device during the projection from 340, the device can be - integrated video playback wear and light indicator 345 can be used as - game platform to control = Tian 1 line For example, the light indicator (4) is used to project a visible light spot on the projection surface 340 as a specific item in the game played on the tracking device or the 15 200935164 shooting device 300. It is to be understood that these devices 300 The use of the examples is for illustrative purposes. The device 300 can also be used to control its function according to the spatiotemporal features of visible light points in the projection surface for other purposes. Figure 4 shows a pair constructed in accordance with an embodiment of the present invention. The image sensor module 110 of the dual-mode projection device 100 includes an image sensor 400. The image sensor 400 can be a CMOS (Complementary Metal Oxide Semiconductor). Oxygen semiconductor) or CCD (charge couple device) image sensor or any other type of image sensor capable of capturing an optical image. In an embodiment, image sensor 400 may include one The visible light spot filter is taken as the visible light spot 140 on the projection surface 125 in Fig. 1. In another embodiment, the image sensor 400 can capture all the wavelength light. The D image sensor 400 can The embedded processing capability is used to determine the position of the visible light spot 140 when the visible light spot 140 on the projection surface 125 is sensed. In this example, no additional processor is required to determine the position of the visible light spot 140, all processing is Directly by the image sensor 400. Figure 5 is a detailed block diagram of another dual mode projection device constructed in accordance with an embodiment of the present invention. In this example, the image sensor module 110 contains The image sensor 500 and the processor 505 can be mounted on individual wafers. The image sensor 500 can be a CMOS (Complementary Metal Oxide Semiconductor, Complementary 16 200935164). A CMOS (charge couple device) image sensor or any other type of image sensor capable of capturing an optical image. The processor 505 can be a digital signal processor (DSP, Digital Signal) Processor), Image Signal Processor (ISP) or any other type of processor that can be associated with image sensor 500. In one embodiment, image sensor 500 captures a visible spot 140 image on projection surface 125 and transmits it to processor 505 for analysis and processing. The processor 505 can then perform an image processing routine to detect and determine the spot 140 on the captured image. As described above, the two-dimensional coordinates or displacement of the spot 140 on the projection surface 125 can be calculated by the processor 505 to remotely control the remote device, such as the remote device 135 of FIG. 1 and the remote device 205 of FIG. A block diagram of a more detailed portion of a dual mode projection device constructed in accordance with an embodiment of the present invention. Image sensor module 110 in dual mode projection device 100 includes an integrated image sensor/processor chip 600. The same integrated Q wafer 600 has an image sensor and a processor. The image sensor and processor may be similar to image sensor 500 and processor 505, as shown in Figure 5. In this embodiment, a single integrated wafer 600 is used to capture the image of the display spot 140 and detect the position of the spot 140 in the captured image. Referring now to Figure 7, a flow diagram of controlling a remote device with a dual mode projection device and a light index device in accordance with an embodiment of the present invention is described. First, in step 700, a projection module in the dual mode projection device projects the image on a projection surface, such as the projection module 105 in the dual mode projection device 100. Double 17 200935164 Γ: One of the image sensor modules will also be placed from the projection surface = Figure 1 Dual-mode projection device 10" image sensor module 2 =: projection module and image sensing in the device The modulo...^ will be aligned to precisely align the image with the projection surface. In step 710, the lion image is generated by the light indicator of 贞_丝H(四).

於步驟715中，遠端裝置之遙控可藉由影像感測器模 組初次狀投影面上可見光點之時”徵來達成。於步驟 720中，該可見光點之時空特徵會藉由通訊模組被傳送至 遠端裝置，如雙模投影裝置1〇〇中的通訊模組ιΐ5。之後 於步驟725中，根據該時空特徵可控制該遠端裝置，如投 影面上可見光點之位置、速度、加速度等。 須瞭解此例中投影機裝置係整合於遠端裝置中，如同 圖三中裝置300之例子，時空特徵會被送至整合裝置中一 控制模組來控制其功能。 ❹ 圖八描繪了根據本發明實施例一雙模投影裝置之運作 實施範例。雙模投影裝置800可用來投影一數位影像，如 將數位影像8 0 5投影在投影面81 〇上。投影面可為一顯示 螢幕來顯示遠端電腦815所生成之影像。 光指標器820可於呈影期間用一可見光點來強調數位 影像805中之位置或目標物，如藉由光指標器820發出之 光束所生成之可見光點825。光指標器820為任何可在投 影面上生成可見光點之光指標器。 根據本發明實施例，雙模投影裝置800具有一投影模 18 200935164 組830、一影像感測器模組835、一通訊模組84〇、以及一 校準模組845。投影模組83〇會將數位影像8〇5投影在投 影面810上，與圖一所示投影裝置1〇〇中投影模組之 作法類似。 影像感測器模組835會偵測投影面81〇上的可見光點 825並判定其位置。如上所述者，影像感測器模組奶可 含有一影像感測器與一選配之處理器，如圖四與圖五中所 示之影像感測器模組1 1 0 〇 〇 光點825之位置可藉由通訊模組84〇傳送至遠端電腦 815’其可能為類似投景彡裝置丨⑽巾的有線或無線通訊模組 115:校準模組845會將投影模組83〇與影像感測器模組 835對準以精確定位與感測數位影像8〇5。 遠端電腦815可使用可見光點825之位置來控制其一 或多項功能。舉例而言，遠端控制電腦815可視光點825 之位置來指示呈影相關之運作，如跳至前一影像或下一影 ❹像^始-動晝、或將另一影像重疊在現時影像邮 等。 f 須瞭解退端電腦815可具有調整例程85〇來將顯示螢 幕810上的光點位置映射成以顯示螢幕81〇上所顯示影像 為尺度之位置。舉例而言，顯示螢幕810上的二維作摞 (^，y!)可對應到所顯示影像中的二維座標（X2，y2)。亦須瞭解 遠端電腦815可具有訓練與調變例程855以將光指標器 820所生成不同的絲位置解譯成上述不同的指令。丁° 圖九表不了由圖八所示雙模投影裝置8〇〇擷取與處理 19 200935164 的影像範例。影像900表示出當光指標器820將光點825 投射在顯示螢幕810上時投影裝置8〇〇影像感測器模組 835中影像感測器所感測到之光學影像。 在一實施例中，衫像感測器模組835中的影像感測器 可具有一濾光器來擷取光點825之波長以產生如所示之影 像900。在另一實施例中，影像感測器模組835中的影像 感測器亦能夠擷取除可見光點825以外之影像805。可見 ❾光點8 2 5被影像感測器視為—個區域9 0 5，其可能為螢幕 上一看起來與背景不同之彩色區域。 舉例而言，光點825可為單色光（如紅、綠、或藍光）， 其一般為一給定直徑與亮度之近圓區域。影像感測器模組 835會處理影像900來偵測並為光點825定位二維座標或 位移。處理後之影像910可含有一標記，如一十字標記91 $ 來指示光點825之位置。 須瞭解影像感測器模組835可含有影像處理例程來判 ©定該區域9〇5為光點825並計算光點825之二維座標或位 移。類例程可能包含了如物件與圖樣辨識例程、邊緣偵 測例程、與其他電腦視覺（c〇mputer visi〇n)以及景》像處理例 程等來將區域905判定為光點825以與其他所擷取影 所區別’並加以定位。 圖十表不了根據本發明實施例雙模投影裝置之另一實 施範例。雙模投影袈置胸可與光指標器ι〇〇5 一起 2端電腦1〇1〇之遙控器。與遠端電腦ι〇ι〇連結之雙模 又〜裝置1000可用於演說期間將影像投影在顯示螢幕 20 200935164 1015上。而光指標器祕則可用來將一光束投射成一光 點1020,纟可能與顯示螢幕1015上所顯示之影像重疊。 雙模投影裝置1000中的影像感測模組可藉由重疊在 圖示1025上的光點1020感測到顯示勞幕^^上所顯示之 影像並偵測到光點购之位置。投影裝置_中一傳送 模組可將該位置料至遠端電腦刪。當遠端電腦議 接到光點1G2G之位置時並判定出該光點ι_位於圖示 ©In step 715, the remote control of the remote device can be achieved by the image sensor module initializing the visible light spot on the surface. In step 720, the temporal and spatial characteristics of the visible light point are communicated by the communication module. Is transmitted to a remote device, such as the communication module ιΐ5 in the dual-mode projection device 1 。. Then in step 725, the remote device can be controlled according to the spatiotemporal feature, such as the position, speed, and Acceleration, etc. It should be understood that the projector device in this example is integrated in the remote device. As in the example of device 300 in Figure 3, the spatiotemporal feature is sent to a control module in the integrated device to control its function. According to an embodiment of the present invention, a dual-mode projection apparatus 800 can be used to project a digital image, such as a digital image 850 projected on a projection surface 81. The projection surface can be a display screen. To display the image generated by the remote computer 815. The light indicator 820 can emphasize the position or target in the digital image 805 with a visible light point during the shadowing, for example, by the light indicator 820. The visible light spot 825 generated by the light beam. The light indexer 820 is any light indicator that can generate visible light spots on the projection surface. According to an embodiment of the invention, the dual mode projection device 800 has a projection mode 18 200935164 group 830, an image The sensor module 835, a communication module 84A, and a calibration module 845. The projection module 83 投影 projects the digital image 8〇5 on the projection surface 810, and the projection device 1 shown in FIG. The method of the middle projection module is similar. The image sensor module 835 detects the visible light spot 825 on the projection surface 81 and determines its position. As described above, the image sensor module milk may contain an image sensing. And an optional processor, as shown in FIG. 4 and FIG. 5, the position of the image sensor module 1 1 0 light spot 825 can be transmitted to the remote computer 815 by the communication module 84 〇 It may be a wired or wireless communication module 115 similar to a projection device (10) towel: the calibration module 845 will align the projection module 83A with the image sensor module 835 to accurately position and sense the digital image 8 〇 5. The remote computer 815 can use the position of the visible light point 825 One or more functions are performed. For example, the remote control computer 815 can view the position of the light spot 825 to indicate the shadow related operation, such as jumping to the previous image or the next image, or Another image is superimposed on the current image mail, etc. f It is understood that the back-end computer 815 can have an adjustment routine 85 to map the position of the spot on the display screen 810 to a position on the display of the image displayed on the screen 81. For example, the two-dimensional operation (^, y!) on the display screen 810 can correspond to the two-dimensional coordinates (X2, y2) in the displayed image. It should also be understood that the remote computer 815 can have training and modulation examples. The process 855 interprets the different wire positions generated by the light indexer 820 into the different instructions described above. D. Figure 9 shows an example of an image captured and processed by the dual-mode projection device 8 shown in Figure 8. The image 900 shows the optical image sensed by the image sensor in the image sensor module 835 when the light indicator 820 projects the light spot 825 onto the display screen 810. In one embodiment, the image sensor in the portrait sensor module 835 can have a filter to capture the wavelength of the spot 825 to produce an image 900 as shown. In another embodiment, the image sensor in image sensor module 835 can also capture image 805 other than visible point 825. It can be seen that the light spot 8 2 5 is regarded by the image sensor as an area 905, which may be a color area on the screen that looks different from the background. For example, spot 825 can be a monochromatic light (such as red, green, or blue light), which is typically a near-circular area of a given diameter and brightness. Image sensor module 835 processes image 900 to detect and position two-dimensional coordinates or displacements for spot 825. The processed image 910 can contain a mark, such as a cross mark 91 $ to indicate the position of the spot 825. It is to be understood that the image sensor module 835 can include an image processing routine to determine the region 9〇5 as the spot 825 and calculate the two-dimensional coordinates or displacement of the spot 825. Class routines may include, for example, object and pattern recognition routines, edge detection routines, and other computer vision (c〇mputer visi〇n) and scene image processing routines to determine region 905 as spot 825. Distinguish from other captured images and position them. Figure 10 illustrates another embodiment of a dual mode projection apparatus in accordance with an embodiment of the present invention. The dual-mode projector can be used with the light indicator ι〇〇5 for the 2-terminal computer 1〇1〇 remote control. The dual mode connected to the remote computer ι〇ι〇 and the device 1000 can be used to project the image on the display screen 20 200935164 1015 during the speech. The light indexer can be used to project a beam of light into a spot 1020 that may overlap the image displayed on the display screen 1015. The image sensing module in the dual mode projection device 1000 can sense the image displayed on the screen and detect the location of the spot purchase by the light spot 1020 superimposed on the graphic 1025. The projection device _ medium one transmission module can feed the position to the remote computer. When the remote computer is connected to the position of the light spot 1G2G and determines that the light spot ι_ is located in the icon ©

簡内，遠端電腦聊會自動顯示下—影像並藉由雙模 投影裝置1000投影在顯示螢幕1〇15上。 圖十描繪了當投影裴置1000與光指標器1005進行 控制時遠端電腦10H)的回應。於本例中，接收到圖示聽 上光點1G2G之位置即代表顯示—新的演說影像，遠端電腦 1_會受指不跳至下—演說影像。其後該下—影像會被投 影機1_投影到顯示螢幕1G15上成為影像簡。 〜像1100包含了頁面圖示11〇5，其指示了在顯示螢 幕1015上顯示下一演說影像（頁面二）。演說者隨後可使用 光才日標^§ 10 0 5來強今固旦:ί /务11 η λ ， 水周衫像1100上的目標物，例如藉由將 光指標器1005指向顯示螢幕1〇15來產生光點111〇。 須瞭解光指標器1005可與投影裝置1000 一同運作， 作為一可操縱遠端電腦1_之無線滑鼠來使用。亦須瞭解 遠端電& 1010可能含有各種例程來解譯光指標器i⑽所 產生光點之位置以回應不同的滑鼠操作，如選擇、點擊右 鍵、點擊左鍵、拖戈等。 圖十二表示了根據本發明實施例光指標器裝置運作之 200935164 另一實施範例。在此實施範例中，投影裝置1000與—光指 標器1200 —起被用來作為一與該投影裝置1〇〇〇連接之遊 戲機的遊戲平台來使用。光指標器1200與投影震置1〇〇 一起被用來作為遊戲機1205的遙控器。 在所示的例子中，遊戲機1205係連接到投影裝置1〇〇〇 以將、、射擊鴨子之動作影像121〇投射到顯示榮幕i2i5 上。遊戲玩家可使用光指標器1200來與遊戲互動，如將光 _ 束4又射成光點1220以猫準影像1210上所示之鴨v 〇 T。 該光點1220之位置會被投影裝置1〇〇〇中的影像减測 器模組偵測到並藉由投影裝置10〇〇中的通訊模組傳送至 遊戲主機1205。於接收到位置後，遊戲主機12〇5會指示 主機記錄光點1220 ’其可能代表使用者射擊鴨子的動作 敗。 須注意此處所示的光指標器12〇0、遊戲主機12〇5、以 及遊戲影像1210僅供作說明之目的。在不悖離本發明之範 ❹4與原駐，使用本發明之投影裝置亦可控制其他遠端裝 置。 、 在優點方面，本發明之雙模投影裝置能夠讓使用者遙 控-裝置’其僅須透過將-光指標器指向所欲之位置並以 投影裝置偵測該位置等簡單動作即可達成。發明中，光指 標器可以是任何類型，包含不具有指令開關之指示器等。曰 遠端裝置可根據該光指標器所生成之可見光點位置以 模投影裝置之偵測來加以控制。 本發明並未侷限於此處所描述之特定細節特徵。在本 22 200935164 發明之精神與範轉下，其與先前描述與圖式相關之許多不 Η的發，變更是可被允許的。因此，本發明將由下述之 利申請範圍來定義涵括其所可能之修改與變更， 方之描述來界定本發明之範疇。 上 【圖式簡單說明】 贿上述詳細描述以及隨附之圖示，閱者可更清楚地 Ο ^明’其相同的元件符號係對應各圖示中相同的部 1千’其中· 置； 圖-描繪了根據本發明實施例所建構之—雙模投影裝 圖二描繪了根據本發明實施例使用雙模投 施範例； 圖二描繪了根據本發明實施例所建構之一 影裝置之實 置； 雙模投影裝 Ο 圖四描繪了圖一雙模投影裝置細部之方塊圖； 圖五描繪了圖一雙模投影裝置更細部之方塊圖. 圖六描繪了圖一雙模投影裝置更細部之方塊圖； 栌扭圖七描繪了根據本發明實施例-雙模投影裝置與一朵 曰‘器控制一遠端裝置之流程圖； 、 圖八描繪了根據本發明實施例—雙模投影褒置之 貝％範例； <# 影像^描繪了由圖人所示雙模投影裝置所擷取與處理之 圖十描繪了根據本發明實施例雙模投影裝置之另—In the case, the remote computer will automatically display the next image and project it on the display screen 1〇15 by the dual mode projection device 1000. Figure 10 depicts the response of the remote computer 10H) when the projection device 1000 is in control with the light director 1005. In this example, the position of the illuminated spot 1G2G is received to represent the display - a new speech image, and the remote computer 1_ will be fingered to the next - speech image. Thereafter, the image is projected onto the display screen 1G15 by the projector 1_ to become a simple image. The ~1100 contains a page icon 11〇5 indicating that the next speech image (page 2) is displayed on the display screen 1015. The speaker can then use the light-only Japanese standard ^§ 10 0 5 to force the current solid: ί / 务 11 η λ, the water-like shirt like the target on the 1100, for example by pointing the light indicator 1005 to the display screen 1〇 15 to produce a spot 111〇. It should be understood that the optical indicator 1005 can operate with the projection device 1000 as a wireless mouse that can manipulate the remote computer 1_. It is also important to understand that the Remote Power & 1010 may contain various routines to interpret the position of the light spot produced by the light indicator i(10) in response to different mouse operations, such as selecting, clicking the right button, clicking the left button, dragging, etc. Figure 12 shows another embodiment of 200935164 operation of the optical indicator device in accordance with an embodiment of the present invention. In this embodiment, the projection device 1000 is used with the optical indexer 1200 as a gaming platform for a game machine connected to the projection device 1A. The light indexer 1200 is used together with the projection shake 1 作为 as a remote controller of the gaming machine 1205. In the illustrated example, the gaming machine 1205 is coupled to the projection device 1A to project the action image 121 of the shooting duck onto the display screen i2i5. The game player can use the light indicator 1200 to interact with the game, such as shooting the light beam 4 into spot 1220 to display the duck v 〇 T on the cat image 1210. The position of the spot 1220 is detected by the image subsizer module in the projection device 1 and transmitted to the game console 1205 by the communication module in the projection device 10. Upon receiving the location, the game console 12〇5 will instruct the host to record the spot 1220' which may represent the user's action to shoot the duck. It should be noted that the optical indicator 12 〇 0, the game console 12 〇 5, and the game image 1210 shown here are for illustrative purposes only. Other remote devices can be controlled using the projection apparatus of the present invention without departing from the invention and the present invention. In terms of advantages, the dual mode projection device of the present invention enables the user to remotely control the device to be achieved simply by pointing the light indicator to the desired position and detecting the position by the projection device. In the invention, the optical indexer can be of any type, including an indicator without an instruction switch, and the like.远程 The remote device can be controlled by the detection of the visible light spot generated by the optical indicator by the analog projection device. The invention is not limited to the specific details described herein. In the spirit and scope of the invention, it is permissible to change many of the inconsistencies associated with the previous description and the schema. Accordingly, the invention is intended to be defined by the scope of the invention [Simplified description of the drawings] Bribes the above detailed description and accompanying illustrations, the reader can more clearly 明 ming 'the same component symbol corresponds to the same part of each figure 1 thousand '. - Depicted in accordance with an embodiment of the present invention - Dual Mode Projection FIG. 2 depicts an example of using a dual mode application in accordance with an embodiment of the present invention; FIG. 2 depicts the implementation of a shadow device constructed in accordance with an embodiment of the present invention. Figure 2 depicts a block diagram of a detail of a dual-mode projection device. Figure 5 depicts a more detailed block diagram of the dual-mode projection device. Figure 6 depicts a more detailed view of the dual-mode projection device. FIG. 7 depicts a flow diagram of a dual mode projection device and a remote device controlling a remote device in accordance with an embodiment of the present invention; FIG. 8 depicts a dual mode projection device in accordance with an embodiment of the present invention. Example of a double-mode projection device according to an embodiment of the present invention, which depicts a drawing and processing by a dual-mode projection device shown by a figure.

W 23 200935164 施範例； 圖十一描繪出根據本發明實施例一遠端裝置A 施範例中雙模投影裝置控制之示意圖；及 圖十二描繪了根據本發明實施例雙模投影裝 【主要元件符號說明】 100 投影裝置 105 投影模組W 23 200935164 Example; FIG. 11 is a schematic diagram showing control of a dual mode projection device in a remote device A embodiment according to an embodiment of the present invention; and FIG. 12 depicts a dual mode projection device according to an embodiment of the present invention. Symbol Description] 100 Projection Device 105 Projection Module

110 影像感測器模組 115 通訊模組 120 校準模組 125 投影面 130 數位影像 135 遠端裝置 140 光點110 Image Sensor Module 115 Communication Module 120 Calibration Module 125 Projection Surface 130 Digital Image 135 Remote Device 140 Spot

實施範例 置之又 145 光指標器 2〇〇 來源裝置 205 遠端裝置 300 裝置 3〇5 投影模組 310 影像感測器模組 315 通訊模組 320 校準模組 325 控制模組 24 200935164 330 光點 335 數位影像 340 投影面 345 光指標器 400 影像感測器 500 影像感測器 600 晶片 步驟 700, 705, 710, 715, 720, 725Example 145 optical indicator 2 〇〇 source device 205 remote device 300 device 3 〇 5 projection module 310 image sensor module 315 communication module 320 calibration module 325 control module 24 200935164 330 light spot 335 Digital Image 340 Projection Surface 345 Light Indicator 400 Image Sensor 500 Image Sensor 600 Wafer Steps 700, 705, 710, 715, 720, 725

800 雙模投影裝置 805 數位影像 810 投影面 815 遠端電腦 820 光指標器 825 光點 830 投影模組 835 影像感測器模組 840 通訊模組 845 校準模組 850 調整例程 855 訓練與調變例程 900 影像 905 區域 910 影像 915 十字標記 25 200935164 1000 1005 1010 1015 1020 1025 1100 1105 ® 1110 1200 1205 1210 1215 1220 雙模投影裝置 光指標器 遠端電腦 顯示螢幕 光點 圖不' 影像 影像 光點 光指標器 遊戲機 影像 顯示螢幕 光點800 dual-mode projection device 805 digital image 810 projection surface 815 remote computer 820 light indicator 825 light point 830 projection module 835 image sensor module 840 communication module 845 calibration module 850 adjustment routine 855 training and modulation Routine 900 Image 905 Area 910 Image 915 Cross Mark 25 200935164 1000 1005 1010 1015 1020 1025 1100 1105 ® 1110 1200 1205 1210 1215 1220 Dual Mode Projector Light Indicator Remote Computer Display Screen Spot Image No ' Image Image Spot Light Indicator game machine image display screen spot

2626

Claims (1)

200935164 七、申請專利範圍： 1. 一種雙模投影裝置，包含： 投影面上； 投影模組，用以將一影像投 二影像感測器模組’用以擷取該投影面之影像並判定重 疊於該投影面上一可見光點之時空特徵；及 一通訊模、组’用以傳送該可見光點<時空特徵至一遠端 裝置以根據該可見光點之時空特徵遙控該遠端裝置。 2.如請求項丨所述之雙模投影裝置，其中該時空特徵包 含：該投影面上該可見光點之位置、該投影面上該可見 光點之速度、該投影面上該可見光點之加速度、以及於 该影像投影在該投影面期間該投影面上該可見光點之 位置順序。 3.如％求項2所述之雙模投影裝置，其中該遠端裝置可根 〇 據該可見光點之位置來控制。 4·如請求項1所述之雙模投影裝置，更包含一校準模組用 以將該影像感測器模組與該投影模組對準。 5·如請求項1所述之雙模投影裝置，其中該影像感測器模 組包含一影像感測器。 6 .如請求項5所述之雙模投影裝置，其中該影像感測器被 27 200935164 5周變來感測特定的波長光。200935164 VII. Patent application scope: 1. A dual-mode projection device, comprising: a projection surface; a projection module for using an image to cast a second image sensor module for capturing the image of the projection surface and determining a space-time feature superimposed on a visible light spot on the projection surface; and a communication mode, the group 'to transmit the visible light point < spatiotemporal feature to a remote device to remotely control the remote device according to the spatiotemporal feature of the visible light spot. 2. The dual mode projection device of claim 2, wherein the spatiotemporal feature comprises: a position of the visible spot on the projection surface, a velocity of the visible spot on the projection surface, an acceleration of the visible spot on the projection surface, And a position sequence of the visible light points on the projection surface during the projection of the image on the projection surface. 3. The dual mode projection device of item 2, wherein the remote device is controllable according to a position of the visible spot. 4. The dual mode projection device of claim 1, further comprising a calibration module for aligning the image sensor module with the projection module. 5. The dual mode projection device of claim 1, wherein the image sensor module comprises an image sensor. 6. The dual mode projection device of claim 5, wherein the image sensor is changed by 27 200935164 to sense a particular wavelength of light. 如請求項 組更包含 1所述之雙模投影裝置，其中該影像感測 一處理器。 器模 8.如:求項！所述之雙模投影裝置，其中該通訊模 一無線通訊模組。 求項8所述之雙模投影裝置，其中該通訊模組包含 -接收器用以接收來自該遠端裝置之影像。 10·如明求項1所述之雙模投影裝置，其中該位置包含一位 移位置。 11. 如„月求項1〇所述之雙模投影裝置，其中該位移位置係 〇 根據投影面中的參考點來決定。 12. 如請求項10所述之雙模投影裝置，其中該位移位置係 根據該可見光點之一先前位置來決定。 13. 如請求項1所述之雙模投影裝置，其中該遠端裝置包 含：呈影電腦；遊戲機、DVD播放器（Digital Versatile Disc ’ 數位多功能光碟）、dVRs (Digital video Recorder ’數位錄放影機）、機上盒（set_t〇p b〇x)、有線 28 200935164 電視接收器 衛星接收器、娛樂單元、以及電視 電源開關來開關該光指標器；及 影像投影至一投影面上，該投影 14. 一光學裝置，包含： 一光指標器，其具有一 一投影裝置，用以將一 裝置包含： 以影像感測器模組，用以擷取該投影面上之影像並判 ❹ 定重疊在該投影面上可見光點之時空特徵；及 一通訊模組，用以傳送該可見光點之 端裝置以根據該可見光點之時空特批 " 〜砰工将徵遙控該遠端裝 置。 15.如請求項14所述之光學裝置，其中該投影裝置包含一 投影模纟且，用以將影像投影至該投影面上。 ❹I6.如請求項15所述之光學裝置，更包含—校準模組用已 將該影像感測器模組與該投影模組對準。 17. 如請求項14所述之光學裝置，其中該影像感測器模組 包含一影像感測器。 18. 如請求項17所述之光學裝置，其中該影像感測器模組 更包含一處理器° 29 200935164 19. 如請求項18所述之光學裝置，其中該影像感測器與該 處理器襄設在個別的晶片上。 20. 如請求項18所述之光學裝置，其中該影㈣測器與該 處理器整合在單一晶片上。 21·'— 種 ❹ 由雙模投影裝置與光指標器來控制遠端裝置的 方法，包含下列步驟： 以該雙模投影裝置中的一投影模組將—第一 至一投影面上； 影像投影 影像感測器模組擷取該 以該雙模投影裝置中整合之 投影面上一第二影像； 以該影像感測器模組偵測該第二影像中一 可見光點係以該光指標器所生成； 九”以 〇 以忒衫像感測器模組判定該可見光點之時空特徵. 將該可見光點之時空特徵傳送至一遠端裝置；’丄， 根據該可見光點之時空特徵控制該遠端裝置1 以該投影模組校準該 22·如凊求項21所述之方法’更包含 影像感測器模組。 23.如請求項21所述之方法，更包合 .A 文1 3將该可見光點之位置 映射為該第一影像中之位置。 200935164 24. —裝置，包含： 一投影模組，用以將一影像投影至一投影面上； 一影像感測器模組，用以擷取該投影面之影像並判定重 疊在該投影面上可見光點之時空特徵；及 一控制模組，根據該可見光點之時空特徵控制該裝置。 25. 如請求項24所述之裝置，其中該裝置包含：電腦、遊 戲機、DVD播放器（Digital Versatile Disc，數位多功能 ® 光碟）、DVRs (Digital Video Recorder，數位錄放影機）、 機上盒（set-top box)、有線電視接收器、衛星接收器、 娛樂單元、以及電視。 〇 31The request item group further includes the dual mode projection device of 1, wherein the image senses a processor. Mode 8. For example: Item! The dual mode projection device, wherein the communication module is a wireless communication module. The dual mode projection device of claim 8, wherein the communication module includes a receiver for receiving images from the remote device. 10. The dual mode projection device of claim 1, wherein the location comprises a one-bit shift position. 11. The dual mode projection device of the present invention, wherein the displacement position is determined according to a reference point in the projection surface. 12. The dual mode projection device of claim 10, wherein the displacement The position is determined according to the previous position of one of the visible spots. 13. The dual mode projection device of claim 1, wherein the remote device comprises: a video player; a game machine, a DVD player (Digital Versatile Disc 'digital Multi-function disc), dVRs (Digital video Recorder 'digital recorder>), set-top box (set_t〇pb〇x), cable 28 200935164 TV receiver satellite receiver, entertainment unit, and TV power switch to switch the light indicator And an image projected onto a projection surface, the projection 14. An optical device comprising: an optical indicator having a projection device for including a device: an image sensor module for Obtaining an image on the projection surface and determining a spatiotemporal feature of the visible light spot superimposed on the projection surface; and a communication module for transmitting the end point of the visible light point According to the time and space of the visible light point, the remote device is remotely controlled. The optical device according to claim 14, wherein the projection device comprises a projection module and is used for projecting an image to The optical device of claim 15 further comprising - the alignment module has aligned the image sensor module with the projection module. 17. The method of claim 14 The optical device, wherein the image sensor module comprises an image sensor. 18. The optical device of claim 17, wherein the image sensor module further comprises a processor. 29 200935164 19. The optical device of item 18, wherein the image sensor and the processor are disposed on an individual wafer. The optical device of claim 18, wherein the image sensor is integrated with the processor On a single wafer. 21·'- ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ ❹ Image projection image The sensor module captures a second image on the projection surface integrated in the dual-mode projection device; and the image sensor module detects a visible light point in the second image to the optical indicator device生成 九 判定 判定 忒 忒 忒 像 像 像 像 像 像 像 像 像 像 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定 判定The end device 1 calibrates the method according to the projection module 21 with the projection module, and further includes an image sensor module. 23. The method of claim 21, further comprising .A1 1-3 mapping the location of the visible spot to a location in the first image. 200935164 24. The device comprises: a projection module for projecting an image onto a projection surface; an image sensor module for capturing an image of the projection surface and determining to overlap the projection surface a temporal and spatial characteristic of the visible light point; and a control module that controls the device according to the temporal and spatial characteristics of the visible light point. 25. The device of claim 24, wherein the device comprises: a computer, a game console, a DVD player (Digital Versatile Disc), a DVR (Digital Video Recorder), and an onboard Set-top box, cable TV receiver, satellite receiver, entertainment unit, and TV. 〇 31
TW097141444A 2007-11-07 2008-10-28 Dual-mode projection apparatus and method for locating a light spot in a projected image TWI400554B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/936,746 US7862179B2 (en) 2007-11-07 2007-11-07 Dual-mode projection apparatus and method for locating a light spot in a projected image
US11/936,737 US8188973B2 (en) 2007-11-07 2007-11-07 Apparatus and method for tracking a light pointer

Publications (2)

Publication Number Publication Date
TW200935164A true TW200935164A (en) 2009-08-16
TWI400554B TWI400554B (en) 2013-07-01

Family

ID=40626122

Family Applications (2)

Application Number Title Priority Date Filing Date
TW097141444A TWI400554B (en) 2007-11-07 2008-10-28 Dual-mode projection apparatus and method for locating a light spot in a projected image
TW097141436A TWI375898B (en) 2007-11-07 2008-10-28 Apparatus and method for tracking a light pointer

Family Applications After (1)

Application Number Title Priority Date Filing Date
TW097141436A TWI375898B (en) 2007-11-07 2008-10-28 Apparatus and method for tracking a light pointer

Country Status (4)

Country Link
EP (2) EP2218252A4 (en)
CN (2) CN101896867B (en)
TW (2) TWI400554B (en)
WO (2) WO2009061619A2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI400556B (en) * 2009-11-30 2013-07-01 Pegatron Corp Multimedia projecting device and controlling method thereof
TWI701497B (en) * 2018-10-17 2020-08-11 英錡科技股份有限公司 Projection device with auto-correction of spots

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
HK1147897A2 (en) * 2011-02-14 2011-08-19 Centek Internat Hk Ltd Game apparatus and method of use thereof
CN102509068A (en) * 2011-10-09 2012-06-20 海信集团有限公司 Method and device for projecting
CN102682637A (en) * 2012-05-05 2012-09-19 山东长征教育科技有限公司 Omnibearing interactive wired teaching system
CN102915126B (en) * 2012-09-29 2016-03-02 深圳创维数字技术有限公司 A kind of method, Apparatus and system of light ray remote-control location
CN103595469A (en) * 2013-02-02 2014-02-19 彭海涛 Infrared photoconduction remote control system
US9002112B2 (en) * 2013-08-27 2015-04-07 Trimble Navigation Limited Video alignment system
JP2015158644A (en) * 2014-02-25 2015-09-03 カシオ計算機株式会社 Projection device, projection method, and program
CN104142739B (en) * 2014-08-12 2017-05-17 广东顺德中山大学卡内基梅隆大学国际联合研究院 Laser point tracking system and method based on optical mouse sensing array
US9423278B1 (en) 2015-03-09 2016-08-23 Laser Projection Technologies, Inc. 3D laser projection, scanning and object tracking
TWI684058B (en) * 2016-09-13 2020-02-01 揚明光學股份有限公司 Projection system
CN106610490A (en) * 2016-12-30 2017-05-03 北京大学 Optical positioning method, system and device based on LED and image sensor
JP6941976B2 (en) * 2017-06-06 2021-09-29 株式会社コーエーテクモゲームス User interface processing program, recording medium, user interface processing method
DE102017010079A1 (en) * 2017-10-30 2019-05-02 Michael Kaiser Device with an object and its control
CN112702586B (en) * 2020-12-21 2023-06-30 极米科技股份有限公司 Virtual touch tracking method, device and system for projector based on visible light
CN113440841B (en) * 2021-07-14 2023-11-17 网易（杭州）网络有限公司 Virtual character control method and device, electronic equipment and readable storage medium

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5477284A (en) * 1994-12-15 1995-12-19 Texas Instruments Incorporated Dual mode overhead projection system using field emission device
JPH0980372A (en) * 1995-09-07 1997-03-28 Toshiba Corp Projection display device
US6050690A (en) * 1998-01-08 2000-04-18 Siemens Information And Communication Networks, Inc. Apparatus and method for focusing a projected image
JP2000276297A (en) * 1999-03-25 2000-10-06 Seiko Epson Corp Pointing position detecting device, pointing position detecting method, presentation system, and information storage medium
US6275214B1 (en) * 1999-07-06 2001-08-14 Karl C. Hansen Computer presentation system and method with optical tracking of wireless pointer
US20010010514A1 (en) * 1999-09-07 2001-08-02 Yukinobu Ishino Position detector and attitude detector
US20010030668A1 (en) * 2000-01-10 2001-10-18 Gamze Erten Method and system for interacting with a display
US6704000B2 (en) * 2000-11-15 2004-03-09 Blue Iris Technologies Method for remote computer operation via a wireless optical device
US6736517B2 (en) * 2001-02-28 2004-05-18 Principia Lightworks Inc. Dual mode laser projection system for electronic and film images
TW522283B (en) * 2002-06-27 2003-03-01 Avermedia Tech Inc A boundary indicator of a projector
JP3867205B2 (en) * 2002-08-30 2007-01-10 カシオ計算機株式会社 Pointed position detection device, pointed position detection system, and pointed position detection method
US6979087B2 (en) * 2002-10-31 2005-12-27 Hewlett-Packard Development Company, L.P. Display system with interpretable pattern detection
US7038661B2 (en) * 2003-06-13 2006-05-02 Microsoft Corporation Pointing device and cursor for use in intelligent computing environments
US6805451B1 (en) * 2003-11-12 2004-10-19 Cinetron Technology Inc. Horizontal/vertical dual-mode LCD projector
KR20050069828A (en) * 2003-12-31 2005-07-05 엘지전자 주식회사 Projection device of high resolution
CN1674654A (en) * 2004-03-25 2005-09-28 乐金电子（沈阳）有限公司 Rear-projection television and picture protection function releasing method
US7683881B2 (en) * 2004-05-24 2010-03-23 Keytec, Inc. Visual input pointing device for interactive display system
US7746321B2 (en) * 2004-05-28 2010-06-29 Erik Jan Banning Easily deployable interactive direct-pointing system and presentation control system and calibration method therefor
KR20070105322A (en) * 2005-02-10 2007-10-30 유겐가이샤 타크람 디자인 엔지니어링 Pointer light tracking method, program and recording medium thereof
US20060197742A1 (en) * 2005-03-04 2006-09-07 Gray Robert H Iii Computer pointing input device
KR100740660B1 (en) * 2005-11-16 2007-07-19 한양대학교 산학협력단 Mobile communication terminal having laser pointer and presentation providing system using same
TWI305892B (en) * 2005-11-23 2009-02-01 Inst Information Industry Apparatus, computer equipment, method and computer readable media for simultaneously controlling a cursor and an optical pointer
CN100504576C (en) * 2005-12-05 2009-06-24 财团法人资讯工业策进会 Device and method for synchronous operation of cursor and optical projection

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI400556B (en) * 2009-11-30 2013-07-01 Pegatron Corp Multimedia projecting device and controlling method thereof
TWI701497B (en) * 2018-10-17 2020-08-11 英錡科技股份有限公司 Projection device with auto-correction of spots

Also Published As

Publication number Publication date
CN101896867B (en) 2012-01-25
EP2208112A2 (en) 2010-07-21
EP2218252A1 (en) 2010-08-18
TW200933452A (en) 2009-08-01
WO2009061620A1 (en) 2009-05-14
WO2009061619A2 (en) 2009-05-14
CN101919241A (en) 2010-12-15
EP2208112A4 (en) 2012-06-27
CN101896867A (en) 2010-11-24
EP2218252A4 (en) 2013-02-27
TWI400554B (en) 2013-07-01
CN101919241B (en) 2013-09-18
TWI375898B (en) 2012-11-01
WO2009061619A3 (en) 2009-08-06

Similar Documents

Publication Publication Date Title
TW200935164A (en) Dual-mode projection apparatus and method for locating a light spot in a projected image
US7862179B2 (en) Dual-mode projection apparatus and method for locating a light spot in a projected image
US8188973B2 (en) Apparatus and method for tracking a light pointer
CN1290320C (en) Remote control system and method for a television receiver
JP5428600B2 (en) Projector, image projection system, and image projection method
US20070115254A1 (en) Apparatus, computer device, method and computer program product for synchronously controlling a cursor and an optical pointer
US20120098744A1 (en) Systems, methods, and apparatuses for spatial input associated with a display
JP2009050701A (en) Interactive picture system, interactive apparatus, and its operation control method
US10423282B2 (en) Display apparatus that switches modes based on distance between indicator and distance measuring unit
JP2016189517A (en) Display device, control method of display device, painting camera, and control method of painting camera
US20230130815A1 (en) Image processing apparatus, image processing method, and program
JP6404483B2 (en) Ranging device, ranging control method, and ranging control program
JP6098153B2 (en) Display device and control method of display device
TW201435656A (en) Information technology device input systems and associated methods
JP5115496B2 (en) Content remote control system and remote control terminal
CN113965740A (en) Projection equipment and control method thereof
KR20170057056A (en) Remote Control Apparatus, Driving Method of Remote Control Apparatus, Image Display Apparatus, Driving Method of Image Display Apparatus, and Computer Readable Recording Medium
JP2009015473A (en) Pointing device, indication position specifying device, information presenting system, and program
KR100596140B1 (en) Remote control device with built-in camera and pointing method using the same
JP2007213197A (en) Coordinate designation device
JP2015053734A (en) Projector, image projection system, and image projection method
JP2013238891A (en) Projector, image projection system, and image projection method
WO2022163835A1 (en) Projection control method and projection control device
CN117044225A (en) Registration system, air conditioning system, and registration program
JP2016151924A (en) Projector and control method therefor