201227163 六、發明說明： 【發明所屬之技術領域】 本發明係關於-種全景影像播放褒置 別是關於一種能夠播放 ^'、，、、，並且特 放裝置與系統。 像視續動晝之全景影像播 【先前技藝201227163 VI. Description of the Invention: [Technical Field] The present invention relates to a type of panoramic video playback device that is capable of playing ^',,,, and special devices and systems. Panoramic image broadcast like a continuous image
，像縫合技術—直是影像處理領域 會使用到相關技術。簡單』二合 ====== ，錢離虹郷縫合錢: 點’接著再將各個影像特徵點作配對動作，並 影像，合點，最後將所有影像拼接成一張更 〜。目則有需多將全景影像與虛擬實境技術結合 蚀二古立體方式呈現涵蓋36G度視角的影像，使得 :°身歷其境—般；像是Apple Quiek Time VR技術, like stitching technology - directly related to the field of image processing will use related technology. Simple 』二合 ====== , money from the rainbow 郷 stitching money: point ′ then the image feature points for the pairing action, and the image, the joint, and finally all the images into a single ~. It is necessary to combine the panoramic image with the virtual reality technology to erode the image of the 36G degree angle, which makes the image look like it; like Apple Quiek Time VR technology
Street view糊例影像與虚 然而，目前的全景影像僅能夠呈現靜止的晝面，要即時 呈現王厅、的視訊動晝十分不易。因此，針對上述問題需要一 種新的全景影像齡裝置與系絲有效減全景影像的視訊 與動晝。 【發明内容】 201227163 裝置，僅需簡單的攝影設 成全景影像，並且以虛擬 本發明揭露一種全景影像播放 備，即可將拍攝的影像即時的轉換 實境方式呈現。 、 二二二 影像播放裝置’用以顯示-環境視 每二金框述環境視訊具有複數個連續之晝框， 旦U 之第—影像 置包含Ν個視訊攝影裝置盥 =⑽像播放裝 分別用以擷取並輸出Ν個相鄰:=像：=置 於至少Ρ個視訊攝影裝置，肋接二二，接 出之Ρ個相鄰之第at個視减純置所輪 臀傻綠人炉皮“/ Λ像’並將個相鄰之第一影像進行-办像縫“王序而形成一影像區塊，其 影像區塊之-視角與—球座Ρ :理心別計算 夕h m U ,上 及}不以知不衫像區塊於球形顯示哭 ,Μ個處理器依據對應之視角與球八 ^ 。 像區塊變形轉換至球形顯示器，Μ、Ν、、Ρ為^數· λ/固影 等於…且卩小於等於Νβ ρ為自然數，小於 有：示= = 播放系統，僅需裝備 像，並且以虛擬實境方可崎咖 本發明所提出一種全景影像播放系統，用 硯讯於一球形顯示器，所述 ，.…衣士兄 框，每一晝框具有Ν個相鄰之第一景;像、。二旦=連績之晝 一儲存媒體、—第-處理器以及Μ 4 _二景^像糸統包含 儲存每-晝框之Ν個第一旦^ 處理器。儲存媒體 用以計算每-第4像處理器_儲存媒體， 第如像之一視角與一球座標，並將N個第一 201227163 成Μ組景彡像區塊’每—影像區塊包含至少p個相鄰之 〜像Μ、N、p為自然數，μ小於等於N，且p小於等 於Ν。Μ個第二處理器分職接第—處理器，每一第二處理 f對應接收Μ組影像區塊其中之—内的Ρ個相鄰之第-影 楚一 相鄰之第一影像進行一影像縫合程序，並且μ個 - ^理ϋ依據每—影像區塊中每_第—影像之視角與球座 ^ "刀別將Μ组影像區塊變形轉換至球形顯示器。 因，|發明之全景影像播縣置與祕運算—環境視 Hr 4框’將所述畫框進行影像縫合後，按照時間軸 P 序触’断呈現36。度或者72。度的全景影像 寻訊。藉此’本發明可用以顯示—環境之全角度的視訊畫 關於本發明之優點與精神可以藉由以下的發明詳述及 所附圖式得到進一步的瞭解。 【實施方式】Street view paste image and virtual However, the current panoramic image can only present a static face, it is very difficult to present the video of the royal hall. Therefore, in response to the above problems, a new panoramic image age device and a wire are required to effectively reduce the video and motion of the panoramic image. SUMMARY OF THE INVENTION The 201227163 device requires only simple photography to provide a panoramic image, and the virtual invention discloses a panoramic video playback device, which can instantly display the captured image in a real-time manner. 222. The video playback device is used for display-environmental view. The environment video has a plurality of consecutive frames. The first image of U contains one video camera 盥=(10) To capture and output one adjacent: = like: = placed in at least one video camera, the ribs are connected to the second, and the next one of the adjacent ones is reduced to the pure position. The skin "/ Λ" and the first image of the adjacent one is done - the image is stitched "Wang order to form an image block, the image block - the angle of view and the ball seat Ρ: the heart does not calculate the eve hm U On, and not to know the shirt like a block in the spherical display cry, a processor based on the corresponding perspective and the ball eight ^. If the block deformation is converted to a spherical display, Μ, Ν, Ρ is ^ λ λ / 固 固 equal to ... and 卩 is less than or equal to Ν β ρ is a natural number, less than: show = = playback system, only need to equip the image, and According to the virtual reality, the panoramic image playing system of the present invention provides a panoramic display system for use in a spherical display, wherein the frame has one adjacent first scene; image,.旦 = = 连 连 昼 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存 储存The storage medium is used to calculate each of the 4th image processor_storage medium, such as a view angle and a ball coordinate, and the N first 201227163 into a group of scenes image block 'each image block contains at least p adjacent ~ like Μ, N, p are natural numbers, μ is less than or equal to N, and p is less than or equal to Ν. Each of the second processors is connected to the first processor, and each of the second processes f corresponds to the first image of the adjacent ones of the adjacent ones The image stitching program, and μ--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Because, the invention of the panoramic image broadcast county and secret operation - the environment view Hr 4 frame, after the image frame is stitched, the time axis P sequence touches the broken 36. Degree or 72. Panoramic image of degree. The present invention can be used to display a full-angle video of the environment. The advantages and spirit of the present invention will be further understood from the following detailed description of the invention and the accompanying drawings. [Embodiment]
夕入圖’圖—鱗示根據本發明之—示範實施例 王W健魏㈣魏方塊圖。如圖所示，全景影像 播^裝置1包含Ν聽輯财置1(UxAM鑛理器12。 二,放f置1用以顯示-環境視訊於-球形顯示器 / I母Γ处理$ 10輕接於至少P個視訊攝影裝置12，且Μ 二S Ιΐϋ耦接於球形顯示器14。在這裡提到的_ ^ 或720度之視訊晝面，本發明並不加 二Π卜，所述Μ、Ν為自然數，且Μ小於等於Ν，以 下刀職述本㈣之全景影_放裝置1的元件。 201227163 N個視訊攝影裝置10分別用以擷取並輸出環境視訊 中每一晝框之N個相鄰之第一影像。於實務中，視訊攝 影裝置10可為一攝影機，每一視訊攝影裝置10可單獨拍 攝視訊，若將N個視訊攝影裝置1〇做適當的排列，則可用 以產生N個相鄰之視訊晝面，接著將所述N個視訊畫面 組合起來則可形成一環境視訊。於本發明所屬技術領域具 有通常知識者應了解視訊係由複數個連續之畫框組合^ 成在本心明組合ϊ哀境視§fl的過程中，可藉由即時組合所 述環境視訊的每一個晝框，進而由這些連續晝框 環境視訊。 ϋ㈣ 處理器12用以接收ρ個視訊攝影裝置1〇所輸出之ρ個 相鄰之第—影像，並將ρ個相鄰之第— 程序而形成-影像區塊。其巾，Ρ為自絲，且 處^ 12可連接—舰訊綱_時連接 ^ 鏡頭。於貫務上’處理器丨2可為顯示卡上的圖形處 =mPhlc Processing融，Gpu)，而每個圖形處理器可另 卜連接複數個_，崎鏡麵取視 3合來說’處理器12在進行影_^ 鄰之/ίϋ有―特定區域互縫疊，而纽^ 12再於相 此，區顧影似合㈣絲像區塊。在 tit為色彩、明亮度或者其他適當的參數之ί 自由應用任何影像混合技術 〇 ' ^ -球：以:二=計算所述影像區塊之-視角與 这办像區塊於球形顯示器14之位置，！^個 201227163 處理器12依據對應之視肖與球座標相將％個影像區塊變 形，換至球糊示器14。於實務中，每—影像區塊即為相鄰 之衫像的集合，也就是部分環境視訊的畫框，Μ個影像 區塊可透過設計而形成覆蓋72〇度影像之晝框。進一步地， Μ個處理n 12可分顧先連接至球糊示_ 14的特定顯示 區域’晝框處理完成後可即時透過球形顯示器14的特定顯示 區域顯視訊晝框，在連_放畫框的情況下，本發明之球 形顯示器14可即時顯示動態的720度環境視訊。The present invention is shown in the accompanying drawings - the exemplary embodiment of the invention, Wang W Jianwei (four) Wei block diagram. As shown in the figure, the panoramic video broadcast device 1 includes a Ν 辑 辑 置 1 (UxAM mineral processor 12. Second, put f set 1 for display - environmental video in - spherical display / I mother Γ processing $ 10 light connection At least P video cameras 12, and the second S Ιΐϋ are coupled to the spherical display 14. In the video frame of _ ^ or 720 degrees mentioned herein, the present invention does not add a second, the Μ, Ν For the natural number, and Μ is less than or equal to Ν, the following is the component of the panoramic image _ release device 1 of the syllabus (4). 201227163 N video photographic devices 10 are used to capture and output N frames of each frame in the environmental video. In the practice, the video camera device 10 can be a camera, and each video camera device 10 can separately capture video. If N video cameras 1 are properly arranged, they can be used to generate N. An adjacent video camera, and then combining the N video images to form an environmental video. Those having ordinary knowledge in the technical field of the present invention should understand that the video system is composed of a plurality of consecutive frames. In the process of §fl, this combination of mind and mind can be used by Each frame of the ambient video is combined to be visualized by the continuous frame environment. ϋ (4) The processor 12 is configured to receive ρ adjacent first images output by the video cameras 1 and ρ The adjacent ones - the program forms the image block. The towel, the Ρ is the wire, and the ^ 12 can be connected - the ship _ _ _ connect ^ lens. On the transaction 'processor 丨 2 can be displayed The graphics on the card = mPhlc Processing, Gpu), and each graphics processor can be connected to a plurality of _, Sakura mirror to view 3 together, 'Processor 12 is in the shadow _ ^ 邻 / / ϋ ―The specific areas are seamed together, and the new ^ 12 is again in this phase, and the area is like a shadow (4) silk image block. Freely apply any image mixing technique to the color, brightness, or other suitable parameters of the titer. ^ ^ - Ball: to: 2 = calculate the image block - view angle and the image block in the spherical display 14 position,! ^ 201227163 The processor 12 deforms the % image blocks according to the corresponding view and ball coordinates to the ball paster 14. In practice, each image block is a collection of adjacent shirt images, that is, a frame of some environmental video frames, and an image block can be designed to form a frame covering 72-degree images. Further, the processing n 12 can be separately connected to the specific display area of the ball paste _ 14. After the frame processing is completed, the video frame can be instantly displayed through the specific display area of the spherical display 14 in the frame. In the case of the spherical display 14 of the present invention, dynamic 720-degree environmental video can be instantly displayed.
14 球形顯示H Η可為複數個可撓式顯稀置互娜接而成 為球形，或者，球糊示器14可為—球形投影布幕搭配複數 個投影器，且這些投影器設置於球形投影布幕内部。於實務 中’只要是足以讓環境視訊呈現出球形的顯示介面，'不^ 360—度或者72〇度顯示，皆屬於本發明所述之球形顯示器娜 之範圍，本發明在此不加以限制。 ° 以下舉出本發明之-示範實施例的作動方式為例。 閱圖-、圖二Α與圖二Β’圖二Α係繪示根據本發明之二厂、 範實施例之環境視訊的示意圖。圖二B鱗示_本= 一示範實施例之影像區塊的示意圖。如圖所示，複二 攝景>裝置10可用以拍攝一環境中相鄰的視訊晝面，例士見民 經排列設計之視訊攝影裝置10可分別拍攝相^的書面σ數個 晝面20b以及晝面20c等，而這些視訊攝影裝置1〇 a 一處理器12,由處理器12將這些晝面縫合成為―; 塊20。接著’纽器12需要㈣合完叙影像區塊 示在球形顯示器14的對應區域。 ·# 201227163 射^際i 處理器12可以預設其輸出之影像區塊會顯示於 球开"頁不15 14之败部分，也就是說，處理H 12可以預設 一球座標與視角’搭配適當排列的視訊攝影裝置1G即可準破 地對應顯示拍攝_魏。另外，顯示於球糊示H 14之影 像區塊，更需經過處理！！ 12之變形轉換，如圖二B 二 使得視覺效果更佳。 不 一 ^三麟示根據本發明之—示範實施例之球形顯示器的14 The spherical display H Η can be a spherical shape for a plurality of flexible display fascinating, or the ball paste 14 can be a spherical projection screen with a plurality of projectors, and these projectors are arranged in a spherical projection Inside the curtain. In the practice, as long as it is a display interface that is sufficient for the ambient video to display a spherical shape, the display is not in the range of 360 degrees or 72 degrees, and is in the scope of the spherical display of the present invention. The present invention is not limited thereto. The following is an example of the operation mode of the exemplary embodiment of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 2 is a schematic diagram showing the environmental video of the second factory and the exemplary embodiment of the present invention. FIG. Figure 2B is a schematic diagram of an image block of an exemplary embodiment. As shown in the figure, the device 2 can be used to capture adjacent video frames in an environment. 20b and the facet 20c, etc., and these video camera devices 1a, a processor 12, are stitched by the processor 12 into "blocks 20". Then, the 'News 12' needs to be displayed in the corresponding area of the spherical display 14. · # 201227163 射 ^ i processor 12 can preset its output image block will be displayed in the ball open " page not 15 14 defeated part, that is, processing H 12 can preset a ball coordinate and perspective ' With the properly arranged video camera 1G, you can shoot the corresponding shots. In addition, the image block displayed on the ball paste H 14 needs to be processed! ! The deformation transformation of 12, as shown in Figure 2B, makes the visual effect better. </ RTI> a three-dimensional display of a spherical display according to an exemplary embodiment of the present invention
_如騎示，前狀影像區塊經變錢可由球形顯示 盗Η顯不於對應位置。在此’另一處理器12更可將 一影像區塊3〇等。如此一來，透過複數個影 ’本發明可有效呈現出—環境巾720度的即時 巧且透過組合時間轴上先後的環境影像，本發明 猎此可,4示環境視訊。 露谨ί發r另外揭露—種全景影像播放系統，除了上述揭 魏個視訊攝影褒置即時運算出環境視訊之外 口透過儲存賴與—主控電縣產生崎環境視訊。 例之ϊΐκ二，四係繪示根據本發明之另-示範實施 C播用的，方塊圖。如圖所示’全景影 所述用顯不—壤境視訊於—球形顯示器46， 個相ί以旦具f複3固連續之畫框，每-畫框具有Ν 40、一第匕王？影像播放系統4包含-儲存媒體 虚採哭處理益42、M個第二處理器44。其中，第一 -處ί接齡媒體40 ’ M個第二處理器44分別轉接第 像 = ^ 201227163 務中儲用以儲存每-畫框之N個第-影像。於實 憶體’，在硬碟、揮發故紐或者轉發式記 標，第-聽之:視角與-球座 含至少p個_之;MAf影縣塊，母—影像區塊包 於N，且P小於等、P為自然數，M小於等_If riding, the front image block can be changed by the spherical display. The bandit can not show the corresponding position. Here, the other processor 12 can further block an image block 3 or the like. In this way, the present invention can effectively present the environmental image of 720 degrees by environment and through the combined environmental images on the time axis. The present invention can be used to display environmental video. In addition to the above, Wei video is released in a panoramic video playback system. In addition to the above, a video camera is set up to calculate the ambient video. For example, κ 2 and 4 are diagrams showing a further embodiment of the present invention in accordance with the C broadcast. As shown in the figure, 'the panoramic image is used to display the image---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- The video playback system 4 includes a storage medium, a virtual crying benefit 42, and M second processors 44. Wherein, the first-to-zero age-aged media 40'M second processors 44 respectively transfer the first image = ^ 201227163 to store N first-images of each frame. In the real memory, in the hard disk, volatilization or forwarding type, the first - listening: perspective and - ball seat contains at least p _; MAf shadow block, mother-image block in N, And P is less than equal, P is a natural number, M is less than, etc.
s;(:)包，個== 具有Z視角與球座標 Ο ' ' m 一V第二處理器44對應接收M組影像區塊其中之一 - ί像二鄰序之第甘一影像，將p個相鄰之第-影像進行 π序，並且M個第二處理器44依據每一影像 i變形之視角與球座標，分別將M組影像區 ΐϋΐ球糊不器46 °於實務中，第二處理器44可 pr〇cessing 融 ’ gpu) ’ 裝設於第 a# if，σ舉例來說，第—處理11 42為個人電腦 含圖#ii'f2可裝備有多個顯示卡，每—顯示卡包 理㈢’猎此’本發明之全景影像播放系統4 裝備複數張顯示卡之個人電腦實現。 -綜t所述，本發明之全景影像播放裝置與系統可用以 顯示環丨兄之全角度的視訊晝面，應用多個圖形處理器 (GPU)輔助中央處理器（cpu)進行即時運算。換句話說°， 士發明藉由運算-環境視对的每_畫框，將所述晝框進 行影像縫合後，按照時間軸上的先後順序播放，則可呈現 度或者720度的全景影像之視訊。因此，本發明能以 簡單的攝影設備，將拍攝的影像即時的轉換成全景影像， 201227163 並且以3D虛擬實境方式墓現，給予使用者在觀看全景圖 片時能夠有如身歷其境的感受。 藉由以上較佳具體實施例之詳述，係希望能更加清楚 描述本發明之特徵與精神，而並非以上述所揭露的較佳呈 體實施例來對本發明之範脅加以限制。相反地，1目的^ : = 及具相等性的安排於本發明所欲申請s; (:) package, one == has a Z angle of view and a ball coordinate Ο ' ' m a V second processor 44 corresponding to receive one of the M group of image blocks - ί like the second neighbor of the first Gan image, will The p adjacent contiguous images are π-ordered, and the M second processors 44 respectively divide the M-group image area into a sphere according to the angle of view and the spherical coordinates of each image i. The second processor 44 can be pr〇cessing fused 'gpu) ' installed in the a# if, σ, for example, the first processing 11 42 for the personal computer with the picture #ii'f2 can be equipped with multiple display cards, each - display Card package (3) 'Hunt this' The panoramic image playback system of the present invention 4 is implemented by a personal computer equipped with a plurality of display cards. In summary, the panoramic video playback device and system of the present invention can be used to display the full-angle video plane of the ring brother, and a plurality of graphics processing units (GPUs) are used to assist the central processing unit (CPU) for real-time operations. In other words, in the case of the _ frame, the image frame is stitched by the operation-environmentally-oriented frame, and then played back in the order of time axis, and the panoramic image of 720 degrees can be presented. Video. Therefore, the present invention can instantly convert the captured image into a panoramic image with a simple photographing device, and 20127163 and present it in a 3D virtual reality manner, giving the user a feeling of being immersed when viewing the panoramic image. The features and spirit of the present invention are intended to be more apparent from the detailed description of the preferred embodiments. Conversely, 1 objective ^ : = and equivalent arrangements are to be applied for by the present invention.
圖式簡單說明】 示範實施例之全景影像播 圖一係繪示根據本發明之一 放裝置的功能方塊圖。 圖一 A係繪示根據本發明之一示範實施例之環境視 訊的不意圖。 示範實施例之影像區 圖二B係繪示根據本發明之一 塊的示意圖。 圖二係繪不根據本發明之一示範實施例之球形 。。 的示意圖。 态 圖四係繪示根據本發明之另一示範實施例之全景， 播放系統的功能方塊圖。 卜〜 【主要元件符號說明】 1 :全景影像播放裝置 10 :視訊攝影裝置 11 201227163 12 :處理器 14 ： 20、30 :影像區塊 20a、20b、20c :晝面 4:全景影像播放系統 40 42 :第一處理器 44 46 :球形顯示器 球形顯示器 儲存媒體 第二處理器BRIEF DESCRIPTION OF THE DRAWINGS A panoramic image broadcast of an exemplary embodiment is a functional block diagram of a device according to the present invention. Figure 1A is a schematic illustration of an environmental video in accordance with an exemplary embodiment of the present invention. Image Area of the Exemplary Embodiment FIG. 2B is a schematic view showing a block according to the present invention. Figure 2 depicts a sphere that is not in accordance with an exemplary embodiment of the present invention. . Schematic diagram. Figure 4 is a functional block diagram of a panoramic, playback system in accordance with another exemplary embodiment of the present invention.卜~ [Description of main component symbols] 1 : Panoramic video playback device 10 : Video capture device 11 201227163 12 : Processor 14 : 20, 30 : Image blocks 20 a , 20 b , 20 c : Face 4 : Panoramic video playback system 40 42 : first processor 44 46 : spherical display spherical display storage medium second processor
1212