[go: up one dir, main page]

CN104168407A - How to shoot panoramic images - Google Patents

How to shoot panoramic images Download PDF

Info

Publication number
CN104168407A
CN104168407A CN201410116671.4A CN201410116671A CN104168407A CN 104168407 A CN104168407 A CN 104168407A CN 201410116671 A CN201410116671 A CN 201410116671A CN 104168407 A CN104168407 A CN 104168407A
Authority
CN
China
Prior art keywords
image
target
preliminary election
pattern
focusing position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410116671.4A
Other languages
Chinese (zh)
Other versions
CN104168407B (en
Inventor
张瑞哲
廖健宏
郑志伟
陈宏麟
刘采欣
吴东朋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HTC Corp
Original Assignee
HTC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by HTC Corp filed Critical HTC Corp
Priority to US14/282,218 priority Critical patent/US10070048B2/en
Publication of CN104168407A publication Critical patent/CN104168407A/en
Application granted granted Critical
Publication of CN104168407B publication Critical patent/CN104168407B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/04Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/64Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

本发明为一种全景影像的拍摄方法,应用于一电子装置。拍摄方法包含以下步骤:定义全景影像所需的多个预选对焦位置;显示包含代表该多个预选对焦位置的多个指针的一散布图;拍摄与该多个预选对焦位置对应的多个目标影像;根据该多个目标影像的拍摄状态而改变该多个指针的显示外观;以及根据该多个目标影像产生该全景影像。

The present invention is a method for photographing a panoramic image, which is applied to an electronic device. The method comprises the following steps: defining a plurality of pre-selected focus positions required for the panoramic image; displaying a scatter diagram including a plurality of pointers representing the plurality of pre-selected focus positions; photographing a plurality of target images corresponding to the plurality of pre-selected focus positions; changing the display appearance of the plurality of pointers according to the photographing status of the plurality of target images; and generating the panoramic image according to the plurality of target images.

Description

全景影像的拍摄方法How to shoot panoramic images

技术领域technical field

本发明是有关于一种拍摄方法,且特别是有关于一种全景影像的拍摄方法。The present invention relates to a shooting method, and in particular to a panoramic image shooting method.

背景技术Background technique

为了满足消费者对于拍照的需求,电子装置如:手机、数字相机、平版计算机等,经常内建镜头与屏幕以提供拍摄功能。其中,部分具有拍摄功能的电子装置(以下称为拍摄装置)还进一步提供全景影像(Panorama)的拍摄功能。In order to satisfy consumers' needs for taking photos, electronic devices such as mobile phones, digital cameras, tablet computers, etc. often have built-in lenses and screens to provide shooting functions. Among them, some electronic devices with a shooting function (hereinafter referred to as shooting devices) further provide a panoramic image (Panorama) shooting function.

全景影像是一种拍摄方式,其目的是为了建立具有较大视野的影像。全景影像的产生方式为,将多张拍摄而得的原始影像(raw image)暂存并进行拼接(Stitching)后,共同制成具有较大尺寸的全景影像。Panoramic imagery is a shooting method whose purpose is to create an image with a large field of view. The panorama image is generated by temporarily storing and stitching multiple raw images obtained by shooting, and jointly making a panorama image with a larger size.

请参照图1,其绘示拍摄装置在同一个水平面取得原始影像的俯视图。拍摄装置10通过镜头11取得外部环境的景象后,藉由屏幕(未绘式)显示相对应的预览画面(preview image)。Please refer to FIG. 1 , which shows a top view of the original image captured by the shooting device on the same horizontal plane. After the photographing device 10 captures the scene of the external environment through the lens 11, it displays a corresponding preview image (preview image) through a screen (not shown).

在图1中,假设使用者以顺时针方向旋转拍摄装置10,并依序在第一取景位置P1、第二取景位置P2、第三取景位置P3、第四取景位置P4、第五取景位置P5按下快门。这五张拍摄得出的原始影像彼此相邻,并且有部分区域彼此重迭。经过拼接后,这五张原始影像可用以产生全景影像。In FIG. 1 , it is assumed that the user rotates the photographing device 10 in a clockwise direction, and sequentially selects the first viewfinder position P1, the second viewfinder position P2, the third viewfinder position P3, the fourth viewfinder position P4, and the fifth viewfinder position P5. Press the shutter. The five original images were taken next to each other and partially overlap each other. After stitching, these five original images can be used to generate a panoramic image.

全景影像质量的优劣,取决于原始影像彼此间的相关程度、原始影像的张数等因素。使用越多张原始影像,固然能提升拼接产生的全景影像的效果。但是,原始影像的数量越多,代表使用者必须进行更多次的拍摄,连带使拼接全景影像时的复杂度增加。The quality of the panoramic image depends on factors such as the degree of correlation between the original images and the number of original images. The more original images are used, the effect of the panoramic image generated by stitching can be improved. However, the larger the number of original images, the more times the user has to take pictures, which increases the complexity of stitching the panoramic images.

发明内容Contents of the invention

本发明的一个实施例为一种全景影像的拍摄方法,包含以下步骤:定义一全景影像所需的多个预选对焦位置;显示包含代表该等预选对焦位置的多个指针的一散布图;拍摄与该等预选对焦位置对应的多个目标影像;根据该等目标影像的拍摄状态而改变该等指针的显示外观;以及,根据该等目标影像产生该全景影像。An embodiment of the present invention is a method for shooting a panoramic image, comprising the following steps: defining a plurality of preselected focus positions required for a panoramic image; displaying a scatter diagram including a plurality of pointers representing the preselected focus positions; photographing A plurality of target images corresponding to the pre-selected focus positions; changing the display appearance of the pointers according to the shooting status of the target images; and generating the panoramic image according to the target images.

本发明的另一个实施例为一种全景影像的拍摄方法,应用于一电子装置,该拍摄方法包含以下步骤:以一第一显示模式显示一预览画面;计算产生该全景影像所需的多个预选对焦位置,其中该等预选对焦位置是位于一三维空间;因应该电子装置的转动,显示该等预选对焦位置的其一于该预览画面中;以及当对准该其一预选对焦位置,使得该预览画面中显示一对应目标影像的区域从该第一显示模式改变为一第二显示模式。Another embodiment of the present invention is a method for shooting a panoramic image, which is applied to an electronic device. The shooting method includes the following steps: displaying a preview image in a first display mode; Pre-selected focus positions, wherein the pre-selected focus positions are located in a three-dimensional space; displaying one of the pre-selected focus positions in the preview screen in response to the rotation of the electronic device; and when aligned with the one of the pre-selected focus positions, so that An area displaying a corresponding target image in the preview image is changed from the first display mode to a second display mode.

为了对本发明的上述及其它方面有更佳的了解,下文特举较佳实施例,并配合所附图式,作详细说明如下。In order to have a better understanding of the above and other aspects of the present invention, preferred embodiments will be described in detail below together with the accompanying drawings.

附图说明Description of drawings

图1为拍摄装置在同一个水平面取景的俯视图。Fig. 1 is a top view of the photographing device taking pictures on the same horizontal plane.

图2为拍摄装置在立体空间取景的示意图。FIG. 2 is a schematic diagram of a shooting device taking a view in a stereoscopic space.

图3为根据实施例而产生全景影像的流程图。FIG. 3 is a flowchart of generating a panoramic image according to an embodiment.

图4A为拍摄装置截取初始影像的示意图。FIG. 4A is a schematic diagram of capturing an initial image by a photographing device.

图4B为拍摄装置拍摄初始影像后,屏幕呈现的使用者界面的示意图。FIG. 4B is a schematic diagram of a user interface displayed on the screen after the camera captures an initial image.

图5A为拍摄装置的镜头朝向中心纬线的预选对焦位置的示意图。FIG. 5A is a schematic diagram of a pre-selected focus position of the camera lens facing the central parallel.

图5B为拍摄装置的镜头朝向上方纬线的预选对焦位置的示意图。FIG. 5B is a schematic diagram of a pre-selected focus position where the lens of the photographing device faces the upper latitude.

图5C为拍摄装置的镜头朝向下方纬线的预选对焦位置的示意图。FIG. 5C is a schematic diagram of a pre-selected focus position where the lens of the photographing device faces the lower latitude.

图6为进一步说明散布图与预选对焦位置的对应关系的示意图。FIG. 6 is a schematic diagram further illustrating the corresponding relationship between the scatter diagram and the preselected focus position.

图7A为假设拍摄装置以一圆柱范围产生全景影像。FIG. 7A is a hypothetical shooting device that generates a panoramic image in a cylindrical range.

图7B为代表图7A所示的预选对焦位置的散布图。Figure 7B is a scatter diagram representative of the preselected focus positions shown in Figure 7A.

图8A为于拍摄装置的预览画面中,以一第一显示模式代表尚未拍摄的影像范围的示意图。FIG. 8A is a schematic diagram of a first display mode representing a range of uncaptured images in the preview screen of the photographing device.

图8B为拍摄装置以第一显示模式、第二显示模式显示预览画面的示意图。FIG. 8B is a schematic diagram of the camera displaying a preview image in the first display mode and the second display mode.

图8C为寻找另一预选对焦位置的过程中,拍摄装置的预览画面的示意图。FIG. 8C is a schematic diagram of a preview screen of the photographing device during the process of finding another pre-selected focus position.

图9为拍摄装置的方块图。Fig. 9 is a block diagram of the photographing device.

图10为根据全景影像显示虚拟影像的流程图。FIG. 10 is a flow chart of displaying a virtual image according to a panoramic image.

图11为于屏幕显示虚拟影像的示意图。FIG. 11 is a schematic diagram of displaying a virtual image on a screen.

图12为利用雷达图显示一视角的示意图。FIG. 12 is a schematic diagram showing a viewing angle using a radar chart.

图13为利用雷达图显示另一视角的示意图。FIG. 13 is a schematic diagram showing another perspective using a radar chart.

图14为选取整个虚拟影像作为选取影像的示意图。FIG. 14 is a schematic diagram of selecting the entire virtual image as the selected image.

图15为选取部分的虚拟影像作为选取影像的示意图。FIG. 15 is a schematic diagram of selecting a part of the virtual image as the selected image.

[标号说明][Description of labels]

拍摄装置 10、20、50 镜头 11、305Shooting device 10, 20, 50 Lens 11, 305

屏幕 301            对焦选取图案 31Screen 301 Focus selection pattern 31

左侧部分 31a        右侧部分 31bLeft part 31a Right part 31b

拍摄确认图案 37     提示符号 371Shooting Confirmation Pattern 37 Prompt Symbol 371

散布图 35           目标图案 33Scatter Chart 35 Target Pattern 33

控制单元 303        姿态感测单元 307Control unit 303 Attitude sensing unit 307

重设提示图案 45     视角图式 46Reset Hint Pattern 45 Viewpoint Pattern 46

灰阶扇形 27         选取框 491、492Gray Scale Sector 27 Marquee 491, 492

虚拟影像 60virtual image 60

具体实施方式Detailed ways

为便于说明,以下将用于拼接全景影像的原始影像进一步区分为初始影像(initial photograph)与目标影像(target photograph)。其中,初始影像代表第一张拍摄得出的原始影像,而目标影像代表产生全景影像所需的其余的原始影像。For the convenience of explanation, the original images used for stitching the panoramic images are further divided into an initial image (initial photograph) and a target image (target photograph). Wherein, the initial image represents the original image obtained from the first shot, and the target image represents the rest of the original images required to generate the panoramic image.

此处将拍摄装置拍摄全景影像时,根据全景影像算法估算得出之,与所需拍摄的目标影像对应的拍摄位置,称为预选对焦位置。简言之,与初始影像相对应的初始位置(initial position)是由使用者决定,与目标影像相对应的预选对焦位置则由全景影像算法估算得出。Here, when the shooting device shoots a panoramic image, the shooting position corresponding to the target image to be shot, estimated according to the panoramic image algorithm, is called the pre-selected focus position. In short, the initial position corresponding to the initial image is determined by the user, and the preselected focus position corresponding to the target image is estimated by a panoramic image algorithm.

本发明实施例提供一种拍摄方法,指引使用者快速的拍摄目标影像。以下的实施例说明,如何藉由多种提示图案(prompt patterns),加速全景影像的拍摄与全景影像的显示。这些提示图案通过图形化使用者界面(Graphic UserInterface,简称为GUI)显示,用于协助使用者操作拍摄装置。An embodiment of the present invention provides a shooting method to guide users to quickly shoot target images. The following embodiments illustrate how to speed up the shooting and display of the panoramic image by using various prompt patterns. These prompt patterns are displayed through a Graphical User Interface (GUI for short), and are used to assist the user to operate the photographing device.

例如,一种提示图案的类型为,目标图案(target patterns)。目标图案在屏幕上的位置用于代表预选对焦位置(predefined target positions)。据此,当拍摄装置对准由提示图案代表的预选对焦位置时,拍摄装置就可快速地拍摄得出目标影像。除了目标图案外,拍摄装置亦提供其它类型的提示图案。以下实施例所述的提示图案的外观与位置为举例,实际应用并不以此为限。For example, one type of prompt pattern is target patterns. The position of the target pattern on the screen is used to represent predefined target positions. Accordingly, when the photographing device is aimed at the pre-selected focus position represented by the prompt pattern, the photographing device can quickly capture the target image. In addition to the target pattern, the photographing device also provides other types of prompt patterns. The appearance and position of the reminder pattern described in the following embodiments are examples, and the actual application is not limited thereto.

请参照图2,其绘示在立体空间拍摄全景影像的取景位置(photographingtarget)的示意图。此图式以x轴、y轴、z轴代表立体空间的三个方向,并以拍摄装置20的位置作为立体空间的中心点(x,y,z)=(0,0,0)。一般说来,在拍摄全景影像的过程中,拍摄装置20并不会移动。但是,拍摄装置20会在中心点绕着x轴、y轴、z轴的一者而转动。Please refer to FIG. 2 , which is a schematic diagram of a photographing target for shooting a panoramic image in a three-dimensional space. In this diagram, x-axis, y-axis and z-axis represent three directions of the three-dimensional space, and the position of the camera 20 is taken as the center point (x, y, z)=(0,0,0) of the three-dimensional space. Generally speaking, the photographing device 20 does not move during the process of photographing the panoramic image. However, the imaging device 20 rotates around one of the x-axis, y-axis, and z-axis at the center point.

此图式将拍摄装置20所在的水平面定义为x-y平面;并且,假设拍摄装置20在初始位置时,机身垂直于水平面。此外,图2以多条虚线代表与x-y平面平行的纬线;以及,以多条实线代表与x-y平面垂直的经线。In this figure, the horizontal plane where the photographing device 20 is located is defined as an x-y plane; and it is assumed that when the photographing device 20 is in an initial position, the body is perpendicular to the horizontal plane. In addition, in FIG. 2, a plurality of dotted lines represent latitude lines parallel to the x-y plane; and, a plurality of solid lines represent meridian lines perpendicular to the x-y plane.

首先假设拍摄装置20维持与水平面垂直。其后,当拍摄装置20绕着z轴转动时,同步拍摄位于中心纬线Lc的取景位置,并拍摄得出对应的目标影像。First, it is assumed that the photographing device 20 is kept vertical to the horizontal plane. Afterwards, when the photographing device 20 rotates around the z-axis, it synchronously photographs the viewfinder position located on the central latitude line Lc, and obtains a corresponding target image.

当拍摄装置20的摆置姿态被改变时,拍摄装置20与x-y平面之间的夹角(倾斜角度)也随着改变。连带的,拍摄装置20拍摄的目标影像将对应于上方纬线Lu与下方纬线Ld的取景位置。When the posture of the photographing device 20 is changed, the included angle (tilt angle) between the photographing device 20 and the x-y plane also changes accordingly. Jointly, the target image captured by the photographing device 20 will correspond to the viewfinder positions of the upper latitude Lu and the lower latitude Ld.

简言之,为了拍摄目标影像,拍摄装置20需要自球体表面选择多条纬线上的多个取景位置。其中,与其它纬线相较时,中心纬线Lc的长度较长,因此在中心纬线Lc上的取景位置的数量,也较上方纬线Lu与下方纬线Ld的取景位置的数量更多。In short, in order to capture the target image, the photographing device 20 needs to select multiple viewing positions on multiple parallel lines from the surface of the sphere. Wherein, compared with other latitudes, the length of the central latitude Lc is longer, so the number of viewfinder positions on the central latitude Lc is also larger than the number of viewfinder positions on the upper latitude Lu and the lower latitude Ld.

根据全景影像算法而拼接初始影像与所有的目标影像后,将产生一球状的全景影像。使用者观看此球状的全景影像时,有如置身于图2的球体的中心,观看贴附于球体表面上的全景影像。After splicing the initial image and all target images according to the panoramic image algorithm, a spherical panoramic image will be generated. When the user watches the spherical panoramic image, it is like being in the center of the sphere in FIG. 2 , watching the panoramic image attached to the surface of the sphere.

请参见图3,其是根据实施例而产生全景影像的流程图。当拍摄装置20利用镜头取景时,屏幕将显示与外部景观相对应的预览画面(preview image)(步骤S311)。当使用者移动或转动拍摄装置20时,预览画面所显示的内容也随着改变。若使用者确认要进行拍摄,便利用拍摄装置20拍摄初始影像(步骤S313)。Please refer to FIG. 3 , which is a flowchart of generating a panoramic image according to an embodiment. When the photographing device 20 uses the lens to find a view, the screen will display a preview image (preview image) corresponding to the external landscape (step S311). When the user moves or rotates the photographing device 20 , the content displayed on the preview screen changes accordingly. If the user confirms that he wants to shoot, he uses the camera 20 to shoot an initial image (step S313 ).

于拍摄初始影像后,拍摄装置20根据全景影像算法而估测与目标影像对应的取景位置(步骤S315)。此处将估测得出的取景位置称为预选对焦位置(predefined target position,以CP表示)。在步骤S315中,全景影像算法将根据初始影像的复杂度(complexity)、拍摄角度(capturing angle)、视角(viewingangle)等参数,计算并估计所需的预选对焦位置的数量与位置。其后,拍摄装置20将对应拍摄目标影像(步骤S317)。After capturing the initial image, the photographing device 20 estimates the viewfinder position corresponding to the target image according to the panoramic image algorithm (step S315 ). Here, the estimated framing position is referred to as a pre-selected focus position (predefined target position, denoted by CP). In step S315, the panorama image algorithm will calculate and estimate the number and positions of the required pre-selected focus positions according to the complexity, capturing angle, viewing angle and other parameters of the initial image. Thereafter, the photographing device 20 will correspond to the photographing target image (step S317).

接着,判断全景影像的拍摄过程是否完成(步骤S318)。若否,拍摄装置20将持续拍摄剩余的目标影像。若是,拍摄装置将初始影像与目标影像加以拼接产生全景影像(步骤S319)。Next, it is determined whether the shooting process of the panoramic image is completed (step S318 ). If not, the photographing device 20 will continue to photograph the remaining target images. If so, the photographing device stitches the initial image and the target image to generate a panoramic image (step S319 ).

实际应用时,步骤S318成立与否的判断,并不需要被限定为全部的目标影像均已被拍摄。例如,若使用者在拍摄了部分的目标影像后,想要中断全景影像的拍摄过程,亦可视为步骤S318成立。In practical applications, the determination of whether step S318 is established or not does not need to be limited to the fact that all target images have been captured. For example, if the user wants to interrupt the shooting process of the panoramic image after shooting part of the target image, it can also be considered that step S318 is established.

请参见图4A,其是拍摄装置截取初始影像的示意图。除了初始影像外,屏幕301还显示一组对焦选取图案31,以及一拍摄确认图案(confirmationpattern)37。对焦选取图案31代表镜头的对焦位置(focal position),且通常位于预览画面的中心。在图4A中,对焦选取图案31包含一左侧部分31a与一右侧部分31b。再者,拍摄确认图案37代表拍摄条件是否符合。Please refer to FIG. 4A , which is a schematic diagram of capturing an initial image by the photographing device. Besides the initial image, the screen 301 also displays a set of focus selection patterns 31 and a shooting confirmation pattern 37 . The focus selection pattern 31 represents the focal position of the lens, and is usually located at the center of the preview image. In FIG. 4A, the focus selection pattern 31 includes a left part 31a and a right part 31b. Furthermore, the shooting confirmation pattern 37 represents whether the shooting conditions are met.

拍摄条件符合时,拍摄装置20将持续拍摄目标影像。需留意的是,目标影像的拍摄过程,可能是由使用者手动拍摄,或者由拍摄装置进行自动拍摄。在此实施例中,拍摄确认图案37是通过提示符号(prompt symbol)371的显示,代表是否持续进行拍摄。When the shooting conditions are met, the shooting device 20 will continue to shoot the target image. It should be noted that the shooting process of the target image may be manually shot by the user, or automatically shot by the shooting device. In this embodiment, the shooting confirmation pattern 37 is displayed through a prompt symbol (prompt symbol) 371, representing whether to continue shooting.

在拍摄初始影像前,拍摄确认图案37的提示符号371维持显示为可以拍摄(例如,图4A的提示符号371显示为勾勾)。在初始影像拍摄后,拍摄确认图案37的提示符号371持续显示为不可拍摄(例如,图4B的提示符号371显示为叉号),直到目标影像的拍摄条件符合为止。在此实施例中,每一个预选对焦位置均对应于一个目标图案33。当对焦选取图案31框选住与未被拍摄的预选对焦位置相对应的目标图案33时,视为拍摄条件符合。此时,拍摄装置20将对应拍摄一目标影像。Before the initial image is captured, the prompt symbol 371 of the shooting confirmation pattern 37 remains displayed as being ready to be photographed (for example, the prompt symbol 371 in FIG. 4A is displayed as a tick). After the initial image is captured, the prompt symbol 371 of the shooting confirmation pattern 37 continues to be displayed as unavailable (for example, the prompt symbol 371 in FIG. 4B is displayed as a cross), until the shooting conditions of the target image are met. In this embodiment, each preselected focus position corresponds to a target pattern 33 . When the focus selection pattern 31 frames the target pattern 33 corresponding to the unphotographed preselected focus position, it is considered that the shooting condition is met. At this time, the photographing device 20 will correspondingly photograph a target image.

在此实施例中,拍摄确认图案37利用提示符号371代表拍摄条件的符合与否。在其它的实施例中,则可通过拍摄确认图案37的显示,代表拍摄条件成立,反之亦然。当拍摄条件成立时,可通过手动拍摄或自动拍摄得出目标影像。In this embodiment, the shooting confirmation pattern 37 uses prompt symbols 371 to represent whether the shooting conditions are met or not. In other embodiments, the photographing confirmation pattern 37 can be displayed, which means that the photographing condition is met, and vice versa. When the shooting conditions are satisfied, the target image can be obtained by manual shooting or automatic shooting.

请参见图4B,其是拍摄装置拍摄初始影像后,屏幕呈现的使用者界面的示意图。与图4A相较,此处的提示图案进一步包含一散布图(navigator)35。散布图35用于显示与初始位置相对应的多个预选对焦位置。Please refer to FIG. 4B , which is a schematic diagram of a user interface displayed on the screen after the shooting device shoots an initial image. Compared with FIG. 4A , the hint pattern here further includes a navigator 35 . The scatter diagram 35 is used to display a plurality of preselected focus positions corresponding to the initial positions.

当拍摄装置20的摆置姿态改变时,预览画面显示的景色也将对应改变。连带的,目标图案33在预览画面内的位置也将改变。另一方面,对焦选取图案31仍位于屏幕301的中心位置,对焦选取图案31的位置并不会因预览画面的内容改变而改变。When the posture of the photographing device 20 is changed, the scene displayed on the preview screen will also change correspondingly. Correspondingly, the position of the target pattern 33 in the preview screen will also change. On the other hand, the focus selection pattern 31 is still located at the center of the screen 301 , and the position of the focus selection pattern 31 will not change due to the content of the preview image changing.

因此,根据目标影像可否被拍摄,对焦选取图案31与目标图案33间的相对位置可能包含两种类型。Therefore, according to whether the target image can be captured, the relative position between the focus selection pattern 31 and the target pattern 33 may include two types.

对焦选取图案31与目标图案33间的一种相对位置为,目标图案33被对焦选取图案31所框选。此时,拍摄条件成立,拍摄装置20将拍摄目标影像。在此种情况下,以主动模式(active mode)显示对焦选取图案31与目标图案33。A relative position between the focus selection pattern 31 and the target pattern 33 is that the target pattern 33 is framed by the focus selection pattern 31 . At this time, the shooting condition is satisfied, and the shooting device 20 will shoot the target image. In this case, the focus selection pattern 31 and the target pattern 33 are displayed in an active mode.

对焦选取图案31与目标图案33间的另一种相对位置为,目标图案33并未被对焦选取图案31所涵盖。此时,拍摄条件并未成立,因此以等待模式(standby mode)显示对焦取图案31及目标图案33。Another relative position between the focus selection pattern 31 and the target pattern 33 is that the target pattern 33 is not covered by the focus selection pattern 31 . At this time, the shooting condition is not established, so the focus acquisition pattern 31 and the target pattern 33 are displayed in a standby mode.

因应在主动模式或等待模式间的转换,对焦取图案31及目标图案33的亮度参数、透明度参数、灰阶参数或色调参数,亦可相对应地改变。In response to switching between the active mode and the waiting mode, the brightness parameters, transparency parameters, grayscale parameters or hue parameters of the focus pattern 31 and the target pattern 33 can also be changed correspondingly.

在此实施例中,于屏幕301的左上方显示代表预选对焦位置的分布情形的散布图35。散布图35内的每一个指标(indication)代表一个预选对焦位置,因此,指针的数量与预选对焦位置的数量相等。以下将进一步说明指标。In this embodiment, a scatter diagram 35 representing the distribution of preselected focus positions is displayed on the upper left of the screen 301 . Each indication in the scatter diagram 35 represents a preselected focus position, therefore, the number of pointers is equal to the number of preselected focus positions. Indicators are further explained below.

请参见图5A,其是拍摄装置的镜头朝向中心纬线的预选对焦位置的示意图。假设在中心纬线Lc上,第一预选对焦位置P1对应于y轴的正方向;第二预选对焦位置P2对应于x轴的正方向;第三预选对焦位置对应于y轴的负方向;以及,第四预选对焦位置P4对应于x轴的负方向。Please refer to FIG. 5A , which is a schematic diagram of a pre-selected focus position of the camera lens facing the central parallel. Assuming that on the central parallel Lc, the first preselected focus position P1 corresponds to the positive direction of the y-axis; the second preselected focus position P2 corresponds to the positive direction of the x-axis; the third preselected focus position corresponds to the negative direction of the y-axis; and, The fourth preselected focus position P4 corresponds to the negative direction of the x-axis.

请参见图5B,其是拍摄装置的镜头朝向上方纬线的预选对焦位置的示意图。当拍摄装置20用于拍摄上方纬线Lu对应的预选对焦位置时,拍摄装置20与水平面(即,x-y平面)间间有一夹角。图5B假设在上方纬线Lu上,选取第五预选对焦位置P5与第六预选对焦位置P6。Please refer to FIG. 5B , which is a schematic diagram of a pre-selected focus position where the lens of the photographing device faces the upper latitude. When the photographing device 20 is used to photograph the preselected focus position corresponding to the upper latitude line Lu, there is an included angle between the photographing device 20 and the horizontal plane (ie, the x-y plane). FIG. 5B assumes that the fifth preselected focus position P5 and the sixth preselected focus position P6 are selected on the upper parallel Lu.

请参见图5C,其是拍摄装置的镜头朝向下方纬线的预选对焦位置的示意图。当拍摄装置20用于拍摄下方纬线Ld对应的预选对焦位置时,拍摄装置与水平面(即,x-y平面)间有一夹角。图5C假设在下方纬线Lu上,选取第七预选对焦位置P7与第八预选对焦位置P8。Please refer to FIG. 5C , which is a schematic diagram of a pre-selected focus position where the lens of the photographing device faces the lower latitude. When the photographing device 20 is used to photograph the preselected focus position corresponding to the lower latitude line Ld, there is an included angle between the photographing device and the horizontal plane (ie, the x-y plane). FIG. 5C assumes that the seventh preselected focus position P7 and the eighth preselected focus position P8 are selected on the lower parallel Lu.

请参见图6,其是进一步说明散布图与预选对焦位置的对应关系的示意图。其中,假设散布图35包含三列指标CP1'、CP2'、CP3'、CP4'、CP5'、CP6'、CP7'、CP8',各个指标分别对应于一预选对焦位置。此外,散布图35中的各个指标CP1'、CP2'、CP3'、CP4'、CP5'、CP6'、CP7'、CP8'彼此间的相对位置,亦对应于预选对焦位置彼此间的相对位置。Please refer to FIG. 6 , which is a schematic diagram further illustrating the corresponding relationship between the scatter diagram and the preselected focus position. Wherein, it is assumed that the scatter diagram 35 includes three columns of indicators CP1 ′, CP2 ′, CP3 ′, CP4 ′, CP5 ′, CP6 ′, CP7 ′, and CP8 ′, and each indicator corresponds to a preselected focus position. In addition, the relative positions of the indicators CP1 ′, CP2 ′, CP3 ′, CP4 ′, CP5 ′, CP6 ′, CP7 ′, and CP8 ′ in the scatter diagram 35 also correspond to the relative positions of the preselected focus positions.

散布图35的第一列所包含的第五指标(CP5')与第六指标(CP6'),用于代表图5B所示的第五预选对焦位置(CP5)、第六预选对焦位置(CP6)。散布图35的第二列所包含的第一指标(CP1')、第二指标(CP2')、第三指标(CP3')、第四指标(CP4'),用于代表图5A所示的第一预选对焦位置(CP1)、第二预选对焦位置(CP2)、第三预选对焦位置(CP3)、第四预选对焦位置(CP4)。散布图35的第三列所包含的第七指标(CP7')、第八指标(CP8'),用于代表图5C所示的第七预选对焦位置(CP7)、第八预选对焦位置(CP8)。The fifth index (CP5') and the sixth index (CP6') contained in the first column of the scatter diagram 35 are used to represent the fifth preselected focus position (CP5), the sixth preselected focus position (CP6) shown in FIG. 5B ). The first index (CP1'), the second index (CP2'), the third index (CP3'), and the fourth index (CP4') contained in the second column of the scatter diagram 35 are used to represent the A first preselected focus position (CP1), a second preselected focus position (CP2), a third preselected focus position (CP3), a fourth preselected focus position (CP4). The seventh index (CP7') and the eighth index (CP8') contained in the third column of the scatter diagram 35 are used to represent the seventh preselected focus position (CP7), the eighth preselected focus position (CP8) shown in FIG. 5C ).

在散布图35中,以位于散布图35的中心的指标(CP3')对应于与初始影像对应的预选对焦位置,其余的指针则对应于其它的预选对焦位置。散布图35内的指针以三种状态显示,这三种状态分别代表与其对应的目标影像为已被拍摄、将被拍摄或未被拍摄。In the scatter diagram 35 , the pointer ( CP3 ′) at the center of the scatter diagram 35 corresponds to the preselected focus position corresponding to the initial image, and the rest of the pointers correspond to other preselected focus positions. The pointers in the scatter diagram 35 are displayed in three states, which respectively represent whether the corresponding target image has been photographed, will be photographed or has not been photographed.

若与预选对焦位置对应的目标影像尚未被拍摄时,以第一显示外观提示与该目标影像相对应的指针。若预选对焦位置的对应目标影像已经被拍摄时,以第二显示外观提示与该目标影像相对应的指针。若预选对焦位置的对应目标影像即将被拍摄时,以第三显示外观提示与该目标影像相对应的指针。If the target image corresponding to the preselected focus position has not been captured yet, a pointer corresponding to the target image is prompted with the first display appearance. If the target image corresponding to the preselected focus position has been captured, a pointer corresponding to the target image is prompted with the second display appearance. If the target image corresponding to the preselected focus position is about to be shot, a pointer corresponding to the target image is prompted with a third display appearance.

例如,在图6中,针对已经被选取并拍摄过相对应的原始影像的预选对焦位置(CP3、CP6),以点状底纹标示与其对应的指标(CP3'、CP6');针对尚未被拍摄过的预选对焦位置(CP1、CP4、CP5、CP7、CP8),以斜纹方向的底纹标示与其对应的指标(CP1'、CP4'、CP5'、CP7'、CP8');针对被对焦选取图案31框选,代表即将被拍摄的预选对焦位置(CP2),以较暗的底纹标示与其对应的指标(CP2')。For example, in Fig. 6, for the pre-selected focus positions (CP3, CP6) that have been selected and taken corresponding original images, the corresponding indicators (CP3', CP6') are marked with dotted shading; The pre-selected focus positions (CP1, CP4, CP5, CP7, CP8) that have been photographed are marked with shading in the direction of diagonal lines and the corresponding indicators (CP1', CP4', CP5', CP7', CP8'); The pattern 31 is framed, representing the preselected focus position (CP2) to be photographed, and the corresponding index (CP2') is marked with a darker shading.

实际应用时,指针的显示外观可能通过亮度参数、透明度参数、灰阶参数、或色调参数等的改变而变化。In practical applications, the display appearance of the pointer may be changed by changing brightness parameters, transparency parameters, grayscale parameters, or hue parameters.

再者,屏幕301还可以在预览画面上显示多个与预选对焦位置对应的目标图案33。在图6中,对焦选取图案31框选的虽然是第二预选对焦位置的目标图案33,但是与其相邻的其它的预选对焦位置的目标图案33同样显示于屏幕301中。当使用者拍摄与第二预选对焦位置的目标图案33对应的影像后,可以参酌屏幕301所显示的相邻的目标图案33,并决定是否继续拍摄。此外,屏幕301也可以通过网格线(grid)的显示,提示各目标图案33所代表的预选对焦位置的相对位置。Furthermore, the screen 301 can also display a plurality of target patterns 33 corresponding to the pre-selected focus positions on the preview screen. In FIG. 6 , although the target pattern 33 of the second preselected focus position is framed by the focus selection pattern 31 , the target patterns 33 of other preselected focus positions adjacent to it are also displayed on the screen 301 . After the user shoots an image corresponding to the target pattern 33 at the second preselected focus position, he can refer to the adjacent target patterns 33 displayed on the screen 301 and decide whether to continue shooting. In addition, the screen 301 may also display the relative positions of the pre-selected focus positions represented by the target patterns 33 through the display of grid lines.

如前所述,藉由提示图案(包含对焦选取图案31、目标图案33、拍摄确认图案37),本发明的拍摄装置20可快速拍摄得出球体空间的全景影像。采用此做法时,拍摄装置20仅于预选对焦位置确实被对焦时,才进行目标影像的拍摄。因此,能确保全景影像的拍摄质量。As mentioned above, with the prompt patterns (including the focus selection pattern 31 , the target pattern 33 , and the shooting confirmation pattern 37 ), the photographing device 20 of the present invention can quickly capture a panoramic image of the spherical space. When this approach is adopted, the photographing device 20 only shoots the target image when the pre-selected focus position is indeed in focus. Therefore, the shooting quality of the panoramic image can be ensured.

藉由提示图案的显示,使用者可根据个人喜好而决定拍摄目标影像的顺序。需留意的是,本发明的应用并不以拍摄球体空间的全景影像为限。Through the display of the prompt pattern, the user can determine the sequence of the shooting target images according to personal preference. It should be noted that the application of the present invention is not limited to shooting panoramic images in spherical space.

请参见图7A,其是假设拍摄装置以一圆柱范围产生全景影像。在此圆柱范围中,假设拍摄装置50所拍摄的影像对应于五条纬线(Lu2、Lu1、Lc、Ld1、Ld2)上的数个预选对焦位置。在圆柱范围内,各纬线的长度相等。因此,可假设各个纬线上的预选对焦位置的数量相等。Please refer to FIG. 7A , it is assumed that the shooting device generates a panoramic image in a cylindrical range. In this cylindrical range, it is assumed that the images captured by the photographing device 50 correspond to several pre-selected focus positions on the five latitudes (Lu2, Lu1, Lc, Ld1, Ld2). Within the cylinder, the lengths of the parallels are equal. Therefore, it can be assumed that the number of preselected focus positions on each latitude is equal.

请参见图7B,其是代表图7A所示的预选对焦位置的散布图。此处在各纬线(Lu2、Lu1、Lc、Ld1、Ld2)分别选取四个预选对焦位置。因此,由上而下的五列指标分别对应于图7A中的第二上方纬线Lu2、第一上方纬线Lu1、中心纬线Lc、第一下方纬线Ld1、第二下方纬线Ld2的四个预选对焦位置。同样的,散布图35内的指针,其显示外观可根据所对应的预选对焦位置为未被拍摄、已被拍摄、即将被拍摄的状态而改变。Please refer to FIG. 7B, which is a scatter diagram representing the preselected focus positions shown in FIG. 7A. Here, four preselected focus positions are respectively selected on each latitude (Lu2, Lu1, Lc, Ld1, Ld2). Therefore, the five columns of indicators from top to bottom respectively correspond to the four pre-selected focuses of the second upper latitude Lu2, the first upper latitude Lu1, the center latitude Lc, the first lower latitude Ld1, and the second lower latitude Ld2 in FIG. 7A Location. Similarly, the display appearance of the pointer in the scatter diagram 35 can be changed according to whether the corresponding pre-selected focus position is not photographed, has been photographed, or is about to be photographed.

综上所述,散布图35让使用者更清楚地知道各个预选对焦位置是否已经被选取。使用者也可以由散布图35看出还有哪些预选对焦位置尚未被选取。是故,全景影像的拍摄过程将更有效率。To sum up, the scatter diagram 35 allows the user to know more clearly whether each pre-selected focus position has been selected. The user can also see from the scatter diagram 35 which preselected focus positions have not yet been selected. Therefore, the shooting process of the panoramic image will be more efficient.

本发明的另一个实施例定义两种显示模式。预览画面内的区域,会根据是否包含已拍摄的目标影像而采用不同的显示模式。当预览画面的区域并未包含已被拍摄的目标影像时,以一第一显示模式显示该预览画面的区域。反之,则于预览画面的区内中,以一第二显示模式显示已被拍摄的目标影像的区域。Another embodiment of the present invention defines two display modes. The area in the preview screen will adopt different display modes according to whether it contains the captured target image or not. When the area of the preview image does not include the captured target image, the area of the preview image is displayed in a first display mode. On the contrary, in the area of the preview image, the area of the captured target image is displayed in a second display mode.

第一显示模式与第二显示模式所采用的显示参数,可被设定为不同的数值。例如,以下的实施例假设第一显示模式对应于一第一透明度,以及第二显示模式对应于一第二透明度。The display parameters used in the first display mode and the second display mode can be set to different values. For example, the following embodiments assume that the first display mode corresponds to a first transparency, and the second display mode corresponds to a second transparency.

请参见图8A,其是以第一显示模式显示预览画面的示意图。在图8A中,与第二预选对焦位置(CP2)对应的目标影像尚未被拍摄。因此,预览画面是以第一透明度显示。Please refer to FIG. 8A , which is a schematic diagram of displaying a preview image in the first display mode. In FIG. 8A , the target image corresponding to the second preselected focus position ( CP2 ) has not been captured yet. Therefore, the preview image is displayed with the first transparency.

请参见图8B,其是拍摄装置以第一显示模式、第二显示模式显示预览画面的示意图。此处与第二预选对焦位置(CP2)对应的目标影像已经被拍摄,因此在预览画面中,与第二预选对焦位置相对应的目标影像的区域以第二透明度显示。至于,在预览画面中,非与第二预选对焦位置相对应的目标影像的其余区域,仍维持以第一透明度表示。Please refer to FIG. 8B , which is a schematic diagram showing a preview image displayed by the photographing device in the first display mode and the second display mode. Here, the target image corresponding to the second preselected focus position ( CP2 ) has been captured, so in the preview screen, the region of the target image corresponding to the second preselected focus position is displayed with the second transparency. As for, in the preview image, other regions of the target image that are not corresponding to the second preselected focus position are still represented by the first transparency.

若预选对焦位置位于一球面时,在预览画面中的已拍摄的目标影像(即,以第二透明度显示的区域)的左右两个侧边为弧线。再者,若被选取的预选对焦位置位于上方纬线,则相对应的目标影像的上缘长度会略小于下缘长度。或者,若被选取的预选对焦位置位于下方纬线,则相对应的目标影像的上缘长度会略大于下缘长度。If the pre-selected focus position is located on a spherical surface, the left and right sides of the captured target image (ie, the area displayed with the second transparency) in the preview screen are arcs. Furthermore, if the selected pre-selected focus position is located on the upper latitude, the length of the upper edge of the corresponding target image will be slightly smaller than the length of the lower edge. Alternatively, if the selected pre-selected focus position is located on the lower latitude, the length of the upper edge of the corresponding target image will be slightly longer than the length of the lower edge.

请参见图8C,其是于寻找另一个预选对焦位置的过程中,拍摄装置的预览画面的示意图。图8C假设使用者在拍摄完与第二预选对焦位置(CP2)对应的目标影像后,使用者通过拍摄装置20的转动而找寻其它的目标图案33。即,与第一预选对焦位置(CP1)对应的目标图案33。Please refer to FIG. 8C , which is a schematic diagram of a preview screen of the camera during the process of finding another pre-selected focus position. FIG. 8C assumes that after the user shoots the target image corresponding to the second preselected focus position ( CP2 ), the user searches for another target pattern 33 by rotating the shooting device 20 . That is, the target pattern 33 corresponding to the first preselected focus position (CP1).

由此图式可以看出,随着拍摄装置20的转动,具有第二透明度的区域,其轮廓也会同时改变。例如,通过图8B与图8C的比较可以看出,当拍摄装置20朝右转动时,具有第二透明度的区域如何改变。在图8B中,具有第二透明度的区域,其左右两侧边的长度实质相等。但是,在图8C中,具有第二透明度的区域的左侧较右侧长。再者,在图8C中,具有第二透明度的区域的上缘与下缘均呈现弯曲。It can be seen from the figure that as the camera device 20 rotates, the outline of the region with the second transparency will also change simultaneously. For example, by comparing FIG. 8B with FIG. 8C , it can be seen how the area with the second transparency changes when the photographing device 20 is turned to the right. In FIG. 8B , the lengths of the left and right sides of the region with the second transparency are substantially equal. However, in FIG. 8C, the left side of the region having the second transparency is longer than the right side. Furthermore, in FIG. 8C , both the upper edge and the lower edge of the region with the second transparency are curved.

承上,采用此种拍摄方法时,预览画面所显示的具有第一透明度的区域逐渐减少,且具有第二透明度的区域逐渐增加。当使用者完成完所有目标影像的拍摄后,预览画面将维持以第二透明度显示。As mentioned above, when this shooting method is adopted, the area with the first transparency displayed on the preview screen gradually decreases, and the area with the second transparency gradually increases. After the user finishes shooting all target images, the preview image will remain displayed with the second transparency.

请参见图9,其是拍摄装置的方块图。拍摄装置20包含屏幕301、控制单元303、姿态感测单元307、镜头305。控制单元303电连接于其它三者。姿态感测单元307用于感测拍摄装置20被摆置的姿态。姿态感测单元307可为陀螺仪(gyroscope)。Please refer to FIG. 9 , which is a block diagram of the photographing device. The photographing device 20 includes a screen 301 , a control unit 303 , an attitude sensing unit 307 , and a lens 305 . The control unit 303 is electrically connected to the other three. The posture sensing unit 307 is used for sensing the posture of the photographing device 20 . The attitude sensing unit 307 can be a gyroscope.

拍摄装置20的操作包含两个阶段:拍摄阶段(photographing stage)与显示阶段(displaying stage)。于显示阶段中,使用者利用屏幕301观看球状全景影像时,视觉上的感觉就像相当于置身于球体的中心,观看在球体表面贴附的的全景影像。除了前述于拍摄阶段所提供的提示图案外,本发明亦于显示全景影像时,搭配提示图案的使用。The operation of the photographing device 20 includes two stages: a photographing stage and a displaying stage. In the display stage, when the user uses the screen 301 to watch the spherical panoramic image, the visual feeling is equivalent to being in the center of the sphere and watching the panoramic image attached to the surface of the sphere. In addition to the aforementioned reminder patterns provided during the shooting phase, the present invention also uses reminder patterns when displaying panoramic images.

受限于屏幕301为二维的缘故,拍摄装置20无法直接使用屏幕301呈现具有立体感的全景影像。因此,通过屏幕301显示的,其实是将全景影像透视投射后产生的虚拟影像(virtual image)。其中,透视投射的方式可采用球体透视投影法(spherical perspective projection)、或柱体透视投影法(cylindricalperspective projection)。Due to the limitation that the screen 301 is two-dimensional, the photographing device 20 cannot directly use the screen 301 to present a three-dimensional panoramic image. Therefore, what is displayed on the screen 301 is actually a virtual image generated by perspective projection of the panoramic image. Wherein, the way of perspective projection can adopt spherical perspective projection method (spherical perspective projection), or cylindrical perspective projection method (cylindrical perspective projection).

根据本发明的实施例,屏幕301所显示的全景影像,会根据拍摄装置20的摆置姿态及/或使用者的操作(例如一重设(resume)操作、一缩放操作或一旋转操作)而调整。连带的,屏幕301所显示的提示图案与画面内容也将改变。According to an embodiment of the present invention, the panoramic image displayed on the screen 301 will be adjusted according to the posture of the shooting device 20 and/or the user's operation (such as a reset (resume) operation, a zoom operation or a rotation operation) . Correspondingly, the prompt pattern and screen content displayed on the screen 301 will also change.

请参见图10,其是根据全景影像显示虚拟影像范围的流程示意图。首先,提供全景影像(步骤S321)。接着,感测使用者是否对拍摄装置20进行各种操作,并据以产生操作信号(operation signal)(步骤S323)。根据操作信号而计算或估算得出目标位置。目标位置代表使用者观看全景影像时,在球体(柱体)空间中,使用者的视线所朝向的位置。之后,根据目标位置而对全景影像进行透视投射(步骤S325),以及显示虚拟影像(步骤S327)。Please refer to FIG. 10 , which is a schematic flowchart of displaying a virtual image range according to a panoramic image. First, a panoramic image is provided (step S321). Next, whether the user performs various operations on the photographing device 20 is sensed, and an operation signal is generated accordingly (step S323). The target position is calculated or estimated according to the operation signal. The target position represents the position where the user's line of sight is directed in the spherical (cylindrical) space when the user views the panoramic image. After that, perform perspective projection on the panoramic image according to the target position (step S325 ), and display the virtual image (step S327 ).

请参见图11,其是显示虚拟影像的示意图。如图11所示,屏幕301亦显示重设提示图案45与视角图式46。以下以雷达图作为视角图式46的举例。使用者选取重设提式图案45时,屏幕301所显示的虚拟影像将以一预设位置为基准。其中,预设位置可以是与初始影像对应的初始位置,或由使用者根据个人喜好而设定。Please refer to FIG. 11 , which is a schematic diagram showing a virtual image. As shown in FIG. 11 , the screen 301 also displays a reset prompt pattern 45 and a perspective pattern 46 . The following uses a radar chart as an example of the viewing angle schema 46 . When the user chooses to reset the lifting pattern 45, the virtual image displayed on the screen 301 will be based on a preset position. Wherein, the preset position may be the initial position corresponding to the initial image, or set by the user according to personal preference.

请参见图12,其是利用雷达图显示一视角的示意图。其中,以灰阶扇形27代表在虚拟影像中,预设位置与目标位置间的视角。通过与全景影像相对应的全视角的视角图式,使用者可以更全面的方式,掌握其操作对于虚拟影像的影响。当然,视角图式并不限定为雷达图。例如,圆饼图或其它类型的图标也可作为视角图式。Please refer to FIG. 12 , which is a schematic diagram showing a viewing angle using a radar chart. Wherein, the gray scale sector 27 represents the viewing angle between the preset position and the target position in the virtual image. Through the full-view perspective schema corresponding to the panoramic image, the user can grasp the influence of his operation on the virtual image in a more comprehensive manner. Of course, the viewing angle schema is not limited to the radar graph. For example, pie charts or other types of icons can also serve as perspective schemas.

此处假设,雷达图的水平方向对应于全景影像的x-轴方向、雷达图的垂直方向对应于全景影像的y方向。其中,雷达图的右侧代表全景影像的x-轴的正方向、雷达图的左侧代表全景影像的x-轴的负方向。雷达图的上方代表全景影像的y-轴的正方向、雷达图的下方代表全景影像的y-轴的负方向。It is assumed here that the horizontal direction of the radar chart corresponds to the x-axis direction of the panoramic image, and the vertical direction of the radar chart corresponds to the y direction of the panoramic image. Wherein, the right side of the radar chart represents the positive direction of the x-axis of the panoramic image, and the left side of the radar chart represents the negative direction of the x-axis of the panoramic image. The upper part of the radar chart represents the positive direction of the y-axis of the panoramic image, and the lower part of the radar chart represents the negative direction of the y-axis of the panoramic image.

再者,雷达图中的同心圆大小,代表目标位置与z-轴的距离。例如:当灰阶扇形的弧线位于较小的同心圆时,代表目标位置距离球心的距离较近。Furthermore, the size of the concentric circles in the radar image represents the distance between the target position and the z-axis. For example: when the arcs of the grayscale sector are located in smaller concentric circles, it means that the target position is closer to the center of the sphere.

请参见图13,其是利用雷达图显示另一视角的示意图。在图12中,灰阶扇形的弧线朝上;在图13中,灰阶扇形的弧线朝下。由于灰阶扇形的弧线在图12与图13中彼此反向,代表图12与图13的目标位置彼此相反。Please refer to FIG. 13 , which is a schematic diagram showing another perspective using a radar chart. In FIG. 12 , the arc of the gray-scale sector faces upward; in FIG. 13 , the arc of the gray-scale sector faces downward. Since the arcs of the gray scale fan are opposite to each other in FIG. 12 and FIG. 13 , it means that the target positions in FIG. 12 and FIG. 13 are opposite to each other.

使用者在观看虚拟影像时,可以根据个人喜好而操作。使用者可进行缩放操作、旋转操作、回复操作等。拍摄装置可通过具有触控功能的屏幕301,或是通过姿态感测单元307感测到使用者的操作,并对应产生一操作信号。随着操作信号的产生,目标位置亦将改变。Users can operate according to their personal preferences when viewing virtual images. Users can perform scaling operations, rotation operations, recovery operations, and the like. The photographing device can sense the user's operation through the touch screen 301 or the gesture sensing unit 307 , and generate an operation signal correspondingly. As the operation signal is generated, the target position will also change.

当屏幕301感测使用者进行缩放操作时,屏幕301将对应产生缩放操作信号。控制单元303据以得到一成像距离后,根据成像距离而更新目标位置。When the screen 301 senses that the user performs a zoom operation, the screen 301 will correspondingly generate a zoom operation signal. After obtaining an imaging distance, the control unit 303 updates the target position according to the imaging distance.

旋转操作被感测到时,姿态感测单元307或屏幕301将对应产生旋转操作信号。旋转操作的产生原因可能是,拍摄装置20本身的摆置姿态因为使用者的握持而产生旋转。或者,旋转操作的另一种产生原因可能是,因应屏幕301上的触控轨迹所导致。经由姿态感测单元307或屏幕301,控制单元303对应得出旋转方向与旋转角度。之后,控制单元303将跟据旋转方向与旋转角度而更新目标位置。When the rotation operation is sensed, the gesture sensing unit 307 or the screen 301 will correspondingly generate a rotation operation signal. The reason for the rotation operation may be that the posture of the shooting device 20 itself is rotated by the user's grip. Alternatively, another reason for the rotation operation may be caused by a touch track on the screen 301 . Through the posture sensing unit 307 or the screen 301 , the control unit 303 obtains the rotation direction and the rotation angle correspondingly. Afterwards, the control unit 303 will update the target position according to the rotation direction and rotation angle.

回复操作可通过屏幕301感测得出。当回复操作信号被感测到时,控制单元303将使用者的视线所朝向的目标位置,由当前位置回复至预设位置。接着投影产生预设虚拟影像。预设位置可以是与x-y平面垂直的一目标位置,或是由使用者预先选定的预设目标位置。The reply operation can be sensed through the screen 301 . When the return operation signal is sensed, the control unit 303 returns the target position where the user's line of sight is directed from the current position to the preset position. Then the projection generates a preset virtual image. The preset position may be a target position perpendicular to the x-y plane, or a preset target position pre-selected by the user.

其后,控制单元303再根据更新后的目标位置,控制屏幕301所显示的虚拟影像。因此,拍摄装置20所显示的虚拟影像,可动态的根据使用者的操作而调整。Thereafter, the control unit 303 controls the virtual image displayed on the screen 301 according to the updated target position. Therefore, the virtual image displayed by the shooting device 20 can be dynamically adjusted according to the user's operation.

再者,拍摄装置20还可针对虚拟影像的全部或局部范围进行拍摄。请参见图14,其是选取整个虚拟影像的示意图。图14所示的虚拟影像60包含房子与树木。使用者可利用拖曳的方式,经由选取框491而选择虚拟影像60的边界。其中,将选取框491所涵盖的范围,定义为选取影像(selected image)。Furthermore, the photographing device 20 can also photograph the entire or partial range of the virtual image. Please refer to FIG. 14 , which is a schematic diagram of selecting the entire virtual image. The virtual image 60 shown in FIG. 14 includes houses and trees. The user can select the boundary of the virtual image 60 through the marquee 491 by dragging. Wherein, the range covered by the marquee 491 is defined as a selected image.

请参见图15,其是选取部分的虚拟影像作为选取影像的示意图。此图式说明,选取影像是以图14的虚拟影像60为基础,只利用选取框492选择其中的一个小区域。例如:图15所示的选取框,只选择房子而未选择树木作为选取影像。Please refer to FIG. 15 , which is a schematic diagram of selecting a part of the virtual image as the selected image. This figure shows that the selected image is based on the virtual image 60 in FIG. 14 , and only a small area is selected by the marquee 492 . For example: in the marquee box shown in Figure 15, only houses are selected but no trees are selected as the selected image.

选取框492的轮廓并不需要被限定。例如,使用者可以在虚拟影像60上,任意的圈选偏好的范围。其后,被选取范围内地影像(选取影像)将用于显示或被储存The outline of the marquee 492 need not be defined. For example, the user can arbitrarily select a preferred range on the virtual image 60 . Thereafter, images within the selected range (selected images) will be used for display or stored

根据图14、图15所述的撷取方法,使用者可以在虚拟影像60中,选择希望拍摄的部分当作选取影像。其中,选取影像的尺寸小于或等于虚拟影像。According to the capturing method described in FIG. 14 and FIG. 15 , the user can select the desired part of the virtual image 60 as the selected image. Wherein, the size of the selected image is smaller than or equal to the virtual image.

据此,使用者可进一步在全景影像中,对个人喜好的虚拟影像进行快照(snapshot)。因此,即使使用者在拍摄时,受限于拍摄环境的限制未能选择理想的角度,仍能在事后在全景影像内,任意选择拍摄角度与拍摄位置而撷取合适的选择影像。Accordingly, the user can further take a snapshot of a virtual image of personal preference in the panoramic image. Therefore, even if the user fails to select an ideal angle due to the limitations of the shooting environment when shooting, he can still choose the shooting angle and shooting position in the panoramic image afterwards to capture a suitable selected image.

承上,于初始影像拍摄后,拍摄装置20将自动显示相对应的提示图案(例如,目标图案33、散布图35与标记等)。依循提示图案,使用者可轻易拍摄合适的目标影像。As mentioned above, after the initial image is captured, the photographing device 20 will automatically display the corresponding prompt pattern (for example, the target pattern 33 , the scatter diagram 35 and the mark, etc.). Following the prompt pattern, the user can easily take a suitable target image.

于显示全景影像时,视角图式让使用者以更全面的方式观看全景影像。再者,在显示虚拟影像时,拍摄装置20还提供虚拟影像的撷取功能。是故,拍摄装置20所提供的全景影像拍摄方法、显示方法、影像撷取方法能让使用者更容易操作。When displaying a panoramic image, the viewing angle pattern allows the user to view the panoramic image in a more comprehensive manner. Moreover, when displaying the virtual image, the shooting device 20 also provides the function of capturing the virtual image. Therefore, the panoramic image shooting method, display method, and image capture method provided by the shooting device 20 can be operated more easily by the user.

综上所述,虽然本发明已以较佳实施例揭露如上,然其并非用以限定本发明。本领域技术人员,在不脱离本发明的精神和范围内,当可作各种的更动与润饰。因此,本发明的保护范围当视所附的权利要求范围所界定者为准。To sum up, although the present invention has been disclosed as above with preferred embodiments, it is not intended to limit the present invention. Those skilled in the art may make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention should be defined by the appended claims.

Claims (9)

1. an image pickup method for full-view image, comprises following steps:
Define the required multiple preliminary election focusing positions of a full-view image;
Show a scatter diagram that comprises the multiple pointers that represent the plurality of preliminary election focusing position;
Take the multiple target images corresponding with the plurality of preliminary election focusing position;
Change the demonstration outward appearance of the plurality of pointer according to the shooting state of the plurality of target image; And
Produce this full-view image according to the plurality of target image.
2. image pickup method according to claim 1, wherein, the step that changes the demonstration outward appearance of the plurality of pointer according to the shooting state of the plurality of target image comprises following steps:
In the time that target image corresponding to this preliminary election focusing position is not yet taken, to there is the pointer prompting of one first demonstration outward appearance;
In the time that target image corresponding to this preliminary election focusing position has been taken, to there is the pointer prompting of one second demonstration outward appearance; And
In the time that target image corresponding to this preliminary election focusing position is about to be taken, to there is the pointer prompting of one the 3rd demonstration outward appearance.
3. image pickup method according to claim 1, wherein the demonstration outward appearance of these pointers is to change according to a luminance parameter, a transparency parameter, a GTG parameter or a colorimetric parameter.
4. an image pickup method for full-view image, for an electronic installation, this image pickup method comprises following steps:
Show a preview screen with one first display mode;
Calculate and produce the required multiple preliminary election focusing positions of this full-view image, wherein the plurality of preliminary election focusing position is to be positioned at a three dimensions;
Because of rotation that should electronic installation, show that the one of the plurality of preliminary election focusing position is in this preview screen; And
When aiming at this one preliminary election focusing position, make the region that shows a corresponding target image in this preview screen change into one second display mode from this first display mode.
5. image pickup method according to claim 4, wherein,
This first display mode points out the corresponding target image of this preliminary election focusing position to be not yet taken; And
This second display mode points out the corresponding target image of this preliminary election focusing position to be taken.
6. image pickup method according to claim 4, also comprises following steps:
Take the multiple target images corresponding with the plurality of preliminary election focusing position.
7. image pickup method according to claim 6, the step of wherein taking the multiple target images corresponding with the plurality of preliminary election focusing position comprises following steps:
Pattern is chosen in demonstration one focusing; And
In the time that target pattern corresponding to this one preliminary election focusing position chosen pattern frame and selected by this focusing, show that one takes and confirms pattern.
8. image pickup method according to claim 7, the step of wherein taking the multiple target images corresponding with the plurality of preliminary election focusing position also comprises following steps:
In the time that target pattern corresponding to this one preliminary election focusing position chosen pattern institute frame and selected by this focusing, pattern is chosen in this focusing and this target pattern is converted to an aggressive mode from a standby mode.
9. image pickup method according to claim 8, wherein to choose pattern and this target pattern be in response to this standby mode and this aggressive mode and change a luminance parameter, a transparency parameter, a GTG parameter or a colorimetric parameter in this focusing.
CN201410116671.4A 2013-03-26 2014-03-26 How to shoot panoramic images Active CN104168407B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/282,218 US10070048B2 (en) 2013-03-26 2014-05-20 Panorama photographing method, panorama displaying method, and image capturing method

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201361805155P 2013-03-26 2013-03-26
US61/805,155 2013-03-26
US201414219690A 2014-03-19 2014-03-19
US14/219,690 2014-03-19

Publications (2)

Publication Number Publication Date
CN104168407A true CN104168407A (en) 2014-11-26
CN104168407B CN104168407B (en) 2019-03-22

Family

ID=51519959

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410116671.4A Active CN104168407B (en) 2013-03-26 2014-03-26 How to shoot panoramic images

Country Status (3)

Country Link
CN (1) CN104168407B (en)
DE (1) DE102014104070B4 (en)
TW (1) TWI484285B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106303223A (en) * 2016-07-29 2017-01-04 努比亚技术有限公司 A kind of image processing method and equipment
CN107786722A (en) * 2016-08-27 2018-03-09 华为技术有限公司 A kind of panorama shooting method and terminal
CN110494915A (en) * 2017-04-04 2019-11-22 佳能株式会社 Electronic device and its control method

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9241104B1 (en) * 2014-10-30 2016-01-19 Htc Corporation Panorama photographing method
TWI550334B (en) * 2015-06-29 2016-09-21 華碩電腦股份有限公司 Sphere panorama image capturing device
CN108495045B (en) * 2018-05-17 2020-11-27 Oppo广东移动通信有限公司 Image capturing method, image capturing apparatus, electronic apparatus, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1940712A (en) * 2005-09-30 2007-04-04 乐金电子(中国)研究开发中心有限公司 Method for taking a panoramic picture and mobile terminal therefor
CN101288025A (en) * 2005-07-11 2008-10-15 诺基亚公司 Improved system and method for displaying image focus information on a viewfinder
KR20080094321A (en) * 2007-04-20 2008-10-23 삼성전자주식회사 Apparatus and method for controlling panoramic image shooting using auto focus
CN101964869A (en) * 2009-07-23 2011-02-02 华晶科技股份有限公司 Directed shooting method for panoramic picture
US20120194637A1 (en) * 2011-01-31 2012-08-02 Samsung Electronics Co., Ltd. Photographing apparatus for photgraphing panoramic image and method thereof

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6144501A (en) 1998-08-28 2000-11-07 Lucent Technologies Inc. Split mirrored panoramic image display
US7746404B2 (en) * 2003-11-10 2010-06-29 Hewlett-Packard Development Company, L.P. Digital camera with panoramic image capture
US7630571B2 (en) * 2005-09-15 2009-12-08 Microsoft Corporation Automatic detection of panoramic camera position and orientation table parameters
TWI274971B (en) * 2006-03-28 2007-03-01 Univ Nat Chiao Tung Mark-assisted positioning system and method
KR100827089B1 (en) 2006-04-25 2008-05-02 삼성전자주식회사 How to take a panoramic photo
KR100725053B1 (en) * 2006-06-22 2007-06-08 삼성전자주식회사 Panoramic photographing device and method of portable terminal
KR101496467B1 (en) 2008-09-12 2015-02-26 엘지전자 주식회사 A mobile terminal having a panoramic photographing function and a method of operating the same
KR101631912B1 (en) 2009-11-03 2016-06-20 엘지전자 주식회사 Mobile terminal and control method thereof
CN102918858B (en) * 2010-12-24 2014-09-03 富士胶片株式会社 3-D panoramic image creating apparatus, 3-D panoramic image creating method,3-D panoramic image replay apparatus, and 3-D panoramic image replay method
WO2012131151A1 (en) 2011-03-28 2012-10-04 Nokia Corporation Methods and apparatuses for generating a panoramic image
WO2012154365A2 (en) 2011-04-12 2012-11-15 Google Inc. Integrating maps and street views
US20130104025A1 (en) 2011-10-20 2013-04-25 Microsoft Corporation Enabling immersive search engine home pages
CN103907341B (en) 2011-11-07 2017-05-24 索尼电脑娱乐公司 Image generation device, and image generation method
US20160063671A1 (en) 2012-08-30 2016-03-03 Nokia Corporation A method and apparatus for updating a field of view in a user interface

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101288025A (en) * 2005-07-11 2008-10-15 诺基亚公司 Improved system and method for displaying image focus information on a viewfinder
CN1940712A (en) * 2005-09-30 2007-04-04 乐金电子(中国)研究开发中心有限公司 Method for taking a panoramic picture and mobile terminal therefor
KR20080094321A (en) * 2007-04-20 2008-10-23 삼성전자주식회사 Apparatus and method for controlling panoramic image shooting using auto focus
CN101964869A (en) * 2009-07-23 2011-02-02 华晶科技股份有限公司 Directed shooting method for panoramic picture
US20120194637A1 (en) * 2011-01-31 2012-08-02 Samsung Electronics Co., Ltd. Photographing apparatus for photgraphing panoramic image and method thereof

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106303223A (en) * 2016-07-29 2017-01-04 努比亚技术有限公司 A kind of image processing method and equipment
CN107786722A (en) * 2016-08-27 2018-03-09 华为技术有限公司 A kind of panorama shooting method and terminal
CN107786722B (en) * 2016-08-27 2020-09-18 华为技术有限公司 Panoramic shooting method and terminal
CN110494915A (en) * 2017-04-04 2019-11-22 佳能株式会社 Electronic device and its control method
US11100903B2 (en) 2017-04-04 2021-08-24 Canon Kabushiki Kaisha Electronic device and control method for controlling a display range on a display
CN110494915B (en) * 2017-04-04 2022-02-18 佳能株式会社 Electronic device, control method thereof, and computer-readable medium

Also Published As

Publication number Publication date
DE102014104070B4 (en) 2019-03-07
TWI484285B (en) 2015-05-11
TW201447468A (en) 2014-12-16
CN104168407B (en) 2019-03-22
DE102014104070A1 (en) 2014-10-02

Similar Documents

Publication Publication Date Title
EP2154648B1 (en) Image processing device, image processing method, and image processing program
US10070048B2 (en) Panorama photographing method, panorama displaying method, and image capturing method
US9282242B2 (en) Method and electric device for taking panoramic photograph
US9674444B2 (en) Apparatus and method for positioning image area using image sensor location
JP6205072B2 (en) Imaging control apparatus, imaging control method, camera, camera system, and program
US9456129B2 (en) Image processing device, imaging device, program, and image processing method
CN103188434B (en) Method and device of image collection
US20110273369A1 (en) Adjustment of imaging property in view-dependent rendering
TWI484285B (en) Panorama photographing method
US20150077591A1 (en) Information processing device and information processing method
JP2006129511A (en) Projection system, method for adjusting projected image and projector
KR101703013B1 (en) 3d scanner and 3d scanning method
WO2018045592A1 (en) Image shooting method and device, and terminal
EP4195664A1 (en) Image processing method, mobile terminal, and storage medium
JP2006244329A (en) Mobile terminal, information processing apparatus and system
JP2013009189A (en) Imaging device and imaging method
CN113329172B (en) Shooting method and device and electronic equipment
JP7640718B2 (en) Photographing method, device, electronic device, and readable storage medium
CN105991918B (en) Panoramic image shooting method
CN105094614B (en) Method for displaying image and device
US20150022559A1 (en) Method and apparatus for displaying images in portable terminal
CN114549658A (en) Camera calibration method and device and electronic equipment
KR101960046B1 (en) Method for producing virtual reality image, portable device in which VR photographing program for performing the same is installed, and server supplying the VR photographing program to the portable device
CN115379075A (en) Moon shooting method and device, storage medium and shooting equipment
KR20090028043A (en) Recording device and screen designation method that can designate screen based on shooting screen

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant