[go: up one dir, main page]

CN114641805A - Split screen feature for macro photography - Google Patents

Split screen feature for macro photography Download PDF

Info

Publication number
CN114641805A
CN114641805A CN202180006265.0A CN202180006265A CN114641805A CN 114641805 A CN114641805 A CN 114641805A CN 202180006265 A CN202180006265 A CN 202180006265A CN 114641805 A CN114641805 A CN 114641805A
Authority
CN
China
Prior art keywords
camera
macro
electronic device
mobile electronic
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180006265.0A
Other languages
Chinese (zh)
Inventor
加尔·沙伯泰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Corephotonics Ltd
Original Assignee
Corephotonics Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Corephotonics Ltd filed Critical Corephotonics Ltd
Publication of CN114641805A publication Critical patent/CN114641805A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/02Viewfinders
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/02Viewfinders
    • G03B13/06Viewfinders with lenses with or without reflectors
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B30/00Camera modules comprising integrated lens units and imaging units, specially adapted for being embedded in other devices, e.g. mobile phones or vehicles
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/04Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147Details of sensors, e.g. sensor lenses
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/635Region indicators; Field of view indicators
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/69Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/001Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/06Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Vascular Medicine (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)

Abstract

Various mobile electronic devices include a first camera having a first field of view (FOV)1) (ii) a A second macro camera having a macro field of view (FOV) smaller than the first field of viewM) (ii) a And a device screen including a first screen portion configured to display first image data from the first camera; and a second screen portion configured to display second image data from the macro camera when both cameras are focused to a distance equal to or less than 30 cm.

Description

用于微距摄影的分屏特征Split screen feature for macro photography

相关申请的交叉引用CROSS-REFERENCE TO RELATED APPLICATIONS

本申请要求于2020年2月22日提交的美国临时专利申请第62/980,184号;2020年5月30日提交的美国临时专利申请第63,032,576号;以及2020年9月18日提交的美国临时专利申请第63,080,047号的优先权,其全部内容通过引用并入本文。This application claims US Provisional Patent Application No. 62/980,184, filed February 22, 2020; US Provisional Patent Application No. 63,032,576, filed May 30, 2020; and US Provisional Patent Application No. 18, 2020 Priority to Application No. 63,080,047, the entire contents of which are incorporated herein by reference.

技术领域technical field

本文公开的主题大体上涉及微距(Macro)图像,并且具体地涉及使用多摄像头(multi-cameras)(例如:双摄像头(dual-cameras))获得此类图像的方法。The subject matter disclosed herein relates generally to macro images, and in particular to methods of obtaining such images using multi-cameras (eg, dual-cameras).

背景技术Background technique

多孔数码摄像头(Multi-aperture digital cameras)(或多摄像头(multi-cameras))是移动电子装置(例如,智能手机、平板电脑等)的标准配置。多摄像头通常包括具有广角视场(wide field-of-view)(或角度)FOVW的摄像头(广角摄像头),以及至少一附加摄像头,具有相同的视场(例如,深度辅助摄像头),具有更窄(比广角视场)视场FOVT(长焦(Telephoto)或长焦(Tele)摄像头),或具有比广角视场更广角的超广角(UW)视场FOVUW。在以下一些实施例中,广角或超广角摄像头可被称为非微距摄像头(non-Macro camera)。Multi-aperture digital cameras (or multi-cameras) are standard in mobile electronic devices (eg, smartphones, tablets, etc.). Multiple cameras typically include a camera with a wide field-of-view (or angle) FOV W (a wide-angle camera), and at least one additional camera with the same field-of-view (eg, a depth assist camera), with a larger Narrow (wider than wide) field of view FOV T (Telephoto or Tele camera), or ultra-wide (UW) FOV UW with wider than wide field of view. In some embodiments below, a wide-angle or ultra-wide-angle camera may be referred to as a non-Macro camera.

微距摄影模式正在成为智能手机摄像头的流行差异化因素。微距摄影是指拍摄距离摄像头非常近的物体,使图像传感器记录的物体图像尺寸几乎与被拍摄的物体的实际尺寸一样大,即它有一个大物体,例如图像放大率10:1到1:1。这样的图像可以被称为微距图像。第一批包含具有微距视场FOVM的微距摄像头(通常基于超广角摄像头)的智能手机已进入消费市场。微距摄像头可以用远摄摄像头(Tele camera)来实现。一个优点是使用远摄摄像头捕捉的微距图像的高放大率,因此可以说是超微距图像(Super Macro Image)”。在一些示例中,微距摄像头可以是扫描式远摄摄像头(scanning Tele camera),其可以使用其原生(native)微距视场扫描场景,例如在共同拥有的美国专利10,578,948中所描述的。Macro photography mode is becoming a popular differentiator for smartphone cameras. Macro photography refers to shooting an object very close to the camera so that the image sensor records the size of the image of the object almost as large as the actual size of the object being shot, i.e. it has a large object, such as an image magnification of 10:1 to 1: 1. Such images may be referred to as macro images. The first smartphones to include a macro camera (usually based on an ultra-wide-angle camera) with a macro field of view FOV M have entered the consumer market. A macro camera can be implemented with a tele camera (Tele camera). One advantage is the high magnification of macro images captured with a telephoto camera, so it can be said to be a “Super Macro Image”. In some examples, the macro camera may be a scanning telephoto camera. camera), which can scan a scene using its native macro field of view, such as described in commonly owned US Patent 10,578,948.

微距图像以约20厘米或更小的物体-摄像头距离记录。超广角摄像头可能仍然能够对焦到这些小距离。通常,非常小的物体(例如,尺寸小于1厘米)被定位为图像物体(即,感兴趣的物体(objects of interest,OOI))。微距图像的这种非常小的感兴趣的物体可能会被多摄像头主机装置(multi-camera hosting device)遮挡,使得微距摄像头难以以精确方式捕捉感兴趣的物体。当微距视场捕捉物体的小面积(例如,几平方毫米)时(例如,放置在距离摄像头2厘米到10厘米的地方),同时被集成在大型装置中时,这一点尤其重要。有一种支持快速且用户友好的方式来将微距摄像头微距视场指向非常小的感兴趣的物体的方法会是有益的。Macro images are recorded at an object-camera distance of about 20 cm or less. Ultra-wide cameras may still be able to focus to these small distances. Typically, very small objects (eg, less than 1 cm in size) are located as image objects (ie, objects of interest (OOI)). Such a very small object of interest for macro images may be obscured by a multi-camera hosting device, making it difficult for a macro camera to capture the object of interest in an accurate manner. This is especially important when the macro field of view captures a small area of the object (eg, a few square millimeters) (eg, placed 2 cm to 10 cm from the camera) while being integrated in a larger setup. It would be beneficial to have a method that supports a fast and user-friendly way to point the macro camera's macro field of view at very small objects of interest.

发明内容SUMMARY OF THE INVENTION

在一些实施例中,提供了在多摄像头主机装置(multi-camera hosting device)上分屏(split screen)视图,其示出了超广角摄像头视场(field of view,FOV)的预览图像片段以及微距视场(Macro field of view,FOVM)的预览图像片段,以支持使用微距视场对准感兴趣的物体(object of interest,OOI)。In some embodiments, a split screen view is provided on a multi-camera hosting device showing a preview image segment of the ultra-wide camera field of view (FOV) and A preview image segment of the Macro field of view (FOV M ) to support targeting objects of interest (OOI) using the macro field of view.

向用户显示的超广角摄像头视场的图像片段可以包含一些区分元素,标记将通过微距模式捕捉的感兴趣的物体的区域。这种区分元素标记可以包括一可触摸框(touchablebox),例如,一矩形框。用户可以在屏幕上获得反馈,其中多摄像头主机装置将被移动,以使用微距视场捕捉感兴趣的物体。The image segment of the ultra-wide camera's field of view shown to the user can contain distinguishing elements that mark the area of the object of interest that will be captured by macro mode. Such distinguishing element marking may include a touchable box, eg, a rectangular box. The user can get feedback on the screen where the multi-camera host unit will be moved to capture the object of interest using the macro field of view.

在各种实施例中,提供了多种移动电子装置,包括一第一摄像头(camera),具有一第一视场(first field of view,FOV1);一第二微距摄像头(Macro camera),具有一微距视场(Macro field of view,FOVM),所述微距视场小于所述第一视场;以及一装置屏幕,包括一第一屏幕部分,配置为显示来自所述第一摄像头的第一图像数据;以及一第二屏幕部分,配置为当两个摄像头对焦到等于或小于30厘米(cm)的距离时,显示来自所述微距摄像头的第二图像数据。In various embodiments, various mobile electronic devices are provided, including a first camera (camera) having a first field of view (FOV 1 ); a second macro camera (Macro camera) , having a macro field of view (FOV M ), the macro field of view is smaller than the first field of view; and a device screen, including a first screen portion, configured to display from the first first image data from a camera; and a second screen portion configured to display second image data from the macro camera when the two cameras are in focus to a distance equal to or less than 30 centimeters (cm).

在一些实施例中,所述微距视场显示并标记在所述第一屏幕部分内。In some embodiments, the macro field of view is displayed and marked within the first screen portion.

在一些实施例中,所述第一屏幕部分包括一视觉指示,用于引导所述移动电子装置的一用户使用所述微距视场朝向一场景。In some embodiments, the first screen portion includes a visual indication for directing a user of the mobile electronic device toward a scene using the macro field of view.

在一些实施例中,所述第二屏幕部分显示来自所述第一摄像头的第一图像数据。In some embodiments, the second screen portion displays first image data from the first camera.

在一些实施例中,一装置还包含一控制器,用于基于所述第一图像数据控制所述微距摄像头的状态的改变。在一些实施例中,所述微距摄像头的状态是一变焦状态。在一些实施例中,所述微距摄像头的状态是一对焦状态。In some embodiments, an apparatus further includes a controller for controlling changes in the state of the macro camera based on the first image data. In some embodiments, the state of the macro camera is a zoom state. In some embodiments, the state of the macro camera is an in-focus state.

在一些实施例中,所述第一摄像头的一焦距在2到7毫米之间。In some embodiments, a focal length of the first camera is between 2 and 7 mm.

在一些实施例中,所述微距摄像头的一焦距在12到40毫米之间。In some embodiments, a focal length of the macro camera is between 12 and 40 millimeters.

在一些实施例中,所述微距摄像头的一焦距在14到30毫米之间。In some embodiments, a focal length of the macro camera is between 14 and 30 millimeters.

在一些实施例中,所述微距摄像头的一焦距在15到20毫米之间。In some embodiments, a focal length of the macro camera is between 15 and 20 millimeters.

在一些实施例中,两个摄像头均可以对焦到小于20厘米的距离。In some embodiments, both cameras can focus to a distance of less than 20 centimeters.

在一些实施例中,两个摄像头均可以对焦到10厘米或更小的距离。In some embodiments, both cameras can focus to a distance of 10 centimeters or less.

在一些实施例中,至少一摄像头可以对焦到5到10厘米之间的距离。In some embodiments, at least one camera can focus to a distance between 5 and 10 centimeters.

在一些实施例中,至少一摄像头可以对焦到5厘米或更小的距离。In some embodiments, at least one camera can focus to a distance of 5 centimeters or less.

在一些实施例中,至少一摄像头可以对焦到3厘米或更小的距离。In some embodiments, at least one camera can focus to a distance of 3 centimeters or less.

在一些实施例中,所述第一摄像头是一超广角摄像头。In some embodiments, the first camera is an ultra-wide-angle camera.

在一些实施例中,所述第一摄像头是一广角摄像头。In some embodiments, the first camera is a wide-angle camera.

在一些实施例中,所述微距摄像头是一扫描式远摄摄像头(scanning Telecamera)。在一些实施例中,所述装置还包含一控制器,用于基于所述第一图像数据控制所述微距摄像头的一扫描状态的改变。In some embodiments, the macro camera is a scanning telecamera. In some embodiments, the apparatus further includes a controller for controlling a change of a scanning state of the macro camera based on the first image data.

在一些实施例中,所述微距摄像头是具有不同变焦状态的一远摄摄像头。In some embodiments, the macro camera is a telephoto camera with different zoom states.

在一些实施例中,所述第一摄像头对焦到一第一距离,所述第一距离与所述微距摄像头对焦到的一第二距离不同。In some embodiments, the first camera focuses to a first distance, and the first distance is different from a second distance to which the macro camera focuses.

在一些实施例中,当所述移动电子装置保持在一横向(landscape)方向时,所述第一屏幕部分及所述第二屏幕部分被垂直分割,并且当所述移动电子装置保持在一纵向(portrait)方向时,所述第一屏幕部分及所述第二屏幕部分被水平分割。In some embodiments, the first screen portion and the second screen portion are vertically split when the mobile electronic device is held in a landscape orientation, and when the mobile electronic device is held in a portrait orientation (portrait) direction, the first screen portion and the second screen portion are divided horizontally.

在一些实施例中,所述装置是一智能手机。In some embodiments, the device is a smartphone.

在一些实施例中,所述装置还包含一控制器,用于基于所述第一图像数据控制所述微距摄像头的一扫描状态的改变。In some embodiments, the apparatus further includes a controller for controlling a change of a scanning state of the macro camera based on the first image data.

在各种实施例中,提供了多种方法,包含:提供一移动电子装置,包括一第一摄像头,具有第一视场;一第二微距摄像头,具有小于所述第一视场的一微距视场;以及一装置屏幕;将所述第一摄像头与所述微距摄像头对焦到≤30厘米的距离;以及在所述装置屏幕的一第一部分上显示来自所述第一摄像头的第一图像数据,并且在所述装置屏幕的一第二部分上显示来自所述第二摄像头的第二图像数据。In various embodiments, methods are provided, including: providing a mobile electronic device including a first camera having a first field of view; a second macro camera having a smaller than the first field of view a macro field of view; and a device screen; focusing the first camera and the macro camera to a distance of ≤30 centimeters; and displaying a first image from the first camera on a first portion of the device screen image data, and second image data from the second camera is displayed on a second portion of the device screen.

在一些实施例中,将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将所述第一摄像头对焦到≤30厘米的一第一距离,以及将所述微距摄像头对焦到与所述第一距离不同的≤30厘米的距离。In some embodiments, focusing the first camera and the macro camera to a distance of ≤30 centimeters includes focusing the first camera to a first distance of ≤30 centimeters, and focusing the macro camera to a distance of ≤30 centimeters Focus to a distance of ≤30 cm different from the first distance.

在一些实施例中,将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将两个摄像头对焦到20厘米或更小的距离。In some embodiments, focusing the first camera and the macro camera to a distance of < 30 centimeters includes focusing both cameras to a distance of 20 centimeters or less.

在一些实施例中,将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将两个摄像头对焦到10厘米或更小的距离。In some embodiments, focusing the first camera and the macro camera to a distance of < 30 centimeters includes focusing both cameras to a distance of 10 centimeters or less.

在一些实施例中,将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将两个摄像头或其中一个摄像头对焦到5厘米或更小的距离。In some embodiments, focusing the first camera and the macro camera to a distance of < 30 centimeters includes focusing either or both cameras to a distance of 5 centimeters or less.

在一些实施例中,将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将两个摄像头或其中一个摄像头对焦到3厘米或更小的距离。In some embodiments, focusing the first camera and the macro camera to a distance of < 30 centimeters includes focusing either or both cameras to a distance of 3 centimeters or less.

在一些实施例中,一种方法还包含在所述第一屏幕部分内显示及标记所述微距视场。In some embodiments, a method further includes displaying and marking the macro field of view within the first screen portion.

在一些实施例中,一种方法还包含在所述第一屏幕部分中包括一视觉指示,用于引导所述移动电子装置的一用户使用所述微距视场朝向一场景。In some embodiments, a method further includes including a visual indication in the first screen portion for directing a user of the mobile electronic device toward a scene using the macro field of view.

在一些实施例中,一种方法还包含在所述第二屏幕部分中显示所述第一图像数据。In some embodiments, a method further includes displaying the first image data in the second screen portion.

在一些实施例中,一种方法还包含基于所述第一图像数据控制所述微距摄像头的状态的改变。In some embodiments, a method further includes controlling a change in state of the macro camera based on the first image data.

在一些实施例中,控制所述微距摄像头的状态的改变包括控制选自于由所述微距摄像头的一扫描状态、一变焦状态及一对焦状态所组成的群组中的一状态的改变。In some embodiments, controlling the change of the state of the macro camera includes controlling the change of a state selected from the group consisting of a scan state, a zoom state, and a focus state of the macro camera .

在一些实施例中,所述微距摄像头是一扫描式远摄摄像头(scanning Telecamera),并且基于所述第一图像数据控制所述微距摄像头的状态的改变包括自动控制所述扫描式远摄摄像头的一扫描状态的改变。In some embodiments, the macro camera is a scanning telecamera, and controlling a change in the state of the macro camera based on the first image data includes automatically controlling the scanning telecamera A change in the scanning state of the camera.

在一些实施例中,所述微距摄像头是具有不同变焦状态的一远摄摄像头,并且控制所述微距摄像头的状态的改变包括自动控制所述远摄摄像头的一变焦状态的改变。In some embodiments, the macro camera is a telephoto camera with different zoom states, and controlling a change in the state of the macro camera includes automatically controlling a change in a zoom state of the telephoto camera.

附图说明Description of drawings

下面参考在此段落之后列出的附图描述本文公开的实施例的非限制性示例。附图以及描述旨在阐明及说明本文公开的实施例,并且不应以任何方式被认为是限制性的。不同附图中的相同元件可以使用相同的数字表示。附图中的元件不一定按比例绘制。Non-limiting examples of the embodiments disclosed herein are described below with reference to the figures listed after this paragraph. The drawings and description are intended to illustrate and describe the embodiments disclosed herein, and should not be considered limiting in any way. The same elements in different drawings may be represented by the same numerals. Elements in the figures are not necessarily drawn to scale.

图1示意性地示出了超广角视场(field of view,FOV)以及微距视场之间的双摄像头(dual-camera)输出图像大小及比率;Figure 1 schematically shows the dual-camera (dual-camera) output image size and ratio between the ultra-wide field of view (FOV) and the macro field of view;

图2A示出了根据本文公开的实施例的一种具有超广角摄像头、微距摄像头以及屏幕被分成两个部分的智能手机,其中一个部分展示了超广角视场(或其裁剪(crop)区域),而一个部分展示了微距视场(或其裁剪区域);2A illustrates a smartphone with an ultra-wide-angle camera, a macro camera, and a screen divided into two parts, one of which shows the ultra-wide-angle field of view (or its crop area), according to embodiments disclosed herein ), while a section shows the macro field of view (or its cropped region);

图2B示出了朝向一感兴趣的物体(object of interest,OOI)移动智能手机的过程中的一第一阶段以及图2A的摄像头中的微距视场,如屏幕的每个部分所示;Figure 2B shows a first stage in the process of moving a smartphone towards an object of interest (OOI) and the macro field of view in the camera of Figure 2A, as shown in each portion of the screen;

图2C示出了朝向一感兴趣的物体移动智能手机的过程中的一最后阶段以及图2A的摄像头中的微距视场,如屏幕的每个部分所示;Figure 2C shows a final stage in the process of moving the smartphone towards an object of interest and the macro field of view in the camera of Figure 2A, as shown in each portion of the screen;

图3示出了根据本文公开的另一实施例的一分屏(split screen)视图;3 illustrates a split screen view according to another embodiment disclosed herein;

图4示出了根据本文公开的多个实施例的在移动电子装置中使用分屏进行微距摄影的方法的流程图;以及FIG. 4 shows a flowchart of a method for macro photography using split screen in a mobile electronic device according to various embodiments disclosed herein; and

图5示意性地示出了包括多摄像头并且被配置为执行本文公开的方法的电子装置的实施例。Figure 5 schematically illustrates an embodiment of an electronic device including multiple cameras and configured to perform the methods disclosed herein.

具体实施方式Detailed ways

本文公开的实施例解决了当使用智能手机以及其他移动电子装置中包括的多摄像头执行微距摄影时一感兴趣的物体的遮挡(occlusion)问题。为简单起见且仅作为示例,此解决方案以双摄像头(dual-camera)来说明,但应理解其也清楚地适用于具有三个或更多摄像头的多摄像头(multi-cameras)。Embodiments disclosed herein address the problem of occlusion of an object of interest when performing macro photography using multiple cameras included in smartphones and other mobile electronic devices. For simplicity and as an example only, this solution is illustrated with a dual-camera, but it should be understood that it is also clearly applicable to multi-cameras with three or more cameras.

图1示出了智能手机100的典型的视场(field of-view,FOV)比例,包括多摄像头(未示出),其包括一超广角(ultra-Wide,UW)摄像头,具有覆盖大部分场景的超广角视场(FOVUW)102;以及一微距摄像头,具有覆盖小部分场景的微距视场(FOVM)104。可以看到超广角与微距输出图像之间的示例尺寸及比例。FIG. 1 shows a typical field of-view (FOV) scale for a smartphone 100, including multiple cameras (not shown), including an ultra-wide (UW) camera with coverage over most of the an ultra-wide field of view (FOV UW ) 102 of the scene; and a macro camera with a macro field of view (FOV M ) 104 covering a small portion of the scene. Example sizes and ratios between ultra-wide and macro output images can be seen.

在一些示例中,微距摄像头可以是连续远摄变焦摄像头(continuous Tele zoomcamera),其中微距视场随着变焦因子(zoom factor,ZF)的变化而变化。In some examples, the macro camera may be a continuous tele zoom camera (continuous tele zoom camera), where the macro field of view varies with the zoom factor (ZF).

图2A示出了根据当前公开的主题的编号为200的智能电话的实施例,所述智能电话包括:具有超广角视场202的一超广角摄像头;具有微距视场204的一微距摄像头;以及一屏幕(显示器)206。图5中给出了智能手机200的系统描述。如图2A至图2C中的四个箭头所示,智能手机200可以由用户在四个或更多方向上移动,以手动将微距视场移向感兴趣的物体(object of interest,OOI)/感兴趣的区域(region-of-interest,ROI)。屏幕206示出了用于显示多摄像头的图像的一第一屏幕的示例。微距摄影需要近距离捕捉小物体。微距摄像头可以包括一焦距比超广角摄像头的焦距大得多(例如,3倍到25倍)的一远摄(Tele)镜头。在这种情况下,超广角摄像头可以轻松对焦到近距离(例如,2厘米(cm)到30cm),但由于焦距小,视场大,因此空间分辨率较差。例如,考虑2.5毫米(mm)焦距的超广角摄像头以及25mm焦距的微距摄像头。两个摄像头可以包括相同或不同的传感器(例如,具有相同或不同的像素数及像素大小)。假设两个摄像头包括相同的传感器,例如,具有4mm的主动图像传感器宽度。当对焦到5cm时,微距摄像头的M为1:1,会捕捉4mm宽的物体(与传感器宽度相同)。超广角摄像头的M为19:1,会捕捉76mm宽的物体。FIG. 2A illustrates an embodiment of a smartphone, numbered 200, according to the presently disclosed subject matter, the smartphone comprising: an ultra-wide camera with an ultra-wide field of view 202; a macro camera with a macro field of view 204 ; and a screen (display) 206. A system description of the smartphone 200 is given in FIG. 5 . As indicated by the four arrows in FIGS. 2A-2C , the smartphone 200 can be moved by the user in four or more directions to manually move the macro field of view toward an object of interest (OOI) /region-of-interest (ROI). Screen 206 shows an example of a first screen for displaying images from multiple cameras. Macro photography involves capturing small objects up close. The macro camera may include a telephoto (Tele) lens with a focal length much larger (eg, 3x to 25x) than that of the ultra-wide-angle camera. In this case, ultra-wide-angle cameras can easily focus to close distances (e.g., 2 centimeters (cm) to 30cm), but have poor spatial resolution due to their small focal length and large field of view. For example, consider an ultra-wide-angle camera with a 2.5 millimeter (mm) focal length and a macro camera with a 25mm focal length. The two cameras may include the same or different sensors (eg, have the same or different pixel counts and pixel sizes). Assume that both cameras include the same sensor, eg, with an active image sensor width of 4mm. When focusing to 5cm, the M of the macro camera is 1:1 and will capture objects 4mm wide (the same width as the sensor). The ultra-wide-angle camera has an M ratio of 19:1 and will capture objects up to 76mm wide.

在一些示例中,为了执行本文所公开的方法,代替或是除了具有超广角视场202的超广角摄像头之外,一智能手机,例如智能电话200可以包括一广角摄像头,所述广角(Wide,W)摄像头的一广角视场(FOVW)(未示出)小于超广角视场202,但仍然大于微距视场。在一些示例中,广角摄像头可能无法对焦到与例如距离很近的物体,例如10cm。在这样的示例中,为了执行本文公开的方法,广角摄像头可以被对焦到其最小焦距,例如20cm。In some examples, a smartphone, such as smartphone 200, may include a wide-angle camera in place of or in addition to an ultra-wide-angle camera having an ultra-wide-angle field of view 202 in order to perform the methods disclosed herein. W) A wide field of view (FOV W ) (not shown) of the camera is smaller than the ultra wide field of view 202, but still larger than the macro field of view. In some examples, the wide-angle camera may not be able to focus on objects that are very close, eg, 10cm. In such an example, to perform the methods disclosed herein, the wide-angle camera may be focused to its minimum focal length, eg, 20 cm.

上述超广角或广角摄像头的景深比具有微距视场的具有微距功能的远摄摄像头大。在超广角或广角图像数据中比在微距图像数据中更容易检测到感兴趣的区域。因此,可以使用超广角、广角或微距摄像头图像数据来自动检测及选择感兴趣的区域。The aforementioned ultra-wide or wide-angle cameras have a greater depth of field than macro-capable telephoto cameras with a macro field of view. Regions of interest are easier to detect in ultra-wide or wide-angle image data than in macro image data. Therefore, ultra-wide-angle, wide-angle or macro camera image data can be used to automatically detect and select regions of interest.

在示例性情况下,用户希望使用智能手机200捕捉一感兴趣的物体(例如,在摄像头中形成图像216的花208)或是具有非常高(微距)分辨率的一感兴趣的区域。对于本文公开的使用方法,屏幕206被分为两部分,一第一部分210(可能被裁剪(crop))以及一第二部分212。第一屏幕部分可以使用第一视场(first field of view,FOV1)显示来自第一摄像头的第一图像数据,第二屏幕部分可以用微距视场显示来自第二摄像头的第二图像数据。这里的示例显示屏幕上的分屏(split screen)视图,即,两个屏幕部分并排显示。在其他示例(未示出)中,可以在屏幕上显示“画中画(picture-in-picture)”视图,即一个屏幕部分可以显示为另一屏幕部分中的嵌件(inlay)。在一些示例中,第二屏幕部分可以显示在整个屏幕上或屏幕的大部分上,但显示第一屏幕部分的部分除外,其中第一屏幕部分覆盖的屏幕区域小于第二屏幕。在图2A至图2C的实施例中,两个屏幕部分典型地具有“横向(landscape)”方向,即,第一屏幕部分与第二屏幕部分被垂直分割,当装置以横向方向固定时是有益的。屏幕206可以包括已知的附加图标或符号(未显示)。第一屏幕部分210显示被裁剪的超广角视场(因此可以称为“超广角(UW)屏幕部分210”),而第二屏幕部分212显示微距视场(因此可以称为“微距屏幕部分212”)。在第一部分210内,微距视场204可由物理(即,在屏幕上可见)矩形204’标记。矩形204’表示微距视场204相对于超广角视场202的实际位置。可选地,另一个物理矩形204”指示感兴趣的物体(花)208的超广角预览,以便引导用户朝向花208。用户可以在超广角屏幕部分210中始终看到FOVM 204相对于矩形204”的位置,同时,微距屏幕部分212显示FOVM内的场景。在使用中,用户将带有摄像头的智能手机朝向花朵208移动。在微距屏幕部分212中,一箭头218指示将花朵208与微距视场204对齐所需的移动方向及距离。在一些示例中,来自超广角视场202的图像数据可以在微距屏幕部分212中显示。例如,当微距摄像头可能不在整个摄像头微距视场204的焦点上或当存在其他光学或图像质量问题时,这是有益的。In an exemplary case, the user wishes to use smartphone 200 to capture an object of interest (eg, flower 208 forming image 216 in the camera) or a region of interest with very high (macro) resolution. For the method of use disclosed herein, the screen 206 is divided into two parts, a first part 210 (possibly cropped) and a second part 212 . The first screen portion may display first image data from the first camera using a first field of view (FOV 1 ), and the second screen portion may display second image data from the second camera using a macro field of view . The example here shows a split screen view on the screen, ie two screen parts are displayed side by side. In other examples (not shown), a "picture-in-picture" view may be displayed on the screen, ie one screen portion may be displayed as an inlay in another screen portion. In some examples, the second screen portion may be displayed on the entire screen or a large portion of the screen, except for the portion where the first screen portion is displayed, wherein the first screen portion covers a smaller area of the screen than the second screen. In the embodiment of Figures 2A-2C, the two screen parts typically have a "landscape" orientation, ie the first screen part and the second screen part are vertically split, which is beneficial when the device is fixed in a landscape orientation of. Screen 206 may include known additional icons or symbols (not shown). The first screen portion 210 displays a cropped ultra-wide field of view (hence may be referred to as an "ultra wide angle (UW) screen portion 210"), while the second screen portion 212 displays a macro field of view (hence may be referred to as a "macro screen"). section 212"). Within the first portion 210, the macro field of view 204 may be marked by a physical (ie, visible on screen) rectangle 204'. The rectangle 204 ′ represents the actual position of the macro field of view 204 relative to the ultra-wide field of view 202 . Optionally, another physical rectangle 204" indicates an ultra wide angle preview of the object of interest (flower) 208 in order to guide the user towards the flower 208. The user can always see the FOVM 204 relative to the rectangle 204" in the ultra wide angle screen portion 210 At the same time, the macro screen portion 212 displays the scene within the FOVM. In use, the user moves the smartphone with the camera towards the flower 208 . In the macro screen portion 212, an arrow 218 indicates the direction and distance of movement required to align the flower 208 with the macro field of view 204. In some examples, image data from the ultra-wide field of view 202 may be displayed in the macro screen portion 212 . This is beneficial, for example, when the macro camera may not be in focus of the entire camera macro field of view 204 or when there are other optical or image quality issues.

图2B、图2C示出了将智能手机(及微距视场)移向花208(即,移向预览216)的过程。如图2B所示,超广角屏幕部分指示微距视场204的移动,使其接近矩形204”(预览216)。花开始出现在微距屏幕部分212中。在图2C中,微距视场204在超广角屏幕部分中被视为完全重叠的矩形204”,而花朵208在微距屏幕部分212中完全显示。2B, 2C illustrate the process of moving the smartphone (and macro field of view) toward the flower 208 (ie, toward the preview 216). As shown in Figure 2B, the ultra-wide screen portion indicates the movement of the macro field of view 204, making it close to the rectangle 204" (preview 216). Flowers begin to appear in the macro screen portion 212. In Figure 2C, the macro field of view 204 is seen as a fully overlapping rectangle 204" in the ultra-wide screen portion, while the flower 208 is fully displayed in the macro screen portion 212.

图3示出了根据当前公开的主题的标号微300的智能电话的实施例,所述智能电话包括:具有超广角视场302的一超广角摄像头;具有微距视场304的一微距摄像头;以及一屏幕306。屏幕306被分成一超广角屏幕部分310以及一微距屏幕部分312,两者都是纵向的,即,第一屏幕部分及第二屏幕部分被水平分割,当装置被保持在纵向时是有益的。在图2C中,在第一部分310内,微距视场304由一物理矩形304’标记,并且可选地,另一个物理矩形304”指示花308的超广角预览(其在摄像头中形成图像316),以便引导用户朝向花308。FIG. 3 illustrates an embodiment of a smartphone, labeled Micro 300 , according to the presently disclosed subject matter, the smartphone comprising: an ultra-wide camera with an ultra-wide field of view 302 ; a macro camera with a macro field of view 304 ; and a screen 306. The screen 306 is divided into an ultra-wide-angle screen portion 310 and a macro screen portion 312, both of which are in portrait orientation, i.e. the first screen portion and the second screen portion are split horizontally, which is beneficial when the device is held in portrait orientation . In Figure 2C, within the first portion 310, the macro field of view 304 is marked by a physical rectangle 304', and optionally another physical rectangle 304" indicates an ultra-wide preview of the flower 308 (which forms an image 316 in the camera) ) to guide the user towards the flower 308.

这种分割屏幕并同时显示超广角视场及微距视场的方法或装置允许用户找到感兴趣的物体,并使用微距摄像头(也可以同时使用超广角摄像头)捕捉它,即使手机(图像捕捉装置)遮挡了感兴趣的物体。This method or device for splitting the screen and displaying the super wide-angle field of view and the macro field of view at the same time allows the user to find the object of interest and capture it with the macro camera (and the super-wide-angle camera can also be used at the same time), even if the mobile phone (image capture device) occludes the object of interest.

图4示出了根据本文公开的实施例的在一移动电子装置中使用分屏进行微距摄影的方法的流程图。在步骤400,一移动电子装置的一屏幕被分割,以同时显示非微距(例如:超广角)摄像头图像流(steam)(或其裁剪版本)以及微距摄像头图像流(或其裁剪版本)。在步骤402,通过在感兴趣的物体/感兴趣的区域选择器546上运行的专用算法或是通过一人类用户在超广角摄像头的超广角视场中选择一感兴趣的物体/感兴趣的区域作为微距图像的一场景。超广角视场以及微距视场已被校准。如本领域已知的,超广角视场中的感兴趣的物体/感兴趣的区域的位置可以被转换为微距视场中的一相应的感兴趣的物体/感兴趣的区域的位置。在步骤404,基于超广角视场中的感兴趣的物体/感兴趣的区域的定位位置,来计算感兴趣的物体/感兴趣的区域相对于微距视场的各个位置。在步骤406,用户被视觉地或以其他方式引导朝向感兴趣的物体/感兴趣的区域相对于微距视场的定位位置。用于引导的视觉或其他指示可以是视觉的(例如,通过图2A至图2B中所示的箭头218),或是通过专用声音,或是通过一些触觉反馈。在一些示例中,用户控制单元544配置为提供视觉或其他指示。根据步骤406的引导,用户移动摄像头的主机(hosting)装置(例如,智能手机),直到感兴趣的物体/感兴趣的区域出现在微距视场中。在步骤408中,用户捕捉感兴趣的物体/感兴趣的区域的一微距图像(也称为超微距图像(Super Macro image))。FIG. 4 shows a flowchart of a method for macro photography using split screen in a mobile electronic device according to embodiments disclosed herein. In step 400, a screen of a mobile electronic device is segmented to simultaneously display a non-macro (eg, ultra-wide angle) camera image stream (steam) (or a cropped version thereof) and a macro camera image stream (or a cropped version thereof). . At step 402, an object of interest/region of interest is selected in the ultra-wide field of view of the ultra-wide camera by a dedicated algorithm running on the object of interest/region of interest selector 546 or by a human user A scene as a macro image. The ultra-wide field of view as well as the macro field of view have been calibrated. As is known in the art, the position of an object/region of interest in the ultra-wide field of view can be converted to the position of a corresponding object/region of interest in the macro field of view. In step 404, each position of the object of interest/region of interest relative to the macro field of view is calculated based on the positioning positions of the object of interest/region of interest in the super wide-angle field of view. At step 406, the user is visually or otherwise directed toward the location of the object/region of interest relative to the location of the macro field of view. Visual or other indications for guidance may be visual (eg, by arrow 218 shown in Figures 2A-2B), or by dedicated sounds, or by some tactile feedback. In some examples, user control unit 544 is configured to provide visual or other indications. Following the instructions of step 406, the user moves the camera's hosting device (eg, smartphone) until the object/region of interest appears in the macro field of view. In step 408, the user captures a macro image (also referred to as a Super Macro image) of the object/region of interest.

图5示意性地示出了编号为500的电子装置(例如,智能手机)的实施例,其包括多摄像头,并且配置为执行本文公开的方法。电子装置500包括具有微距视场的一微距摄像头510。微距摄像头510包括具有微距镜头的一微距镜头模块512、一微距图像传感器514以及用于致动微距镜头模块512的一镜头致动器516。微距镜头形成由微距图像传感器514记录的一微距图像。5 schematically illustrates an embodiment of an electronic device (eg, a smartphone), numbered 500, that includes multiple cameras and is configured to perform the methods disclosed herein. The electronic device 500 includes a macro camera 510 having a macro field of view. The macro camera 510 includes a macro lens module 512 having a macro lens, a macro image sensor 514 , and a lens actuator 516 for actuating the macro lens module 512 . The macro lens forms a macro image recorded by the macro image sensor 514 .

可选地,微距镜头可以具有提供一固定变焦因子的一固定有效焦距(effectivefocal length,EFL),或是提供一适配(adaptable)的变焦因子的一适配(可变(variable))的固定有效焦距。固定有效焦距的适配可以是离散的或连续的,即,用于提供具有相应的变焦因子的多个离散或连续变焦状态的可变的固定有效焦距的离散数量。摄像头510可以自动切换到有益的变焦状态。Alternatively, the macro lens may have a fixed effective focal length (EFL) that provides a fixed zoom factor, or an adaptable (variable) lens that provides an adaptable zoom factor. Fixed effective focal length. The adaptation of the fixed effective focal length may be discrete or continuous, ie a discrete number of variable fixed effective focal lengths for providing a plurality of discrete or continuous zoom states with corresponding zoom factors. Camera 510 can automatically switch to a beneficial zoom state.

可选地,微距摄像头510可以是折叠式摄像头,其包括光路折叠元件(opticalpath folding element,OPFE)518及光路折叠元件致动器522,用于致动光路折叠元件518,以进行光学图像稳定(optical image stabilization,OIS)及/或视场扫描。在一些实施例中,可以通过启动一个或多个光路折叠元件来执行微距摄像头的视场扫描。例如,在2020年11月5日提交的共同拥有的美国临时专利申请第63/110,057号中描述了通过驱动两个光路折叠元件执行视场扫描的扫描式微距摄像头。Alternatively, the macro camera 510 may be a folding camera including an optical path folding element (OPFE) 518 and an optical path folding element actuator 522 for actuating the optical path folding element 518 for optical image stabilization (optical image stabilization, OIS) and/or field scanning. In some embodiments, field-of-view scanning of the macro camera may be performed by activating one or more optical path folding elements. For example, commonly owned US Provisional Patent Application No. 63/110,057, filed on November 5, 2020, describes a scanning macro camera that performs field-of-view scanning by driving two optical path folding elements.

微距摄像头模块510还包括第一存储器524,例如在电子式可擦除可编程只读存储器(Electrically-Erasable Programmable Read-Only Memory,EEPROM)中。在一些实施例中,第一校准数据可以存储在存储器524中。在其他实施例中,第一校准数据可以存储在诸如非易失性存储器(Non-Volatile Memory,NVM)的第三存储器560中。第一校准数据可以包括图像传感器514与534之间的校准数据。The macro camera module 510 further includes a first memory 524, for example, in an electronically erasable programmable read-only memory (EEPROM). In some embodiments, the first calibration data may be stored in memory 524 . In other embodiments, the first calibration data may be stored in a third memory 560 such as Non-Volatile Memory (NVM). The first calibration data may include calibration data between image sensors 514 and 534 .

电子装置500还包括具有大于摄像头510的微距视场的超广角视场的超广角摄像头530。超广角摄像头530包括具有超广角镜头及超广角图像传感器534的超广角镜头模块532。镜头致动器536可以移动镜头模块532,以用于对焦及/或光学图像稳定。在一些实施例中,第二校准数据可以存储在第二存储器538中。在其他实施例中,第二校准数据可以存储在第三存储器560中。第二校准数据可以包括图像传感器514与534之间的校准数据。The electronic device 500 also includes an ultra-wide-angle camera 530 having an ultra-wide-angle field of view that is larger than the macro field of view of the camera 510 . The ultra-wide-angle camera 530 includes an ultra-wide-angle lens module 532 having an ultra-wide-angle lens and an ultra-wide-angle image sensor 534 . Lens actuator 536 may move lens module 532 for focusing and/or optical image stabilization. In some embodiments, the second calibration data may be stored in the second memory 538 . In other embodiments, the second calibration data may be stored in the third memory 560 . The second calibration data may include calibration data between image sensors 514 and 534 .

微距摄像头可以具有例如8至30mm或更大的一有效焦距,10至40度的对角视场,以及约f/#=1.8至6的f数。超广角摄像头可以具有例如2.5至8mm的一有效焦距,50至130度的对角视场,以及约1.0至2.5的f/#。Macro cameras may have, for example, an effective focal length of 8 to 30 mm or more, a diagonal field of view of 10 to 40 degrees, and an f-number of about f/#=1.8 to 6. Ultra wide angle cameras may have, for example, an effective focal length of 2.5 to 8 mm, a diagonal field of view of 50 to 130 degrees, and an f/# of about 1.0 to 2.5.

在一些实施例中,微距摄像头可以覆盖约50%的超广角摄像头的视场的的区域。在一些实施例中,微距摄像头可以覆盖约10%或更少的超广角摄像头的视场的区域。In some embodiments, the macro camera may cover approximately 50% of the area of the ultra-wide camera's field of view. In some embodiments, the macro camera may cover about 10% or less of the area of the ultra-wide camera's field of view.

电子装置500还包括应用处理器(application processor,AP)540。应用处理器540包括一摄像头控制器542、一用户控制单元544、感兴趣的物体/感兴趣的区域选择器546,以及一图像处理器548。电子装置500还包括一屏幕控制550及一屏幕570。屏幕570可以显示如本文所公开的方法。The electronic device 500 further includes an application processor (AP) 540 . The application processor 540 includes a camera controller 542 , a user control unit 544 , an object of interest/region of interest selector 546 , and an image processor 548 . The electronic device 500 also includes a screen control 550 and a screen 570 . Screen 570 may display methods as disclosed herein.

现在回到图4中的使用方法,在一些示例中,摄像头控制器542可以使用超广角或广角摄像头图像数据来自动改变微距摄像头的状态(即,控制微距摄像头的扫描状态的改变)。所述状态可以是扫描(或引导(steer))状态、变焦状态或对焦状态。例如,超广角或广角摄像头图像数据可用于自动引导(或扫描)扫描式远摄摄像头的微距视场朝向一感兴趣的区域(微距摄像头的扫描状态的变化)。在一示例中,微距摄像头可以自行操纵,并且将微距视场引导到感兴趣的区域的步骤406可以由摄像头控制器542自动完成。如上所述,选择超广角视场中的感兴趣的物体/感兴趣的区域作为微距图像摄像头的场景可以通过在感兴趣的物体/感兴趣的区域选择器546上运行的专用算法来完成。在另一个示例中,微距摄像头可以使用超广角或广角图像数据在变焦状态之间切换。摄像头控制器542可以自动将微距摄像头切换到有益的变焦状态(即,控制微距摄像头的变焦状态的改变),例如在执行步骤404及406时。有益的变焦状态可以是微距感兴趣的物体或感兴趣的区域完全进入微距视场的状态。在又一个示例中,摄像头控制器542可以使用广角或超广角摄像头的图像数据将微距摄像头自动对焦到微距视场内的感兴趣的区域(即,控制微距摄像头的对焦状态的改变)。跨越大于微距视场的场景的片段的感兴趣的物体或感兴趣的区域可以在两个或更多个连续帧中被完全捕捉,其中每个帧包括感兴趣的物体或感兴趣的区域的不同片段。顺序帧一起包括整体上的感兴趣的物体或感兴趣的区域上的图像数据,并由图像处理器548拼接成单个图像。Returning now to the method of use in FIG. 4, in some examples, the camera controller 542 may use the ultra-wide or wide-angle camera image data to automatically change the state of the macro camera (ie, control changes in the scan state of the macro camera). The state may be a scan (or steer) state, a zoom state or a focus state. For example, ultra-wide or wide-angle camera image data can be used to automatically steer (or scan) the macro field of view of the scanning telephoto camera toward an area of interest (change in scan state of the macro camera). In one example, the macro camera may be self-steering, and the step 406 of directing the macro field of view to the area of interest may be done automatically by the camera controller 542 . As mentioned above, selecting the object/region of interest in the ultra-wide field of view as the scene of the macro image camera can be accomplished by a dedicated algorithm running on the object/region of interest selector 546 . In another example, a macro camera can use ultra-wide or wide-angle image data to switch between zoom states. The camera controller 542 may automatically switch the macro camera to a beneficial zoom state (ie, control a change in the zoom state of the macro camera), eg, when steps 404 and 406 are performed. A beneficial zoom state may be one in which the macro object of interest or the region of interest fully enters the macro field of view. In yet another example, the camera controller 542 may use image data from the wide-angle or ultra-wide-angle camera to automatically focus the macro camera to a region of interest within the macro field of view (ie, control changes in the focus state of the macro camera) . Objects of interest or regions of interest spanning a segment of the scene larger than the macro field of view may be fully captured in two or more consecutive frames, where each frame includes an different fragments. The sequential frames together include image data on the object of interest or region of interest as a whole, and are stitched into a single image by the image processor 548 .

尽管已经根据某些示例和通常相关联的方法描述了本公开,但是示例和方法的改变和排列对于本领域技术人员来说将是显而易见的。本公开应理解为不受本文描述的具体示例的限制,而仅受所附权利要求的范围的限制。Although the present disclosure has been described in terms of certain examples and generally associated methods, modifications and permutations of the examples and methods will be apparent to those skilled in the art. The present disclosure should be understood not to be limited by the specific examples described herein, but only by the scope of the appended claims.

应当理解,为了清楚起见,在单独示例的上下文中描述的当前公开主题的某些特征也可以在单个示例中组合地提供。相反,为了简洁起见,在单个示例的上下文中描述的当前公开主题的各种特征也可以单独或以任何合适的子组合提供。It should be appreciated that certain features of the presently disclosed subject matter that are, for clarity, described in the context of separate examples, may also be provided in combination in a single example. Conversely, various features of the presently disclosed subject matter that are, for brevity, described in the context of a single example, may also be provided separately or in any suitable subcombination.

除非另有说明,否则在供选择的选择列表的最后两个成员之间使用“及/或”表示选择一个或多个所列选择是适当的,并且可以进行。Unless otherwise stated, the use of "and/or" between the last two members of a list of choices to choose from means that selection of one or more of the listed choices is appropriate and available.

应当理解,在权利要求或说明书提及“一(a)”或“一(an)”的元件的情况下,这种提及不应被解释为仅存在所述元件中的一个。It will be understood that, where the claim or specification refers to "a (a)" or "an (an)" elements, such reference should not be construed as presenting only one of the elements.

本说明书中提及的所有参考文献均以引用方式整体并入本说明书中,其程度如同每个单独的参考文献被具体地及单独地指示以引用方式并入本文一样。此外,本申请中任何参考文献的引用或标识不应被解释为承认所述参考文献可作为本申请的现有技术使用。All references mentioned in this specification are incorporated by reference in their entirety into this specification to the same extent as if each individual reference was specifically and individually indicated to be incorporated by reference. In addition, citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the present application.

Claims (39)

1.一种移动电子装置,其特征在于,所述移动电子装置包含:1. A mobile electronic device, wherein the mobile electronic device comprises: 一第一摄像头,具有一第一视场;a first camera with a first field of view; 一第二微距摄像头,具有一微距视场,所述微距视场小于所述第一视场;以及a second macro camera having a macro field of view, the macro field of view being smaller than the first field of view; and 一装置屏幕,包括一第一屏幕部分,配置为显示来自所述第一摄像头的第一图像数据;以及一第二屏幕部分,配置为当两个摄像头对焦到等于或小于30厘米的距离时,显示来自所述微距摄像头的第二图像数据。A device screen including a first screen portion configured to display first image data from the first camera; and a second screen portion configured to, when the two cameras focus to a distance equal to or less than 30 cm, Second image data from the macro camera is displayed. 2.如权利要求1所述的移动电子装置,其特征在于:所述微距视场显示并标记在所述第一屏幕部分内。2. The mobile electronic device of claim 1, wherein the macro field of view is displayed and marked within the first screen portion. 3.如权利要求1所述的移动电子装置,其特征在于:所述第一屏幕部分包括一视觉指示,用于引导所述移动电子装置的一用户使用所述微距视场朝向一场景。3 . The mobile electronic device of claim 1 , wherein the first screen portion includes a visual indication for guiding a user of the mobile electronic device to use the macro field of view toward a scene. 4 . 4.如权利要求1所述的移动电子装置,其特征在于:所述第二屏幕部分显示来自所述第一摄像头的第一图像数据。4. The mobile electronic device of claim 1, wherein the second screen portion displays the first image data from the first camera. 5.如权利要求1所述的移动电子装置,其特征在于:所述移动电子装置还包含一控制器,用于基于所述第一图像数据控制所述微距摄像头的状态的改变。5 . The mobile electronic device of claim 1 , wherein the mobile electronic device further comprises a controller for controlling a state change of the macro camera based on the first image data. 6 . 6.如权利要求1所述的移动电子装置,其特征在于:所述第一摄像头的一焦距在2到7毫米之间。6 . The mobile electronic device of claim 1 , wherein a focal length of the first camera is between 2 and 7 mm. 7 . 7.如权利要求1所述的移动电子装置,其特征在于:所述微距摄像头的一焦距在12到40毫米之间。7 . The mobile electronic device of claim 1 , wherein a focal length of the macro camera is between 12 and 40 mm. 8 . 8.如权利要求1所述的移动电子装置,其特征在于:所述微距摄像头的一焦距在14到30毫米之间。8 . The mobile electronic device of claim 1 , wherein a focal length of the macro camera is between 14 and 30 mm. 9 . 9.如权利要求1所述的移动电子装置,其特征在于:所述微距摄像头的一焦距在15到20毫米之间。9 . The mobile electronic device of claim 1 , wherein a focal length of the macro camera is between 15 and 20 mm. 10 . 10.如权利要求1至9中任一项所述的移动电子装置,其特征在于:两个摄像头均可以对焦到小于20厘米的距离。10. The mobile electronic device according to any one of claims 1 to 9, wherein both cameras can focus to a distance less than 20 cm. 11.如权利要求1至9中任一项所述的移动电子装置,其特征在于:至少一摄像头可以对焦到5到10厘米之间的距离。11. The mobile electronic device according to any one of claims 1 to 9, wherein at least one camera can focus to a distance between 5 and 10 centimeters. 12.如权利要求1至9中任一项所述的移动电子装置,其特征在于:两个摄像头都可以对焦到10厘米或更小的距离。12. The mobile electronic device according to any one of claims 1 to 9, wherein both cameras can focus to a distance of 10 cm or less. 13.如权利要求1至9中任一项所述的移动电子装置,其特征在于:至少一摄像头可以对焦到5厘米或更小的距离。13. The mobile electronic device according to any one of claims 1 to 9, wherein at least one camera can focus to a distance of 5 cm or less. 14.如权利要求1至9中任一项所述的移动电子装置,其特征在于:至少一摄像头可以对焦到3厘米或更小的距离。14. The mobile electronic device according to any one of claims 1 to 9, wherein at least one camera can focus to a distance of 3 cm or less. 15.如权利要求1所述的移动电子装置,其特征在于:所述第一摄像头是一超广角摄像头。15. The mobile electronic device of claim 1, wherein the first camera is an ultra-wide-angle camera. 16.如权利要求1所述的移动电子装置,其特征在于:所述第一摄像头是一广角摄像头。16. The mobile electronic device of claim 1, wherein the first camera is a wide-angle camera. 17.如权利要求1所述的移动电子装置,其特征在于:所述微距摄像头是一扫描式远摄摄像头。17. The mobile electronic device of claim 1, wherein the macro camera is a scanning telephoto camera. 18.如权利要求1所述的移动电子装置,其特征在于:所述微距摄像头是具有不同变焦状态的一远摄摄像头。18. The mobile electronic device of claim 1, wherein the macro camera is a telephoto camera with different zoom states. 19.如权利要求1所述的移动电子装置,其特征在于:所述第一摄像头对焦到一第一距离,所述第一距离与所述微距摄像头对焦到的一第二距离不同。19 . The mobile electronic device of claim 1 , wherein the first camera focuses on a first distance, and the first distance is different from a second distance on which the macro camera focuses. 20 . 20.如权利要求1所述的移动电子装置,其特征在于:当所述移动电子装置保持在一横向方向时,所述第一屏幕部分及所述第二屏幕部分被垂直分割,并且当所述移动电子装置保持在一纵向方向时,所述第一屏幕部分及所述第二屏幕部分被水平分割。20. The mobile electronic device of claim 1, wherein when the mobile electronic device is held in a landscape orientation, the first screen portion and the second screen portion are vertically divided, and when all the When the mobile electronic device is maintained in a portrait orientation, the first screen portion and the second screen portion are divided horizontally. 21.如权利要求1所述的移动电子装置,其特征在于:所述装置是一智能手机。21. The mobile electronic device of claim 1, wherein the device is a smart phone. 22.如权利要求5所述的移动电子装置,其特征在于:所述微距摄像头的状态为一变焦状态。22. The mobile electronic device of claim 5, wherein the state of the macro camera is a zoom state. 23.如权利要求5所述的移动电子装置,其特征在于:所述微距摄像头的状态为一对焦状态。23. The mobile electronic device of claim 5, wherein the state of the macro camera is a focus state. 24.如权利要求17所述的移动电子装置,其特征在于:所述移动电子装置还包含一控制器,用于基于所述第一图像数据控制所述微距摄像头的一扫描状态的改变。24. The mobile electronic device of claim 17, wherein the mobile electronic device further comprises a controller for controlling a change of a scanning state of the macro camera based on the first image data. 25.一种方法,其特征在于,所述方法包含:25. A method, characterized in that the method comprises: 提供一移动电子装置,包括一第一摄像头,具有第一视场;一第二微距摄像头,具有小于所述第一视场的一微距视场;以及一装置屏幕;A mobile electronic device is provided, including a first camera with a first field of view; a second macro camera with a macro field of view smaller than the first field of view; and a device screen; 将所述第一摄像头与所述微距摄像头对焦到≤30厘米的距离;以及focusing the first camera and the macro camera to a distance of ≤30 cm; and 在所述装置屏幕的一第一部分上显示来自所述第一摄像头的第一图像数据,并且在所述装置屏幕的一第二部分上显示来自所述第二摄像头的第二图像数据。First image data from the first camera is displayed on a first portion of the device screen, and second image data from the second camera is displayed on a second portion of the device screen. 26.如权利要求25所述的方法,其特征在于:所述方法还包含在所述第一屏幕部分内显示及标记所述微距视场。26. The method of claim 25, further comprising displaying and marking the macro field of view within the first screen portion. 27.如权利要求25所述的方法,其特征在于:所述方法还包含在所述第一屏幕部分中包括一视觉指示,用于引导所述移动电子装置的一用户使用所述微距视场朝向一场景。27. The method of claim 25, further comprising including a visual indication in the first screen portion for directing a user of the mobile electronic device to use the macro view The field is oriented towards a scene. 28.如权利要求25所述的方法,其特征在于:所述方法还包含在所述第二屏幕部分中显示所述第一图像数据。28. The method of claim 25, further comprising displaying the first image data in the second screen portion. 29.如权利要求25所述的方法,其特征在于:所述第一摄像头的一焦距在2至7毫米之间。29. The method of claim 25, wherein a focal length of the first camera is between 2 and 7 mm. 30.如权利要求25所述的方法,其特征在于:所述微距摄像头的一焦距在12至40毫米之间。30. The method of claim 25, wherein a focal length of the macro camera is between 12 and 40 mm. 31.如权利要求25所述的方法,其特征在于:将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将所述第一摄像头对焦到≤30厘米的一第一距离,以及将所述微距摄像头对焦到与所述第一距离不同的≤30厘米的距离。31. The method of claim 25, wherein focusing the first camera and the macro camera to a distance of ≤30 centimeters comprises focusing the first camera to a distance of ≤30 centimeters distance, and focusing the macro camera to a distance of ≤30 cm different from the first distance. 32.如权利要求25所述的方法,其特征在于:将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将两个摄像头对焦到20厘米或更小的距离。32. The method of claim 25, wherein focusing the first camera and the macro camera to a distance of < 30 centimeters comprises focusing both cameras to a distance of 20 centimeters or less. 33.如权利要求25所述的方法,其特征在于:将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将两个摄像头对焦到10厘米或更小的距离。33. The method of claim 25, wherein focusing the first camera and the macro camera to a distance of < 30 centimeters comprises focusing both cameras to a distance of 10 centimeters or less. 34.如权利要求25所述的方法,其特征在于:将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将两个摄像头或其中一个摄像头对焦到5厘米或更小的距离。34. The method of claim 25, wherein focusing the first camera and the macro camera to a distance of ≤ 30 centimeters comprises focusing either or both cameras to a distance of 5 centimeters or less the distance. 35.如权利要求25所述的方法,其特征在于:将所述第一摄像头及所述微距摄像头对焦到≤30厘米的距离包括将两个摄像头或其中一个摄像头对焦到3厘米或更小的距离。35. The method of claim 25, wherein focusing the first camera and the macro camera to a distance of ≤ 30 centimeters comprises focusing either or both cameras to a distance of 3 centimeters or less the distance. 36.如权利要求25所述的方法,其特征在于:所述方法还包含基于所述第一图像数据控制所述微距摄像头的状态的改变。36. The method of claim 25, further comprising controlling a change in state of the macro camera based on the first image data. 37.如权利要求36所述的方法,其特征在于:控制所述微距摄像头的状态的改变包括控制选自于由所述微距摄像头的一扫描状态、一变焦状态及一对焦状态所组成的群组中的一状态的改变。37. The method of claim 36, wherein controlling the change of the state of the macro camera comprises controlling a state selected from the group consisting of a scan state, a zoom state and a focus state of the macro camera A state change in a group of . 38.如权利要求36所述的方法,其特征在于:所述微距摄像头是一扫描式远摄摄像头,并且基于所述第一图像数据控制所述微距摄像头的状态的改变包括自动控制所述扫描式远摄摄像头的一扫描状态的改变。38. The method of claim 36, wherein the macro camera is a scanning telephoto camera, and controlling a change in state of the macro camera based on the first image data comprises automatically controlling all Change of a scanning state of the scanning telephoto camera. 39.如权利要求36所述的方法,其特征在于:所述微距摄像头是具有不同变焦状态的一远摄摄像头,并且控制所述微距摄像头的状态的改变包括自动控制所述远摄摄像头的一变焦状态的改变。39. The method of claim 36, wherein the macro camera is a telephoto camera with different zoom states, and controlling a change in the state of the macro camera comprises automatically controlling the telephoto camera A zoom state change.
CN202180006265.0A 2020-02-22 2021-01-27 Split screen feature for macro photography Pending CN114641805A (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US202062980184P 2020-02-22 2020-02-22
US62/980,184 2020-02-22
US202063032576P 2020-05-30 2020-05-30
US63/032,576 2020-05-30
US202063080047P 2020-09-18 2020-09-18
US63/080,047 2020-09-18
PCT/IB2021/050639 WO2021165764A1 (en) 2020-02-22 2021-01-27 Split screen feature for macro photography

Publications (1)

Publication Number Publication Date
CN114641805A true CN114641805A (en) 2022-06-17

Family

ID=77391863

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180006265.0A Pending CN114641805A (en) 2020-02-22 2021-01-27 Split screen feature for macro photography

Country Status (5)

Country Link
US (2) US12007668B2 (en)
EP (1) EP4052176A4 (en)
KR (1) KR20220053023A (en)
CN (1) CN114641805A (en)
WO (1) WO2021165764A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12007668B2 (en) * 2020-02-22 2024-06-11 Corephotonics Ltd. Split screen feature for macro photography
CN115714899A (en) * 2021-08-20 2023-02-24 北京小米移动软件有限公司 Microspur shooting method and device, electronic equipment and storage medium
KR102785049B1 (en) * 2022-08-05 2025-03-21 코어포토닉스 리미티드 System and method for a zoom digital camera having an automatically adjustable zoom field of view
WO2024076092A1 (en) * 2022-10-04 2024-04-11 삼성전자 주식회사 Method for controlling camera and electronic device supporting same

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160381289A1 (en) * 2015-06-23 2016-12-29 Samsung Electronics Co., Ltd. Digital photographing apparatus and method of operating the same
CN106405798A (en) * 2016-11-29 2017-02-15 广东欧珀移动通信有限公司 Imaging device and electronic device
CN108028880A (en) * 2015-10-19 2018-05-11 核心光电有限公司 Based on Dual-Aperture zoom digital camera user interface
US20180368656A1 (en) * 2017-05-24 2018-12-27 Camplex, Inc. Surgical visualization systems and displays

Family Cites Families (323)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4199785A (en) 1979-01-05 1980-04-22 Honeywell Inc. Electronic zoom system
JPS59191146A (en) 1983-04-13 1984-10-30 Hitachi Ltd Optical scanner
US5099263A (en) 1984-11-10 1992-03-24 Minolta Camera Kabushiki Kaisha Variable focal length camera
DE58902538D1 (en) 1988-05-19 1992-12-03 Siemens Ag METHOD FOR OBSERVING A SCENE AND DEVICE FOR IMPLEMENTING THE METHOD.
DE3927334C1 (en) 1989-08-18 1991-01-10 Messerschmitt-Boelkow-Blohm Gmbh, 8012 Ottobrunn, De
JP2703105B2 (en) 1989-10-20 1998-01-26 富士写真フイルム株式会社 Image stabilization device
US5032917A (en) 1990-03-12 1991-07-16 Rca Licensing Corporation Video signal blending apparatus
JPH0443773A (en) 1990-06-11 1992-02-13 Matsushita Electric Ind Co Ltd Arithmetic circuit
US5041852A (en) 1990-10-18 1991-08-20 Fjui Photo Film Co., Ltd. Camera shake correction system
JP3261152B2 (en) 1991-03-13 2002-02-25 シャープ株式会社 Imaging device having a plurality of optical systems
US5394520A (en) 1991-09-26 1995-02-28 Hughes Aircraft Company Imaging apparatus for providing a composite digital representation of a scene within a field of regard
US5657402A (en) 1991-11-01 1997-08-12 Massachusetts Institute Of Technology Method of creating a high resolution still image using a plurality of images and apparatus for practice of the method
US5248971A (en) 1992-05-19 1993-09-28 Mandl William J Method and apparatus for multiplexed oversampled analog to digital modulation
JPH06177706A (en) 1992-12-08 1994-06-24 Sony Corp Signal processing unit
DE69324224T2 (en) 1992-12-29 1999-10-28 Koninklijke Philips Electronics N.V., Eindhoven Image processing method and apparatus for generating an image from a plurality of adjacent images
US5682198A (en) 1993-06-28 1997-10-28 Canon Kabushiki Kaisha Double eye image pickup apparatus
US6128416A (en) 1993-09-10 2000-10-03 Olympus Optical Co., Ltd. Image composing technique for optimally composing a single image from a plurality of digital images
JP3355787B2 (en) 1994-05-20 2002-12-09 ソニー株式会社 Optical axis correction mechanism
US6714665B1 (en) 1994-09-02 2004-03-30 Sarnoff Corporation Fully automated iris recognition system utilizing wide and narrow fields of view
CA2155719C (en) 1994-11-22 2005-11-01 Terry Laurence Glatt Video surveillance system with pilot and slave cameras
JPH08271976A (en) 1995-03-29 1996-10-18 Canon Inc Camera
US5768443A (en) 1995-12-19 1998-06-16 Cognex Corporation Method for coordinating multiple fields of view in multi-camera
US5982951A (en) 1996-05-28 1999-11-09 Canon Kabushiki Kaisha Apparatus and method for combining a plurality of images
US5926190A (en) 1996-08-21 1999-07-20 Apple Computer, Inc. Method and system for simulating motion in a computer graphics application using image registration and view interpolation
JPH10126796A (en) 1996-09-12 1998-05-15 Eastman Kodak Co Digital camera for dynamic and still images using dual mode software processing
US5960218A (en) 1997-02-18 1999-09-28 Mobi Corporation Dual focal length camera
US5940641A (en) 1997-07-10 1999-08-17 Eastman Kodak Company Extending panoramic images
US6148120A (en) 1997-10-30 2000-11-14 Cognex Corporation Warping of focal images to correct correspondence error
US6268611B1 (en) 1997-12-18 2001-07-31 Cellavision Ab Feature-free registration of dissimilar images using a robust similarity metric
JP3695119B2 (en) 1998-03-05 2005-09-14 株式会社日立製作所 Image synthesizing apparatus and recording medium storing program for realizing image synthesizing method
US6208765B1 (en) 1998-06-19 2001-03-27 Sarnoff Corporation Method and apparatus for improving image resolution
GB9823689D0 (en) 1998-10-30 1998-12-23 Greenagate Limited Improved methods and apparatus for 3-D imaging
US6611289B1 (en) 1999-01-15 2003-08-26 Yanbin Yu Digital cameras using multiple sensors with multiple lenses
US6738073B2 (en) 1999-05-12 2004-05-18 Imove, Inc. Camera system with both a wide angle view and a high resolution view
US20020075258A1 (en) 1999-05-12 2002-06-20 Imove Inc. Camera system with high resolution image inside a wide angle view
US20020063711A1 (en) 1999-05-12 2002-05-30 Imove Inc. Camera system with high resolution image inside a wide angle view
US6346950B1 (en) 1999-05-20 2002-02-12 Compaq Computer Corporation System and method for display images using anamorphic video
US7038716B2 (en) 1999-07-30 2006-05-02 Pixim, Inc. Mobile device equipped with digital image sensor
US7015954B1 (en) 1999-08-09 2006-03-21 Fuji Xerox Co., Ltd. Automatic video system using multiple cameras
US6650368B1 (en) 1999-10-26 2003-11-18 Hewlett-Packard Development Company, Lp. Digital camera and method of enhancing zoom effects
US6643416B1 (en) 1999-11-30 2003-11-04 Eastman Kodak Company Method for determining necessary resolution for zoom and crop images
US20020005902A1 (en) 2000-06-02 2002-01-17 Yuen Henry C. Automatic video recording system using wide-and narrow-field cameras
JP2002010276A (en) 2000-06-22 2002-01-11 Olympus Optical Co Ltd Imaging apparatus
JP4501239B2 (en) 2000-07-13 2010-07-14 ソニー株式会社 Camera calibration apparatus and method, and storage medium
US7002583B2 (en) 2000-08-03 2006-02-21 Stono Technologies, Llc Display of images and image transitions
US6778207B1 (en) 2000-08-07 2004-08-17 Koninklijke Philips Electronics N.V. Fast digital pan tilt zoom video
US7345277B2 (en) 2000-08-09 2008-03-18 Evan Zhang Image intensifier and LWIR fusion/combination system
JP2002214662A (en) 2001-01-23 2002-07-31 Olympus Optical Co Ltd Shake correcting device for optical device
US6741250B1 (en) 2001-02-09 2004-05-25 Be Here Corporation Method and system for generation of multiple viewpoints into a scene viewed by motionless cameras and for presentation of a view path
US7346217B1 (en) 2001-04-25 2008-03-18 Lockheed Martin Corporation Digital image enhancement using successive zoom images
JP2002341220A (en) 2001-05-14 2002-11-27 Olympus Optical Co Ltd Optical instrument
GB0116877D0 (en) 2001-07-10 2001-09-05 Hewlett Packard Co Intelligent feature selection and pan zoom control
US6680748B1 (en) 2001-09-27 2004-01-20 Pixim, Inc., Multi-mode camera and method therefor
US20030093805A1 (en) 2001-11-15 2003-05-15 Gin J.M. Jack Dual camera surveillance and control system
US7339621B2 (en) 2001-12-13 2008-03-04 Psion Teklogix Systems, Inc. Imager output signal processing
JP4198449B2 (en) 2002-02-22 2008-12-17 富士フイルム株式会社 Digital camera
JP2003298920A (en) 2002-03-29 2003-10-17 Fuji Photo Film Co Ltd Digital camera
JP4657564B2 (en) 2002-04-30 2011-03-23 イーストマン コダック カンパニー Electronic still camera and image processing method
GB2388265B (en) 2002-04-30 2005-10-12 Hewlett Packard Co Improvements in and relating to processing of images
CA2386560A1 (en) 2002-05-15 2003-11-15 Idelix Software Inc. Controlling optical hardware and dynamic data viewing systems with detail-in-context viewing tools
JP3870124B2 (en) 2002-06-14 2007-01-17 キヤノン株式会社 Image processing apparatus and method, computer program, and computer-readable storage medium
US6839067B2 (en) 2002-07-26 2005-01-04 Fuji Xerox Co., Ltd. Capturing and producing shared multi-resolution video
US20040061788A1 (en) 2002-09-26 2004-04-01 Logitech Europe S.A. Multiple mode capture button for a digital camera
JP4481560B2 (en) 2002-10-08 2010-06-16 オリンパス株式会社 Lens barrel
US7321470B2 (en) 2002-10-08 2008-01-22 Olympus Corporation Camera
GB2394852B (en) 2002-10-31 2006-12-20 Hewlett Packard Co Image capture systems using motion detection
JP2004219569A (en) 2003-01-10 2004-08-05 Olympus Corp Electronic image pickup unit
JP3861815B2 (en) 2003-01-17 2006-12-27 コニカミノルタフォトイメージング株式会社 Camera with image stabilization function
JP4055599B2 (en) 2003-02-13 2008-03-05 コニカミノルタオプト株式会社 Imaging lens device and electronic apparatus equipped with the same
AU2003236050A1 (en) 2003-03-20 2004-10-11 Seijiro Tomita Panoramic picture creating method and device, and monitor system using the method and device
KR20040103786A (en) 2003-06-02 2004-12-09 펜탁스 가부시키가이샤 A multiple-focal-length imaging device, and a mobile device having the multiple-focal-length imaging device
US7596284B2 (en) 2003-07-16 2009-09-29 Hewlett-Packard Development Company, L.P. High resolution image reconstruction
US7619683B2 (en) 2003-08-29 2009-11-17 Aptina Imaging Corporation Apparatus including a dual camera module and method of using the same
JP2005099265A (en) 2003-09-24 2005-04-14 Fujinon Corp Imaging apparatus, imaging method, and range finding method
EP1536633A1 (en) 2003-11-27 2005-06-01 Sony Corporation Photographing apparatus and method, supervising system, program and recording medium
JP2005208194A (en) 2004-01-21 2005-08-04 Konica Minolta Photo Imaging Inc Photographing apparatus
KR20050090780A (en) 2004-03-10 2005-09-14 삼성전자주식회사 Image photographing apparatus
JP2008507229A (en) 2004-07-19 2008-03-06 グランドアイ,エルティーディー Automatic expansion of zoom function of wide-angle video camera
EP1780567B1 (en) 2004-07-20 2011-09-14 Five Dimension Co., Ltd. Electronic imaging device
US7564019B2 (en) 2005-08-25 2009-07-21 Richard Ian Olsen Large dynamic range cameras
US7916180B2 (en) 2004-08-25 2011-03-29 Protarius Filo Ag, L.L.C. Simultaneous multiple field of view digital cameras
US20060054782A1 (en) 2004-08-25 2006-03-16 Olsen Richard I Apparatus for multiple camera devices and method of operating same
US7465107B2 (en) 2004-09-21 2008-12-16 Canon Kabushiki Kaisha Photographing apparatus and control method therefor
KR101054344B1 (en) 2004-11-17 2011-08-04 삼성전자주식회사 Thin film transistor array panel and manufacturing method thereof
US7688364B2 (en) 2004-12-10 2010-03-30 Ambarella, Inc. Decimating and cropping based zoom factor for a digital camera
KR100636969B1 (en) 2004-12-30 2006-10-19 매그나칩 반도체 유한회사 ISP built-in image sensor and dual camera system
US7573514B2 (en) 2005-02-03 2009-08-11 Eastman Kodak Company Digital imaging system with digital zoom warning
US7663662B2 (en) 2005-02-09 2010-02-16 Flir Systems, Inc. High and low resolution camera systems and methods
US20060187322A1 (en) 2005-02-18 2006-08-24 Janson Wilbert F Jr Digital camera using multiple fixed focal length lenses and multiple image sensors to provide an extended zoom range
US7561191B2 (en) 2005-02-18 2009-07-14 Eastman Kodak Company Camera phone using multiple lenses and image sensors to provide an extended zoom range
US7206136B2 (en) 2005-02-18 2007-04-17 Eastman Kodak Company Digital camera using multiple lenses and image sensors to provide an extended zoom range
US7236306B2 (en) 2005-02-18 2007-06-26 Eastman Kodak Company Digital camera using an express zooming mode to provide expedited operation over an extended zoom range
US7256944B2 (en) 2005-02-18 2007-08-14 Eastman Kodak Company Compact image capture assembly using multiple lenses and image sensors to provide an extended zoom range
JP2006238325A (en) 2005-02-28 2006-09-07 Canon Inc Camera system
KR100658150B1 (en) 2005-04-08 2006-12-15 삼성전기주식회사 Camera module and its manufacturing method
JP3934151B2 (en) 2005-06-22 2007-06-20 松下電器産業株式会社 Image generating apparatus and image generating method
KR20070005946A (en) 2005-07-05 2007-01-11 엘지전자 주식회사 Device for detecting position of camera lens for mobile terminal
JP2007033879A (en) 2005-07-27 2007-02-08 Sony Corp Imaging lens device and imaging apparatus
US7424218B2 (en) 2005-07-28 2008-09-09 Microsoft Corporation Real-time preview for panoramic images
JP4573724B2 (en) 2005-08-01 2010-11-04 イーストマン コダック カンパニー Imaging apparatus having a plurality of optical systems
JP4573725B2 (en) 2005-08-01 2010-11-04 イーストマン コダック カンパニー Imaging apparatus having a plurality of optical systems
US7964835B2 (en) 2005-08-25 2011-06-21 Protarius Filo Ag, L.L.C. Digital cameras with direct luminance and chrominance detection
EP1950608B1 (en) 2005-11-14 2010-09-22 Nikon Corporation Image shake correction device and camera
JP4788953B2 (en) 2005-11-16 2011-10-05 ソニー株式会社 Imaging device and zoom lens
US8238695B1 (en) 2005-12-15 2012-08-07 Grandeye, Ltd. Data reduction techniques for processing wide-angle video
US20070177025A1 (en) 2006-02-01 2007-08-02 Micron Technology, Inc. Method and apparatus minimizing die area and module size for a dual-camera mobile device
US20090122406A1 (en) 2006-02-06 2009-05-14 Jarkko Rouvinen Optical Image Stabilizer Using Gimballed Prism
JP4579842B2 (en) 2006-02-06 2010-11-10 イーストマン コダック カンパニー Imaging device
CN101401022B (en) 2006-02-06 2010-07-21 诺基亚公司 Method and apparatus for position detection in imaging system
US9182228B2 (en) 2006-02-13 2015-11-10 Sony Corporation Multi-lens array system and method
JP4622882B2 (en) 2006-02-21 2011-02-02 カシオ計算機株式会社 Digital camera
US7708478B2 (en) 2006-04-13 2010-05-04 Nokia Corporation Actuator mechanism and a shutter mechanism
US7773121B1 (en) 2006-05-03 2010-08-10 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration High-resolution, continuous field-of-view (FOV), non-rotating imaging system
JP2007306282A (en) 2006-05-11 2007-11-22 Citizen Electronics Co Ltd The camera module
KR100749337B1 (en) 2006-06-13 2007-08-14 삼성전자주식회사 Method and apparatus for photographing using a mobile communication terminal having a plurality of camera lenses
US7737379B2 (en) 2006-07-19 2010-06-15 Witdouck Calvin J System and method for sorting larvae cocoons
US8189100B2 (en) 2006-07-25 2012-05-29 Qualcomm Incorporated Mobile device with dual digital camera sensors and methods of using the same
US7756330B2 (en) 2006-07-27 2010-07-13 Eastman Kodak Company Producing an extended dynamic range digital image
US20080030592A1 (en) 2006-08-01 2008-02-07 Eastman Kodak Company Producing digital image with different resolution portions
US7667762B2 (en) 2006-08-01 2010-02-23 Lifesize Communications, Inc. Dual sensor video camera
JP2008076485A (en) 2006-09-19 2008-04-03 Konica Minolta Opto Inc Lens barrel and imaging apparatus
JP2008096584A (en) 2006-10-10 2008-04-24 Nikon Corp Camera
US7697053B2 (en) 2006-11-02 2010-04-13 Eastman Kodak Company Integrated display having multiple capture devices
JP4448844B2 (en) 2006-11-22 2010-04-14 富士フイルム株式会社 Compound eye imaging device
KR100871566B1 (en) 2006-12-04 2008-12-02 삼성전자주식회사 Apparatus and method for image stabilization of an image pickup device
US7533819B2 (en) 2007-01-31 2009-05-19 Symbol Technologies, Inc. Dual camera assembly for an imaging-based bar code reader
US7978239B2 (en) 2007-03-01 2011-07-12 Eastman Kodak Company Digital camera using multiple image sensors to provide improved temporal sampling
US7683962B2 (en) 2007-03-09 2010-03-23 Eastman Kodak Company Camera using multiple lenses and image sensors in a rangefinder configuration to provide a range map
US7729602B2 (en) 2007-03-09 2010-06-01 Eastman Kodak Company Camera using multiple lenses and image sensors operable in a default imaging mode
US7859588B2 (en) 2007-03-09 2010-12-28 Eastman Kodak Company Method and apparatus for operating a dual lens camera to augment an image
US7676146B2 (en) 2007-03-09 2010-03-09 Eastman Kodak Company Camera using multiple lenses and image sensors to provide improved focusing capability
WO2008129552A1 (en) 2007-04-19 2008-10-30 Dvp Technologies Ltd. Imaging system and method for use in monitoring a field of regard
US7918398B2 (en) 2007-06-04 2011-04-05 Hand Held Products, Inc. Indicia reading terminal having multiple setting imaging lens
US8390729B2 (en) 2007-09-05 2013-03-05 International Business Machines Corporation Method and apparatus for providing a video image having multiple focal lengths
US20090086074A1 (en) 2007-09-27 2009-04-02 Omnivision Technologies, Inc. Dual mode camera solution apparatus, system, and method
JP2009109904A (en) 2007-10-31 2009-05-21 Sony Corp Lens barrel and imaging apparatus
US20090122195A1 (en) 2007-11-09 2009-05-14 Van Baar Jeroen System and Method for Combining Image Sequences
US20090128644A1 (en) 2007-11-15 2009-05-21 Camp Jr William O System and method for generating a photograph
US8310587B2 (en) 2007-12-04 2012-11-13 DigitalOptics Corporation International Compact camera optics
KR20090058229A (en) 2007-12-04 2009-06-09 삼성전기주식회사 Dual camera module
JP4529094B2 (en) * 2007-12-28 2010-08-25 ソニー株式会社 Imaging apparatus, function control method, and function control program
JP4582152B2 (en) 2008-01-25 2010-11-17 ソニー株式会社 IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, AND COMPUTER PROGRAM
US8824833B2 (en) 2008-02-01 2014-09-02 Omnivision Technologies, Inc. Image data fusion systems and methods
US8115825B2 (en) 2008-02-20 2012-02-14 Apple Inc. Electronic device with two image sensors
CN101276415A (en) 2008-03-03 2008-10-01 北京航空航天大学 Device and method for realizing multi-resolution image acquisition with multiple fixed-focus cameras
US20100097444A1 (en) 2008-10-16 2010-04-22 Peter Lablans Camera System for Creating an Image From a Plurality of Images
US8866920B2 (en) 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
FI20085510L (en) 2008-05-28 2009-11-29 Valtion Teknillinen A zoom-camera arrangement comprising several sub-cameras
JP4513906B2 (en) 2008-06-27 2010-07-28 ソニー株式会社 Image processing apparatus, image processing method, program, and recording medium
KR101477178B1 (en) 2008-07-17 2014-12-29 삼성전자주식회사 A portable terminal having a dual camera and a photographing method using the same
US8134589B2 (en) 2008-07-17 2012-03-13 Eastman Kodak Company Zoom by multiple image capture
GB2462095A (en) 2008-07-23 2010-01-27 Snell & Wilcox Ltd Processing of images to represent a transition in viewpoint
US8237807B2 (en) 2008-07-24 2012-08-07 Apple Inc. Image capturing device with touch screen for adjusting camera settings
CN102150078B (en) 2008-09-10 2013-09-04 松下电器产业株式会社 Camera body and imaging device
CN101394487B (en) 2008-10-27 2011-09-14 华为技术有限公司 Image synthesizing method and system
JP5230376B2 (en) 2008-11-28 2013-07-10 三星電子株式会社 Imaging apparatus and imaging method
JP5265336B2 (en) 2008-12-25 2013-08-14 富士フイルム株式会社 Camera shake correction apparatus and optical apparatus
JP2010204341A (en) 2009-03-03 2010-09-16 Nikon Corp Camera
CN101833157A (en) 2009-03-13 2010-09-15 鸿富锦精密工业(深圳)有限公司 Camera module
JP2012521673A (en) 2009-03-19 2012-09-13 フレクストロニクス エイピー エルエルシー Dual sensor camera
WO2010116369A1 (en) 2009-04-07 2010-10-14 Nextvision Stabilized Systems Ltd Methods of manufacturing a camera system having multiple image sensors
KR101552481B1 (en) 2009-04-13 2015-09-21 삼성전자 주식회사 Zoom Lens Module
WO2010122841A1 (en) 2009-04-22 2010-10-28 コニカミノルタオプト株式会社 Mirror-lens barrel, image pickup device and method for manufacturing a mirror-lens barrel
US8553106B2 (en) 2009-05-04 2013-10-08 Digitaloptics Corporation Dual lens digital zoom
CN107181897B (en) 2009-06-16 2021-08-13 英特尔公司 Handheld device and method, apparatus, and readable medium for capturing an image by a handheld device
WO2010148363A2 (en) 2009-06-18 2010-12-23 Theia Technologies, Llc Compact dome camera
WO2011005413A2 (en) 2009-06-22 2011-01-13 Omnivision Technologies, Inc. System and method for an image sensor operable in multiple video standards
WO2011009108A2 (en) 2009-07-17 2011-01-20 Universal Robotics, Inc. System and method for automatic calibration of stereo images
JP5846346B2 (en) 2009-08-21 2016-01-20 ミツミ電機株式会社 Camera shake correction device
CN201514511U (en) 2009-09-08 2010-06-23 华晶科技股份有限公司 periscope lens structure
KR101613928B1 (en) 2009-09-09 2016-04-20 엘지전자 주식회사 Portable terminal
ES2739036T3 (en) 2009-09-14 2020-01-28 Viion Systems Inc Saccadic Dual Resolution Video Analysis Camera
KR101617289B1 (en) 2009-09-30 2016-05-02 엘지전자 주식회사 Mobile terminal and operation control method thereof
JP5513834B2 (en) 2009-10-13 2014-06-04 台湾東電化股▲ふん▼有限公司 Lens drive device
EP2502410B1 (en) 2009-11-19 2019-05-01 eSight Corporation A method for augmenting sight
WO2011063347A2 (en) 2009-11-20 2011-05-26 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
KR101604846B1 (en) * 2009-11-27 2016-03-21 엘지전자 주식회사 Mobile terminal and operation control method thereof
US8400555B1 (en) 2009-12-01 2013-03-19 Adobe Systems Incorporated Focused plenoptic camera employing microlenses with different focal lengths
US20110128288A1 (en) 2009-12-02 2011-06-02 David Petrou Region of Interest Selector for Visual Queries
CN102906763A (en) 2010-01-28 2013-01-30 美国路通创新科技公司 Document Imaging System with Capture Scanner and PC-based Processing Software
JP5445235B2 (en) 2010-03-09 2014-03-19 ソニー株式会社 Image processing apparatus, image processing method, and program
JP2011205374A (en) 2010-03-25 2011-10-13 Fujifilm Corp Display apparatus
TWI478828B (en) 2010-03-26 2015-04-01 Hon Hai Prec Ind Co Ltd Vehicle imaging system and vehicle with same
JP4783465B1 (en) 2010-03-26 2011-09-28 富士フイルム株式会社 Imaging device and display device
US8456518B2 (en) 2010-03-31 2013-06-04 James Cameron & Vincent Pace Stereoscopic camera with automatic obstruction removal
US8547389B2 (en) 2010-04-05 2013-10-01 Microsoft Corporation Capturing image structure detail from a first image and color from a second image
US20110242355A1 (en) 2010-04-05 2011-10-06 Qualcomm Incorporated Combining data from multiple image sensors
CN102215373B (en) 2010-04-07 2014-12-24 苹果公司 In conference display adjustments
US8446484B2 (en) 2010-04-21 2013-05-21 Nokia Corporation Image processing architecture with pre-scaler
US9369621B2 (en) 2010-05-03 2016-06-14 Invisage Technologies, Inc. Devices and methods for high-resolution image and video capture
US20130250150A1 (en) 2010-05-03 2013-09-26 Michael R. Malone Devices and methods for high-resolution image and video capture
DE102010017057B4 (en) 2010-05-21 2015-03-19 Jena-Optronik Gmbh Camera with several fixed focal lengths
EP2593835B1 (en) 2010-07-13 2016-07-13 Ram Srikanth Mirlay Variable three-dimensional camera assembly for still photography
JP2012027263A (en) 2010-07-23 2012-02-09 Sony Corp Imaging apparatus, control method and program thereof
US8493482B2 (en) 2010-08-18 2013-07-23 Apple Inc. Dual image sensor image processing system and method
US8896655B2 (en) 2010-08-31 2014-11-25 Cisco Technology, Inc. System and method for providing depth adaptive video conferencing
JP5609467B2 (en) 2010-09-15 2014-10-22 株式会社リコー Imaging apparatus and imaging method
US8780251B2 (en) 2010-09-20 2014-07-15 Canon Kabushiki Kaisha Image capture with focus adjustment
US20120075489A1 (en) 2010-09-24 2012-03-29 Nishihara H Keith Zoom camera image blending technique
US20140192238A1 (en) 2010-10-24 2014-07-10 Linx Computational Imaging Ltd. System and Method for Imaging and Image Processing
US9204026B2 (en) 2010-11-01 2015-12-01 Lg Electronics Inc. Mobile terminal and method of controlling an image photographing therein
JP5719148B2 (en) 2010-11-10 2015-05-13 キヤノン株式会社 Imaging apparatus, control method therefor, and program
KR101731346B1 (en) 2010-11-12 2017-04-28 엘지전자 주식회사 Method for providing display image in multimedia device and thereof
WO2012075250A1 (en) 2010-12-01 2012-06-07 Magna Electronics Inc. System and method of establishing a multi-camera image using pixel remapping
US8274552B2 (en) 2010-12-27 2012-09-25 3Dmedia Corporation Primary and auxiliary image capture devices for image processing and related methods
US10200671B2 (en) 2010-12-27 2019-02-05 3Dmedia Corporation Primary and auxiliary image capture devices for image processing and related methods
JP2012141442A (en) 2010-12-28 2012-07-26 Sony Corp Lens protection device, lens unit, and image pickup apparatus
US8803990B2 (en) 2011-01-25 2014-08-12 Aptina Imaging Corporation Imaging system with multiple sensors for producing high-dynamic-range images
US8520080B2 (en) 2011-01-31 2013-08-27 Hand Held Products, Inc. Apparatus, system, and method of use of imaging assembly on mobile terminal
JP5814566B2 (en) 2011-02-28 2015-11-17 オリンパス株式会社 IMAGING DEVICE, IMAGING METHOD, AND IMAGING DEVICE CONTROL PROGRAM
US20120229663A1 (en) 2011-03-08 2012-09-13 Spectral Instruments Imaging , Llc Imaging system having primary and auxiliary camera systems
JP5708097B2 (en) 2011-03-18 2015-04-30 株式会社リコー Imaging apparatus, imaging method, and imaging program
US9172856B2 (en) 2011-03-29 2015-10-27 Microsoft Technology Licensing, Llc Folded imaging path camera
CN102739949A (en) 2011-04-01 2012-10-17 张可伦 Control method for multi-lens camera and multi-lens device
US8553129B2 (en) 2011-05-10 2013-10-08 Htc Corporation Handheld electronic device with two lens modules, dual image capturing method applying for the handheld electronic device, and computer program product for load into the handheld electronic device
EP2523450B1 (en) 2011-05-10 2014-05-14 HTC Corporation Handheld electronic device with dual image capturing method and computer program product
KR101251761B1 (en) 2011-05-13 2013-04-05 주식회사 케이티 Method for Data Transferring Between Applications and Terminal Apparatus Using the Method
KR101224790B1 (en) 2011-06-14 2013-01-21 삼성전기주식회사 Image Photographing Device
US8605199B2 (en) 2011-06-28 2013-12-10 Canon Kabushiki Kaisha Adjustment of imaging properties for an imaging assembly having light-field optics
JP5821356B2 (en) 2011-07-15 2015-11-24 ミツミ電機株式会社 Lens drive device
US9270875B2 (en) 2011-07-20 2016-02-23 Broadcom Corporation Dual image capture processing
JP6103840B2 (en) 2011-07-28 2017-03-29 キヤノン株式会社 Correction optical apparatus and imaging apparatus
US8988564B2 (en) 2011-09-09 2015-03-24 Apple Inc. Digital camera with light splitter
EP2582128A3 (en) 2011-10-12 2013-06-19 Canon Kabushiki Kaisha Image-capturing device
US8947627B2 (en) 2011-10-14 2015-02-03 Apple Inc. Electronic devices having displays with openings
JP5884421B2 (en) 2011-11-14 2016-03-15 ソニー株式会社 Image processing apparatus, image processing apparatus control method, and program
JP5741395B2 (en) 2011-11-16 2015-07-01 コニカミノルタ株式会社 Imaging device
US8970655B2 (en) 2011-12-16 2015-03-03 Polycom, Inc. Reflective and refractive solutions to providing direct eye contact videoconferencing
US8619148B1 (en) 2012-01-04 2013-12-31 Audience, Inc. Image correction after combining images from multiple cameras
JP2013143753A (en) 2012-01-12 2013-07-22 Olympus Corp Imaging apparatus
KR20130090225A (en) 2012-02-03 2013-08-13 삼성전자주식회사 Method of changing an operation mode of a camera image sensor
GB2499200B (en) 2012-02-07 2014-12-17 Canon Kk Method and device for transitioning between an image of a first video sequence and an image for a second video sequence
US8866943B2 (en) 2012-03-09 2014-10-21 Apple Inc. Video camera providing a composite video sequence
US20130258044A1 (en) 2012-03-30 2013-10-03 Zetta Research And Development Llc - Forc Series Multi-lens camera
US9029759B2 (en) 2012-04-12 2015-05-12 Nan Chang O-Film Optoelectronics Technology Ltd Compact camera modules with features for reducing Z-height and facilitating lens alignment and methods for manufacturing the same
JP2013238848A (en) 2012-04-20 2013-11-28 Hoya Corp Imaging apparatus
CN102722321A (en) 2012-05-22 2012-10-10 中兴通讯股份有限公司 Method and device for switching between double cameras
US8953084B2 (en) 2012-05-30 2015-02-10 Digimarc Corporation Plural focal-plane imaging
US9583133B2 (en) 2012-06-11 2017-02-28 Sony Corporation Image generation device and image generation method for multiplexing captured images to generate an image stream
KR101991719B1 (en) 2012-06-29 2019-06-21 엘지이노텍 주식회사 Camera Module
US9134503B2 (en) 2012-07-06 2015-09-15 Apple Inc. VCM OIS actuator module
US9225903B2 (en) 2012-07-12 2015-12-29 Sony Corporation Image blur correction apparatus, method of correcting image blur, and imaging apparatus
KR20150043312A (en) 2012-07-12 2015-04-22 주식회사 듀얼어퍼처인터네셔널 Gesture-based user interface
KR102051501B1 (en) 2012-07-26 2019-12-03 엘지이노텍 주식회사 Camera module
US9398264B2 (en) 2012-10-19 2016-07-19 Qualcomm Incorporated Multi-camera system using folded optics
CN104937920A (en) 2012-10-31 2015-09-23 因维萨热技术公司 Extended field of view image and video capture
WO2014072818A2 (en) 2012-11-08 2014-05-15 Dynaoptics Pte Ltd. Miniature optical zoom lens
JP6152386B2 (en) 2012-11-16 2017-06-21 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America Camera drive device
KR101960493B1 (en) 2012-12-12 2019-07-15 삼성전자주식회사 Optical adjusting apparatus
CN103024272A (en) 2012-12-14 2013-04-03 广东欧珀移动通信有限公司 Dual-camera control device, method, system and mobile terminal for mobile terminal
US9547160B2 (en) 2013-01-05 2017-01-17 Light Labs Inc. Methods and apparatus for capturing and/or processing images
US20140313316A1 (en) 2013-01-30 2014-10-23 SeeScan, Inc. Adjustable variable resolution inspection systems and methods using multiple image sensors
US20140218587A1 (en) 2013-02-07 2014-08-07 Motorola Mobility Llc Double sided camera module
US9413930B2 (en) 2013-03-14 2016-08-09 Joergen Geerds Camera system
US10268276B2 (en) 2013-03-15 2019-04-23 Eyecam, LLC Autonomous computing and telecommunications head-up displays glasses
JP6214206B2 (en) 2013-05-13 2017-10-18 キヤノン株式会社 Imaging apparatus, control method, and program
JP6100089B2 (en) 2013-05-17 2017-03-22 キヤノン株式会社 Image processing apparatus, image processing method, and program
DE102013209829B4 (en) 2013-05-27 2016-04-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Optical structure with webs disposed thereon and method of making the same
KR102166262B1 (en) 2013-06-10 2020-10-15 삼성전자주식회사 Camera lens assembly
CN109040552B (en) 2013-06-13 2021-06-22 核心光电有限公司 Dual Aperture Zoom Digital Camera
TWI546570B (en) 2013-07-01 2016-08-21 台灣東電化股份有限公司 Optical anti-shake apparatus with switchable light path
US9137447B2 (en) 2013-07-31 2015-09-15 Panasonic Intellectual Property Management Co., Ltd. Imaging apparatus that generates an image including an emphasized in-focus part of a captured image
US9285566B2 (en) 2013-08-08 2016-03-15 Apple Inc. Mirror tilt actuation
US9494769B2 (en) 2013-09-12 2016-11-15 Hong Kong Applied Science And Technology Research Institute Co. Ltd. Multi-lens imaging module and actuator with auto-focus adjustment
CN105579902B (en) 2013-09-23 2019-06-28 Lg伊诺特有限公司 A method of manufacture camera model
US9615012B2 (en) 2013-09-30 2017-04-04 Google Inc. Using a second camera to adjust settings of first camera
TW201515433A (en) 2013-10-14 2015-04-16 Etron Technology Inc Image calibration system and calibration method of a stereo camera
US9736365B2 (en) 2013-10-26 2017-08-15 Light Labs Inc. Zoom related methods and apparatus
US9344626B2 (en) 2013-11-18 2016-05-17 Apple Inc. Modeless video and still frame capture using interleaved frames of video and still resolutions
CN104680501B (en) 2013-12-03 2018-12-07 华为技术有限公司 The method and device of image mosaic
US9215377B2 (en) 2013-12-04 2015-12-15 Nokia Technologies Oy Digital zoom with sensor mode change
CN105339841B (en) 2013-12-06 2018-12-14 华为终端(东莞)有限公司 The photographic method and bimirror head apparatus of bimirror head apparatus
EP3062509B1 (en) 2013-12-06 2020-06-03 Huawei Device Co., Ltd. Terminal and image processing method
US9736391B2 (en) 2013-12-06 2017-08-15 Huawei Device Co., Ltd. Photographing method of dual-lens device, and dual-lens device
US10306165B2 (en) 2013-12-06 2019-05-28 Huawei Device Co., Ltd. Image generating method and dual-lens device
US9538096B2 (en) 2014-01-27 2017-01-03 Raytheon Company Imaging system and methods with variable lateral magnification
KR102128468B1 (en) 2014-02-19 2020-06-30 삼성전자주식회사 Image Processing Device and Method including a plurality of image signal processors
TW201533514A (en) 2014-02-27 2015-09-01 Tdk Taiwan Corp Reflector structure and photographic device
US9316810B2 (en) 2014-03-07 2016-04-19 Apple Inc. Folded telephoto camera lens system
US9557627B2 (en) 2014-03-07 2017-01-31 Apple Inc. Folded camera lens systems
CN103841404A (en) 2014-03-18 2014-06-04 江西省一元数码科技有限公司 Novel three-dimensional image shooting module
US20150271471A1 (en) 2014-03-19 2015-09-24 Htc Corporation Blocking detection method for camera and electronic apparatus with cameras
KR102214193B1 (en) 2014-03-25 2021-02-09 삼성전자 주식회사 Depth camera device, 3d image display system having the same and control methods thereof
US9383550B2 (en) 2014-04-04 2016-07-05 Qualcomm Incorporated Auto-focus in low-profile folded optics multi-camera system
KR101771778B1 (en) 2014-04-11 2017-08-25 삼성전기주식회사 Camera module
CN105024516B (en) 2014-04-30 2017-12-01 光宝电子(广州)有限公司 Voice coil motor array module
CN105556935B (en) 2014-05-15 2019-04-19 华为技术有限公司 Method and terminal for multi-frame noise reduction
US20150334309A1 (en) 2014-05-16 2015-11-19 Htc Corporation Handheld electronic apparatus, image capturing apparatus and image capturing method thereof
US9360671B1 (en) 2014-06-09 2016-06-07 Google Inc. Systems and methods for image zoom
US9392188B2 (en) 2014-08-10 2016-07-12 Corephotonics Ltd. Zoom dual-aperture camera with folded lens
JP2016057468A (en) 2014-09-10 2016-04-21 Hoya株式会社 Bending imaging device
KR102032882B1 (en) 2014-09-30 2019-10-16 후아웨이 테크놀러지 컴퍼니 리미티드 Autofocus method, device and electronic apparatus
JP6465625B2 (en) * 2014-10-10 2019-02-06 キヤノン株式会社 Control device, control method therefor, and program
WO2016081567A1 (en) 2014-11-19 2016-05-26 Orlo James Fiske Thin optical system and camera
KR102287013B1 (en) 2014-11-25 2021-08-06 삼성디스플레이 주식회사 Thin film transistor, organic light emitting diode display including the same and manufacuring method thereof
US10634867B2 (en) 2014-11-28 2020-04-28 Samsung Electro-Mechanics Co., Ltd. Camera module
US9286680B1 (en) 2014-12-23 2016-03-15 Futurewei Technologies, Inc. Computational multi-camera adjustment for smooth view switching and zooming
US11019330B2 (en) 2015-01-19 2021-05-25 Aquifi, Inc. Multiple camera system with auto recalibration
US9800798B2 (en) 2015-02-13 2017-10-24 Qualcomm Incorporated Systems and methods for power optimization for imaging devices with dual cameras
WO2016166730A1 (en) 2015-04-16 2016-10-20 Corephotonics Ltd. Auto focus and optical image stabilization in a compact folded camera
US9485432B1 (en) 2015-04-29 2016-11-01 Uurmi Systems Private Limited Methods, systems and apparatuses for dual-camera based zooming
US20160353012A1 (en) 2015-05-25 2016-12-01 Htc Corporation Zooming control method for camera and electronic apparatus with camera
KR101992040B1 (en) 2015-06-24 2019-06-21 코어포토닉스 리미티드 Low-Profile 3-Axis Actuator for Foldable Lens Cameras
CN106709899B (en) 2015-07-15 2020-06-02 华为终端有限公司 Method, device and equipment for calculating relative positions of two cameras
US10230898B2 (en) 2015-08-13 2019-03-12 Corephotonics Ltd. Dual aperture zoom camera with video support and switching / non-switching dynamic control
US20170070731A1 (en) 2015-09-04 2017-03-09 Apple Inc. Single And Multi-Camera Calibration
KR101993077B1 (en) 2015-09-06 2019-06-25 코어포토닉스 리미티드 Automatic focus and optical image stabilization by roll compensation of compact folding camera
US10382698B2 (en) * 2015-09-30 2019-08-13 Apple Inc. Mobile zoom using multiple optical image stabilization cameras
KR20170075442A (en) 2015-12-23 2017-07-03 삼성전자주식회사 Photographing apparatus module, user terminal comprising the photographing apparatus and method of operating the photographing apparatus module
US9843736B2 (en) 2016-02-26 2017-12-12 Essential Products, Inc. Image capture with a camera integrated display
KR20170112491A (en) 2016-03-31 2017-10-12 엘지전자 주식회사 Mobile terminal and method for controlling the same
CN114143464A (en) * 2016-05-20 2022-03-04 麦克赛尔株式会社 Camera and its setting screen
CN111965919B (en) 2016-05-30 2022-02-08 核心光电有限公司 Rotary ball guided voice coil motor
US10303042B2 (en) 2016-07-12 2019-05-28 Tdk Taiwan Corp. Lens driving module
TWM533229U (en) 2016-08-26 2016-12-01 Largan Precision Co Ltd Optical path folding element, imaging lens module and electronic device
CN106603765B (en) 2016-12-20 2020-03-17 Oppo广东移动通信有限公司 Bracket component and mobile terminal
CN106534655B (en) 2017-01-11 2019-04-16 Oppo广东移动通信有限公司 Camera module and mobile terminal
KR102612454B1 (en) 2017-01-12 2023-12-08 코어포토닉스 리미티드 Compact folded camera
US10334149B2 (en) 2017-02-23 2019-06-25 Qualcomm Incorporated Adjustment for cameras for low power mode operation
KR102426728B1 (en) 2017-04-10 2022-07-29 삼성전자주식회사 Method and electronic device for focus control
JP6967715B2 (en) 2017-04-18 2021-11-17 パナソニックIpマネジメント株式会社 Camera calibration method, camera calibration program and camera calibration device
CN109729266A (en) 2018-12-25 2019-05-07 努比亚技术有限公司 A kind of image capturing method, terminal and computer readable storage medium
US12007668B2 (en) * 2020-02-22 2024-06-11 Corephotonics Ltd. Split screen feature for macro photography

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160381289A1 (en) * 2015-06-23 2016-12-29 Samsung Electronics Co., Ltd. Digital photographing apparatus and method of operating the same
CN108028880A (en) * 2015-10-19 2018-05-11 核心光电有限公司 Based on Dual-Aperture zoom digital camera user interface
CN106405798A (en) * 2016-11-29 2017-02-15 广东欧珀移动通信有限公司 Imaging device and electronic device
US20180368656A1 (en) * 2017-05-24 2018-12-27 Camplex, Inc. Surgical visualization systems and displays

Also Published As

Publication number Publication date
US20240295795A1 (en) 2024-09-05
KR20220053023A (en) 2022-04-28
EP4052176A4 (en) 2023-01-04
US12007668B2 (en) 2024-06-11
EP4052176A1 (en) 2022-09-07
US20220385831A1 (en) 2022-12-01
WO2021165764A1 (en) 2021-08-26

Similar Documents

Publication Publication Date Title
CN114641805A (en) Split screen feature for macro photography
KR102530535B1 (en) Cameras with panoramic scanning range
KR102187146B1 (en) Dual-aperture zoom digital camera with automatic adjustable tele field of view
EP3328055B1 (en) Control method, control device and electronic device
US7561788B2 (en) Image-capturing device having multiple optical systems
US9380201B2 (en) Image capture apparatus and control method therefor
CN102404505B (en) Imaging apparatus and control method for same
US11770618B2 (en) Systems and methods for obtaining a smart panoramic image
US20250063253A1 (en) Systems and methods for obtaining a super macro image
US12075151B2 (en) Systems and methods for obtaining a smart panoramic image
US11982925B2 (en) Folded zoom camera module with adaptive aperture
US11140327B2 (en) Image-capturing device and method for operating image-capturing system of two cameras
CN110891140B (en) Image pickup apparatus, image processing apparatus, control method therefor, and storage medium
WO2015022700A2 (en) A method for capturing an accurately composed high quality self-image using a multi camera device
JP2010147695A (en) Imaging device
JP2024522409A (en) Imaging device and focus control program
JP2006054803A (en) Digital photographing apparatus, recording medium therefor image display method, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination