CN110830728A - Exposure adjusting method and device - Google Patents
Exposure adjusting method and device Download PDFInfo
- Publication number
- CN110830728A CN110830728A CN201810916791.0A CN201810916791A CN110830728A CN 110830728 A CN110830728 A CN 110830728A CN 201810916791 A CN201810916791 A CN 201810916791A CN 110830728 A CN110830728 A CN 110830728A
- Authority
- CN
- China
- Prior art keywords
- image
- depth
- light intensity
- exposure
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
本发明涉及图像采集技术领域,具体涉及一种曝光调整方法及装置,方法包括:检测图像采集设备的摄像头传输的图像是否处于过曝状态,并在检测结果为是时获取摄像头对应的曝光参数,以及获取该图像对应的深度位置信息,将该图像与深度位置信息进行映射后得到深度图像,并将深度图像输入预设深度图像学习模型进行检测以得到检测目标,将该图像与检测目标进行反映射得到检测目标在图像中的对应位置并将该对应位置作为目标位置,根据光强值对摄像头的曝光参数进行调整后对目标位置进行聚焦。通过上述方法,以实现自动调节曝光参数,并有效避免采用人工调节的方式造成时间浪费和调节不准确的情况。
The invention relates to the technical field of image acquisition, and in particular to an exposure adjustment method and device. The method includes: detecting whether an image transmitted by a camera of an image acquisition device is in an overexposed state, and acquiring exposure parameters corresponding to the camera when the detection result is yes, and obtaining the depth position information corresponding to the image, mapping the image and the depth position information to obtain a depth image, inputting the depth image into a preset depth image learning model for detection to obtain a detection target, and reflecting the image and the detection target The corresponding position of the detection target in the image is obtained and the corresponding position is taken as the target position, and the target position is focused after adjusting the exposure parameters of the camera according to the light intensity value. Through the above method, the exposure parameters can be adjusted automatically, and the situation of time waste and inaccurate adjustment caused by manual adjustment can be effectively avoided.
Description
技术领域technical field
本发明涉及图像采集技术领域,具体而言,涉及一种曝光调整方法及装置。The present invention relates to the technical field of image acquisition, and in particular, to an exposure adjustment method and device.
背景技术Background technique
目前,在采用摄像头进行图像获取的过程中通常存在过曝光或欠曝光进而造成影像失常的情况,目前主要通过人工调节的方式重新聚焦,从而修正了强光引起的曝光时间过长造成的影像失常,或者光照不足引起的图像过暗的情况。At present, in the process of using a camera for image acquisition, there is usually over-exposure or under-exposure, which causes image aberrations. At present, refocusing is mainly performed by manual adjustment, thereby correcting the image aberration caused by excessive exposure time caused by strong light. , or the image is too dark due to insufficient lighting.
发明人经研究发现,采用人工调节的方式进行聚焦通常会花费过多的时间,且在调节过程中,由于采用人的主观判断较为局限进而存在调节不准确影响图像的拍摄效果的情况。The inventor found through research that manual adjustment usually takes too much time to focus, and in the adjustment process, due to the limited use of human subjective judgment, inaccurate adjustment may affect the shooting effect of the image.
发明内容SUMMARY OF THE INVENTION
有鉴于此,本发明的目的在于提供一种曝光调整方法及装置,以有效缓解上述技术问题。In view of this, an object of the present invention is to provide an exposure adjustment method and device to effectively alleviate the above-mentioned technical problems.
为实现上述目的,本发明实施例采用如下技术方案:To achieve the above purpose, the embodiment of the present invention adopts the following technical solutions:
一种曝光调整方法,应用于图像采集设备,包括:An exposure adjustment method, applied to an image acquisition device, includes:
检测所述图像采集设备的摄像头传输的图像是否处于过曝状态,并在检测结果为是时获取所述摄像头对应的曝光参数,以及获取该图像对应的深度位置信息;Detecting whether the image transmitted by the camera of the image acquisition device is in an overexposed state, and acquiring exposure parameters corresponding to the camera when the detection result is yes, and acquiring depth position information corresponding to the image;
将该图像与所述深度位置信息进行映射后得到深度图像,并将所述深度图像输入预设深度图像学习模型进行检测以得到检测目标;After the image is mapped with the depth position information, a depth image is obtained, and the depth image is input into a preset depth image learning model for detection to obtain a detection target;
将该图像与所述检测目标进行反映射得到该检测目标在该图像中的对应位置并将该对应位置作为目标位置;Perform inverse mapping on the image and the detection target to obtain the corresponding position of the detection target in the image and use the corresponding position as the target position;
调整所述摄像头的曝光参数,并采用调整后的曝光参数对所述目标位置进行重新聚焦。Adjust the exposure parameters of the camera, and use the adjusted exposure parameters to refocus the target position.
在本发明的较佳实施例中,在上述曝光调整方法中,所述摄像头的视口位置处设置有深度传感器,获取该图像对应的深度位置信息的步骤包括:In a preferred embodiment of the present invention, in the above exposure adjustment method, a depth sensor is provided at the viewport position of the camera, and the step of acquiring depth position information corresponding to the image includes:
获取所述深度传感器对该图像进行图像深度检测得到的深度位置信息。Acquire depth position information obtained by performing image depth detection on the image by the depth sensor.
在本发明的较佳实施例中,在上述曝光调整方法中,所述预设深度图像学习模型为Faster R-CNN深度图像学习模型、R-FCN深度图像学习模型或SSD深度图像学习模型。In a preferred embodiment of the present invention, in the above exposure adjustment method, the preset deep image learning model is a Faster R-CNN deep image learning model, an R-FCN deep image learning model or an SSD deep image learning model.
在本发明的较佳实施例中,在上述曝光调整方法中,所述深度位置信息中包括该深度位置信息对应图像中各像素点的位置坐标和深度值,将该图像与所述深度位置信息进行映射后得到深度图像的步骤包括:In a preferred embodiment of the present invention, in the above exposure adjustment method, the depth position information includes the position coordinates and depth values of each pixel in the image corresponding to the depth position information, and the image and the depth position information The steps of obtaining a depth image after mapping include:
获取该图像中每个像素点的位置坐标;Get the position coordinates of each pixel in the image;
将获取的每个像素点的位置坐标与所述深度位置信息中各像素点的位置坐标和深度值进行映射得到深度图像。A depth image is obtained by mapping the acquired position coordinates of each pixel with the position coordinates and depth values of each pixel in the depth position information.
在本发明的较佳实施例中,在上述曝光调整方法中,检测所述图像采集设备的摄像头传输的图像是否处于过曝状态的步骤包括:In a preferred embodiment of the present invention, in the above exposure adjustment method, the step of detecting whether the image transmitted by the camera of the image acquisition device is in an overexposed state includes:
对所述图像采集设备的摄像头传输的图像进行光强检测得到该图像对应的光强值;Perform light intensity detection on the image transmitted by the camera of the image acquisition device to obtain a light intensity value corresponding to the image;
判断所述光强值是否位于预设光强范围内,当所述光强值不在所述预设光强范围内时,获取在该光强值下所述摄像头对应的曝光参数。It is judged whether the light intensity value is within the preset light intensity range, and when the light intensity value is not within the preset light intensity range, the exposure parameter corresponding to the camera under the light intensity value is obtained.
一种曝光调整装置,应用于图像采集设备,所述装置包括:An exposure adjustment device, applied to image acquisition equipment, includes:
曝光状态检测模块,用于检测所述图像采集设备的摄像头传输的图像是否处于过曝状态,并在检测结果为是时获取所述摄像头对应的曝光参数,以及获取该图像对应的深度位置信息;an exposure state detection module, configured to detect whether the image transmitted by the camera of the image acquisition device is in an overexposed state, and when the detection result is yes, obtain the exposure parameter corresponding to the camera, and obtain the depth position information corresponding to the image;
深度图像获得模块,用于将该图像与所述深度位置信息进行映射后得到深度图像,并将所述深度图像输入预设深度图像学习模型进行检测以得到检测目标;a depth image obtaining module, configured to obtain a depth image after mapping the image with the depth position information, and input the depth image into a preset depth image learning model for detection to obtain a detection target;
目标位置获得模块,用于将该图像与所述检测目标进行反映射得到该检测目标在该图像中的对应位置并将该对应位置作为目标位置;a target position obtaining module, used for inversely mapping the image and the detection target to obtain the corresponding position of the detection target in the image and using the corresponding position as the target position;
曝光参数调整模块,用于调整所述摄像头的曝光参数,并采用调整后的曝光参数对所述目标位置进行重新聚焦。The exposure parameter adjustment module is used to adjust the exposure parameter of the camera, and use the adjusted exposure parameter to refocus the target position.
在本发明的较佳实施例中,在上述曝光调整装置中,所述摄像头的视口位置处设置有深度传感器,所述深度图像获得模块还用于获取所述深度传感器对该图像进行图像深度检测得到的深度位置信息。In a preferred embodiment of the present invention, in the above-mentioned exposure adjustment device, a depth sensor is provided at the viewport position of the camera, and the depth image obtaining module is further configured to obtain the depth sensor for image depth of the image. The detected depth position information.
在本发明的较佳实施例中,在上述曝光调整装置中,所述预设深度图像学习模型为Faster R-CNN深度图像学习模型、R-FCN深度图像学习模型或SSD深度图像学习模型。In a preferred embodiment of the present invention, in the exposure adjustment device, the preset deep image learning model is a Faster R-CNN deep image learning model, an R-FCN deep image learning model or an SSD deep image learning model.
在本发明的较佳实施例中,在上述曝光调整装置中,所述深度位置信息中包括该深度位置信息对应图像中各像素点的位置坐标和深度值,所述深度图像获得模块包括:In a preferred embodiment of the present invention, in the above exposure adjustment device, the depth position information includes the position coordinates and depth values of each pixel in the image corresponding to the depth position information, and the depth image obtaining module includes:
坐标获取子模块,用于获取该图像中每个像素点的位置坐标;The coordinate acquisition sub-module is used to acquire the position coordinates of each pixel in the image;
映射子模块,用于将获取的每个像素点的位置坐标与所述深度位置信息中各像素点的位置坐标和深度值进行映射得到深度图像。The mapping submodule is used for mapping the acquired position coordinates of each pixel with the position coordinates and depth values of each pixel in the depth position information to obtain a depth image.
在本发明的较佳实施例中,在上述曝光调整装置中,所述曝光状态检测模块包括:In a preferred embodiment of the present invention, in the above exposure adjustment device, the exposure state detection module includes:
检测子模块,用于对所述图像采集设备的摄像头传输的图像进行光强检测得到该图像对应的光强值;a detection sub-module, configured to perform light intensity detection on the image transmitted by the camera of the image acquisition device to obtain a light intensity value corresponding to the image;
判断子模块,用判断所述光强值是否位于预设光强范围内,当所述光强值不在所述预设光强范围内时,获取在该光强值下所述摄像头对应的曝光参数。The judgment sub-module is used to judge whether the light intensity value is within the preset light intensity range, and when the light intensity value is not within the preset light intensity range, obtain the exposure corresponding to the camera under the light intensity value parameter.
本发明提供的一种曝光调整方法及装置,通过在检测所述图像采集设备的摄像头传输的图像处于过曝状态时,获取所述摄像头对应的曝光参数,以及获取该图像对应的深度位置信息,根据该图像对应的深度位置信息得到检测目标以及与该检测目标对应的目标位置,并对摄像头的曝光参数进行调整后,根据调整后的曝光参数对目标位置进行聚焦,进而实现自动调节曝光参数,并有效避免了采用人工调节的方式造成时间浪费以及调节不准确的情况。An exposure adjustment method and device provided by the present invention, by acquiring exposure parameters corresponding to the camera and acquiring depth position information corresponding to the image when detecting that the image transmitted by the camera of the image acquisition device is in an overexposed state, The detection target and the target position corresponding to the detection target are obtained according to the depth position information corresponding to the image, and after adjusting the exposure parameters of the camera, the target position is focused according to the adjusted exposure parameters, thereby realizing automatic adjustment of the exposure parameters. And effectively avoid the waste of time and inaccurate adjustment caused by manual adjustment.
为使本发明的上述目的、特征和优点能更明显易懂,下文特举较佳实施例,并配合所附附图,作详细说明如下。In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below, and are described in detail as follows in conjunction with the accompanying drawings.
附图说明Description of drawings
图1为本发明实施例提供的一种图像采集设备的连接框图。FIG. 1 is a connection block diagram of an image acquisition device according to an embodiment of the present invention.
图2为本发明实施例提供的一种图像处理方法的流程示意图。FIG. 2 is a schematic flowchart of an image processing method according to an embodiment of the present invention.
图3为图2中步骤S110的流程示意图。FIG. 3 is a schematic flowchart of step S110 in FIG. 2 .
图4为图2中步骤S120的流程示意图。FIG. 4 is a schematic flowchart of step S120 in FIG. 2 .
图5为本发明实施例提供的一种曝光调整装置的连接框图。FIG. 5 is a connection block diagram of an exposure adjustment device according to an embodiment of the present invention.
图6为本发明实施例提供的一种曝光状态检测模块的连接框图。FIG. 6 is a connection block diagram of an exposure state detection module provided by an embodiment of the present invention.
图7为本发明实施例提供的一种深度图像获得模块的连接框图。FIG. 7 is a connection block diagram of a depth image obtaining module according to an embodiment of the present invention.
图标:10-图像采集设备;11-摄像头;12-存储器;13-处理器;14-深度传感器;15-显示器;100-曝光调整装置;110-曝光状态检测模块;112-检测子模块;114-判断子模块;120-深度图像获得模块;122-坐标获取子模块;124-映射子模块;130-目标位置获得模块;140-曝光参数调整模块。Icon: 10-image acquisition device; 11-camera; 12-memory; 13-processor; 14-depth sensor; 15-display; 100-exposure adjustment device; 110-exposure state detection module; 112-detection sub-module; 114 - Judgment sub-module; 120 - Depth image acquisition module; 122 - Coordinate acquisition sub-module; 124 - Mapping sub-module; 130 - Target position acquisition module; 140 - Exposure parameter adjustment module.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例只是本发明的一部分实施例,而不是全部的实施例。通常在此处附图中描述和示出的本发明实施例的组件可以以各种不同的配置来布置和设计。In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is only a part of the embodiments of the present invention, but not all of the embodiments. The components of the embodiments of the invention generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations.
因此,以下对在附图中提供的本发明的实施例的详细描述并非旨在限制要求保护的本发明的范围,而是仅仅表示本发明的选定实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。Thus, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the invention as claimed, but is merely representative of selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步定义和解释。It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.
如图1所示,本发明实施例提供了一种图像采集设备10,包括摄像头11、存储器12、处理器13、深度传感器14以及显示器15,所述摄像头11、存储器12、处理器13、深度传感器14以及显示器15相互之间直接或间接地电性连接,以实现数据的传输或交互。As shown in FIG. 1, an embodiment of the present invention provides an
具体的,所述摄像头11、存储器12、深度传感器14以及显示器15分别与所述处理器13电连接,所述摄像头11用于拍摄图像,所述存储器12中存储有以软件或固件(Firmware)的形式存储于所述存储器12中的软件功能模块,所述处理器13通过运行存储在存储器12内的软件程序以及模块,如本发明实施例中的曝光调整装置100,从而执行各种功能应用以及数据处理,即实现本发明实施例中的曝光调整方法,所述深度传感器14用于检测所述摄像头11拍摄的图像的深度位置信息,所述显示器15用于显示摄像头11拍摄的图像,以便于用户查看。Specifically, the
其中,所述图像采集设备10可以是但不限于手机、平板或相机,在此不作具体限定。Wherein, the
所述存储器12可以是,但不限于,随机存取存储器(Random Access Memory,RAM),只读存储器(Read Only Memory,ROM),可编程只读存储器(Programmable Read-OnlyMemory,PROM),可擦除只读存储器(Erasable Programmable Read-Only Memory,EPROM),电可擦除只读存储器(Electrically Erasable Programmable Read-Only Memory,EEPROM)等。其中,存储器12用于存储程序,所述处理器13在接收到执行指令后,执行所述程序。The
所述处理器13可以是通用处理器,包括中央处理器(Central Processing Unit,CPU)、网络处理器(Network Processor,NP)等,还可以是数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The
可以理解,图1所示的结构仅为示意,所述图像采集设备10还可包括比图1中所示更多或者更少的组件,或者具有与图1所示不同的配置。图1中所示的各组件可以采用硬件、软件或其组合实现。It can be understood that the structure shown in FIG. 1 is only for illustration, and the
请结合图2,本发明提供一种可应用于上述图像采集设备10的曝光调整方法,所述曝光调整方法应用于上述图像采集设备10时实现步骤S110-S140四个步骤。Referring to FIG. 2 , the present invention provides an exposure adjustment method applicable to the above-mentioned
步骤S110:检测所述图像采集设备10的摄像头11传输的图像是否处于过曝状态,并在检测结果为是时获取所述摄像头11对应的曝光参数,以及获取该图像对应的深度位置信息。Step S110: Detect whether the image transmitted by the
具体的,检测所述图像采集设备10的摄像头11传输的图像是否处于过曝状态的方式为,对所述摄像头11在进行拍摄过程中或在调焦过程中对传输的每一图像根据图像的光强值进行曝光检测,或根据图像的清晰度和亮度进行曝光检测。Specifically, the method of detecting whether the image transmitted by the
请结合图3,可选的,在本实施例中,检测所述图像采集设备10的摄像头11传输的图像是否处于过曝状态的步骤包括:Please refer to FIG. 3 , optionally, in this embodiment, the step of detecting whether the image transmitted by the
步骤S112:对所述图像采集设备10的摄像头11传输的图像进行光强检测得到该图像对应的光强值。Step S112: Perform light intensity detection on the image transmitted by the
步骤S114:判断所述光强值是否位于预设光强范围内,并在当所述光强值不在所述预设光强范围内时,获取在该光强值下所述摄像头11对应的曝光参数。Step S114: Determine whether the light intensity value is within the preset light intensity range, and when the light intensity value is not within the preset light intensity range, obtain the corresponding light intensity value of the
具体的,进行光强度检测的方式可以是根据设置于所述摄像头11的光强度传感器进行检测,也可以是根据能够进行光强检测的深度图像学习模型进行光强度检测,在此不作具体限定,根据是实际需求进行设置即可。Specifically, the light intensity detection may be performed according to the light intensity sensor provided in the
为使得进行光强度检测的结果更加准确,并有效避免增加硬件结构造成图像采集设备10的成本增加的问题,在本实施例中,可以采用但不限于gogleNet深度学习模型、AlexNet深度学习模型或VGG深度学习模型对该图像进行曝光程度检测以得到该图像对应的光强值。In order to make the result of the light intensity detection more accurate, and to effectively avoid the problem of increasing the cost of the
可以理解,在本实施例中,光强值不在所述预设光强范围内的情况通常包括光强值大于所述预设光强值范围的最大值而处于过曝光状态的情况,以及所述光强值小于所述预设光强值范围的最小值而处于欠曝光状态的情况。It can be understood that, in this embodiment, the situation that the light intensity value is not within the preset light intensity range generally includes the situation that the light intensity value is greater than the maximum value of the preset light intensity value range and is in an overexposure state, and all The light intensity value is less than the minimum value of the preset light intensity value range and is in an under-exposure state.
其中,所述预设光强值范围可以根据用户的需求进行选取,具体的,所述存储器12中可以存储有多个预设光强值范围,且不同的预设光强值范围对应有不同的环境场景,例如,该环境场景可以是包括气候情况,如晴天、阴天或下雨等,不同的环境场景下对应的光强值范围不同。用户可以根据实际需求选取所需的环境场景得到对应的预设范围。The preset light intensity value range can be selected according to the needs of the user. Specifically, the
可以理解,为实现使用户选取不同的场景,在本实施例中,所述图像采集设备10包括显示器15,以使用户可以根据显示器15查看并选取所需的环境场景。It can be understood that, in order to enable the user to select different scenes, in this embodiment, the
所述曝光参数可以包括但不限于曝光时间和曝光光圈等影响进行图像拍摄后得到的图像光强值的因素。可选的,在本实施例中,所述曝光参数包括曝光时间和曝光光圈。The exposure parameters may include, but are not limited to, factors such as exposure time and exposure aperture, which affect the light intensity value of the image obtained after the image is captured. Optionally, in this embodiment, the exposure parameters include exposure time and exposure aperture.
其中,获取所述目标图像对应的深度位置信息的方式可以是,通过对所述目标图像采用深度检测算法或模型进行深度检测以得到深度位置信息,也可以是采用深度检测器进行检测以得到该目标图像的深度位置信息,在此不作具体限定。Wherein, the method of acquiring the depth position information corresponding to the target image may be by performing depth detection on the target image by using a depth detection algorithm or model to obtain the depth position information, or by using a depth detector to perform detection to obtain the depth position information. The depth position information of the target image is not specifically limited here.
请结合图3,可选的,在本实施例中,所述摄像头11的视口位置处设置有深度传感器14,获取所述目标图像对应的深度位置信息的步骤包括:获取所述深度传感器14对所述目标图像进行图像深度检测得到的深度位置信息。Please refer to FIG. 3 , optionally, in this embodiment, a
通过上述设置,以有效保障检测到的深度位置信息的准确性。Through the above settings, the accuracy of the detected depth position information can be effectively guaranteed.
步骤S120:将所述目标图像与所述深度位置信息进行映射后得到深度图像,并将所述深度图像采用预设深度图像学习模型进行检测以得到检测目标。Step S120: A depth image is obtained after mapping the target image and the depth position information, and a preset depth image learning model is used to detect the depth image to obtain a detection target.
将所述目标图像与所述深度位置信息进行映射的方式可以是将所述目标图像与所述深度位置信息采用参数化的方式进行映射,也可以是按照对应关系进行映射,在此不作具体限定,根据实际需求进行设置。The method of mapping the target image and the depth position information may be to map the target image and the depth position information in a parameterized manner, or may be mapped according to a corresponding relationship, which is not specifically limited here. , set according to actual needs.
为使进行映射的效率更高,将所述目标图像与所述深度位置信息采用参数化的方式进行映射,具体地,请结合图4,在本实施例中,所述深度位置信息中包括该深度位置信息对应图像中各像素点的位置坐标和深度值,步骤S120包括:In order to make the mapping more efficient, the target image and the depth position information are mapped in a parameterized manner. Specifically, please refer to FIG. 4 , in this embodiment, the depth position information includes the depth position information. The depth position information corresponds to the position coordinates and depth values of each pixel in the image, and step S120 includes:
步骤S122:获取该图像中每个像素点的位置坐标。Step S122: Obtain the position coordinates of each pixel in the image.
步骤S124:将获取的每个像素点的位置坐标与所述深度位置信息中各像素点的位置坐标和深度值进行映射得到深度图像。Step S124: Map the acquired position coordinates of each pixel with the position coordinates and depth values of each pixel in the depth position information to obtain a depth image.
所述预设深度图像学习模型可以是但不限于Faster R-CNN、R-FCN或SSD深度学习目标检测模型,只要能够将所述深度图像采用所述预设深度图像学习模型进行检测并根据实际需求进行选取即可,在此不作具体限定。The preset deep image learning model may be, but is not limited to, Faster R-CNN, R-FCN or SSD deep learning target detection model, as long as the depth image can be detected by using the preset deep image learning model and based on actual conditions. It can be selected according to the requirements, which is not specifically limited here.
所述检测目标可以是但不限于人、景物、车辆或车牌等,在此不作具体限定,将所述深度图像输入预设深度图像学习模型进行检测以得到检测目标的方式可以是:将所述深度图像输入预设深度图像学习模型进行检测得到多个检测图像,并接收用户从多个检测图像中选取的一个检测图像作为检测目标。具体的,将所述深度图像输入预设深度图像学习模型进行检测得到多个检测图像,并控制所述显示器15显示所述多个检测图像,接收用户基于该多个检测图像中选取的一个检测图像作为目标图像。The detection target may be, but is not limited to, a person, a scene, a vehicle or a license plate, etc., which is not specifically limited here. The method of inputting the depth image into a preset depth image learning model for detection to obtain the detection target may be: The depth image is input to a preset depth image learning model for detection to obtain multiple detection images, and a detection image selected by the user from the multiple detection images is received as a detection target. Specifically, the depth image is input into a preset depth image learning model for detection to obtain a plurality of detection images, and the
步骤S130:将该图像与所述检测目标进行反映射得到该检测目标在该图像中的对应位置并将该对应位置作为目标位置。Step S130: Perform inverse mapping of the image and the detection target to obtain a corresponding position of the detection target in the image, and use the corresponding position as a target position.
可以理解,当所述目标图像与所述深度位置信息使用参数化的映射方法进行映射时,则将所述目标图像与所述检测目标进行反映射也是采用参数化的映射方法的进行反映射。It can be understood that when the target image and the depth position information are mapped using a parameterized mapping method, the inverse mapping of the target image and the detection target is also performed using a parameterized mapping method.
步骤S140:调整所述摄像头11的曝光参数,并采用调整后的曝光参数对所述目标位置进行重新聚焦。Step S140: Adjust the exposure parameters of the
其中,调整所述摄像头11的曝光参数的方式可以是根据所述光强值对所述摄像头11的曝光参数进行调整,具体的,当所述光强值大于所述预设光强范围的最大值时降低曝光时间和/或降低曝光光圈,当所述光强值小于所述预设光强值范围的最小值时增加曝光时间和/或增大曝光光圈。并在所述曝光参数调整完成后对所述目标位置进行聚焦,以实现拍摄,进而保证了高质量图像的获取。The method of adjusting the exposure parameter of the
通过上述方法,以实现自动调节曝光参数,避免在过曝光状态下,且无人工干预时则造成摄像头11会保持该光强值对应的曝光参数继续进行拍摄进而影响拍摄效果,进而可以有效避免采用人工调节的方式造成时间浪费和调节不准确的情况。Through the above method, the exposure parameters can be automatically adjusted to avoid the overexposure state, and without manual intervention, the
可以理解,上述的曝光调整方法可以用个人计算机、行车记录仪以及无人机等具有图像采集功能的图像采集设备10上,同时保持了摄像头11的整体性并节省了成本,并可以扩展到普适、家用。It can be understood that the above-mentioned exposure adjustment method can be applied to the
因此,通过上述方法,还能够有效避免通过X射线红外传感等判断关键点位置自动重新聚焦调整存在的物料成本昂贵、并容易产生热量等其他容易影响判断的情况,以及避免由于采用X射线红外传感的方式只针对使用双摄像头和带有辅助性功能的摄像头进行协同判断,进而造成成本过高的问题。因此,本发明提供的曝光调整方法不仅够自动重新处理聚焦,自动调整曝光参数以进行拍摄,还能够克服成本昂贵的难题,可以快速高效的处理,保证高质量图像的获取。Therefore, through the above method, it is also possible to effectively avoid the high cost of materials, easy generation of heat and other situations that can easily affect the judgment, such as judging the position of key points by X-ray infrared sensing, etc. The sensing method is only for the use of dual cameras and cameras with auxiliary functions for collaborative judgment, which leads to the problem of high cost. Therefore, the exposure adjustment method provided by the present invention can not only automatically reprocess focusing and automatically adjust exposure parameters for shooting, but also can overcome the problem of high cost, can process quickly and efficiently, and ensure the acquisition of high-quality images.
请结合图5,在上述基础上,本发明还提供一种曝光调整装置100,包括:曝光状态检测模块110、深度图像获得模块120、目标位置获得模块130以及曝光参数调整模块140。Referring to FIG. 5 , on the basis of the above, the present invention further provides an
所述曝光状态检测模块110用于检测所述图像采集设备10的摄像头11传输的图像是否处于过曝状态,并在检测结果为是时获取所述摄像头11对应的曝光参数,以及获取该图像对应的深度位置信息。在本实施例中,所述曝光状态检测模块110可用于执行图2所示的步骤S110,关于所述曝光状态检测模块110的具体描述可以参照前文对步骤S110的描述。The exposure
请结合图6,可选的,在本实施例中,所述光强值获取模块110还用于包括检测子模块112和判断子模块114。Please refer to FIG. 6 , optionally, in this embodiment, the light intensity
所述检测子模块112对所述图像采集设备10的摄像头11传输的图像进行光强检测得到该图像对应的光强值。在本实施例中,所述检测子模块112可用于执行图3所示的步骤S112,关于所述检测子模块112的具体描述可以参照前文对步骤S112的描述。The
所述判断子模块114用于判断所述光强值是否位于预设光强范围内,当所述光强值不在所述预设光强范围内时,获取在该光强值下所述摄像头11对应的曝光参数。在本实施例中,所述判断子模块114可用于执行图3所示的步骤S114,关于所述判断子模块114的具体描述可以参照前文对步骤S114的描述。The judging sub-module 114 is used to judge whether the light intensity value is within the preset light intensity range, and when the light intensity value is not within the preset light intensity range, obtain the camera at the light intensity value. 11 corresponds to the exposure parameters. In this embodiment, the judging sub-module 114 may be configured to perform step S114 shown in FIG. 3 , and for the specific description of the judging sub-module 114 , reference may be made to the foregoing description of step S114 .
所述深度图像获得模块120用于将该图像与所述深度位置信息进行映射后得到深度图像,并将所述深度图像输入预设深度图像学习模型进行检测以得到检测目标。在本实施例中,所述深度图像获得模块120可用于执行图2所示的步骤S120,关于所述深度图像获得模块120的具体描述可以参照前文对步骤S120的描述。The depth
可选的,在本实施例中,所述摄像头11的视口位置处设置有深度传感器14,所述深度图像获得模块120还用于获取所述深度传感器14对该图像进行图像深度检测得到的深度位置信息。Optionally, in this embodiment, a
可选的,在本实施例中,所述预设深度图像学习模型为Faster R-CNN深度图像学习模型、R-FCN深度图像学习模型或SSD深度图像学习模型。Optionally, in this embodiment, the preset deep image learning model is a Faster R-CNN deep image learning model, an R-FCN deep image learning model, or an SSD deep image learning model.
请结合图7,可选的,在本实施例中,所述深度位置信息中包括该深度位置信息对应图像中各像素点的位置坐标和深度值,所述深度图像获得模块120包括:坐标获取子模块122和映射子模块124。Please refer to FIG. 7 , optionally, in this embodiment, the depth position information includes the position coordinates and depth values of each pixel in the image corresponding to the depth position information, and the depth
所述坐标获取子模块122用于获取该图像中每个像素点的位置坐标。在本实施例中,所述坐标获取子模块122可用于执行图4所示的步骤S122,关于所述坐标获取子模块122的具体描述可以参照前文对步骤S122的描述。The coordinate obtaining sub-module 122 is used to obtain the position coordinates of each pixel in the image. In this embodiment, the coordinate acquisition sub-module 122 may be configured to execute step S122 shown in FIG. 4 , and for the specific description of the coordinate
所述映射子模块124用于将获取的每个像素点的位置坐标与所述深度位置信息中各像素点的位置坐标和深度值进行映射得到深度图像。在本实施例中,所述映射子模块124可用于执行图4所示的步骤S124,关于所述映射子模块124的具体描述可以参照前文对步骤S124的描述。The
所述目标位置获得模块130用于将该图像与所述检测目标进行反映射得到该检测目标在该图像中的对应位置并将该对应位置作为目标位置。在本实施例中,所述目标位置获得模块130可用于执行图2所示的步骤S130,关于所述目标位置获得模块130的具体描述可以参照前文对步骤S130的描述。The target
所述曝光参数调整模块140用于根据所述光强值对所述摄像头11的曝光参数进行调整后对所述目标位置进行聚焦。在本实施例中,所述曝光参数调整模块140可用于执行图2所示的步骤S140,关于所述曝光参数调整模块140的具体描述可以参照前文对步骤S140的描述。The exposure
综上,本发明提供的一种曝光调整方法及装置,方法通过在检测到图像采集设备10的摄像头11传输的图像处于过曝状态时,获取所述摄像头11对应的曝光参数,以及获取该图像对应的深度位置信息,将该图像与深度位置信息进行映射后得到深度图像,并将深度图像输入预设深度图像学习模型进行检测以得到检测目标,将该图像与检测目标进行反映射得到检测目标在图像中的对应位置并将该对应位置作为目标位置,根据光强值对摄像头11的曝光参数进行调整后对目标位置进行聚焦。通过上述方法,以实现自动调节曝光参数,并有效避免采用人工调节的方式造成时间浪费和调节不准确的情况。To sum up, the present invention provides an exposure adjustment method and device. The method obtains exposure parameters corresponding to the
在本发明实施例所提供的几个实施例中,应该理解到,所揭露的装置和方法,也可以通过其它的方式实现。以上所描述的装置和方法实施例仅仅是示意性的,例如,附图中的流程图和框图显示了根据本发明的多个实施例的装置、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现方式中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。In the several embodiments provided by the embodiments of the present invention, it should be understood that the disclosed apparatus and method may also be implemented in other manners. The apparatus and method embodiments described above are merely illustrative, for example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention, function and operation. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more functions for implementing the specified logical function(s) executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810916791.0A CN110830728A (en) | 2018-08-13 | 2018-08-13 | Exposure adjusting method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810916791.0A CN110830728A (en) | 2018-08-13 | 2018-08-13 | Exposure adjusting method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110830728A true CN110830728A (en) | 2020-02-21 |
Family
ID=69546817
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810916791.0A Pending CN110830728A (en) | 2018-08-13 | 2018-08-13 | Exposure adjusting method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110830728A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114972262A (en) * | 2022-05-26 | 2022-08-30 | 昆山丘钛微电子科技股份有限公司 | Depth image calculation method, device, equipment and medium |
CN115118886A (en) * | 2021-03-22 | 2022-09-27 | Oppo广东移动通信有限公司 | Image processing chip, application processing chip, electronic device and image processing method |
CN117872674A (en) * | 2024-01-30 | 2024-04-12 | 深圳华盛光刻系统有限公司 | Stress relief method for 3D lithography manufacturing depth lens |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102006421A (en) * | 2009-09-01 | 2011-04-06 | 华晶科技股份有限公司 | Processing method for image with face |
CN102868861A (en) * | 2011-07-07 | 2013-01-09 | 华晶科技股份有限公司 | The method to get the image |
US20130120610A1 (en) * | 2011-11-11 | 2013-05-16 | Canon Kabushiki Kaisha | Image capture apparatus, control method thereof, and recording medium |
CN103428439A (en) * | 2013-08-22 | 2013-12-04 | 浙江宇视科技有限公司 | Automatic exposure control method and device for imaging equipment |
CN103699877A (en) * | 2013-12-02 | 2014-04-02 | 广东欧珀移动通信有限公司 | Method and system for improving face recognition effects |
CN104104886A (en) * | 2014-07-24 | 2014-10-15 | 深圳市中兴移动通信有限公司 | Overexposure shooting method and device |
US20150054987A1 (en) * | 2013-08-21 | 2015-02-26 | Canon Kabushiki Kaisha | Image processing apparatus, image pickup apparatus, method of controlling the image processing apparatus, and non-transitory computer-readable storage medium |
US20150163389A1 (en) * | 2013-12-06 | 2015-06-11 | Chung-Shan Institute Of Science And Technology, Armaments Bureau, M.N.D | Exposure-suppressing imaging system |
CN105049726A (en) * | 2015-08-05 | 2015-11-11 | 广东欧珀移动通信有限公司 | Mobile terminal shooting method and mobile terminal |
CN105635565A (en) * | 2015-12-21 | 2016-06-01 | 华为技术有限公司 | Shooting method and equipment |
CN106210523A (en) * | 2016-07-22 | 2016-12-07 | 浙江宇视科技有限公司 | A kind of exposure adjustment method and device |
CN107846556A (en) * | 2017-11-30 | 2018-03-27 | 广东欧珀移动通信有限公司 | Imaging method, device, mobile terminal and storage medium |
CN107945107A (en) * | 2017-11-30 | 2018-04-20 | 广东欧珀移动通信有限公司 | Image processing method, device, computer-readable storage medium, and electronic device |
-
2018
- 2018-08-13 CN CN201810916791.0A patent/CN110830728A/en active Pending
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102006421A (en) * | 2009-09-01 | 2011-04-06 | 华晶科技股份有限公司 | Processing method for image with face |
CN102868861A (en) * | 2011-07-07 | 2013-01-09 | 华晶科技股份有限公司 | The method to get the image |
US20130120610A1 (en) * | 2011-11-11 | 2013-05-16 | Canon Kabushiki Kaisha | Image capture apparatus, control method thereof, and recording medium |
US20150054987A1 (en) * | 2013-08-21 | 2015-02-26 | Canon Kabushiki Kaisha | Image processing apparatus, image pickup apparatus, method of controlling the image processing apparatus, and non-transitory computer-readable storage medium |
CN103428439A (en) * | 2013-08-22 | 2013-12-04 | 浙江宇视科技有限公司 | Automatic exposure control method and device for imaging equipment |
CN103699877A (en) * | 2013-12-02 | 2014-04-02 | 广东欧珀移动通信有限公司 | Method and system for improving face recognition effects |
US20150163389A1 (en) * | 2013-12-06 | 2015-06-11 | Chung-Shan Institute Of Science And Technology, Armaments Bureau, M.N.D | Exposure-suppressing imaging system |
CN104104886A (en) * | 2014-07-24 | 2014-10-15 | 深圳市中兴移动通信有限公司 | Overexposure shooting method and device |
CN105049726A (en) * | 2015-08-05 | 2015-11-11 | 广东欧珀移动通信有限公司 | Mobile terminal shooting method and mobile terminal |
CN105635565A (en) * | 2015-12-21 | 2016-06-01 | 华为技术有限公司 | Shooting method and equipment |
CN106210523A (en) * | 2016-07-22 | 2016-12-07 | 浙江宇视科技有限公司 | A kind of exposure adjustment method and device |
CN107846556A (en) * | 2017-11-30 | 2018-03-27 | 广东欧珀移动通信有限公司 | Imaging method, device, mobile terminal and storage medium |
CN107945107A (en) * | 2017-11-30 | 2018-04-20 | 广东欧珀移动通信有限公司 | Image processing method, device, computer-readable storage medium, and electronic device |
Non-Patent Citations (1)
Title |
---|
权巍 等: "基于多曝光的高动态范围全景图像合成", 《系统仿真学报》 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115118886A (en) * | 2021-03-22 | 2022-09-27 | Oppo广东移动通信有限公司 | Image processing chip, application processing chip, electronic device and image processing method |
CN114972262A (en) * | 2022-05-26 | 2022-08-30 | 昆山丘钛微电子科技股份有限公司 | Depth image calculation method, device, equipment and medium |
CN117872674A (en) * | 2024-01-30 | 2024-04-12 | 深圳华盛光刻系统有限公司 | Stress relief method for 3D lithography manufacturing depth lens |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10997696B2 (en) | Image processing method, apparatus and device | |
US11563897B2 (en) | Image processing method and apparatus which determines an image processing mode based on status information of the terminal device and photographing scene information | |
CN108364267B (en) | Image processing method, device and equipment | |
US8184196B2 (en) | System and method to generate depth data using edge detection | |
CN104853109B (en) | A kind of method and camera terminal for automatically adjusting flash of light | |
WO2019085951A1 (en) | Image processing method, and device | |
US20170256036A1 (en) | Automatic microlens array artifact correction for light-field images | |
US10171743B2 (en) | Image pickup apparatus, image processing apparatus, image processing method, and non-transitory computer-readable storage medium for improving quality of captured image | |
WO2018201809A1 (en) | Double cameras-based image processing device and method | |
WO2017206444A1 (en) | Method and device for detecting imaging difference, and computer storage medium | |
WO2015081556A1 (en) | Photographing method for dual-camera device and dual-camera device | |
CN105959581A (en) | Electronic device for image capture with dynamically controlled flash and related control method | |
US10602075B2 (en) | Automatically determining a set of exposure values for a high dynamic range image capture device | |
CN110349163A (en) | Image processing method and apparatus, electronic device, computer-readable storage medium | |
CN110830728A (en) | Exposure adjusting method and device | |
CN106412423A (en) | Focusing method and device | |
US10972676B2 (en) | Image processing method and electronic device capable of optimizing hdr image by using depth information | |
CN110493515B (en) | Method, device, storage medium and electronic device for enabling high dynamic range shooting mode | |
CN105007410B (en) | A kind of big visual angle camera control method and user terminal | |
US11496660B2 (en) | Dual sensor imaging system and depth map calculation method thereof | |
CN114143419B (en) | Dual-sensor camera system and depth map calculation method thereof | |
CN110392211A (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
US10853685B2 (en) | Method and apparatus for detecting fog from image | |
CN110853127A (en) | Image processing method, device and equipment | |
CN104994288A (en) | Shooting method and user terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200221 |