[go: up one dir, main page]

CN106534663A - Imaging apparatus - Google Patents

Imaging apparatus Download PDF

Info

Publication number
CN106534663A
CN106534663A CN201610602503.5A CN201610602503A CN106534663A CN 106534663 A CN106534663 A CN 106534663A CN 201610602503 A CN201610602503 A CN 201610602503A CN 106534663 A CN106534663 A CN 106534663A
Authority
CN
China
Prior art keywords
reference value
value
captured image
image
processing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610602503.5A
Other languages
Chinese (zh)
Inventor
杉本和彦
吉村靖博
稻垣勇树
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsuboshi Diamond Industrial Co Ltd
Original Assignee
Mitsuboshi Diamond Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsuboshi Diamond Industrial Co Ltd filed Critical Mitsuboshi Diamond Industrial Co Ltd
Publication of CN106534663A publication Critical patent/CN106534663A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/81Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/64Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/82Camera processing pipelines; Components thereof for controlling camera response irrespective of the scene brightness, e.g. gamma correction

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

本发明提供一种摄像装置,能够通过简单的处理而抑制在对拍摄图像的不清晰度进行自动修正的情况下的误动作。本发明的摄像装置(1)具备:摄像部(10),使来自目标区域的光在摄像元件(14)成像;图像处理部(21),对从摄像元件(14)输出的信号进行处理且输出影像信息;以及存储部(22),存储表示拍摄图像的清晰度的参数的基准值。图像处理部(21)根据从摄像元件(14)输入的信号而取得所述参数的实测值,且将在特定的时点取得的实测值作为基准值而存储在存储部(22),根据之后取得的实测值与存储在存储部(22)的基准值的差,执行对拍摄图像的清晰化处理。

The present invention provides an imaging device capable of suppressing erroneous operations in the case of automatically correcting the blur of a captured image through simple processing. The imaging device (1) of the present invention comprises: an imaging unit (10), which forms an image of light from a target area on an imaging element (14); an image processing unit (21), which processes a signal output from the imaging element (14) and output video information; and a storage unit (22) storing a reference value of a parameter indicating sharpness of a captured image. The image processing unit (21) acquires the actual measurement value of the parameter based on the signal input from the imaging element (14), stores the actual measurement value acquired at a specific time point as a reference value in the storage unit (22), and then The difference between the obtained measured value and the reference value stored in the storage unit (22) is used to perform sharpening processing on the captured image.

Description

摄像装置camera device

技术领域technical field

本发明涉及一种拍摄目标区域的摄像装置,尤其是适合用于拍摄清晰度可能会因产生雨或雾等而降低的风景时的摄像装置。The present invention relates to an imaging device for photographing a target area, in particular, an imaging device suitable for photographing scenery whose clarity may be reduced due to rain or fog.

背景技术Background technique

已知利用监控相机拍摄街道或交叉路口的摄像装置。这种摄像装置是将拍摄到的图像用于例如交通事故的鉴定等。在鉴定中,能够确认车辆或行人的状况、或交通信号灯的点亮状况等。也就是说,能够确认事故时交通信号灯是以红色、蓝色、黄色的哪种颜色点亮。Camera devices are known which take pictures of streets or intersections with surveillance cameras. Such an imaging device uses captured images for identification of traffic accidents, for example. In the identification, it is possible to check the conditions of vehicles and pedestrians, the lighting conditions of traffic lights, and the like. In other words, it is possible to confirm whether the traffic lights are lit in red, blue, or yellow at the time of an accident.

然而,在街道或交叉路口等处,因雨或雾的产生而可能会引起被拍摄体的对比度降低。例如,如果交叉路口被雾笼罩,那么便有无法清晰地拍摄车辆或行人的状况、或交通信号灯的点亮状况等的担忧。如此一来,无法顺利地进行使用拍摄图像的鉴定。However, in places such as streets and intersections, the contrast of the subject may be lowered due to rain or fog. For example, if the intersection is covered with fog, there is a concern that the conditions of vehicles and pedestrians, the lighting conditions of traffic lights, etc. cannot be clearly captured. As a result, authentication using captured images cannot be performed smoothly.

在以下的专利文献1中,记载着一种具备监控相机装置与控制装置的监控相机系统。该监控相机系统中,根据监控相机装置所拍摄的图像,利用控制装置检测出雾或霞。雾或霞的产生是通过以下方式检测:将预先拍摄的图像与当前的图像进行比较,根据其结果是否产生浮白而检测。另外,雾或霞的强度是根据数字影像信号成分中影像的明亮度成为最低的部分的电平(黑峰值电平)是否超出特定的阈值来判定。如此检测出雾或霞,进而,如果判定出雾或霞的强度,便将与雾或霞的强度对应的警报从控制装置输出至外部设备。另外,进行与所判定出的雾或霞的强度对应的霞修正。Patent Document 1 below describes a monitoring camera system including a monitoring camera device and a control device. In this monitoring camera system, fog or haze is detected by a control device based on an image captured by the monitoring camera device. The occurrence of fog or haze is detected by comparing a pre-taken image with the current image, and detecting whether or not whitening occurs as a result. In addition, the intensity of fog or haze is judged based on whether or not the level (black peak level) of the portion where the brightness of the image becomes the lowest among the digital video signal components exceeds a specific threshold. Fog or haze is detected in this way, and further, when the intensity of fog or haze is determined, an alarm corresponding to the intensity of fog or haze is output from the control device to an external device. In addition, haze correction corresponding to the determined intensity of fog or haze is performed.

[背景技术文献][Background Art Document]

[专利文献][Patent Document]

[专利文献1]日本专利特开2014-192762号公报[Patent Document 1] Japanese Patent Laid-Open No. 2014-192762

发明内容Contents of the invention

[发明所要解决的问题][Problem to be Solved by the Invention]

如上所述,专利文献1的方法中,为修正图像而必须进行雾或霞的检测测、与雾或霞的强度的判定这两个步骤的处理。雾或霞的强度的判定是根据黑峰值电平是否超出特定的阈值来进行,因此,例如在如将原本影像信号的黑峰值电平变高的风景作为拍摄对象的情况下,有在修正中产生误动作的担忧。As described above, in the method of Patent Document 1, in order to correct the image, it is necessary to perform two-step processing of detecting fog or haze and determining the intensity of fog or haze. The intensity of fog or haze is judged based on whether the black peak level exceeds a specific threshold. Therefore, for example, when shooting a scene with a high black peak level in the original video signal, correction may be made. Fear of misoperation.

鉴于该问题,本发明的目的在于提供一种摄像装置,能够通过简单的处理而抑制在对拍摄图像的不清晰度进行自动修正的情况下的误动作。In view of this problem, an object of the present invention is to provide an imaging device capable of suppressing malfunctions when automatically correcting blur in a captured image through simple processing.

[解决问题的技术手段][Technical means to solve the problem]

本发明的主要形态涉及一种摄像装置。本形态的摄像装置具备:摄像部,使来自目标区域的光在摄像元件成像;图像处理部,对从所述摄像元件输出的信号进行处理且输出影像信息;以及存储部,存储表示拍摄图像的清晰度的特定的参数的基准值。这里,所述图像处理部根据从所述摄像元件输入的信号而取得所述参数的实测值,且将在特定的时点取得的实测值作为所述基准值而存储在所述存储部,根据之后取得的实测值与存储在所述存储部的基准值的差,执行对拍摄图像的清晰化处理。A main aspect of the present invention relates to an imaging device. The imaging device of this aspect includes: an imaging unit that forms an image of light from a target area on an imaging element; an image processing unit that processes a signal output from the imaging element and outputs image information; and a storage unit that stores a data representing a captured image. Benchmark values for specific parameters of sharpness. Here, the image processing unit acquires the actual measurement value of the parameter based on the signal input from the imaging element, and stores the actual measurement value acquired at a specific time point as the reference value in the storage unit. The difference between the actual measured value obtained thereafter and the reference value stored in the storage unit is used to perform sharpening processing on the captured image.

根据本形态的摄像装置,根据从摄像元件输入的信号而设定表示拍摄图像的清晰度的参数的基准值,因此所设定的基准值与拍摄对象的风景相对应。例如,在为了拍摄交叉路口而设置摄像装置的情况下,基准值与交叉路口的规模或交通信号灯的设置状况等目标区域的风景(构造物的布局等)相对应。而且,根据如此设定的基准值、与之后的摄像时取得的实测值的差而执行对拍摄图像的清晰化处理,因此能够适当地识别拍摄对象的目标区域的不清晰已达到何种程度,且能够抑制清晰化处理的误动作。如此,根据本形态的摄像装置,能够抑制在对拍摄图像的不清晰度进行自动修正的情况下的误动作。According to the imaging device of this aspect, since the reference value of the parameter indicating the sharpness of the captured image is set based on the signal input from the imaging element, the set reference value corresponds to the scene to be photographed. For example, when an imaging device is installed to photograph an intersection, the reference value corresponds to the scenery (layout of structures, etc.) of the target area such as the scale of the intersection or the installation status of traffic lights. In addition, since the sharpening process of the captured image is performed based on the difference between the reference value set in this way and the actual measurement value obtained at the time of subsequent imaging, it is possible to appropriately recognize how blurred the target area of the subject is, In addition, it is possible to suppress malfunction of the sharpening process. In this way, according to the imaging device of this aspect, it is possible to suppress malfunctions when automatically correcting the blur of a captured image.

另外,根据本形态的摄像装置,根据基准值与实测值的差而适当地执行清晰化处理,因此无需另外进行检测拍摄图像是否变得不清晰的处理。由此,根据本形态的摄像装置,能够通过简单的处理来进行拍摄图像的清晰化。In addition, according to the imaging device of the present aspect, the sharpening process is appropriately performed based on the difference between the reference value and the actual measurement value, and therefore it is not necessary to separately perform a process of detecting whether the captured image is blurred. Thus, according to the imaging device of this aspect, it is possible to clear a captured image by simple processing.

此外,所谓“实测值与基准值的差”,不仅是指由实测值减去基准值所得的值,而且也可以是指实测值相对于基准值的比率等,只要是表示实测值与基准值相差多少的值,便可以是任意值。In addition, the "difference between the actual measurement value and the reference value" refers not only to the value obtained by subtracting the reference value from the actual measurement value, but also refers to the ratio of the actual measurement value to the reference value, etc., as long as the actual measurement value and the reference value The value of the difference can be any value.

在本形态的摄像装置中,能以如下方式构成:所述图像处理部在受理设定指示的输入的情况下,将根据来自所述摄像元件的信号所取得的所述参数的实测值作为所述基准值而存储在所述存储部。如此一来,能够顺利地避免在目标区域不清晰的时点取得并设定基准值。因此,能够更确实地抑制在对拍摄图像的不清晰度进行自动修正的情况下的误动作。In the imaging device of the present aspect, when the image processing unit accepts an input of a setting instruction, it may be configured such that the actual measurement value of the parameter obtained from the signal from the imaging element is used as the set value. The reference value is stored in the storage unit. In this way, it is possible to smoothly avoid obtaining and setting a reference value at a time when the target area is not clear. Therefore, it is possible to more reliably suppress a malfunction in the case of automatically correcting the blur of a captured image.

在本形态的摄像装置中,能以如下方式构成:所述存储部是与基于实测值的第1基准值分开地预先存储第2基准值。该情况下,能以如下方式构成:所述图像处理部在设定了使用基于实测值的所述第1基准值的模式的情况下,根据实测值而取得所述第1基准值且执行所述清晰化处理,在未设定所述模式的情况下,根据所述第2基准值而执行所述清晰化处理。如此一来,例如,在由于无法获得与第1基准值的设定相适的清晰的拍摄图像而未设定使用第1基准值的模式的情况下,也能够使用第2基准值来执行清晰化处理。In the imaging device of the present aspect, the storage unit may store the second reference value in advance separately from the first reference value based on the actually measured value. In this case, the image processing unit may be configured such that, when a mode using the first reference value based on an actual measurement value is set, the image processing unit acquires the first reference value based on an actual measurement value and executes the In the sharpening process, when the mode is not set, the sharpening process is executed based on the second reference value. In this way, for example, when the mode using the first reference value is not set because a clear captured image suitable for the setting of the first reference value cannot be obtained, it is possible to perform sharpening using the second reference value. processing.

在本形态的摄像装置中,能以如下方式构成:所述图像处理部根据所述实测值与所述基准值的差而切换用以使拍摄图像清晰化的调整值。该情况下,所述调整值能够设为用以对从所述摄像元件输出的信号进行伽玛修正的值。如此,通过调整用以进行伽玛修正的值,能够将拍摄图像的对比度通过简易的处理而顺利地调整为适于清晰化的状态。In the imaging device of this aspect, it is possible to configure the image processing unit to switch an adjustment value for sharpening a captured image according to a difference between the actual measurement value and the reference value. In this case, the adjustment value may be a value for performing gamma correction on a signal output from the imaging element. In this way, by adjusting the value for gamma correction, the contrast of the captured image can be smoothly adjusted to a state suitable for sharpening through simple processing.

此外,本形态的摄像装置中,作为表示拍摄图像的清晰度的所述参数,可使用例如从自摄像元件输出的一图像的信号所取得的亮度的标准偏差。通过如此使用亮度的标准偏差,能够准确地掌握拍摄图像的不清晰度。In addition, in the imaging device of this aspect, as the parameter indicating the sharpness of the captured image, for example, the standard deviation of brightness obtained from a signal of one image output from the imaging element can be used. By using the standard deviation of brightness in this way, it is possible to accurately grasp the unsharpness of a captured image.

[发明的效果][Effect of the invention]

如上,根据本发明,可提供一种摄像装置,能够通过简单的处理而抑制在对拍摄图像的不清晰度进行自动修正的情况下的误动作。As described above, according to the present invention, it is possible to provide an imaging device capable of suppressing malfunctions when automatically correcting blur in a captured image through simple processing.

本发明的效果或意义能够通过以下所示的实施方式的说明而更加明确。但是,以下所示的实施方式终究只是实施本发明时的一个例示,本发明丝毫不受以下实施方式所记载内容的限制。The effects and significance of the present invention will be clarified by the description of the embodiments shown below. However, the embodiments shown below are merely examples for implementing the present invention, and the present invention is by no means limited by the contents described in the following embodiments.

附图说明Description of drawings

图1是表示实施方式的摄像装置的构成的框图。FIG. 1 is a block diagram showing the configuration of an imaging device according to an embodiment.

图2是表示实施方式的图像处理部的构成的框图。FIG. 2 is a block diagram showing the configuration of an image processing unit according to the embodiment.

图3(a)~(d)是例示实施方式的拍摄图像的状况与亮度的直方图的关系的图。3( a ) to ( d ) are diagrams illustrating the relationship between the state of a captured image and the histogram of brightness according to the embodiment.

图4(a)~(d)是说明实施方式的拍摄图像的对比度的修正方法(清晰化处理)的图。4( a ) to ( d ) are diagrams illustrating a method of correcting the contrast of a captured image (sharpening process) according to the embodiment.

图5(a)、(b)是表示使实施方式的伽玛值变化的情况下的亮度的直方图的变化的图。5( a ) and ( b ) are diagrams showing changes in the histogram of luminance when the gamma value of the embodiment is changed.

图6(a)、(b)是表示尽管实施方式的拍摄图像清晰、但直方图的亮度分布范围较窄的情况下的目标区域的构成例的图。6( a ) and ( b ) are diagrams showing configuration examples of target areas in a case where the brightness distribution range of the histogram is narrow although the captured image according to the embodiment is clear.

图7是表示实施方式的清晰化处理的流程图。FIG. 7 is a flowchart showing the sharpening process of the embodiment.

图8是表示用于实施方式的清晰化处理的伽玛特性的一例的图。FIG. 8 is a diagram showing an example of gamma characteristics used in sharpening processing according to the embodiment.

图9(a)、(b)是示意性地表示实施方式的清晰化处理的作用的图。9( a ) and ( b ) are diagrams schematically showing the effect of the sharpening process according to the embodiment.

具体实施方式detailed description

以下,参照附图,对本发明的实施方式进行说明。本实施方式是将本发明应用于拍摄交叉路口或街道等的监控相机。Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this embodiment, the present invention is applied to a monitoring camera for photographing intersections, streets, and the like.

图1是表示摄像装置1的构成的图。FIG. 1 is a diagram showing the configuration of an imaging device 1 .

摄像装置1具备摄像部10、图像处理部21、存储部22、滤光片驱动部23、光圈驱动部24、输入部25及输出部26。The imaging device 1 includes an imaging unit 10 , an image processing unit 21 , a storage unit 22 , a filter driving unit 23 , an aperture driving unit 24 , an input unit 25 , and an output unit 26 .

摄像部10具备镜头11、光圈12、滤光片13及摄像元件14。The imaging unit 10 includes a lens 11 , a diaphragm 12 , a filter 13 , and an imaging element 14 .

镜头11撷取来自目标区域的光,使目标区域的像在摄像元件14的受光面成像。光圈12以根据来自目标区域的光的强弱而将适当的光量入射至摄像元件14的方式限制来自外部的光。光圈12是通过光圈驱动部24而调整孔径量。The lens 11 captures the light from the target area, and forms the image of the target area on the light-receiving surface of the imaging element 14 . The aperture 12 restricts light from the outside so that an appropriate amount of light is incident on the imaging element 14 according to the intensity of light from the target area. The aperture of the diaphragm 12 is adjusted by the diaphragm driving unit 24 .

滤光片13包含用以去除红外线的IR(Infrared,红外)截止滤光片及使红外线也和可见光一起透过的白玻璃(dummy glass)。滤光片13是经由滤光片驱动部23且通过图像处理部21而将IR截止滤光片与白玻璃的任一个定位在光圈12与摄像元件14之间的光路上。具体来说,在摄像元件14中获得通常电平以上的照度的情况下,将IR截止滤光片插入至光路,去除红外线。另外,当在摄像元件14中获得的照度低的情况下,将白玻璃插入至光路,使红外线也和可见光一起导入至摄像元件14,从而提高灵敏度。The filter 13 includes an IR (Infrared) cut filter for cutting out infrared rays and a dummy glass for transmitting infrared rays together with visible light. The filter 13 is positioned on the optical path between the diaphragm 12 and the imaging element 14 by the image processing unit 21 via the filter driving unit 23 . Specifically, when an illuminance higher than a normal level is obtained in the imaging element 14 , an IR cut filter is inserted into the optical path to cut infrared rays. Also, when the illuminance obtained by the imaging element 14 is low, white glass is inserted into the optical path to introduce infrared rays into the imaging element 14 together with visible light, thereby improving sensitivity.

摄像元件14是彩色的CMOS(Complementary Metal Oxide Semiconductor,互补金属氧化物半导体)影像传感器。摄像元件14也可以是CCD(Charge Coupled Device,电荷耦合元件)影像传感器。摄像元件14通过来自图像处理部21的控制而将与拍摄图像对应的信号输出至图像处理部21。The imaging element 14 is a color CMOS (Complementary Metal Oxide Semiconductor, Complementary Metal Oxide Semiconductor) image sensor. The imaging element 14 may also be a CCD (Charge Coupled Device, Charge Coupled Device) image sensor. The imaging element 14 outputs a signal corresponding to a captured image to the image processing unit 21 under the control of the image processing unit 21 .

图像处理部21具备CPU(Central Processing Unit,中央处理器)等运算处理电路,根据保存在存储部22的程序而执行图像处理。存储部22具备ROM(Read Only Memory,只读存储器)或RAM(Random Access Memory,随机存取存储器)等存储媒体,除保持图像处理用的程序之外,在由图像处理部21进行处理时也用作工作区域。存储部22中保持有与拍摄图像的清晰度的电平对应的多个伽玛修正值。参照图8,对保持在存储部22的伽玛修正值进行追加说明。The image processing unit 21 includes an arithmetic processing circuit such as a CPU (Central Processing Unit, central processing unit), and executes image processing based on a program stored in the storage unit 22 . The storage unit 22 includes a storage medium such as a ROM (Read Only Memory) or a RAM (Random Access Memory, random access memory), and not only holds a program for image processing, but also stores a program when the image processing unit 21 performs processing. Used as a work area. The storage unit 22 holds a plurality of gamma correction values corresponding to the level of sharpness of captured images. The gamma correction value held in the storage unit 22 will be additionally described with reference to FIG. 8 .

滤光片驱动部23及光圈驱动部24分别是用以通过来自图像处理部21的控制而驱动滤光片13及光圈12的驱动器。输入部25具有操作按钮等输入机构,受理来自用户的指示。输出部26将由图像处理部21处理后的影像信息经由输出端子而输出至外部设备。The filter drive unit 23 and the aperture drive unit 24 are drivers for driving the filter 13 and the aperture 12 under control from the image processing unit 21 , respectively. The input unit 25 has input means such as operation buttons, and accepts instructions from the user. The output unit 26 outputs the image information processed by the image processing unit 21 to an external device via an output terminal.

图3是图像处理部21的功能框图。FIG. 3 is a functional block diagram of the image processing unit 21 .

图像处理部21具备马赛克处理部101、线性矩阵处理部102、伽玛修正处理部103、Y/C分离处理部104、轮廓修正处理部105、色差修正处理部106及噪声去除处理部107、108。The image processing unit 21 includes a mosaic processing unit 101, a linear matrix processing unit 102, a gamma correction processing unit 103, a Y/C separation processing unit 104, an outline correction processing unit 105, a color difference correction processing unit 106, and noise removal processing units 107 and 108. .

从图1的摄像元件14输出的信号被输入至马赛克处理部101。马赛克处理部101从来自各像素的信号产生R、G、B该三色的信号。线性矩阵处理部102对由马赛克处理部101所产生的信号实施分光特性修正。The signal output from the imaging element 14 in FIG. 1 is input to the mosaic processing unit 101 . The mosaic processing unit 101 generates three-color signals of R, G, and B from signals from each pixel. The linear matrix processing unit 102 performs spectral characteristic correction on the signal generated by the mosaic processing unit 101 .

伽玛修正处理部103对已完成分光特性修正的信号实施伽玛修正。如上所述,存储部22中,保持有与拍摄图像的清晰度的电平对应的多个伽玛修正值。对于伽玛修正处理部103,应用与拍摄图像的清晰度对应的伽玛修正值。伽玛修正处理部103利用所应用的伽玛修正值对来自线性矩阵处理部102的信号实施伽玛修正。The gamma correction processing unit 103 performs gamma correction on the signal whose spectral characteristics have been corrected. As described above, the storage unit 22 holds a plurality of gamma correction values corresponding to the level of sharpness of captured images. The gamma correction processing unit 103 applies a gamma correction value corresponding to the sharpness of the captured image. The gamma correction processing unit 103 performs gamma correction on the signal from the linear matrix processing unit 102 using the applied gamma correction value.

Y/C分离处理部104将已实施伽玛修正的信号分离为亮度信号与色差信号。轮廓修正处理部105根据马赛克处理后的信号而选取被拍摄体的轮廓,对Y/C分离后的亮度信号施加轮廓信号。色差修正处理部106对Y/C分离后的色差信号实施强调特定颜色等的修正处理。噪声去除处理部107、108分别去除与Y/C分离后的亮度信号及色差信号重叠的噪声。已去除噪声的亮度信号及色差信号被输出至图1的输出部26。输出部26将亮度信号与色差信号进行串行转换后输出至外部。The Y/C separation processing unit 104 separates the gamma-corrected signal into a luminance signal and a color difference signal. The contour correction processing unit 105 extracts the contour of the subject from the mosaic-processed signal, and adds the contour signal to the Y/C separated luminance signal. The color difference correction processing unit 106 performs correction processing such as emphasizing a specific color on the Y/C separated color difference signal. The noise removal processing units 107 and 108 remove noise superimposed on the Y/C-separated luminance signal and color difference signal, respectively. The noise-removed luminance signal and color difference signal are output to the output unit 26 in FIG. 1 . The output unit 26 serially converts the luminance signal and the color difference signal and outputs it to the outside.

其次,参照图3(a)~图6(b),对图像处理部21的清晰化处理进行说明。此外,这里为方便起见,将交叉路口或街道以外的风景作为被拍摄体。Next, the sharpening processing by the image processing unit 21 will be described with reference to FIGS. 3( a ) to 6 ( b ). In addition, here, for the sake of convenience, the scenery other than the intersection or the street is taken as the subject.

图3(a)~(d)是表示实施方式的拍摄图像的状况与亮度的直方图的关系的一例的图。图3(b)是针对图3(a)的拍摄图像的直方图,图3(d)是针对图3(c)的拍摄图像的直方图。此外,图3(a)、(c)实际上是彩色的图像。也就是说,图像中的马赛克磁砖与玩偶带有各种颜色。另外,图3(c)的拍摄图像是将雾镜(foggy filter)插入至摄像光学系统中所拍摄的。3( a ) to ( d ) are diagrams showing an example of the relationship between the state of the captured image and the histogram of brightness in the embodiment. FIG. 3( b ) is a histogram for the captured image of FIG. 3( a ), and FIG. 3( d ) is a histogram for the captured image of FIG. 3( c ). In addition, Fig. 3 (a), (c) is actually a color image. That is, the mosaic tiles and dolls in the image come in various colors. In addition, the captured image in FIG. 3( c ) was captured by inserting a foggy filter into the imaging optical system.

如图3(b)、(d)所示,即使被拍摄体相同,直方图上的亮度分布范围(R1、R2)也会根据拍摄图像的清晰度而变化。具体来说,拍摄图像不清晰的情况下的分布范围R2比拍摄图像清晰的情况下的分布范围R1窄。如此,拍摄图像的清晰度(对比度)越降低,亮度分布范围越狭窄。因此,能够根据亮度的分布范围而检测出拍摄图像的清晰度。As shown in FIG. 3( b ) and ( d ), even if the subject is the same, the brightness distribution range ( R1 , R2 ) on the histogram changes according to the sharpness of the captured image. Specifically, the distribution range R2 when the captured image is unclear is narrower than the distribution range R1 when the captured image is clear. In this way, the lower the sharpness (contrast) of the captured image is, the narrower the luminance distribution range becomes. Therefore, the sharpness of a captured image can be detected from the distribution range of brightness.

此外,用以判定拍摄图像的清晰度的信息并不限定于亮度的直方图。例如,也可使用自动光圈的统计数据等来判定拍摄图像的清晰度。In addition, the information for determining the sharpness of a captured image is not limited to the brightness histogram. For example, the sharpness of the captured image may be determined using statistical data of the auto iris or the like.

图4(a)~(d)是说明拍摄图像的对比度的修正方法(清晰化处理)的图。图4(a)、(c)分别是图3(b)、(d)所示的直方图,且与图3(a)、(c)的拍摄图像的直方图对应。另外,图4(b)、(d)分别是示意性地表示亮度的直方图为图4(a)、(b)的情况下的伽玛修正值(伽玛特性)的曲线图。在图4(a)、(b)中,横轴是输入信号的信号电平,纵轴是伽玛修正后的输出信号的信号电平。4( a ) to ( d ) are diagrams illustrating a method of correcting the contrast of a captured image (sharpening processing). 4( a ), ( c ) are the histograms shown in FIGS. 3( b ) and ( d ), respectively, and correspond to the histograms of the captured images in FIGS. 3( a ) and (c). 4( b ) and ( d ) are graphs schematically showing gamma correction values (gamma characteristics) when the brightness histograms are shown in FIG. 4( a ) and (b), respectively. In FIGS. 4( a ) and ( b ), the horizontal axis represents the signal level of the input signal, and the vertical axis represents the signal level of the output signal after gamma correction.

如图4(a)所示,当直方图中的亮度分布范围R1宽的情况下,使用图4(b)所示的通常的伽玛修正值进行伽玛修正。另一方面,如图4(c)所示,当直方图中的亮度分布范围R2窄的情况下,使用用以提高图4(d)所示的对比度的伽玛修正值进行伽玛修正。As shown in FIG. 4( a ), when the luminance distribution range R1 in the histogram is wide, gamma correction is performed using the normal gamma correction value shown in FIG. 4( b ). On the other hand, as shown in FIG. 4( c ), when the brightness distribution range R2 in the histogram is narrow, gamma correction is performed using a gamma correction value for improving the contrast shown in FIG. 4( d ).

图4(d)的伽玛修正值中,将信号电平低于范围W之输入信号一律转换为最低电平的输出信号。另外,将信号电平高于范围W的输入信号一律转换为最高电平的输出信号。因此,将黑附近的灰的输入信号一律转换为黑,将白附近的灰的输入信号一律转换为白。由此,图像的对比度提高。In the gamma correction value of FIG. 4( d ), the input signals whose signal level is lower than the range W are uniformly converted to the output signal of the lowest level. In addition, input signals whose signal levels are higher than the range W are uniformly converted into output signals of the highest level. Therefore, gray input signals near black are uniformly converted to black, and gray input signals near white are uniformly converted to white. Thereby, the contrast of an image improves.

图5(a)、(b)是表示使伽玛值(伽玛特性)变化的情况下的亮度的直方图的变化的图。在图5(a)中,虚线是伽玛值为0.45的情况下的通常的伽玛修正中使用的伽玛特性,实线是拍摄图像的清晰度(对比度)低的情况下应用的伽玛特性。图5(a)中,纵轴与横轴是以1标准化。另外,在图5(b)中,虚线是对特定的拍摄图像应用图5(a)的伽玛值为0.45的虚线的伽玛特性的情况下的直方图,实线是对同一拍摄图像应用图5(a)的低对比度用的实线的伽玛特性的情况下的直方图。5( a ) and ( b ) are diagrams showing changes in the brightness histogram when the gamma value (gamma characteristic) is changed. In Fig. 5(a), the dotted line is the gamma characteristic used in normal gamma correction when the gamma value is 0.45, and the solid line is the gamma applied when the sharpness (contrast) of the captured image is low characteristic. In Fig. 5(a), the vertical and horizontal axes are normalized to 1. In addition, in FIG. 5(b), the dotted line is a histogram when the gamma characteristic of the dotted line with a gamma value of 0.45 in FIG. 5(a) is applied to a specific captured image, and the solid line is a histogram when applying FIG. 5( a ) is a histogram in the case of the gamma characteristic of the solid line for low contrast.

如图5(b)所示,如果应用低对比度用的伽玛特性进行伽玛修正,那么修正后的拍摄图像的直方图与修正前相比,亮度分布范围显著扩大。也就是说,能够通过对清晰度低的低对比度的拍摄图像应用图5(a)的低对比度用的伽玛特性进行伽玛修正来提高图像的清晰度(对比度)。As shown in FIG. 5( b ), when gamma correction is performed using the gamma characteristic for low contrast, the histogram of the captured image after correction has a significantly wider brightness distribution range than before correction. That is, it is possible to improve the sharpness (contrast) of an image by performing gamma correction by applying the gamma characteristic for low contrast of FIG.

如上所述,能够通过选择要应用的伽玛修正值来提高拍摄图像的对比度。图1的图像处理部21在拍摄图像的清晰度(对比度)低的情况下,通过变更图2的伽玛修正处理部103中应用的伽玛值(伽玛特性)来提高拍摄图像的对比度。As described above, it is possible to improve the contrast of a captured image by selecting the gamma correction value to be applied. The image processing unit 21 of FIG. 1 improves the contrast of the captured image by changing the gamma value (gamma characteristic) applied by the gamma correction processing unit 103 of FIG. 2 when the sharpness (contrast) of the captured image is low.

更详细来说,图1的存储部22将拍摄图像的清晰度低的情况下应用的伽玛值(伽玛特性)与清晰度高的情况下的通常的伽玛值(伽玛特性)一起存储。图像处理部21在由摄像元件14所拍摄的拍摄图像的清晰度(对比度)低的情况下,从存储部22选择适于该拍摄图像的清晰度的伽玛值,且将所选择的伽玛值应用于图2的伽玛修正处理部103。由此,能够提高拍摄图像的清晰度。More specifically, the storage unit 22 in FIG. 1 stores the gamma value (gamma characteristic) applied when the resolution of the captured image is low and the normal gamma value (gamma characteristic) when the resolution is high. storage. The image processing unit 21 selects a gamma value suitable for the sharpness of the captured image from the storage unit 22 when the resolution (contrast) of the captured image captured by the imaging element 14 is low, and sets the selected gamma value to The value is applied to the gamma correction processing unit 103 in FIG. 2 . Thereby, the sharpness of a captured image can be improved.

这里,拍摄图像的清晰度是否低,能根据如图3(a)~(d)所示的亮度分布的直方图来判定。Here, whether or not the sharpness of the captured image is low can be determined from the histograms of the luminance distribution as shown in FIGS. 3( a ) to ( d ).

然而,根据拍摄图像而有以下情况:尽管清晰度并未降低,但因被拍摄体的布局等而使直方图的亮度分布范围窄。例如,图6(a)所示的拍摄图像(实际上是彩色图像)的直方图如图6(b)。该直方图中,尽管拍摄图像清晰,但亮度分布范围R3窄。这种情况下,如果应用低对比度用的伽玛值,那么拍摄图像的清晰度反而会降低。However, depending on the captured image, there are cases where the brightness distribution range of the histogram is narrowed due to the layout of the subject, etc., although the sharpness does not decrease. For example, the histogram of the captured image (actually a color image) shown in Fig. 6(a) is shown in Fig. 6(b). In this histogram, although the captured image is clear, the luminance distribution range R3 is narrow. In this case, if the gamma value for low contrast is applied, the sharpness of the captured image will be reduced instead.

因此,本实施方式中,进行用以抑制对不清晰的拍摄图像自动修正的情况下的误动作的处理。Therefore, in the present embodiment, processing for suppressing malfunctions in the case of automatically correcting an unclear captured image is performed.

图7是表示由图像处理部21进行的清晰化处理的流程图。FIG. 7 is a flowchart showing sharpening processing performed by the image processing unit 21 .

在图7的流程图中,作为表示拍摄图像的清晰度的参数,使用亮度的直方图(例如参照图3(b)、(d))的标准偏差σ。另外,在图1的存储部22中,除存储有在通常的清晰度的情况下应用的伽玛值G3之外,还存储有在清晰度低的情况下应用的两种伽玛值G1、G2。In the flowchart of FIG. 7 , the standard deviation σ of a brightness histogram (for example, see FIGS. 3( b ), ( d ) ) is used as a parameter indicating the sharpness of a captured image. In addition, the storage unit 22 in FIG. 1 stores two gamma values G1, G1, G2.

进而,在图7的流程图中,在处理开始之前或者开始之后,能由用户经由图1所示的输入部25而进行清晰化处理的模式设定。这里,将根据拍摄目标区域所获得的拍摄图像而设定标准偏差的基准值σRef的模式称为预设接通模式,将预先保持在存储部22的通用的标准偏差σ0设定为基准值σRef的模式称为预设断开模式。标准偏差σ0例如是以清晰的状态拍摄标准的风景所获得的拍摄图像的亮度直方图的标准偏差。Furthermore, in the flowchart of FIG. 7 , the mode setting of the sharpening process can be performed by the user via the input unit 25 shown in FIG. 1 before or after the process starts. Here, the mode in which the reference value σRef of the standard deviation is set based on the photographed image obtained by photographing the target area is referred to as the preset ON mode, and the general-purpose standard deviation σ0 held in advance in the storage unit 22 is set as the reference value σRef. mode is called preset disconnect mode. The standard deviation σ0 is, for example, the standard deviation of the brightness histogram of a captured image obtained by capturing a standard landscape in a clear state.

参照图7,如果对摄像装置1接通电源且完成初始化处理,那么图像处理部21开始摄像动作。如此,在开始摄像动作之后,图像处理部21判定是否为垂直同步信号(Vsync)的输出时点(S101)。当为垂直同步信号的输出时点的情况下(S101:YES(是)),图像处理部21执行自动光圈处理(S102)与自动白平衡处理(S103)。进而,图像处理部21根据从摄像元件14输出的信号而算出拍摄图像的亮度直方图的标准偏差σ(S104)。Referring to FIG. 7 , when the imaging device 1 is powered on and the initialization process is completed, the image processing unit 21 starts the imaging operation. In this way, after the imaging operation is started, the image processing unit 21 determines whether or not it is the output timing of the vertical synchronization signal (Vsync) ( S101 ). When the vertical synchronization signal is output (S101: YES), the image processing unit 21 executes automatic iris processing (S102) and automatic white balance processing (S103). Furthermore, the image processing unit 21 calculates the standard deviation σ of the luminance histogram of the captured image based on the signal output from the imaging element 14 ( S104 ).

随后,图像处理部21判定摄像装置1中设定的清晰化处理的模式是否为预设接通模式(S105)。这里,当清晰化处理的模式并非预设接通模式的情况下(S105:NO(否)),图像处理部21将预先存储在存储部22的通用的标准偏差σ0设定为标准偏差的基准值σRef(S108)。Subsequently, the image processing section 21 determines whether or not the mode of the sharpening process set in the imaging device 1 is the preset ON mode (S105). Here, when the mode of the sharpening process is not the preset ON mode (S105: NO), the image processing unit 21 sets the common standard deviation σ0 previously stored in the storage unit 22 as the reference of the standard deviation. Value σRef (S108).

另一方面,当清晰化处理的模式是预设接通模式的情况下(S105:YES),图像处理部21判定在前一个垂直同步信号的输出时点清晰化处理的模式是否为预设断开模式,也就是,清晰化处理的模式是否从预设断开模式切换为预设接通模式(S106)。这里,当在前一个垂直同步信号的输出时点清晰化处理的模式是预设断开模式的情况下(S106:YES),图像处理部21将在步骤S104中算出的标准偏差σ设定为基准值σRef,且将所设定的基准值σRef存储在存储部22(S107)。On the other hand, when the mode of the sharpening processing is the preset ON mode (S105: YES), the image processing unit 21 determines whether the mode of the sharpening processing is the preset OFF mode at the output timing of the previous vertical synchronizing signal. On mode, that is, whether the mode of the clearing processing is switched from the preset off mode to the preset on mode (S106). Here, when the mode of the sharpening process at the previous output timing of the vertical synchronizing signal is the preset off mode (S106: YES), the image processing unit 21 sets the standard deviation σ calculated in step S104 to The reference value σRef is set, and the set reference value σRef is stored in the storage unit 22 (S107).

另外,当在前一个垂直同步信号的输出时点清晰化处理的模式也是预设接通模式的情况下(S106:NO),也就是,当预设接通模式是从前一次继续中的情况下,图像处理部21跳过步骤S107,将处理前进至步骤S109。该情况下,至少在前一次以前的垂直同步信号的输出时点,对基准值σRef设定基于在该时点所取得的拍摄图像的标准偏差σ,且该基准值在本次的垂直同步信号的输出时点也有效。In addition, when the mode of the sharpening process at the output timing of the previous vertical synchronizing signal is also the preset ON mode (S106: NO), that is, when the preset ON mode is in continuation from the previous time , the image processing unit 21 skips step S107, and proceeds to step S109. In this case, at least at the previous output timing of the vertical synchronization signal, a standard deviation σ based on the captured image obtained at that timing is set to the reference value σRef, and the reference value is set at the output timing of the current vertical synchronization signal. The output timing of is also valid.

随后,图像处理部21将基准值σRef除以在步骤S104中所取得的标准偏差σ,取得参照值(S109)。如此算出的参照值当步骤S104中取得的标准偏差σ与基准值σRef相比越小时则越大。也就是说,本次取得的针对拍摄图像的亮度直方图的亮度分布范围与对应于基准值σRef的亮度直方图的亮度分布范围相比越窄,则参照值越大。因此,参照值越大,则能评估本次取得的拍摄图像的清晰度越低。Next, the image processing unit 21 divides the reference value σRef by the standard deviation σ obtained in step S104 to obtain a reference value (S109). The reference value thus calculated becomes larger as the standard deviation σ acquired in step S104 is smaller than the reference value σRef. That is, the narrower the luminance distribution range of the luminance histogram obtained this time for the captured image is compared with the luminance distribution range of the luminance histogram corresponding to the reference value σRef, the larger the reference value. Therefore, the larger the reference value, the lower the sharpness of the captured image obtained this time can be estimated.

如此算出参照值之后,图像处理部21将预先设定的阈值Th1、Th2(Th1>Th2)与参照值进行比较(S110、S112)。这里,如果参照值大于阈值Th1(S110:YES),那么图像处理部21将存储在存储部22中的低清晰度用的伽玛值G1应用于图2的伽玛修正处理部103(S111)。另外,如果参照值为阈值Th1以下且大于阈值Th2(S110:NO,S112:YES),那么图像处理部21将存储在存储部22中的低清晰度用的伽玛值G2应用于图2的伽玛修正处理部103(S113)。另外,当参照值为阈值Th2以下的情况下(S110:NO,S112:NO),图像处理部21将存储在存储部22中的通常的清晰度用的伽玛值G3应用于图2的伽玛修正处理部103(S114)。图2的伽玛修正处理部103根据如此应用的伽玛值来执行伽玛修正。After the reference value is calculated in this way, the image processing unit 21 compares the preset thresholds Th1 and Th2 (Th1>Th2) with the reference value (S110, S112). Here, if the reference value is larger than the threshold Th1 (S110: YES), the image processing unit 21 applies the gamma value G1 for low-resolution stored in the storage unit 22 to the gamma correction processing unit 103 of FIG. 2 (S111). . Also, if the reference value is equal to or less than the threshold Th1 and greater than the threshold Th2 (S110: NO, S112: YES), the image processing unit 21 applies the low-resolution gamma value G2 stored in the storage unit 22 to the The gamma correction processing unit 103 (S113). Also, when the reference value is equal to or less than the threshold Th2 (S110: NO, S112: NO), the image processing unit 21 applies the normal sharpness gamma value G3 stored in the storage unit 22 to the gamma value G3 in FIG. 2 . The MA correction processing unit 103 (S114). The gamma correction processing section 103 of FIG. 2 performs gamma correction based on the thus applied gamma value.

然后,图像处理部21判定垂直同步信号的输出时点是否结束(S115)。如果垂直同步信号的输出时点结束(S115:YES),那么图像处理部21将处理返回至步骤S101,等待下一个垂直同步信号的输出时点的到来(S101)。继而,如果下一个垂直同步信号的输出时点到来(S101:YES),那么图像处理部21再次执行S102以后的处理。该处理在摄像装置1的电源被阻断之前反复执行。Then, the image processing unit 21 determines whether or not the output timing of the vertical synchronization signal has ended (S115). When the output timing of the vertical synchronization signal ends (S115: YES), the image processing unit 21 returns the process to step S101, and waits for the next output timing of the vertical synchronization signal to arrive (S101). Then, when the next output timing of the vertical synchronization signal comes (S101: YES), the image processing unit 21 executes the processing after S102 again. This process is repeatedly executed until the power of the imaging device 1 is turned off.

图8是示意性地表示伽玛值G1、G2、G3的伽玛特性的图。FIG. 8 is a diagram schematically showing gamma characteristics of gamma values G1 , G2 , and G3 .

如图8所示,伽玛值G2被设定为,相对于伽玛值G3将输入信号的低电平侧的范围W2修正为零电平的输出信号,且与伽玛值G3相比,输入信号的高电平侧更快地接近最大电平。另外,伽玛值G1被设定为,输入侧的范围W1与伽玛值G2的范围W2相比扩大,且与伽玛值G2相比,输入信号的高电平侧更快地接近最大电平。As shown in FIG. 8, the gamma value G2 is set so as to correct the range W2 on the low-level side of the input signal to a zero-level output signal with respect to the gamma value G3, and compared with the gamma value G3, The high side of the input signal approaches the maximum level more quickly. In addition, the gamma value G1 is set so that the range W1 on the input side is wider than the range W2 of the gamma value G2, and the high-level side of the input signal approaches the maximum voltage faster than the gamma value G2. flat.

通过如此设定伽玛值G1、G2,而像参照图5(a)、(b)所说明的那样,在应用伽玛值G2进行伽玛修正的情况下,与应用通常的伽玛值G3进行伽玛修正的情况相比,拍摄图像的清晰度(对比度)提高。另外,在应用伽玛值G1进行伽玛修正的情况下,与应用伽玛值G2进行伽玛修正的情况相比,拍摄图像的清晰度(对比度)进一步提高。By setting the gamma values G1 and G2 in this way, as described with reference to FIGS. Compared with the case where gamma correction is performed, the sharpness (contrast) of the captured image is improved. In addition, when the gamma correction is performed using the gamma value G1, the sharpness (contrast) of the captured image is further improved compared to the case where the gamma correction is performed using the gamma value G2.

因此,在图7的步骤S110中,在判定参照值大于阈值Th1,也就是拍摄图像的清晰度降低急遽的情况下,通过将伽玛值G1应用于伽玛修正处理部103(参照图2)来进行伽玛修正,能够有效地进行拍摄图像的清晰化。另外,在图7的步骤S112中,在判定参照值大于阈值Th2,也就是拍摄图像的清晰度降低为中等程度的情况下,通过将伽玛值G2应用于伽玛修正处理部103来进行伽玛修正,能够有效地进行拍摄图像的清晰化而不会对拍摄图像进行过度的清晰化处理。Therefore, in step S110 of FIG. 7 , when it is determined that the reference value is greater than the threshold Th1, that is, the sharpness of the captured image decreases sharply, the gamma correction processing unit 103 (see FIG. 2 ) To perform gamma correction, it can effectively clear the captured image. In addition, in step S112 of FIG. 7 , when it is determined that the reference value is greater than the threshold Th2, that is, the sharpness of the captured image is reduced to a moderate degree, gamma is performed by applying the gamma value G2 to the gamma correction processing unit 103. MA correction can effectively sharpen the captured image without excessive sharpening processing on the captured image.

图9是示意性地表示将摄像装置1设置在交叉路口的情况下的拍摄图像的图。FIG. 9 is a diagram schematically showing captured images when the imaging device 1 is installed at an intersection.

图9(a)表示因雨或雾等的影响而使拍摄图像的清晰度降低的状态。本实施方式中,如上所述,根据参照值的大小、也就是拍摄图像的清晰度降低的电平而应用适当的伽玛值,因此如图9(b),能够改善拍摄图像的清晰度。由此,用户能够根据拍摄图像而准确地确认交通信号灯2、交叉路口3、人4及汽车5的状况。FIG. 9( a ) shows a state in which the sharpness of a captured image is lowered due to the influence of rain, fog, or the like. In the present embodiment, as described above, an appropriate gamma value is applied according to the magnitude of the reference value, that is, the level at which the sharpness of the captured image is lowered. Therefore, as shown in FIG. 9( b ), the sharpness of the captured image can be improved. Thereby, the user can accurately confirm the conditions of the traffic signal 2 , the intersection 3 , the person 4 , and the vehicle 5 from the captured image.

<实施方式的效果><Effects of the implementation>

根据本实施方式,能够发挥以下的效果。According to this embodiment, the following effects can be exhibited.

如图7的步骤S104、S107所示,根据从摄像元件14输入的信号,设定表示拍摄图像的清晰度的参数(亮度直方图的标准偏差)的基准值σRef。因此,所设定的基准值σRef成为与拍摄对象的风景对应的值。例如,如图9(a)、(b)所示,在为了拍摄交叉路口3而设置摄像装置1的情况下,基准值σRef成为与交叉路口3的规模或交通信号灯2的设置状况等目标区域的风景(构造物的布局等)对应的值。继而,根据如此设定的基准值σRef、与此后的摄像时所取得的实测值(标准偏差σ)的差(参照值:σRef/σ),执行对拍摄图像的清晰化处理,因此能够精确地识别拍摄对象的目标区域的不清晰已达到何种程度,能够抑制清晰化处理的误动作。如此,根据本实施方式的摄像装置1,能够抑制在自动修正拍摄图像的不清晰度的情况下的误动作。As shown in steps S104 and S107 of FIG. 7 , a reference value σRef of a parameter (standard deviation of the luminance histogram) indicating the sharpness of a captured image is set based on a signal input from the imaging element 14 . Therefore, the set reference value σRef is a value corresponding to the scenery to be photographed. For example, as shown in FIGS. 9( a ) and ( b ), when an imaging device 1 is installed to photograph an intersection 3 , the reference value σRef becomes the target area corresponding to the scale of the intersection 3 or the installation status of traffic lights 2 . The value corresponding to the scenery (the layout of the structure, etc.). Then, the sharpening process of the captured image is performed based on the difference (reference value: σRef/σ) between the reference value σRef set in this way and the actual measurement value (standard deviation σ) acquired at the time of subsequent imaging, so that it is possible to accurately It is possible to suppress the erroneous operation of the sharpening process by recognizing the degree of blurring of the target area of the subject. In this manner, according to the imaging device 1 of the present embodiment, it is possible to suppress malfunctions when automatically correcting blurring of captured images.

另外,根据本实施方式的摄像装置,根据基准值σRef与实测值(标准偏差σ)的差(参照值:σRef/σ)而适当地进行清晰化处理,因此无需另外执行检测拍摄图像是否变得不清晰的处理。由此,根据本实施方式的摄像装置1,能够通过简单的处理来进行拍摄图像的清晰化。In addition, according to the imaging device of this embodiment, the sharpening process is appropriately performed based on the difference between the reference value σRef and the actual measurement value (standard deviation σ) (reference value: σRef/σ), so it is not necessary to separately perform detection of whether the captured image has become blurred or not. Unclear processing. Thus, according to the imaging device 1 of the present embodiment, it is possible to clear a captured image by simple processing.

另外,本实施方式的摄像装置1以如下方式构成:如图7的步骤S105所示,当由用户经由输入部25而受理了预设接通模式的设定指示的输入的情况下,图像处理部21将根据来自摄像元件14的信号所取得的参数的实测值(标准偏差σ)作为基准值σRef而存储在存储部22。因此,用户通过在目标区域清晰的时点输入预设接通模式的设定指示,能够将基于清晰的拍摄图像的标准偏差σ设定为基准值σRef。由此,能够顺利地避免在目标区域不清晰的时点取得并设定基准值。由此,能够更确实地抑制在对拍摄图像的不清晰度进行自动修正的情况下的误动作。In addition, the imaging device 1 of the present embodiment is configured so that, as shown in step S105 of FIG. The unit 21 stores the actually measured value (standard deviation σ) of the parameter obtained from the signal from the imaging element 14 as a reference value σRef in the storage unit 22 . Therefore, the user can set the standard deviation σ based on a clear captured image as the reference value σRef by inputting an instruction to set the preset on mode when the target area is clear. Accordingly, it is possible to smoothly avoid obtaining and setting a reference value at a time when the target area is unclear. Thereby, it is possible to more reliably suppress malfunctions in the case of automatically correcting the blur of the captured image.

另外,本实施方式的摄像装置1中,在设定基于实测值(标准偏差σ)的基准值σRef之前,预先将通用的基准值σ0存储在存储部22。继而,如图7的步骤S105~S108所示,图像处理部21在设定了预设接通模式的情况下,取得基于实测值的基准值σRef且执行清晰化处理,当未设定预设接通模式的情况下,根据通用的基准值σ0来执行清晰化处理。因此,例如在摄像装置1启动时为阴天的情况等,由于无法获得与基准值σRef的设定相适的清晰的拍摄图像而未设定预设接通模式的情况下,也能够使用通用的基准值σ0来执行清晰化处理。In addition, in the imaging device 1 of the present embodiment, before setting the reference value σRef based on the actual measurement value (standard deviation σ), the common reference value σ0 is stored in the storage unit 22 in advance. Next, as shown in steps S105 to S108 of FIG. 7 , when the preset ON mode is set, the image processing unit 21 acquires the reference value σRef based on the actual measurement value and performs sharpening processing. In the ON mode, clearing processing is performed based on a common reference value σ0. Therefore, for example, when the image pickup device 1 is started on a cloudy day, etc., and a clear captured image suitable for the setting of the reference value σRef cannot be obtained and the preset on-mode is not set, the general-purpose switch can also be used. The base value σ0 of σ is used to perform the sharpening process.

另外,本实施方式的摄像装置1中,构成为如图7的步骤S110~S114所示,根据参照值的大小来切换用以使拍摄图像清晰化的调整值(伽玛值G1~G3),因此能够通过简易的处理将拍摄图像的对比度顺利地调整为适于清晰化的状态。In addition, in the imaging device 1 of the present embodiment, as shown in steps S110 to S114 of FIG. Therefore, the contrast of the captured image can be smoothly adjusted to a state suitable for sharpening by simple processing.

此外,本实施方式的摄像装置1中,作为表示拍摄图像的清晰度的参数,使用从自摄像元件14输出的一图像的信号所取得的亮度标准偏差σ,因此像参照图3(a)、(b)所说明的那样,能够准确地掌握拍摄图像的不清晰度。In addition, in the imaging device 1 of the present embodiment, as a parameter indicating the sharpness of the captured image, the brightness standard deviation σ obtained from the signal of one image output from the imaging element 14 is used. As described in (b), the blurriness of the captured image can be accurately grasped.

<变更例><Modification example>

在所述实施方式中,通过调整伽玛修正处理部103中应用的伽玛值来进行拍摄图像的清晰化,但拍摄图像的清晰化处理并不限于此。例如,在搭载用以进行清晰化的清晰化处理引擎的摄像装置中,也可通过调整清晰化处理引擎中设定的参数值来进行拍摄图像的清晰化。In the above-described embodiment, the sharpening of the captured image is performed by adjusting the gamma value applied by the gamma correction processing unit 103 , but the sharpening process of the captured image is not limited to this. For example, in an imaging device equipped with a sharpening engine for sharpening, it is also possible to sharpen captured images by adjusting parameter values set in the sharpening engine.

另外,在所述实施方式中,准备两个伽玛值G1、G2以用于清晰度低的拍摄图像的修正,但用于清晰化处理的伽玛值的种类并不限于此。例如,在图7的流程图中,也可将与参照值比较的阈值设定为三个以上,且将用于清晰化处理的伽玛值设定为三个以上。如此一来,能够实现更准确的清晰化处理。或者也能够将阈值设为一个,且将伽玛值设为一个。In addition, in the above-described embodiment, two gamma values G1 and G2 are prepared for correction of a low-resolution captured image, but the types of gamma values used for sharpening processing are not limited thereto. For example, in the flowchart of FIG. 7 , three or more threshold values for comparison with the reference value may be set, and three or more gamma values for sharpening processing may be set. In this way, more accurate sharpening processing can be realized. Alternatively, it is also possible to set one threshold value and one gamma value.

另外,在所述实施方式中,将参照值设为基准值σRef与实测值(标准偏差σ)的比,但参照值并不限于此,只要是表示实测值与基准值相差多少的值,便可以是任意值。例如,也可将从基准值σRef减去实测值(标准偏差σ)所得的值用作参照值。In addition, in the above-mentioned embodiment, the reference value is set as the ratio of the reference value σRef to the actual measurement value (standard deviation σ), but the reference value is not limited to this, as long as it is a value indicating how much the actual measurement value differs from the reference value, it can be used. Can be any value. For example, a value obtained by subtracting an actual measurement value (standard deviation σ) from a reference value σRef may be used as a reference value.

另外,在所述实施方式中,作为表示拍摄图像的清晰度的参数,使用亮度直方图的方差,但表示拍摄图像的清晰度的参数并不限于此。另外,表示拍摄图像的清晰度的参数并非必须限于一种,也可组合两种以上的参数来判定拍摄图像的清晰度。In addition, in the above-described embodiment, the variance of the luminance histogram is used as the parameter indicating the sharpness of the captured image, but the parameter indicating the sharpness of the captured image is not limited to this. In addition, the parameter indicating the sharpness of the captured image is not necessarily limited to one type, and two or more parameters may be combined to determine the sharpness of the captured image.

另外,在所述实施方式中,与垂直同步信号同步地进行用于清晰化处理的值(伽玛值)的更新,但进行该更新的时点并不限于此。例如,也可每隔特定的时间(例如,数秒~数十秒)进行用于清晰化处理的值的更新,或者可在根据日期时间与照度而检测出天气变化的时点进行该更新。In addition, in the above-described embodiment, the update of the value (gamma value) used for the sharpening process is performed in synchronization with the vertical synchronization signal, but the timing of performing this update is not limited to this. For example, the update of the value used for the sharpening process may be performed every specific time (for example, several seconds to several tens of seconds), or may be performed when a weather change is detected based on date and illuminance.

另外,摄像装置1的模块构成并不限于图1所示的构成,而是能够进行各种变更。另外,图像处理部21也可由硬件(电路)构成,或者也可由软件构成。另外,摄像装置1除用于拍摄街道或交叉路口的监控相机之外,还可用于各种用途。In addition, the block configuration of the imaging device 1 is not limited to the configuration shown in FIG. 1 , and various changes can be made. In addition, the image processing unit 21 may be constituted by hardware (circuit), or may be constituted by software. In addition, the imaging device 1 can be used for various purposes other than a monitoring camera for photographing a street or an intersection.

此外,本发明的实施方式在权利要求书所示的技术思想的范畴内,能够适当地进行各种变更。In addition, the embodiments of the present invention can be appropriately modified in various ways within the scope of the technical idea shown in the claims.

符号的说明Explanation of symbols

1 摄像装置1 Camera

10 摄像部10 camera department

21 图像处理部21 Image Processing Department

22 存储部22 Storage

Claims (6)

1.一种摄像装置,其特征在于具备:1. A camera, characterized in that: 摄像部,使来自目标区域的光在摄像元件成像;The imaging unit is used to image the light from the target area on the imaging element; 图像处理部,对从所述摄像元件输出的信号进行处理且输出影像信息;以及an image processing unit that processes a signal output from the imaging element and outputs image information; and 存储部,存储表示拍摄图像的清晰度的特定的参数的基准值;a storage unit storing a reference value of a specific parameter indicating the sharpness of the captured image; 所述图像处理部根据从所述摄像元件输入的信号而取得所述参数的实测值,且将在特定的时点取得的实测值作为所述基准值而存储在所述存储部,根据之后取得的实测值与存储在所述存储部的基准值的差,执行对拍摄图像的清晰化处理。The image processing unit acquires the actual measurement value of the parameter based on the signal input from the imaging element, and stores the actual measurement value acquired at a specific point of time as the reference value in the storage unit, and then obtains the parameter based on The difference between the actual measured value and the reference value stored in the storage unit is used to perform sharpening processing on the captured image. 2.根据权利要求1所述的摄像装置,其特征在于:2. The imaging device according to claim 1, characterized in that: 所述图像处理部在受理设定指示的输入的情况下,将根据来自所述摄像元件的信号所取得的所述参数的实测值作为所述基准值而存储在所述存储部。The image processing unit stores, as the reference value, an actually measured value of the parameter obtained from a signal from the imaging element in the storage unit when receiving an input of a setting instruction. 3.根据权利要求1或2所述的摄像装置,其特征在于:3. The imaging device according to claim 1 or 2, characterized in that: 所述存储部是与基于实测值的第1基准值分开地预先存储第2基准值,The storage unit previously stores a second reference value separately from a first reference value based on an actual measurement value, 所述图像处理部在设定了使用基于实测值的所述第1基准值的模式的情况下,根据实测值而取得所述第1基准值且执行所述清晰化处理,在未设定所述模式的情况下,根据所述第2基准值而执行所述清晰化处理。The image processing unit acquires the first reference value based on an actual measurement value and executes the sharpening process when a mode using the first reference value based on an actual measurement value is set, and when the first reference value based on an actual measurement value is not set. In the case of the above mode, the sharpening process is executed based on the second reference value. 4.根据权利要求1至3中任一项所述的摄像装置,其特征在于:4. The imaging device according to any one of claims 1 to 3, characterized in that: 所述图像处理部根据所述实测值与所述基准值的差而切换用以使拍摄图像清晰化的调整值。The image processing unit switches an adjustment value for sharpening a captured image according to a difference between the actual measurement value and the reference value. 5.根据权利要求4所述的摄像装置,其特征在于:5. The imaging device according to claim 4, characterized in that: 所述调整值是用以对从所述摄像元件输出的信号进行伽玛修正的值。The adjustment value is a value for performing gamma correction on a signal output from the imaging element. 6.根据权利要求1至5中任一项所述的摄像装置,其特征在于:6. The imaging device according to any one of claims 1 to 5, characterized in that: 表示拍摄图像的清晰度的所述参数是从自所述摄像元件输出的一图像的信号所取得的亮度的标准偏差。The parameter representing the sharpness of a captured image is a standard deviation of brightness obtained from a signal of an image output from the imaging element.
CN201610602503.5A 2015-09-14 2016-07-27 Imaging apparatus Pending CN106534663A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015-181214 2015-09-14
JP2015181214A JP2017059905A (en) 2015-09-14 2015-09-14 Imaging device

Publications (1)

Publication Number Publication Date
CN106534663A true CN106534663A (en) 2017-03-22

Family

ID=58344283

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610602503.5A Pending CN106534663A (en) 2015-09-14 2016-07-27 Imaging apparatus

Country Status (4)

Country Link
JP (1) JP2017059905A (en)
KR (1) KR20170032158A (en)
CN (1) CN106534663A (en)
TW (1) TW201711442A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108932847A (en) * 2017-05-23 2018-12-04 杭州海康威视数字技术股份有限公司 A kind of method and device acquiring signal lamp image
CN115118852A (en) * 2018-02-23 2022-09-27 欧姆龙株式会社 Image sensor with a plurality of pixels

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6227266B2 (en) 2013-03-27 2017-11-08 株式会社日立国際電気 Monitoring system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108932847A (en) * 2017-05-23 2018-12-04 杭州海康威视数字技术股份有限公司 A kind of method and device acquiring signal lamp image
CN108932847B (en) * 2017-05-23 2020-08-28 杭州海康威视数字技术股份有限公司 Method and device for collecting signal lamp image
CN115118852A (en) * 2018-02-23 2022-09-27 欧姆龙株式会社 Image sensor with a plurality of pixels

Also Published As

Publication number Publication date
TW201711442A (en) 2017-03-16
KR20170032158A (en) 2017-03-22
JP2017059905A (en) 2017-03-23

Similar Documents

Publication Publication Date Title
KR101747603B1 (en) Color night vision system and operation method thereof
JP6029954B2 (en) Imaging device
KR101367637B1 (en) Monitoring device
US7262804B2 (en) Autofocus camera adjusting focus lens position based on illumination characteristics
JP2016126750A (en) Image processing system, image processing device, imaging device, image processing method, program, and recording medium
JP4523629B2 (en) Imaging device
JP2003219254A (en) Camera with shooting mode switching function
JP6230265B2 (en) Imaging device
CN113126252B (en) Low-light-level imaging system
CN106534663A (en) Imaging apparatus
CN106534664A (en) Imaging apparatus
JP2012010282A (en) Imaging device, exposure control method, and exposure control program
WO2015141860A1 (en) Image processing apparatus, imaging apparatus, image processing program, and image processing method
CN112770021B (en) Camera and filter switching method
US20210168345A1 (en) Image processing device, image processing method, program, and imaging device
JP2012095223A (en) Imaging device, imaging method, and program
JP2012008845A (en) Image processor
JP6561479B2 (en) Imaging device capable of color shading correction
JP2008153834A (en) Image processing apparatus
KR101691043B1 (en) Closed circuit television camera for color image at night using infrared light
EP3389257A1 (en) Method for adapting brightness of image data, image capturing system and advanced driver assistance system
JP4281134B2 (en) Digital camera
CN112135012B (en) Image acquisition device and image acquisition method
JP2016200742A (en) Imaging apparatus
CN114299465A (en) Obstacle sensing method, device, equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170322