[go: up one dir, main page]

CN107408202A - Method and system for detecting ambient light - Google Patents

Method and system for detecting ambient light Download PDF

Info

Publication number
CN107408202A
CN107408202A CN201680013346.2A CN201680013346A CN107408202A CN 107408202 A CN107408202 A CN 107408202A CN 201680013346 A CN201680013346 A CN 201680013346A CN 107408202 A CN107408202 A CN 107408202A
Authority
CN
China
Prior art keywords
predetermined
threshold
ambient light
less
tunnel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201680013346.2A
Other languages
Chinese (zh)
Other versions
CN107408202B (en
Inventor
史密塔·奈尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
KPIT Technologies Ltd
Original Assignee
KPIT Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by KPIT Technologies Ltd filed Critical KPIT Technologies Ltd
Publication of CN107408202A publication Critical patent/CN107408202A/en
Application granted granted Critical
Publication of CN107408202B publication Critical patent/CN107408202B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/50Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/56Extraction of image or video features relating to colour

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Photometry And Measurement Of Optical Pulse Characteristics (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Traffic Control Systems (AREA)
  • Facsimile Image Signal Circuits (AREA)

Abstract

The invention discloses a method and a system for detecting ambient light. The method includes capturing one or more viewable images by an image capture device, converting a color of each captured image to a gray color, determining a histogram for each gray captured image, calculating an average frequency average and a data average for the determined histograms, and at least one comparing the average frequency average to a predetermined FM threshold and the data average to a predetermined DM threshold for detecting ambient light.

Description

用于检测环境光的方法和系统Method and system for detecting ambient light

发明领域field of invention

本发明领域通常涉及环境光检测,更具体地涉及车辆的环境光检测。The field of the invention relates generally to ambient light detection, and more particularly to ambient light detection for vehicles.

发明背景Background of the invention

现有车辆使用多个传感器用于各种功能,例如用于检测环境光、位置、距离、速度等。除了增加解决方案的复杂性和结构外,多个传感器还增加了用于检测环境光的系统的总体成本。Existing vehicles use multiple sensors for various functions, such as for detecting ambient light, location, distance, speed, etc. In addition to adding to the complexity and structure of the solution, multiple sensors add to the overall cost of the system used to detect ambient light.

在必须感测环境光的各种应用中,环境光感测都是需要的。例如,对于汽车应用,在高端车辆中,环境光传感器用于调节仪表盘的背光强度或GPS设备或DVD屏幕的LCD背光。此外,在各种场景下环境光需要检测,例如当车辆进入隧道时,在桥梁下/树冠下等。另外,基于感测到的环境光,环境光感测需要从日到夜自动调整摄像机模式。Ambient light sensing is required in a variety of applications where ambient light must be sensed. For example, for automotive applications, in high-end vehicles, ambient light sensors are used to adjust the backlight intensity of the instrument cluster or the LCD backlight of GPS devices or DVD screens. In addition, ambient light needs to be detected in various scenarios, such as when a vehicle enters a tunnel, under a bridge/under a tree canopy, etc. Additionally, ambient light sensing is required to automatically adjust the camera mode from day to night based on the sensed ambient light.

对于环境光检测,现有系统使用通常用于光检测的光学/光电传感器,如光电二极管或光电晶体管。现有的隧道检测方法通常使用两个环境传感器。第一传感器具有宽视野,而其它传感器具有窄视野。它感测车辆前面的环境光状况。传感器对光的突然变化迅速反应。两个传感器组合来检测环境中的光照量,并自动启动/关闭车大灯。For ambient light detection, existing systems use optical/photoelectric sensors typically used for light detection, such as photodiodes or phototransistors. Existing tunnel detection methods usually use two environmental sensors. The first sensor has a wide field of view, while the other sensors have a narrow field of view. It senses the ambient light conditions in front of the vehicle. The sensor reacts quickly to sudden changes in light. Two sensors combine to detect the amount of light in the environment and automatically turn on/off the headlights.

目前,高端车型中存在环境光传感器。这些传感器基本上是光学传感器,并通常安装在车辆内的挡风玻璃上。传感器跟踪环境中的各种光照水平,并自动启动/关闭车大灯。Currently, ambient light sensors are present in high-end models. These sensors are basically optical sensors and are usually mounted on the windshield inside the vehicle. Sensors track various light levels in the environment and automatically turn on/off the headlights.

然而,现有的系统需要大量的传感器来检测环境光。这增加了成本和系统的复杂性。因此,需要减少检测环境光所需的传感器的数量,并提供经济有效和简单的解决方案。However, existing systems require a large number of sensors to detect ambient light. This increases cost and system complexity. Therefore, there is a need to reduce the number of sensors required to detect ambient light and provide a cost-effective and simple solution.

概述overview

本发明的各实施例公开了一种用于检测环境光的方法和系统。该方法包括捕获一个或多个可视图像,将拍摄的图像转换成灰色图像,确定每个灰色图像的直方图,计算平均频率平均值(FM)和直方图的数据平均值(DM),并且执行以下步骤之一(a)将FM与预定的FM阈值进行比较,当比较的FM大于预定的FM阈值时,检测环境光作为最佳光,(b)将FM与预定的FM阈值比较并且将DM与预定的DM阈值比较,当比较的FM小于预定的FM阈值并且所比较的DM大于预定的DM阈值,检测环境光作为最佳光,以及(c)将FM预定的FM阈值比较并将DM与预定的DM阈值进行比较,并且如果FM小于预定的FM阈值并且DM小于预定的DM阈值,将所识别的感兴趣区域(ROI)的FM与预定的FM阈值进行比较,并且当比较的ROI的FM小于预定的FM阈值时,检测的环境光低于最佳光。Embodiments of the invention disclose a method and system for detecting ambient light. The method includes capturing one or more visual images, converting the captured images into gray images, determining a histogram for each gray image, computing the mean frequency mean (FM) and the data mean (DM) of the histogram, and Perform one of the following steps (a) compare FM with a predetermined FM threshold, and when the compared FM is greater than the predetermined FM threshold, detect ambient light as the best light, (b) compare FM with the predetermined FM threshold and comparing the DM with a predetermined DM threshold, and when the compared FM is less than the predetermined FM threshold and the compared DM is greater than the predetermined DM threshold, detecting ambient light as the best light, and (c) comparing the FM to the predetermined FM threshold and DM Compared with a predetermined FM threshold, and if the FM is less than the predetermined FM threshold and the DM is less than the predetermined DM threshold, the FM of the identified region of interest (ROI) is compared to the predetermined FM threshold, and when the compared ROI's When FM is less than a predetermined FM threshold, the detected ambient light is below optimal light.

根据本文的实施例,该方法还包括确定所识别的感兴趣区域(ROI)的FM:识别捕获图像中的感兴趣区域,以及当FM小于预定的FM阈值,并且当DM值小于预定的DM阈值时,确定所识别的感兴趣区域(ROI)的FM。According to embodiments herein, the method further comprises determining the FM of the identified region of interest (ROI): identifying the ROI in the captured image, and when the FM is less than a predetermined FM threshold, and when the DM value is less than a predetermined DM threshold , determine the FM of the identified region of interest (ROI).

根据本文的实施例,计算确定的直方图的FM,包括:针对预定数量的帧确定所确定的直方图的频率平均值,以及针对预定数量的帧确定FM。According to the embodiments herein, calculating the FM of the determined histogram includes: determining the frequency average value of the determined histogram for a predetermined number of frames, and determining the FM for a predetermined number of frames.

根据本文的实施例,该方法还包括当检测的环境光高于最佳光时,检测为白天时间。此外,当检测到的环境光低于最佳光时,检测为可能进入和离开隧道。According to embodiments herein, the method further comprises detecting time of day when the detected ambient light is higher than optimal light. Furthermore, when the detected ambient light is lower than optimal light, it is detected as possible entering and exiting the tunnel.

根据本文的实施例,该方法还包括基于检测环境光的一个或多个状态来执行预定的控制功能。According to embodiments herein, the method further includes performing a predetermined control function based on detecting one or more states of ambient light.

根据本发明的另一实施例,一种用于检测环境光的系统,包括:适于捕获一个或多个图像的图像捕获装置,以及连接到所述图像捕获装置的处理单元,其配置为执行以下步骤:将每个所拍摄的图像的颜色转换为灰色,确定所述每一个灰色捕获图像的直方图,计算所确定的直方图的平均频率平均值(FM)和数据平均值(DM),并执行以下步骤之一:(a)将FM与预定的FM阈值比较,并且当比较的FM大于预定的FM阈值时,检测环境光作为最佳光,(b)将FM与预定的FM阈值进行比较,将DM与预定的DM阈值进行比较,以及当比较的FM小于预定的FM阈值并且比较的DM大于预定的DM值时,检测环境光作为最佳光,以及(c)将FM与预定的FM阈值进行比较,将DM与预定的DM阈值进行比较,并且当比较的FM小于预定的FM阈值及DM小于预定的DM阈值时,将识别的感兴趣区域(ROI)的FM与预定的FM阈值进行比较,并且当比较的ROI的FM小于预定的FM阈值时,检测环境光为低于最佳光。According to another embodiment of the present invention, a system for detecting ambient light comprises: an image capture device adapted to capture one or more images, and a processing unit connected to the image capture device configured to perform The steps of: converting the color of each captured image to gray, determining a histogram of each gray captured image, calculating the mean frequency mean (FM) and data mean (DM) of the determined histogram, and perform one of the following steps: (a) compare the FM with a predetermined FM threshold, and when the compared FM is greater than the predetermined FM threshold, detect ambient light as the best light, (b) compare the FM with the predetermined FM threshold comparing, comparing the DM with a predetermined DM threshold, and when the compared FM is less than the predetermined FM threshold and the compared DM is greater than the predetermined DM value, detecting ambient light as the best light, and (c) comparing the FM with the predetermined The FM threshold is compared, the DM is compared with a predetermined DM threshold, and when the compared FM is smaller than the predetermined FM threshold and the DM is smaller than the predetermined DM threshold, the FM of the identified region of interest (ROI) is compared with the predetermined FM threshold A comparison is made, and when the FM of the compared ROI is less than a predetermined FM threshold, the ambient light is detected as less than optimal light.

附图简述Brief description of the drawings

以下结合附图对本发明的上述方面和其它特征进行说明,其中:The above-mentioned aspects and other features of the present invention are described below in conjunction with the accompanying drawings, wherein:

图1示出了根据本发明实施例的用于检测环境光的系统的框图。Fig. 1 shows a block diagram of a system for detecting ambient light according to an embodiment of the present invention.

图2是根据本发明的实施例的输入图像和对应的直方图的示意图。Fig. 2 is a schematic diagram of an input image and a corresponding histogram according to an embodiment of the present invention.

图3是根据本发明的实施例的检测环境光状况的方法的流程图。FIG. 3 is a flowchart of a method of detecting ambient light conditions according to an embodiment of the present invention.

图4是根据本发明的实施例的不同的环境光状况和对应的直方图的示意图。Fig. 4 is a schematic diagram of different ambient light conditions and corresponding histograms according to an embodiment of the present invention.

图5a和5b是根据本发明的实施例的具有低对比度图像和良好对比度图像的白天时间状况的示意图。Figures 5a and 5b are schematic illustrations of time of day conditions with low-contrast images and good-contrast images, according to an embodiment of the invention.

图6a和图6b是根据本发明的实施例的当平均频率平均值(FM)较小但数据平均值(DM)高时的白天时间状况的示意图。Figures 6a and 6b are schematic diagrams of daytime time conditions when the average frequency mean (FM) is small but the data mean (DM) is high, according to an embodiment of the present invention.

图7a和7b是根据本发明的实施例的可能的隧道状况的示意图。Figures 7a and 7b are schematic diagrams of possible tunnel situations according to an embodiment of the invention.

图8a是根据本发明的实施例的进入隧道的示意图。Figure 8a is a schematic diagram of an entry tunnel according to an embodiment of the present invention.

图8b是根据本发明的实施例的隧道状况的示意图。Fig. 8b is a schematic diagram of tunnel conditions according to an embodiment of the present invention.

图9a是根据本发明的实施例的离开隧道状况的示意图。Fig. 9a is a schematic diagram of exit tunnel conditions according to an embodiment of the present invention.

图9b是根据本发明的实施例的最终出口隧道状况的示意图。Figure 9b is a schematic diagram of the final egress tunnel condition according to an embodiment of the present invention.

发明详述Detailed description of the invention

现在将参考附图详细描述本发明的实施例。然而,本发明并不限于这些实施例。本发明可以以各种形式进行修改。因此,仅提供本发明的实施例以对本发明的技术人员更清楚地解释本发明。在附图中,相同的附图标记用于表示相同的部件。Embodiments of the present invention will now be described in detail with reference to the accompanying drawings. However, the present invention is not limited to these Examples. The present invention can be modified in various forms. Therefore, the embodiments of the present invention are merely provided to more clearly explain the present invention to those skilled in the art. In the drawings, the same reference numerals are used to denote the same components.

说明书会在实施例的一些位置中指出“一”、“一个”或“一些”。这并不意味着每个这样的指出都是表示相同的实施例,或者该特征仅适用于单个实施例。不同实施例的单个特征也可以组合以提供其他实施例。The specification will refer to "a", "an" or "some" in some places of the examples. This does not mean that each such reference refers to the same embodiment, or that a feature is only applicable to a single embodiment. Single features of different embodiments may also be combined to provide other embodiments.

如本文所使用的,除非另有明确说明,否则单数形式“一”、“一个”和“所述”也旨在包括复数形式。还可以进一步理解为,术语“包含”、“包括”、″包含″和/或″包含″当在本说明书中使用时,指定所述特征、整体、步骤、操作、元件和/或组件的存在,但不排除一个或多个其他特征、整体、步骤、操作、元件、组件和/或其组合的存在或增加。如本文所使用的,术语“和/或”包含一个或多个相关列出的项目的任何和所有组合和设置。As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless expressly stated otherwise. It can be further understood that the terms "comprising", "comprising", "comprises" and/or "comprising" when used in this specification designate the presence of said features, integers, steps, operations, elements and/or components , but does not exclude the existence or addition of one or more other features, integers, steps, operations, elements, components and/or combinations thereof. As used herein, the term "and/or" includes any and all combinations and arrangements of one or more of the associated listed items.

除非另有定义,本文使用的所有术语(包括技术和科学术语)具有与本发明所属领域的普通技术人员通常理解的相同的含义。还将进一步理解,诸如常用词典中定义的术语,应解释为具有与其在相关领域的背景下的含义一致的意义,并且不会以理想化或过度正式的方式解释,除非明确如此定义。在一个实施例中,平均频率平均值可互换地称为FM和FM平均值Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will also be further understood that terms such as those defined in commonly used dictionaries should be construed to have a meaning consistent with their meaning in the context of the relevant field, and not be interpreted in an idealized or overly formal manner unless expressly so defined. In one embodiment, the mean frequency mean is interchangeably referred to as FM and FM mean .

本发明描述了在环境中检测变化的环境光状况的方法和系统。The present invention describes methods and systems for detecting changing ambient light conditions in an environment.

图1示出了根据本发明实施例的用于检测环境光的系统的框图。该系统包括图像捕获装置101、处理单元102、和显示单元103。图像捕获装置101适于捕获一个或多个图像。处理单元102连接到图像捕获装置101以处理捕获的图像。处理单元102适于执行以下步骤,包括:将每个拍摄图像的颜色转换成灰色,确定每个转换的灰色图像的直方图,计算确定的直方图的数据平均值(DM)和平均频率平均值(FM),将平均频率平均值与用于检测环境光的预定的FM阈值进行比较。此外,当平均频率平均值小于用于检测环境光的预定的FM阈值时,处理单元102将数据平均值与预定的DM阈值进行比较。在环境光的检测低于最佳光时,系统向用户发送警报。在一个实施例中,可视警报显示在显示单元103上。Fig. 1 shows a block diagram of a system for detecting ambient light according to an embodiment of the present invention. The system includes an image capture device 101 , a processing unit 102 , and a display unit 103 . The image capture device 101 is adapted to capture one or more images. The processing unit 102 is connected to the image capture device 101 to process captured images. The processing unit 102 is adapted to perform the steps comprising: converting the color of each captured image into gray, determining a histogram of each converted gray image, calculating a data mean (DM) and a mean frequency mean of the determined histograms (FM), comparing the mean frequency average to a predetermined FM threshold for detecting ambient light. Furthermore, the processing unit 102 compares the data average with a predetermined DM threshold when the average frequency average is less than a predetermined FM threshold for detecting ambient light. When the detection of ambient light is below optimal light, the system sends an alert to the user. In one embodiment, the visual alert is displayed on the display unit 103 .

在一个实施例中,所述方法和系统用于使用车载前置图像捕获装置101例如车辆中的摄像机101来检测环境光。车辆中的前置摄像机可以是驾驶员辅助系统的现有摄像机或者可以改装。In one embodiment, the method and system are used to detect ambient light using a vehicle-mounted front image capture device 101 , such as a camera 101 in a vehicle. The front camera in the vehicle can be an existing camera of a driver assistance system or it can be retrofitted.

在本实施例中,本发明的所述方法检测各种道路场景状况下的环境光,包括但不限于:In this embodiment, the method of the present invention detects ambient light under various road scene conditions, including but not limited to:

·正常的日光· Normal daylight

·进入/退出隧道·Enter/Exit Tunnel

·在隧道内/进入停车场/车库/封闭区等。· In tunnels/entering parking lots/garages/closed areas, etc.

·桥梁/由于树冠造成的阴影等。· Bridges / shadows due to tree crowns, etc.

当车辆在移动时,车辆中的前置摄像机101捕获车辆前方的周围的图像。捕获的图像然后由处理单元102处理,其中环境光和道路景况状况由处理单元的控制逻辑检测。一旦检测到环境光低于最佳光,则处理单元向用户发送警报。在一个实施例中,警报是显示在显示单元103上的信息的形式。在另一实施例中,电子控制单元104(ECU)基于检测的环境光执行预定的控制功能。处理单元向光照的电子控制单元104(ECU)发送信号,其顺序控制一个或多个车辆的功能,例如车大灯105。预定的控制功能,包括但不限于调节车大灯、仪表板灯、根据道路状况转向自动亮灯。When the vehicle is moving, the front camera 101 in the vehicle captures images of the surroundings in front of the vehicle. The captured images are then processed by the processing unit 102, wherein ambient light and road conditions are detected by the processing unit's control logic. Once it detects that the ambient light is below optimal, the processing unit sends an alert to the user. In one embodiment, the alert is in the form of a message displayed on the display unit 103 . In another embodiment, the electronic control unit 104 (ECU) performs predetermined control functions based on the detected ambient light. The processing unit sends signals to an electronic control unit 104 (ECU) of the lighting, which sequentially controls one or more vehicle functions, such as the headlights 105 . Predetermined control functions, including but not limited to adjusting headlights, dashboard lights, and turning on lights automatically according to road conditions.

图2示出根据本发明的实施例的输入图像和对应的直方图的示意图。由车辆的前置摄像机101捕获的图像是如图2(a)所示的彩色图像,然后处理单元102将捕获的彩色图像转换为灰色图像,并且随后确定图像的直方图,如图2(b)。Fig. 2 shows a schematic diagram of an input image and a corresponding histogram according to an embodiment of the present invention. The image captured by the front camera 101 of the vehicle is a color image as shown in FIG. ).

图3示出根据本发明的实施例的检测环境光状况的方法的流程图。在步骤301中,前置摄像机101捕获车子前方的周边的彩色图像。在步骤302中,捕获的彩色图像由处理单元102处理并转换为灰色图像。在步骤303,确定处理图像的直方图。在步骤304,根据所确定的图像的直方图,计算提供图像的平均亮度(数据均值/DM)的数据平均值和直方图的频率值的平均值。在步骤305,将所计算的FM与预定的FM阈值进行比较。在步骤306,如果FM小于预定的FM阈值,则将计算的DM与预定的DM阈值进行比较。在步骤307,基于比较,利用定义的标示和阈值来确定环境光状况。在步骤308,基于相对于预定义的阈值而改变的DM和FM的值,给出/显示适当的警报/警告。Fig. 3 shows a flowchart of a method of detecting ambient light conditions according to an embodiment of the present invention. In step 301, the front camera 101 captures a color image of the surroundings in front of the vehicle. In step 302, the captured color image is processed by the processing unit 102 and converted into a gray image. In step 303, a histogram of the processed image is determined. In step 304, according to the determined histogram of the image, a data average providing the average brightness (data mean/DM) of the image and an average of frequency values of the histogram are calculated. At step 305, the calculated FM is compared to a predetermined FM threshold. At step 306, if the FM is less than the predetermined FM threshold, the calculated DM is compared to the predetermined DM threshold. At step 307, based on the comparison, ambient light conditions are determined using defined indicators and thresholds. At step 308, appropriate alerts/warnings are given/displayed based on the changed values of DM and FM relative to predefined thresholds.

根据本发明的实施例,考虑在白天时间/足够的环境光下用于检测环境光的系统正在启动。对于当前场景计算平均频率平均值(FM),并将所计算的FM与预定的FM阈值进行比较。如果FM大于预定的FM阈值,则场景会识别为白天,并且所环境光检测为最佳光。如果FM小于预定的FM阈值,则针对当前场景计算数据平均值(DM),并且如果DM大于预定的DM阈值,则场景识别为白天,并且环境光检测为最佳光。进一步地,如果FM小于预定的FM阈值并且DM小于预定的DM阈值,则选择图像中心的小区域(感兴趣区域),然后计算所选ROI的FM。当所比较的ROI的FM小于预定的FM阈值时,环境光检测为低于最佳光。According to an embodiment of the present invention, the system for detecting ambient light is considered to be active during daytime hours/sufficient ambient light. An average frequency mean (FM) is calculated for the current scene, and the calculated FM is compared to a predetermined FM threshold. If the FM is greater than a predetermined FM threshold, the scene is identified as daytime and the ambient light is detected as optimal light. If FM is less than a predetermined FM threshold, a data mean (DM) is calculated for the current scene, and if DM is greater than a predetermined DM threshold, the scene is identified as daytime and the ambient light is detected as optimal light. Further, if FM is less than a predetermined FM threshold and DM is less than a predetermined DM threshold, a small region in the center of the image (region of interest) is selected, and then the FM of the selected ROI is calculated. Ambient light is detected as less than optimal light when the FM of the ROI being compared is less than a predetermined FM threshold.

根据本发明的另一个实施例,考虑用于检测环境光的系统正在夜间/较暗区域/较小环境光区域中启动。针对当前场景计算平均频率平均值(FM)和数据平均值(DM)。将FM和DM与预定的阈值进行比较。如果FM大于预定的FM阈值并且DM大于预定的DM阈值,则场景识别为白天,并且环境光检测为最佳光。如果FM小于预定的FM阈值并且DM大于预定的DM阈值,则场景识别为白天,并且环境光检测为最佳光。进一步地,如果FM小于预定的FM阈值并且DM小于预定的DM阈值,则选择图像中心的小区域(感兴趣区域),然后计算所选ROI的FM。当所比较的ROI的FM小于预定的FM阈值时,环境光检测为低于最佳光。According to another embodiment of the invention, it is considered that the system for detecting ambient light is being activated in nighttime/darker areas/lower ambient light areas. Computes the mean frequency mean (FM) and data mean (DM) for the current scene. FM and DM are compared to predetermined thresholds. If FM is greater than a predetermined FM threshold and DM is greater than a predetermined DM threshold, the scene is identified as daytime and the ambient light is detected as optimal light. If FM is less than the predetermined FM threshold and DM is greater than the predetermined DM threshold, the scene is identified as daytime and the ambient light is detected as optimal light. Further, if FM is less than a predetermined FM threshold and DM is less than a predetermined DM threshold, a small region in the center of the image (region of interest) is selected, and then the FM of the selected ROI is calculated. Ambient light is detected as less than optimal light when the FM of the ROI being compared is less than a predetermined FM threshold.

本文中提及的“最佳光”包括但不限于高于预定阈值的光、亮光状况和白天状况的光。本文中提及的″低于最佳光″包括但不限于低于预定阈值的光、低光状况、夜间状况、隧道、停车、车库、桥下、树冠等的光。当检测到低于最佳光状况时,系统向驾驶员显示适当的警告,并且ECU控制适当的车辆功能。"Optimal light" as referred to herein includes, but is not limited to, light above a predetermined threshold, bright light conditions, and daylight conditions. Reference herein to "below optimal light" includes, but is not limited to, light below a predetermined threshold, low light conditions, nighttime conditions, tunnel, parking, garage, under bridge, tree canopy, etc. light. When sub-optimal light conditions are detected, the system displays appropriate warnings to the driver and the ECU controls the appropriate vehicle functions.

例如,在一个实施例中,本发明的方法检测可能的隧道状况-进入隧道、隧道内和离开隧道。在进一步的描述中详细描述了可能的隧道状况的检测方法。如果图像的所选ROI的FM小于预定的FM阈值,则系统警告前方的区域可能是隧道,并且在车辆显示器上发出警告消息(“可能隧道”)。如果这种情况持续存在一定数量″n″的帧,则警告信息将改变为“进入隧道”,例如10帧然后″进入隧道″标示将设置。一旦设置了″进入隧道″标示,则会假设车辆在隧道区域中并且显示警告消息“在隧道内”。监视在隧道内状况的FM,如果它下降到预定的FM阈值以下很多,系统会警告它可能是离开隧道状况。因此,将提供″离开隧道″警告信息,并设置″离开隧道″标示。显示″离开隧道″警告,例如,约15帧。在离开状况的15帧后监视最终出口,直到FM变得大于预定的FM阈值。一旦FM变得大于预定的FM阈值,它表明最佳光和白天状况,并且所有标示相应地重置。For example, in one embodiment, the method of the present invention detects possible tunnel conditions - entering a tunnel, entering a tunnel, and exiting a tunnel. A method for detecting possible tunnel conditions is described in detail in the further description. If the FM of the selected ROI of the image is less than a predetermined FM threshold, the system warns that the area ahead may be a tunnel and issues a warning message on the vehicle display ("Tunnel possible"). If this condition persists for a certain number of "n" frames, the warning message will change to "Enter Tunnel", eg 10 frames and then the "Enter Tunnel" flag will be set. Once the "Enter Tunnel" flag is set, the vehicle is assumed to be in the tunnel area and the warning message "In Tunnel" is displayed. The FM monitors the in-tunnel condition, and if it drops much below a predetermined FM threshold, the system warns it may be an out-of-tunnel condition. Therefore, an "exit tunnel" warning message will be provided and an "exit tunnel" flag will be set. A "Leaving Tunnel" warning is displayed, for example, about 15 frames. The final exit is monitored after 15 frames of leaving the condition until FM becomes greater than a predetermined FM threshold. Once FM becomes greater than a predetermined FM threshold, it indicates optimum light and daylight conditions, and all indicators reset accordingly.

根据本发明的实施例,用于识别可能的场景的算法包括以下步骤:According to an embodiment of the invention, the algorithm for identifying possible scenarios comprises the following steps:

a.直方图计算(总组数=256)a. Histogram calculation (total number of groups = 256)

i.计算直方图的组值i. Calculate the group value of the histogram

ii.计算256个组的最大值ii. Calculate the maximum value of 256 groups

iii.标尺化具有最大值的组值iii. Scale the group value with the largest value

b.频率平均值和数据平均值b. Frequency average and data average

i.计算标尺的组值的平均值(频率平均值)i. Calculate the average of the group values of the scale (frequency average)

ii.计算来自于组值的数据值(数据平均值)ii. Calculate the data value (data mean) from the group value

C.道路场景识别-设置阈值C. Road Scene Recognition - Setting Threshold

i.计算频率平均值超过5帧的平均值(FM)i. Calculate the frequency average over 5 frames (FM)

ii.设置FM和DM的阈值(FM_THR、DM_THR、退出_THR)d.道路场景识别-方法ii. Set thresholds for FM and DM (FM_THR, DM_THR, Exit_THR) d. Road scene recognition - method

i.白天i. During the day

1.如果FM>FM_THR1. If FM>FM_THR

2.否则FM<FM_THR但DM>DM_THR2. Else FM < FM_THR but DM > DM_THR

3.否则FM<FM_THR与DM<DM_THR但FM_ROI>FM_THR3. Otherwise FM < FM_THR and DM < DM_THR but FM_ROI > FM_THR

a.计数器1=计数器1-1;a. Counter 1 = Counter 1-1;

ii.可能隧道ii. Possible Tunnel

1.如果FM<FM_THR,DM<DM_THR与FM_ROI<FM_THR1. If FM<FM_THR, DM<DM_THR and FM_ROI<FM_THR

2.计数器1=计数器1+1;2. Counter 1 = Counter 1+1;

iii.进入隧道iii. Enter the tunnel

1.如果计数器1>5,则在隧道内标示=01. If counter 1 > 5, mark = 0 in the tunnel

2.计数器2=计数器2+1;2. Counter 2 = Counter 2+1;

3.重复显示“进入隧道”,直到计数器2=103. Display "Enter Tunnel" repeatedly until counter 2 = 10

4.在隧道内标示=14. Mark in the tunnel = 1

iv.在隧道内iv. In the tunnel

1.如果计数器2>10与在隧道内标示=1与FM>FM_THR1. If counter 2 > 10 and mark in tunnel = 1 and FM > FM_THR

v.离开v. leave

1.如果在隧道内标示=1,计数器2>10,但FM<退出_THR1. If flag = 1 in tunnel, counter 2 > 10, but FM < exit_THR

2.离开标示=12. Leave sign = 1

3.计数器3=计数器3+13. Counter 3 = Counter 3+1

v.最后离开v. leave last

1.如果计数器3==151. If counter 3 == 15

2.如果FM<退出_THR,显示′退出′标示2. If FM<exit_THR, display 'exit' mark

3.否则如果FM>FM_THR,显示′白天′标示3. Otherwise, if FM>FM_THR, display the 'day' mark

以下详细说明检测环境光的步骤,例如白天时间、可能的隧道、进入隧道、在隧道内、离开隧道和最终出口。The steps for detecting ambient light, such as time of day, possible tunnel, entering tunnel, within tunnel, exiting tunnel and final exit, are detailed below.

a.直方图计算a. Histogram calculation

对于给出的灰度级图像I,具有从0...L-1,排列的强度(n)的尺寸(m1xm2)直方图如下计算:For a given grayscale image I, a histogram of size (m1xm2) with intensities (n) arranged from 0...L-1, is computed as follows:

步骤1:计算直方图组值Step 1: Calculate the histogram group values

使′p′表示图像的直方图组并且“i”表示组索引Let 'p' denote the histogram group of the image and 'i' denote the group index

然后,Then,

pi=强度为ni的像素总数pi = total number of pixels with intensity ni

其中,i=1...L-1(L=256) 公式1Among them, i=1...L-1(L=256) Formula 1

步骤2:计算最大频率值Step 2: Calculate the maximum frequency value

计算所计算的直方图组值的最大值。该值提供为最大频率值。Computes the maximum of the computed histogram group values. This value is provided as the maximum frequency value.

最大值_p=最大值(pi) (i=0...L-1) 公式2Max_p = Max(pi) (i=0...L-1) Formula 2

步骤3:用最大频率值标尺化组值Step 3: Scale group values with maximum frequency value

以最大频率值的标尺化的组值为每个直方图提供不同的频率均值,从而提供有关分布的信息。详细内容在下节中解释。The scaled group value at the maximum frequency value gives each histogram a different frequency mean, which provides information about the distribution. Details are explained in the next section.

b.频率平均值和数据平均值b. Frequency average and data average

直方图提供频率分布或亮度值分布。A histogram provides a frequency distribution or a distribution of brightness values.

根据本发明的实施例,图4示出不同的环境光状况和对应的直方图的示意图。公开了各种道路状况例如白天、进入隧道、在隧道内、离开隧道、最终出口(隧道外)等的频率分布。对于不同的环境光状况生成直方图,并且对于每个道路状况都是不同的。在非归一化直方图的情况下,例如,直方图组的频率之和等于图像的大小,并且在归一化直方图的情况下,其等于1。According to an embodiment of the present invention, FIG. 4 shows a schematic diagram of different ambient light conditions and corresponding histograms. Frequency distributions for various road conditions such as daytime, entering tunnel, inside tunnel, leaving tunnel, final exit (outside tunnel), etc. are disclosed. The histogram is generated for different ambient light conditions and is different for each road condition. In the case of a non-normalized histogram, for example, the sum of the frequencies of the histogram groups is equal to the size of the image, and in the case of a normalized histogram, it is equal to 1.

为了获得可以提供关于频率分布的信息的奇异值,计算频率分布的最大频率值,并且标尺化直方图值。To obtain singular values that can provide information about the frequency distribution, the maximum frequency value of the frequency distribution is calculated and the histogram values are scaled.

Pi=Pi/最大值p 公式4P i =P i /maximum value p Equation 4

组值如下计算Group values are calculated as follows

其中in

L=256,标尺化因子=图像的高度L=256, scaling factor=height of the image

对于进入隧道或退出隧道状况,直方图分别接近零或255,所以最大频率值将保持相似并且频率平均值也将在相同的范围内。为了避免错误的判定,由于频率平均值也在同一范围内,因此还要比较图像的数据/亮度平均值。The histograms are close to zero or 255 for the entering tunnel or exiting tunnel conditions respectively, so the maximum frequency values will remain similar and the frequency averages will also be in the same range. To avoid erroneous decisions, the data/brightness averages of the images are also compared since the frequency averages are also in the same range.

从直方图计算图像的数据平均值或亮度值。由公式1获得的直方图数据归一化如下:Calculates the data average or brightness value of an image from a histogram. The histogram data obtained by Equation 1 were normalized as follows:

pi的范围在0和1之间pi ranges between 0 and 1

C.场景识别:设置阈值C. Scene Recognition: Setting Thresholds

假设系统将在白天时间状况下打开以识别环境光状况。各种环境光状况的频率平均值和数据平均值的示例范围如下所述:It is assumed that the system will be turned on during daytime conditions to recognize ambient light conditions. Example ranges of frequency averages and data averages for various ambient light conditions are described below:

表1:2个视频的分析结果以计算频率平均值和数据平均值的阈值。Table 1: Analysis results of 2 videos to calculate frequency average and threshold for data average.

如表1所示,白天时间亮度值的范围在90至150之间变化,而FM位于30以上。为了清楚地区分白天时间和低环境光情景,将预定的DM阈值设置为80(DM_THR)。可以观察到,频率平均值存在波动,特别是当车辆通过桥梁或树冠时。为了避免错误检测,计算频率均值的平均值。对于当前帧,对前几帧的平均值进行存储和估计。更新FM如下:As shown in Table 1, the daytime brightness values range from 90 to 150, while FM is above 30. To clearly distinguish between daytime hours and low ambient light scenarios, the predetermined DM threshold is set to 80 (DM_THR). It can be observed that there are fluctuations in the frequency mean, especially when vehicles pass over bridges or tree canopies. To avoid false detections, the average of the frequency means is calculated. For the current frame, the average value of previous frames is stored and estimated. Update FM as follows:

最初,第一个K帧的频率平均值存储在一个阵列中,然后,针对当前帧,之前的K帧的平均值计算如下:Initially, the frequency averages for the first K frames are stored in an array, then, for the current frame, the averages for the previous K frames are calculated as follows:

更新:FM(i)=FM(i+1)....for i=1..kUpdate: FM(i)=FM(i+1)....for i=1..k

FM(k)=FM(当前图像的FM)FM(k)=FM (FM of current image)

FM的阈值设置为30(FM_THR)。如表1所示,在出口状态下,频率均值突然下降。为了区分退出状况和白天时间状况,FM的退出阈值设置为20(退出_THR)。The threshold of FM is set to 30 (FM_THR). As shown in Table 1, in the egress state, the frequency mean drops suddenly. To differentiate exit conditions from daytime time conditions, the exit threshold for FM is set to 20 (Exit_THR).

FM_THRFM_THR 3030 DM_THRDM_THR 8080 退出_THRExit_THR 2020

表2:系统定义的阈值Table 2: System-Defined Thresholds

d.区分道路场景的方法d. Methods for distinguishing road scenes

使用所述系统识别以下的环境光状况/场景:白天、可能隧道、进入隧道、在隧道内、退出隧道和最终出口。The following ambient light conditions/scenes are recognized using the system: daytime, possible tunnel, entering tunnel, within tunnel, exiting tunnel and final exit.

根据本发明的实施例,图5a和5b示出具有低对比度图像和良好对比度图像的白天时间状况的示意图。如图5a所示,例如,FM值为54.2而DM值为101.2并且FM和DM分别高于其阈值30和80。同样在图5b中,FM值为48.7而DM值为128.05,其中两个值都分别高于其阈值30和80。因此,如果FM大于预定的FM阈值(FM_THR),则当前帧被标记为″白天时间″。采用以前帧的平均值,因此如果环境光突然减少,则可以避免错误地确定道路状况。Figures 5a and 5b show schematic diagrams of daytime time situations with low-contrast images and good-contrast images, according to an embodiment of the invention. As shown in Fig. 5a, for example, the FM value is 54.2 and the DM value is 101.2 and FM and DM are above their thresholds of 30 and 80, respectively. Also in Figure 5b, the FM value is 48.7 and the DM value is 128.05, where both values are above their thresholds of 30 and 80, respectively. Thus, if the FM is greater than a predetermined FM threshold (FM_THR), the current frame is marked as "time of day". Takes an average of previous frames, so you can avoid wrongly determining road conditions if the ambient light suddenly decreases.

根据本发明的实施例,图6a和图6b示出了白天时间状况的示意图,其中平均频率平均值(FM)较小但数据平均值(DM)较高。如图6b所示,FM值为7.28而DM值为87.5。这时,FM小于预定的FM阈值(FM_THR)30,但是当前图像的DM大于预定的DM阈值(DM_THR)80,因此当前帧标记为“白天时间”。Figures 6a and 6b show schematic diagrams of daytime time conditions in which the average frequency mean (FM) is small but the data mean (DM) is high, according to an embodiment of the present invention. As shown in Figure 6b, the FM value is 7.28 and the DM value is 87.5. At this time, the FM is less than the predetermined FM threshold (FM_THR) 30, but the DM of the current image is greater than the predetermined DM threshold (DM_THR) 80, so the current frame is marked as "daytime".

进一步地,如图6a所示,FM值为29.02而DM值为68.64。这里,FM和DM都小于它们各自的阈值30和80,因此提取了固定的宽度和高度的图像中心中的感兴趣区域(ROI)。将当前ROI的FM与预定的FM阈值(FM_THR)进行比较并且如果发现较大,则将当前帧标记为“白天时间”。Further, as shown in Figure 6a, the FM value is 29.02 and the DM value is 68.64. Here, both FM and DM are smaller than their respective thresholds of 30 and 80, thus extracting a fixed width and height region of interest (ROI) in the center of the image. The FM of the current ROI is compared with a predetermined FM threshold (FM_THR) and if found larger, the current frame is marked as "daytime".

根据本发明的实施例,图7a和7b示出了可能的隧道状况的示意图。如果在如图6所示的上述最后一种情况中,当前ROI的FM小于预定的FM阈值(FM_THR),则当前帧被标记为“可能隧道”。该状况通过递增计数值(计数器_1)直至五帧来监控。Figures 7a and 7b show schematic diagrams of possible tunnel situations, according to an embodiment of the invention. If the FM of the current ROI is smaller than a predetermined FM threshold (FM_THR) in the above last case as shown in FIG. 6, the current frame is marked as "possible tunnel". This condition is monitored by incrementing the count value (Counter_1) up to five frames.

根据本发明的实施例,图8a和8b示出进入隧道和在隧道内的状况的示意图。如果计数值(计数器_1)大于5,如图8a所示当前帧标示切换为“进入隧道″。如果遇到白天时间场景,计数(计数器_1)将递减。在五帧后,进入隧道状况会保持至下一个连续的十帧(计数器_2),在这之后会如图8b所示的设置″在隧道内″标示。直到FM降至低于退出阈值(退出_THR),当前帧会标记为″在隧道内″。Figures 8a and 8b show schematic views of conditions entering and inside a tunnel, according to an embodiment of the invention. If the count value (counter_1) is greater than 5, the current frame flag is switched to "entering the tunnel" as shown in FIG. 8a. If a daytime scenario is encountered, the count (counter_1) will be decremented. After five frames, the entering tunnel status will remain until the next ten consecutive frames (counter_2), after which the "in tunnel" flag will be set as shown in FIG. 8b. Until the FM drops below the Exit Threshold (Exit_THR), the current frame will be marked "in the tunnel".

根据本发明的实施例,图9a示出的离开隧道状况的示意图。除非设置了在隧道内标示的情况下才监视离开隧道的状况。如果FM降至低于退出阈值(退出_THR),则当前帧标记为“退出隧道”并且退出的计数(计数器_3)递增。同时,在退出期间,可以观察到,亮度值急剧增加。还可以监控到这个状况以避免出口状况的错误检测。离开状况显示约15帧(计数器_3)。此后,设置退出隧道标示,并监视最终出口状况。According to an embodiment of the present invention, Fig. 9a shows a schematic diagram of exiting a tunnel situation. Exiting the tunnel is only monitored unless marked in the tunnel is set. If the FM falls below the Exit Threshold (Exit_THR), the current frame is marked as "Exit Tunnel" and the count of Exit (Counter_3) is incremented. At the same time, during the exit period, it can be observed that the brightness value increases sharply. This condition can also be monitored to avoid false detection of egress conditions. The exit status is displayed for about 15 frames (counter_3). Thereafter, set the exit tunnel sign and monitor the final exit status.

根据本发明的实施例,图9b示出最终出口隧道状况的示意图。如果FM小于退出阈值(退出_THR),则当前帧标记为“离开隧道”,否则,当前帧标记为“白天时间”。标示和计数器都会重置以检测更多的类似隧道的状况。Figure 9b shows a schematic diagram of the final egress tunnel condition, according to an embodiment of the present invention. If the FM is less than the exit threshold (Exit_THR), the current frame is marked as "Leaving the Tunnel", otherwise, the current frame is marked as "Daytime". Both flags and counters are reset to detect more tunnel-like conditions.

设置三个计数器使得从一个场景切换到另一个场景不是突然的。第一个计数器(计数器_1)监视5帧可能的隧道状况。如果遇到“白天时间”状况,则计数器_1会递减。第二个计数器(计数器_2)监视进入隧道状态,并且保持″进入隧道″状况至下一个连续的10帧。第三个计数器(计数器_3)维持退出隧道状况约15帧。Setting three counters makes switching from one scene to another not abrupt. The first counter (counter_1) monitors 5 frames for possible tunnel conditions. If a "time of day" condition is encountered, counter_1 is decremented. The second counter (Counter_2) monitors the In-Tunnel status and maintains the "Enter-Tunnel" condition until the next consecutive 10 frames. The third counter (Counter_3) maintains the exit tunnel condition for approximately 15 frames.

两个附加标示(在隧道内和退出标示)确保从在隧道内状况到白天时间状况以及从退出状况到白天时间状况的切换不会以随机方式发生。一旦检测到进入隧道,就设置了在隧道内标示,这确保在达到退出状况之前下一状况将是处于在隧道内状况。只有在设置了退出标示之后,才监视白天时间状况,否则标记为退出隧道。The two additional flags (In Tunnel and Exit flag) ensure that switching from the In Tunnel condition to the Daytime condition and from the Exit condition to the Daytime condition does not occur in a random fashion. Once an entry into the tunnel is detected, the in-tunnel flag is set, which ensures that the next condition before reaching the exit condition will be the in-tunnel condition. Daytime conditions are monitored only after an exit flag is set, otherwise it is flagged to exit the tunnel.

本发明的方法和系统是简单且准确的环境光检测系统。本发明的检测方法有助于区分各种低光状况,例如但不限于隧道类似状况、停车、桥下、树冠等。本发明提供了适当的警告,例如“可能隧道”和“进入隧道”,根据情况。此外,ECU基于检测到的环境光的数量执行预定的控制功能。ECU根据检测到的环境光来控制一个或多个车辆的功能。预定义的控制功能包括但不限于,根据道路情况自动调节车大灯、仪表板灯、转向灯。如本发明所述,通过仅使用平均频率平均值(FM)和数据平均值(DM)两个参数来实现道路场景状况的整体分类和环境光的检测。The method and system of the present invention is a simple and accurate ambient light detection system. The detection method of the present invention helps to distinguish various low-light conditions, such as but not limited to tunnel-like conditions, parking, under bridges, tree crowns, and the like. The present invention provides appropriate warnings, such as "Possible Tunnel" and "Enter Tunnel", depending on the situation. In addition, the ECU performs predetermined control functions based on the detected amount of ambient light. The ECU controls one or more vehicle functions based on the detected ambient light. Pre-defined control functions include, but are not limited to, automatic adjustment of headlights, dashboard lights, and turn signals according to road conditions. According to the present invention, the overall classification of road scene conditions and the detection of ambient light are realized by using only two parameters of mean frequency mean (FM) and data mean (DM).

本发明旨在涵盖与本申请的图中所示和所描述的所有等效关系。用于说明本发明的实施例的例子绝不限制本发明对它们的适用性。应当注意,本领域普通技术人员将理解,在不违背本发明的范围的情况下,各种修改和细节的替代都可以在本发明所公开的整体教导下来进行研究。This invention is intended to cover all equivalents to those shown and described in the drawings of this application. The examples of embodiments used to illustrate the invention in no way limit the applicability of the invention to them. It should be noted that those skilled in the art will appreciate that various modifications and substitutions of details may be made on the overall teaching of the present disclosure without departing from the scope of the present invention.

Claims (8)

1.一种检测环境光的方法,包括:1. A method for detecting ambient light, comprising: 捕获一个或多个可视图像;capture one or more viewable images; 将捕获的图像转换成灰色图像;convert the captured image into a gray image; 确定每个灰色图像的直方图;determine the histogram of each gray image; 计算确定的直方图的平均频率平均值(FM)和数据平均值(DM);和calculating the average frequency mean (FM) and data mean (DM) of the determined histogram; and 执行以下步骤中的一个Do one of the following steps a)将FM与预定的FM阈值进行比较;并且a) comparing FM to a predetermined FM threshold; and 当比较的FM大于预定的FM阈值时,检测环境光为最佳光;When the compared FM is greater than the predetermined FM threshold, the ambient light is detected as the best light; b)将FM与预定的FM阈值进行比较并将DM与预定的DM阈值进行比较;并且b) comparing FM to a predetermined FM threshold and comparing DM to a predetermined DM threshold; and 当比较的FM小于预定的FM阈值和比较的DM大于预定的DM阈值时,检测环境光为最佳光;和Detecting ambient light as optimal light when the compared FM is less than a predetermined FM threshold and the compared DM is greater than a predetermined DM threshold; and c)将FM与预定的FM阈值进行比较并将DM与预定的DM阈值进行比较;和c) comparing FM to a predetermined FM threshold and comparing DM to a predetermined DM threshold; and 如果FM小于预定的FM阈值并且DM小于预定的DM阈值;if FM is less than a predetermined FM threshold and DM is less than a predetermined DM threshold; 将所识别的感兴趣区域(ROI)的FM与预定的FM阈值进行比较;和comparing the FM of the identified region of interest (ROI) to a predetermined FM threshold; and 当比较的ROI的FM小于预定的FM阈值时,检测环境光为低于最佳光。Ambient light is detected as less than optimal light when the FM of the compared ROI is less than a predetermined FM threshold. 2.根据权利要求1所述的方法,还包括确定所识别的感兴趣区域(ROI)的FM:2. The method of claim 1, further comprising determining the FM of the identified region of interest (ROI): 识别所捕获图像的感兴趣区域;和identifying a region of interest in the captured image; and 当FM小于预定的FM阈值时并且DM小于预定的DM阈值时,确定所识别的感兴趣区域(ROI)的FM。The FM of the identified region of interest (ROI) is determined when the FM is less than a predetermined FM threshold and when the DM is less than a predetermined DM threshold. 3.根据权利要求1所述的方法,其中计算所确定的直方图的FM,包括:3. The method of claim 1, wherein calculating the FM of the determined histogram comprises: 对于预定数量的帧,确定所确定的直方图的频率平均值;和For a predetermined number of frames, determining a frequency average of the determined histogram; and 确定预定的帧数的FM。Determine the FM of the predetermined number of frames. 4.根据权利要求1所述的方法,还包括当检测的环境光高于最佳光时,检测为白天时间。4. The method of claim 1, further comprising detecting time of day when the detected ambient light is higher than optimal light. 5.根据权利要求1所述的方法,还包括当检测的环境光低于最佳光时,检测为可能进入隧道和离开隧道。5. The method of claim 1, further comprising detecting possible entry into and exit from the tunnel when the detected ambient light is below optimal light. 6.根据权利要求1所述的方法,还包括基于所检测的环境光的一个或多个状况来执行预定义的控制功能。6. The method of claim 1, further comprising executing a predefined control function based on the detected one or more conditions of ambient light. 7.一种用于检测环境光的系统,包括:7. A system for detecting ambient light comprising: 适于捕获一个或多个图像的图像捕获装置;和an image capture device adapted to capture one or more images; and 连接到图像捕获装置的处理单元,配置为执行包括以下步骤:A processing unit connected to the image capture device, configured to perform the steps comprising: 将每个捕获的图像的颜色转换成灰色;Convert the color of each captured image to gray; 确定每个灰色捕获图像的直方图;Determine the histogram of each gray captured image; 计算所确定的直方图的平均频率平均值(FM)和数据平均值(DM);和calculating the average frequency mean (FM) and data mean (DM) of the determined histogram; and 执行以下步骤中的一个Do one of the following steps a)将FM与预定的FM阈值进行比较;和a) comparing FM to a predetermined FM threshold; and 当比较的FM大于预定的FM阈值时,检测环境光为最佳光;When the compared FM is greater than the predetermined FM threshold, the ambient light is detected as the best light; b)将FM与预定的FM阈值进行比较;b) comparing the FM with a predetermined FM threshold; 将DM与预定的DM阈值进行比较;和comparing the DM to a predetermined DM threshold; and 当比较的FM小于预定的FM阈值并且比较的DM大于预定的DM阈值时,检测环境光为最佳光;和Detecting ambient light as optimal light when the compared FM is less than a predetermined FM threshold and the compared DM is greater than a predetermined DM threshold; and c)将FM与预定的FM阈值进行比较;c) comparing the FM with a predetermined FM threshold; 将DM与预定的DM阈值进行比较;Comparing the DM to a predetermined DM threshold; 当比较的FM小于预定的FM阈值并且DM小于预定的DM阈值时;when the compared FM is less than a predetermined FM threshold and the DM is less than a predetermined DM threshold; 将所识别的感兴趣区域(ROI)的FM与预定的FM阈值进行比较;和comparing the FM of the identified region of interest (ROI) to a predetermined FM threshold; and 当比较的ROI的FM小于预定的FM阈值时,检测环境光低于最佳光。When the FM of the compared ROI is less than a predetermined FM threshold, the detected ambient light is below optimal light. 8.根据权利要求7所述的系统,其中所述处理器进一步配置为执行确定所识别的感兴趣区域(ROI)的FM的步骤:8. The system of claim 7, wherein the processor is further configured to perform the step of determining the FM of the identified region of interest (ROI): 识别所捕获图像的感兴趣区域;和identifying a region of interest in the captured image; and 当FM小于预定的FM阈值并且DM小于预定的DM阈值时,确定所识别的感兴趣区域(ROI)的FM。The FM of the identified region of interest (ROI) is determined when the FM is less than a predetermined FM threshold and the DM is less than a predetermined DM threshold.
CN201680013346.2A 2015-03-05 2016-02-25 Method and system for detecting ambient light Expired - Fee Related CN107408202B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
IN727MU2015 2015-03-05
IN727/MUM/2015 2015-03-05
PCT/IN2016/000051 WO2016139674A1 (en) 2015-03-05 2016-02-25 Method and system for detecting ambient light

Publications (2)

Publication Number Publication Date
CN107408202A true CN107408202A (en) 2017-11-28
CN107408202B CN107408202B (en) 2020-09-15

Family

ID=55963430

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680013346.2A Expired - Fee Related CN107408202B (en) 2015-03-05 2016-02-25 Method and system for detecting ambient light

Country Status (4)

Country Link
JP (1) JP6592522B2 (en)
KR (1) KR101969856B1 (en)
CN (1) CN107408202B (en)
WO (1) WO2016139674A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110197185A (en) * 2019-05-23 2019-09-03 北京云星宇交通科技股份有限公司 A kind of method and system based on Scale invariant features transform algorithm monitoring space under bridge
CN111497732A (en) * 2019-01-31 2020-08-07 杭州海康威视数字技术股份有限公司 Automobile lamp control method, device, control equipment, system and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20250232702A1 (en) * 2024-01-12 2025-07-17 Visteon Global Technologies, Inc. Image enhancement framework

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101479766A (en) * 2006-07-10 2009-07-08 丰田自动车株式会社 Object detection apparatus, method and program
CN101567976A (en) * 2008-01-22 2009-10-28 索尼株式会社 Image capturing apparatus, control method therefor, and program
CN102334128A (en) * 2008-12-26 2012-01-25 数据逻辑扫描公司 Systems and methods for imaging
CN102685516A (en) * 2011-03-07 2012-09-19 李慧盈 Active safety type assistant driving method based on stereoscopic vision
CN103413441A (en) * 2013-06-26 2013-11-27 广东惠利普路桥信息工程有限公司 Road weather condition monitoring system and monitoring method
US20130335556A1 (en) * 2012-06-15 2013-12-19 Palo Alto Research Center Incorporated Day night classification of images using thresholding on hsv histogram
CN104050620A (en) * 2013-03-13 2014-09-17 株式会社电装 Object detection apparatus

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09233336A (en) * 1996-02-20 1997-09-05 Fuji Xerox Co Ltd Image processor
JPH11167633A (en) * 1997-12-02 1999-06-22 Dainippon Screen Mfg Co Ltd Method and device for analyzing image
FR2883818B1 (en) * 2005-03-31 2008-09-12 Valeo Vision Sa METHOD OF ANTICIPATED DETECTION OF AN ARRIVAL OF A MOTOR VEHICLE IN A DARK SECTOR
JP5436892B2 (en) * 2009-03-10 2014-03-05 オムロンオートモーティブエレクトロニクス株式会社 Vehicle imaging device
JP5520038B2 (en) * 2009-12-25 2014-06-11 キヤノン株式会社 Video processing apparatus and video processing method
KR20110125154A (en) * 2010-05-12 2011-11-18 삼성전자주식회사 Apparatus and method for automatically adjusting the brightness of an imaging device
KR101660878B1 (en) * 2010-11-18 2016-09-28 현대모비스 주식회사 Apparatus for processing image of camera in vehicle and method thereof

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101479766A (en) * 2006-07-10 2009-07-08 丰田自动车株式会社 Object detection apparatus, method and program
CN101567976A (en) * 2008-01-22 2009-10-28 索尼株式会社 Image capturing apparatus, control method therefor, and program
CN102334128A (en) * 2008-12-26 2012-01-25 数据逻辑扫描公司 Systems and methods for imaging
CN102685516A (en) * 2011-03-07 2012-09-19 李慧盈 Active safety type assistant driving method based on stereoscopic vision
US20130335556A1 (en) * 2012-06-15 2013-12-19 Palo Alto Research Center Incorporated Day night classification of images using thresholding on hsv histogram
CN104050620A (en) * 2013-03-13 2014-09-17 株式会社电装 Object detection apparatus
CN103413441A (en) * 2013-06-26 2013-11-27 广东惠利普路桥信息工程有限公司 Road weather condition monitoring system and monitoring method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MASSIMO BERTOZZI 等: "Fast Vision-Based Road Tunnel Detection", 《ICIAP 2011》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111497732A (en) * 2019-01-31 2020-08-07 杭州海康威视数字技术股份有限公司 Automobile lamp control method, device, control equipment, system and storage medium
CN111497732B (en) * 2019-01-31 2022-06-03 杭州海康威视数字技术股份有限公司 Automobile lamp control method, device, control equipment, system and storage medium
CN110197185A (en) * 2019-05-23 2019-09-03 北京云星宇交通科技股份有限公司 A kind of method and system based on Scale invariant features transform algorithm monitoring space under bridge

Also Published As

Publication number Publication date
CN107408202B (en) 2020-09-15
KR20170120149A (en) 2017-10-30
JP6592522B2 (en) 2019-10-16
WO2016139674A1 (en) 2016-09-09
KR101969856B1 (en) 2019-04-17
JP2018515746A (en) 2018-06-14

Similar Documents

Publication Publication Date Title
CN105160924B (en) Intelligent signal lamp condition detection method and detecting system based on Video processing
US7566851B2 (en) Headlight, taillight and streetlight detection
US11749112B2 (en) Warning device, warning method, and warning program
US20120002052A1 (en) Obstacle detection apparatus, obstacle detection system having same, and obstacle detection method
JP7697219B2 (en) Apparatus, method and electronic device for recognizing vehicle turn signal indicators
US9928444B2 (en) Image recognizing apparatus and method that informs the driver that the image is not recognized when it is determined that a disturbance occurs in the image
JP2011076214A (en) Obstacle detection device
EP4304191A2 (en) Camera system, method for controlling the same, and computer program
CN107408202B (en) Method and system for detecting ambient light
JP5780979B2 (en) Vehicle state detection device, vehicle behavior detection device, and vehicle state detection method
JP2011227657A (en) Device for monitoring periphery of vehicle
CN204801615U (en) System and outside light control system of scene imaging system , control vehicle arrangement
JP6877651B1 (en) Visual load value estimation device, visual load value estimation system, visual load value estimation method, and visual load value estimation program
CN108259819B (en) Dynamic image feature enhancement method and system
US20130039576A1 (en) Method and device for analyzing an image of an image recording device for a vehicle
KR101865958B1 (en) Method and apparatus for recognizing speed limit signs
KR101960741B1 (en) Method for Setting Event Rule According to Interested Boundary and Apparatus for Monitoring Event Using The Method
JP5587068B2 (en) Driving support apparatus and method
CN118560516A (en) HUD self-adaptive display method, HUD self-adaptive display system, HUD self-adaptive display equipment and vehicle
CN102542241A (en) Embedded image processing and identifying system and method
US12530906B2 (en) System for avoiding accidents caused by wild animals crossing at dusk and at night
JP2005339234A (en) Front vehicle monitoring device
JP2012118929A (en) Outside environment determination device and outside environment determination program
JP2015058747A (en) Vehicle lamp body control device
KR101564394B1 (en) Method and recording medium for day and night recognition of input image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200915

CF01 Termination of patent right due to non-payment of annual fee