[go: up one dir, main page]

CN105635597B - The automatic explosion method and system of in-vehicle camera - Google Patents

The automatic explosion method and system of in-vehicle camera Download PDF

Info

Publication number
CN105635597B
CN105635597B CN201510968340.8A CN201510968340A CN105635597B CN 105635597 B CN105635597 B CN 105635597B CN 201510968340 A CN201510968340 A CN 201510968340A CN 105635597 B CN105635597 B CN 105635597B
Authority
CN
China
Prior art keywords
exposure
value
frame
time
adjustment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201510968340.8A
Other languages
Chinese (zh)
Other versions
CN105635597A (en
Inventor
张颖江
袁方
吴聪
潘尧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hubei University of Technology
Original Assignee
Hubei University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hubei University of Technology filed Critical Hubei University of Technology
Priority to CN201510968340.8A priority Critical patent/CN105635597B/en
Publication of CN105635597A publication Critical patent/CN105635597A/en
Application granted granted Critical
Publication of CN105635597B publication Critical patent/CN105635597B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/75Circuitry for compensating brightness variation in the scene by influencing optical camera components

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

A kind of automatic explosion method and system of in-vehicle camera, are arranged area-of-interest after initialization, are all handled just for area-of-interest every frame image;Start camera, the time for exposure of first frame uses initial exposure time, it carries out that the second frame is arranged by the quick adjusting of standard of gray threshold, to follow-up each frame, present frame and previous frame image gray average difference are not above gray scale shake saltus step range and then retain Time Exposure value using present frame, else if detecting that traffic sign then carries out the exposure based on image entropy and adjusts, else if the gradation of image mean value of present frame then directly uses the value of present frame in standard grayscale threshold range, otherwise gray average difference carries out being adjusted according to the PID of gray scale and exposure value ratio if within the scope of saltus step, otherwise carry out carrying out the Time Exposure discreet value of the exposure method acquisition next frame of fast zoom table using cmos sensor characteristic;Finally discreet value is controlled according to time for exposure adjustable range.

Description

车载相机的自动曝光方法及系统Automatic exposure method and system for vehicle-mounted camera

技术领域technical field

本发明涉及智能交通技术领域,提供一种车载相机的自动曝光方法及系统。The invention relates to the technical field of intelligent transportation, and provides an automatic exposure method and system for a vehicle-mounted camera.

背景技术Background technique

随着生活水平的提高和人们生活节奏的加快,车辆越来越普及,交通运输的压力也因此空前增大,汽车的主动安全的问题逐渐成为人们关注的焦点。With the improvement of living standards and the acceleration of people's life rhythm, vehicles are becoming more and more popular, and the pressure on transportation has also increased unprecedentedly. The issue of active safety of automobiles has gradually become the focus of attention.

无人车的提出就是基于这一需求而来的,无人车集自动控制、体系结构、人工智能、视觉计算等众多技术于一体,是计算机科学、模式识别和智能控制技术高度发展的产物,也是衡量一个国家科研实力和工业水平的一个重要标志,在国防和国民经济领域具有广阔的应用前景。The proposal of unmanned vehicles is based on this demand. Unmanned vehicles integrate many technologies such as automatic control, architecture, artificial intelligence, and visual computing. They are products of highly developed computer science, pattern recognition, and intelligent control technologies. It is also an important symbol to measure a country's scientific research strength and industrial level, and has broad application prospects in the fields of national defense and national economy.

无人驾驶汽车是通过车载传感系统感知道路环境,自动规划行车路线并控制车辆到达预定目标的智能汽车。车载数字相机作为车辆道路环境感知系统的主要传感设备,受到了广泛的重视。A driverless car is a smart car that senses the road environment through an on-board sensor system, automatically plans a driving route, and controls the vehicle to reach a predetermined target. As the main sensing device of vehicle road environment perception system, on-board digital camera has received extensive attention.

而自动曝光技术是车载数字相机中的一个重点技术,不同于传统的自动曝光方法是以人眼视觉作为评判标准,车载环境下的自动曝光是使机器能够自动识别目标物,如识别交通标志、红绿灯、车道线等目标物才是自动曝光的目的。The automatic exposure technology is a key technology in vehicle-mounted digital cameras. Different from the traditional automatic exposure method, which uses human vision as the judging standard, the automatic exposure technology in the vehicle environment enables the machine to automatically identify the target object, such as identifying traffic signs, Target objects such as traffic lights and lane lines are the purpose of automatic exposure.

数字相机的自动曝光方法一般有硬件实现和软件实现两种办法。在数字相机出现的早期多采用硬件控制的方法,它具有控制速度快、效果佳等优点,但存在硬件设备成本高昂的缺点。随着生产技术的革新以及软件曝光算法的成熟,采用软件控制的方法能得到同样的控制效果,并且成本低廉有效地控制曝光主要有3种方法:1调整光圈,2控制电子快门,3调整放大增益。在无人驾驶车的环境感知中,后两种方法应用更为广泛。The automatic exposure method of the digital camera generally has hardware realization and software realization two kinds of ways. In the early days of digital cameras, the method of hardware control was mostly used. It has the advantages of fast control speed and good effect, but has the disadvantage of high cost of hardware equipment. With the innovation of production technology and the maturity of software exposure algorithm, the same control effect can be obtained by using software control method, and there are three main methods to effectively control exposure at low cost: 1. Adjust the aperture, 2. Control the electronic shutter, 3. Adjust the zoom gain. In the environment perception of unmanned vehicles, the latter two methods are more widely used.

目前,数字相机的自动曝光控制的软件方法主要有三种:At present, there are three main software methods for automatic exposure control of digital cameras:

1基于图像亮度均值的自动曝光方法。1 Automatic exposure method based on image brightness average.

2基于图像亮度直方图的自动曝光方法。2 Automatic exposure method based on image brightness histogram.

3基于图像内容的自动爆光方法。3. Automatic exposure method based on image content.

这3种方法各有其优缺点,但是由于车载环境的特殊环境,外界环境易变的高动态环境下,如存在逆光,道路环境复杂,路面积水等情况都不能很好满足程序要求。基于这些原因,车载平台的自动曝光方法要求有很高的适应性,高效性,强实时性和稳定性。These three methods have their own advantages and disadvantages, but due to the special environment of the vehicle environment and the highly dynamic environment with variable external environment, such as backlighting, complex road environment, and water on the road, they cannot meet the program requirements well. For these reasons, the automatic exposure method of the vehicle platform requires high adaptability, high efficiency, strong real-time performance and stability.

发明内容Contents of the invention

不同于照相机和其他监控摄像头的曝光方法,本发明的目的是从基于车载这一平台出发,主要考虑汽车所处的环境,车况复杂多变,在不同的地段都要求准确的识别目标物,使获取的图片数据都能够较好的识别目标物如车道线、交通标志、红绿灯等;而整个系统的复杂性,分配的内存和处理时间不能过大;在高速行驶过程中,怎么快速的识别目标物,曝光程序又是整个图像识别的基石,怎样保证全程的稳定性是重中之重。Different from the exposure methods of cameras and other monitoring cameras, the purpose of the present invention is to start from the vehicle-based platform, mainly considering the environment in which the car is located, the vehicle conditions are complex and changeable, and accurate identification of objects is required in different locations, so that The acquired picture data can better identify objects such as lane lines, traffic signs, traffic lights, etc.; however, the complexity of the entire system, the allocated memory and processing time should not be too large; how to quickly identify objects during high-speed driving Objects, exposure procedures are the cornerstone of the entire image recognition, how to ensure the stability of the whole process is the top priority.

本发明技术方案提供一种车载相机的自动曝光方法,包括以下步骤:The technical solution of the present invention provides an automatic exposure method for a vehicle-mounted camera, comprising the following steps:

步骤1,初始化,包括配置初始曝光时间、曝光时间调节范围、标准灰度阈值范围Gt、符合PID调节的跳变范围Gp和灰度跳变防抖动范围Gc;Step 1, initialization, including configuring initial exposure time, exposure time adjustment range, standard grayscale threshold range Gt, jump range Gp conforming to PID adjustment, and grayscale jump anti-shake range Gc;

步骤2,设置感兴趣区域,对每帧图像都将只针对感兴趣区域进行处理;Step 2, set the region of interest, and each frame of image will only be processed for the region of interest;

步骤3,启动相机,第一帧的曝光时间采用步骤1配置的初始曝光时间,在拍摄第一帧后针对感兴趣区域获取第一帧图像灰度均值,根据设定的标准灰度阈值范围Gt,进行以灰度阈值为标准的快速调节,根据调节结果设置第二帧的曝光时间,进入步骤9;Step 3: Start the camera. The exposure time of the first frame adopts the initial exposure time configured in step 1. After the first frame is shot, the average gray value of the image of the first frame is obtained for the region of interest. According to the set standard gray threshold range Gt , perform a quick adjustment based on the gray threshold value, set the exposure time of the second frame according to the adjustment result, and go to step 9;

步骤4,将当前帧的图像灰度均值与前一帧的图像灰度均值进行比较,若两帧灰度均值差值ΔG变化没有超过步骤1设定的灰度抖动跳变范围Gc则保留采用当前帧的时间曝光值作为下一帧的时间曝光预估值,进入步骤9,否则进入步骤5;Step 4: Compare the image grayscale average value of the current frame with the image grayscale average value of the previous frame, if the difference ΔG of the grayscale average value of the two frames does not exceed the grayscale jitter jump range Gc set in step 1, then keep using The time exposure value of the current frame is used as the estimated time exposure value of the next frame, and enter step 9, otherwise, enter step 5;

步骤5,如果从当前帧图像检测到交通标志则进行基于图像熵的曝光调节,获取下一帧的时间曝光预估值,进入步骤9,否则进入步骤6;Step 5, if a traffic sign is detected from the current frame image, perform exposure adjustment based on image entropy, obtain the estimated time exposure value of the next frame, and go to step 9, otherwise go to step 6;

步骤6,如果当前帧的图像灰度均值在步骤1预设标准灰度阈值范围Gt内,则直接采用当前帧的时间曝光值作为下一帧的时间曝光预估值,进入步骤9,否则进入步骤7;Step 6, if the image grayscale mean value of the current frame is within the preset standard grayscale threshold range Gt in step 1, then directly use the time exposure value of the current frame as the estimated time exposure value of the next frame, and go to step 9, otherwise go to Step 7;

步骤7,根据步骤4所得当前帧的图像灰度均值与前一帧的图像灰度均值的差值ΔG进一步判断,如果在步骤1预设的跳变范围Gp内,则进行根据灰度和曝光值比例的PID调节,获取下一帧的时间曝光预估值,进入步骤9,否则进行步骤8;Step 7, further judge according to the difference ΔG between the image grayscale average value of the current frame and the image grayscale average value of the previous frame obtained in step 4, if it is within the jump range Gp preset in step 1, then proceed according to the grayscale and exposure PID adjustment of the value ratio, obtain the estimated time exposure value of the next frame, go to step 9, otherwise go to step 8;

步骤8,进行利用CMOS传感器特性进行快速查表的曝光方法,获取下一帧的时间曝光预估值,进入步骤9;Step 8, carry out the exposure method of using the characteristics of the CMOS sensor to quickly look up the table, obtain the estimated time exposure value of the next frame, and enter step 9;

步骤9,对当前所得下一帧的时间曝光预估值根据步骤1中的曝光时间调节范围进行控制,如果下一帧的时间曝光预估值大于曝光时间调节范围的最大值,则取最大值为最终确定的下一帧的时间曝光值,如果小于曝光时间调节范围的最小值,则取最小值为最终确定的下一帧的时间曝光值,如果在曝光时间调节范围内则直接设置下一帧的时间曝光预估值为最终的确定的下一帧的时间曝光值;根据最终确定的时间曝光值控制相机拍摄得到下一帧后,返回步骤4,将下一帧作为新的当前帧进行循环。Step 9: Control the current estimated time exposure value of the next frame according to the exposure time adjustment range in step 1. If the time exposure estimate value of the next frame is greater than the maximum value of the exposure time adjustment range, take the maximum value is the time exposure value of the next frame finally determined, if it is less than the minimum value of the exposure time adjustment range, take the minimum value as the final time exposure value of the next frame, if it is within the exposure time adjustment range, directly set the next The estimated time exposure value of a frame is the final determined time exposure value of the next frame; after controlling the camera to capture the next frame according to the final determined time exposure value, return to step 4, and use the next frame as the new current frame cycle.

而且,步骤2中设置感兴趣区域时,去除相机镜头内下方无用的汽车机箱盖区域,顶部天空区域以及两侧边缘。Moreover, when setting the region of interest in step 2, remove the useless car chassis cover area, the top sky area, and the edges on both sides of the camera lens.

本发明提供一种车载相机的自动曝光系统,其特征在于,包括以下模块:The invention provides an automatic exposure system for a vehicle-mounted camera, which is characterized in that it includes the following modules:

初始化模块,用于配置初始曝光时间、曝光时间调节范围、标准灰度阈值范围Gt、符合PID调节的跳变范围Gp和灰度跳变防抖动范围Gc;The initialization module is used to configure the initial exposure time, exposure time adjustment range, standard grayscale threshold range Gt, jump range Gp conforming to PID adjustment, and grayscale jump anti-shake range Gc;

区域划分模块,用于设置感兴趣区域,对每帧图像都将只针对感兴趣区域进行处理;The region division module is used to set the region of interest, and each frame of image will only be processed for the region of interest;

初始启动模块,用于启动相机,第一帧的曝光时间采用初始化模块配置的初始曝光时间,在拍摄第一帧后针对感兴趣区域获取第一帧图像灰度均值,根据设定的标准灰度阈值范围Gt,进行以灰度阈值为标准的快速调节,根据调节结果设置第二帧的曝光时间,命令控制模块工作;The initial startup module is used to start the camera. The exposure time of the first frame adopts the initial exposure time configured by the initialization module. After the first frame is shot, the average gray value of the first frame image is obtained for the region of interest. According to the set standard gray Threshold range Gt, perform quick adjustment based on the gray threshold as the standard, set the exposure time of the second frame according to the adjustment result, and order the control module to work;

防抖动调节模块,用于将当前帧的图像灰度均值与前一帧的图像灰度均值进行比较,若两帧灰度均值差值ΔG变化没有超过初始化模块设定的灰度抖动跳变范围Gc则保留采用当前帧的时间曝光值作为下一帧的时间曝光预估值,命令控制模块工作,否则命令图像熵调节模块工作;The anti-shake adjustment module is used to compare the image grayscale mean value of the current frame with the image grayscale mean value of the previous frame, if the difference ΔG of the grayscale mean value difference between the two frames does not exceed the grayscale jitter jump set by the initialization module The range Gc then retains the time exposure value of the current frame as the estimated time exposure value of the next frame, and commands the control module to work, otherwise the image entropy adjustment module is ordered to work;

图像熵调节模块,用于如果从当前帧图像检测到交通标志则进行基于图像熵的曝光调节,获取下一帧的时间曝光预估值,命令控制模块工作,否则命令标准判断模块工作;The image entropy adjustment module is used to perform exposure adjustment based on image entropy if a traffic sign is detected from the current frame image, obtain the estimated time exposure value of the next frame, and order the control module to work, otherwise order the standard judgment module to work;

标准判断模块,用于如果当前帧的图像灰度均值在初始化模块预设标准灰度阈值范围Gt内,则直接采用当前帧的时间曝光值作为下一帧的时间曝光预估值,命令控制模块工作,否则命令PID控制调节模块工作;A standard judging module, used to directly adopt the time exposure value of the current frame as the estimated time exposure value of the next frame if the image grayscale mean value of the current frame is within the preset standard grayscale threshold range Gt of the initialization module, and order the control module work, otherwise order the PID control adjustment module to work;

PID控制调节模块,用于根据防抖动调节模块所得当前帧的图像灰度均值与前一帧的图像灰度均值的差值ΔG进一步判断,如果在初始化模块预设的跳变范围Gp内,则进行根据灰度和曝光值比例的PID调节,获取下一帧的时间曝光预估值,命令控制模块工作,否则命令CMOS传感器调节模块工作;The PID control adjustment module is used to further judge according to the difference ΔG between the image grayscale average value of the current frame obtained by the anti-shake adjustment module and the image grayscale average value of the previous frame, if it is within the jump range Gp preset by the initialization module, Then perform PID adjustment according to the ratio of grayscale and exposure value, obtain the estimated time exposure value of the next frame, order the control module to work, otherwise order the CMOS sensor adjustment module to work;

CMOS传感器调节模块,用于进行利用CMOS传感器特性进行快速查表的曝光方法,获取下一帧的时间曝光预估值,命令控制模块工作;The CMOS sensor adjustment module is used to perform an exposure method using the characteristics of the CMOS sensor to quickly look up the table, obtain the estimated time exposure value of the next frame, and command the control module to work;

控制模块,用于对当前所得下一帧的时间曝光预估值根据初始化模块中的曝光时间调节范围进行控制,如果下一帧的时间曝光预估值大于曝光时间调节范围的最大值,则取最大值为最终确定的下一帧的时间曝光值,如果小于曝光时间调节范围的最小值,则取最小值为最终确定的下一帧的时间曝光值,如果在曝光时间调节范围内则直接设置下一帧的时间曝光预估值为最终的确定的下一帧的时间曝光值;根据最终确定的时间曝光值控制相机拍摄得到下一帧后,返回命令防抖动调节模块工作,将下一帧作为新的当前帧进行循环。The control module is used to control the current estimated time exposure value of the next frame according to the exposure time adjustment range in the initialization module. If the time exposure estimate value of the next frame is greater than the maximum value of the exposure time adjustment range, take The maximum value is the final time exposure value of the next frame. If it is less than the minimum value of the exposure time adjustment range, take the minimum value as the final time exposure value of the next frame. If it is within the exposure time adjustment range, set it directly The estimated value of the time exposure of the next frame is the final determined time exposure value of the next frame; after controlling the camera to capture the next frame according to the final determined time exposure value, return to order the anti-shake adjustment module to work, and set the next frame The frame is cycled through as the new current frame.

而且,区域划分模块中设置感兴趣区域时,去除相机镜头内下方无用的汽车机箱盖区域,顶部天空区域以及两侧边缘。Moreover, when setting the region of interest in the region division module, the useless car chassis cover region, the top sky region, and the edges on both sides of the camera lens are removed.

本发明综合需要考虑的各种情况,为了解决全图扫描耗时过慢,部分区域可以通过划分区域去掉从而节省扫描时间,采用划分区域结合交通标志检测模块进行分区域曝光,快速性是车载平台要求之一,所以在初始调节的时候采用结合CMOS传感器的感光特性来进行快速调节,同时采取一个灰度阈值范围来进行辅助调节,并加上了灰度变化范围,防止大范围的跳变带来的图像抖动。The present invention synthesizes various situations that need to be considered. In order to solve the slow time-consuming scanning of the whole image, some areas can be removed by dividing the area to save scanning time. The division area is combined with the traffic sign detection module for sub-area exposure. The rapidity is the vehicle-mounted platform. One of the requirements, so in the initial adjustment, it is combined with the photosensitive characteristics of the CMOS sensor for quick adjustment, and at the same time, a gray threshold range is used for auxiliary adjustment, and the gray scale change range is added to prevent large-scale jump bands. The incoming image shakes.

并且,基于灰度阈值来进行调节的曝光方法,调节速度快,但是准确性不高,在某些特殊情况下曝光数值不是很理想,但是由于车载平台的快速性要求,所以采用此种方法进行大范围的调节,特殊情况中采用图像熵模块调节。对于逆光或者顺光的情况一直是车载自动曝光的难点所在,引入图像熵的评价调节对逆光的条件下对目标物进行更加准确的曝光调节。Moreover, the exposure method based on the grayscale threshold adjustment is fast, but the accuracy is not high. In some special cases, the exposure value is not very ideal, but due to the rapidity requirements of the vehicle platform, this method is used. Large-scale adjustment, in special cases, the image entropy module is used for adjustment. The situation of backlight or forward light has always been the difficulty of vehicle automatic exposure. The introduction of image entropy evaluation adjustment can make more accurate exposure adjustment for the target object under the condition of backlight.

因此,本发明具有以下有益效果:Therefore, the present invention has the following beneficial effects:

1、曝光具有很强的实时性,性能能够达到20帧/秒。1. The exposure has strong real-time performance, and the performance can reach 20 frames per second.

2、车载相机在顺逆光的转换情况下能够很快地识别并进行快速地反应曝光值。2. The car camera can quickly identify and respond to the exposure value in the case of forward and reverse light conversion.

3、在一些特殊的情况中,如通过桥洞前后,路面积水严重等的场景中也表现出来很强的适应性。3. In some special situations, such as before and after passing through the bridge hole, the scene of severe water accumulation on the road also shows strong adaptability.

4、在识别交通标志牌的时候由于加入了图像熵的元素,从而使识别率上升。4. When identifying traffic signs, the recognition rate increases due to the addition of image entropy elements.

5、整个流程在时间复杂性和空间复杂性上都很精简,减少了占用总系统的内存和消耗的时间。5. The whole process is very streamlined in terms of time complexity and space complexity, which reduces the memory occupied by the total system and the time consumed.

附图说明Description of drawings

图1是本发明实施例的流程图。Fig. 1 is a flowchart of an embodiment of the present invention.

具体实施方式Detailed ways

以下结合附图和实施例对本发明的技术方案进行详细说明。The technical solutions of the present invention will be described in detail below in conjunction with the drawings and embodiments.

参见图1,本发明实施例的车载相机的自动曝光方法工作流程如下:Referring to Fig. 1, the working procedure of the automatic exposure method of the vehicle-mounted camera according to the embodiment of the present invention is as follows:

步骤1,初始化:具体实施时,可以输入配置文件,包括初始曝光时间,曝光时间调节范围,标准灰度阈值范围Gt,符合PID调节的跳变范围Gp,灰度跳变防抖动范围Gc。所述PID是比例积分微分调节。本领域技术人员可以自行预设初始曝光时间和曝光时间调节范围、范围Gt/Gp/Gc的上下限取值。具体实施时,本领域的技术人员还可以自行进行其他方面的初始设定,例如增益的初始设定,以及相机的各个参数设置,一般包括巨帧的关闭,IP的配置,帧数的设置,白平衡调制,硬件设置为固定光圈数。Step 1, initialization: during specific implementation, configuration files can be input, including initial exposure time, exposure time adjustment range, standard grayscale threshold range Gt, jump range Gp conforming to PID adjustment, and grayscale jump anti-shake range Gc. The PID is proportional integral derivative regulation. Those skilled in the art can preset the initial exposure time, the adjustment range of the exposure time, and the upper and lower limits of the range Gt/Gp/Gc. During specific implementation, those skilled in the art can also perform initial settings in other aspects by themselves, such as initial settings of gain, and various parameter settings of the camera, generally including closing jumbo frames, IP configuration, frame number setting, White balance modulation, the hardware is set to a fixed f-stop.

步骤2,划分区域:设置ROI(感兴趣区域)。Step 2, divide the area: set the ROI (Region of Interest).

车载相机的具体功能并不是全部采景,车载相机只需要识别既定的目标就可以,而这些目标一般都分布在图像的各个区域,所以可采用区域曝光的策略,不仅减少的耗时,也保证了曝光调节的准确性和高效性。进行感兴趣区域的选取时,本领域技术人员可自行预设选取原则,建议去除相机镜头内下方无用汽车机箱盖区域,顶部天空区域以及两侧边缘,最后行成一个倒梯形区域。为预估曝光值,后续获取的帧图像都是只针对此感兴趣区域进行处理。具体实施时,可以预先设置区域遍历函数,供流程调用提取感兴趣区域;或者由用户自行手动选取感兴趣区域。The specific functions of the vehicle-mounted camera are not all the scene-finding. The vehicle-mounted camera only needs to identify the established targets, and these targets are generally distributed in various areas of the image. Therefore, the strategy of regional exposure can be adopted, which not only reduces time-consuming, but also ensures The accuracy and efficiency of exposure adjustment are improved. When selecting the region of interest, those skilled in the art can preset the selection principle by themselves. It is recommended to remove the useless car chassis cover area, the top sky area, and the edges on both sides of the camera lens, and finally form an inverted trapezoidal area. In order to estimate the exposure value, the subsequent acquired frame images are only processed for this region of interest. During specific implementation, the area traversal function can be preset for the process call to extract the area of interest; or the user can manually select the area of interest by himself.

步骤3,启动相机,第一帧的曝光时间是采用步骤1配置的初始曝光时间,在拍摄第一帧后获取第一帧图像灰度均值(只针对感兴趣区域提取灰度均值,后续其他帧同样),根据设定的标准灰度阈值范围Gt,进行以灰度阈值为标准的快速调节,根据调节结果设置得到第二帧的曝光时间,进入步骤9。Step 3: Start the camera. The exposure time of the first frame is the initial exposure time configured in step 1. After the first frame is shot, the average gray value of the image of the first frame is obtained (the gray average value is only extracted for the region of interest, and the subsequent frames of other frames Similarly), according to the set standard gray-scale threshold range Gt, perform a quick adjustment based on the gray-scale threshold as a standard, set the exposure time of the second frame according to the adjustment result, and enter step 9.

具体实施时,以灰度阈值为标准的快速调节具体实现可参见:赵芳,栾晓明,孙越等。基于灰度图像的曝光量估计方法[J]。应用科技,2009。此步骤实现也属于初始准备工作,图1省略了相关内容。For specific implementation, see: Zhao Fang, Luan Xiaoming, Sun Yue, etc. for specific implementation of fast adjustment based on the gray threshold. Exposure Estimation Method Based on Grayscale Image[J]. Applied Science and Technology, 2009. The implementation of this step also belongs to the initial preparation work, and the relevant content is omitted in Figure 1.

步骤4,防抖动调节:将当前帧的图像灰度均值与前一帧保留的图像灰度均值进行比较,两帧灰度均值差值ΔG变化没有超过步骤1设定的灰度抖动跳变范围Gc则保留采用当前帧的时间曝光值作为下一帧的时间曝光预估值,跳至步骤9。否则进入步骤5,开始进行分块调节。Step 4, anti-shake adjustment: compare the image grayscale average value of the current frame with the image grayscale average value retained in the previous frame, and the difference ΔG between the grayscale average values of the two frames does not exceed the grayscale jitter jump set in step 1 The range Gc retains the time exposure value of the current frame as the estimated time exposure value of the next frame, and skips to step 9. Otherwise, go to step 5 and start block adjustment.

由于第一帧的曝光时间是配置直接设定的初始曝光时间,第二帧是根据步骤3快速调节和步骤9控制所得结果,所以从第三帧开始,当前帧的图像灰度均值与前一帧保留的图像灰度均值进行比较,例如,第一次执行步骤4时,当前拍摄所得帧为第二帧,要确定曝光时间的下一帧为第三帧,目标为估计第三帧的曝光时间值,则将当前第二帧的图像灰度均值与第一帧保留的图像灰度均值进行比较。后续返回执行步骤4的方式相同。Since the exposure time of the first frame is the initial exposure time directly set by the configuration, and the second frame is the result obtained according to the quick adjustment in step 3 and the control in step 9, so starting from the third frame, the image gray value of the current frame is the same as that of the previous one. For example, when step 4 is executed for the first time, the currently captured frame is the second frame, and the next frame to determine the exposure time is the third frame, and the goal is to estimate the exposure of the third frame Time value, compare the image grayscale average value of the current second frame with the image grayscale average value retained in the first frame. Subsequent return to step 4 is performed in the same way.

不同于平时家用摄像头的摄像,在车载平台中,由于道路环境多变,外部情况复杂,所以曝光调节的数值并不是一个固定值,反而会在一个区域内不断的变化,而这种变化有时又会因为一个极短时间的跳变,如摄像头镜头被树荫遮挡而产生跳变,图像可能会产生忽明忽暗的变化,为了防止这种情况的发生,加入了防止抖动的调节限制,从而保证图像采集的稳定性。Different from the usual home camera camera, in the car platform, due to the changeable road environment and complex external conditions, the value of exposure adjustment is not a fixed value, but will continue to change in an area, and this change sometimes Because of a very short-term jump, such as the camera lens being blocked by a tree, the image may change from bright to dark. In order to prevent this from happening, an adjustment limit to prevent shaking has been added, so that Ensure the stability of image acquisition.

步骤5,图像熵调节:如果从当前帧图像检测到交通标志则进行基于图像熵的曝光调节,获取下一帧的时间曝光预估值,跳至步骤9。如果没有检测到则进入步骤6。Step 5, image entropy adjustment: If a traffic sign is detected from the current frame image, perform exposure adjustment based on image entropy, obtain the estimated time exposure value of the next frame, and skip to step 9. If not detected, go to step 6.

具体实施时车道线、交通标志、红绿灯等检测可采用相关现有技术,本发明只涉及曝光控制实现。基于图像熵的曝光调节可参见:杨作延,阮萍,翟波等。基于图像熵的高动态范围场景的自动曝光算法[J]。光子学报,2013。During specific implementation, the detection of lane lines, traffic signs, traffic lights, etc. can adopt relevant prior art, and the present invention only involves the realization of exposure control. Exposure adjustment based on image entropy can be found in: Yang Zuoyan, Ruan Ping, Zhai Bo, etc. An automatic exposure algorithm for high dynamic range scenes based on image entropy[J]. Acta Photonica Sinica, 2013.

步骤6,如果当前帧的图像灰度均值在步骤1预设标准灰度阈值范围Gt内(即)则直接保留采用当前帧的时间曝光值作为下一帧的时间曝光预估值,跳至步骤9。如果超出则进入步骤7。Step 6, if the image grayscale mean value of the current frame is within the preset standard grayscale threshold range Gt in step 1 (ie ) then directly retain the time exposure value of the current frame as the estimated time exposure value of the next frame, and skip to step 9. If exceeded, go to step 7.

步骤7,PID控制调节:根据步骤4所得当前帧的图像灰度均值与前一帧的图像灰度均值差值ΔG进一步判断,如果差值较小符合预设的跳变范围Gp(即),即还在可以精确调控的范围内,则进行根据灰度和曝光值比例的PID调节方法,获取下一帧的时间曝光预估值,跳至步骤9。如若超过精确调节范围过大,则进行步骤8。Step 7, PID control adjustment: further judge according to the difference ΔG between the image grayscale mean value of the current frame obtained in step 4 and the image grayscale mean value value ΔG of the previous frame, if the difference is small, it meets the preset jump range Gp (ie ), that is, within the range that can be precisely adjusted, then perform the PID adjustment method based on the ratio of grayscale and exposure value to obtain the estimated time exposure value of the next frame, and skip to step 9. If it exceeds the precise adjustment range too much, go to step 8.

具体实施时,根据灰度和曝光值比例的PID调节具体实现可参见:陈善伟,侯德鑫,叶树亮等.打火机火焰图像分析中的快速自动曝光方法[J].计算机工程,2011,37(23):200-202。During the specific implementation, the specific implementation of PID adjustment according to the ratio of grayscale and exposure value can be found in: Chen Shanwei, Hou Dexin, Ye Shuliang, etc. Fast automatic exposure method in lighter flame image analysis [J]. Computer Engineering, 2011, 37(23): 200-202.

步骤8,基于CMOS传感器调节:因为当前帧与前一帧对比跳变过大,则利用CMOS传感器特性进行快速查表的曝光方法,达到快速锁定曝光范围的效果,获取下一帧的时间曝光预估值,进入步骤9。Step 8, based on CMOS sensor adjustment: because the jump between the current frame and the previous frame is too large, use the CMOS sensor characteristics to quickly look up the exposure method to achieve the effect of quickly locking the exposure range, and obtain the time exposure preview of the next frame. Valuation, go to step 9.

具体实施时,利用CMOS传感器特性进行快速查表的曝光方法具体实现可参见:Vuong Q K,Yun S H,Kim S.A new auto exposure system to detect high dynamicrange conditions using CMOS technology[C].2008 Third International Conferenceon Convergence and Hybrid Information Technology,Busan 2008:577-580.During specific implementation, the specific implementation of the exposure method of using the characteristics of CMOS sensors to quickly look up the table can be found in: Vuong Q K, Yun S H, Kim S.A new auto exposure system to detect high dynamic range conditions using CMOS technology [C]. 2008 Third International Conference on Convergence and Hybrid Information Technology, Busan 2008:577-580.

步骤9,曝光阈值范围控制:对当前所得下一帧的时间曝光预估值根据步骤1中的曝光时间调节范围进行控制,如果下一帧的时间曝光预估值大于曝光时间调节范围的最大值,则取最大值为最终确定的下一帧的时间曝光值,如果小于曝光时间调节范围的最小值,则取最小值为最终确定的下一帧的时间曝光值,如果在曝光时间调节范围内则直接设置下一帧的时间曝光预估值为最终的确定的下一帧的时间曝光值,据此控制相机拍摄得到下一帧后,返回步骤4开始将下一帧作为新的当前帧进行循环,可自动进行直到用户要求停止。Step 9, exposure threshold range control: control the estimated time exposure value of the next frame currently obtained according to the exposure time adjustment range in step 1, if the estimated time exposure value of the next frame is greater than the maximum value of the exposure time adjustment range , then take the maximum value as the final time exposure value of the next frame, if it is less than the minimum value of the exposure time adjustment range, then take the minimum value as the final time exposure value of the next frame, if it is within the exposure time adjustment range Then directly set the time exposure estimate value of the next frame as the final determined time exposure value of the next frame, and then control the camera to capture the next frame, and then return to step 4 to start taking the next frame as the new current frame Loop, which can run automatically until the user asks to stop.

为证明本发明效果,可对各方法进行测试,依据耗时及帧率来判断效果,测试表格如下:In order to prove the effect of the present invention, each method can be tested, and the effect can be judged according to the time-consuming and frame rate. The test table is as follows:

各方法测试依据耗时及帧率来判断效果,测试表格如下:Each method test is based on the time-consuming and frame rate to judge the effect. The test table is as follows:

可见本发明所提供方法提高识别率的效果显著,并且耗时不会延长。It can be seen that the method provided by the present invention has a significant effect of improving the recognition rate, and the time consumption will not be prolonged.

具体实施时,本发明所提供方法可以采用软件技术实现自动运行,也可以采用模块化方式提供相应系统。本发明实施例还提供一种车载相机的自动曝光系统,包括以下模块:During specific implementation, the method provided by the present invention can use software technology to realize automatic operation, and can also provide a corresponding system in a modular manner. The embodiment of the present invention also provides an automatic exposure system for a vehicle-mounted camera, including the following modules:

初始化模块,用于配置初始曝光时间、曝光时间调节范围、标准灰度阈值范围Gt、符合PID调节的跳变范围Gp和灰度跳变防抖动范围Gc;The initialization module is used to configure the initial exposure time, exposure time adjustment range, standard grayscale threshold range Gt, jump range Gp conforming to PID adjustment, and grayscale jump anti-shake range Gc;

区域划分模块,用于设置感兴趣区域,对每帧图像都将只针对感兴趣区域进行处理;The region division module is used to set the region of interest, and each frame of image will only be processed for the region of interest;

初始启动模块,用于启动相机,第一帧的曝光时间采用初始化模块配置的初始曝光时间,在拍摄第一帧后针对感兴趣区域获取第一帧图像灰度均值,根据设定的标准灰度阈值范围Gt,进行以灰度阈值为标准的快速调节,根据调节结果设置第二帧的曝光时间,命令控制模块工作;The initial startup module is used to start the camera. The exposure time of the first frame adopts the initial exposure time configured by the initialization module. After the first frame is shot, the average gray value of the first frame image is obtained for the region of interest. According to the set standard gray Threshold range Gt, perform quick adjustment based on the gray threshold as the standard, set the exposure time of the second frame according to the adjustment result, and order the control module to work;

防抖动调节模块,用于将当前帧的图像灰度均值与前一帧的图像灰度均值进行比较,若两帧灰度均值差值ΔG变化没有超过初始化模块设定的灰度抖动跳变范围Gc则保留采用当前帧的时间曝光值作为下一帧的时间曝光预估值,命令控制模块工作,否则命令图像熵调节模块工作;The anti-shake adjustment module is used to compare the image grayscale mean value of the current frame with the image grayscale mean value of the previous frame, if the difference ΔG of the grayscale mean value difference between the two frames does not exceed the grayscale jitter jump set by the initialization module The range Gc then retains the time exposure value of the current frame as the estimated time exposure value of the next frame, and commands the control module to work, otherwise the image entropy adjustment module is ordered to work;

图像熵调节模块,用于如果从当前帧图像检测到交通标志则进行基于图像熵的曝光调节,获取下一帧的时间曝光预估值,命令控制模块工作,否则命令标准判断模块工作;The image entropy adjustment module is used to perform exposure adjustment based on image entropy if a traffic sign is detected from the current frame image, obtain the estimated time exposure value of the next frame, and order the control module to work, otherwise order the standard judgment module to work;

标准判断模块,用于如果当前帧的图像灰度均值在初始化模块预设标准灰度阈值范围Gt内,则直接采用当前帧的时间曝光值作为下一帧的时间曝光预估值,命令控制模块工作,否则命令PID控制调节模块工作;A standard judging module, used to directly adopt the time exposure value of the current frame as the estimated time exposure value of the next frame if the image grayscale mean value of the current frame is within the preset standard grayscale threshold range Gt of the initialization module, and order the control module work, otherwise order the PID control adjustment module to work;

PID控制调节模块,用于根据防抖动调节模块所得当前帧的图像灰度均值与前一帧的图像灰度均值的差值ΔG进一步判断,如果在初始化模块预设的跳变范围Gp内,则进行根据灰度和曝光值比例的PID调节,获取下一帧的时间曝光预估值,命令控制模块工作,否则命令CMOS传感器调节模块工作;The PID control adjustment module is used to further judge according to the difference ΔG between the image grayscale average value of the current frame obtained by the anti-shake adjustment module and the image grayscale average value of the previous frame, if it is within the jump range Gp preset by the initialization module, Then perform PID adjustment according to the ratio of grayscale and exposure value, obtain the estimated time exposure value of the next frame, order the control module to work, otherwise order the CMOS sensor adjustment module to work;

CMOS传感器调节模块,用于进行利用CMOS传感器特性进行快速查表的曝光方法,获取下一帧的时间曝光预估值,命令控制模块工作;The CMOS sensor adjustment module is used to perform an exposure method using the characteristics of the CMOS sensor to quickly look up the table, obtain the estimated time exposure value of the next frame, and command the control module to work;

控制模块,用于对当前所得下一帧的时间曝光预估值根据初始化模块中的曝光时间调节范围进行控制,如果下一帧的时间曝光预估值大于曝光时间调节范围的最大值,则取最大值为最终确定的下一帧的时间曝光值,如果小于曝光时间调节范围的最小值,则取最小值为最终确定的下一帧的时间曝光值,如果在曝光时间调节范围内则直接设置下一帧的时间曝光预估值为最终的确定的下一帧的时间曝光值;根据最终确定的时间曝光值控制相机拍摄得到下一帧后,返回命令防抖动调节模块工作,将下一帧作为新的当前帧进行循环。The control module is used to control the current estimated time exposure value of the next frame according to the exposure time adjustment range in the initialization module. If the time exposure estimate value of the next frame is greater than the maximum value of the exposure time adjustment range, take The maximum value is the final time exposure value of the next frame. If it is less than the minimum value of the exposure time adjustment range, take the minimum value as the final time exposure value of the next frame. If it is within the exposure time adjustment range, set it directly The estimated value of the time exposure of the next frame is the final determined time exposure value of the next frame; after controlling the camera to capture the next frame according to the final determined time exposure value, return to order the anti-shake adjustment module to work, and set the next frame The frame is cycled through as the new current frame.

进一步地,区域划分模块中设置感兴趣区域时,去除相机镜头内下方无用的汽车机箱盖区域,顶部天空区域以及两侧边缘。Further, when the region of interest is set in the region division module, the useless car chassis cover region, the top sky region and the edges on both sides of the camera lens are removed.

以上实施例仅供说明本发明之用,而非对本发明的限制,有关技术领域的技术人员,在不脱离本发明的精神和范围的情况下,还可以做出各种变换或变型,因此所有等同的技术方案,都落入本发明的保护范围。The above embodiments are only for the purpose of illustrating the present invention, rather than limiting the present invention. Those skilled in the relevant technical fields can also make various changes or modifications without departing from the spirit and scope of the present invention. Therefore, all Equivalent technical solutions all fall within the protection scope of the present invention.

Claims (4)

1.一种车载相机的自动曝光方法,其特征在于,包括以下步骤:1. an automatic exposure method for a vehicle-mounted camera, comprising the following steps: 步骤1,初始化,包括配置初始曝光时间、曝光时间调节范围、标准灰度阈值范围Gt、符合PID调节的跳变范围Gp和灰度跳变防抖动范围Gc;Step 1, initialization, including configuring initial exposure time, exposure time adjustment range, standard grayscale threshold range Gt, jump range Gp conforming to PID adjustment, and grayscale jump anti-shake range Gc; 步骤2,设置感兴趣区域,对每帧图像都将只针对感兴趣区域进行处理;Step 2, set the region of interest, and each frame of image will only be processed for the region of interest; 步骤3,启动相机,第一帧的曝光时间采用步骤1配置的初始曝光时间,在拍摄第一帧后针对感兴趣区域获取第一帧图像灰度均值,根据设定的标准灰度阈值范围Gt,进行以灰度阈值为标准的快速调节,根据调节结果设置第二帧的曝光时间,进入步骤9;Step 3: Start the camera. The exposure time of the first frame adopts the initial exposure time configured in step 1. After the first frame is shot, the average gray value of the image of the first frame is obtained for the region of interest. According to the set standard gray threshold range Gt , perform a quick adjustment based on the gray threshold value, set the exposure time of the second frame according to the adjustment result, and go to step 9; 步骤4,将当前帧的图像灰度均值与前一帧的图像灰度均值进行比较,若两帧灰度均值差值ΔG变化没有超过步骤1设定的灰度跳变防抖动范围Gc则保留采用当前帧的时间曝光值作为下一帧的时间曝光预估值,进入步骤9,否则进入步骤5;Step 4: Compare the image grayscale average value of the current frame with the image grayscale average value of the previous frame, if the difference ΔG of the grayscale average value of the two frames does not exceed the grayscale jump anti-shake range Gc set in step 1, then Keep the time exposure value of the current frame as the estimated time exposure value of the next frame, go to step 9, otherwise go to step 5; 步骤5,如果从当前帧图像检测到交通标志则进行基于图像熵的曝光调节,获取下一帧的时间曝光预估值,进入步骤9,否则进入步骤6;Step 5, if a traffic sign is detected from the current frame image, perform exposure adjustment based on image entropy, obtain the estimated time exposure value of the next frame, and go to step 9, otherwise go to step 6; 步骤6,如果当前帧的图像灰度均值在步骤1预设标准灰度阈值范围Gt内,则直接采用当前帧的时间曝光值作为下一帧的时间曝光预估值,进入步骤9,否则进入步骤7;Step 6, if the image grayscale mean value of the current frame is within the preset standard grayscale threshold range Gt in step 1, then directly use the time exposure value of the current frame as the estimated time exposure value of the next frame, and go to step 9, otherwise go to Step 7; 步骤7,根据步骤4所得当前帧的图像灰度均值与前一帧的图像灰度均值的差值ΔG进一步判断,如果在步骤1预设的跳变范围Gp内,则进行根据灰度和曝光值比例的PID调节,获取下一帧的时间曝光预估值,进入步骤9,否则进行步骤8;Step 7, further judge according to the difference ΔG between the image grayscale average value of the current frame and the image grayscale average value of the previous frame obtained in step 4, if it is within the jump range Gp preset in step 1, then proceed according to the grayscale and exposure PID adjustment of the value ratio, obtain the estimated time exposure value of the next frame, go to step 9, otherwise go to step 8; 步骤8,进行利用CMOS传感器特性进行快速查表的曝光方法,获取下一帧的时间曝光预估值,进入步骤9;Step 8, carry out the exposure method of using the characteristics of the CMOS sensor to quickly look up the table, obtain the estimated time exposure value of the next frame, and enter step 9; 步骤9,对当前所得下一帧的时间曝光预估值根据步骤1中的曝光时间调节范围进行控制,如果下一帧的时间曝光预估值大于曝光时间调节范围的最大值,则取最大值为最终确定的下一帧的时间曝光值,如果小于曝光时间调节范围的最小值,则取最小值为最终确定的下一帧的时间曝光值,如果在曝光时间调节范围内则直接设置下一帧的时间曝光预估值为最终的确定的下一帧的时间曝光值;根据最终确定的时间曝光值控制相机拍摄得到下一帧后,返回步骤4,将下一帧作为新的当前帧进行循环。Step 9: Control the current estimated time exposure value of the next frame according to the exposure time adjustment range in step 1. If the time exposure estimate value of the next frame is greater than the maximum value of the exposure time adjustment range, take the maximum value is the time exposure value of the next frame finally determined, if it is less than the minimum value of the exposure time adjustment range, take the minimum value as the final time exposure value of the next frame, if it is within the exposure time adjustment range, directly set the next The estimated time exposure value of a frame is the final determined time exposure value of the next frame; after controlling the camera to capture the next frame according to the final determined time exposure value, return to step 4, and use the next frame as the new current frame cycle. 2.根据权利要求1所述车载相机的自动曝光方法,其特征在于:步骤2中设置感兴趣区域时,去除相机镜头内下方无用的汽车机箱盖区域,顶部天空区域以及两侧边缘。2. The automatic exposure method of the vehicle-mounted camera according to claim 1, characterized in that: when the region of interest is set in step 2, the useless car chassis cover area, top sky area and both sides of the camera lens are removed. 3.一种车载相机的自动曝光系统,其特征在于,包括以下模块:3. An automatic exposure system for a vehicle-mounted camera, comprising the following modules: 初始化模块,用于配置初始曝光时间、曝光时间调节范围、标准灰度阈值范围Gt、符合PID调节的跳变范围Gp和灰度跳变防抖动范围Gc;The initialization module is used to configure the initial exposure time, exposure time adjustment range, standard grayscale threshold range Gt, jump range Gp conforming to PID adjustment, and grayscale jump anti-shake range Gc; 区域划分模块,用于设置感兴趣区域,对每帧图像都将只针对感兴趣区域进行处理;The region division module is used to set the region of interest, and each frame of image will only be processed for the region of interest; 初始启动模块,用于启动相机,第一帧的曝光时间采用初始化模块配置的初始曝光时间,在拍摄第一帧后针对感兴趣区域获取第一帧图像灰度均值,根据设定的标准灰度阈值范围Gt,进行以灰度阈值为标准的快速调节,根据调节结果设置第二帧的曝光时间,命令控制模块工作;The initial startup module is used to start the camera. The exposure time of the first frame adopts the initial exposure time configured by the initialization module. After the first frame is shot, the average gray value of the first frame image is obtained for the region of interest. According to the set standard gray Threshold range Gt, perform quick adjustment based on the gray threshold as the standard, set the exposure time of the second frame according to the adjustment result, and order the control module to work; 防抖动调节模块,用于将当前帧的图像灰度均值与前一帧的图像灰度均值进行比较,若两帧灰度均值差值ΔG变化没有超过初始化模块设定的灰度跳变防抖动范围Gc则保留采用当前帧的时间曝光值作为下一帧的时间曝光预估值,命令控制模块工作,否则命令图像熵调节模块工作;The anti-shake adjustment module is used to compare the image gray level mean value of the current frame with the image gray level mean value of the previous frame. The jitter range Gc then retains the time exposure value of the current frame as the estimated time exposure value of the next frame, and the command control module works, otherwise the image entropy adjustment module is commanded to work; 图像熵调节模块,用于如果从当前帧图像检测到交通标志则进行基于图像熵的曝光调节,获取下一帧的时间曝光预估值,命令控制模块工作,否则命令标准判断模块工作;The image entropy adjustment module is used to perform exposure adjustment based on image entropy if a traffic sign is detected from the current frame image, obtain the estimated time exposure value of the next frame, and order the control module to work, otherwise order the standard judgment module to work; 标准判断模块,用于如果当前帧的图像灰度均值在初始化模块预设标准灰度阈值范围Gt内,则直接采用当前帧的时间曝光值作为下一帧的时间曝光预估值,命令控制模块工作,否则命令PID控制调节模块工作;A standard judging module, used to directly adopt the time exposure value of the current frame as the estimated time exposure value of the next frame if the image grayscale mean value of the current frame is within the preset standard grayscale threshold range Gt of the initialization module, and order the control module work, otherwise order the PID control adjustment module to work; PID控制调节模块,用于根据防抖动调节模块所得当前帧的图像灰度均值与前一帧的图像灰度均值的差值ΔG进一步判断,如果在初始化模块预设的跳变范围Gp内,则进行根据灰度和曝光值比例的PID调节,获取下一帧的时间曝光预估值,命令控制模块工作,否则命令CMOS传感器调节模块工作;The PID control adjustment module is used to further judge according to the difference ΔG between the image grayscale average value of the current frame obtained by the anti-shake adjustment module and the image grayscale average value of the previous frame, if it is within the jump range Gp preset by the initialization module, Then perform PID adjustment according to the ratio of grayscale and exposure value, obtain the estimated time exposure value of the next frame, order the control module to work, otherwise order the CMOS sensor adjustment module to work; CMOS传感器调节模块,用于进行利用CMOS传感器特性进行快速查表的曝光方法,获取下一帧的时间曝光预估值,命令控制模块工作;The CMOS sensor adjustment module is used to perform an exposure method using the characteristics of the CMOS sensor to quickly look up the table, obtain the estimated time exposure value of the next frame, and command the control module to work; 控制模块,用于对当前所得下一帧的时间曝光预估值根据初始化模块中的曝光时间调节范围进行控制,如果下一帧的时间曝光预估值大于曝光时间调节范围的最大值,则取最大值为最终确定的下一帧的时间曝光值,如果小于曝光时间调节范围的最小值,则取最小值为最终确定的下一帧的时间曝光值,如果在曝光时间调节范围内则直接设置下一帧的时间曝光预估值为最终的确定的下一帧的时间曝光值;根据最终确定的时间曝光值控制相机拍摄得到下一帧后,返回命令防抖动调节模块工作,将下一帧作为新的当前帧进行循环。The control module is used to control the current estimated time exposure value of the next frame according to the exposure time adjustment range in the initialization module. If the time exposure estimate value of the next frame is greater than the maximum value of the exposure time adjustment range, take The maximum value is the final time exposure value of the next frame. If it is less than the minimum value of the exposure time adjustment range, take the minimum value as the final time exposure value of the next frame. If it is within the exposure time adjustment range, set it directly The estimated value of the time exposure of the next frame is the final determined time exposure value of the next frame; after controlling the camera to capture the next frame according to the final determined time exposure value, return to order the anti-shake adjustment module to work, and set the next frame The frame is cycled through as the new current frame. 4.根据权利要求3所述车载相机的自动曝光系统,其特征在于:区域划分模块中设置感兴趣区域时,去除相机镜头内下方无用的汽车机箱盖区域,顶部天空区域以及两侧边缘。4. The automatic exposure system of the vehicle-mounted camera according to claim 3, characterized in that: when the region of interest is set in the region division module, the useless car chassis cover region, top sky region and both sides of the camera lens are removed.
CN201510968340.8A 2015-12-21 2015-12-21 The automatic explosion method and system of in-vehicle camera Expired - Fee Related CN105635597B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510968340.8A CN105635597B (en) 2015-12-21 2015-12-21 The automatic explosion method and system of in-vehicle camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510968340.8A CN105635597B (en) 2015-12-21 2015-12-21 The automatic explosion method and system of in-vehicle camera

Publications (2)

Publication Number Publication Date
CN105635597A CN105635597A (en) 2016-06-01
CN105635597B true CN105635597B (en) 2018-07-27

Family

ID=56050045

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510968340.8A Expired - Fee Related CN105635597B (en) 2015-12-21 2015-12-21 The automatic explosion method and system of in-vehicle camera

Country Status (1)

Country Link
CN (1) CN105635597B (en)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107613190B (en) * 2016-07-11 2020-11-03 中兴通讯股份有限公司 Photographing method and terminal
CN106303279B (en) * 2016-08-31 2019-08-09 北京数字精准医疗科技有限公司 Multi-spectrum endoscopic automatic exposure imaging method
CN106791476A (en) * 2017-01-25 2017-05-31 北京图森未来科技有限公司 A kind of image-pickup method and device
CN111526301A (en) * 2017-08-17 2020-08-11 吴彬 Terminal capable of improving image quality of shot video
CN107592470A (en) * 2017-09-21 2018-01-16 陕西土豆数据科技有限公司 A kind of exposure algorithm applied to more lens sensors
CN107592469B (en) * 2017-10-23 2021-01-05 努比亚技术有限公司 Exposure value adjusting method, mobile terminal and readable storage medium
CN108174114B (en) * 2017-12-08 2020-06-30 上海集成电路研发中心有限公司 Entropy calculation device and entropy calculation method
CN108600622B (en) * 2018-04-12 2021-12-24 联想(北京)有限公司 Video anti-shake method and device
CN108900782B (en) * 2018-08-22 2020-01-24 Oppo广东移动通信有限公司 Exposure control method, device, and electronic device
CN109639994B (en) * 2019-01-03 2020-08-07 湖北工业大学 Dynamic adjustment method of exposure time of embedded vehicle camera
CN110708473B (en) * 2019-11-14 2022-04-15 深圳市道通智能航空技术股份有限公司 High dynamic range image exposure control method, aerial camera and unmanned aerial vehicle
CN113160590B (en) * 2020-01-23 2023-02-03 华为技术有限公司 Smart car control method, device and related equipment
CN111432134A (en) * 2020-03-17 2020-07-17 广东博智林机器人有限公司 Method and device for determining exposure time of image acquisition equipment and processor
CN112153360B (en) * 2020-08-24 2022-03-18 青岛小鸟看看科技有限公司 Method, device and device for determining exposure parameters of head-mounted device
CN112351217A (en) * 2020-11-04 2021-02-09 中冶赛迪技术研究中心有限公司 Image enhancement type waterproof holder image acquisition system and method
CN114866703B (en) * 2021-02-03 2024-12-24 浙江舜宇智能光学技术有限公司 Active exposure method, device and electronic equipment based on TOF imaging system
CN115516397B (en) 2021-04-20 2025-07-08 百度时代网络技术(北京)有限公司 Traffic light detection and classification for autonomous vehicles
CN113657427B (en) * 2021-06-29 2024-01-23 东风汽车集团股份有限公司 In-vehicle multi-source image fusion recognition method and device
CN115278095A (en) * 2022-05-11 2022-11-01 岚图汽车科技有限公司 Vehicle-mounted camera control method and device based on fusion perception
CN116095499B (en) * 2022-12-30 2025-04-04 奥比中光科技集团股份有限公司 A self-adjusting method for exposure time and a self-adjusting depth camera for exposure time
CN117615244B (en) * 2024-01-22 2024-04-02 四川群源科技有限公司 Driving method and device of image pickup equipment and electronic equipment
CN117896622B (en) * 2024-03-15 2024-06-11 深圳赛尔智控科技有限公司 Image local overexposure adjustment method, device and equipment and readable storage medium
CN120563525B (en) * 2025-08-02 2025-10-03 上海帆声图像科技有限公司 Liquid crystal display screen dirt detection method based on multiple exposure

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1547075A (en) * 2003-12-05 2004-11-17 A Method for Improving Auto Exposure in Low Light Conditions
CN101119439A (en) * 2007-08-22 2008-02-06 东风汽车有限公司 Automatic control method for clear lane image shooting by vehicle-mounted camera
CN102369723A (en) * 2011-08-29 2012-03-07 华为终端有限公司 Auto exposure method and device, and imaging device
CN104301622A (en) * 2014-09-30 2015-01-21 上海微小卫星工程中心 A method and device for adaptive control of space-based space target imaging exposure time

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011056994A2 (en) * 2009-11-04 2011-05-12 Board Of Regents, The University Of Texas System Adaptive automatic exposure apparatus and method for digital images
FR2954034B1 (en) * 2009-12-16 2012-07-20 St Microelectronics Grenoble 2 CONTROL OF A DYNAMIC IMAGE SENSOR

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1547075A (en) * 2003-12-05 2004-11-17 A Method for Improving Auto Exposure in Low Light Conditions
CN101119439A (en) * 2007-08-22 2008-02-06 东风汽车有限公司 Automatic control method for clear lane image shooting by vehicle-mounted camera
CN102369723A (en) * 2011-08-29 2012-03-07 华为终端有限公司 Auto exposure method and device, and imaging device
CN104301622A (en) * 2014-09-30 2015-01-21 上海微小卫星工程中心 A method and device for adaptive control of space-based space target imaging exposure time

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
一种面向无人驾驶汽车的高效交通标志识别方法;宋文杰等;《机器人》;20150115;第37卷(第1期);第102-111页 *
基于图像熵的高动态范围场景的自动曝光算法;杨作廷等;《光子学报》;20130531;第42卷(第6期);第742-746页 *

Also Published As

Publication number Publication date
CN105635597A (en) 2016-06-01

Similar Documents

Publication Publication Date Title
CN105635597B (en) The automatic explosion method and system of in-vehicle camera
EP2913993B1 (en) Method and control unit for controlling exposure of a camera
US8045014B2 (en) Auto white balance correction value calculation device, method, program, and image pickup device
CN101304489B (en) Automatic exposure method and apparatus
CN106357987B (en) A kind of exposure method and device
CN113306486B (en) In-vehicle lighting device control method, storage medium, and electronic apparatus
CN101184168B (en) License plate luminance contrast based camera shutter and gain composite control method
US20140232854A1 (en) Apparatus to recognize illumination environment of vehicle and control method thereof
CN105242481A (en) Control method and device of light ring
CN114143940B (en) Tunnel illumination control method, device, equipment and storage medium
CN106161984B (en) Video image highlight suppression, contour and detail enhancement processing method and system
JP5260696B2 (en) Edge point extraction device, lane detection device, and program
CN105915811A (en) Image strong light inhibition adaptation control method and device
JP2013005234A (en) On-vehicle camera device
CN102547132A (en) Method and device for carrying out shooting under backlighting condition, and camera
US20180191949A1 (en) Method and system for image-based dynamic feature enhancement
CN106941588B (en) Data processing method and electronic equipment
CN112291481B (en) Exposure automatic adjusting method and device, electronic equipment and storage medium
CN103747188A (en) Control method of P-iris lens aperture of security device and device thereof
JP2012088785A (en) Object identification device and program
CN111666869B (en) Face recognition method and device based on wide dynamic processing and electronic equipment
CN113780262A (en) Intelligent illumination compensation method, device, equipment and system for face recognition
CN102842025B (en) The detection scene determination methods of video image and device
CN107948620B (en) Binocular camera debugging method based on advanced driving assistance system
CN116503822A (en) Image recognition method and device and electronic equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180727

Termination date: 20201221

CF01 Termination of patent right due to non-payment of annual fee