CN106525244A - Infrared fusion visual detection system - Google Patents
Infrared fusion visual detection system Download PDFInfo
- Publication number
- CN106525244A CN106525244A CN201610894127.1A CN201610894127A CN106525244A CN 106525244 A CN106525244 A CN 106525244A CN 201610894127 A CN201610894127 A CN 201610894127A CN 106525244 A CN106525244 A CN 106525244A
- Authority
- CN
- China
- Prior art keywords
- infrared
- subsystem
- optical fiber
- ofb
- vision
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/02—Constructional details
- G01J5/08—Optical arrangements
- G01J5/0818—Waveguides
- G01J5/0821—Optical fibres
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/10—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
- G01J5/12—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/10—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
- G01J5/12—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using thermoelectric elements, e.g. thermocouples
- G01J2005/123—Thermoelectric array
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Radiation Pyrometers (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
本发明公开了一种基于光纤束层析及红外多目视觉的融合视觉探测系统,系统包括光纤束层析子系统、红外视觉子系统、千兆交换机及计算机。千兆交换机将计算机、光纤束层析子系统与红外视觉子系统组成千兆局域网,所有处理端RJ45网络接口以及传感端RJ45网络接口及计算机的网络接口都通过双绞线与千兆交换机的网络接口相连。计算机通过该千兆局域网对光纤束层析子系统与红外视觉子系统进行控制,并获取光纤束层析子系统的处理结果及与红外视觉子系统输出的红外图像数据。本发明的有益效果是,采用MV重建目标三维红外表面形貌,区分光学薄与光学厚区域,并得到OFBT边界约束条件;OFBT重建光学薄区域内部分布;两者的信息融合解决复杂对象的三维热像检测的难题。
The invention discloses a fusion vision detection system based on optical fiber bundle tomography and infrared multi-eye vision. The system includes an optical fiber bundle tomography subsystem, an infrared vision subsystem, a gigabit switch and a computer. The Gigabit switch forms the Gigabit local area network with the computer, the optical fiber bundle tomography subsystem and the infrared vision subsystem. The network interface is connected. The computer controls the optical fiber bundle tomography subsystem and the infrared vision subsystem through the gigabit local area network, and obtains the processing results of the optical fiber bundle tomography subsystem and the infrared image data output by the infrared vision subsystem. The beneficial effect of the present invention is that the MV is used to reconstruct the three-dimensional infrared surface topography of the target, distinguish optically thin and optically thick regions, and obtain OFBT boundary constraints; OFBT reconstructs the internal distribution of optically thin regions; the information fusion of the two solves the three-dimensional of complex objects The challenge of thermal imaging inspection.
Description
技术领域technical field
本发明涉及一种红外融合视觉探测系统,尤其涉及一种基于光纤束层析及红外多目视觉的融合视觉探测系统。The invention relates to an infrared fusion vision detection system, in particular to a fusion vision detection system based on optical fiber bundle tomography and infrared multi-eye vision.
背景技术Background technique
红外热像技术是利用红外探测器将不可见的红外辐射转换成可见图像的一种技术。其发展初期常采用红外单元传感器结合光机扫描装置获取目标红外图像。上世纪八十年代开始,国际上开始研究并应用红外焦平面阵列(IRFPA)作为热像仪中的传感器,包括制冷型及非制冷型IRFPA,及量子阱(QWIP)、量子点(QDIP)等基于量子效应的新型探测器等。国际上第三代IRFPA已在成像面积、像元规模及多色成像等方面取得进展,如美国Teledyne公司为NASA 2011年投入使用的韦伯太空望远镜提供了高达4096×4096像元的碲镉汞IRFPA;另外1024×1024像元的QWIP中长波IRFPA及四色IRFPA也已研制成功。Infrared thermal imaging technology is a technology that uses infrared detectors to convert invisible infrared radiation into visible images. In the early stages of its development, infrared unit sensors are often used in combination with optical-mechanical scanning devices to obtain target infrared images. Since the 1980s, the international community began to study and apply infrared focal plane array (IRFPA) as a sensor in a thermal imager, including cooled and uncooled IRFPA, and quantum well (QWIP), quantum dot (QDIP), etc. New detectors based on quantum effects, etc. The third-generation IRFPA has made progress in the imaging area, pixel scale and multi-color imaging in the world. For example, Teledyne of the United States provided the HgCdTe IRFPA with a pixel size of 4096×4096 for NASA’s Webb Space Telescope in 2011. ; Another 1024 × 1024 pixel QWIP medium and long wave IRFPA and four-color IRFPA have also been successfully developed.
虽然高分辨IRFPA提高了热图像的分辨率,但常规红外热像方法只能获取目标局部成像平面热像图,其提供的信息有限。目前航空航天、国防军事、工业各部门对能提供目标精确信息的热像技术的需求迫切。由于实际目标大都包括部分光学厚表面或部分处于光学厚材料构成的外界障碍的包围之中,对目标的红外立体探测成为巨大的难题,急需目标红外体热像的测量方法与手段。Although high-resolution IRFPA improves the resolution of thermal images, conventional infrared thermal imaging methods can only obtain the thermal image of the target local imaging plane, which provides limited information. At present, there is an urgent need for thermal imaging technology that can provide accurate target information in aerospace, national defense and military, and various industrial sectors. Since the actual target mostly includes part of the optically thick surface or is partly surrounded by external obstacles composed of optically thick materials, the infrared stereo detection of the target has become a huge problem, and the measurement method and means of the infrared volume thermal image of the target are urgently needed.
针对该问题,本发明提出一种红外融合视觉方法,将自由空间光纤束层析(Optical Fiber Bundle Tomography in Free Space,简称OFBT)与多目视觉(Multi-viewVision,简称MV)信息融合。以实现待测目标立体热成像并可计算发射率、透射率、温度等物理参数的三维分布。To solve this problem, the present invention proposes an infrared fusion vision method, which fuses information from Optical Fiber Bundle Tomography in Free Space (OFBT for short) and Multi-view Vision (MV for short). In order to realize the three-dimensional thermal imaging of the target to be measured and calculate the three-dimensional distribution of physical parameters such as emissivity, transmittance, and temperature.
发明内容Contents of the invention
本发明的目的在于提供一种基于光纤束层析及红外多目视觉的融合视觉探测系统。以MV重构目标表面光学厚区域黑体通带辐射强度分布,并将MV重构的目标表面不同区域边界点坐标及其对应的通带黑体辐射强度作为OFBT约束条件,高精度反演目标光学薄区域内部各点对应的通带黑体辐射强度场分布,从而实现待测目标立体热成像并计算出其空间三维热物理量分布。The purpose of the present invention is to provide a fusion vision detection system based on optical fiber bundle tomography and infrared multi-eye vision. Using MV to reconstruct the blackbody passband radiation intensity distribution in the optically thick area of the target surface, and using the coordinates of the boundary points of different regions of the target surface reconstructed by MV and the corresponding passband blackbody radiation intensity as OFBT constraints, high-precision inversion of the target optically thin The passband blackbody radiation intensity field distribution corresponding to each point in the area, so as to realize the three-dimensional thermal imaging of the target to be measured and calculate its three-dimensional thermal physical quantity distribution.
本发明的技术方案是这样来实现的,基于光纤束层析及红外多目视觉的融合视觉探测的硬件系统主要由测试平台、光纤束层析子系统、红外视觉子系统、千兆交换机、计算机组成;The technical scheme of the present invention is realized in this way, the hardware system based on the fusion visual detection of optical fiber bundle tomography and infrared multi-eye vision mainly consists of a test platform, an optical fiber bundle tomography subsystem, an infrared vision subsystem, a gigabit switch, a computer composition;
其中光纤束层析子系统包含有n个OFB(即Optical fiber bundle,光纤束),n为大于等于4的整数,即从第一个OFB、第二个OFB、第三个OFB一直到第n个OFB;n个三角架、n个空间滤波器;n个通带滤光片;n个长波器件阵列及其对应的模拟放大器和数字信号处理电路;Wherein, the optical fiber bundle tomography subsystem includes n OFBs (that is, Optical fiber bundles, optical fiber bundles), and n is an integer greater than or equal to 4, that is, from the first OFB, the second OFB, the third OFB to the nth OFB One OFB; n tripods, n spatial filters; n passband filters; n long-wave device arrays and their corresponding analog amplifiers and digital signal processing circuits;
每个OFB由p根均匀分布的光纤传感单元组成,p为大于等于10的整数的平方。每根光纤传感单元由传感头、输入耦合器、传感光纤、输出耦合器、长波单元器件组成。属于一个OFB的p根光纤传感单元中的共计p个长波单元器件按顺序排列组成一个长波器件阵列。光纤传感单元的传感头的外径与空间滤波器的定位孔的内径相当,属于一个OFB的根光纤传感单元中的共计个传感头作为一组,按顺序装进空间滤波器的定位孔中并固定,传感头中心开有准直孔,允许光线沿直线进入传感头;空间滤波器前装配同尺寸的通带滤光片,对进入OFB所有光纤传感单元的光进行通带滤光;每个OFB都固定在三角架的云台上,其位置可方便调节;传感光纤通过输入耦合器与传感头连接,通过输出耦合器与长波单元器件相连;长波器件阵列的传感信号可经模拟放大器进行放大,再经数字信号处理电路进行处理,处理结果通过处理端RJ45网络接口向外传送;Each OFB is composed of p optical fiber sensing units uniformly distributed, and p is the square of an integer greater than or equal to 10. Each optical fiber sensing unit is composed of a sensing head, an input coupler, a sensing fiber, an output coupler, and a long-wave unit device. A total of p long-wave unit devices in p optical fiber sensing units belonging to one OFB are arranged in order to form a long-wave device array. The outer diameter of the sensor head of the optical fiber sensing unit is equivalent to the inner diameter of the positioning hole of the spatial filter, and the total sensor heads in the root optical fiber sensing unit belonging to one OFB are taken as a group and loaded into the space filter in sequence The center of the sensor head is provided with a collimation hole, which allows the light to enter the sensor head along a straight line; a passband filter of the same size is installed in front of the spatial filter, and the light entering all the optical fiber sensing units of the OFB is controlled. Pass-band filtering; each OFB is fixed on the pan/tilt of the tripod, and its position can be adjusted conveniently; the sensing fiber is connected to the sensor head through the input coupler, and connected to the long-wave unit device through the output coupler; the long-wave device array The sensing signal can be amplified by the analog amplifier, and then processed by the digital signal processing circuit, and the processing result is sent out through the RJ45 network interface of the processing end;
红外视觉子系统包括有m个红外视觉模组,m为大于等于4的整数;测试平台上有m个平动导轨和一个旋转导轨;m个红外视觉模组安装在这m个平动导轨上,可沿平动导轨作一维平动及绕旋转导轨旋转,到预期空间及角度位置后可固定;红外视觉模组主要包含红外变焦镜头和红外面阵,红外面阵控制与驱动电路上有传感端RJ45网络接口,红外图像数据可通过该接口向外传送;The infrared vision subsystem includes m infrared vision modules, m is an integer greater than or equal to 4; there are m translation guide rails and a rotating guide rail on the test platform; m infrared vision modules are installed on the m translation guide rails , can perform one-dimensional translation along the translation guide rail and rotate around the rotation guide rail, and can be fixed after reaching the expected space and angle position; the infrared vision module mainly includes an infrared zoom lens and an infrared area array, and the infrared area array control and drive circuit has RJ45 network interface on the sensor side, through which infrared image data can be transmitted;
千兆交换机将计算机、光纤束层析子系统与红外视觉子系统组成千兆局域网,所有处理端RJ45网络接口以及传感端RJ45网络接口及计算机的网络接口都通过双绞线与千兆交换机的网络接口相连。计算机通过该千兆局域网对光纤束层析子系统与红外视觉子系统进行控制,并获取光纤束层析子系统的处理结果及与红外视觉子系统输出的红外图像数据,从而实现计算机、光纤束层析子系统与红外视觉子系统之间的千兆级高速数据传输。The Gigabit switch forms the Gigabit local area network with the computer, the optical fiber bundle tomography subsystem and the infrared vision subsystem. The network interface is connected. The computer controls the optical fiber bundle tomography subsystem and the infrared vision subsystem through the Gigabit LAN, and obtains the processing results of the optical fiber bundle tomography subsystem and the infrared image data output by the infrared vision subsystem, thereby realizing computer, optical fiber bundle Gigabit high-speed data transmission between the tomography subsystem and the infrared vision subsystem.
基于光纤束层析及红外多目视觉的融合视觉探测方法其步骤为:The steps of the fusion visual detection method based on optical fiber bundle tomography and infrared multi-eye vision are as follows:
(1)采用黑体炉进行OFB通带辐射标定(1) Calibration of OFB passband radiation using a black body furnace
每个OFB中一根光纤传感单元探测一根红外辐射线,传感光纤采用红外光纤(空芯热红外元件可低损耗传输8~14μm热红外辐射)经输出耦合器耦合长波单元器件实现通带光纤束层析数据采集,把所受辐射转化为模拟电压,经放大及A/D变换后成为数字量。An optical fiber sensing unit in each OFB detects an infrared radiation, and the sensing optical fiber is an infrared optical fiber (the hollow-core thermal infrared element can transmit 8-14 μm thermal infrared radiation with low loss) and is coupled with a long-wave unit device by an output coupler to realize communication. With optical fiber bundle tomographic data acquisition, the received radiation is converted into analog voltage, which becomes digital after amplification and A/D conversion.
n个OFB的共计n乘以p根光纤传感单元的每个长波单元器件位置所对应的通带黑体辐射强度It,j与数字量的关系都必须进行预先标定,It为通带黑体辐射强度,j为待标定的长波单元器件所属光纤传感单元的序号,采用的方法为:The total of n multiplied by p optical fiber sensing units of each long-wave unit device position of n OFBs corresponds to the passband blackbody radiation intensity I t, the relationship between j and the digital quantity must be calibrated in advance, I t is the passband blackbody Radiation intensity, j is the serial number of the optical fiber sensing unit to which the long-wave unit device to be calibrated belongs, and the method adopted is:
选择光纤束层析探测波长范围8~14μm,调节黑体炉温度至某一温度T,根据普朗克黑体辐射公式计算温度T对应的通带黑体辐射强度It(即黑体温度T下的辐射曲线在8~14μm范围的面积)。离黑体炉辐射腔距离L处,固定放置一待标定的光纤传感单元,使其传感头端面对准并垂直于辐射腔中心,测得光纤传感单元输出数字量为D。记录上述的一组参数值(L,It,D)。调节黑体炉温度T,记录另一组参数值(L,It,D),完成整个黑体炉温度范围的标定后,改变L,重复以上步骤,可实现不同距离下,不同通带黑体辐射强度下,光纤传感单元输出数字量的标定。由于每根光纤传感单元的长波单元器件存在个体差异,因此需要对每根光纤传感单元进行标定,减小系统误差。最终完成n个OFB的共计n乘以p根光纤传感单元在不同探测距离L对应的通带黑体辐射强度It,j与输出数字量D的关系It,j=f1(L,D,j),建立OFB通带辐射数据库。Select the optical fiber bundle tomographic detection wavelength range of 8-14 μm, adjust the temperature of the blackbody furnace to a certain temperature T, and calculate the passband blackbody radiation intensity I t corresponding to the temperature T according to the Planck blackbody radiation formula (that is, the radiation curve at the blackbody temperature T Area in the range of 8-14 μm). At a distance L away from the radiation cavity of the blackbody furnace, a fiber optic sensing unit to be calibrated is fixedly placed so that the end face of the sensing head is aligned and perpendicular to the center of the radiation cavity, and the output digital value of the fiber sensing unit is measured as D. Record the above set of parameter values (L,I t ,D). Adjust the temperature T of the blackbody furnace, record another set of parameter values (L, I t , D), after completing the calibration of the entire blackbody furnace temperature range, change L, and repeat the above steps to achieve different distances and different passband blackbody radiation intensities Next, the optical fiber sensing unit outputs digital calibration. Since there are individual differences in the long-wave unit devices of each optical fiber sensing unit, it is necessary to calibrate each optical fiber sensing unit to reduce system errors. Finally, the relationship between the passband black body radiation intensity I t,j corresponding to the passband blackbody radiation intensity I t,j and the output digital quantity D of n multiplied by p optical fiber sensing units at different detection distances L is finally completed I t,j =f 1 (L,D ,j), to establish the OFB passband radiation database.
(2)采用黑体炉进行红外视觉通带辐射标定(2) Use a black body furnace for infrared vision passband radiation calibration
为了实现光纤束层析及红外多目视觉信息融合,即提供光纤束层析重建的边界约束条件,必须解决通带红外图像(8~14μm)灰度与通带黑体辐射强度的转换问题,即进行红外视觉通带辐射标定。In order to realize the fusion of optical fiber bundle tomography and infrared multi-eye vision information, that is, to provide the boundary constraint conditions for optical fiber bundle tomographic reconstruction, it is necessary to solve the conversion problem between the gray level of the passband infrared image (8-14 μm) and the radiation intensity of the passband blackbody, namely Perform infrared vision passband radiation calibration.
m个红外视觉模组中的每个红外面阵输出的红外图像组成像素点灰度值G与通带黑体辐射强度It,i的关系都必须进行预先标定,It为通带黑体辐射强度,i为待标定的红外视觉模组的序号,标定方法与步骤(1)类似:The relationship between the infrared image composed of pixel gray value G and the passband blackbody radiation intensity I t,i of each infrared area array output by the m infrared vision modules must be calibrated in advance, and I t is the passband blackbody radiation intensity , i is the serial number of the infrared vision module to be calibrated, and the calibration method is similar to step (1):
调节黑体炉温度至某一温度T,根据普朗克黑体辐射公式计算温度T对应的通带黑体辐射强度It(即黑体温度T下的辐射曲线在8~14μm范围的面积)。离黑体炉辐射腔距离L处,固定放置一待标定的红外视觉模组,调节红外视觉模组的红外变焦镜头,使其准确聚焦到黑体炉辐射腔。读取该红外视觉模组的红外面阵输出的红外图像中黑体炉辐射腔部分的平均灰度值G,记录上述的一组参数值(L,It,G)。调节黑体炉温度T,记录另一组参数值(L,It,G),完成整个黑体炉温度范围的标定后,改变L,重复以上步骤,可实现不同距离下,不同通带黑体辐射强度下,红外视觉模组输出的红外图像组成像素点灰度值G的标定。由于每个红外视觉模组的红外面阵存在个体差异,因此对所有的红外面阵进行标定,可减小系统误差。最终完成m个红外视觉模组中的共计m个红外面阵在不同探测距离L下,输出的红外图像(8~14μm)组成像素点灰度值G与通带黑体辐射强度It,i的关系It,i=f2(L,G,i),建立多目红外视觉通带辐射数据库。Adjust the temperature of the blackbody furnace to a certain temperature T, and calculate the passband blackbody radiation intensity I t corresponding to the temperature T according to the Planck blackbody radiation formula (that is, the area of the radiation curve at the blackbody temperature T in the range of 8-14 μm). At a distance L away from the radiation cavity of the black body furnace, an infrared vision module to be calibrated is fixedly placed, and the infrared zoom lens of the infrared vision module is adjusted to accurately focus on the radiation cavity of the black body furnace. Read the average gray value G of the radiation cavity part of the blackbody furnace in the infrared image output by the infrared array of the infrared vision module, and record the above-mentioned set of parameter values (L, I t , G). Adjust the temperature T of the blackbody furnace, record another set of parameter values (L, I t , G), after completing the calibration of the entire blackbody furnace temperature range, change L, and repeat the above steps to achieve different distances and different passband blackbody radiation intensities Next, the infrared image output by the infrared vision module constitutes the calibration of the pixel gray value G. Since there are individual differences in the infrared arrays of each infrared vision module, calibration of all infrared arrays can reduce system errors. Finally, a total of m infrared arrays in m infrared vision modules are completed at different detection distances L, and the output infrared image (8-14 μm) is composed of pixel gray value G and passband blackbody radiation intensity I t,i The relationship I t,i =f 2 (L,G,i), establishes a multi-eye infrared vision passband radiation database.
(3)MV及OFBT数据采集(3) MV and OFBT data collection
将待测目标放置于测试平台上,在球形空间(相等球半径R)的不同经纬方向角的位置上,由三角架云台上的安装板,固定放置n个OFB。同时,m个红外视觉模组安装在m个平动导轨8上,沿平动导轨作一维平动及绕旋转导轨旋转,直到各平动导轨之间的夹角相等,且m个红外视觉模组离球形空间球心距离都等于R后可固定,将所有红外视觉模组的红外变焦镜头的焦点调至R;Place the target to be tested on the test platform, and place n OFBs fixedly by the mounting plate on the tripod head at different latitude and longitude angles in the spherical space (equal spherical radius R). At the same time, m infrared vision modules are installed on m translation guide rails 8, and perform one-dimensional translation along the translation guide rails and rotate around the rotation guide rails until the angles between the translation guide rails are equal, and the m infrared vision modules After the distance between the module and the center of the spherical space is equal to R, it can be fixed, and the focus of the infrared zoom lens of all infrared vision modules is adjusted to R;
每个OFB的传感头为平行准直孔结构,该结构既保证直线信号采集又满足实时性要求。属于一个OFB的p根光纤传感单元中的共计p个传感头作为一组,按顺序装进空间滤波器的定位孔中并固定,传感头外径与定位孔直径相等,定位孔中心之间的水平与垂直距离相等,可满足对待测目标进行测试的空间分辨率要求。The sensor head of each OFB has a parallel collimation hole structure, which not only ensures the linear signal acquisition but also meets the real-time requirements. A total of p sensing heads in the p optical fiber sensing unit belonging to an OFB are taken as a group, and are installed in the positioning holes of the spatial filter in sequence and fixed. The outer diameter of the sensing head is equal to the diameter of the positioning hole, and the center of the positioning hole The horizontal and vertical distances between them are equal, which can meet the spatial resolution requirements for testing the target to be tested.
进行待测目标的融合视觉测试,千兆交换机将计算机、光纤束层析子系统与红外视觉子系统组成千兆局域网,计算机通过千兆局域网得到红外视觉子系统输出的有关待测目标不同角度下的m路红外图像数据,对每路红外图像的所有像素点灰度G,对照多目红外视觉通带辐射数据库It,i=f2(R,G,i)进行转换,获得m幅以黑体通带辐射强度It表征的红外辐射图像。Carry out the fusion vision test of the target to be tested. The gigabit switch forms a Gigabit local area network with the computer, the optical fiber bundle tomography subsystem and the infrared vision subsystem. The computer obtains the output of the infrared vision subsystem through the Gigabit LAN. The infrared image data of m paths, all the pixel grayscales G of each infrared image are converted against the multi-eye infrared vision passband radiation database I t,i =f 2 (R,G,i) to obtain m frames with Infrared radiation image characterized by blackbody passband radiation intensity I t .
同时,数字信号处理电路通过控制电子开关对所有n乘以p根光纤传感单元的每个长波单元器件进行工作电源的控制,从而实现以电子快门方式瞬时启动所有长波单元器件以采集待测目标进入各传感头的空间多点通带辐射强度信号,同时各长波单元器件的输出端接峰值保持电路,使采集到的空间多点通带辐射强度信号转换成电压信号锁存在峰值保持电路中。经过模拟放大器进行放大,再经数字信号处理电路进行处理,对所有数据进行模拟信号至数字信号的变换,得到数字量D,再对照OFB通带辐射数据库It,j=f1(R,D,j),获得待测目标空间多点的通带辐射强度原始数据It。At the same time, the digital signal processing circuit controls the working power of each long-wave unit device of all n times p optical fiber sensing units by controlling the electronic switch, so as to realize the instantaneous start-up of all long-wave unit devices in the form of electronic shutter to collect the target to be measured The spatial multi-point passband radiation intensity signal entering each sensor head, and the output terminal of each long-wave unit device is connected to the peak hold circuit, so that the collected spatial multipoint passband radiation intensity signal is converted into a voltage signal and locked in the peak hold circuit . After being amplified by an analog amplifier, and then processed by a digital signal processing circuit, all data is converted from an analog signal to a digital signal to obtain a digital quantity D, and then compared with the OFB passband radiation database I t,j =f 1 (R,D ,j), to obtain the original data I t of the passband radiation intensity of multiple points in the target space to be measured.
(4)融合数据处理(4) Fusion data processing
对计算机中的m幅以黑体通带辐射强度It表征的红外辐射图像,采用Harris算子进行不同区域的角点检测,基于红外通带光学薄及光学厚区域不同的图像空域及频域特征(如灰度、直方图、纹理、幅频分布等)进行区域分割,基于极线约束的图像匹配算法对m幅进行红外辐射图像特征角点匹配,重构待测目标的表面形貌,以及表面不同区域边界三维坐标及通带黑体辐射强度值。根据重构的待测目标的表面不同区域边界,对待测目标进行空间分割,即分为红外通带光学薄及光学厚区域,对于光学厚区域,直接采用重构的待测目标的表面形貌,即完成红外多目视觉的工作;对于光学薄区域,进入下述的光纤束层析空间三维重建:For the m infrared radiation images in the computer characterized by the black body passband radiation intensity I t , the Harris operator is used to detect the corners in different regions, based on the different spatial and frequency domain characteristics of the infrared passband optically thin and optically thick regions (such as grayscale, histogram, texture, amplitude-frequency distribution, etc.) for region segmentation, and an image matching algorithm based on epipolar constraints to perform infrared radiation image feature corner matching on m frames, reconstructing the surface topography of the target to be measured, and The three-dimensional coordinates of the boundary of different areas on the surface and the intensity value of the blackbody radiation in the passband. According to the reconstructed boundaries of different areas on the surface of the target to be measured, the target to be measured is spatially segmented, that is, divided into optically thin and optically thick regions of the infrared passband. For the optically thick region, the reconstructed surface topography of the target to be measured is directly used , that is, to complete the work of infrared multi-eye vision; for optically thin areas, enter the following three-dimensional reconstruction of optical fiber bundle tomography space:
把由红外多目视觉重构的表面不同区域边界三维坐标及通带黑体辐射强度值作为约束,对步骤(2)中数字信号处理电路处理获得的待测目标空间多点的通带辐射强度原始数据进行划分,对光学厚区域的辐射强度数据舍弃,采用光学薄区域的通带辐射强度原始数据进行光纤束发射光学层析的反演计算。通过层析计算,可得到待测目标光学薄区域内部空间各点的通带辐射强度,从而与光学厚区域中,由红外多目视觉重构的待测目标1的表面形貌及其通带辐射强度相融合,完成整个待测目标(包括光学薄区域及光学厚区域)空间三维通带辐射强度It分布的重建,以此为基础可反演待测目标(包括光学薄区域及光学厚区域)空间三维温度、压强、粒子数密度等物理量的分布,其三维分布结果实时在计算机上显示,完成整个融合视觉探测。Taking the three-dimensional coordinates of the boundaries of different areas of the surface reconstructed by infrared multi-eye vision and the passband blackbody radiation intensity values as constraints, the original passband radiation intensity of multiple points in the target space to be measured obtained by the digital signal processing circuit in step (2) The data is divided, the radiation intensity data in the optically thick area is discarded, and the original data of the passband radiation intensity in the optically thin area is used to perform the inversion calculation of the fiber bundle emission optical tomography. Through tomographic calculation, the passband radiation intensity of each point in the internal space of the optically thin area of the target to be measured can be obtained, so as to be compared with the surface topography and passband of the target to be measured 1 reconstructed by infrared multi-eye vision in the optically thick area The radiation intensity is fused together to complete the reconstruction of the spatial three-dimensional passband radiation intensity I t distribution of the entire target to be measured (including optically thin and optically thick areas), and based on this, the target to be measured (including optically thin and optically thick The distribution of physical quantities such as three-dimensional temperature, pressure, and particle number density in the area) space, and the three-dimensional distribution results are displayed on the computer in real time to complete the entire fusion visual detection.
本发明的有益效果是,克服单一OFBT及MV目标三维热像检测的局限,采用MV重建目标三维红外表面形貌,区分光学薄与光学厚区域,并得到OFBT边界约束条件;OFBT重建光学薄区域内部分布;两者的信息融合解决复杂对象的三维热像检测的难题。The beneficial effect of the present invention is to overcome the limitations of single OFBT and MV target 3D thermal image detection, use MV to reconstruct the 3D infrared surface topography of the target, distinguish optically thin and optically thick regions, and obtain OFBT boundary constraints; OFBT reconstructs optically thin regions Internal distribution; the information fusion of the two solves the problem of 3D thermal image detection of complex objects.
附图说明Description of drawings
图1为本发明的原理图,图中:1——待测目标;2——球形空间;3——三角架;4——空间滤波器;5——定位孔;6——第一个OFB;7——通带滤光片;8——平动导轨;9——第二个OFB;10——第三个OFB;11——旋转导轨;12——红外面阵;13——传感端RJ45网络接口;14——红外变焦镜头;15——第n个OFB;16——测试平台;17——准直孔;18——传感头;19——传感光纤;20——输入耦合器;21——长波器件阵列;22——模拟放大器;23——数字信号处理电路;24——处理端RJ45网络接口;25——双绞线;26——千兆交换机;27——计算机;28——红外视觉模组;29——输出耦合器;30——长波单元器件。Fig. 1 is a schematic diagram of the present invention, in the figure: 1—target to be measured; 2—spherical space; 3—tripod; 4—spatial filter; 5—positioning hole; 6—first OFB; 7—pass band filter; 8—translational guide rail; 9—second OFB; 10—third OFB; 11—rotary guide rail; 12—infrared array; 13— RJ45 network interface at the sensing end; 14—infrared zoom lens; 15—the nth OFB; 16—test platform; 17—collimation hole; 18—sensing head; 19—sensing optical fiber; 20 ——Input coupler; 21—Long-wave device array; 22—Analog amplifier; 23—Digital signal processing circuit; 24—RJ45 network interface at the processing end; 25—Twisted pair; 26—Gigabit switch; 27—computer; 28—infrared vision module; 29—output coupler; 30—long wave unit device.
注:OFB即Optical fiber bundle,光纤束;RJ45即Registered Jack 45数据传输接口;n为OFB的总个数。Note: OFB is Optical fiber bundle; RJ45 is Registered Jack 45 data transmission interface; n is the total number of OFB.
具体实施方式detailed description
基于光纤束层析及红外多目视觉的融合视觉探测的硬件系统结构如图1所示,硬件系统主要由测试平台16、光纤束层析子系统、红外视觉子系统、千兆交换机26、计算机27组成;The hardware system structure of the fusion visual detection based on optical fiber bundle tomography and infrared multi-eye vision is shown in Figure 1. The hardware system mainly consists of a test platform 16, an optical fiber bundle tomography subsystem, an infrared vision subsystem, a gigabit switch 26, and a computer. 27 composition;
其中光纤束层析子系统包含有n个OFB,即从第一个OFB 6、第二个OFB9、第三个OFB10一直到第n个OFB 15(本实施例中,n取4);n个三角架3、n个空间滤波器4;n个通带滤光片7;n个长波器件阵列21及其对应的模拟放大器22和数字信号处理电路23;Wherein the optical fiber bundle tomography subsystem includes n OFBs, namely from the first OFB 6, the second OFB9, the third OFB10 to the nth OFB 15 (in this embodiment, n is 4); n Tripod 3, n spatial filters 4; n passband filters 7; n long-wave device arrays 21 and their corresponding analog amplifiers 22 and digital signal processing circuits 23;
每个OFB由p根均匀分布的光纤传感单元组成。每根光纤传感单元由传感头18、输入耦合器20、传感光纤19、输出耦合器29、长波单元器件30组成。属于一个OFB的p根光纤传感单元中的共计p个长波单元器件30按顺序排列组成一个长波器件阵列21。光纤传感单元的传感头18的外径与空间滤波器4的定位孔5的内径相当,属于一个OFB的p根光纤传感单元中的共计p个传感头18作为一组,按顺序装进空间滤波器4的定位孔5中并固定,传感头18中心开有准直孔17,允许光线沿直线进入传感头18;空间滤波器4前装配同尺寸的通带滤光片7(本实施例其通带为8~14μm),对进入OFB所有光纤传感单元的光进行通带滤光;每个OFB都固定在三角架3的云台上,其位置可方便调节;传感光纤19通过输入耦合器20与传感头18连接,通过输出耦合器29与长波单元器件30相连;长波器件阵列21的传感信号可经模拟放大器22进行放大,再经数字信号处理电路23进行处理,处理结果通过处理端RJ45网络接口24向外传送;Each OFB is composed of p optical fiber sensing units evenly distributed. Each optical fiber sensing unit is composed of a sensing head 18 , an input coupler 20 , a sensing fiber 19 , an output coupler 29 , and a long-wave unit device 30 . A total of p long-wave unit devices 30 in p optical fiber sensing units belonging to one OFB are arranged in sequence to form a long-wave device array 21 . The outer diameter of the sensing head 18 of the optical fiber sensing unit is equivalent to the inner diameter of the positioning hole 5 of the spatial filter 4, and a total of p sensing heads 18 in the p optical fiber sensing unit belonging to an OFB are taken as a group, in order Put it into the positioning hole 5 of the spatial filter 4 and fix it. There is a collimation hole 17 in the center of the sensing head 18, allowing light to enter the sensing head 18 along a straight line; the spatial filter 4 is equipped with a pass-band filter of the same size 7 (its passband is 8~14 μ m in the present embodiment), carry out passband filtering to the light that enters all optical fiber sensing units of OFB; Each OFB is all fixed on the cloud platform of tripod 3, and its position can be adjusted conveniently; The sensing optical fiber 19 is connected to the sensor head 18 through the input coupler 20, and connected to the long-wave unit device 30 through the output coupler 29; the sensing signal of the long-wave device array 21 can be amplified by the analog amplifier 22, and then passed through the digital signal processing circuit 23 is processed, and the processing result is transmitted outwards through the RJ45 network interface 24 of the processing end;
红外视觉子系统包括有m个红外视觉模组28;测试平台16上有m个平动导轨8和一个旋转导轨11;m个红外视觉模组28安装在这m个平动导轨8上,可沿平动导轨8作一维平动及绕旋转导轨11旋转,到预期空间及角度位置后可固定;红外视觉模组28主要包含红外变焦镜头14和红外面阵12,红外面阵12控制与驱动电路上有传感端RJ45网络接口13,红外图像数据可通过该接口向外传送;The infrared vision subsystem includes m infrared vision modules 28; m translation guide rails 8 and a rotating guide rail 11 are arranged on the test platform 16; m infrared vision modules 28 are installed on the m translation guide rails 8, which can be Perform one-dimensional translation along the translation guide rail 8 and rotate around the rotation guide rail 11, and can be fixed after reaching the expected space and angle position; the infrared vision module 28 mainly includes an infrared zoom lens 14 and an infrared area array 12, and the infrared area array 12 controls and There is an RJ45 network interface 13 at the sensing end on the drive circuit, through which infrared image data can be transmitted outwards;
千兆交换机26将计算机27、光纤束层析子系统与红外视觉子系统组成千兆局域网,所有处理端RJ45网络接口24以及传感端RJ45网络接口13及计算机27的网络接口都通过双绞线25与千兆交换机26的网络接口相连。计算机27通过该千兆局域网对光纤束层析子系统与红外视觉子系统进行控制,并获取光纤束层析子系统的处理结果及与红外视觉子系统输出的红外图像数据,从而实现计算机27、光纤束层析子系统与红外视觉子系统之间的千兆级高速数据传输。Gigabit switch 26 forms Gigabit local area network with computer 27, optical fiber bundle tomography subsystem and infrared vision subsystem, and all processing end RJ45 network interface 24 and sensing end RJ45 network interface 13 and computer 27 network interfaces are all through twisted pair 25 is connected with the network interface of gigabit switch 26. The computer 27 controls the optical fiber bundle tomography subsystem and the infrared vision subsystem through the gigabit local area network, and obtains the processing results of the optical fiber bundle tomography subsystem and the infrared image data output by the infrared vision subsystem, thereby realizing computer 27, Gigabit high-speed data transmission between the fiber optic bundle tomography subsystem and the infrared vision subsystem.
基于光纤束层析及红外多目视觉的融合视觉探测方法其步骤为:The steps of the fusion visual detection method based on optical fiber bundle tomography and infrared multi-eye vision are as follows:
(1)采用黑体炉进行OFB通带辐射标定(1) Calibration of OFB passband radiation using a black body furnace
每个OFB中一根光纤传感单元探测一根红外辐射线,传感光纤19采用红外光纤(空芯热红外元件可低损耗传输8~14μm热红外辐射)经输出耦合器29耦合长波单元器件30(本实施例采用国产OTP538U单元器件,其光谱响应范围为8~14μm)实现通带光纤束层析数据采集,把所受辐射转化为模拟电压,经放大及A/D变换后成为数字量。An optical fiber sensing unit in each OFB detects an infrared radiation line, and the sensing optical fiber 19 adopts an infrared optical fiber (the hollow-core thermal infrared element can transmit 8-14 μm thermal infrared radiation with low loss) and couples the long-wave unit device through the output coupler 29 30 (this embodiment adopts the domestic OTP538U unit device, and its spectral response range is 8-14 μm) to realize the tomographic data acquisition of the pass-band fiber optic bundle, and convert the received radiation into an analog voltage, which becomes a digital quantity after amplification and A/D conversion .
n个OFB的共计n乘以p根光纤传感单元的每个长波单元器件30位置所对应的通带黑体辐射强度It,j与数字量的关系都必须进行预先标定,It为通带黑体辐射强度,j为待标定的长波单元器件30所属光纤传感单元的序号(本实施例中,n取4,p取900,j的范围为1至3600),采用的方法为:The total of n OFBs multiplied by the pass-band blackbody radiation intensity I t corresponding to the position of each long-wave unit device 30 of the p root optical fiber sensing unit, the relationship between j and the digital quantity must be calibrated in advance, and I t is the pass-band Blackbody radiation intensity, j is the serial number of the optical fiber sensing unit to which the long-wave unit device 30 belongs to to be calibrated (in this embodiment, n is 4, p is 900, and the range of j is 1 to 3600), and the method adopted is:
选择光纤束层析探测波长范围8~14μm,调节黑体炉温度至某一温度T,根据普朗克黑体辐射公式计算温度T对应的通带黑体辐射强度It(即黑体温度T下的辐射曲线在8~14μm范围的面积)。离黑体炉辐射腔距离L处,固定放置一待标定的光纤传感单元,使其传感头18端面对准并垂直于辐射腔中心,测得光纤传感单元输出数字量为D。记录上述的一组参数值(L,It,D)。调节黑体炉温度T,记录另一组参数值(L,It,D),完成整个黑体炉温度范围的标定后,改变L,重复以上步骤,可实现不同距离下,不同通带黑体辐射强度下,光纤传感单元输出数字量的标定。由于每根光纤传感单元的长波单元器件30存在个体差异,因此需要对每根光纤传感单元进行标定,减小系统误差。最终完成n个OFB的共计n乘以p根光纤传感单元在不同探测距离L对应的通带黑体辐射强度It,j与输出数字量D的关系It,j=f1(L,D,j),建立OFB通带辐射数据库。Select the optical fiber bundle tomographic detection wavelength range of 8-14 μm, adjust the temperature of the blackbody furnace to a certain temperature T, and calculate the passband blackbody radiation intensity I t corresponding to the temperature T according to the Planck blackbody radiation formula (that is, the radiation curve at the blackbody temperature T Area in the range of 8-14 μm). At a distance L away from the radiation cavity of the blackbody furnace, a fiber sensing unit to be calibrated is fixedly placed so that the end face of the sensor head 18 is aligned and perpendicular to the center of the radiation cavity, and the output digital value of the fiber sensing unit is measured to be D. Record the above set of parameter values (L,I t ,D). Adjust the temperature T of the blackbody furnace, record another set of parameter values (L, I t , D), after completing the calibration of the entire blackbody furnace temperature range, change L, and repeat the above steps to achieve different distances and different passband blackbody radiation intensities Next, the optical fiber sensing unit outputs digital calibration. Since there are individual differences in the long-wave unit device 30 of each optical fiber sensing unit, it is necessary to calibrate each optical fiber sensing unit to reduce system errors. Finally, the relationship between the passband black body radiation intensity I t,j corresponding to the passband blackbody radiation intensity I t,j and the output digital quantity D of n multiplied by p optical fiber sensing units at different detection distances L is finally completed I t,j =f 1 (L,D ,j), to establish the OFB passband radiation database.
(2)采用黑体炉进行红外视觉通带辐射标定(2) Use a black body furnace for infrared vision passband radiation calibration
为了实现光纤束层析及红外多目视觉信息融合,即提供光纤束层析重建的边界约束条件,必须解决通带红外图像(8~14μm)灰度与通带黑体辐射强度的转换问题,即进行红外视觉通带辐射标定。In order to realize the fusion of optical fiber bundle tomography and infrared multi-eye vision information, that is, to provide the boundary constraint conditions for optical fiber bundle tomographic reconstruction, it is necessary to solve the conversion problem between the gray level of the passband infrared image (8-14 μm) and the radiation intensity of the passband blackbody, namely Perform infrared vision passband radiation calibration.
m个红外视觉模组28中的每个红外面阵12(本实施例采用氧化钒非制冷红外焦平面阵列,其工作波长范围为8~14μm)输出的红外图像组成像素点灰度值G与通带黑体辐射强度It,i的关系都必须进行预先标定,It为通带黑体辐射强度,i为待标定的红外视觉模组28的序号(本实施例中,m取4,i的范围为1至4),标定方法与步骤(1)类似:Each infrared array 12 in the m infrared vision modules 28 (this embodiment uses a vanadium oxide uncooled infrared focal plane array, and its working wavelength range is 8-14 μm) outputs an infrared image composed of pixel grayscale values G and Passband blackbody radiation intensity I t, the relationship of i must be pre-calibrated, I t is the passband blackbody radiation intensity, and i is the serial number of the infrared vision module 28 to be calibrated (in this embodiment, m gets 4, i's The range is 1 to 4), the calibration method is similar to step (1):
调节黑体炉温度至某一温度T,根据普朗克黑体辐射公式计算温度T对应的通带黑体辐射强度It(即黑体温度T下的辐射曲线在8~14μm范围的面积)。离黑体炉辐射腔距离L处,固定放置一待标定的红外视觉模组28,调节红外视觉模组28的红外变焦镜头14,使其准确聚焦到黑体炉辐射腔。读取该红外视觉模组28的红外面阵12输出的红外图像中黑体炉辐射腔部分的平均灰度值G,记录上述的一组参数值(L,It,G)。调节黑体炉温度T,记录另一组参数值(L,It,G),完成整个黑体炉温度范围的标定后,改变L,重复以上步骤,可实现不同距离下,不同通带黑体辐射强度下,红外视觉模组28输出的红外图像组成像素点灰度值G的标定。由于每个红外视觉模组28的红外面阵12存在个体差异,因此对所有的红外面阵12进行标定,可减小系统误差。最终完成m个红外视觉模组28中的共计m个红外面阵12在不同探测距离L下,输出的红外图像(8~14μm)组成像素点灰度值G与通带黑体辐射强度It,i的关系It,i=f2(L,G,i),建立多目红外视觉通带辐射数据库。Adjust the temperature of the blackbody furnace to a certain temperature T, and calculate the passband blackbody radiation intensity I t corresponding to the temperature T according to the Planck blackbody radiation formula (that is, the area of the radiation curve at the blackbody temperature T in the range of 8-14 μm). At a distance L away from the radiation cavity of the black body furnace, an infrared vision module 28 to be calibrated is fixedly placed, and the infrared zoom lens 14 of the infrared vision module 28 is adjusted to accurately focus on the radiation cavity of the black body furnace. Read the average gray value G of the radiation cavity part of the blackbody furnace in the infrared image output by the infrared array 12 of the infrared vision module 28, and record the above-mentioned set of parameter values (L, I t , G). Adjust the temperature T of the blackbody furnace, record another set of parameter values (L, I t , G), after completing the calibration of the entire blackbody furnace temperature range, change L, and repeat the above steps to achieve different distances and different passband blackbody radiation intensities Next, the infrared image output by the infrared vision module 28 constitutes the calibration of the pixel gray value G. Since there are individual differences in the infrared area arrays 12 of each infrared vision module 28, all infrared area arrays 12 are calibrated to reduce system errors. Finally, a total of m infrared arrays 12 in m infrared vision modules 28 are completed at different detection distances L, and the output infrared images (8-14 μm) are composed of pixel gray value G and passband blackbody radiation intensity I t, The relation of i is I t,i =f 2 (L,G,i), and the multi-eye infrared vision passband radiation database is established.
(3)MV及OFBT数据采集(3) MV and OFBT data collection
将待测目标1放置于测试平台16上,在球形空间2(相等球半径R)的不同经纬方向角的位置上,由三角架3云台上的安装板,固定放置n个OFB。同时,m个红外视觉模组28安装在m个平动导轨8上,沿平动导轨8作一维平动及绕旋转导轨11旋转,直到各平动导轨8之间的夹角相等,且m个红外视觉模组28离球形空间2球心距离都等于R后可固定,将所有红外视觉模组28的红外变焦镜头14的焦点调至R;The target 1 to be tested is placed on the test platform 16, and n OFBs are fixedly placed on the mounting plate on the tripod 3 at different latitude and longitude angles in the spherical space 2 (equal spherical radius R). At the same time, m infrared vision modules 28 are installed on m translation guide rails 8, and perform one-dimensional translation along the translation guide rails 8 and rotate around the rotation guide rails 11 until the angles between the translation guide rails 8 are equal, and M infrared vision modules 28 can be fixed after being equal to R from the spherical space 2 sphere center distances, and the focus of the infrared zoom lens 14 of all infrared vision modules 28 is adjusted to R;
每个OFB的传感头18为平行准直孔结构,该结构既保证直线信号采集又满足实时性要求。属于一个OFB的p根光纤传感单元中的共计p个传感头18作为一组,按顺序装进空间滤波器4的定位孔5中并固定,传感头18外径与定位孔5直径相等(本实施例中均为1mm),定位孔5中心之间的水平与垂直距离相等(本实施例中该距离为2mm),可满足对待测目标1进行测试的空间分辨率要求。The sensing head 18 of each OFB has a structure of parallel collimation holes, which not only guarantees linear signal collection but also meets real-time requirements. A total of p sensing heads 18 in the p optical fiber sensing units belonging to one OFB are used as a group, and are loaded into the positioning holes 5 of the spatial filter 4 in sequence and fixed. The outer diameter of the sensing heads 18 is the same as the diameter of the positioning holes 5 Equal (both 1 mm in this embodiment), the horizontal and vertical distances between the centers of the positioning holes 5 are equal (the distance is 2 mm in this embodiment), which can meet the spatial resolution requirements of the target 1 to be tested.
进行待测目标1的融合视觉测试,千兆交换机26将计算机27、光纤束层析子系统与红外视觉子系统组成千兆局域网,计算机27通过千兆局域网得到红外视觉子系统输出的有关待测目标1不同角度下的m路红外图像数据,对每路红外图像的所有像素点灰度G,对照多目红外视觉通带辐射数据库It,i=f2(R,G,i)进行转换,获得m幅以黑体通带辐射强度It表征的红外辐射图像。Carry out the fusion vision test of the target to be tested 1, the Gigabit switch 26 forms the Gigabit local area network with the computer 27, the optical fiber bundle tomography subsystem and the infrared vision subsystem, and the computer 27 obtains the relevant test data output by the infrared vision subsystem through the Gigabit local area network For the m-channel infrared image data under different angles of the target 1, the grayscale G of all pixels of each infrared image is converted against the multi-eye infrared vision passband radiation database I t,i =f 2 (R,G,i) , to obtain m infrared radiation images characterized by blackbody passband radiation intensity I t .
同时,数字信号处理电路23通过控制电子开关对所有n乘以p根光纤传感单元的每个长波单元器件30进行工作电源的控制,从而实现以电子快门方式瞬时启动所有长波单元器件30以采集待测目标1进入各传感头18的空间多点通带辐射强度信号,同时各长波单元器件30的输出端接峰值保持电路,使采集到的空间多点通带辐射强度信号转换成电压信号锁存在峰值保持电路中。经过模拟放大器22进行放大,再经数字信号处理电路23进行处理,对所有数据进行模拟信号至数字信号的变换,得到数字量D,再对照OFB通带辐射数据库It,j=f1(R,D,j),获得待测目标1空间多点的通带辐射强度原始数据It。At the same time, the digital signal processing circuit 23 controls the working power of each long-wave unit device 30 of all n multiplied by p optical fiber sensing units by controlling the electronic switch, so as to realize the instantaneous start-up of all long-wave unit devices 30 in an electronic shutter mode to collect The target 1 to be measured enters the spatial multipoint passband radiation intensity signal of each sensor head 18, and the output terminal of each long-wave unit device 30 is connected to a peak hold circuit at the same time, so that the collected spatial multipoint passband radiation intensity signal is converted into a voltage signal Latched in the peak hold circuit. After being amplified by the analog amplifier 22, and then processed by the digital signal processing circuit 23, all data are converted from analog signals to digital signals to obtain the digital quantity D, and then compared with the OFB passband radiation database I t, j =f 1 (R ,D,j), to obtain the original data I t of the passband radiation intensity of multiple points in the target 1 space.
(4)融合数据处理(4) Fusion data processing
对计算机27中的m幅以黑体通带辐射强度It表征的红外辐射图像,采用Harris算子进行不同区域的角点检测,基于红外通带光学薄及光学厚区域不同的图像空域及频域特征(如灰度、直方图、纹理、幅频分布等)进行区域分割,基于极线约束的图像匹配算法对m幅进行红外辐射图像特征角点匹配,重构待测目标1的表面形貌,以及表面不同区域边界三维坐标及通带黑体辐射强度值。根据重构的待测目标1的表面不同区域边界,对待测目标1进行空间分割,即分为红外通带光学薄及光学厚区域,对于光学厚区域,直接采用重构的待测目标1的表面形貌,即完成红外多目视觉的工作;对于光学薄区域,进入下述的光纤束层析空间三维重建:For the m infrared radiation images in the computer 27 characterized by the black body passband radiation intensity I t , the Harris operator is used to detect the corners in different regions, based on the different image space and frequency domains of the infrared passband optically thin and optically thick regions Features (such as grayscale, histogram, texture, amplitude-frequency distribution, etc.) are used for region segmentation, and the image matching algorithm based on epipolar line constraints is used to match the feature corners of infrared radiation images for m frames, and the surface morphology of the target 1 to be measured is reconstructed , as well as the three-dimensional coordinates of the boundary of different areas on the surface and the radiation intensity value of the blackbody in the passband. According to the reconstructed boundaries of different regions on the surface of the target to be measured 1, the target to be measured 1 is spatially segmented, that is, divided into optically thin and optically thick regions of the infrared passband. For the optically thick region, the reconstructed target to be measured 1 is directly used Surface topography, that is, to complete the work of infrared multi-eye vision; for optically thin areas, enter the following three-dimensional reconstruction of optical fiber bundle tomography space:
把由红外多目视觉重构的表面不同区域边界三维坐标及通带黑体辐射强度值作为约束,对步骤(2)中数字信号处理电路23处理获得的待测目标1空间多点的通带辐射强度原始数据进行划分,对光学厚区域的辐射强度数据舍弃,采用光学薄区域的通带辐射强度原始数据进行光纤束发射光学层析的反演计算。通过层析计算,可得到待测目标1光学薄区域内部空间各点的通带辐射强度,从而与光学厚区域中,由红外多目视觉重构的待测目标1的表面形貌及其通带辐射强度相融合,完成整个待测目标1(包括光学薄区域及光学厚区域)空间三维通带辐射强度It分布的重建,以此为基础可反演待测目标1(包括光学薄区域及光学厚区域)空间三维温度、压强、粒子数密度等物理量的分布,其三维分布结果实时在计算机27上显示,完成整个融合视觉探测。Using the three-dimensional coordinates of the boundaries of different areas of the surface reconstructed by infrared multi-eye vision and the passband blackbody radiation intensity values as constraints, the passband radiation of the multi-point passband radiation of the target to be measured 1 space obtained by processing the digital signal processing circuit 23 in step (2) The intensity raw data is divided, the radiation intensity data in the optically thick region is discarded, and the passband radiation intensity raw data in the optically thin region is used for the inversion calculation of optical tomography of the optical fiber bundle emission. Through tomographic calculation, the passband radiation intensity of each point in the internal space of the optically thin area of the target 1 to be measured can be obtained, so as to be consistent with the surface topography and passband of the target 1 to be measured reconstructed by infrared multi-eye vision in the optically thick area. The three-dimensional passband radiation intensity I t distribution of the entire object to be measured 1 (including the optically thin area and the optically thick area) is fused together to complete the reconstruction of the spatial three-dimensional passband radiation intensity I t distribution of the target to be measured 1 (including the optically thin area). and optically thick region) spatial distribution of three-dimensional temperature, pressure, particle number density and other physical quantities, the three-dimensional distribution results are displayed on the computer 27 in real time to complete the entire fusion visual detection.
Claims (1)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610894127.1A CN106525244B (en) | 2016-10-13 | 2016-10-13 | A kind of infrared fusion visual detection system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610894127.1A CN106525244B (en) | 2016-10-13 | 2016-10-13 | A kind of infrared fusion visual detection system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106525244A true CN106525244A (en) | 2017-03-22 |
| CN106525244B CN106525244B (en) | 2019-04-02 |
Family
ID=58331670
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610894127.1A Active CN106525244B (en) | 2016-10-13 | 2016-10-13 | A kind of infrared fusion visual detection system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106525244B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107944439A (en) * | 2017-11-09 | 2018-04-20 | 苏州铭冠软件科技有限公司 | A kind of device for visual identification |
| CN115598075A (en) * | 2022-12-14 | 2023-01-13 | 自然资源部第二海洋研究所(Cn) | Deep-sea hyperspectral imaging detection system and method based on dual-channel coaxial optical path |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000079089A (en) * | 1998-09-07 | 2000-03-21 | Olympus Optical Co Ltd | Thermograph for endoscope |
| US6291824B1 (en) * | 1998-04-13 | 2001-09-18 | Board Of Supervisors Of Louisiana State University And Agricultural And Mechanical College | Apparatus and method for high-bandwidth optical tomography |
| US7671337B1 (en) * | 2005-11-29 | 2010-03-02 | Lockheed Martin Corporation | System and method for pointing a laser beam |
| CN101915616A (en) * | 2010-07-22 | 2010-12-15 | 南昌航空大学 | A helical emission spectrometer |
| CN102353453A (en) * | 2011-08-27 | 2012-02-15 | 南昌航空大学 | Method for reconstructing flow field of optical fiber beams |
| CN103889616A (en) * | 2012-08-28 | 2014-06-25 | 新日铁住金株式会社 | Method and device for measuring surface temperature of slab |
-
2016
- 2016-10-13 CN CN201610894127.1A patent/CN106525244B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6291824B1 (en) * | 1998-04-13 | 2001-09-18 | Board Of Supervisors Of Louisiana State University And Agricultural And Mechanical College | Apparatus and method for high-bandwidth optical tomography |
| JP2000079089A (en) * | 1998-09-07 | 2000-03-21 | Olympus Optical Co Ltd | Thermograph for endoscope |
| US7671337B1 (en) * | 2005-11-29 | 2010-03-02 | Lockheed Martin Corporation | System and method for pointing a laser beam |
| CN101915616A (en) * | 2010-07-22 | 2010-12-15 | 南昌航空大学 | A helical emission spectrometer |
| CN102353453A (en) * | 2011-08-27 | 2012-02-15 | 南昌航空大学 | Method for reconstructing flow field of optical fiber beams |
| CN103889616A (en) * | 2012-08-28 | 2014-06-25 | 新日铁住金株式会社 | Method and device for measuring surface temperature of slab |
Non-Patent Citations (2)
| Title |
|---|
| SHUQI ZHAO等: "Three-dimensional profile reconstruction based on infrared multi-view vision", 《PROC. OF SPIE》 * |
| XINHUA YI等: "3-D Shape Display of Intelligent Colonoscope Based on FBG Sensor Array and Binocular Vision", 《IEEE/ICME INTERNATIONAL CONFERENCE ON COMPLEX MEDICAL ENGINEERING》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107944439A (en) * | 2017-11-09 | 2018-04-20 | 苏州铭冠软件科技有限公司 | A kind of device for visual identification |
| CN115598075A (en) * | 2022-12-14 | 2023-01-13 | 自然资源部第二海洋研究所(Cn) | Deep-sea hyperspectral imaging detection system and method based on dual-channel coaxial optical path |
| CN115598075B (en) * | 2022-12-14 | 2023-03-31 | 自然资源部第二海洋研究所 | Deep-sea hyperspectral imaging detection system and method based on dual-channel coaxial optical path |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106525244B (en) | 2019-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109632103B (en) | High-altitude building temperature distribution and surface crack remote monitoring system and monitoring method | |
| CN100464167C (en) | Method and device for real-time correcting infrared measuring temperature | |
| CN113175899B (en) | Camera and galvanometer combined three-dimensional imaging model of variable sight line system and calibration method thereof | |
| CN102494609B (en) | Three-dimensional photographing process based on laser probe array and device utilizing same | |
| CN107144241B (en) | A kind of binocular vision high-precision measuring method based on depth of field compensation | |
| CN107401977A (en) | The imaging compensating method of refraction deviation is considered in the measurement of high temperature binocular stereo vision | |
| CN106092057B (en) | A kind of helicopter rotor blade dynamic trajectory measuring method based on four item stereo visions | |
| CN102538983B (en) | CCD (Charge Coupled Device) temperature measuring device | |
| TW201601536A (en) | Performance parameter measurement method and dead pixel detection method of infrared focal plane array module | |
| CN106053026B (en) | Optical efficiency testing method for infrared optical fiber image transmission bundle | |
| CN106405671B (en) | A kind of infrared fusion visual detection method | |
| CN108204888B (en) | An on-site calibration device for an infrared dynamic scene simulator for simulation | |
| CN106918306A (en) | Industrial products three-dimensional appearance real-time detecting system based on light field one camera | |
| CN112556594A (en) | Strain field and temperature field coupling measurement method and system fusing infrared information | |
| CN112880563B (en) | A method for measuring the spatial position of an equivalent narrow-area array camera in single-dimensional pixel binning mode | |
| CN109243268A (en) | A kind of the aerospace test of visible images detector and demonstration and verification platform and method | |
| CN115218810B (en) | Single-camera three-dimensional deformation measurement system and method for resisting strong light and strong heat radiation interference | |
| CN108507674A (en) | A kind of nominal data processing method of light field light spectrum image-forming spectrometer | |
| CN104596638A (en) | High-resolution multi-wavelength laser intensity distribution detector and measurement method implemented by same | |
| CN106679595A (en) | Center offset and wedge angle detecting instrument for wedge angle spherical lens and measurement method | |
| CN115077714A (en) | Flame multispectral imaging measurement device, system and method based on optical fiber image transmission bundle | |
| Wang et al. | Multi-perspective digital image correlation method using a single color camera | |
| CN106525244A (en) | Infrared fusion visual detection system | |
| CN116067506A (en) | A method and system for constructing a three-dimensional temperature field on the surface of industrial kiln materials | |
| CN104316202A (en) | Device capable of being used for high temperature three-dimensional measurement and measuring method of device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200629 Address after: 201800 First Floor and First Floor of the Underground of 2398 Luyi Road Comprehensive Laboratory Building, Jiading Industrial Zone, Jiading District, Shanghai Patentee after: SHANGHAI JIWU PHOTOELECTRIC TECHNOLOGY CO.,LTD. Address before: 200083 No. 500, Yutian Road, Shanghai, Hongkou District Patentee before: SHANGHAI INSTITUTE OF TECHNICAL PHYSICS, CHINESE ACADEMY OF SCIENCE |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20250321 Address after: 201306 building 3, No. 1558, Pingzhuang East Road, Lingang xinpian District, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai Patentee after: Puguan Visual Technology (Shanghai) Co.,Ltd. Country or region after: China Address before: 201800 1 / F and 1 / F, no.2398, Lvyi Road, Jiading Industrial Zone, Jiading District, Shanghai Patentee before: SHANGHAI JIWU PHOTOELECTRIC TECHNOLOGY CO.,LTD. Country or region before: China |
|
| TR01 | Transfer of patent right |