CN107121079B - A device and method for measuring surface height information based on monocular vision - Google Patents
A device and method for measuring surface height information based on monocular vision Download PDFInfo
- Publication number
- CN107121079B CN107121079B CN201710447508.XA CN201710447508A CN107121079B CN 107121079 B CN107121079 B CN 107121079B CN 201710447508 A CN201710447508 A CN 201710447508A CN 107121079 B CN107121079 B CN 107121079B
- Authority
- CN
- China
- Prior art keywords
- axis
- parallel light
- detection camera
- source
- curved surface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000001514 detection method Methods 0.000 claims abstract description 99
- 238000005259 measurement Methods 0.000 claims abstract description 48
- 230000005540 biological transmission Effects 0.000 claims abstract description 35
- 238000003384 imaging method Methods 0.000 claims abstract description 13
- 230000003287 optical effect Effects 0.000 claims description 63
- 230000000712 assembly Effects 0.000 claims description 13
- 238000000429 assembly Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 9
- 238000009434 installation Methods 0.000 claims description 8
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 230000008859 change Effects 0.000 claims description 3
- NCGICGYLBXGBGN-UHFFFAOYSA-N 3-morpholin-4-yl-1-oxa-3-azonia-2-azanidacyclopent-3-en-5-imine;hydrochloride Chemical compound Cl.[N-]1OC(=N)C=[N+]1N1CCOCC1 NCGICGYLBXGBGN-UHFFFAOYSA-N 0.000 claims description 2
- XDNBGBASBLCTIN-UHFFFAOYSA-L 2-(dimethylamino)ethyl 4-(butylamino)benzoate;n,n-dimethylformamide;n-[2-ethyl-2-(3-methoxyphenyl)butyl]-4-hydroxybutanamide;trimethyl-[4-[[4-(trimethylazaniumyl)cyclohexyl]methyl]cyclohexyl]azanium;diiodide;hydrochloride Chemical compound Cl.[I-].[I-].CN(C)C=O.CCCCNC1=CC=C(C(=O)OCCN(C)C)C=C1.OCCCC(=O)NCC(CC)(CC)C1=CC=CC(OC)=C1.C1CC([N+](C)(C)C)CCC1CC1CCC([N+](C)(C)C)CC1 XDNBGBASBLCTIN-UHFFFAOYSA-L 0.000 claims 3
- 210000000481 breast Anatomy 0.000 claims 2
- 230000000149 penetrating effect Effects 0.000 claims 2
- 241000208340 Araliaceae Species 0.000 claims 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims 1
- 235000003140 Panax quinquefolius Nutrition 0.000 claims 1
- 235000008434 ginseng Nutrition 0.000 claims 1
- 238000007373 indentation Methods 0.000 claims 1
- 230000000007 visual effect Effects 0.000 claims 1
- 241000375392 Tana Species 0.000 description 12
- 238000010586 diagram Methods 0.000 description 12
- 238000004364 calculation method Methods 0.000 description 7
- 244000089409 Erythrina poeppigiana Species 0.000 description 6
- 235000009776 Rathbunia alamosensis Nutrition 0.000 description 6
- 230000006872 improvement Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000004441 surface measurement Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000001627 detrimental effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
- G01B11/06—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness for measuring thickness ; e.g. of sheet material
- G01B11/0608—Height gauges
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
本发明属于机器视觉成像技术相关领域,并公开了一种基于单目视觉的曲面高度信息测量装置及方法,包括测量机架、平行光源组件、检测相机和距离传感器,其中平行光源组件由安装盒、平行光管和透射光栅共同组成,并且透射光栅上刻有宽窄相间的平行刻痕,由此使得平行光管发出的平行光束在待测曲面上可投射形成明暗相间的平行条纹;此外,检测相机的数量仅为一个并与平行光源组件相配合,由此对待测曲面上所形成的平行条纹执行采图以获得图像。本发明还公开了相应的曲面高度信息测量方法。通过本发明,不仅只需要使用单个相机即可高效率完成曲面高度信息测量,而且整体结构紧凑合理、便于操作,适应性强,同时显著提高了最终可获得的测量精度。
The invention belongs to the related field of machine vision imaging technology, and discloses a device and method for measuring the height information of a curved surface based on monocular vision, including a measuring frame, a parallel light source assembly, a detection camera and a distance sensor, wherein the parallel light source assembly consists of a mounting box , a collimator and a transmission grating, and the transmission grating is engraved with alternate wide and narrow parallel notches, so that the parallel light beam emitted by the collimator can be projected on the surface to be tested to form parallel stripes of light and dark; in addition, the detection The number of the camera is only one and it cooperates with the parallel light source component, so that the parallel stripes formed on the surface to be tested are captured to obtain an image. The invention also discloses a corresponding method for measuring the height information of the curved surface. Through the present invention, not only only a single camera can be used to complete the height information measurement of the curved surface with high efficiency, but also the overall structure is compact and reasonable, easy to operate, strong adaptability, and at the same time, the final obtainable measurement accuracy is significantly improved.
Description
技术领域technical field
本发明属于机器视觉成像技术相关领域,更具体地,涉及一种基于单目视觉的曲面高度信息测量装置及方法。The invention belongs to the related field of machine vision imaging technology, and more specifically relates to a device and method for measuring curved surface height information based on monocular vision.
背景技术Background technique
在视觉技术中,为了测量曲面的高度信息,至少需要从多个角度获取被测曲面的多个图像。已有的方法通常是利用两个或者多个相机进行采图,并利用几何约束条件获得被测曲面的三维信息;或者仅利用一个相机从多个角度进行采图。然而对前者来说,由于必需利用多个相机,在提高成本的同时,还存在多相机系统中相机内外参数标定非常繁琐的问题,而且对于最终的测量精度往往也影响较大。对于后者来说,虽然只使用了一个相机,但操作时通常需要频繁改变相机的空间位置,操作繁琐且往往无法保证精确的移动位置,同样会不利于最终的测量精度。In vision technology, in order to measure the height information of a curved surface, at least multiple images of the measured curved surface need to be obtained from multiple angles. Existing methods usually use two or more cameras to collect images, and use geometric constraints to obtain three-dimensional information of the measured surface; or use only one camera to collect images from multiple angles. However, for the former, since it is necessary to use multiple cameras, while increasing the cost, there is also the problem of very cumbersome calibration of the internal and external parameters of the camera in a multi-camera system, and it often has a great impact on the final measurement accuracy. For the latter, although only one camera is used, the spatial position of the camera usually needs to be changed frequently during operation. The operation is cumbersome and often cannot guarantee the precise moving position, which will also be detrimental to the final measurement accuracy.
通过检索发现,CN201510248456.4公开了一种具有三角测距功能的单目视觉传感器,其由激光器发出激光束,经过聚焦镜组之后形成一束准直激光束,在被测目标表面形成激光光斑;成像镜组将被测目标(连同激光光斑一起)成像到成像器件表面上,然后通过计算来获得被测目标的二维信息与距离信息,从而实现了利用单目视觉传感器获取被测目标的三维信息。Through searching, it is found that CN201510248456.4 discloses a monocular vision sensor with triangular ranging function, which emits a laser beam from a laser, forms a collimated laser beam after passing through a focusing lens group, and forms a laser spot on the surface of the measured target The imaging lens group images the measured target (together with the laser spot) on the surface of the imaging device, and then obtains the two-dimensional information and distance information of the measured target through calculation, thereby realizing the use of the monocular vision sensor to obtain the measured target. three-dimensional information.
然而,进一步的研究表明,上述现有方案只适用于针对平面物体的测量,而在曲面物体测量应用场合很难有效使用;尤其是,它只能测定被测物体到相机的距离信息,而无法获得被测物体在离面方向的变形信息,而后者对于曲面测量应用来说是非常关键的指标。相应地,本领域亟需针对上述技术问题寻求更为完善的解决方案,以满足目前日益提高的工艺要求。However, further studies have shown that the above-mentioned existing solutions are only suitable for the measurement of planar objects, and it is difficult to use them effectively in the application of curved surface object measurement; in particular, it can only measure the distance information from the measured object to the camera, but cannot Obtain the deformation information of the measured object in the out-of-plane direction, and the latter is a very critical indicator for surface measurement applications. Correspondingly, there is an urgent need in the art to seek a more complete solution to the above technical problems so as to meet the current increasing technological requirements.
发明内容Contents of the invention
针对现有技术的以上缺陷或改进需求,本发明提供了一种基于单目视觉的曲面高度信息测量装置及方法,其中结合各类曲面测量应用场合的特定需求及实际工况特点,针对该测量装置的整体构造布局、以及多个关键组件的具体组成和设置方式等多个方面重新作出设计,同时对其测量算法进行了研究和改进,相应与现有的曲面测量方案相比,不仅只需要使用单个相机即可高效率完成曲面高度信息测量,而且整体结构紧凑合理、便于操作,适应性强,同时显著提高了最终可获得的测量精度,因而尤其适用于曲面信息测量的应用场合。In view of the above defects or improvement needs of the prior art, the present invention provides a device and method for measuring curved surface height information based on monocular vision, in which, in combination with the specific requirements of various curved surface measurement applications and the characteristics of actual working conditions, the measurement The overall structural layout of the device, as well as the specific composition and setting methods of multiple key components, etc. have been redesigned, and the measurement algorithm has been researched and improved. Compared with the existing surface measurement scheme, not only Using a single camera can efficiently complete the measurement of surface height information, and the overall structure is compact and reasonable, easy to operate, strong adaptability, and at the same time significantly improve the final measurement accuracy, so it is especially suitable for the application of surface information measurement.
为实现上述目的,按照本发明的一个方面,提供了一种基于单目视觉的曲面高度信息测量装置,该装置包括测量机架、平行光源组件、检测相机和距离传感器,其特征在于:In order to achieve the above object, according to one aspect of the present invention, a device for measuring surface height information based on monocular vision is provided, which device includes a measuring frame, a parallel light source assembly, a detection camera and a distance sensor, and is characterized in that:
所述测量机架呈水平布置的对称十字框架的形式,并作为其他组件的安装基础;The measuring frame is in the form of a symmetrical cross frame arranged horizontally and serves as the installation basis for other components;
所述平行光源组件的数量为四个,它们各自安装在所述测量机架的四个相同臂结构的末端下方,并分别可经由配套的电机来驱动发生旋转以使其投影角发生改变;各个平行光源组件分别均由安装盒、以及依次分设在此安装盒内部的平行光管和透射光栅共同组成,其中该平行光管用于向所述透射光栅发射平行光束,该透射光栅上则刻有宽窄相间的两种平行刻痕也即具备宽窄相间的透光缝隙,由此使得所述平行光管发出的平行光束在待测曲面上可投射形成明暗相间的平行条纹;The number of the parallel light source components is four, and they are respectively installed under the ends of the four identical arm structures of the measurement rack, and can be driven to rotate by matching motors to change the projection angle; each The parallel light source components are respectively composed of an installation box, and a collimator and a transmission grating respectively arranged inside the installation box, wherein the collimator is used to emit parallel light beams to the transmission grating, and the transmission grating is engraved with width The two alternate parallel notches also have light-transmitting slits alternated in width and width, so that the parallel light beams emitted by the collimator can be projected on the surface to be measured to form parallel stripes of light and dark;
所述检测相机的数量仅为一个,它固定安装在所述测量机架的中央下方,并与各个所述平行光源组件相配合,用于对待测曲面上所形成的平行条纹执行采图以获得所需的二维图像;The number of the detection camera is only one, which is fixedly installed under the center of the measurement frame, and cooperates with each of the parallel light source components, and is used to collect images of the parallel stripes formed on the surface to be measured to obtain the desired 2D image;
此外,以该检测相机的透镜光心为原点来建立一个相机直角坐标系XYZ,其中该相机直角坐标系的Z轴与所述检测相机的光轴重合且指向该检测相机的下方,其X轴、Y轴满足右手定则,并且四个所述平行光源组件中的两个保持对称地处于此X轴上,剩余两个同样保持对称地处于此Y轴上;类似地,以所述检测相机的成像平面的中心为原点建立一个图像直角坐标系X′Y′Z,其中该图像直角坐标系的Z轴与所述相机直角坐标系的Z轴相重合,其X′轴、Y′轴同样满足右手定则;接着,在所述检测相机的正下方建立一个参考直角坐标系X"Y"Z,其中该参考直角坐标系的Z轴与所述检测相机的光轴重合,其X"轴、Y"轴同样满足右手定则,并且它的X"Y"平面保持与所述相机直角坐标系的XY平面相互平行;In addition, a camera Cartesian coordinate system XYZ is established with the lens optical center of the detection camera as the origin, wherein the Z axis of the camera Cartesian coordinate system coincides with the optical axis of the detection camera and points below the detection camera, and its X axis , the Y-axis satisfies the right-hand rule, and two of the four parallel light source assemblies remain symmetrically on this X-axis, and the remaining two also remain symmetrically on this Y-axis; similarly, with the detection camera The center of the imaging plane is the origin to establish an image Cartesian coordinate system X'Y'Z, wherein the Z axis of the image Cartesian coordinate system coincides with the Z axis of the camera Cartesian coordinate system, and its X' axis and Y' axis are the same Satisfy the right-hand rule; then, establish a reference rectangular coordinate system X"Y"Z directly below the detection camera, wherein the Z axis of the reference rectangular coordinate system coincides with the optical axis of the detection camera, and its X" axis , Y "axis also satisfies the right-hand rule, and its X"Y" plane remains parallel to the XY plane of the Cartesian coordinate system of the camera;
所述距离传感器分别对应于各个所述平行光源组件而设置,并且当通过调整所述测量机架的高度使得所述检测相机可获得清晰的所述二维图像时,用于在此位置下对所述检测相机的透镜光心到所述X"Y"平面之间的垂直距离H进行测量,同时用于对此检测相机的成像平面与该X"Y"平面之间的平行度进行检测。The distance sensors are arranged corresponding to each of the parallel light source components, and when the height of the measurement frame is adjusted so that the detection camera can obtain a clear two-dimensional image, it is used to measure the distance at this position. The vertical distance H between the optical center of the lens of the detection camera and the X"Y" plane is measured, and is used to detect the parallelism between the imaging plane of the detection camera and the X"Y" plane.
作为进一步优选地,对于各个所述平行光源组件而言,其光轴与所述XY平面之间的初始投影角α优选通过下式来计算获得:As a further preference, for each of the parallel light source components, the initial projection angle α between its optical axis and the XY plane is preferably calculated by the following formula:
α=sin-1(d/d0)α=sin -1 (d/d 0 )
式中,d表示各个所述平行光源组件的透射光栅自身具备的光栅常数;d0表示所述X"Y"平面上所形成的明暗相间的平行条纹中,彼此相邻的两个条纹之间的中心距。In the formula, d represents the grating constant of the transmission grating of each of the parallel light source components; d 0 represents the distance between two adjacent stripes in the parallel stripes formed on the X"Y" plane. center distance.
作为进一步优选地,对于处于所述X轴上的两个所述平行光源组件而言,两者在待测曲面上所投射形成的条纹彼此平行且构成第一条纹组;对于处于所述Y轴上的两个所述平行光源组件而言,两者在待测曲面上所投射形成的条纹同样彼此平行且构成第二条纹组;此外,所述第一条纹组与所述第二条纹组之间相互垂直。As further preferably, for the two parallel light source assemblies on the X-axis, the fringes formed by the two projections on the curved surface to be measured are parallel to each other and form a first fringe group; for the two parallel light source assemblies on the Y-axis For the two parallel light source components above, the fringes formed by the two projections on the curved surface to be measured are also parallel to each other and constitute the second fringe group; in addition, the difference between the first fringe group and the second fringe group perpendicular to each other.
作为进一步优选地,对于所述透射光栅各自具备的透光缝隙中的透光宽缝与透光窄缝而言,它们的位置按n位二进制方式进行编码排序,并优选对这n×2n条透光缝进行编码;其中n的取值根据所述检测相机的视场大小来确定,并确保使得所述检测相机所获得的图像中条纹数应满足m>3n-1;此外,所述透光窄缝d2与所述透光宽缝d1之间的宽窄比优选满足公式d1/d2≥2。As further preferably, for the light-transmitting wide slits and light-transmitting narrow slits in the light-transmitting slits respectively provided by the transmission gratings, their positions are coded and sorted in n-bit binary mode, and preferably the n×2 n The number of light-transmitting slits is encoded; the value of n is determined according to the field of view of the detection camera, and it is ensured that the number of stripes in the image obtained by the detection camera should satisfy m>3n-1; in addition, the The width ratio between the light-transmitting narrow slit d 2 and the light-transmitting wide slit d 1 preferably satisfies the formula d 1 /d 2 ≥2.
作为进一步优选地,对于处于所述X轴上的两个所述平行光源组件而言,其在待测曲面上所投射形成条纹上的任一点P的X轴坐标x优选分别通过下列公式计算得出:As a further preference, for the two parallel light source components on the X-axis, the X-axis coordinate x of any point P on the stripe formed by projection on the curved surface to be measured is preferably calculated by the following formula out:
x=x’×(D×tanax)/(f-x’tanax)x=x'×(D×tana x )/(f-x'tana x )
式中,D表示各个所述平行光源组件的平行光管的透镜光心到所述检测相机的透镜光心之间的距离;f为所述检测相机的焦距;ax分别表示位于所述X轴上的各个平行光源组件的光轴与所述XY平面之间的投影角;x′分别表示在所述检测相机所获得的二维图像中,与所述点P保持对应的像素点P′的X′轴坐标值。In the formula, D represents the distance between the optical center of the lens of the collimator of each of the parallel light source components and the optical center of the lens of the detection camera; f is the focal length of the detection camera; The projection angle between the optical axis of each parallel light source assembly on the axis and the XY plane; x' respectively represents the pixel point P' corresponding to the point P in the two-dimensional image obtained by the detection camera The X' axis coordinate value of .
作为进一步优选地,对于处于所述Y轴上的两个所述平行光源组件而言,其在待测曲面上所投射形成条纹上的任一点P的Y轴坐标y优选分别通过下列公式计算得出:As a further preference, for the two parallel light source components on the Y-axis, the Y-axis coordinate y of any point P projected on the curved surface to be measured to form stripes is preferably calculated by the following formula out:
y=y’×(D×tanay)/(f-y’tanay)y=y'×(D×tana y )/(f-y'tana y )
式中,D表示各个所述平行光源组件的平行光管的透镜光心到所述检测相机的透镜光心之间的距离;f为所述检测相机的焦距;ay分别表示位于所述Y轴上的各个平行光源组件的光轴与所述XY平面之间的投影角;y′分别表示在所述检测相机所获得的二维图像中,与所述点P保持对应的像素点P′的Y′轴坐标值。In the formula, D represents the distance between the optical center of the lens of the collimator of each of the parallel light source components and the optical center of the lens of the detection camera; f is the focal length of the detection camera; The projection angle between the optical axis of each parallel light source assembly on the axis and the XY plane; y' respectively represents the pixel point P' corresponding to the point P in the two-dimensional image obtained by the detection camera The Y' axis coordinate value of .
作为进一步优选地,对于处于所述X轴上的两个所述平行光源组件而言,其在待测曲面上所形成条纹上的任一点P在Z轴方向上的变形量hx优选分别通过下列公式计算得出:As a further preference, for the two parallel light source components on the X axis, the deformation amount h x of any point P on the stripes formed on the curved surface to be measured in the direction of the Z axis preferably passes through The following formula is calculated:
hx=|x–{(H cotax-D)±(kx×d/sinax)}|×tanax h x =|x–{(H cota x -D)±(k x ×d/sina x )}|×tana x
式中,x表示位于所述X轴上的各个平行光源组件在待测曲面上所投射形成条纹上的任一点P的X轴坐标值;H表示当所述检测相机可获得清晰的所述二维图像时,该检测相机的透镜中心到所述X"Y"平面之间的垂直距离;ax分别表示位于所述X轴上的各个平行光源组件的光轴与所述XY平面之间的投影角;D表示各个所述平行光源的平行光管的透镜光心到所述检测相机的透镜光心之间的距离;d表示各个所述平行光源组件的透射光栅自身具备的光栅常数;此外,kx表示位于所述X轴上的各个平行光源组件在待测曲面上所投射形成的多个平行条纹中包含P点的条纹的序号,kx为自然数,且从沿X轴最中心的条纹开始计数。In the formula, x represents the X-axis coordinate value of any point P on the stripe formed by each parallel light source component located on the X-axis projected on the curved surface to be measured; H represents when the detection camera can obtain a clear image of the two dimensional image, the vertical distance between the lens center of the detection camera and the X"Y"plane; a x respectively represent the distance between the optical axis of each parallel light source assembly on the X axis and the XY plane Projection angle; D represents the distance between the optical center of the lens of the collimator of each of the parallel light sources and the optical center of the lens of the detection camera; d represents the grating constant of the transmission grating of each of the parallel light source components; in addition , k x represents the serial number of the fringe that includes point P among the multiple parallel fringes formed by the projection of each parallel light source component on the X-axis on the surface to be measured, k x is a natural number, and starts from the most central point along the X-axis Streaks start counting.
作为进一步优选地,对于处于所述Y轴上的两个所述平行光源组件而言,其在待测曲面上所形成条纹上的任一点P在Z轴方向上的变形量hy优选分别通过下列公式计算得出:As further preferably, for the two parallel light source components on the Y axis, the deformation amount h y of any point P on the stripe formed on the curved surface to be measured in the direction of the Z axis preferably passes through The following formula is calculated:
hy=|y–{(H cotay-D)±(ky×d/sinay)}|×tanay h y =|y–{(H cota y -D)±(k y ×d/sina y )}|×tana y
式中,y表示位于所述Y轴上的各个平行光源组件在待测曲面上所投射形成条纹上的任一点P的Y轴坐标值;H表示当所述检测相机可获得清晰的所述二维图像时,该检测相机的透镜中心到所述X"Y"平面之间的垂直距离;ay分别表示位于所述Y轴上的各个平行光源组件的光轴与所述XY平面之间的投影角;D表示各个所述平行光源的平行光管的透镜光心到所述检测相机的透镜光心之间的距离;d表示各个所述平行光源组件的透射光栅自身具备的光栅常数;此外,ky表示位于所述Y轴上的各个平行光源组件在待测曲面上所投射形成的多个平行条纹中包含P点的条纹的序号,ky为自然数,且从沿Y轴最中心的条纹开始计数。In the formula, y represents the Y-axis coordinate value of any point P on the stripe formed by each parallel light source component located on the Y-axis projected on the curved surface to be measured; H represents when the detection camera can obtain a clear image of the two dimensional image, the vertical distance between the lens center of the detection camera and the X"Y"plane; a and y respectively represent the distance between the optical axis of each parallel light source assembly on the Y axis and the XY plane Projection angle; D represents the distance between the optical center of the lens of the collimator of each of the parallel light sources and the optical center of the lens of the detection camera; d represents the grating constant of the transmission grating of each of the parallel light source components; in addition , k y represents the serial number of the fringe that includes point P among the multiple parallel fringes formed by the projection of each parallel light source component on the Y-axis on the surface to be measured, k y is a natural number, and starts from the centermost point along the Y-axis Streaks start counting.
按照本发明的另一方面,还提供了相应的曲面高度信息测量方法,其特征在于,该方法包括下列步骤:According to another aspect of the present invention, a corresponding method for measuring curved surface height information is also provided, characterized in that the method includes the following steps:
步骤一:首先利用所述四个距离传感器分别测量其到所述X"Y"平面的距离信息,根据所得距离信息来调整X"Y"平面位姿,使其与所述检测相机成像平面保持平行;同时,对所述距离传感器与所述检测相机光心之间在Z轴方向的差值进行补偿,然后测量并确定所述检测相机的光心到所述X"Y"平面之间的的垂直距离H;Step 1: first use the four distance sensors to measure the distance information to the X"Y" plane respectively, and adjust the X"Y" plane pose according to the obtained distance information so that it is kept in line with the imaging plane of the detection camera Parallel; at the same time, compensate the difference in the Z-axis direction between the distance sensor and the optical center of the detection camera, and then measure and determine the distance between the optical center of the detection camera and the X"Y" plane The vertical distance H;
步骤二:使用所述一组平行光源组件在待测曲面上投射出宽窄相间的明亮条纹,并采用所述电机带动该平行光源组件旋转,使得条纹缓慢扫过整个待测区域;所述检测相机采图,并记下各图像的投影角α;接着,依次使用剩余三组所述平行光源组件,重复上述步骤,分别得到在所述四组平行光源组件所投射的条纹下待测区域的四组图像;Step 2: Use the set of parallel light source components to project bright stripes with alternate widths and narrow widths on the surface to be tested, and use the motor to drive the parallel light source components to rotate, so that the stripes slowly sweep across the entire area to be tested; the detection camera Take a picture, and write down the projection angle α of each image; then, use the remaining three groups of parallel light source components in turn, repeat the above steps, and obtain four images of the region to be measured under the stripes projected by the four groups of parallel light source components. group image;
步骤三:针对所得到的四组图像,分别计算得到各个所述平行光源组件在待测曲面上所投射形成条纹上的任一点P在Z轴方向的变形量,进而通过加权求平均值的方式来计算求出实际变形量;Step 3: For the obtained four sets of images, calculate the deformation of any point P in the Z-axis direction on the stripes formed by each of the parallel light source components projected on the surface to be measured, and then calculate the average value by weighting method to calculate the actual deformation;
步骤四:移动测量机架,依次遍历完整个待测曲面,重复进行步骤一至步骤三,直至获得整个待测曲面所有点的高度信息为止,由此完成整体的曲面高度测量过程。Step 4: Move the measurement rack, traverse the entire surface to be measured in sequence, and repeat steps 1 to 3 until the height information of all points on the entire surface to be measured is obtained, thereby completing the overall surface height measurement process.
总体而言,通过本发明所构思的以上技术方案与现有技术相比,主要具备以下的技术优点:Generally speaking, compared with the prior art, the above technical solution conceived by the present invention mainly has the following technical advantages:
1、本发明中通过对曲面高度信息测量装置的整体构造布局重新进行了设计,尤其是一些关键组件如测量机架、平行光源组件和检测相机的具体组成结构和设置方式作出改进,相应不仅能够紧使用单个相机即可完成曲面高度信息的整体测量过程,而且与现有设备相比其结构更为紧凑合理、便于操控,而且显著提高了最终可获得的测量精度;1. In the present invention, the overall structural layout of the curved surface height information measuring device is redesigned, especially the specific composition and arrangement of some key components such as the measurement frame, parallel light source components and detection cameras are improved. Correspondingly, not only can The overall measurement process of surface height information can be completed by using a single camera, and compared with existing equipment, its structure is more compact and reasonable, easy to operate, and significantly improves the final measurement accuracy;
2、本发明中各组件的参数选择可根据所需测量精度进行选择,相应在实际应用中具备适用性强和便于根据工况高效操作的特定;例如,当测量精度要求不高时,可通过增大按照本发明的平行光源组件的条纹间距的方式来进行操作,由此减少测量数据,提高测量速度,同时还有利于增大相机视场范围,大大提高了测量速度;而当测量精度要求高时,则可通过减小条纹间距的方式来进行操作,测量数据增多,精度提高;同时还有利于减小相机视场范围,增大图像像素,同样大大提高了测量精度;2. The parameter selection of each component in the present invention can be selected according to the required measurement accuracy, correspondingly, in practical applications, it has strong applicability and is convenient for efficient operation according to working conditions; for example, when the measurement accuracy is not high, it can be selected by The operation is carried out by increasing the fringe spacing of the parallel light source assembly according to the present invention, thus reducing the measurement data and improving the measurement speed, and at the same time, it is also beneficial to increase the field of view of the camera, which greatly improves the measurement speed; and when the measurement accuracy requires When it is high, it can be operated by reducing the fringe spacing, the measurement data increases, and the accuracy is improved; at the same time, it is also beneficial to reduce the field of view of the camera and increase the image pixels, which also greatly improves the measurement accuracy;
3、本发明中还结合平行光源组件的构造特点对其条纹编码方式进行了优化设计,相应使得在图像处理过程中能够快速辨别各条纹,加快了检测速度;此外,本发明中成组的平行光源可形成多组条纹,不仅避免了曲面变化大导致一侧条纹投射不到的问题,还可对同一点多次测量,通过计算得到更为精确的高度信息;3. In the present invention, the fringe encoding method is also optimized in combination with the structural characteristics of the parallel light source assembly, so that each fringe can be quickly identified in the image processing process, and the detection speed is accelerated; in addition, in the present invention, groups of parallel The light source can form multiple groups of stripes, which not only avoids the problem that the stripes on one side cannot be projected due to large changes in the curved surface, but also can measure the same point multiple times, and obtain more accurate height information through calculation;
4、本发明中还结合以上装置构造设计的特点,进一步对各个测量点在XYZ多轴上的坐标值及变形量计算公式作出了针对性测量,实际测试表明不仅可简化运算处理过程,可以计算获得数据与实际数据相比具备精度高、便于后续处理等特点,因而与传统处理算法相比可显著提高曲面高度测量的最终精度。4. In the present invention, combined with the characteristics of the above-mentioned device structure design, the coordinate values and deformation calculation formulas of each measurement point on the XYZ multi-axis are further targeted for measurement. Actual tests show that not only the calculation process can be simplified, but also the calculation formula can be calculated. Compared with the actual data, the obtained data has the characteristics of high precision and convenient subsequent processing, so compared with the traditional processing algorithm, the final precision of the surface height measurement can be significantly improved.
附图说明Description of drawings
图1是按照本发明优选实施例所构建的基于单目视觉的曲面高度信息测量装置的整体构造示意图;1 is a schematic diagram of the overall structure of a monocular vision-based surface height information measuring device constructed according to a preferred embodiment of the present invention;
图2是图1中所示测量机架及安装其上的平行光源组件、距离传感器和检测相机的具体布置示意图;Fig. 2 is a schematic diagram of the specific layout of the measuring frame shown in Fig. 1 and the parallel light source assembly, the distance sensor and the detection camera installed thereon;
图3是用于示范性说明为了便于后期计算处理而构建的多个坐标系的示意图;FIG. 3 is a schematic diagram for exemplarily illustrating multiple coordinate systems constructed to facilitate post-calculation processing;
图4是按照本发明优选实施例设计的平行光源组件的组成结构示意图;4 is a schematic diagram of the composition and structure of a parallel light source assembly designed according to a preferred embodiment of the present invention;
图5是用于示范性说明平行光源组件投射形成多个条纹的原理图;FIG. 5 is a schematic diagram for exemplarily illustrating the formation of multiple stripes by projection of parallel light source components;
图6是按照本发明优选实施可采用的、对平行光源组件所形成的多个条纹进行编码处理所获得的示意图;Fig. 6 is a schematic diagram obtained by encoding a plurality of stripes formed by parallel light source components according to the preferred implementation of the present invention;
图7是用于解释说明以检测相机为中心、运用三角测量几何原理执行曲面高度信息测量的示意图;Fig. 7 is a schematic diagram for explaining the measurement of the height information of the curved surface with the detection camera as the center and using the geometric principle of triangulation;
图8是用于示范性说明按照本发明的上述测量装置在X"Y"平面上投射形成的条纹示意图。Fig. 8 is a schematic diagram for exemplarily illustrating fringes projected on the X"Y" plane by the above measuring device according to the present invention.
具体实施方式Detailed ways
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。此外,下面所描述的本发明各个实施方式中所涉及到的技术特征只要彼此之间未构成冲突就可以相互组合。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.
图1是按照本发明优选实施例所构建的基于单目视觉的曲面高度信息测量装置的整体构造示意图,图2是图1中所示测量机架及安装其上的平行光源组件、距离传感器和检测相机的具体布置示意图。如图1和图2所示,该纠偏器主要包括测量机架10、平行光源组件30、检测相机20和距离传感器40等组件,下面将对其逐一进行具体说明。Fig. 1 is a schematic diagram of the overall structure of a monocular vision-based surface height information measuring device constructed according to a preferred embodiment of the present invention, and Fig. 2 is a measurement frame shown in Fig. 1 and a parallel light source assembly, a distance sensor and a parallel light source assembly installed thereon. Schematic diagram of the specific layout of the detection camera. As shown in FIGS. 1 and 2 , the deflection corrector mainly includes components such as a measuring frame 10 , a parallel light source assembly 30 , a detection camera 20 , and a distance sensor 40 , which will be described in detail below.
测量机架10在本发明可设计为呈水平布置的对称十字框架的形式,并作为其他组件的安装基础。The measurement frame 10 in the present invention can be designed in the form of a horizontally arranged symmetrical cross frame, and serves as the installation basis for other components.
平行光源组件30的数量为四个,它们各自安装在所述测量机架10的四个相同臂结构的末端下方,并分别可经由配套的电机50来驱动发生旋转以使其投影角发生改变,其中,电机50固定于测量机架上,而平行光源组件30与电机轴相连,即电机50可带动平行光源组件30旋转;更具体地,如图2中所示。作为本发明的关键改进之一,各个平行光源组件分别均由安装盒31、以及依次分设在此安装盒内部的平行光管32和透射光栅33共同组成,其中该平行光管32用于向所述透射光栅33发射单色的平行光束,该透射光栅33上则刻有宽窄相间的两种平行刻痕也即具备宽窄相间的透光缝隙,由此使得所述平行光管32发出的平行光束在待测曲面上可投射形成明暗相间的平行条纹。The number of parallel light source assemblies 30 is four, and they are respectively installed under the ends of the four identical arm structures of the measurement frame 10, and can be driven to rotate through the matching motor 50 to change the projection angle, Wherein, the motor 50 is fixed on the measuring frame, and the parallel light source assembly 30 is connected to the motor shaft, that is, the motor 50 can drive the parallel light source assembly 30 to rotate; more specifically, as shown in FIG. 2 . As one of the key improvements of the present invention, each collimated light source assembly is composed of an installation box 31, and a collimator 32 and a transmission grating 33 respectively arranged inside the installation box, wherein the collimator 32 is used to The transmission grating 33 emits monochromatic parallel light beams, and the transmission grating 33 is engraved with two kinds of parallel notches with alternate widths and narrow ones, that is, it has light transmission slits with alternate widths and narrow ones, so that the parallel light beams emitted by the collimator 32 It can be projected to form light and dark parallel stripes on the surface to be tested.
同时参看图4可见,平行光源组件30中,平行光管32与透射光栅33固定于安装盒30内。平行光管32可产生平行的单色光束;透射光栅33上刻有如图5所示不透光平行刻痕,从而在刻痕之间形成宽窄不同的透光缝。透光缝中心线到相邻刻痕中心线之间距离为光栅常数d,透光宽缝宽度为d1,透光窄缝宽度为d2。平行光管32发出的平行光经过透射光栅33后在待测曲面上形成宽窄不同的条纹。为保证不产生光的衍射现象,平行光管32的单色光波长λ应根据透光缝宽度来进行选取,但必须小于透光缝宽度,即λ<min{d1,d2}。再根据精度要求进行选择,波长λ越小,衍射现象越不明显。Referring to FIG. 4 at the same time, it can be seen that in the parallel light source assembly 30 , the collimator 32 and the transmission grating 33 are fixed in the installation box 30 . The collimator 32 can generate parallel monochromatic light beams; the transmission grating 33 is engraved with opaque parallel notches as shown in FIG. 5 , thereby forming light-transmitting slits with different widths between the notches. The distance between the center line of the light-transmitting slit and the center line of the adjacent notch is the grating constant d, the width of the light-transmitting wide slit is d 1 , and the width of the light-transmitting narrow slit is d 2 . The parallel light emitted by the collimator 32 passes through the transmission grating 33 to form stripes with different widths on the curved surface to be measured. In order to avoid light diffraction, the monochromatic light wavelength λ of the collimator 32 should be selected according to the width of the light transmission slit, but must be smaller than the width of the light transmission slit, that is, λ<min{d 1 ,d 2 }. Then choose according to the accuracy requirements, the smaller the wavelength λ, the less obvious the diffraction phenomenon.
此外,按照本发明的一个优选实施例,如图6所示,平行光源组件30产生的条纹光束可在X"Y"平面上形成多个条纹,其中用“1”表示细条纹,用“0”表示粗条纹。通过此种编码方式,即可辨别检测相机20拍摄图像中的待测曲面上条纹与X"Y"平面上条纹的对应关系。当检测相机20拍摄到待测曲面上条纹为“001010011”,可能结果有三种:“0”“010”“100”“11”、“00”“101”“001”“1”和“001”“010”“011”,分别对应序号为“x123x2”、“x351x4”、“123”。其中,x1不为1且x2大于4,故第一组错误;第二组序列也错误;因此只剩第三组序列,且符合编码规则。视场中每条条纹均能正确识别。In addition, according to a preferred embodiment of the present invention, as shown in FIG. 6, the streaked light beam generated by the parallel light source assembly 30 can form a plurality of stripes on the X"Y" plane, where "1" is used to represent the thin stripes, and "0" is used to represent the stripes. ” indicates thick stripes. Through this encoding method, the corresponding relationship between the fringes on the curved surface to be measured and the fringes on the X"Y" plane in the image captured by the detection camera 20 can be identified. When the detection camera 20 captures that the stripe on the surface to be tested is "001010011", there are three possible results: "0", "010", "100", "11", "00", "101", "001", "1" and "001""010" and "011" respectively correspond to serial numbers "x 1 23x 2 ", "x 3 51x 4 ", and "123". Among them, x 1 is not 1 and x 2 is greater than 4, so the first group is wrong; the second group of sequences is also wrong; therefore, only the third group of sequences remains, and it conforms to the coding rules. Every fringe in the field of view is correctly identified.
作为本发明的另一关键改进,检测相机20的数量仅为一个,它固定安装在所述测量机架10的中央下方,并与各个所述平行光源组件30相配合,用于对待测曲面上所形成的平行条纹执行采图以获得所需的二维图像。As another key improvement of the present invention, the number of detection cameras 20 is only one, which is fixedly installed under the center of the measurement frame 10, and cooperates with each of the parallel light source assemblies 30 to be used on the curved surface to be measured. The formed parallel fringes perform imaging to obtain the desired two-dimensional image.
此外,如图3示范性所示,可以该检测相机20的透镜光心为原点来建立一个相机直角坐标系XYZ,其中该相机指教坐标系的Z轴与所述检测相机20的光轴重合且指向该检测相机的下方,其X轴、Y轴满足右手定则,并且四个所述平行光源组件30中的两个保持对称地处于此X轴上,剩余两个同样保持对称地处于此Y轴上;类似地,以所述检测相机20的成像平面的中心为原点建立一个图像直角坐标系X′Y′Z,其中该图像直角坐标系的Z轴与所述相机指教坐标系的Z轴相重合,其X′轴、Y′轴同样满足右手定则;接着,在所述检测相机20的正下方建立一个参考直角坐标系X"Y"Z,其中该参考直角坐标系的Z轴与所述检测相机的光轴重合,其X"轴、Y"轴同样满足右手定则,并且它的X"Y"平面保持与所述相机直角坐标系的XY平面相互平行。In addition, as exemplarily shown in FIG. 3 , a camera Cartesian coordinate system XYZ can be established with the optical center of the lens of the detection camera 20 as the origin, wherein the Z axis of the camera teaching coordinate system coincides with the optical axis of the detection camera 20 and Pointing to the bottom of the detection camera, its X-axis and Y-axis satisfy the right-hand rule, and two of the four parallel light source assemblies 30 remain symmetrically located on this X-axis, and the remaining two remain symmetrically located on this Y-axis on the axis; similarly, an image Cartesian coordinate system X'Y'Z is established with the center of the imaging plane of the detection camera 20 as the origin, wherein the Z axis of the image Cartesian coordinate system and the Z axis of the camera teaching coordinate system coincides with each other, its X' axis and Y' axis also meet the right-hand rule; then, a reference rectangular coordinate system X"Y"Z is established directly below the detection camera 20, wherein the Z axis of the reference rectangular coordinate system is the same as The optical axes of the detection camera are coincident, and its X" axis and Y" axis also satisfy the right-hand rule, and its X"Y" plane remains parallel to the XY plane of the camera Cartesian coordinate system.
重新参看图2,四个距离传感器40分别对应于各个所述平行光源组件30而设置,并且当通过调整所述测量机架10的高度使得所述检测相机(20)可获得清晰的所述二维图像时,用于在此位置下对所述检测相机20的透镜光心到所述X"Y"平面之间的垂直距离H进行测量,同时用于对此检测相机20的成像平面与该X"Y"平面之间的平行度进行检测。所述电机50的电机轴与检测相机20光心同在XY平面的平行面上,且平行光管32的透镜光心在电机轴所在直线上,从而保证在电机50转动改变投影角α角度时,平行光管32透镜光心与检测相机20光心的相对位置不变,故其水平距离D保持不变。Referring again to Fig. 2, four distance sensors 40 are respectively arranged corresponding to each of the parallel light source assemblies 30, and when the height of the measuring frame 10 is adjusted so that the detection camera (20) can obtain a clear image of the two In the case of a three-dimensional image, it is used to measure the vertical distance H between the optical center of the lens of the detection camera 20 and the X"Y" plane at this position, and it is used to measure the imaging plane of the detection camera 20 and the The parallelism between the X"Y" planes is tested. The motor shaft of the motor 50 and the optical center of the detection camera 20 are on the parallel plane of the XY plane, and the lens optical center of the collimator 32 is on the straight line where the motor shaft is located, thereby ensuring that when the motor 50 rotates and changes the projection angle α angle , the relative position of the optical center of the lens of the collimator 32 and the optical center of the detection camera 20 remains unchanged, so the horizontal distance D thereof remains unchanged.
下面将更具体地解释按照本发明的测量工艺过程。The measurement process according to the present invention will be explained more specifically below.
首先,如图7所示,显示了以检测相机为中心、运用三角测量几何原理执行曲面高度信息测量的示意图。其中,仅画出在X轴上的平行光源组件30,其在待测曲面上所投射条纹与Y轴平行,故只需其X轴坐标信息;而在Y轴上的两组平行光源组件30,其在待测曲面上所投射条纹与X轴平行,故只需其Y轴坐标信息。由平行光管32发出的平行光束经过透射光栅33后在待测曲面上形成明暗相间的编码条纹,覆盖整个待测区域。以其中某一条纹进行阐述,该条纹中心线经过点P。此时,位于X轴上的平行光源组件30光轴与XY平面之间呈投影角α。First, as shown in Fig. 7, it shows a schematic diagram of measuring the height information of a surface with the detection camera as the center and using the geometric principle of triangulation. Among them, only the parallel light source assembly 30 on the X-axis is drawn, and the stripes projected on the curved surface to be measured are parallel to the Y-axis, so only the X-axis coordinate information is needed; and the two groups of parallel light source assemblies 30 on the Y-axis , the stripes projected on the surface to be measured are parallel to the X-axis, so only the Y-axis coordinate information is required. The parallel light beams emitted by the collimator 32 pass through the transmission grating 33 to form coded stripes with alternating light and dark on the surface to be tested, covering the entire area to be tested. One of the stripes is used for illustration, and the center line of the stripe passes through the point P. At this time, the projection angle α is formed between the optical axis of the parallel light source assembly 30 on the X-axis and the XY plane.
假设点P相机坐标为(x,y,z),检测相机20所拍得二维图像中点P的像坐标P′为(x′,y′)。则在X轴上的平行光源组件30在待测曲面上所投射条纹上点P在X轴方向上坐标为:Assuming that the camera coordinates of point P are (x, y, z), the image coordinates P′ of point P in the two-dimensional image captured by the detection camera 20 are (x′, y′). Then the coordinates of the point P on the stripe projected by the parallel light source assembly 30 on the X-axis on the curved surface to be measured in the X-axis direction are:
x=x’×(D×tanax)/(f-x’tanax) (1-1)x=x'×(D×tana x )/(f-x'tana x ) (1-1)
式中,D表示各个所述平行光源组件的平行光管的透镜光心到所述检测相机的透镜光心之间的距离;f为所述检测相机的焦距;ax分别表示位于所述X轴上的各个平行光源组件的光轴与所述XY平面之间的投影角;x′分别表示在所述检测相机所获得的二维图像中,与所述点P保持对应的像素点P′的X′轴坐标值。In the formula, D represents the distance between the optical center of the lens of the collimator of each of the parallel light source components and the optical center of the lens of the detection camera; f is the focal length of the detection camera; The projection angle between the optical axis of each parallel light source assembly on the axis and the XY plane; x' respectively represents the pixel point P' corresponding to the point P in the two-dimensional image obtained by the detection camera The X' axis coordinate value of .
而在Y轴上的平行光源组件30在待测曲面所投射条纹上点P在Y轴方向上坐标为:The coordinates of the point P on the stripes projected by the parallel light source assembly 30 on the Y-axis in the Y-axis direction on the curved surface to be measured are:
y=y’×(D×tanay)/(f-y’tanay) (1-2)y=y'×(D×tana y )/(f-y'tana y ) (1-2)
式中,D表示各个所述平行光源组件的平行光管的透镜光心到所述检测相机的透镜光心之间的距离;f为所述检测相机的焦距;ay分别表示位于所述Y轴上的各个平行光源组件的光轴与所述XY平面之间的投影角;y′分别表示在所述检测相机所获得的二维图像中,与所述点P保持对应的像素点P′的Y′轴坐标值。In the formula, D represents the distance between the optical center of the lens of the collimator of each of the parallel light source components and the optical center of the lens of the detection camera; f is the focal length of the detection camera; The projection angle between the optical axis of each parallel light source assembly on the axis and the XY plane; y' respectively represents the pixel point P' corresponding to the point P in the two-dimensional image obtained by the detection camera The Y' axis coordinate value of .
图8是用于示范性说明按照本发明的上述测量装置在X"Y"平面上投射形成的条纹示意图。进一步地,还需要分别求出处于所述X轴和Y轴上的两个所述平行光源组件而言,其在待测曲面上所形成条纹上的任一点P在Z轴方向上的变形量。Fig. 8 is a schematic diagram for exemplarily illustrating fringes projected on the X"Y" plane by the above measuring device according to the present invention. Further, it is also necessary to separately calculate the deformation amount of any point P on the stripes formed on the curved surface to be measured for the two parallel light source components on the X-axis and Y-axis in the direction of the Z-axis .
如图8中所示,仅画出在X轴上的平行光源组件30在待测曲面上所投射条纹,其与Y轴平行,故只需其X轴坐标信息;而在Y轴上的平行光源组件30在待测曲面上所投射条纹与X轴平行,故只需其Y轴坐标信息。假设在X轴上的平行光源组件30中透射光栅33某一条纹为中心条纹,则所投射条纹上点在X轴方向上坐标为:As shown in Figure 8, only the parallel light source assembly 30 on the X-axis is drawn on the curved surface to be measured to project stripes, which are parallel to the Y-axis, so only its X-axis coordinate information is needed; The stripes projected by the light source assembly 30 on the curved surface to be measured are parallel to the X-axis, so only the Y-axis coordinate information is required. Assuming that a certain fringe of the transmission grating 33 in the parallel light source assembly 30 on the X-axis is the central fringe, the coordinates of the point on the projected fringe in the X-axis direction are:
x0=H×cotax-D (1-3)x 0 =H×cota x -D (1-3)
而在Y轴上的平行光源组件30中透射光栅33某一条纹为中心条纹,则所投射条纹上点在Y轴方向上坐标为:In the parallel light source assembly 30 on the Y axis, a certain stripe of the transmission grating 33 is the central stripe, and the coordinates of the point on the projected stripe in the direction of the Y axis are:
y0=H×cotay-D (1-4)y 0 =H×cota y -D (1-4)
由于透射光栅33上各条纹为等间距(即光栅常数d),则在X轴上的平行光源组件30在X"Y"平面上投射各条纹的X轴坐标为:Since the stripes on the transmission grating 33 are equally spaced (i.e. the grating constant d), the X-axis coordinates of the stripes projected by the parallel light source assembly 30 on the X-axis on the X"Y" plane are:
xk=x0±(k×d/sinax) (1-5)x k =x 0 ±(k×d/sina x ) (1-5)
式中,d为光栅常数;k为距离中心零条纹的第k条条纹,X轴正方向为+,负方向为-;In the formula, d is the grating constant; k is the kth stripe from the center zero stripe, the positive direction of the X axis is +, and the negative direction is -;
而则在Y轴上的平行光源组件30在X"Y"平面上投射各条纹的Y轴坐标为:And then the Y-axis coordinates of each stripe projected by the parallel light source assembly 30 on the Y-axis on the X"Y" plane are:
yk=y0±(k×d/sinay) (1-6)y k =y 0 ±(k×d/sina y ) (1-6)
联合以上计算式,相应地可求得,对于处于所述X轴上的两个所述平行光源组件而言,其在待测曲面上所形成条纹上的任一点P在Z轴方向上的变形量hx优选分别通过下列公式计算得出:Combining the above calculation formulas, correspondingly, for the two parallel light source components on the X-axis, the deformation of any point P on the stripes formed on the curved surface to be measured in the Z-axis direction The quantities h x are preferably calculated by the following formulas, respectively:
hx=|x–{(H cotax-D)±(kx×d/sinax)}|×tanax h x =|x–{(H cota x -D)±(k x ×d/sina x )}|×tana x
式中,x表示位于所述X轴上的各个平行光源组件在待测曲面上所投射形成条纹上的任一点P的X轴坐标值;H表示当所述检测相机(20)可获得清晰的所述二维图像时,该检测相机的透镜中心到所述X"Y"平面之间的垂直距离;ax分别表示位于所述X轴上的各个平行光源组件的光轴与所述XY平面之间的投影角;D表示各个所述平行光源的平行光管的透镜光心到所述检测相机的透镜光心之间的距离;d表示各个所述平行光源组件的透射光栅自身具备的光栅常数;此外,kx表示位于所述X轴上的各个平行光源组件在待测曲面上所投射形成的多个平行条纹中包含P点的条纹的序号,kx为自然数,且从沿X轴最中心的条纹开始计数。In the formula, x represents the X-axis coordinate value of any point P on the stripe formed by each parallel light source assembly located on the X-axis projected on the curved surface to be measured; H represents that when the detection camera (20) can obtain a clear During the two-dimensional image, the vertical distance between the lens center of the detection camera and the X"Y"plane; a x respectively represent the optical axis of each parallel light source assembly on the X axis and the XY plane D represents the distance between the optical center of the lens of the collimator of each of the parallel light sources and the optical center of the lens of the detection camera; d represents the grating of the transmission grating of each of the parallel light source components. constant; in addition, k x represents the sequence number of the fringe that includes point P among the multiple parallel fringes formed by the projection of each parallel light source component on the X-axis on the surface to be measured, and k x is a natural number, and from along the X-axis The centermost stripe starts counting.
类似地,对于处于所述Y轴上的两个所述平行光源组件而言,其在待测曲面上所形成条纹上的任一点P在Z轴方向上的变形量hy优选分别通过下列公式计算得出:Similarly, for the two parallel light source components on the Y-axis, the deformation amount h y of any point P on the stripes formed on the curved surface to be measured in the Z-axis direction is preferably respectively expressed by the following formulas Calculated:
hy=|y–{(H cotay-D)±(ky×d/sinay)}|×tanay h y =|y–{(H cota y -D)±(k y ×d/sina y )}|×tana y
式中,y表示位于所述Y轴上的各个平行光源组件在待测曲面上所投射形成条纹上的任一点P的Y轴坐标值;H表示当所述检测相机(20)可获得清晰的所述二维图像时,该检测相机的透镜中心到所述X"Y"平面之间的垂直距离;ay分别表示位于所述Y轴上的各个平行光源组件的光轴与所述XY平面之间的投影角;D表示各个所述平行光源的平行光管的透镜光心到所述检测相机的透镜光心之间的距离;d表示各个所述平行光源组件的透射光栅自身具备的光栅常数;此外,ky表示位于所述Y轴上的各个平行光源组件在待测曲面上所投射形成的多个平行条纹中包含P点的条纹的序号,ky为自然数,且从沿Y轴最中心的条纹开始计数。In the formula, y represents the Y-axis coordinate value of any point P on the stripe formed by each parallel light source assembly located on the Y-axis projected on the curved surface to be measured; H represents that when the detection camera (20) can obtain a clear During the two-dimensional image, the vertical distance between the lens center of the detection camera and the X"Y"plane; a and y respectively represent the optical axis of each parallel light source assembly on the Y axis and the XY plane D represents the distance between the optical center of the lens of the collimator of each of the parallel light sources and the optical center of the lens of the detection camera; d represents the grating of the transmission grating of each of the parallel light source components. constant; in addition, k y represents the sequence number of the fringe that includes point P among the multiple parallel fringes formed by the projection of each parallel light source component on the Y-axis on the surface to be measured, and k y is a natural number, and from along the Y-axis The centermost stripe starts counting.
以上的曲面高度信息测量工艺方法可概括如下主要步骤:The above surface height information measurement process method can be summarized as follows main steps:
步骤一:首先利用所述四个距离传感器40分别测量其到所述X"Y"平面的距离信息,根据所得距离信息来调整X"Y"平面位姿,使其与所述检测相机20成像平面保持平行;同时,对所述距离传感器40与所述检测相机20光心之间在Z轴方向的差值进行补偿,然后测量并确定所述检测相机20的光心到所述X"Y"平面之间的的垂直距离H;Step 1: First, use the four distance sensors 40 to measure the distance information to the X"Y" plane respectively, and adjust the pose of the X"Y" plane according to the obtained distance information to make it image with the detection camera 20 The planes remain parallel; at the same time, the difference in the Z-axis direction is compensated between the distance sensor 40 and the optical center of the detection camera 20, and then measured and determined from the optical center of the detection camera 20 to the X, Y "The vertical distance H between the planes;
步骤二:使用所述一组平行光源组件30在待测曲面上投射出宽窄相间的明亮条纹,并采用所述电机50带动该平行光源组件30旋转,使得条纹缓慢扫过整个待测区域;所述检测相机20采图,并记下各图像的投影角α;接着,依次使用剩余三组所述平行光源组件30,重复上述步骤,分别得到在所述四组平行光源组件30所投射的条纹下待测区域的四组图像;Step 2: using the set of parallel light source assemblies 30 to project bright stripes with alternate widths and narrow widths on the surface to be measured, and using the motor 50 to drive the parallel light source assemblies 30 to rotate, so that the stripes slowly sweep across the entire area to be measured; The detection camera 20 captures a picture, and writes down the projection angle α of each image; then, uses the remaining three groups of parallel light source assemblies 30 in sequence, repeats the above steps, and obtains the stripes projected by the four groups of parallel light source assemblies 30 respectively Four sets of images of the area to be tested;
步骤三:针对所得到的四组图像,分别计算得到各个所述平行光源组件在待测曲面上所投射形成条纹上的任一点P在Z轴方向的变形量,进而通过加权求平均值的方式来计算求出实际变形量;Step 3: For the obtained four sets of images, calculate the deformation of any point P in the Z-axis direction on the stripes formed by each of the parallel light source components projected on the surface to be measured, and then calculate the average value by weighting method to calculate the actual deformation;
步骤四:移动测量机架10,依次遍历完整个待测曲面,重复进行步骤一至步骤三,直至获得整个待测曲面所有点的高度信息为止,由此完成整体的曲面高度测量过程。Step 4: Move the measurement rack 10, traverse the entire surface to be measured in sequence, and repeat steps 1 to 3 until the height information of all points on the entire surface to be measured is obtained, thereby completing the overall surface height measurement process.
综上,按照本发明的曲面高度信息测量装置不仅能够紧使用单个相机即可完成曲面高度信息的整体测量过程,而且与现有设备相比其结构更为紧凑合理、便于操控,而且显著提高了最终可获得的测量精度;同时它还应用范围更为广泛,便于在多种工况下高效率调整操作参数,因而更加适用于高效率高精度的各类曲面高度测量应用场合。To sum up, the curved surface height information measuring device according to the present invention can not only use a single camera to complete the overall measurement process of curved surface height information, but also has a more compact and reasonable structure and is easier to manipulate than existing equipment, and significantly improves At the same time, it has a wider range of applications, which is convenient for efficient adjustment of operating parameters under various working conditions, so it is more suitable for various high-efficiency and high-precision surface height measurement applications.
本领域的技术人员容易理解,以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。It is easy for those skilled in the art to understand that the above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention, All should be included within the protection scope of the present invention.
Claims (5)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710447508.XA CN107121079B (en) | 2017-06-14 | 2017-06-14 | A device and method for measuring surface height information based on monocular vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710447508.XA CN107121079B (en) | 2017-06-14 | 2017-06-14 | A device and method for measuring surface height information based on monocular vision |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107121079A CN107121079A (en) | 2017-09-01 |
| CN107121079B true CN107121079B (en) | 2019-11-22 |
Family
ID=59718403
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710447508.XA Active CN107121079B (en) | 2017-06-14 | 2017-06-14 | A device and method for measuring surface height information based on monocular vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107121079B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107514958B (en) * | 2017-10-12 | 2023-06-02 | 华中科技大学 | A multifunctional measuring instrument and measuring method for shape and position tolerance of shaft assembly |
| CN110057835B (en) * | 2019-05-29 | 2024-09-20 | 深圳中科飞测科技股份有限公司 | A detection device and a detection method |
| CN110646171B (en) * | 2019-10-31 | 2021-11-02 | 中国科学院长春光学精密机械与物理研究所 | A method for measuring the parallelism of light sources |
| IT202000001057A1 (en) | 2020-01-21 | 2021-07-21 | Visiontek Eng S R L | MOBILE APPARATUS FOR THREE-DIMENSIONAL OPTICAL MEASUREMENT FOR ROPES WITH ROPE ATTACHMENT DEVICE |
| CN113503830B (en) * | 2021-07-05 | 2023-01-03 | 无锡维度投资管理合伙企业(有限合伙) | Aspheric surface shape measuring method based on multiple cameras |
| CN115096222B (en) * | 2022-08-24 | 2022-12-20 | 中科卓芯半导体科技(苏州)有限公司 | Flatness detection method and system for photomask substrate |
| CN116608774B (en) * | 2023-07-18 | 2024-05-14 | 宁德时代新能源科技股份有限公司 | Structural part notch residual thickness detection method, thickness detection equipment and detection device |
| CN118670327B (en) * | 2024-08-22 | 2024-11-05 | 山东山森数控技术有限公司 | Self-positioning three-coordinate detection tool |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH036411A (en) * | 1989-06-05 | 1991-01-11 | Toshiba Corp | Surface defect recordor |
| JP2003270719A (en) * | 2002-03-13 | 2003-09-25 | Osaka Industrial Promotion Organization | Projection method, projector, and method and system for supporting work |
| EP1127245B1 (en) * | 1998-11-04 | 2004-07-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Device for determining the spatial co-ordinates of objects |
| JP2004361142A (en) * | 2003-06-02 | 2004-12-24 | Yamatake Corp | Three-dimensional measuring device and three-dimensional measuring method |
| CN101013028A (en) * | 2006-01-31 | 2007-08-08 | 欧姆龙株式会社 | Image processing method and image processor |
| CN101986350A (en) * | 2010-10-22 | 2011-03-16 | 武汉大学 | Monocular structured light-based three-dimensional modeling method |
| WO2013058710A1 (en) * | 2011-10-18 | 2013-04-25 | Nanyang Technological University | Apparatus and method for 3d surface measurement |
| CN104034280A (en) * | 2009-05-21 | 2014-09-10 | 株式会社高永科技 | Shape measurement apparatus and method |
| CN105043300A (en) * | 2015-05-27 | 2015-11-11 | 东莞市盟拓光电科技有限公司 | A 3D measurement system capable of simultaneously projecting the measured object from multiple directions |
| CN204902787U (en) * | 2015-05-27 | 2015-12-23 | 东莞市盟拓光电科技有限公司 | A 3D measurement system capable of simultaneously projecting the measured object from multiple directions |
| CN105180904A (en) * | 2015-09-21 | 2015-12-23 | 大连理工大学 | High-speed moving target position and posture measurement method based on coding structured light |
| CN106370103A (en) * | 2016-08-31 | 2017-02-01 | 成都主导软件技术有限公司 | Method and device for detecting pantograph state |
| CN206095965U (en) * | 2016-08-31 | 2017-04-12 | 苏州市铂汉塑胶五金有限公司 | Full angle automated inspection equipment of single -phase machine |
-
2017
- 2017-06-14 CN CN201710447508.XA patent/CN107121079B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH036411A (en) * | 1989-06-05 | 1991-01-11 | Toshiba Corp | Surface defect recordor |
| EP1127245B1 (en) * | 1998-11-04 | 2004-07-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Device for determining the spatial co-ordinates of objects |
| JP2003270719A (en) * | 2002-03-13 | 2003-09-25 | Osaka Industrial Promotion Organization | Projection method, projector, and method and system for supporting work |
| JP2004361142A (en) * | 2003-06-02 | 2004-12-24 | Yamatake Corp | Three-dimensional measuring device and three-dimensional measuring method |
| CN101013028A (en) * | 2006-01-31 | 2007-08-08 | 欧姆龙株式会社 | Image processing method and image processor |
| CN104034280A (en) * | 2009-05-21 | 2014-09-10 | 株式会社高永科技 | Shape measurement apparatus and method |
| CN101986350A (en) * | 2010-10-22 | 2011-03-16 | 武汉大学 | Monocular structured light-based three-dimensional modeling method |
| WO2013058710A1 (en) * | 2011-10-18 | 2013-04-25 | Nanyang Technological University | Apparatus and method for 3d surface measurement |
| CN105043300A (en) * | 2015-05-27 | 2015-11-11 | 东莞市盟拓光电科技有限公司 | A 3D measurement system capable of simultaneously projecting the measured object from multiple directions |
| CN204902787U (en) * | 2015-05-27 | 2015-12-23 | 东莞市盟拓光电科技有限公司 | A 3D measurement system capable of simultaneously projecting the measured object from multiple directions |
| CN105180904A (en) * | 2015-09-21 | 2015-12-23 | 大连理工大学 | High-speed moving target position and posture measurement method based on coding structured light |
| CN106370103A (en) * | 2016-08-31 | 2017-02-01 | 成都主导软件技术有限公司 | Method and device for detecting pantograph state |
| CN206095965U (en) * | 2016-08-31 | 2017-04-12 | 苏州市铂汉塑胶五金有限公司 | Full angle automated inspection equipment of single -phase machine |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107121079A (en) | 2017-09-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107121079B (en) | A device and method for measuring surface height information based on monocular vision | |
| CN101526336B (en) | Calibration method of line structured light 3D vision sensor based on gauge block | |
| TWI460394B (en) | Three-dimensional image measuring apparatus | |
| EP2568253B1 (en) | Structured-light measuring method and system | |
| CN107014312A (en) | A kind of integral calibrating method of mirror-vibrating line laser structured light three-dimension measuring system | |
| CN101539422B (en) | Monocular vision real time distance measuring method | |
| CN108362228B (en) | Double-optical-machine-based optical knife grating hybrid three-dimensional measurement device and measurement method | |
| CN104583713B (en) | The method that the body surface of preferably structuring is imaged and the device for imaging | |
| KR20200105498A (en) | 3D reconstruction system and 3D reconstruction method | |
| CN108827187B (en) | A 3D Profile Measurement System | |
| CN107101582A (en) | Axial workpiece run-out error On-line Measuring Method based on structure light vision | |
| JPH07509782A (en) | Validation method for optical distance measurement of target surfaces in turbulent environments | |
| CN113888693B (en) | A high-precision point cloud data reconstruction method | |
| CN103454070A (en) | Focus performance test method for X-ray combined refraction lens on basis of CCD detection | |
| CN102538707B (en) | Three dimensional localization device and method for workpiece | |
| CN109506629B (en) | A method for calibrating the rotation center of an underwater nuclear fuel assembly detection device | |
| JP5098174B2 (en) | 3D shape measuring device | |
| WO2023089788A1 (en) | Three-dimensional measuring device | |
| Wu et al. | A unified calibration method of 3D laser profile measurement with different of laser-line lengths | |
| CN109186969A (en) | A kind of servo feed movement dynamic property visible detection method | |
| CN105758339B (en) | Optical axis and object plane measuring for verticality method based on geometric error correction technique | |
| CN108662980B (en) | Welding stud position detection device and method based on silhouette technology | |
| CN208187381U (en) | Laser leveler automatic checkout system | |
| US12332431B2 (en) | Compensation of pupil aberration of a lens objective | |
| CN108181093A (en) | High-speed swing mirror performance index detection device and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |