[go: up one dir, main page]

WO2018176370A1 - Visual inspection system and method - Google Patents

Visual inspection system and method Download PDF

Info

Publication number
WO2018176370A1
WO2018176370A1 PCT/CN2017/078962 CN2017078962W WO2018176370A1 WO 2018176370 A1 WO2018176370 A1 WO 2018176370A1 CN 2017078962 W CN2017078962 W CN 2017078962W WO 2018176370 A1 WO2018176370 A1 WO 2018176370A1
Authority
WO
WIPO (PCT)
Prior art keywords
detected
image
detection image
detection
interference
Prior art date
Application number
PCT/CN2017/078962
Other languages
French (fr)
Chinese (zh)
Inventor
阳光
郝少华
牛立涛
Original Assignee
深圳配天智能技术研究院有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳配天智能技术研究院有限公司 filed Critical 深圳配天智能技术研究院有限公司
Priority to CN201780001564.9A priority Critical patent/CN107980094B/en
Priority to PCT/CN2017/078962 priority patent/WO2018176370A1/en
Publication of WO2018176370A1 publication Critical patent/WO2018176370A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8806Specially adapted optical and illumination features
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8887Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques

Definitions

  • Embodiments of the present invention relate to the field of visual inspection, and in particular, to a visual inspection system and method.
  • Industrial visual inspection generally performs image acquisition by the object to be detected, and performs image recognition on the acquired image, and identifies predetermined targets such as scratches, cracks, and the like from the image of the object to be detected.
  • predetermined targets such as scratches, cracks, and the like from the image of the object to be detected.
  • the surface of the object to be inspected is easy to deposit dust, and the object to be detected is often susceptible to dust, so it needs to be tested in a dust-free environment, which increases the cost of detection;
  • an embodiment of the present invention provides a visual detection method, which includes: acquiring a first detection image and a second detection image of an object to be detected under different illumination conditions and/or shooting conditions; The brightness values of the corresponding positions of the first detection image and the second detection image are mathematically operated to distinguish the object to be detected and the interference on the object to be detected.
  • the step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: setting different illumination conditions and/or shooting conditions according to the reflection characteristics of the object to be detected and the interference. In addition, there is a certain difference in the brightness values of the target to be detected and the interference after the mathematical operation.
  • the step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: setting different illumination conditions and/or shooting conditions according to the reflection characteristics of the object to be detected and the interference. And further enabling distinguishing between the first detection image and the second detection image on the one of the first detection image and the second detection image according to the brightness value. One can distinguish the interference from the target to be detected and other areas of the object to be detected according to the brightness value.
  • the step of performing mathematical operations on the luminance values of the corresponding positions of the first detection image and the second detection image to further distinguish the target to be detected and the interference on the object to be detected includes: using a preset threshold segmentation condition and a logical operation
  • the luminance values of the corresponding positions of the first detection image and the second detection image are processed to further distinguish the target to be detected and the interference.
  • the interference includes dust
  • the object to be detected includes at least one of a scratch and a crack
  • the interference includes one of a scratch and a crack
  • the object to be detected includes the other of the scratch and the crack.
  • the step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: changing at least one of a position, a light intensity, and an illumination angle of the light source or by changing the image At least one of a position of the device, an exposure intensity, and a shooting angle is acquired to acquire different lighting conditions or shooting conditions.
  • the step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: setting the light source at different height positions with respect to the object to be detected, and respectively using the image acquisition device to the high position
  • the object to be detected and the object to be detected illuminated by the light source disposed under the light source are subjected to image acquisition to obtain the first detection image and the second detection image respectively; and corresponding positions of the first detection image and the second detection image
  • the step of performing a mathematical operation on the brightness value to distinguish the object to be detected and the interference on the object to be detected includes: performing mathematical operations on the brightness values of the corresponding positions of the first detection image and the second detection image, thereby distinguishing the cracks on the object to be detected Or scratches the dust on the object to be inspected.
  • the step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions further includes: setting the light source and the image collection device on the same side of the object to be detected, and placing the image
  • the angle between the normal direction of the acquisition device and the normal direction of the object to be detected is set between 15 degrees and 70 degrees.
  • the step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions further includes: normalizing the normal direction of the image collection device and the normal direction of the light source set by the high position The angle between the angles is set to be less than 10 degrees, and the angle between the normal direction of the image capturing device and the normal direction of the light source set at the lower position is set to be greater than 30 degrees.
  • the step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: performing image collection on the object to be detected under different illuminations by the image acquisition device respectively. Obtaining the first detection image and the second detection image respectively; performing mathematical operations on the brightness values of the corresponding positions of the first detection image and the second detection image, and further distinguishing the target to be detected and the interference on the object to be detected include: The brightness values of the corresponding positions of the detected image and the second detected image are mathematically operated to distinguish the scratches and cracks on the object to be detected.
  • embodiments of the present invention provide a visual inspection system including a light source, an image acquisition device, and a processor, wherein the light source and the image acquisition device cooperate to further different lighting conditions and/or shooting conditions. Obtaining a first detection image and a second detection image of the object to be detected, and the processor performs a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image, thereby distinguishing the target to be detected and the interference on the object to be detected .
  • the illumination condition and/or the shooting condition are set according to the reflection target of the object to be detected and the interference, so that there is a certain difference in the brightness value of the object to be detected and the interference after the mathematical operation.
  • the illumination condition and/or the shooting condition are set according to the reflection characteristic of the object to be detected and the interference, so that the target and the interference and the object to be detected can be detected according to the brightness value on one of the first detection image and the second detection image.
  • the other areas are distinguished, and on the other of the first detection image and the second detection image, the interference can be distinguished from the object to be detected and other areas of the object to be detected according to the brightness value.
  • the processor processes the brightness values of the corresponding positions of the first detection image and the second detection image by using a preset threshold segmentation condition and a logic operation to further distinguish the target to be detected and the interference.
  • the interference includes dust
  • the object to be detected includes at least one of a scratch and a crack
  • the interference includes one of a scratch and a crack
  • the object to be detected includes the other of the scratch and the crack.
  • different lighting conditions or shooting conditions are acquired by changing at least one of the position, the light intensity, and the illumination angle of the light source or by changing at least one of the position, the exposure intensity, and the shooting angle of the image capturing device.
  • the light source is set at different height positions with respect to the object to be detected
  • the image acquisition device respectively performs image acquisition on the object to be detected irradiated by the light source set by the high position and the object to be detected under the light source set by the low position to obtain the first detection respectively.
  • the processor performs a mathematical operation on the brightness values of the corresponding positions of the first detected image and the second detected image, thereby distinguishing the cracks or scratches on the object to be detected from the dust on the object to be detected.
  • the light source and the image collecting device are disposed on the same side of the object to be detected, and an angle between a normal direction of the image capturing device and a normal direction of the object to be detected is set between 15 degrees and 70 degrees.
  • an angle between a normal direction of the image capturing device and a normal direction of the light source disposed at a high position is set to be less than 10 degrees, and a clip between a normal direction of the image capturing device and a normal direction of the light source disposed at a low position The angle is set to be greater than 30 degrees.
  • the image acquisition device respectively performs image acquisition on the object to be detected under different illuminations of the light source to obtain a first detection image and a second detection image, respectively, and the corresponding position of the first detection image and the second detection image by the processor
  • the brightness value is mathematically manipulated to distinguish between scratches and cracks on the object to be inspected.
  • the detection target and the interference are effectively distinguished by the combination of the two detection images acquired under different illumination conditions and/or shooting conditions.
  • FIG. 1 is a schematic structural view of a visual inspection system according to an embodiment of the present invention.
  • FIG. 2 is a schematic flow chart of a visual inspection method according to an embodiment of the invention.
  • FIG. 3 is a schematic diagram of a manner of acquiring a first detected image according to an embodiment of the invention.
  • FIG. 4 is a schematic diagram of a manner of acquiring a second detected image according to an embodiment of the invention.
  • FIG. 5 is a schematic diagram of performing logical operations on a first detected image and a second detected image according to an embodiment of the invention
  • FIG. 6 is a schematic diagram of performing logical operations on a first detected image and a second detected image according to another embodiment of the present invention.
  • FIG. 1 is a schematic structural diagram of a visual inspection system according to an embodiment of the present invention.
  • the visual inspection system of the present embodiment includes light sources 111, 112, an image acquisition device 12, and a processor 13.
  • the light source 111, 112 is used to provide illumination for the object to be detected 14, the image acquisition device 12 is used for image acquisition of the object 14 to be detected under the illumination of the light source 111, 112, and the processor 13 is collected according to the image acquisition device 12.
  • the image is identified and the object to be detected on the object 14 to be detected is extracted.
  • FIG. 2 is a schematic flow chart of a visual detection method according to an embodiment of the invention.
  • a visual detection method is proposed based on the visual inspection system shown in FIG. 1, which specifically includes the following steps:
  • Step S11 acquiring a first detection image and a second detection image of the object to be detected under different illumination conditions and/or shooting conditions;
  • Step S12 performing mathematical operations on the brightness values of the corresponding positions of the first detection image and the second detection image, thereby distinguishing the target to be detected and the interference on the object to be detected.
  • step S11 different illumination conditions and/or shooting conditions are set according to the reflection characteristics of the object to be detected and the interference, so that there is a certain difference in the brightness values of the object to be detected and the interference after the mathematical operation in step S12. Further, different illumination conditions and/or shooting conditions are set according to the reflection characteristics of the object to be detected and the interference, so that the target and the interference can be detected according to the brightness value on one of the first detection image and the second detection image. The other areas of the object to be detected are distinguished, and on the other of the first detection image and the second detection image, the interference can be distinguished from the object to be detected and other areas of the object to be detected according to the brightness value.
  • an appropriate mathematical operation rule can be set according to the brightness value of the first detection image and the second detection image according to the object to be detected, the interference, and other regions of the object to be detected, thereby performing mathematical operations. There is a certain difference in the brightness values of the target to be detected and the interference.
  • the specific lighting conditions and shooting conditions are set by acquiring at least one of the position, the light intensity, and the illumination angle of the light sources 111, 112 to obtain different lighting conditions, or by changing the position, exposure intensity, and shooting angle of the image capturing device 12. At least one shooting condition. It should be noted that two light sources 111, 112 are shown in FIG. 1. However, in a specific implementation process, the number of light sources is not limited thereto, for example, only one light source may be disposed, and the position and intensity of the light source may be And illumination angle adjustment to obtain different lighting conditions. Also, the number of image capture devices 12 and processors 13 is not limited by the one shown in FIG.
  • the brightness values of the corresponding positions of the first detection image and the second detection image may be processed by using a preset threshold segmentation condition and a logical operation, and the detection target and the interference are further distinguished.
  • the first detection image and the second detection image are binarized by a preset threshold segmentation condition, and the object to be detected and the interference are distinguished according to an appropriate logical operation based on obtaining the two binarized images.
  • the first detection image and the second detection image may be directly logically operated, and then the threshold image segmentation condition is used to perform threshold segmentation on the computed image to distinguish the target to be detected and the interference.
  • the disturbance may include dust
  • the object to be detected includes at least one of a scratch and a crack
  • the interference includes one of a scratch and a crack
  • the object to be detected includes the other of the scratch and the crack.
  • the light sources 111, 112 are disposed at different height positions with respect to the object 14 to be detected.
  • the light sources 111, 112 as described above may be the same light source.
  • the light sources 111, 112 and the image acquisition device 12 are disposed on the same side of the object 14 to be detected, that is, the projection area of the surface to be detected of the object 14 to be detected shown by the broken lines B1, B2.
  • the outer side, and the angle between the normal direction A2 of the image capturing device 12 and the normal direction A1 of the object to be detected 14 is set between 15 degrees and 70 degrees.
  • the angle between the normal direction A2 of the image capturing device 12 and the normal direction A3 of the light source 111 of the high position is set to be less than 10 degrees, and the light source direction A2 of the image capturing device 12 and the light source of the low position are set.
  • the angle between the normal directions A4 of 112 is set to be greater than 30 degrees.
  • the normal direction A1 is specifically the vertical direction of the surface to be inspected of the detecting object 14, and the normal directions A2, A3 and A4 are specifically the optical axis or the main axis direction of the image capturing device 12, the light sources 111, 112, respectively.
  • the image acquisition device 12 performs image acquisition on the object 14 to be detected illuminated by the light source 111 disposed at the high position to obtain the first detection image 21.
  • the second detection image 22 is obtained by performing image acquisition on the object to be detected 14 illuminated by the light source 112 disposed at the lower position by the image acquisition device 12.
  • the scratches 141 and the cracks 142 are opposed to the dust 143 (indicated by thin solid lines in the first detected image 21, respectively).
  • Other areas (scratches 141, cracks 142, and areas other than the dust 143) of the object 14 to be inspected are all highlighted. That is, the difference in luminance between the scratch 141, the crack 142, and the dust 143 is small, and the difference in brightness between the scratch 141, the crack 142, and the dust 143 and other regions of the object 14 to be detected is large, and thus the brightness can be passed.
  • the value distinguishes the scratch 141, the crack 142, and the dust 143 from other areas of the object 14 to be detected, such as by threshold division.
  • the scratches 141 and the cracks 142 are rendered in a low-light state (ie, the brightness is close) with respect to other areas of the object 14 to be detected, and dust 143 (represented by thin solid lines in the second detected image 22, respectively) still exhibits a highlight state with respect to other areas of the object 14 to be detected.
  • the difference in brightness between the scratch 141 and the crack 142 and the dust 143 is large, while the difference in brightness between the scratch 141 and the crack 142 and other regions of the object 14 to be detected is small, and the dust 143 and the object 14 to be detected are different.
  • the brightness difference of the other areas is large, and the dust 143 can be distinguished from the scratches 141, the cracks 142, and other areas of the object 14 to be detected by the brightness value.
  • the luminance values of the scratches 141, the cracks 142, and the dust 143 have the above difference
  • the first detection image is set by setting a preset threshold value.
  • 21 and the second detection image 22 are subjected to binarization processing, and the brightness values of the scratches 141 and the cracks 142 and the dust 143 in the first detection image 21 can be set to 1, and the brightness values of other regions of the object to be detected are 0.
  • the first binarized image 23 as shown in FIG. 5 is obtained.
  • the brightness value of the dust 143 in the second detection image 22 can be set to 1, and the brightness values of other areas of the object 14 to be detected, the scratches 141 and the cracks 142 can be set to 0, or vice versa, thereby obtaining the figure.
  • the corresponding scratches 141 can be extracted from the corresponding scratches 141.
  • the crack 142 as shown by the final image 25 in FIG. 5, further distinguishes the scratch 141 and the crack 142 from the dust 143.
  • the scratches 141 and cracks 142 may be extracted by other logic operations and threshold segmentation conditions.
  • the luminance values of the corresponding positions of the first detection image 21 and the second detection image 22 are directly subtracted by a logical operation, at which time the scratches 141 and the cracks 142 are respectively presented in the first detection image 21 and the second detection image 22
  • the highlight and the low-light display have a large difference in brightness obtained by subtraction, and the dust 143 is highlighted in both the first detection image 21 and the second detection image 22, and the luminance difference obtained by subtraction is small. Therefore, by setting an appropriate threshold division condition, the portion having a larger difference is retained, and the portion having a smaller difference is ignored, and the scratch 141 and the crack 142 can also be extracted.
  • the logical operations used are set according to actual conditions, including but not limited to the same OR operation or the exclusive OR operation, and may be other operations such as AND, OR, addition, multiplication, and the like.
  • the object to be detected 14 can be rotated by rotating the object to be detected 14, the rotating light sources 111, 112 and the image capturing device 12 or using other light sources and image collecting devices. Repeat the above detection process on one side to avoid missed detection.
  • the image capturing device 12 respectively performs image acquisition on the object 14 to be detected under different light intensity illumination to obtain the first detection image 31 and the second detection image 32, respectively, and further utilizes the first detection image 31 and The second detected image 32 distinguishes between scratches and cracks on the object 14 to be detected.
  • the scratches 141 and the cracks 142 (represented by thick solid lines in the first detection image 31, respectively) with respect to other areas of the object 14 to be detected are
  • the highlight state is exhibited, that is, the difference in brightness between the scratch 141 and the crack 142 is small, and the difference in brightness between the scratch 141 and the crack 142 and other regions of the object 14 to be detected is large, and the scratch 141 can be distinguished by the brightness value.
  • the crack 142 and other areas of the object 14 to be inspected are the highlight state, that is, the difference in brightness between the scratch 141 and the crack 142 is small, and the difference in brightness between the scratch 141 and the crack 142 and other regions of the object 14 to be detected is large, and the scratch 141 can be distinguished by the brightness value.
  • the crack 142 and other areas of the object 14 to be inspected are
  • the scratches 141 are rendered in a low state with respect to other areas of the object 14 to be detected, and the cracks 142 is still highlighted with respect to other areas of the object 14 to be inspected, that is, the difference in brightness between the scratch 141 and the crack 142 is large, and the difference in brightness between the scratch 141 and other areas of the object to be detected 14 is small, and the crack
  • the difference in brightness between the other areas of the object 142 and the object to be detected 14 is large, and the dent 142 and the scratch 141 and other areas of the object 14 to be detected can be split according to the brightness value area.
  • the first detection image 31 and the second detection image 32 can be binarized by setting appropriate threshold division conditions, thereby obtaining the first binarized image 33 and the second binary value.
  • the image 34 is imaged and the scratches 141 are extracted from the first binarized image 33 and the second binarized image 34 by appropriate logic operations to effect differentiation of the cracks 142 from the scratches 141.
  • the first detection image 31 and the second detection image 32 can be directly subtracted and then the scratch 141 can be extracted using the threshold division condition.
  • the embodiment of the present invention further provides a visual inspection system, which includes a light source 111, 112, an image acquisition device 12, and a processor 13, wherein the light sources 111, 112 and the image acquisition device 12 cooperate, and further Obtaining the first detection image and the second detection image of the object 14 to be detected under different illumination conditions and/or shooting conditions, and the processor 13 performs a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image, Further, the target to be detected and the interference on the object 14 to be detected are distinguished.
  • a visual inspection system which includes a light source 111, 112, an image acquisition device 12, and a processor 13, wherein the light sources 111, 112 and the image acquisition device 12 cooperate, and further Obtaining the first detection image and the second detection image of the object 14 to be detected under different illumination conditions and/or shooting conditions, and the processor 13 performs a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image, Further, the target to be detected and the interference on the object
  • the above lighting conditions and/or shooting conditions are set according to the reflection characteristics of the object to be detected and the interference, so that there is a certain difference in the brightness values of the object to be detected and the interference after the mathematical operation. Further, the lighting conditions and/or the shooting conditions are set according to the reflection characteristics of the object to be detected and the interference, so that the target and the interference and the object to be detected can be detected according to the brightness value on one of the first detection image and the second detection image. The other areas of the 14 are distinguished, and on the other of the first detected image and the second detected image, the interference can be distinguished from the object to be detected and other areas of the object 14 to be detected according to the brightness value.
  • the specific setting of the lighting conditions and/or the shooting conditions may be at least one of changing the position of the light sources 111, 112, the light intensity, and the illumination angle or by changing at least one of the position, the exposure intensity, and the shooting angle of the image capturing device 12. To get different lighting conditions or shooting conditions.
  • the processor 13 processes the brightness values of the corresponding positions of the first detection image and the second detection image by using a preset threshold division condition and a logical operation, thereby distinguishing the target to be detected and the interference.
  • the interference includes dust
  • the object to be detected includes at least one of a scratch and a crack
  • the interference includes one of a scratch and a crack
  • the object to be detected includes the other of the scratch and the crack.
  • the light sources 111, 112 are disposed at different height positions relative to the object 14 to be detected. And in order to obtain a better detection effect, the light sources 111, 112 and the image acquisition device 12 are disposed on the same side of the object 14 to be detected, and the normal direction A2 of the image acquisition device 12 and the normal direction A1 of the object 14 to be detected are The angle between the two is set between 15 degrees and 70 degrees. Further, an angle between the normal direction A2 of the image capturing device 12 and the normal direction A3 of the light source 111 disposed at the upper position is set to be less than 10 degrees, and the normal direction A2 of the image capturing device 12 and the light source 112 of the low position are set. The angle between the normal directions A4 is set to be greater than 30 degrees.
  • the image capturing device 12 respectively performs image acquisition on the object to be detected 14 illuminated by the light source 111 and the light source 112 disposed in the low position, respectively, to obtain the first detection image and the second detection image, respectively, and the processor 13
  • the brightness values of the corresponding positions of the first detection image and the second detection image are mathematically operated to distinguish the cracks or scratches on the object 14 to be detected from the dust on the object 14 to be detected.
  • the image acquisition device 12 respectively performs image acquisition on the object 14 to be detected under different illuminations of the light source 111 to obtain a first detection image and a second detection image, respectively, and the processor 13 detects the first detection.
  • the brightness values of the corresponding positions of the image and the second detected image are mathematically operated to distinguish the scratches and cracks on the object 14 to be detected.

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

Disclosed are a visual inspection system and method. The method comprises: acquiring a first inspection image (21, 31) and a second inspection image (22, 32) of an object to be inspected (14) under different illumination conditions and/or photographing conditions (S11); and carrying out mathematical operations on luminance values of corresponding positions on the first inspection image (21, 31) and the second inspection image (22, 32) and then distinguishing a target to be inspected and interference on the object to be inspected (14) (S12). A target to be inspected and interference are effectively distinguished by using the synthesis of two inspection images acquired under different illumination conditions and/or photographing conditions.

Description

一种视觉检测系统及方法 Visual inspection system and method
【技术领域】[Technical Field]
本发明实施例涉及视觉检测领域,特别是涉及一种视觉检测系统及方法。Embodiments of the present invention relate to the field of visual inspection, and in particular, to a visual inspection system and method.
【背景技术】 【Background technique】
工业视觉检测一般是通过对待检测物体进行图像采集,并对采集的图像进行图像识别,而从待检测物体的图像中识别出预定的目标,例如划痕、裂痕等缺陷。目前,在工业视觉检测过程中普遍面临两个问题:一个是待检测物体表面容易沉积灰尘,待检测目标经常容易受到灰尘影响,因此需要在无尘环境下进行检测,增加了检测成本;另一个是待检测物体上通常包含多重缺陷,难以对不同缺陷进行有效区分。Industrial visual inspection generally performs image acquisition by the object to be detected, and performs image recognition on the acquired image, and identifies predetermined targets such as scratches, cracks, and the like from the image of the object to be detected. At present, there are two problems in the industrial visual inspection process: one is that the surface of the object to be inspected is easy to deposit dust, and the object to be detected is often susceptible to dust, so it needs to be tested in a dust-free environment, which increases the cost of detection; It is the object to be inspected that usually contains multiple defects, and it is difficult to effectively distinguish different defects.
【发明内容】 [Summary of the Invention]
为了至少部分解决以上问题,本发明实施例提出了一种视觉检测方法,该方法包括:在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像;对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的待检测目标和干扰。In order to at least partially solve the above problems, an embodiment of the present invention provides a visual detection method, which includes: acquiring a first detection image and a second detection image of an object to be detected under different illumination conditions and/or shooting conditions; The brightness values of the corresponding positions of the first detection image and the second detection image are mathematically operated to distinguish the object to be detected and the interference on the object to be detected.
其中,在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:根据待检测目标和干扰的反射特性设置不同的照明条件和/或拍摄条件,进而使得经数学操作后的待检测目标和干扰的亮度值存在一定差异。The step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: setting different illumination conditions and/or shooting conditions according to the reflection characteristics of the object to be detected and the interference. In addition, there is a certain difference in the brightness values of the target to be detected and the interference after the mathematical operation.
其中,在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:根据待检测目标和干扰的反射特性设置不同的照明条件和/或拍摄条件,进而使得在第一检测图像和第二检测图像中的一个上能够根据亮度值对待检测目标和干扰与待检测物体的其他区域进行区分,而在第一检测图像和第二检测图像中的另一个上能够根据亮度值对干扰与待检测目标和待检测物体的其他区域进行区分。The step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: setting different illumination conditions and/or shooting conditions according to the reflection characteristics of the object to be detected and the interference. And further enabling distinguishing between the first detection image and the second detection image on the one of the first detection image and the second detection image according to the brightness value. One can distinguish the interference from the target to be detected and other areas of the object to be detected according to the brightness value.
其中,对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的待检测目标和干扰的步骤包括:利用预设的阈值分割条件与逻辑运算配合对第一检测图像和第二检测图像的对应位置的亮度值进行处理,进而区分待检测目标和干扰。The step of performing mathematical operations on the luminance values of the corresponding positions of the first detection image and the second detection image to further distinguish the target to be detected and the interference on the object to be detected includes: using a preset threshold segmentation condition and a logical operation The luminance values of the corresponding positions of the first detection image and the second detection image are processed to further distinguish the target to be detected and the interference.
其中,干扰包括灰尘,待检测目标包括划痕和裂痕中的至少一个,或者干扰包括划痕和裂痕中的一个,待检测目标包括划痕和裂痕中的另一个。Wherein the interference includes dust, the object to be detected includes at least one of a scratch and a crack, or the interference includes one of a scratch and a crack, and the object to be detected includes the other of the scratch and the crack.
其中,在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:通过改变光源的位置、光强和照射角度中的至少一个或者通过改变图像采集设备的位置、曝光强度和拍摄角度中的至少一个来获取不同的照明条件或拍摄条件。The step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: changing at least one of a position, a light intensity, and an illumination angle of the light source or by changing the image At least one of a position of the device, an exposure intensity, and a shooting angle is acquired to acquire different lighting conditions or shooting conditions.
其中,在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:相对于待检测物体以不同高度位置设置光源,利用图像采集设备分别对高位设置的光源照射下的待检测物体和低位设置的光源照射下的待检测物体进行图像采集来分别获得第一检测图像和第二检测图像;对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的待检测目标和干扰的步骤包括:对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的裂痕或划痕与待检测物体上的灰尘。The step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: setting the light source at different height positions with respect to the object to be detected, and respectively using the image acquisition device to the high position The object to be detected and the object to be detected illuminated by the light source disposed under the light source are subjected to image acquisition to obtain the first detection image and the second detection image respectively; and corresponding positions of the first detection image and the second detection image The step of performing a mathematical operation on the brightness value to distinguish the object to be detected and the interference on the object to be detected includes: performing mathematical operations on the brightness values of the corresponding positions of the first detection image and the second detection image, thereby distinguishing the cracks on the object to be detected Or scratches the dust on the object to be inspected.
其中,在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤进一步包括:将光源和图像采集设备设置于待检测物体的同一侧,且将图像采集设备的法线方向与待检测物体的法线方向之间的夹角设置在15度-70度之间。The step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions further includes: setting the light source and the image collection device on the same side of the object to be detected, and placing the image The angle between the normal direction of the acquisition device and the normal direction of the object to be detected is set between 15 degrees and 70 degrees.
其中,在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤进一步包括:将图像采集设备的法线方向与高位设置的光源的法线方向之间的夹角设置成小于10度,并将图像采集设备的法线方向与低位设置的光源的法线方向之间的夹角设置成大于30度。The step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions further includes: normalizing the normal direction of the image collection device and the normal direction of the light source set by the high position The angle between the angles is set to be less than 10 degrees, and the angle between the normal direction of the image capturing device and the normal direction of the light source set at the lower position is set to be greater than 30 degrees.
其中,在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:利用图像采集设备分别对不同光强照射下的待检测物体进行图像采集来分别获得第一检测图像和第二检测图像;对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的待检测目标和干扰的步骤包括:对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的划痕与裂痕。The step of acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions includes: performing image collection on the object to be detected under different illuminations by the image acquisition device respectively. Obtaining the first detection image and the second detection image respectively; performing mathematical operations on the brightness values of the corresponding positions of the first detection image and the second detection image, and further distinguishing the target to be detected and the interference on the object to be detected include: The brightness values of the corresponding positions of the detected image and the second detected image are mathematically operated to distinguish the scratches and cracks on the object to be detected.
为了至少部分解决以上问题,本发明实施例提出了一种视觉检测系统,该系统包括光源、图像采集设备及处理器,其中光源和图像采集设备配合,进而在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像,处理器对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的待检测目标和干扰。In order to at least partially solve the above problems, embodiments of the present invention provide a visual inspection system including a light source, an image acquisition device, and a processor, wherein the light source and the image acquisition device cooperate to further different lighting conditions and/or shooting conditions. Obtaining a first detection image and a second detection image of the object to be detected, and the processor performs a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image, thereby distinguishing the target to be detected and the interference on the object to be detected .
其中,照明条件和/或拍摄条件根据待检测目标和干扰的反射特性进行设置,进而使得经数学操作后的待检测目标和干扰的亮度值存在一定差异。The illumination condition and/or the shooting condition are set according to the reflection target of the object to be detected and the interference, so that there is a certain difference in the brightness value of the object to be detected and the interference after the mathematical operation.
其中,照明条件和/或拍摄条件根据待检测目标和干扰的反射特性进行设置,进而使得在第一检测图像和第二检测图像中的一个上能够根据亮度值对待检测目标和干扰与待检测物体的其他区域进行区分,而在第一检测图像和第二检测图像中的另一个上能够根据亮度值对干扰与待检测目标和待检测物体的其他区域进行区分。Wherein, the illumination condition and/or the shooting condition are set according to the reflection characteristic of the object to be detected and the interference, so that the target and the interference and the object to be detected can be detected according to the brightness value on one of the first detection image and the second detection image. The other areas are distinguished, and on the other of the first detection image and the second detection image, the interference can be distinguished from the object to be detected and other areas of the object to be detected according to the brightness value.
其中,处理器利用预设的阈值分割条件与逻辑运算配合对第一检测图像和第二检测图像的对应位置的亮度值进行处理,进而区分待检测目标和干扰。The processor processes the brightness values of the corresponding positions of the first detection image and the second detection image by using a preset threshold segmentation condition and a logic operation to further distinguish the target to be detected and the interference.
其中,干扰包括灰尘,待检测目标包括划痕和裂痕中的至少一个,或者干扰包括划痕和裂痕中的一个,待检测目标包括划痕和裂痕中的另一个。Wherein the interference includes dust, the object to be detected includes at least one of a scratch and a crack, or the interference includes one of a scratch and a crack, and the object to be detected includes the other of the scratch and the crack.
其中,通过改变光源的位置、光强和照射角度中的至少一个或者通过改变图像采集设备的位置、曝光强度和拍摄角度中的至少一个来获取不同的照明条件或拍摄条件。Wherein, different lighting conditions or shooting conditions are acquired by changing at least one of the position, the light intensity, and the illumination angle of the light source or by changing at least one of the position, the exposure intensity, and the shooting angle of the image capturing device.
其中,光源相对于待检测物体以不同高度位置进行设置,图像采集设备分别对高位设置的光源照射下的待检测物体和低位设置的光源照射下的待检测物体进行图像采集来分别获得第一检测图像和第二检测图像,处理器对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的裂痕或划痕与待检测物体上的灰尘。Wherein, the light source is set at different height positions with respect to the object to be detected, and the image acquisition device respectively performs image acquisition on the object to be detected irradiated by the light source set by the high position and the object to be detected under the light source set by the low position to obtain the first detection respectively. The image and the second detected image, the processor performs a mathematical operation on the brightness values of the corresponding positions of the first detected image and the second detected image, thereby distinguishing the cracks or scratches on the object to be detected from the dust on the object to be detected.
其中,光源和图像采集设备设置于待检测物体的同一侧,且图像采集设备的法线方向与待检测物体的法线方向之间的夹角设置在15度-70度之间。Wherein, the light source and the image collecting device are disposed on the same side of the object to be detected, and an angle between a normal direction of the image capturing device and a normal direction of the object to be detected is set between 15 degrees and 70 degrees.
其中,图像采集设备的法线方向与高位设置的光源的法线方向之间的夹角设置成小于10度,且图像采集设备的法线方向与低位设置的光源的法线方向之间的夹角设置成大于30度。Wherein, an angle between a normal direction of the image capturing device and a normal direction of the light source disposed at a high position is set to be less than 10 degrees, and a clip between a normal direction of the image capturing device and a normal direction of the light source disposed at a low position The angle is set to be greater than 30 degrees.
其中,图像采集设备分别对光源的不同光强照射下的待检测物体进行图像采集来分别获得第一检测图像和第二检测图像,处理器对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的划痕与裂痕。The image acquisition device respectively performs image acquisition on the object to be detected under different illuminations of the light source to obtain a first detection image and a second detection image, respectively, and the corresponding position of the first detection image and the second detection image by the processor The brightness value is mathematically manipulated to distinguish between scratches and cracks on the object to be inspected.
通过上述方式,利用在不同的照明条件和/或拍摄条件下获取的两幅检测图像的综合来对待检测目标和干扰进行有效区分。In the above manner, the detection target and the interference are effectively distinguished by the combination of the two detection images acquired under different illumination conditions and/or shooting conditions.
【附图说明】 [Description of the Drawings]
图1是根据本发明一实施例的视觉检测系统的结构示意图;1 is a schematic structural view of a visual inspection system according to an embodiment of the present invention;
图2是根据本发明一实施例的视觉检测方法的流程示意图;2 is a schematic flow chart of a visual inspection method according to an embodiment of the invention;
图3是根据本发明一实施例的第一检测图像的获取方式的示意图;FIG. 3 is a schematic diagram of a manner of acquiring a first detected image according to an embodiment of the invention; FIG.
图4是根据本发明一实施例的第二检测图像的获取方式的示意图;FIG. 4 is a schematic diagram of a manner of acquiring a second detected image according to an embodiment of the invention; FIG.
图5是根据本发明一实施例的对第一检测图像和第二检测图像进行逻辑运算的示意图;FIG. 5 is a schematic diagram of performing logical operations on a first detected image and a second detected image according to an embodiment of the invention; FIG.
图6是根据本发明另一实施例的对第一检测图像和第二检测图像进行逻辑运算的示意图。FIG. 6 is a schematic diagram of performing logical operations on a first detected image and a second detected image according to another embodiment of the present invention.
【具体实施方式】【detailed description】
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本发明的一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
参见图1,图1是根据本发明一实施例的视觉检测系统的结构示意图。本实施例的视觉检测系统包括光源111、112、图像采集设备12以及处理器13。其中,光源111、112用于为待检测物体14提供照明,图像采集设备12用于对光源111、112照射下的待检测物体14进行图像采集,而处理器13则根据图像采集设备12所采集的图像进行识别,并提取出待检测物体14上的待检测目标。Referring to FIG. 1, FIG. 1 is a schematic structural diagram of a visual inspection system according to an embodiment of the present invention. The visual inspection system of the present embodiment includes light sources 111, 112, an image acquisition device 12, and a processor 13. The light source 111, 112 is used to provide illumination for the object to be detected 14, the image acquisition device 12 is used for image acquisition of the object 14 to be detected under the illumination of the light source 111, 112, and the processor 13 is collected according to the image acquisition device 12. The image is identified and the object to be detected on the object 14 to be detected is extracted.
进一步参见图2,图2是根据本发明一实施例的视觉检测方法的流程示意图。在本实施例中,基于图1所示的视觉检测系统提出一种视觉检测方法,具体包括以下步骤:Further referring to FIG. 2, FIG. 2 is a schematic flow chart of a visual detection method according to an embodiment of the invention. In this embodiment, a visual detection method is proposed based on the visual inspection system shown in FIG. 1, which specifically includes the following steps:
步骤S11,在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像;Step S11, acquiring a first detection image and a second detection image of the object to be detected under different illumination conditions and/or shooting conditions;
步骤S12,对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体上的待检测目标和干扰。Step S12, performing mathematical operations on the brightness values of the corresponding positions of the first detection image and the second detection image, thereby distinguishing the target to be detected and the interference on the object to be detected.
进一步,在步骤S11中,根据待检测目标和干扰的反射特性设置不同的照明条件和/或拍摄条件,进而使得在步骤S12中经数学操作后的待检测目标和干扰的亮度值存在一定差异。进一步来说,根据待检测目标和干扰的反射特性设置不同的照明条件和/或拍摄条件,进而使得在第一检测图像和第二检测图像中的一个上能够根据亮度值对待检测目标和干扰与待检测物体的其他区域进行区分,而在第一检测图像和第二检测图像中的另一个上能够根据亮度值对干扰与待检测目标和待检测物体的其他区域进行区分。由此以来,在步骤S12中,可根据待检测目标、干扰和待检测物体的其他区域在上述第一检测图像和第二检测图像上的亮度值设置适当的数学操作规则,进而使得经数学操作后的待检测目标和干扰的亮度值存在一定差异。Further, in step S11, different illumination conditions and/or shooting conditions are set according to the reflection characteristics of the object to be detected and the interference, so that there is a certain difference in the brightness values of the object to be detected and the interference after the mathematical operation in step S12. Further, different illumination conditions and/or shooting conditions are set according to the reflection characteristics of the object to be detected and the interference, so that the target and the interference can be detected according to the brightness value on one of the first detection image and the second detection image. The other areas of the object to be detected are distinguished, and on the other of the first detection image and the second detection image, the interference can be distinguished from the object to be detected and other areas of the object to be detected according to the brightness value. Thus, in step S12, an appropriate mathematical operation rule can be set according to the brightness value of the first detection image and the second detection image according to the object to be detected, the interference, and other regions of the object to be detected, thereby performing mathematical operations. There is a certain difference in the brightness values of the target to be detected and the interference.
具体照明条件和拍摄条件的设置方式是通过改变光源111、112的位置、光强和照射角度中的至少一个来获取不同的照明条件,或者通过改变图像采集设备12的位置、曝光强度和拍摄角度中的至少一个拍摄条件。值得注意的是,在图1中显示了两个光源111、112,然而在具体实现过程中,光源的数量不受此限制,例如可仅设置一个光源,并通过对该光源进行位置、光强以及照射角度调节来获得不同的照明条件。同样,图像采集设备12和处理器13的数量也不受图1所示的限制。The specific lighting conditions and shooting conditions are set by acquiring at least one of the position, the light intensity, and the illumination angle of the light sources 111, 112 to obtain different lighting conditions, or by changing the position, exposure intensity, and shooting angle of the image capturing device 12. At least one shooting condition. It should be noted that two light sources 111, 112 are shown in FIG. 1. However, in a specific implementation process, the number of light sources is not limited thereto, for example, only one light source may be disposed, and the position and intensity of the light source may be And illumination angle adjustment to obtain different lighting conditions. Also, the number of image capture devices 12 and processors 13 is not limited by the one shown in FIG.
在步骤S12中,可利用预设的阈值分割条件与逻辑运算配合对第一检测图像和第二检测图像的对应位置的亮度值进行处理,进而对待检测目标和干扰进行区分。例如,通过预设的阈值分割条件对第一检测图像和第二检测图像进行二值化,再基于获得两个二值化图像中根据适当的逻辑运算区分待检测目标和干扰。当然,也可以直接对第一检测图像和第二检测图像进行逻辑运算,再通过预设的阈值分割条件来对运算后的图像进行阈值分割来区分待检测目标和干扰。In step S12, the brightness values of the corresponding positions of the first detection image and the second detection image may be processed by using a preset threshold segmentation condition and a logical operation, and the detection target and the interference are further distinguished. For example, the first detection image and the second detection image are binarized by a preset threshold segmentation condition, and the object to be detected and the interference are distinguished according to an appropriate logical operation based on obtaining the two binarized images. Certainly, the first detection image and the second detection image may be directly logically operated, and then the threshold image segmentation condition is used to perform threshold segmentation on the computed image to distinguish the target to be detected and the interference.
在本实施例中,干扰可以包括灰尘,待检测目标包括划痕和裂痕中的至少一个,或者干扰包括划痕和裂痕中的一个,待检测目标包括划痕和裂痕中的另一个。In the present embodiment, the disturbance may include dust, the object to be detected includes at least one of a scratch and a crack, or the interference includes one of a scratch and a crack, and the object to be detected includes the other of the scratch and the crack.
下文将结合具体实例来详细描述照明条件、拍摄条件以及阈值分割条件、逻辑运算的具体设置方式。当然,本领域技术人员在本发明相关实施例的启示下可以根据待检测目标和干扰的实际情况对上述内容进行相应设置。The lighting conditions, the shooting conditions, and the threshold division conditions, and the specific arrangement of the logic operations will be described in detail below with reference to specific examples. Of course, those skilled in the art can accordingly set the above content according to the actual situation of the target to be detected and the interference in the enlightenment of the related embodiments of the present invention.
进一步参见图3-5,下文将以如何将划痕或裂痕与灰尘进行区分为例进行详细描述。Referring further to Figures 3-5, a detailed description will be made below on how to distinguish scratches or cracks from dust.
如图1所示,在本实施例中,相对于待检测物体14以不同高度位置设置光源111、112。如上文所描述的光源111、112可以是同一个光源。其中,为了获得相对较好的检测效果,将光源111、112和图像采集设备12设置于待检测物体14的同一侧,即虚线B1、B2所示的待检测物体14的待检测表面的投影区域的外侧,且将图像采集设备12的法线方向A2与待检测物体14的法线方向A1之间的夹角设置在15度-70度之间。进一步,将图像采集设备12的法线方向A2与高位设置的光源111的法线方向A3之间的夹角设置成小于10度,并将图像采集设备12的法线方向A2与低位设置的光源112的法线方向A4之间的夹角设置成大于30度。法线方向A1具体为检测物体14的待检测表面的垂直方向,法线方向A2、A3和A4分别具体为图像采集设备12、光源111、112的光轴或主轴方向。As shown in FIG. 1, in the present embodiment, the light sources 111, 112 are disposed at different height positions with respect to the object 14 to be detected. The light sources 111, 112 as described above may be the same light source. Wherein, in order to obtain a relatively good detection effect, the light sources 111, 112 and the image acquisition device 12 are disposed on the same side of the object 14 to be detected, that is, the projection area of the surface to be detected of the object 14 to be detected shown by the broken lines B1, B2. The outer side, and the angle between the normal direction A2 of the image capturing device 12 and the normal direction A1 of the object to be detected 14 is set between 15 degrees and 70 degrees. Further, the angle between the normal direction A2 of the image capturing device 12 and the normal direction A3 of the light source 111 of the high position is set to be less than 10 degrees, and the light source direction A2 of the image capturing device 12 and the light source of the low position are set. The angle between the normal directions A4 of 112 is set to be greater than 30 degrees. The normal direction A1 is specifically the vertical direction of the surface to be inspected of the detecting object 14, and the normal directions A2, A3 and A4 are specifically the optical axis or the main axis direction of the image capturing device 12, the light sources 111, 112, respectively.
进一步如图3所示,利用图像采集设备12对高位设置的光源111照射下的待检测物体14进行图像采集来获得第一检测图像21。如图4所示,利用图像采集设备12对低位设置的光源112照射下的待检测物体14进行图像采集来获得第二检测图像22。Further, as shown in FIG. 3, the image acquisition device 12 performs image acquisition on the object 14 to be detected illuminated by the light source 111 disposed at the high position to obtain the first detection image 21. As shown in FIG. 4, the second detection image 22 is obtained by performing image acquisition on the object to be detected 14 illuminated by the light source 112 disposed at the lower position by the image acquisition device 12.
由于划痕和裂痕具有面反射特性,而灰尘具有漫反射特性。因此,在第一检测图像21中,划痕141和裂痕142(在第一检测图像21中分别以粗实线表示)与灰尘143(在第一检测图像21中分别以细实线表示)相对于待检测物体14的其他区域(划痕141、裂痕142和灰尘143以外的区域)均呈现高亮状态。也就是说,划痕141、裂痕142和灰尘143之间的亮度差异较小,划痕141、裂痕142和灰尘143与待检测物体14的其他区域之间的亮度差异较大,进而能够通过亮度值将划痕141、裂痕142和灰尘143与待检测物体14的其他区域进行区分,例如通过阈值分割方式。在第二检测图像22中,划痕141和裂痕142(在第二检测图像22中分别以粗虚线表示)相对于待检测物体14的其他区域呈现低亮状态(即,亮度接近),而灰尘143(在第二检测图像22中分别以细实线表示)相对于待检测物体14的其他区域仍呈现高亮状态。也就是说,划痕141和裂痕142与灰尘143之间的亮度差异较大,同时划痕141和裂痕142与待检测物体14的其他区域的亮度差异较小,灰尘143与待检测物体14的其他区域的亮度差异较大,进而能够通过亮度值将灰尘143与划痕141、裂痕142和待检测物体14的其他区域进行区分。Since scratches and cracks have surface reflection characteristics, dust has diffuse reflection characteristics. Therefore, in the first detected image 21, the scratches 141 and the cracks 142 (indicated by thick solid lines in the first detected image 21, respectively) are opposed to the dust 143 (indicated by thin solid lines in the first detected image 21, respectively). Other areas (scratches 141, cracks 142, and areas other than the dust 143) of the object 14 to be inspected are all highlighted. That is, the difference in luminance between the scratch 141, the crack 142, and the dust 143 is small, and the difference in brightness between the scratch 141, the crack 142, and the dust 143 and other regions of the object 14 to be detected is large, and thus the brightness can be passed. The value distinguishes the scratch 141, the crack 142, and the dust 143 from other areas of the object 14 to be detected, such as by threshold division. In the second detection image 22, the scratches 141 and the cracks 142 (indicated by thick broken lines in the second detection image 22, respectively) are rendered in a low-light state (ie, the brightness is close) with respect to other areas of the object 14 to be detected, and dust 143 (represented by thin solid lines in the second detected image 22, respectively) still exhibits a highlight state with respect to other areas of the object 14 to be detected. That is, the difference in brightness between the scratch 141 and the crack 142 and the dust 143 is large, while the difference in brightness between the scratch 141 and the crack 142 and other regions of the object 14 to be detected is small, and the dust 143 and the object 14 to be detected are different. The brightness difference of the other areas is large, and the dust 143 can be distinguished from the scratches 141, the cracks 142, and other areas of the object 14 to be detected by the brightness value.
进一步如图5所示,在第一检测图像21和第二检测图像22中,划痕141、裂痕142和灰尘143的亮度值存在上述差异,通过设置预设的阈值分割条件对第一检测图像21和第二检测图像22进行二值化处理,可以将第一检测图像21中的划痕141和裂痕142与灰尘143的亮度值置1,而将待检测物体的其他区域的亮度值0,或者反之亦可,进而得到如图5所示的第一二值化图像23。同时,可以将第二检测图像22中的灰尘143的亮度值置1,而将待检测物体14的其他区域、划痕141和裂痕142的亮度值置0,或者反之亦可,进而得到如图5所示的第二二值化图像24。Further, as shown in FIG. 5, in the first detection image 21 and the second detection image 22, the luminance values of the scratches 141, the cracks 142, and the dust 143 have the above difference, and the first detection image is set by setting a preset threshold value. 21 and the second detection image 22 are subjected to binarization processing, and the brightness values of the scratches 141 and the cracks 142 and the dust 143 in the first detection image 21 can be set to 1, and the brightness values of other regions of the object to be detected are 0. Alternatively, the first binarized image 23 as shown in FIG. 5 is obtained. At the same time, the brightness value of the dust 143 in the second detection image 22 can be set to 1, and the brightness values of other areas of the object 14 to be detected, the scratches 141 and the cracks 142 can be set to 0, or vice versa, thereby obtaining the figure. The second binarized image 24 shown in FIG.
进一步,通过对第一二值化图像23和第二二值化图像24对应位置的亮度值进行适当的逻辑运算(例如,同或运算或异或运算),可以从提取出相应的划痕141和裂痕142,如图5中的最终图像25所示,进而将划痕141和裂痕142与灰尘143进行区分。Further, by performing appropriate logical operations (for example, the same OR operation or the exclusive OR operation) on the luminance values of the corresponding positions of the first binarized image 23 and the second binarized image 24, the corresponding scratches 141 can be extracted from the corresponding scratches 141. And the crack 142, as shown by the final image 25 in FIG. 5, further distinguishes the scratch 141 and the crack 142 from the dust 143.
在其他实施例中,可以通过其他逻辑运算和阈值分割条件来提取划痕141和裂痕142。例如,通过逻辑运算直接将第一检测图像21和第二检测图像22的对应位置的亮度值相减,此时由于划痕141和裂痕142在第一检测图像21和第二检测图像22分别呈现高亮显示和低亮显示,相减获得的亮度差异较大,而灰尘143在第一检测图像21和第二检测图像22均呈现高亮显示,相减获得的亮度差异较小。因此,通过设置适当的阈值分割条件,保留差异较大的部分,而忽略差异较小的部分,同样可以提取出划痕141和裂痕142。In other embodiments, the scratches 141 and cracks 142 may be extracted by other logic operations and threshold segmentation conditions. For example, the luminance values of the corresponding positions of the first detection image 21 and the second detection image 22 are directly subtracted by a logical operation, at which time the scratches 141 and the cracks 142 are respectively presented in the first detection image 21 and the second detection image 22 The highlight and the low-light display have a large difference in brightness obtained by subtraction, and the dust 143 is highlighted in both the first detection image 21 and the second detection image 22, and the luminance difference obtained by subtraction is small. Therefore, by setting an appropriate threshold division condition, the portion having a larger difference is retained, and the portion having a smaller difference is ignored, and the scratch 141 and the crack 142 can also be extracted.
在本实施例中,所采用的逻辑运算根据实际情况进行设置,包括但不限于同或运算或异或运算,可以是与、或、加法、乘法等其他操作。In this embodiment, the logical operations used are set according to actual conditions, including but not limited to the same OR operation or the exclusive OR operation, and may be other operations such as AND, OR, addition, multiplication, and the like.
值得注意的,在待检测物体14的一侧完成上述检测后,可以通过旋转待检测物体14、旋转光源111、112和图像采集设备12或者利用其他光源和图像采集设备从待检测物体14的另一侧重复上述检测过程,进而避免漏检。It should be noted that after the above detection is completed on one side of the object 14 to be detected, the object to be detected 14 can be rotated by rotating the object to be detected 14, the rotating light sources 111, 112 and the image capturing device 12 or using other light sources and image collecting devices. Repeat the above detection process on one side to avoid missed detection.
进一步结合图6,下文将以如何将划痕与裂痕进行区分为例进行详细描述。Further in conjunction with FIG. 6, a detailed description will be made below on how to distinguish scratches from cracks.
在本实施例中,利用图像采集设备12分别对不同光强照射下的待检测物体14进行图像采集来分别获得第一检测图像31和第二检测图像32,并进一步利用第一检测图像31和第二检测图像32对待检测物体14上的划痕与裂痕进行区分。In the embodiment, the image capturing device 12 respectively performs image acquisition on the object 14 to be detected under different light intensity illumination to obtain the first detection image 31 and the second detection image 32, respectively, and further utilizes the first detection image 31 and The second detected image 32 distinguishes between scratches and cracks on the object 14 to be detected.
例如,在相对较小光强照射下形成的第一检测图像31中,划痕141和裂痕142(在第一检测图像31中分别以粗实线表示)相对于待检测物体14的其他区域均呈现高亮状态,即划痕141和裂痕142的亮度差异较小,同时划痕141和裂痕142与待检测物体14的其他区域之间的亮度差异较大,进而能够通过亮度值区分划痕141和裂痕142与待检测物体14的其他区域。在相对较大光强照射下形成的第二检测图像32中,划痕141(在第二检测图像32中分别以粗虚线表示)相对于待检测物体14的其他区域呈现低亮状态,而裂痕142相对于待检测物体14的其他区域仍呈现高亮状态,即划痕141与裂痕142之间的亮度差异较大,同时划痕141与待检测物体14的其他区域的亮度差异较小,裂痕142与待检测物体14的其他区域的亮度差异较大,进而能够根据亮度值区分裂痕142与划痕141和待检测物体14的其他区域。For example, in the first detection image 31 formed under relatively small light intensity illumination, the scratches 141 and the cracks 142 (represented by thick solid lines in the first detection image 31, respectively) with respect to other areas of the object 14 to be detected are The highlight state is exhibited, that is, the difference in brightness between the scratch 141 and the crack 142 is small, and the difference in brightness between the scratch 141 and the crack 142 and other regions of the object 14 to be detected is large, and the scratch 141 can be distinguished by the brightness value. And the crack 142 and other areas of the object 14 to be inspected. In the second detection image 32 formed under relatively large light intensity illumination, the scratches 141 (indicated by thick broken lines in the second detection image 32, respectively) are rendered in a low state with respect to other areas of the object 14 to be detected, and the cracks 142 is still highlighted with respect to other areas of the object 14 to be inspected, that is, the difference in brightness between the scratch 141 and the crack 142 is large, and the difference in brightness between the scratch 141 and other areas of the object to be detected 14 is small, and the crack The difference in brightness between the other areas of the object 142 and the object to be detected 14 is large, and the dent 142 and the scratch 141 and other areas of the object 14 to be detected can be split according to the brightness value area.
因此,参照与上文描述类似的方式,可通过设置适当的阈值分割条件将第一检测图像31和第二检测图像32进行二值化,进而获得第一二值化图像33和第二二值化图像34,并通过适当的逻辑运算从第一二值化图像33和第二二值化图像34提取出划痕141,进而实现裂痕142与划痕141的区分。当然,可以对第一检测图像31和第二检测图像32直接相减后再利用阈值分割条件提取出划痕141。Therefore, referring to the manner similar to the above description, the first detection image 31 and the second detection image 32 can be binarized by setting appropriate threshold division conditions, thereby obtaining the first binarized image 33 and the second binary value. The image 34 is imaged and the scratches 141 are extracted from the first binarized image 33 and the second binarized image 34 by appropriate logic operations to effect differentiation of the cracks 142 from the scratches 141. Of course, the first detection image 31 and the second detection image 32 can be directly subtracted and then the scratch 141 can be extracted using the threshold division condition.
进一步如图1所示,本发明实施例进一步提出了一种视觉检测系统,该系统包括光源111、112、图像采集设备12及处理器13,其中光源111、112和图像采集设备12配合,进而在不同的照明条件和/或拍摄条件下获取待检测物体14的第一检测图像和第二检测图像,处理器13对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体14上的待检测目标和干扰。As further shown in FIG. 1 , the embodiment of the present invention further provides a visual inspection system, which includes a light source 111, 112, an image acquisition device 12, and a processor 13, wherein the light sources 111, 112 and the image acquisition device 12 cooperate, and further Obtaining the first detection image and the second detection image of the object 14 to be detected under different illumination conditions and/or shooting conditions, and the processor 13 performs a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image, Further, the target to be detected and the interference on the object 14 to be detected are distinguished.
在本实施例中,上述照明条件和/或拍摄条件根据待检测目标和干扰的反射特性进行设置,进而使得经数学操作后的待检测目标和干扰的亮度值存在一定差异。进一步,照明条件和/或拍摄条件根据待检测目标和干扰的反射特性进行设置,进而使得在第一检测图像和第二检测图像中的一个上能够根据亮度值对待检测目标和干扰与待检测物体14的其他区域进行区分,而在第一检测图像和第二检测图像中的另一个上能够根据亮度值对干扰与待检测目标和待检测物体14的其他区域进行区分。照明条件和/或拍摄条件的具体设置方式可以是通过改变光源111、112的位置、光强和照射角度中的至少一个或者通过改变图像采集设备12的位置、曝光强度和拍摄角度中的至少一个来获取不同的照明条件或拍摄条件。In the present embodiment, the above lighting conditions and/or shooting conditions are set according to the reflection characteristics of the object to be detected and the interference, so that there is a certain difference in the brightness values of the object to be detected and the interference after the mathematical operation. Further, the lighting conditions and/or the shooting conditions are set according to the reflection characteristics of the object to be detected and the interference, so that the target and the interference and the object to be detected can be detected according to the brightness value on one of the first detection image and the second detection image. The other areas of the 14 are distinguished, and on the other of the first detected image and the second detected image, the interference can be distinguished from the object to be detected and other areas of the object 14 to be detected according to the brightness value. The specific setting of the lighting conditions and/or the shooting conditions may be at least one of changing the position of the light sources 111, 112, the light intensity, and the illumination angle or by changing at least one of the position, the exposure intensity, and the shooting angle of the image capturing device 12. To get different lighting conditions or shooting conditions.
在本实施例中,处理器13利用预设的阈值分割条件与逻辑运算配合对第一检测图像和第二检测图像的对应位置的亮度值进行处理,进而区分待检测目标和干扰。其中,干扰包括灰尘,待检测目标包括划痕和裂痕中的至少一个,或者干扰包括划痕和裂痕中的一个,待检测目标包括划痕和裂痕中的另一个。In this embodiment, the processor 13 processes the brightness values of the corresponding positions of the first detection image and the second detection image by using a preset threshold division condition and a logical operation, thereby distinguishing the target to be detected and the interference. Wherein the interference includes dust, the object to be detected includes at least one of a scratch and a crack, or the interference includes one of a scratch and a crack, and the object to be detected includes the other of the scratch and the crack.
在一具体实现方式中,光源111、112相对于待检测物体14以不同高度位置进行设置。并且为了获取到更好的检测效果,光源111、112和图像采集设备12设置于待检测物体14的同一侧,且图像采集设备12的法线方向A2与待检测物体14的法线方向A1之间的夹角设置在15度-70度之间。进一步,图像采集设备12的法线方向A2与高位设置的光源111的法线方向A3之间的夹角设置成小于10度,且图像采集设备12的法线方向A2与低位设置的光源112的法线方向A4之间的夹角设置成大于30度。In a specific implementation, the light sources 111, 112 are disposed at different height positions relative to the object 14 to be detected. And in order to obtain a better detection effect, the light sources 111, 112 and the image acquisition device 12 are disposed on the same side of the object 14 to be detected, and the normal direction A2 of the image acquisition device 12 and the normal direction A1 of the object 14 to be detected are The angle between the two is set between 15 degrees and 70 degrees. Further, an angle between the normal direction A2 of the image capturing device 12 and the normal direction A3 of the light source 111 disposed at the upper position is set to be less than 10 degrees, and the normal direction A2 of the image capturing device 12 and the light source 112 of the low position are set. The angle between the normal directions A4 is set to be greater than 30 degrees.
图像采集设备12分别对高位设置的光源111照射下的待检测物体14和低位设置的光源112照射下的待检测物体14进行图像采集来分别获得第一检测图像和第二检测图像,处理器13对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体14上的裂痕或划痕与待检测物体14上的灰尘。The image capturing device 12 respectively performs image acquisition on the object to be detected 14 illuminated by the light source 111 and the light source 112 disposed in the low position, respectively, to obtain the first detection image and the second detection image, respectively, and the processor 13 The brightness values of the corresponding positions of the first detection image and the second detection image are mathematically operated to distinguish the cracks or scratches on the object 14 to be detected from the dust on the object 14 to be detected.
在另一具体实现方式中,图像采集设备12分别对光源111的不同光强照射下的待检测物体14进行图像采集来分别获得第一检测图像和第二检测图像,处理器13对第一检测图像和第二检测图像的对应位置的亮度值进行数学操作,进而区分待检测物体14上的划痕与裂痕。In another specific implementation, the image acquisition device 12 respectively performs image acquisition on the object 14 to be detected under different illuminations of the light source 111 to obtain a first detection image and a second detection image, respectively, and the processor 13 detects the first detection. The brightness values of the corresponding positions of the image and the second detected image are mathematically operated to distinguish the scratches and cracks on the object 14 to be detected.
关于上述元件及其工作原理可参照上文针对视觉检测方法的具体实施例的详细描述,在此不再赘述。For the above components and their working principles, reference may be made to the detailed description of the specific embodiments of the visual detection method, and details are not described herein.
综上所述,本领域技术人员容易理解,利用在不同的照明条件和/或拍摄条件下获取的两幅检测图像的综合来进行待检测目标的提取,可对待检测目标和干扰进行有效区分。In summary, those skilled in the art can easily understand that the extraction of the object to be detected is performed by using a combination of two detection images acquired under different illumination conditions and/or shooting conditions, and the object to be detected and the interference can be effectively distinguished.
以上所述仅为本发明的实施方式,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the invention and the drawings are directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.

Claims (20)

  1. 一种视觉检测方法,其特征在于,所述方法包括:A visual inspection method, the method comprising:
    在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像;Acquiring the first detection image and the second detection image of the object to be detected under different illumination conditions and/or shooting conditions;
    对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行数学操作,进而区分所述待检测物体上的待检测目标和干扰。And performing a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image to further distinguish the target to be detected and the interference on the object to be detected.
  2. 根据权利要求1所述的方法,其特征在于,所述在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:The method according to claim 1, wherein the step of acquiring the first detected image and the second detected image of the object to be detected under different lighting conditions and/or shooting conditions comprises:
    根据所述待检测目标和所述干扰的反射特性设置不同的照明条件和/或拍摄条件,进而使得经所述数学操作后的所述待检测目标和所述干扰的亮度值存在一定差异。Different illumination conditions and/or shooting conditions are set according to the to-be-detected target and the reflection characteristic of the interference, so that there is a certain difference in the brightness value of the object to be detected and the interference after the mathematical operation.
  3. 根据权利要求2所述的方法,其特征在于,所述在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:The method according to claim 2, wherein the step of acquiring the first detected image and the second detected image of the object to be detected under different lighting conditions and/or shooting conditions comprises:
    根据所述待检测目标和所述干扰的反射特性设置不同的照明条件和/或拍摄条件,进而使得在所述第一检测图像和所述第二检测图像中的一个上能够根据亮度值对所述待检测目标和所述干扰与所述待检测物体的其他区域进行区分,而在所述第一检测图像和所述第二检测图像中的另一个上能够根据亮度值对所述干扰与所述待检测目标和所述待检测物体的其他区域进行区分。Setting different illumination conditions and/or shooting conditions according to the target to be detected and the reflection characteristic of the interference, so that one of the first detection image and the second detection image can be aligned according to the brightness value Determining that the detection target and the interference are distinguished from other areas of the object to be detected, and the interference and the interference can be based on the brightness value on the other of the first detection image and the second detection image The detection target and the other areas of the object to be detected are distinguished.
  4. 根据权利要求1-3 任一项所述的方法,其特征在于,所述对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行数学操作,进而区分所述待检测物体上的待检测目标和干扰的步骤包括:According to claims 1-3 The method according to any one of the preceding claims, wherein the brightness value of the corresponding position of the first detection image and the second detection image is mathematically operated to further distinguish the target to be detected on the object to be detected And the steps of interference include:
    利用预设的阈值分割条件与逻辑运算配合对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行处理,进而区分所述待检测目标和干扰。The brightness values of the corresponding positions of the first detection image and the second detection image are processed by using a preset threshold segmentation condition and a logical operation to further distinguish the target to be detected and the interference.
  5. 根据权利要求1所述的方法,其特征在于,所述干扰包括灰尘,所述待检测目标包括划痕和裂痕中的至少一个,或者所述干扰包括划痕和裂痕中的一个,所述待检测目标包括划痕和裂痕中的另一个。The method according to claim 1, wherein said interference comprises dust, said object to be detected includes at least one of a scratch and a crack, or said interference includes one of a scratch and a crack, said The detection target includes the other of the scratches and cracks.
  6. 根据权利要求5所述的方法,其特征在于,所述在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:The method according to claim 5, wherein the step of acquiring the first detected image and the second detected image of the object to be detected under different lighting conditions and/or shooting conditions comprises:
    通过改变光源的位置、光强和照射角度中的至少一个或者通过改变图像采集设备的位置、曝光强度和拍摄角度中的至少一个来获取不同的照明条件或拍摄条件。Different lighting conditions or shooting conditions are acquired by changing at least one of the position, the light intensity, and the illumination angle of the light source or by changing at least one of the position, the exposure intensity, and the shooting angle of the image capturing device.
  7. 根据权利要求6所述的方法,其特征在于,所述在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:The method according to claim 6, wherein the step of acquiring the first detected image and the second detected image of the object to be detected under different lighting conditions and/or shooting conditions comprises:
    相对于所述待检测物体以不同高度位置设置光源,利用图像采集设备分别对高位设置的光源照射下的所述待检测物体和低位设置的光源照射下的所述待检测物体进行图像采集来分别获得第一检测图像和第二检测图像;And setting the light source at different height positions with respect to the object to be detected, and respectively, using the image capturing device to respectively perform image acquisition on the object to be detected and the object to be detected under the illumination of the light source set by the high-level light source, respectively Obtaining a first detection image and a second detection image;
    所述对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行数学操作,进而区分所述待检测物体上的待检测目标和干扰的步骤包括:The step of performing a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image to further distinguish the target to be detected and the interference on the object to be detected includes:
    对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行数学操作,进而区分所述待检测物体上的裂痕或划痕与所述待检测物体上的灰尘。And performing a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image to further distinguish the cracks or scratches on the object to be detected from the dust on the object to be detected.
  8. 根据权利要求7所述的方法,其特征在于,所述在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤进一步包括:The method according to claim 7, wherein the step of acquiring the first detected image and the second detected image of the object to be detected under different lighting conditions and/or shooting conditions further comprises:
    将所述光源和所述图像采集设备设置于所述待检测物体的同一侧,且将所述图像采集设备的法线方向与所述待检测物体的法线方向之间的夹角设置在15度-70度之间。Setting the light source and the image capturing device on the same side of the object to be detected, and setting an angle between a normal direction of the image capturing device and a normal direction of the object to be detected at 15 Degree between -70 degrees.
  9. 根据权利要求8所述的方法,其特征在于,所述在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤进一步包括:The method according to claim 8, wherein the step of acquiring the first detected image and the second detected image of the object to be detected under different lighting conditions and/or shooting conditions further comprises:
    将所述图像采集设备的法线方向与高位设置的所述光源的法线方向之间的夹角设置成小于10度,并将所述图像采集设备的法线方向与低位设置的所述光源的法线方向之间的夹角设置成大于30度。Setting an angle between a normal direction of the image capturing device and a normal direction of the light source disposed at a high position to be less than 10 degrees, and setting the normal direction of the image capturing device to the light source at a low position The angle between the normal directions is set to be greater than 30 degrees.
  10. 根据权利要求1所述的方法,其特征在于,所述在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像的步骤包括:The method according to claim 1, wherein the step of acquiring the first detected image and the second detected image of the object to be detected under different lighting conditions and/or shooting conditions comprises:
    利用图像采集设备分别对不同光强照射下的所述待检测物体进行图像采集来分别获得第一检测图像和第二检测图像;Acquiring an image of the object to be detected under different illuminations by an image acquisition device to obtain a first detection image and a second detection image, respectively;
    所述对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行数学操作,进而区分所述待检测物体上的待检测目标和干扰的步骤包括:The step of performing a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image to further distinguish the target to be detected and the interference on the object to be detected includes:
    对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行数学操作,进而区分所述待检测物体上的划痕与裂痕。Performing a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image to further distinguish the scratches and cracks on the object to be detected.
  11. 一种视觉检测系统,其特征在于,所述系统包括光源、图像采集设备及处理器,其中所述光源和所述图像采集设备配合,进而在不同的照明条件和/或拍摄条件下获取待检测物体的第一检测图像和第二检测图像,所述处理器对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行数学操作,进而区分所述待检测物体上的待检测目标和干扰。A visual inspection system, characterized in that the system comprises a light source, an image acquisition device and a processor, wherein the light source cooperates with the image acquisition device to obtain a detection under different illumination conditions and/or shooting conditions a first detection image and a second detection image of the object, the processor performing a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image, thereby distinguishing the to-be-detected object Detect targets and interference.
  12. 根据权利要求11所述的系统,其特征在于,所述照明条件和/或拍摄条件根据所述待检测目标和所述干扰的反射特性进行设置,进而使得经所述数学操作后的所述待检测目标和所述干扰的亮度值存在一定差异。The system according to claim 11, wherein said illumination condition and/or photographing condition is set according to said reflection target and said reflection reflection characteristic, thereby causing said waiting after said mathematical operation There is a difference between the detection target and the brightness value of the interference.
  13. 根据权利要求12所述的系统,其特征在于,所述照明条件和/或拍摄条件根据所述待检测目标和所述干扰的反射特性进行设置,进而使得在所述第一检测图像和所述第二检测图像中的一个上能够根据亮度值对所述待检测目标和所述干扰与所述待检测物体的其他区域进行区分,而在所述第一检测图像和所述第二检测图像中的另一个上能够根据亮度值对所述干扰与所述待检测目标和所述待检测物体的其他区域进行区分。The system according to claim 12, wherein said illumination condition and/or photographing condition is set according to said reflection target and said interference reflection characteristic, thereby causing said first detection image and said One of the second detection images is capable of distinguishing the object to be detected and the interference from other regions of the object to be detected according to a brightness value, and in the first detection image and the second detection image On the other side, the interference can be distinguished from the object to be detected and other areas of the object to be detected according to the brightness value.
  14. 根据权利要求11-13任一项所述的系统,其特征在于,所述处理器利用预设的阈值分割条件与逻辑运算配合对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行处理,进而区分所述待检测目标和干扰。The system according to any one of claims 11 to 13, wherein the processor cooperates with a logical operation to match a corresponding position of the first detection image and the second detection image by using a preset threshold division condition The brightness values are processed to distinguish the target to be detected and the interference.
  15. 根据权利要求11所述的系统,其特征在于,所述干扰包括灰尘,所述待检测目标包括划痕和裂痕中的至少一个,或者所述干扰包括划痕和裂痕中的一个,所述待检测目标包括划痕和裂痕中的另一个。The system according to claim 11, wherein said interference includes dust, said object to be detected includes at least one of a scratch and a crack, or said interference includes one of a scratch and a crack, said The detection target includes the other of the scratches and cracks.
  16. 根据权利要求15所述的系统,其特征在于,通过改变所述光源的位置、光强和照射角度中的至少一个或者通过改变所述图像采集设备的位置、曝光强度和拍摄角度中的至少一个来获取不同的照明条件或拍摄条件。The system according to claim 15, wherein at least one of changing a position, a light intensity, and an illumination angle of the light source or by changing at least one of a position, an exposure intensity, and a shooting angle of the image pickup device To get different lighting conditions or shooting conditions.
  17. 根据权利要求16所述的系统,其特征在于,所述光源相对于所述待检测物体以不同高度位置进行设置,所述图像采集设备分别对高位设置的光源照射下的所述待检测物体和低位设置的光源照射下的所述待检测物体进行图像采集来分别获得第一检测图像和第二检测图像,所述处理器对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行数学操作,进而区分所述待检测物体上的裂痕或划痕与所述待检测物体上的灰尘。The system according to claim 16, wherein the light source is disposed at different height positions with respect to the object to be detected, and the image capturing device respectively irradiates the object to be detected under a light source set at a high position and Performing image acquisition on the object to be detected illuminated by the light source disposed at a low position to obtain a first detection image and a second detection image, respectively, where the processor corresponds to the first detection image and the second detection image The brightness value is mathematically operated to distinguish between cracks or scratches on the object to be detected and dust on the object to be detected.
  18. 根据权利要求17所述的系统,其特征在于,所述光源和所述图像采集设备设置于所述待检测物体的同一侧,且所述图像采集设备的法线方向与所述待检测物体的法线方向之间的夹角设置在15度-70度之间。The system according to claim 17, wherein the light source and the image capturing device are disposed on the same side of the object to be detected, and a normal direction of the image capturing device and an object to be detected The angle between the normal directions is set between 15 degrees and 70 degrees.
  19. 根据权利要求18所述的系统,其特征在于,所述图像采集设备的法线方向与高位设置的所述光源的法线方向之间的夹角设置成小于10度,且所述图像采集设备的法线方向与低位设置的所述光源的法线方向之间的夹角设置成大于30度。The system according to claim 18, wherein an angle between a normal direction of the image capturing device and a normal direction of the light source disposed at a high position is set to be less than 10 degrees, and the image capturing device The angle between the normal direction and the normal direction of the light source disposed at the lower position is set to be greater than 30 degrees.
  20. 根据权利要求11所述的系统,其特征在于,所述图像采集设备分别对所述光源的不同光强照射下的所述待检测物体进行图像采集来分别获得第一检测图像和第二检测图像,所述处理器对所述第一检测图像和所述第二检测图像的对应位置的亮度值进行数学操作,进而区分所述待检测物体上的划痕与裂痕。The system according to claim 11, wherein the image acquisition device respectively performs image acquisition on the object to be detected under different illuminations of the light source to obtain a first detection image and a second detection image, respectively. And the processor performs a mathematical operation on the brightness values of the corresponding positions of the first detection image and the second detection image to further distinguish the scratches and cracks on the object to be detected.
PCT/CN2017/078962 2017-03-31 2017-03-31 Visual inspection system and method WO2018176370A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780001564.9A CN107980094B (en) 2017-03-31 2017-03-31 Visual detection system and method
PCT/CN2017/078962 WO2018176370A1 (en) 2017-03-31 2017-03-31 Visual inspection system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/078962 WO2018176370A1 (en) 2017-03-31 2017-03-31 Visual inspection system and method

Publications (1)

Publication Number Publication Date
WO2018176370A1 true WO2018176370A1 (en) 2018-10-04

Family

ID=62006190

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/078962 WO2018176370A1 (en) 2017-03-31 2017-03-31 Visual inspection system and method

Country Status (2)

Country Link
CN (1) CN107980094B (en)
WO (1) WO2018176370A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109580631B (en) * 2018-11-22 2021-04-20 成都市鹰诺实业有限公司 Method for judging surface difference of measured object by using light intensity
CN110445921A (en) * 2019-09-06 2019-11-12 东北大学 A kind of Mobile phone screen backlight foreign matter defect diagnostic method and device based on machine vision
CN113466233B (en) * 2020-03-31 2024-07-16 北京配天技术有限公司 Visual inspection method, visual inspection apparatus, and computer storage medium
CN111879791B (en) * 2020-07-30 2023-06-20 西湖大学 A machine vision system and method for enhancing convex features on a pattern surface

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101034069A (en) * 2006-03-10 2007-09-12 欧姆龙株式会社 Defect inspection apparatus and defect inspection method
CN102292805A (en) * 2009-01-26 2011-12-21 恪纳腾公司 System and method for detecting defects on a wafer
US20120106799A1 (en) * 2009-07-03 2012-05-03 Shenzhen Taishan Online Technology Co., Ltd. Target detection method and apparatus and image acquisition device
CN103245670A (en) * 2013-05-06 2013-08-14 科瑞自动化技术(深圳)有限公司 Defect detection device and defect detection method of optical element

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3866054A (en) * 1973-09-28 1975-02-11 Du Pont Defect size discriminator circuit for web inspection system
US6256093B1 (en) * 1998-06-25 2001-07-03 Applied Materials, Inc. On-the-fly automatic defect classification for substrates using signal attributes
AU1553601A (en) * 1999-11-29 2001-06-12 Olympus Optical Co., Ltd. Defect inspecting system
US7177458B1 (en) * 2000-09-10 2007-02-13 Orbotech Ltd. Reduction of false alarms in PCB inspection
US7589869B2 (en) * 2006-04-28 2009-09-15 Electro Scientific Industries, Inc. Adjusting image quality using multi-wavelength light
KR100894684B1 (en) * 2007-04-26 2009-04-24 주식회사 엔케이스틸 Metal plate surface defect inspection device and metal plate surface defect inspection method using image measuring device and laser depth measuring device
KR101377098B1 (en) * 2011-12-19 2014-03-25 (주)포스코 Apparatus for detecting the surface of roll in annealing furnace
JP6328468B2 (en) * 2014-03-31 2018-05-23 株式会社日立ハイテクノロジーズ Defect inspection apparatus and inspection method
CN104240204B (en) * 2014-09-11 2017-02-15 镇江苏仪德科技有限公司 Solar silicon wafer and battery piece counting method based on image processing
CN104586404A (en) * 2015-01-27 2015-05-06 深圳泰山在线科技有限公司 Method and system for identifying posture of fitness and health monitoring
CN106504215A (en) * 2016-11-10 2017-03-15 中国科学院长春光学精密机械与物理研究所 A kind of method and device of image enhaucament

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101034069A (en) * 2006-03-10 2007-09-12 欧姆龙株式会社 Defect inspection apparatus and defect inspection method
CN102292805A (en) * 2009-01-26 2011-12-21 恪纳腾公司 System and method for detecting defects on a wafer
US20120106799A1 (en) * 2009-07-03 2012-05-03 Shenzhen Taishan Online Technology Co., Ltd. Target detection method and apparatus and image acquisition device
CN103245670A (en) * 2013-05-06 2013-08-14 科瑞自动化技术(深圳)有限公司 Defect detection device and defect detection method of optical element

Also Published As

Publication number Publication date
CN107980094A (en) 2018-05-01
CN107980094B (en) 2021-02-26

Similar Documents

Publication Publication Date Title
WO2018176370A1 (en) Visual inspection system and method
CN110403232B (en) Cigarette quality detection method based on secondary algorithm
WO2017039259A1 (en) Apparatus and method for diagnosing electric power equipment using thermal imaging camera
CN112033965B (en) 3D arc surface defect detection method based on differential image analysis
EP1277042B1 (en) Directional lighting and method to distinguish three dimensional information
CN108387516A (en) Threading defects detection device and detection method based on CCD camera image processing technologies
CN102680498B (en) A kind of concave pattern of cigarette filter tip integrality detection method
WO2020051728A1 (en) System and method for automatically sorting ceramic balls
CN112129769A (en) Capsule defect detection online image acquisition and detection system with multiple cameras and multiple light sources
CN110441318A (en) A kind of chemical fibre spinneret hole defect inspection method based on machine vision
WO2019119453A1 (en) Image matching method and visual system
CN2791639Y (en) Infrared device for detecting internal defect of semiconductor material
JPH04305144A (en) Outer circumference chipping inspector for contact lens
CN116253026A (en) Cigarette appearance detection and discrimination processing system and method for GDX2 packaging equipment
CN114813784A (en) Flexible circuit board visual detection device and flexible circuit board visual detection method
TWI448606B (en) Method and device for inspecting surface
JP2010523958A (en) Residual oxide detection and classification device in metal plate production line
MY151606A (en) Slant vision system
CN218819539U (en) Gas safety inspection device
JPH05142161A (en) Method and device for inspecting appearance, method and device for inspecting magnetic head, and magnetic head manufacturing facility
JP3682249B2 (en) Glass bottle thread inspection device
CN223244410U (en) A composite filter rod appearance detection device
JPH043820B2 (en)
JPH0299806A (en) Inspection of surface defect
JPH0829357A (en) Appearance inspection device for automation line

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17904118

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17904118

Country of ref document: EP

Kind code of ref document: A1