[go: up one dir, main page]

CN103170778B - An Automatic Seam Tracking System - Google Patents

An Automatic Seam Tracking System Download PDF

Info

Publication number
CN103170778B
CN103170778B CN201310111811.4A CN201310111811A CN103170778B CN 103170778 B CN103170778 B CN 103170778B CN 201310111811 A CN201310111811 A CN 201310111811A CN 103170778 B CN103170778 B CN 103170778B
Authority
CN
China
Prior art keywords
image
weld
frame
seam
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310111811.4A
Other languages
Chinese (zh)
Other versions
CN103170778A (en
Inventor
梁德群
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dalian Maritime University
Original Assignee
Dalian Maritime University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dalian Maritime University filed Critical Dalian Maritime University
Priority to CN201310111811.4A priority Critical patent/CN103170778B/en
Publication of CN103170778A publication Critical patent/CN103170778A/en
Application granted granted Critical
Publication of CN103170778B publication Critical patent/CN103170778B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

本发明公开了一种焊缝自动跟踪系统。该系统中,摄像机组(1)采集焊缝图像,图像识别装置(3)通过图像采集卡(2)获取该焊缝图像,利用自身模板法在该焊缝图像中搜索和匹配焊缝中心当前位置,根据匹配到的焊缝中心当前位置生成控制信号并输出给自动控制装置(4),自动控制装置(4)依据给定的控制信号调整焊枪臂的位置,以将焊枪移动到焊缝中心位置。该系统由于是采用了自身模板法,提高了识别过程的抗干扰能力,从而提高识别成功率。

The present invention discloses an automatic welding seam tracking system. In the system, a camera group (1) collects welding seam images, an image recognition device (3) obtains the welding seam images through an image acquisition card (2), searches and matches the current position of the welding seam center in the welding seam images using a self-template method, generates a control signal according to the matched current position of the welding seam center and outputs it to an automatic control device (4), and the automatic control device (4) adjusts the position of the welding gun arm according to the given control signal to move the welding gun to the welding seam center position. Since the system adopts the self-template method, the anti-interference ability of the recognition process is improved, thereby improving the recognition success rate.

Description

一种焊缝自动跟踪系统An Automatic Seam Tracking System

技术领域technical field

本发明属于焊接自动化中焊缝自动跟踪技术领域,特别是一种利用图像识别方法的焊缝自动跟踪系统。The invention belongs to the technical field of automatic welding seam tracking in welding automation, in particular to an automatic welding seam tracking system using an image recognition method.

背景技术Background technique

在大型钢结构体(如:石油天然气钢管、船体、压力容器等)的生产中,广泛应用自动焊接技术。为了实现自动焊接,需要通过焊缝自动跟踪方法使得焊枪与焊缝的相对位置稳定地保持准确。In the production of large steel structures (such as: oil and gas steel pipes, ship hulls, pressure vessels, etc.), automatic welding technology is widely used. In order to realize automatic welding, it is necessary to keep the relative position of the welding torch and the welding seam stable and accurate through the method of automatic welding seam tracking.

已有的焊缝自动跟踪方法包括:靠模跟踪方法、涡流跟踪方法、电磁跟踪方法、光电跟踪方法、图像跟踪方法等。其中的图像跟踪方法是利用摄像机实时获取焊缝图像,利用模式识别的理论和方法在当前图像中寻找焊缝,将焊缝当前位置传输给自动控制环节,再发出调整位置的命令,实现焊缝位置的自动跟踪。Existing seam automatic tracking methods include: profile tracking method, eddy current tracking method, electromagnetic tracking method, photoelectric tracking method, image tracking method and so on. The image tracking method is to use the camera to obtain the weld seam image in real time, use the theory and method of pattern recognition to find the weld seam in the current image, transmit the current position of the weld seam to the automatic control link, and then issue the command to adjust the position to realize the welding seam Automatic tracking of location.

图像跟踪方法又包括两大类:一类是基于结构光方法。其原理是,发出一束与焊缝走向成垂直方向的窄条光线,保持摄像机的视线在一个平面上,该平面与包含焊缝中心线的切平面垂直,视线还要与焊缝走向呈一定角度,从而获取反映焊缝横截面形状的图像,这种形状一般有V字形和U字形两种。于是V字形或U字形就作为识别用的特征。由于特征简单明显,便于识别,在工艺条件保证的条件下,能保证可靠跟踪。但是,这种方法容易受到干扰。当焊缝不规则时,或较大的外部光线干扰时,无法呈现明显的V字形或U字形时,就会造成识别失败。另一类是基于非结构光方法。其原理是,直接获取焊缝图像,提取焊缝的多种特征,构成特征向量,再构建复杂的识别方法,实现焊缝的寻找。这种方法的难点在于特征向量的提取,最简单的特征提取方式是,在一幅标准的焊缝图像中取一个包含焊缝的窗口作为模板,在当前图像中进行窗口图像匹配,当匹配误差最小时,认为找到焊缝。由于焊缝表面并不平整和清洁,再加上外界光线的干扰,实际上很难得到一个合适的“标准焊缝图像”,所取模板图像与当前图像常常会有较大的差别,因而使识别失败。Image tracking methods include two categories: one is based on structured light methods. The principle is to emit a narrow beam of light perpendicular to the direction of the welding seam, and keep the line of sight of the camera on a plane, which is perpendicular to the tangent plane including the center line of the welding seam, and the line of sight must be in a certain direction with the direction of the welding seam. Angle, so as to obtain an image reflecting the cross-sectional shape of the weld, which generally has two types: V-shape and U-shape. The V-shape or U-shape is then used as a feature for identification. Because the feature is simple and obvious, it is easy to identify, and it can ensure reliable tracking under the condition of guaranteed process conditions. However, this approach is susceptible to interference. When the welding seam is irregular, or when there is a large external light interference, when the obvious V-shape or U-shape cannot be presented, it will cause the recognition failure. The other category is based on unstructured light methods. The principle is to directly acquire the image of the weld, extract various features of the weld to form a feature vector, and then construct a complex recognition method to realize the search for the weld. The difficulty of this method lies in the extraction of feature vectors. The simplest feature extraction method is to take a window containing a weld in a standard weld image as a template, and perform window image matching in the current image. When the matching error Minimal, considered to find the weld. Due to the unevenness and cleanness of the weld surface, coupled with the interference of external light, it is actually difficult to obtain a suitable "standard weld image", and the template image taken is often quite different from the current image. Recognition failed.

发明内容Contents of the invention

针对上述已有两类图像跟踪方法存在的问题,本发明提出了一种焊缝自动跟踪系统,该系统同样基于图像跟踪方法,利用自身模板与自身图像做匹配寻找焊缝的当前位置,以提高跟踪过程的抗干扰能力。Aiming at the problems existing in the above-mentioned two types of image tracking methods, the present invention proposes an automatic welding seam tracking system, which is also based on the image tracking method and uses its own template to match its own image to find the current position of the weld seam to improve Anti-interference ability of tracking process.

本发明采用的技术手段是:一种焊缝自动跟踪系统,其特征在于包括:置于焊枪臂上的摄像机组、图像采集卡、图像显示和识别装置、自动控制装置;The technical means adopted in the present invention is: an automatic welding seam tracking system, which is characterized in that it includes: a camera group placed on the welding torch arm, an image acquisition card, an image display and recognition device, and an automatic control device;

摄像机组采集焊缝图像,图像显示和识别装置通过图像采集卡获取该焊缝图像,利用自身模板法在该焊缝图像中搜索和匹配焊缝中心当前位置,根据匹配到的焊缝中心当前位置生成控制信号并输出给自动控制装置,自动控制装置依据给定的控制信号调整焊枪臂的位置,以将焊枪移动到焊缝中心位置。The camera group collects the weld image, and the image display and recognition device acquires the weld image through the image acquisition card, uses its own template method to search and match the current position of the weld center in the weld image, and according to the matched current position of the weld center The control signal is generated and output to the automatic control device, and the automatic control device adjusts the position of the welding torch arm according to the given control signal, so as to move the welding torch to the center position of the welding seam.

本发明的系统利用自身模板法实现焊缝的中心定位;具体是,在摄像机组所获得的图像序列中,要保证在焊缝前进方向上的相邻两帧图像有大约一半区域重叠,也就是说,在前一帧图像的后半部分会移动到在当前帧图像的前半部分;于是,在前一帧图像的后半部取包含一定长度焊缝的一个窗口图像并作为模板,在当前一帧图像的前半部分进行匹配,当最好匹配时就找到了模板本身的图像,则焊缝的横向偏移值就被确定;由于在前一幅图像中所取得模板内的图像一定会在当前一帧的前半部图像中重复出现,考虑到连续两帧的时间间隔很小,外界环境不会有太大的变化,因此所做的是自身与自身的图像匹配,提高了识别过程的抗干扰能力,从而提高识别成功率。The system of the present invention uses its own template method to realize the center positioning of the weld; specifically, in the image sequence obtained by the camera group, it is necessary to ensure that about half of the areas of the adjacent two frames of images in the forward direction of the weld overlap, that is, That is to say, the second half of the image in the previous frame will move to the first half of the image in the current frame; therefore, take a window image containing a certain length of weld in the second half of the image in the previous frame and use it as a template, in the current frame The first half of the frame image is matched, and when the best match is found, the image of the template itself is found, and the lateral offset value of the weld is determined; since the image in the template obtained in the previous image must be in the current It appears repeatedly in the first half image of a frame. Considering that the time interval between two consecutive frames is very small, the external environment will not change much, so what is done is to match itself with its own image, which improves the anti-interference of the recognition process ability, thereby improving the recognition success rate.

附图说明Description of drawings

以下结合附图及实施例,对本发明进行进一步详细说明:Below in conjunction with accompanying drawing and embodiment, the present invention is described in further detail:

图1为本发明焊缝自动跟踪系统原理图;Fig. 1 is the schematic diagram of the welding seam automatic tracking system of the present invention;

图2为提取自身模板进行搜索匹配的示意图;Figure 2 is a schematic diagram of extracting its own template for search and matching;

图3为数据传输图;Fig. 3 is a data transmission diagram;

图4为实施例的示意图。Figure 4 is a schematic diagram of the embodiment.

具体实施方式Detailed ways

如图1所示,本发明焊缝自动跟踪系统包括:置于焊枪臂上的摄像机组1、图像采集卡2、图像识别装置3、自动控制装置4。摄像机组1采集焊缝图像,图像识别装置3通过图像采集卡2获取该焊缝图像,利用自身模板法在该焊缝图像中搜索和匹配焊缝中心当前位置,根据匹配到的焊缝中心当前位置和随动系统控制原理生成控制信号并输出给自动控制装置4,自动控制装置4依据给定控制信号调整焊枪臂的位置,以将焊枪移动到焊缝中心位置。As shown in FIG. 1 , the welding seam automatic tracking system of the present invention includes: a camera group 1 placed on a welding torch arm, an image acquisition card 2 , an image recognition device 3 , and an automatic control device 4 . The camera group 1 collects the weld seam image, and the image recognition device 3 obtains the weld seam image through the image acquisition card 2, uses its own template method to search and match the current position of the weld seam center in the weld seam image, and according to the current position of the weld seam center matched The principle of position and servo system control generates a control signal and outputs it to the automatic control device 4. The automatic control device 4 adjusts the position of the welding torch arm according to the given control signal to move the welding torch to the center of the weld.

其中摄像机组可以包含一个或二个,设一帧焊缝图像视场的尺寸为Fv=a×b,a为垂直于焊缝前进方向的长度,其坐标方向定为x,b为沿焊缝前进方向的长度,其坐标方向定为y,选择一个或二个摄像机的原则是:设焊缝移动速度Sw、一帧焊缝图像持续时间TV,当Sw、b和TV之间满足关系时,在一帧焊缝图像的持续时间TV内,焊缝仅在视场内移动距离小于b/2,因此可只用一台摄像机为自身模板法提供了足够的图像重叠部分。当Sw、b和TV之间满足关系时,需要采用两台摄像机分别采集两帧相邻的焊缝图像,而为了应用自身模板法,需要相邻的两帧焊缝图像至少有一半的重叠,为此,两个摄像机视场中心在焊缝走向上的距离为LVF,则有:LVF≤TV×SwThe camera group can contain one or two cameras. Let the size of the field of view of a frame of weld image be F v =a×b, a is the length perpendicular to the direction of weld advance, its coordinate direction is set to x, and b is the length along the weld seam. The length in the forward direction of the seam, and its coordinate direction is set as y. The principle of selecting one or two cameras is: set the moving speed of the weld seam S w , and the duration of one frame of weld seam image T V , when the distance between S w , b and T V satisfies the relation When , within the duration T V of one frame of weld image, the weld only moves less than b/2 in the field of view, so only one camera can be used to provide enough image overlap for the self-template method. When S w , b and T V satisfy the relation When , it is necessary to use two cameras to collect two frames of adjacent weld images respectively, and in order to apply the self-template method, at least half of the adjacent two frames of weld images need to overlap. Therefore, the centers of the fields of view of the two cameras are at The distance on the direction of the weld is L VF , then: L VF ≤T V ×S w .

其中的TV有两种标准:在PAL制下,TV=40ms;在NTS制下,TV=30ms。a、b、x和y的具体值由分辨率和电视制式决定;分辨率定义为焊缝图像中一个像素代表实际焊件上的尺寸,其具体值由生产工艺对控制精度的要求;设px为像素在x方向的分辨率,允许的最大控制误差为±Erc,则px≤Erc/2,x的取值范围为x=1,…,N;设py为像素在y方向的分辨率,y的取值为y=1,…,M。常用图像采集卡是N=768像素,M=572像素;于是a=N·px,b=M·py;常用摄像机的画面长宽比是4.8/3.6,4.8/3.6≈768/572≈1.3,于是py=px/1.3;在现场确定实际位置时的办法是灵活的,本发明推荐的方法是:根据上述原则计算出a、b的实际值,将一个标准的长度尺放置在摄像机下方,调整摄像机的位置和聚焦镜头,观察显示屏中的图像,使a尽量充满整个视频显示器的宽度。Among them, there are two standards for TV V : under the PAL system, TV V =40ms; under the NTS system, TV V =30ms. The specific values of a, b, x and y are determined by the resolution and the TV system; the resolution is defined as a pixel in the weld image representing the size of the actual weldment, and its specific value is determined by the production process's requirements for control accuracy; set px is the resolution of the pixel in the x direction, and the maximum allowable control error is ±Er c , then px≤Er c /2, and the value range of x is x=1,...,N; let py be the resolution of the pixel in the y direction rate, the value of y is y=1,...,M. The commonly used image acquisition card is N=768 pixels, M=572 pixels; so a=N px, b=M py; the aspect ratio of the commonly used cameras is 4.8/3.6, 4.8/3.6≈768/572≈1.3, Then py=px/1.3; the way to determine the actual position on the spot is flexible, and the method recommended by the present invention is: calculate the actual values of a and b according to the above principles, place a standard length ruler under the camera, adjust Position the camera and focus the lens to observe the image on the display screen so that a fills the width of the entire video display as much as possible.

下面对图像识别装置3利用自身模板法在焊缝图像中搜索和匹配焊缝中心当前位置的过程详细说明如下:The process of searching and matching the current position of the weld seam center in the weld seam image by the image recognition device 3 using its own template method is described in detail below:

步骤一:设置三个图像序列变量,记为Qi、Cii=1,2,…,U,U=L/b,L为连续焊接过程中焊缝经过视场的总长度。其中,当摄像机组1为一台摄像机时,Qi(i=1,…,U)为该摄像机组采集的连续帧焊缝图像依次顺序排列所得到的图像序列;当摄像机组1为两台摄像机时,该图像序列中的奇数帧为一台摄像机采集的焊缝图像,该图像序列的偶数帧为另一台摄像机采集的焊缝图像,用Qi(x,y)(i=1,…,U)表示Qi中位于焊缝图像中(x,y)坐标点上的像素灰度值序列;Ci(i=1,…,U)为光标图像序列,Ci(x,y)(i=1,…,U)表示焊缝图像中(x,y)坐标点的光标灰度值序列,光标的形状由设计者决定,常用十字形;表示加上了光标的图像序列,表示中位于焊缝图像(x,y)坐标点上的像素灰度值序列。对于一帧图像中的所有的x和y,执行运算即可将光标序列叠加到焊缝图像帧中,⊕表示异或运算。以下统称βi和βi+1分别为当前帧和下一帧,β在不同表示处可以分别代表Q、和C;需要说明的是,在算法的角度上,上述三个序列的层数可以由设计者根据焊接系统的工作周期设置,也即i的最大取值U可以有较大的变化。在实际实现中,如果用计算机实现,摄像机与图像卡相连,计算机通过设置多线程从图像卡的帧存储器读取数据,上述的三个序列组成队列方式;如果自制由DSP和FPGA组成的处理器,则为了节省存储器空间,上述图像序列可以只设二层,即U=2,并采用传统的双体交叉结构的帧存取器来实现存储器空间的压缩,当一个摄像机时,用两个存储器的双体交叉的结构,当二个摄像机时,用4个帧存取储器组成两对双体交叉的结构(在多种存储器结构的文献中都有介绍);Step 1: Set three image sequence variables, denoted as Q i , C i and i=1,2,..., U, U=L/b, L is the total length of the weld passing through the field of view during the continuous welding process. Among them, when the camera group 1 is one camera, Q i (i=1,...,U) is the image sequence obtained by sequentially arranging the continuous frame weld images collected by the camera group; when the camera group 1 is two When using a camera, the odd frames in the image sequence are weld images collected by one camera, and the even frames in the image sequence are weld images collected by another camera. Q i (x, y) (i=1, ..., U) represent the sequence of pixel gray values in Q i located at the (x, y) coordinate point in the weld image; C i (i=1,..., U) is the cursor image sequence, C i (x, y )(i=1,...,U) indicates the cursor gray value sequence of (x, y) coordinate points in the weld image, the shape of the cursor is determined by the designer, and a cross is commonly used; represents the sequence of images with the cursor attached, express The pixel gray value sequence located on the (x, y) coordinate points of the weld image in . For all x and y in a frame of image, execute The operation can superimpose the cursor sequence into the weld image frame, ⊕ means XOR operation. Hereinafter, β i and β i+1 are collectively referred to as the current frame and the next frame respectively, and β can represent Q, and C; It should be noted that from the perspective of the algorithm, the number of layers of the above three sequences can be set by the designer according to the working cycle of the welding system, that is, the maximum value U of i can have a large change. In actual implementation, if it is implemented with a computer, the camera is connected to the image card, and the computer reads data from the frame memory of the image card by setting multi-threading, and the above three sequences form a queue; if the self-made processor composed of DSP and FPGA , in order to save memory space, the above image sequence can only have two layers, that is, U=2, and use the traditional two-body cross structure frame accessor to realize the compression of memory space. When a camera is used, two memory The two-body crossover structure, when there are two cameras, use four frame access memories to form two pairs of two-body crossover structures (introduced in the literature of various memory structures);

步骤二:由操作者对焊缝中心进行初始化定位:操作者在视频显示器上通过如键盘、鼠标之类的人工输入设备移动光标至焊缝中心位置,图像识别装置3读取光标指示的位置,将此位置作为焊缝中心的初始化定位。Step 2: The operator performs initial positioning on the center of the weld: the operator moves the cursor to the center of the weld through a manual input device such as a keyboard and a mouse on the video display, and the image recognition device 3 reads the position indicated by the cursor, Use this position as the initial location of the weld center.

操作者做初始化定位可有两种规则:第一,由一个操作者定位,又分为:1.具有长期操作经验的操作者,可通过观察视频显示器上的图像,移动光标到所看到的焊缝中心;2.在移动光标的同时图像识别装置3将光标的移动信号发送给自动控制装置4,由自动控制装置4控制焊枪对准焊缝中心;或者将图像识别装置3的视频显示器放到焊枪附近,由一个操作者一面调整焊枪位置,使其对准焊缝中心,一面在视频显示器上观察并移动光标位置,完成初始光标定位的工作;第二,由两个操作者的配合来定位:第一个操作者在焊枪附近直接测量焊枪与焊缝中心的相对偏差,同时指挥显示器前的第二个操作者移动光标向焊缝中心靠近,当第一个操作者确定焊枪对准焊缝中心时,同时指挥第二个操作者停止移动光标,则完成光标的初始定位,并将当前的光标值存储。当然,完成初始光标定位后即启动自动跟踪系统。初始定位帧作为后续算法中的第一个当前帧的焊缝图像QjThere are two rules for the operator to do the initial positioning: first, one operator locates, which is further divided into: 1. Operators with long-term operating experience can move the cursor to what they see by observing the image on the video display. 2. While moving the cursor, the image recognition device 3 sends the moving signal of the cursor to the automatic control device 4, and the automatic control device 4 controls the welding torch to align with the center of the weld seam; or put the video display of the image recognition device 3 on Near the welding torch, one operator adjusts the position of the welding torch to align it with the center of the weld, and at the same time observes and moves the cursor position on the video display to complete the initial cursor positioning; Positioning: The first operator directly measures the relative deviation between the welding torch and the center of the welding seam near the welding torch, and at the same time instructs the second operator in front of the display to move the cursor closer to the center of the welding seam. At the same time, instruct the second operator to stop moving the cursor at the center of the seam, the initial positioning of the cursor is completed, and the current cursor value is stored. Of course, the automatic tracking system starts after the initial cursor positioning. The initial positioning frame is used as the weld seam image Q j of the first current frame in the subsequent algorithm.

步骤三:在当前帧的焊缝图像Qj的后半部分取一个区域作为自身模板Pj。Pj的中心定在焊缝中心上,将此中心坐标记录在中间变量Co中;Pj的尺寸的确定原则是:设dpx为垂直于焊缝走向上的模板长度,满足:dpx≥dw+2(d'w-dw),dw为焊缝的平均宽度,d'w为焊缝的最大宽度;dpy为沿焊缝走向上的模板长度,其取值焊缝的速度稳定性,本发明推荐 Step 3: Take an area in the second half of the weld image Q j of the current frame as its own template P j . The center of P j is set on the center of the weld, and the coordinates of this center are recorded in the intermediate variable C o ; the principle of determining the size of P j is: let d px be the length of the template perpendicular to the direction of the weld, satisfying: d px ≥d w +2(d' w -d w ), d w is the average width of the weld, d' w is the maximum width of the weld; d py is the length of the template along the direction of the weld, and its value is the weld speed stability, the present invention recommends

步骤四:用Pj在下一帧焊缝图像Qj+1中的前半部分,通过使用搜索和匹配算法,完成对Qj+1帧焊缝图像中焊缝中心的当前位置的定位。其中的搜索指的是移动自身模板Pj,匹配指的是用自身模板Pj与Qj+1帧焊缝图像中搜索到的位置上的子图像作比较并记录比较结果。自身模板Pj的移动要按一定的路径顺序进行,不同的设计者可采用不同路径顺序;多数采用采用先沿x方向移动再在y方向上移动一行,如此重复,形成“之”字形路径顺序;也可以采用x和y交换的顺序;或者由设计者设计出特殊的路径顺序,本发明以“之”字形路径顺序为例;步骤四又包括的具体步骤:Step 4: use P j in the first half of the next frame of weld image Q j+1 , and use the search and matching algorithm to complete the positioning of the current position of the weld center in the Q j+1 frame of weld image. The search refers to moving the own template P j , and the matching refers to comparing the own template P j with the sub-image at the searched position in the Q j+1 frame weld image and recording the comparison result. The movement of the self-template P j must be carried out in a certain path sequence, and different designers can adopt different path sequences; most of them adopt the method of first moving along the x direction and then moving one line in the y direction, and so on, forming a "zigzag" path sequence The order that x and y are exchanged can also be adopted; perhaps a special path sequence is designed by the designer, and the present invention takes the "zigzag" path sequence as an example; the concrete steps that step 4 includes again:

步骤1:在下一帧焊缝图像Qj+1的前半部分中间区域,确定一个搜索匹配区,设搜索匹配区起点坐标为(xs0,ys0),终点坐标(xs0+Lsx,ys0+Lsy)。该搜索匹配区的大小按下述原则确定:搜索匹配区规定为矩形,其尺寸应保证在搜索匹配过程中做到过搜索,所说的过搜索指的是,在得到最佳匹配之后还要继续做若干次搜索匹配,然后通过回朔,真正找到正确匹配位置;设x方向的长度为Lsx,为了保证做到过搜索,则要求Lsx≥d'w+kx1Δdwm+kx2,Δdwm>0为在整个跟踪过程中允许的最大焊缝偏差,设kx1和kx2作为可调参数设置在视频显示器上的人机界面中或特别设置调整键,由操作者调整kx1和kx2的值;kx1是为补偿系统工作稳定性而设置的,在系统工作稳定的状况下,kx1可小,在系统工作不太稳定的状况下,kx1要取大的值;kx2是为保证实现过搜索而设置的,理论上只要令kx2=py,但考虑噪声干扰,要求kx2>py,在实际系统上可通过试运行将kx2调整到合理的值;y方向的长度为Lsy,Lsy取值与焊缝移动速度的稳定性有关,建议Lsy≥dpy+2ΔSwTV+3py,ΔSw≥0为焊缝移动速度的最大偏差,这个值在自动焊接系统设计和运行中是给定的。Step 1: Determine a search matching area in the middle area of the first half of the next frame of weld image Q j+1 , set the starting point coordinates of the search matching area as (x s0 , y s0 ), and the end point coordinates (x s0 +L sx , y s0 +L sy ). The size of the search matching area is determined according to the following principles: the search matching area is defined as a rectangle, and its size should ensure that it has been searched during the search and match process. Continue to do several search matches, and then find the correct matching position through backtracking; let the length in the x direction be L sx , in order to ensure that the search is done, it is required that L sx ≥ d' w +k x1 Δd wm +k x2 , Δd wm >0 is the maximum allowable weld seam deviation during the whole tracking process, k x1 and k x2 are set as adjustable parameters in the man-machine interface on the video display or a special adjustment key is set, and k x1 is adjusted by the operator and the value of k x2 ; k x1 is set to compensate for the stability of the system. When the system is stable, k x1 can be small, and when the system is not stable, k x1 should take a large value; k x2 is set to ensure over-searching. In theory, as long as k x2 = py, but considering noise interference, k x2 > py is required. In the actual system, k x2 can be adjusted to a reasonable value through trial operation; y The length of the direction is L sy , and the value of L sy is related to the stability of the welding seam moving speed. It is suggested that L sy ≥d py +2ΔS w T V +3py, and ΔS w ≥0 is the maximum deviation of the welding seam moving speed. This value It is a given in the design and operation of automatic welding systems.

步骤2:设置两个中间数组变量M1(z)和M2(z),其中,z=1,…,Z,分别记录匹配运算之和,以及Qj+1帧焊缝图像上当前匹配到的位置坐标。Step 2: Set two intermediate array variables M 1 (z) and M 2 (z), where z=1,...,Z, respectively record the sum of matching operations, and the current matching on Q j+1 frame weld image to the location coordinates.

步骤3:将自身模板Pj的左上角放在(xs0,ys0)上,从z=1开始,先x方向再y方向以一个像素为步距移动自身模板Pj,每移动一步做z=z+1直到Z止去循环地做如下匹配运算:Step 3: Place the upper left corner of the own template P j on (x s0 , y s0 ), start from z=1, first move the own template P j in the x direction and then the y direction with a step of one pixel, and do z=z+1 until Z to do the following matching operations in a loop:

M1(z)=Pj(x,y)-Qj+1(x,y)M 1 (z)=P j (x,y)-Q j+1 (x,y)

这一运算产生一个数据序列M1(z),z=1,…,Z,Z的取值要保证自身模板Pj在移动过程中覆盖整个搜索匹配区,即要保证自身模板Pj的右下角能最终到达坐标(xs0+Lsx,ys0+Lsy),Lsx和Lsy分别为x和y方向的长度。This operation generates a data sequence M 1 (z), z=1,...,Z, the value of Z must ensure that the template P j covers the entire search matching area during the moving process, that is, the right side of the template P j must be ensured. The lower corner can finally reach the coordinates (x s0 +L sx , y s0 +L sy ), where L sx and L sy are the lengths in the x and y directions, respectively.

其中,自身模板Pj移动的步距有两种:一种是最小步距,即一个像素作为一个步距单位;另一种是大步距,是若干个像素为一个步距单位。在运算时间能够满足要求的情况下一般用最小步距,在运算时间过长时要大步距和最小步距相结合,称为结合算法。结合算法是先用大步距做粗定位再用最小步距做精确定位。运算时间的长短由生产工艺和图像处理装置的能力决定;当图像处理装置的运算能够以最小步距在生产工艺要求所要求两次控制命令的间隔内完成一次搜索匹配运算时,就用最小步距,否则用结合算法。Among them, there are two kinds of step distances for the template P j to move: one is the minimum step distance, that is, one pixel is used as a step distance unit; the other is a large step distance, and several pixels are used as a step distance unit. In the case that the operation time can meet the requirements, the minimum step distance is generally used. When the operation time is too long, a combination of a large step distance and the minimum step distance is required, which is called a combination algorithm. The combination algorithm is to use the large step distance for rough positioning first, and then use the minimum step distance for precise positioning. The length of the operation time is determined by the production process and the capability of the image processing device; when the operation of the image processing device can complete a search and matching operation within the interval between two control commands required by the production process with the minimum step distance, the minimum step is used. distance, otherwise the combined algorithm is used.

步骤4:求得序列M1(z),z=1,…,Z的最小值,这个最小值对应于准确匹配,同时记录对应此最小值的匹配坐标点,即M2(z)=(x,y)给出焊缝图像Qj+1上准确匹配的位置,则此位置上自身模板Pj的中心就是焊缝的中心。Step 4: Obtain the minimum value of the sequence M 1 (z), z=1,..., Z, this minimum value corresponds to an exact match, and record the matching coordinate point corresponding to this minimum value, that is, M 2 (z)=( x, y) gives the exact matching position on the weld image Q j+1 , then the center of the own template P j at this position is the center of the weld.

步骤5:做焊缝偏差运算ΔC=Co-M2(z),根据ΔC记录的坐标值改变Cj+1(x,y)中光标的位置同时向控制装置发出移动焊枪的控制命令,接着做运算 Q ^ j + 1 ( x , y ) = Q j + 1 ( x , y ) ⊕ C j + 1 ( x , y ) , 之后将 Q ^ j + 1 ( x , y ) 送显示器显示。Step 5: Perform weld seam deviation calculation ΔC=C o -M 2 (z), change the position of the cursor in C j+1 (x,y) according to the coordinate value recorded by ΔC, and at the same time send a control command to the control device to move the welding torch, Then do the calculation Q ^ j + 1 ( x , the y ) = Q j + 1 ( x , the y ) ⊕ C j + 1 ( x , the y ) , will later Q ^ j + 1 ( x , the y ) send to the monitor.

步骤五:检查是否有停止命令,如有,则停止上述运算和操作,否则回到步骤三,重做取模板、搜索匹配、改写光标位置、送显示和发出控制命令等操作。发出停止命令有二种情况:(1)系统发出故障报警,(2)人为停止工作。Step 5: Check whether there is a stop command, if so, stop the above calculations and operations, otherwise go back to step 3, redo fetching templates, searching for matches, rewriting cursor position, sending Operations such as displaying and issuing control commands. There are two situations for issuing the stop command: (1) The system sends out a fault alarm, (2) The work is stopped manually.

如图2给出了提取自身模板进行搜索匹配的示意图,焊缝沿Y轴方向前进,沿X方向会出现偏差。图中画出了三个坐标平面,它们分别记为x(tj-1),y(tj-1),x(tj),y(tj),x(tj+1),y(tj+1),在空间上,这三个平面实际上在一个平面上,只是在时间轴(记为t)上表示为三个平面,其时间坐标记分别为(tj-1),(tj),(tj+1)。在三个坐标平面上分别画出了三帧焊缝图像Qj-1,Qj,Qj+1;图中焊缝边缘在y方向上分成多段,各段用不同的线型表示,这是为了表明焊缝移动过程中位置变化的对应关系(由实线双箭头进一步指出),从这种对应关系中可以看出,三帧焊缝图像之间相邻二帧有约一半图像重叠;Pj和Pj-1分别表示Qj和Qj-1帧中的模板,字符号表示匹配中心,其中Pj-1在Qj-1后半部取得,在Qj的前半部做搜索匹配,Pj在Qj后半部取得,在Qj+1的前半部做搜索匹配,这种搜索匹配的变化关系由虚线双箭头指出。图中,xj-1,xj,xj+1分别表示焊缝中心的坐标。Figure 2 shows a schematic diagram of extracting its own template for search and matching. The weld advances along the Y-axis direction, and deviations occur along the X-axis direction. Three coordinate planes are drawn in the figure, which are recorded as x(t j-1 ), y(t j-1 ), x(t j ), y(t j ), x(t j+1 ), y(t j+1 ), in space, these three planes are actually on one plane, but they are represented as three planes on the time axis (marked as t), and their time coordinates are marked as (t j-1 ),(t j ),(t j+1 ). Three frames of weld images Q j-1 , Q j , Q j+1 are drawn respectively on the three coordinate planes; the edge of the weld in the figure is divided into multiple segments in the y direction, and each segment is represented by a different line type. It is to indicate the corresponding relationship between the position changes during the moving process of the weld (further pointed out by the solid double arrow), from this corresponding relationship, it can be seen that about half of the images of the two adjacent frames of the three weld images overlap; P j and P j-1 denote templates in Q j and Q j-1 frames, respectively, The character symbol indicates the matching center, where P j-1 is obtained in the second half of Q j-1 , and the search and match is performed in the first half of Q j , P j is obtained in the second half of Q j , and it is performed in the first half of Q j+1 A search match, the variation relationship of this search match is indicated by the dotted double arrow. In the figure, x j-1 , x j , and x j+1 represent the coordinates of the weld center respectively.

本发明的图像识别装置3是可以订购或定制的,目前一般有两种形式的结构,一种是基于工控机的通用结构,另一种是基于DSP、FPGA、单片机等器件的组成的专用结构。专用结构的具体构成方式多种多样,但图像的获取和传输流与前述的通用结构基本一致。图1展示了通用结构的示意图,在结构示意图中只画出了与本发明有关的部件。The image recognition device 3 of the present invention can be ordered or customized. At present, there are generally two types of structures, one is a general structure based on industrial computers, and the other is a special structure based on components such as DSP, FPGA, and single-chip microcomputers. . The specific structure of the dedicated structure is various, but the image acquisition and transmission flow are basically the same as the aforementioned general structure. Fig. 1 shows a schematic diagram of a general structure, in which only components related to the present invention are drawn.

在图1中,将订购或定制的带有双摄像机接口的图像采集卡插入工控机相应的插槽中。图像识别装置3又包括:内存、视频显示器和处理器;内存又包括内存缓冲区1、内存缓冲区2和内存缓冲区3。内存缓冲区1存储一台摄像机采集的焊缝图像帧Q2n+1,内存缓冲区2存储另一台摄像机采集的焊缝图像帧Q2n,内存缓冲区3存储光标图像,图形的更新由算法决定;处理器利用上述自身模板法在该焊缝图像中搜索和匹配焊缝中心当前位置,根据匹配到的焊缝中心当前位置生成控制信号,并输出给自动控制装置4。如前面的叙述中所指出的那样,内存缓冲器1、2、3的层数是可以减少到二层。上述的相关参数可放在其余的存储空间。In Figure 1, the ordered or customized image acquisition card with dual camera interfaces is inserted into the corresponding slot of the industrial computer. The image recognition device 3 further includes: a memory, a video display and a processor; the memory further includes a memory buffer 1 , a memory buffer 2 and a memory buffer 3 . Memory buffer 1 stores the weld seam image frame Q 2n+1 collected by one camera, memory buffer 2 stores the weld seam image frame Q 2n collected by another camera, memory buffer 3 stores the cursor image, and the graphics are updated by the algorithm Decision; the processor uses the self-template method to search and match the current position of the weld center in the weld image, generates a control signal according to the matched current position of the weld center, and outputs it to the automatic control device 4 . As pointed out in the foregoing description, the number of layers of memory buffers 1, 2, and 3 can be reduced to two layers. The above-mentioned relevant parameters can be placed in the rest of the storage space.

图3示出了图像数据和识别结果产生的控制信号的传输路径。FIG. 3 shows the transmission paths of image data and control signals generated by recognition results.

图4是一个实施例的演示图。其中左图是前一帧焊缝图像,右图是相邻的后一帧图像。右图中可见前一帧图像的下半部被模板所框的焊缝图像在相邻的后一帧图像中移到了上半部,为了指明这一点,我们人为地在焊缝旁边贴上一个白色三角。从图中可以看出,焊缝中心大约向左偏移了4毫米(注:这只是演示图,而且没有加控制反馈来调整偏差。实际中不可能允许相邻两帧焊缝偏移这么多。)Figure 4 is a diagram illustrating an embodiment. The image on the left is the weld seam image of the previous frame, and the image on the right is the image of the next adjacent frame. In the figure on the right, it can be seen that the weld seam image framed by the template in the lower half of the previous frame image has moved to the upper half in the next adjacent frame image. To indicate this, we artificially paste a white triangle. It can be seen from the figure that the center of the weld is shifted to the left by about 4mm (Note: This is just a demonstration picture, and there is no control feedback to adjust the deviation. In practice, it is impossible to allow the welds of two adjacent frames to deviate so much .)

Claims (4)

1. a seam tracking system, is characterized in that comprising: be placed in the shooting unit (1) on welding gun arm, image pick-up card (2), image display and recognition device (3), automaton (4);
Shooting unit (1) gathers weld image, image display and recognition device (3) obtain this weld image by image pick-up card (2) and are stored in image display and recognition device (3), in image display and recognition device (3), utilize self form method search in this weld image and mate Weld pipe mill current location, generate control signal according to the Weld pipe mill current location matched and export to automaton (4), automaton (4) is according to the position adjusting welding gun arm to control signal, so that welding gun is moved to Weld pipe mill position, image display and recognition device (3) utilize self form method to search in weld image and the step of mating Weld pipe mill current location comprises:
Step one: three image sequence variablees are set, are designated as Q i, C iwith wherein i=1,2 ..., U, U=L/b, L be in continuous welding process weld seam through the total length of visual field; Wherein, when unit (1) of making a video recording is a video camera, Q i(i=1,2 ..., U) sequentially arrange the image sequence obtained successively for the successive frame weld image of this shooting unit collection; When unit (1) of making a video recording is two video cameras, the odd-numbered frame in this image sequence is the weld image of a camera acquisition, and the even frame of this image sequence is the weld image of another camera acquisition, uses Q i(x, y) (i=1,2 ..., U) represent Q iin be arranged in pixel grey scale value sequence in weld image coordinate points, (x, y), x=1,2 ..., N, y=1,2 ..., M, N=a/px, M=b/py, px and py are the image resolution ratios in x and y direction, also the size of i.e. pixel; C ifor cursor glyph sequence, C i(x, y) (i=1,2 ..., U) represent C ithe cursor gray value sequence of (x, y) coordinate points in middle weld image; (i=1,2 ..., U) represent the image sequence adding cursor, represent in be positioned at pixel grey scale value sequence in weld image (x, y) coordinate points; For x and y all in a two field picture, perform computing is by cursor its superimposition in weld image frame, and ⊕ represents XOR;
Step 2: carry out initialization by operator's butt welded seam center and locate;
Step 3: at the weld image Q of present frame jlatter half get a rectangular area as self form P j, wherein Q jbelong to image sequence Q iin piece image, formula is expressed as Q j∈ Q i, j ∈ i, P j(x, y) x, y represents template P jin coordinate value, P jcenter fix on Weld pipe mill, this centre coordinate is recorded in intermediate variable C oin; P jthe determination principle of size be: establish d pxfor walking template length upwards perpendicular to weld seam, meet: d px>=d w+ 2 (d' w-d w), d wfor the mean breadth of weld seam, d' wfor the Breadth Maximum of weld seam, d pyfor walking template length upwards along weld seam,
Step 4: use P jat next frame weld image frame Q j+1in first half, by use search and matching algorithm, complete butt welded seam picture frame Q j+1the location of middle Weld pipe mill current location;
Step 5: checked whether and ceased and desisted order; If any, then stop above-mentioned computing and operation, otherwise get back to step 3, delivery plate of reforming, search mate, rewrite cursor position, send showing and send control command operation, sending two kinds of situations of having ceased and desisted order: (1) system sends fault alarm, and (2) people is for quitting work.
2. system according to claim 1, is characterized in that a frame weld image visual field is of a size of F v=a × b, a is the length perpendicular to weld seam direction of advance, and its coordinate direction is decided to be x, and b is the length along weld seam direction of advance, and its coordinate direction is decided to be y, a frame weld image duration T v, weld seam is at y direction translational speed S w, when meeting relation time, shooting unit is a video camera, and now adjacent two two field pictures just have the overlap of more than 1/2; And work as time, also will ensure that adjacent two two field pictures have the overlap of more than 1/2, then require that shooting unit is 2 video cameras, these 2 video cameras gather the weld image of two consecutive frames respectively; The distance along weld seam trend at these two camera field of view centers is L vF, require L vF≤ T v× S w; Wherein, T under PAL-system v=40ms, under NTS system, T v=30ms.
3. system according to claim 1, is characterized in that step 4 also comprises:
Step 1: at Q j+1the zone line of frame weld image the first half determines a search Matching band, if search
Rope Matching band is rectangle, and the coordinate of the upper left corner in picture frame is (x s0, y s0), lower right corner coordinate
(x s0+ L sx, y s0+ L sy), L sxand L sybe respectively the length in x and y direction;
Step 2: aray variable M in the middle of arranging two 1(z) and M 2(z), wherein, z=1 ..., Z, record matching operation result, and Q respectively j+1the current position coordinates matched on frame weld image;
Step 3: by self form P jthe upper left corner be placed on Q j+1(the x of frame weld image s0, y s0) on, from z=1, first x direction again y direction with a pixel for step pitch moves self form P j, often moving moves a step is z=z+1 until z=Z only goes cyclically to do following matching operation:
M 1(z)=P j(x,y)-Q j+1(x,y)
Operation result is recorded in M 1z, in (), the value of Z will ensure self form P jthe lower right corner can finally arrive coordinate (x s0+ L sx, y s0+ L sy), this computing produces a data sequence M 1(z), z=1 ..., Z;
Step 4: try to achieve sequence M 1(z), z=1 ..., the minimum of a value of Z, simultaneously the coupling coordinate points of record this minimum of a value corresponding, and use M 2z () record, even M 2(z)=(x, y), thus provide Q j+1the position of accurate match on frame weld image, then self form P on this position jcenter be exactly the center of weld seam;
Step 5: be weld seam deviation computing Δ C=C o-M 2z (), changes C according to the deviate that Δ C records j+1in (x, y), the position of cursor sends the control command of mobile welding gun simultaneously to control device, then does computing afterwards will display is sent to show.
4. system according to claim 3, the size and the position that it is characterized in that searching in step 1 Matching band are determined by following principle: search Matching band meets L sx>=d'+k x1Δ d wm+ k x2and L sy>=d py+ 2 Δ S wt v+ 3py, Δ d wm>0 is the maximum weld seam deviation allowed in whole tracing process, k x1and k x2for arrange adjustable parameter, its position in the central authorities of the first half of a two field picture, Δ S w>=0 is the maximum deviation of weld movement speed.
CN201310111811.4A 2013-04-01 2013-04-01 An Automatic Seam Tracking System Expired - Fee Related CN103170778B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310111811.4A CN103170778B (en) 2013-04-01 2013-04-01 An Automatic Seam Tracking System

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310111811.4A CN103170778B (en) 2013-04-01 2013-04-01 An Automatic Seam Tracking System

Publications (2)

Publication Number Publication Date
CN103170778A CN103170778A (en) 2013-06-26
CN103170778B true CN103170778B (en) 2015-06-24

Family

ID=48631202

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310111811.4A Expired - Fee Related CN103170778B (en) 2013-04-01 2013-04-01 An Automatic Seam Tracking System

Country Status (1)

Country Link
CN (1) CN103170778B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104416305B (en) * 2013-08-30 2016-08-10 中国石油天然气集团公司 Pipeline Multipoint synchronous automatic welding prescan formula seam laser tracking and device
CN105160645B (en) * 2015-01-24 2017-09-19 六安志成智能科技有限公司 Welding Torch Displacement Control System Tracking Welding Seam Position
CN105479029B (en) * 2015-12-30 2018-05-25 中北大学 A kind of automatic Tracking monitoring system of straight welding machine
CN107248170B (en) * 2017-04-24 2020-06-26 辽宁师范大学 Weld joint tracking method based on image matching
CN118492769A (en) * 2024-06-19 2024-08-16 重庆衍数自动化设备有限公司 Automatic positioning system for welding spot center of automobile part
CN119688826A (en) * 2025-02-25 2025-03-25 成都盛锴科技有限公司 Intelligent detection method and system for movable framework

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1511669A (en) * 2002-12-27 2004-07-14 中国科学院自动化研究所 Arc welding robot control platform with visual seam automatic tracking function
CN201264138Y (en) * 2008-08-01 2009-07-01 蔡杨波 Device for automatically recognizing and tracking weld joint by video camera imaging
CN201300288Y (en) * 2008-10-31 2009-09-02 鞍山荣邦电力电子有限公司 Automatic seam tracking system
CN101961819A (en) * 2009-07-22 2011-02-02 中国科学院沈阳自动化研究所 Device for realizing laser welding and seam tracking and control method thereof
CN202278307U (en) * 2011-08-19 2012-06-20 广州有色金属研究院 An adjustable double line structured light weld tracking visual sensing system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8365602B2 (en) * 2009-10-09 2013-02-05 Olympus Ndt, Inc. Weld seam tracking system using phased array ultrasonic devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1511669A (en) * 2002-12-27 2004-07-14 中国科学院自动化研究所 Arc welding robot control platform with visual seam automatic tracking function
CN201264138Y (en) * 2008-08-01 2009-07-01 蔡杨波 Device for automatically recognizing and tracking weld joint by video camera imaging
CN201300288Y (en) * 2008-10-31 2009-09-02 鞍山荣邦电力电子有限公司 Automatic seam tracking system
CN101961819A (en) * 2009-07-22 2011-02-02 中国科学院沈阳自动化研究所 Device for realizing laser welding and seam tracking and control method thereof
CN202278307U (en) * 2011-08-19 2012-06-20 广州有色金属研究院 An adjustable double line structured light weld tracking visual sensing system

Also Published As

Publication number Publication date
CN103170778A (en) 2013-06-26

Similar Documents

Publication Publication Date Title
CN103170778B (en) An Automatic Seam Tracking System
US11245806B2 (en) Method and apparatus for scanning and printing a 3D object
US10810734B2 (en) Computer aided rebar measurement and inspection system
JP7439073B2 (en) System and method for welding path generation
CN106181162B (en) A kind of real-time weld joint tracking detection method based on machine vision
CN103838437B (en) Touch positioning control method based on projection image
CN110102886A (en) A kind of Intelligent welding system applied to metal structure
Zou et al. Conditional generative adversarial network-based training image inpainting for laser vision seam tracking
CN105096382A (en) Method and apparatus for associating actual object information in video monitoring image
CN114838668B (en) Tunnel displacement monitoring method and system
CN105499337A (en) High-frequency welded tube molding control system and method
US7651027B2 (en) Remote instruction system and method thereof
CN117824624B (en) Indoor tracking and positioning method, system and storage medium based on face recognition
Li et al. A guidance system for robotic welding based on an improved YOLOv5 algorithm with a RealSense depth camera
CN114211164A (en) A seam tracking control method for a seam tracking system of an underwater welding robot
CN104866564A (en) Picture searching method and apparatus
JPH08123946A (en) Plant monitoring equipment
Yang et al. Automatic and continuous projector display surface calibration using every-day imagery
US20220245882A1 (en) Semi-automatic 3d scene optimization with user-provided constraints
US20240127427A1 (en) Systems and methods for generating floorplans from large area scanning
CN114147389A (en) Welding auxiliary method and system for detecting welding process parameters
CN204053279U (en) Sheet metal lap weld little characteristic point four head serial vision-based detection tracking means
CN104038668B (en) A kind of panoramic video display methods and system
Xin et al. 3D augmented reality teleoperated robot system based on dual vision
CN110619337A (en) Method for extracting and identifying sub-pixel edge of pantograph slide plate

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150624