[go: up one dir, main page]

CN116962649B - Image monitoring and adjustment system and line construction model - Google Patents

Image monitoring and adjustment system and line construction model Download PDF

Info

Publication number
CN116962649B
CN116962649B CN202311205474.5A CN202311205474A CN116962649B CN 116962649 B CN116962649 B CN 116962649B CN 202311205474 A CN202311205474 A CN 202311205474A CN 116962649 B CN116962649 B CN 116962649B
Authority
CN
China
Prior art keywords
point cloud
rotation matrix
adjacent cameras
matrix
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202311205474.5A
Other languages
Chinese (zh)
Other versions
CN116962649A (en
Inventor
单长孝
李凯
张文涛
汪宏春
张必余
余刚
刘云飞
黄朝永
陈晨
张志争
纪大付
刘国强
李延军
赵瑞旺
施怀礼
刘峰
田埂
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
State Grid Anhui Electric Power Co Ltd
Anhui Power Transmission and Transformation Engineering Co Ltd
State Grid Corp of China SGCC
Original Assignee
State Grid Anhui Electric Power Co Ltd
Anhui Power Transmission and Transformation Engineering Co Ltd
State Grid Corp of China SGCC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by State Grid Anhui Electric Power Co Ltd, Anhui Power Transmission and Transformation Engineering Co Ltd, State Grid Corp of China SGCC filed Critical State Grid Anhui Electric Power Co Ltd
Priority to CN202311205474.5A priority Critical patent/CN116962649B/en
Publication of CN116962649A publication Critical patent/CN116962649A/en
Application granted granted Critical
Publication of CN116962649B publication Critical patent/CN116962649B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention relates to the technical field of monitoring system deployment, in particular to an image monitoring and adjusting system. The image monitoring and adjusting system is used for adjusting shooting angles of 2 adjacent cameras respectively and comprises a point cloud database, a three-dimensional point cloud generating unit, a rotation matrix calculating unit and an angle adjusting unit. The invention can realize the guidance of the deployment of the monitoring system on the construction site based on the acquired power transmission line point cloud data, and particularly can preferably realize the automatic adjustment of the shooting angle of a single camera.

Description

图像监控调整系统及线路施工模型Image monitoring and adjustment system and line construction model

技术领域Technical field

本发明涉及监控系统部署技术领域,具体地说,涉及一种图像监控调整系统。The present invention relates to the technical field of monitoring system deployment, and specifically to an image monitoring and adjustment system.

背景技术Background technique

在线路施工过程中,能够通过部署视频监控系统的方式,实现对施工现场的监控,以达到辅助管控的目的。在部署视频监控系统时,需要考虑如下问题:During the line construction process, the construction site can be monitored by deploying a video surveillance system to assist management and control. When deploying a video surveillance system, you need to consider the following issues:

1、如何实现视频监控系统的覆盖率,尤其是对于输电通道等狭长的施工区段,需要对相邻相机间的拍摄角度进行反复的调整,以实现最大覆盖率的获取,也即最大程度地降低监控盲区;1. How to achieve the coverage of the video surveillance system, especially for long and narrow construction sections such as power transmission channels, it is necessary to repeatedly adjust the shooting angles between adjacent cameras to achieve maximum coverage, that is, to maximize the coverage. Reduce monitoring blind spots;

2、考虑到目前图像识别算法的成熟运用,使得将成熟的图像识别算法运用于监控画面的自动检测、识别等成为可能;就图像识别检测算法的原理而言,其有个前提条件,就是需要所拍摄的监控画面的参数不能发生过大变化,否则就需要再次对相应的图像识别检测算法的参数进行调整;但输电线路施工中,考虑到施工进度的进行和施工现场的较恶劣环境,所部署视频监控系统的监测点处的相机会存在必然的移动及不可预见的偏移等;这也将必然导致难以保证图像识别检测算法在进行运用时的结果稳定性。2. Considering the mature application of current image recognition algorithms, it is possible to apply mature image recognition algorithms to automatic detection and identification of surveillance images. As far as the principle of image recognition detection algorithms is concerned, there is a prerequisite, which is the need The parameters of the captured monitoring pictures cannot change too much, otherwise the parameters of the corresponding image recognition detection algorithm need to be adjusted again; however, during the construction of transmission lines, taking into account the progress of the construction progress and the harsh environment of the construction site, so The camera at the monitoring point where the video surveillance system is deployed will have certain movements and unforeseen offsets; this will inevitably make it difficult to ensure the stability of the results of the image recognition detection algorithm when used.

发明内容Contents of the invention

本发明提供了一种图像监控调整系统,其能够克服现有视频监控系统在进行部署时,所存在单个相机的拍摄角度难以精确调整的问题。The present invention provides an image monitoring and adjustment system, which can overcome the problem that the shooting angle of a single camera is difficult to accurately adjust when the existing video monitoring system is deployed.

根据本发明的一种图像监控调整系统,其用于分别实现2个相邻相机的拍摄角度的调整,其包括:An image monitoring and adjustment system according to the present invention is used to adjust the shooting angles of two adjacent cameras, which includes:

点云数据库,其用于存储施工现场的空间点云数据Point cloud database, which is used to store spatial point cloud data on construction sites ;

三维点云生成单元,其用于自空间点云数据中获取所述2个相邻相机的重叠区域的空间点云数据/>,并分别将空间点云数据/>变换至所述2个相邻相机的坐标系中,以获取分别对应所述2个相邻相机的三维点云/>和三维点云/>3D point cloud generation unit for self-space point cloud data Obtain the spatial point cloud data of the overlapping area of the two adjacent cameras/> , and respectively convert the spatial point cloud data/> Transform into the coordinate systems of the two adjacent cameras to obtain three-dimensional point clouds corresponding to the two adjacent cameras/> and 3D point cloud/> ;

旋转矩阵计算单元,其用于基于所述2个相邻相机的初始旋转矩阵为、内参矩阵为/>、初始旋转矩阵为/>和内参矩阵为/>,获取所述2个相邻相机的目标旋转矩阵为/>和目标旋转矩阵为/>A rotation matrix calculation unit, which is used to calculate the initial rotation matrix based on the two adjacent cameras as , the internal parameter matrix is/> , the initial rotation matrix is/> and the internal parameter matrix is/> , obtaining the target rotation matrix of the two adjacent cameras is/> and the target rotation matrix is/> ;

其中,in,

,

;

其中,坐标点为三维点云/>中的任一点,坐标点/>为三维点云/>中的任一点;Among them, the coordinate point For 3D point cloud/> Any point in , coordinate point/> For 3D point cloud/> any point in;

目标旋转矩阵为、初始旋转矩阵为/>、内参矩阵为/>和三维点云/>,对应所述2个相邻相机的其一;The target rotation matrix is , the initial rotation matrix is/> , the internal parameter matrix is/> and 3D point cloud/> , corresponding to one of the two adjacent cameras;

目标旋转矩阵为、初始旋转矩阵为/>、内参矩阵为/>和三维点云/>,对应所述2个相邻相机的另一;The target rotation matrix is , the initial rotation matrix is/> , the internal parameter matrix is/> and 3D point cloud/> , corresponding to the other of the two adjacent cameras;

以及角度调节单元,其以作为航向角并以/>作为俯仰角对所述2个相邻相机的所述其一的角度进行调整,以/>作为航向角并以/>作为俯仰角对应所述2个相邻相机的所述另一的角度进行调整。and an angle adjustment unit, which features as heading angle and /> The angle of one of the two adjacent cameras is adjusted as the pitch angle to/> as heading angle and /> The pitch angle is adjusted corresponding to the other angle of the two adjacent cameras.

作为优选,所述2个相邻相机在安装完毕后,通过标定获取初始旋转矩阵为、内参矩阵为/>、初始旋转矩阵为/>和内参矩阵为/>Preferably, after the two adjacent cameras are installed, the initial rotation matrix is obtained through calibration as , the internal parameter matrix is/> , the initial rotation matrix is/> and the internal parameter matrix is/> ;

其中,in,

.

作为优选,三维点云生成单元通过分别获取所述2个相邻相机各自的相机坐标系与空间点云数据所在的世界坐标系的转换矩阵,实现三维点云/>和三维点云/>的获取。Preferably, the three-dimensional point cloud generation unit obtains the camera coordinate system and spatial point cloud data of each of the two adjacent cameras. The transformation matrix of the world coordinate system to realize the three-dimensional point cloud/> and 3D point cloud/> of acquisition.

作为优选,旋转矩阵计算单元在计算目标旋转矩阵为和目标旋转矩阵为/>时,坐标点/>采用三维点云/>的重心;Preferably, the rotation matrix calculation unit calculates the target rotation matrix as and the target rotation matrix is/> When, coordinate point/> Using 3D point cloud/> center of gravity;

其中,in,

,

,

;

其中,M为三维点云中的坐标点总数,/>为三维点云/>中第m个点的坐标。Among them, M is the three-dimensional point cloud The total number of coordinate points in ,/> For 3D point cloud/> The coordinates of the m-th point in .

作为优选,旋转矩阵计算单元在计算目标旋转矩阵为和目标旋转矩阵为/>时,坐标点/>采用三维点云/>的重心;Preferably, the rotation matrix calculation unit calculates the target rotation matrix as and the target rotation matrix is/> When, coordinate point/> Using 3D point cloud/> center of gravity;

其中,in,

,

,

;

其中,N为三维点云中的坐标点总数,/>为三维点云/>中第n个点的坐标。Among them, N is the three-dimensional point cloud The total number of coordinate points in ,/> For 3D point cloud/> The coordinates of the nth point in .

作为优选,角度调节单元包括相机云台,所述2个相邻相机分别通过对应的相机云台设置于安装点处。Preferably, the angle adjustment unit includes a camera platform, and the two adjacent cameras are respectively installed at the installation points through corresponding camera platforms.

作为优选,在任一相机与多个相机间均存在重叠区域时,旋转矩阵计算单元分别获取基于两两相邻的相应重叠区域获取该任一相机的多个旋转矩阵,并以该多个旋转矩阵的均值作为最终的目标旋转矩阵。Preferably, when there are overlapping areas between any camera and multiple cameras, the rotation matrix calculation unit obtains multiple rotation matrices of any camera based on corresponding overlapping areas that are adjacent to each other, and uses the multiple rotation matrices to The mean value is used as the final target rotation matrix.

此外,本发明还提供了一种线路施工模型,其具有输电线路点云建立单元及任一上述的图像监控调整系统,输电线路点云建立单元用于实现空间点云数据的获取及更新。In addition, the present invention also provides a line construction model, which has a transmission line point cloud creation unit and any one of the above image monitoring and adjustment systems. The transmission line point cloud creation unit is used to realize spatial point cloud data. Obtain and update.

作为优选,输电线路点云建立单元包括无人机,空间点云数据通过无人机航拍获取。As an option, the transmission line point cloud creation unit includes drones and spatial point cloud data. Obtained through drone aerial photography.

本发明具有如下有益效果:The invention has the following beneficial effects:

1、所提供的图像监控调整系统,能够首先基于施工现场的空间点云数据以及所需部署的相机总数以及每个相机的拍摄范围,对所有相机的安装点位进行预估,进而获取任意两两相邻相机的大概安装位置;而后,在将所有相机安装至所预估的安装点位后,将不再需要对其进行严格的角度调整,而是只需要结合实际的安装位置对任意两两相邻相机的重叠区域进行划分获取,即可基于所需得到的重叠区域实现每个相机实际所需的空间角度的获取,进而实现每个相机角度的自动调整;1. The image monitoring and adjustment system provided can first be based on the spatial point cloud data of the construction site As well as the total number of cameras to be deployed and the shooting range of each camera, estimate the installation points of all cameras, and then obtain the approximate installation positions of any two adjacent cameras; then, install all cameras to the estimated After the installation point is determined, there is no need to strictly adjust the angle. Instead, you only need to divide and obtain the overlapping area of any two adjacent cameras based on the actual installation position, and then you can obtain the overlapping area based on the desired Realize the acquisition of the actual spatial angle required by each camera, and then realize the automatic adjustment of each camera angle;

2、所提供的图像监控调整系统,能够有效地实现每个相机拍摄角度的较精准调节,从而能够较佳地基于预想的所需拍摄覆盖率,实现最大实际监控覆盖率的获取。同时,由于本发明的系统是基于相邻2个相机间的重叠区域应该保持不变的思路,实现单个相机的拍摄角度的调整,故在任一相机的位置发生变化时,能够基于预设的固定的应有的重叠区域,实现任一相机的拍摄角度的自适应调节;此能够为下一步的如图像识别检测等,提供更为稳定的原始图像;2. The provided image monitoring adjustment system can effectively achieve more precise adjustment of the shooting angle of each camera, thereby achieving the maximum actual monitoring coverage based on the expected required shooting coverage. At the same time, because the system of the present invention is based on the idea that the overlapping area between two adjacent cameras should remain unchanged, it realizes the adjustment of the shooting angle of a single camera. Therefore, when the position of any camera changes, it can be based on the preset fixed The due overlap area enables adaptive adjustment of the shooting angle of any camera; this can provide a more stable original image for the next step such as image recognition and detection;

3、所提供的线路施工模型,能够较佳地实现输电线路点云数据的获取,并能够基于所获取的输电线路点云数据,实现对施工现场的监控系统部署的指引,尤其是能够较佳地实现单个相机的拍摄角度的自动调整。3. The line construction model provided can better achieve the acquisition of transmission line point cloud data, and can provide guidance for the deployment of monitoring systems at the construction site based on the obtained transmission line point cloud data. In particular, it can better achieve Automatically adjust the shooting angle of a single camera.

附图说明Description of the drawings

图1为实施例1中的图像监控调整系统的布置示意图。Figure 1 is a schematic layout diagram of the image monitoring and adjustment system in Embodiment 1.

具体实施方式Detailed ways

为进一步了解本发明的内容,结合附图和实施例对本发明作详细描述。应当理解的是,实施例仅仅是对本发明进行解释而并非限定。In order to further understand the content of the present invention, the present invention will be described in detail with reference to the accompanying drawings and embodiments. It should be understood that the embodiments are only for explanation of the present invention but not for limitation.

实施例1Example 1

结合图1所示,本实施例提供了一种图像监控调整系统,其用于分别实现2个相邻相机的拍摄角度的调整,其包括:As shown in FIG. 1 , this embodiment provides an image monitoring and adjustment system, which is used to adjust the shooting angles of two adjacent cameras, which includes:

点云数据库,其用于存储施工现场的空间点云数据Point cloud database, which is used to store spatial point cloud data on construction sites ;

三维点云生成单元,其用于自空间点云数据中获取所述2个相邻相机的重叠区域的空间点云数据/>,并分别将空间点云数据/>变换至所述2个相邻相机的坐标系中,以获取分别对应所述2个相邻相机的三维点云/>和三维点云/>3D point cloud generation unit for self-space point cloud data Obtain the spatial point cloud data of the overlapping area of the two adjacent cameras/> , and respectively convert the spatial point cloud data/> Transform into the coordinate systems of the two adjacent cameras to obtain three-dimensional point clouds corresponding to the two adjacent cameras/> and 3D point cloud/> ;

旋转矩阵计算单元,其用于基于所述2个相邻相机的初始旋转矩阵为、内参矩阵为/>、初始旋转矩阵为/>和内参矩阵为/>,获取所述2个相邻相机的目标旋转矩阵为/>和目标旋转矩阵为/>A rotation matrix calculation unit, which is used to calculate the initial rotation matrix based on the two adjacent cameras as , the internal parameter matrix is/> , the initial rotation matrix is/> and the internal parameter matrix is/> , obtaining the target rotation matrix of the two adjacent cameras is/> and the target rotation matrix is/> ;

其中,in,

,

;

其中,坐标点为三维点云/>中的任一点,坐标点/>为三维点云/>中的任一点;Among them, the coordinate point For 3D point cloud/> Any point in , coordinate point/> For 3D point cloud/> any point in;

目标旋转矩阵为、初始旋转矩阵为/>、内参矩阵为/>和三维点云/>,对应所述2个相邻相机的其一;The target rotation matrix is , the initial rotation matrix is/> , the internal parameter matrix is/> and 3D point cloud/> , corresponding to one of the two adjacent cameras;

目标旋转矩阵为、初始旋转矩阵为/>、内参矩阵为/>和三维点云/>,对应所述2个相邻相机的另一;The target rotation matrix is , the initial rotation matrix is/> , the internal parameter matrix is/> and 3D point cloud/> , corresponding to the other of the two adjacent cameras;

以及角度调节单元,其以作为航向角并以/>作为俯仰角对所述2个相邻相机的所述其一的角度进行调整,以/>作为航向角并以/>作为俯仰角对应所述2个相邻相机的所述另一的角度进行调整。and an angle adjustment unit, which features as heading angle and /> The angle of one of the two adjacent cameras is adjusted as the pitch angle to/> as heading angle and /> The pitch angle is adjusted corresponding to the other angle of the two adjacent cameras.

通过上述,能够首先基于施工现场的空间点云数据以及所需部署的相机总数以及每个相机的拍摄范围,对所有相机的安装点位进行预估,进而获取任意两两相邻相机的大概安装位置;而后,在将所有相机安装至所预估的安装点位后,将不再需要对其进行严格的角度调整,而是只需要结合实际的安装位置对任意两两相邻相机的重叠区域进行划分获取,即可基于所需得到的重叠区域实现每个相机实际所需的空间角度的获取,进而实现每个相机角度的自动调整。Through the above, we can first use the spatial point cloud data of the construction site to As well as the total number of cameras to be deployed and the shooting range of each camera, estimate the installation points of all cameras, and then obtain the approximate installation positions of any two adjacent cameras; then, install all cameras to the estimated After the installation point is determined, there is no need to strictly adjust the angle. Instead, you only need to divide and obtain the overlapping area of any two adjacent cameras based on the actual installation position, and then you can obtain the overlapping area based on the desired Realize the acquisition of the actual spatial angle required by each camera, and then realize the automatic adjustment of each camera angle.

基于此种手段,能够有效地实现每个相机拍摄角度的较精准调节,从而能够较佳地基于预想的所需拍摄覆盖率,实现最大实际监控覆盖率的获取。同时,由于本发明的系统是基于相邻2个相机间的重叠区域应该保持不变的思路,实现单个相机的拍摄角度的调整,故在任一相机的位置发生变化时,能够基于预设的固定的应有的重叠区域,实现任一相机的拍摄角度的自适应调节;此能够为下一步的如图像识别检测等,提供更为稳定的原始图像。Based on this method, the shooting angle of each camera can be effectively adjusted more accurately, so that the maximum actual monitoring coverage can be obtained based on the expected required shooting coverage. At the same time, because the system of the present invention is based on the idea that the overlapping area between two adjacent cameras should remain unchanged, it realizes the adjustment of the shooting angle of a single camera. Therefore, when the position of any camera changes, it can be based on the preset fixed The due overlap area enables adaptive adjustment of the shooting angle of any camera; this can provide a more stable original image for the next step, such as image recognition and detection.

本实施例中,航向角对应的是水平方向的偏移量,俯仰角对应的是竖直方向的偏移量。In this embodiment, the heading angle corresponds to the offset in the horizontal direction, and the pitch angle corresponds to the offset in the vertical direction.

可以理解的是,本实施例中,任意两两相邻相机的重叠区域的分割,能够以盲区最小(即覆盖率最高)作为优化目标,并采用现有的优化算法计算获取。此不涉及本发明的改进点,本实施例中不予过多描述。It can be understood that in this embodiment, the segmentation of the overlapping areas of any two adjacent cameras can be performed with the smallest blind area (that is, the highest coverage) as the optimization goal, and can be calculated and obtained using existing optimization algorithms. This does not involve improvements of the present invention, and will not be described in detail in this embodiment.

本实施例中,所述2个相邻相机在安装完毕后,通过标定获取初始旋转矩阵为、内参矩阵为/>、初始旋转矩阵为/>和内参矩阵为/>In this embodiment, after the two adjacent cameras are installed, the initial rotation matrix is obtained through calibration as , the internal parameter matrix is/> , the initial rotation matrix is/> and the internal parameter matrix is/> ;

其中,in,

.

通过上述,能够较佳地在相机首次安装完成后,通过诸如棋盘格等标定方法即可实现对每个相机的相关参数矩阵的较便捷获取,从而不再需要对任一相机的安装位置有所要求。可以理解的是,下述的相机坐标系与世界坐标系的转换矩阵,也能够通过标定一并获取。Through the above, after the camera is installed for the first time, the relevant parameter matrix of each camera can be obtained more conveniently through calibration methods such as checkerboard, so that there is no need to know the installation position of any camera. Require. It can be understood that the following transformation matrix between the camera coordinate system and the world coordinate system can also be obtained through calibration.

本实施例中,三维点云生成单元通过分别获取所述2个相邻相机各自的相机坐标系与空间点云数据所在的世界坐标系的转换矩阵,实现三维点云/>和三维点云/>的获取。故而能够较佳地实现三维点云/>和三维点云/>的获取。In this embodiment, the three-dimensional point cloud generation unit obtains the camera coordinate system and spatial point cloud data of each of the two adjacent cameras. The transformation matrix of the world coordinate system to realize the three-dimensional point cloud/> and 3D point cloud/> of acquisition. Therefore, the three-dimensional point cloud can be better realized/> and 3D point cloud/> of acquisition.

本实施例中,旋转矩阵计算单元在计算目标旋转矩阵为和目标旋转矩阵为/>时,坐标点/>采用三维点云/>的重心;In this embodiment, the rotation matrix calculation unit calculates the target rotation matrix as and the target rotation matrix is/> When, coordinate point/> Using 3D point cloud/> center of gravity;

其中,in,

,

,

;

其中,M为三维点云中的坐标点总数,/>为三维点云/>中第m个点的坐标。Among them, M is the three-dimensional point cloud The total number of coordinate points in ,/> For 3D point cloud/> The coordinates of the m-th point in .

通过基于重心计算旋转矩阵,故而能够较佳地提升精度。By calculating the rotation matrix based on the center of gravity, the accuracy can be improved better.

本实施例中,旋转矩阵计算单元在计算目标旋转矩阵为和目标旋转矩阵为/>时,坐标点/>采用三维点云/>的重心;In this embodiment, the rotation matrix calculation unit calculates the target rotation matrix as and the target rotation matrix is/> When, coordinate point/> Using 3D point cloud/> center of gravity;

其中,in,

,

,

;

其中,N为三维点云中的坐标点总数,/>为三维点云/>中第n个点的坐标。Among them, N is the three-dimensional point cloud The total number of coordinate points in ,/> For 3D point cloud/> The coordinates of the nth point in .

通过基于重心计算旋转矩阵,故而能够较佳地提升精度。By calculating the rotation matrix based on the center of gravity, the accuracy can be improved better.

本实施例中,角度调节单元包括相机云台,所述2个相邻相机分别通过对应的相机云台设置于安装点处。故而能够较佳地实现对监控设备的自动调整。In this embodiment, the angle adjustment unit includes a camera pan/tilt, and the two adjacent cameras are respectively installed at the installation points through corresponding camera pan/tilts. Therefore, automatic adjustment of the monitoring equipment can be better realized.

本实施例中,在任一相机与多个相机间均存在重叠区域时,旋转矩阵计算单元分别获取基于两两相邻的相应重叠区域获取该任一相机的多个旋转矩阵,并以该多个旋转矩阵的均值作为最终的目标旋转矩阵。故而能够较佳地提升调整精度。In this embodiment, when there are overlapping areas between any camera and multiple cameras, the rotation matrix calculation unit obtains multiple rotation matrices of any camera based on corresponding overlapping areas that are adjacent to each other, and uses the multiple rotation matrices The mean value of the rotation matrix is used as the final target rotation matrix. Therefore, the adjustment accuracy can be better improved.

实施例2Example 2

本实施例提供了一种线路施工模型,其具有输电线路点云建立单元及实施例1中所述的图像监控调整系统,输电线路点云建立单元用于实现空间点云数据的获取及更新。This embodiment provides a line construction model, which has a transmission line point cloud creation unit and the image monitoring and adjustment system described in Embodiment 1. The transmission line point cloud creation unit is used to realize spatial point cloud data. Obtain and update.

通过本实施例的线路施工模型,能够较佳地实现输电线路点云数据的获取,并能够基于所获取的输电线路点云数据,实现对施工现场的监控系统部署的指引,尤其是能够较佳地实现单个相机的拍摄角度的自动调整。Through the line construction model of this embodiment, the point cloud data of the transmission line can be better obtained, and based on the obtained point cloud data of the transmission line, guidance on the deployment of the monitoring system at the construction site can be achieved, especially the point cloud data of the transmission line can be better obtained. Automatically adjust the shooting angle of a single camera.

本实施例中,输电线路点云建立单元包括无人机,空间点云数据通过无人机航拍获取。故而能够较佳地实现空间点云数据/>的获取。In this embodiment, the transmission line point cloud creation unit includes a drone, and the spatial point cloud data Obtained through drone aerial photography. Therefore, spatial point cloud data can be better realized/> of acquisition.

以上示意性的对本发明及其实施方式进行了描述,该描述没有限制性,附图中所示的也只是本发明的实施方式之一,实际的结构并不局限于此。所以,如果本领域的普通技术人员受其启示,在不脱离本发明创造宗旨的情况下,不经创造性的设计出与该技术方案相似的结构方式及实施例,均应属于本发明的保护范围。The present invention and its embodiments are schematically described above. This description is not limiting. What is shown in the drawings is only one embodiment of the present invention, and the actual structure is not limited thereto. Therefore, if a person of ordinary skill in the art is inspired by the invention and without departing from the spirit of the invention, can devise structural methods and embodiments similar to the technical solution without inventiveness, they shall all fall within the protection scope of the invention. .

Claims (7)

1.图像监控调整系统,其用于分别实现2个相邻相机的拍摄角度的调整,其特征在于,包括:1. Image monitoring and adjustment system, which is used to adjust the shooting angles of two adjacent cameras, and is characterized by: 点云数据库,其用于存储施工现场的空间点云数据 Point cloud database, which is used to store spatial point cloud data on construction sites ; 三维点云生成单元,其用于自空间点云数据中获取所述2个相邻相机的重叠区域的空间点云数据/>,并分别将空间点云数据/>变换至所述2个相邻相机的坐标系中,以获取分别对应所述2个相邻相机的三维点云/>和三维点云/>3D point cloud generation unit for self-space point cloud data Obtain the spatial point cloud data of the overlapping area of the two adjacent cameras/> , and respectively convert the spatial point cloud data/> Transform into the coordinate systems of the two adjacent cameras to obtain three-dimensional point clouds corresponding to the two adjacent cameras/> and 3D point cloud/> ; 旋转矩阵计算单元,其用于基于所述2个相邻相机的初始旋转矩阵为、内参矩阵为/>、初始旋转矩阵为/>和内参矩阵为/>,获取所述2个相邻相机的目标旋转矩阵为/>和目标旋转矩阵为/>A rotation matrix calculation unit, which is used to calculate the initial rotation matrix based on the two adjacent cameras as , the internal parameter matrix is/> , the initial rotation matrix is/> and the internal parameter matrix is/> , obtaining the target rotation matrix of the two adjacent cameras is/> and the target rotation matrix is/> ; 其中,in, , ; 其中,坐标点为三维点云/>中的任一点,坐标点/>为三维点云/>中的任一点;Among them, the coordinate point For 3D point cloud/> Any point in , coordinate point/> For 3D point cloud/> any point in; 目标旋转矩阵为、初始旋转矩阵为/>、内参矩阵为/>和三维点云/>,对应所述2个相邻相机的其一;The target rotation matrix is , the initial rotation matrix is/> , the internal parameter matrix is/> and 3D point cloud/> , corresponding to one of the two adjacent cameras; 目标旋转矩阵为、初始旋转矩阵为/>、内参矩阵为/>和三维点云/>,对应所述2个相邻相机的另一;The target rotation matrix is , the initial rotation matrix is/> , the internal parameter matrix is/> and 3D point cloud/> , corresponding to the other of the two adjacent cameras; 以及角度调节单元,其以作为航向角并以/>作为俯仰角对所述2个相邻相机的所述其一的角度进行调整,以/>作为航向角并以/>作为俯仰角对应所述2个相邻相机的所述另一的角度进行调整;and an angle adjustment unit, which features as heading angle and /> The angle of one of the two adjacent cameras is adjusted as the pitch angle to/> as heading angle and /> The pitch angle is adjusted corresponding to the other angle of the two adjacent cameras; 所述2个相邻相机在安装完毕后,通过标定获取初始旋转矩阵为、内参矩阵为/>、初始旋转矩阵为/>和内参矩阵为/>After the two adjacent cameras are installed, the initial rotation matrix is obtained through calibration as , the internal parameter matrix is/> , the initial rotation matrix is/> and the internal parameter matrix is/> ; 其中,in, ; 在任一相机与多个相机间均存在重叠区域时,旋转矩阵计算单元分别获取基于两两相邻的相应重叠区域获取该任一相机的多个旋转矩阵,并以该多个旋转矩阵的均值作为最终的目标旋转矩阵。When there are overlapping areas between any camera and multiple cameras, the rotation matrix calculation unit obtains multiple rotation matrices of any camera based on the corresponding overlapping areas adjacent to each other, and uses the mean of the multiple rotation matrices as The final target rotation matrix. 2.根据权利要求1所述的图像监控调整系统,其特征在于:三维点云生成单元通过分别获取所述2个相邻相机各自的相机坐标系与空间点云数据所在的世界坐标系的转换矩阵,实现三维点云/>和三维点云/>的获取。2. The image monitoring and adjustment system according to claim 1, characterized in that: the three-dimensional point cloud generation unit obtains the camera coordinate system and spatial point cloud data of each of the two adjacent cameras. The transformation matrix of the world coordinate system to realize the three-dimensional point cloud/> and 3D point cloud/> of acquisition. 3.根据权利要求1所述的图像监控调整系统,其特征在于:旋转矩阵计算单元在计算目标旋转矩阵为和目标旋转矩阵为/>时,坐标点/>采用三维点云/>的重心;3. The image monitoring and adjustment system according to claim 1, characterized in that: the rotation matrix calculation unit calculates the target rotation matrix as and the target rotation matrix is/> When, coordinate point/> Using 3D point cloud/> center of gravity; 其中,in, , , ; 其中,M为三维点云中的坐标点总数,/>为三维点云/>中第m个点的坐标。Among them, M is the three-dimensional point cloud The total number of coordinate points in ,/> For 3D point cloud/> The coordinates of the m-th point in . 4.根据权利要求1或3所述的图像监控调整系统,其特征在于:旋转矩阵计算单元在计算目标旋转矩阵为和目标旋转矩阵为/>时,坐标点/>采用三维点云/>的重心;4. The image monitoring and adjustment system according to claim 1 or 3, characterized in that: the rotation matrix calculation unit calculates the target rotation matrix as and the target rotation matrix is/> When, coordinate point/> Using 3D point cloud/> center of gravity; 其中,in, , , ; 其中,N为三维点云中的坐标点总数,/>为三维点云/>中第n个点的坐标。Among them, N is the three-dimensional point cloud The total number of coordinate points in ,/> For 3D point cloud/> The coordinates of the nth point in . 5.根据权利要求1所述的图像监控调整系统,其特征在于:角度调节单元包括相机云台,所述2个相邻相机分别通过对应的相机云台设置于安装点处。5. The image monitoring and adjustment system according to claim 1, wherein the angle adjustment unit includes a camera pan/tilt, and the two adjacent cameras are respectively installed at the installation points through corresponding camera pan/tilts. 6.根据权利要求1所述的图像监控调整系统,其特征在于:空间点云数据的获取及更新通过一输电线路点云建立单元实现。6. The image monitoring and adjustment system according to claim 1, characterized in that: spatial point cloud data The acquisition and update are realized through a transmission line point cloud creation unit. 7.根据权利要求6所述的图像监控调整系统,其特征在于:输电线路点云建立单元包括无人机,空间点云数据通过无人机航拍获取。7. The image monitoring and adjustment system according to claim 6, characterized in that: the transmission line point cloud establishment unit includes a drone, and the spatial point cloud data Obtained through drone aerial photography.
CN202311205474.5A 2023-09-19 2023-09-19 Image monitoring and adjustment system and line construction model Active CN116962649B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311205474.5A CN116962649B (en) 2023-09-19 2023-09-19 Image monitoring and adjustment system and line construction model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311205474.5A CN116962649B (en) 2023-09-19 2023-09-19 Image monitoring and adjustment system and line construction model

Publications (2)

Publication Number Publication Date
CN116962649A CN116962649A (en) 2023-10-27
CN116962649B true CN116962649B (en) 2024-01-09

Family

ID=88447685

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311205474.5A Active CN116962649B (en) 2023-09-19 2023-09-19 Image monitoring and adjustment system and line construction model

Country Status (1)

Country Link
CN (1) CN116962649B (en)

Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101404725A (en) * 2008-11-24 2009-04-08 深圳华为通信技术有限公司 Camera, camera set, its control method, apparatus and system
CN101527828A (en) * 2009-04-14 2009-09-09 深圳华为通信技术有限公司 Image acquisition equipment
CN101825444A (en) * 2010-04-09 2010-09-08 上海辉格科技发展有限公司 Vehicle-mounted road spectrum testing system based on surface structured light
CN103337094A (en) * 2013-06-14 2013-10-02 西安工业大学 Method for realizing three-dimensional reconstruction of movement by using binocular camera
FR3023910A1 (en) * 2014-07-16 2016-01-22 Cie Maritime D Expertises IMAGE RECORDING SYSTEM FOR REAL-TIME ODOMETRY AND THE PRODUCTION OF A THREE-DIMENSIONAL MODEL
JP2016181148A (en) * 2015-03-24 2016-10-13 日本原子力防護システム株式会社 Virtual monitoring image creation system, information setting system, and simulation system
CN106851190A (en) * 2015-12-04 2017-06-13 国网陕西省电力公司渭南供电公司 A kind of low-power consumption electric power facility visualization of 3 d monitoring technology
CN106954012A (en) * 2017-03-29 2017-07-14 武汉嫦娥医学抗衰机器人股份有限公司 A kind of high definition polyphaser full-view stereo imaging system and method
CN108171758A (en) * 2018-01-16 2018-06-15 重庆邮电大学 Polyphaser scaling method based on minimum time principle and transparent glass scaling board
CN207976923U (en) * 2018-01-12 2018-10-16 东莞前沿技术研究院 It is a kind of based on the three-dimensional modeling apparatus for being tethered at aerostatics
CN110223354A (en) * 2019-04-30 2019-09-10 惠州市德赛西威汽车电子股份有限公司 A kind of Camera Self-Calibration method based on SFM three-dimensional reconstruction
KR102033570B1 (en) * 2019-07-16 2019-10-17 한국교통대학교산학협력단 A Camera System For Remote Safety Management of Construction Site
CN111741255A (en) * 2020-05-14 2020-10-02 中国电力工程顾问集团西南电力设计院有限公司 Method for adjusting position of camera based on three-dimensional scene of power transmission line
CN112396663A (en) * 2020-11-17 2021-02-23 广东电科院能源技术有限责任公司 Visual calibration method, device, equipment and medium for multi-depth camera
CN112907676A (en) * 2019-11-19 2021-06-04 浙江商汤科技开发有限公司 Calibration method, device and system of sensor, vehicle, equipment and storage medium
KR102405647B1 (en) * 2022-03-15 2022-06-08 헬리오센 주식회사 Space function system using 3-dimensional point cloud data and mesh data
CN114637026A (en) * 2022-03-18 2022-06-17 福建和盛高科技产业有限公司 A method for online monitoring and intelligent inspection of transmission lines based on three-dimensional simulation technology
CN114723271A (en) * 2022-03-31 2022-07-08 国网山东省电力公司经济技术研究院 Power transmission project quality detection method and system based on image recognition
CN115002353A (en) * 2022-06-30 2022-09-02 天翼数字生活科技有限公司 Camera scheduling method and system under video monitoring cooperative coverage scene
CN115205466A (en) * 2022-07-25 2022-10-18 江苏濠汉信息技术有限公司 Structured light-based three-dimensional reconstruction method and system for power transmission channel
WO2022222121A1 (en) * 2021-04-23 2022-10-27 华为技术有限公司 Panoramic image generation method, vehicle-mounted image processing apparatus, and vehicle
CN116188591A (en) * 2022-12-28 2023-05-30 合肥工业大学 Multi-camera global calibration method and device and electronic equipment
CN116310891A (en) * 2023-02-16 2023-06-23 云南电力试验研究院(集团)有限公司 Cloud-edge cooperative transmission line defect intelligent detection system and method
CN116337101A (en) * 2023-03-29 2023-06-27 博雷顿科技股份公司 Unmanned environment sensing and navigation system based on digital twin technology
CN116433573A (en) * 2022-12-31 2023-07-14 中国民航大学 Aircraft Surface Ice Detection Method, Reconstruction System and Equipment Using Light Field Speckle Imaging

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SG10201505251XA (en) * 2015-07-02 2017-02-27 Nec Asia Pacific Pte Ltd Surveillance System With Fixed Camera And Temporary Cameras
US9947111B2 (en) * 2015-10-28 2018-04-17 Sony Corporation Method of multiple camera positioning utilizing camera ordering
CN105678748B (en) * 2015-12-30 2019-01-15 清华大学 Interactive calibration method and device in three-dimension monitoring system based on three-dimensionalreconstruction
US10628967B2 (en) * 2017-12-21 2020-04-21 Facebook, Inc. Calibration for multi-camera systems
US20230133685A1 (en) * 2021-10-29 2023-05-04 Hewlett-Packard Development Company, L.P. Camera systems for tracking target objects

Patent Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101404725A (en) * 2008-11-24 2009-04-08 深圳华为通信技术有限公司 Camera, camera set, its control method, apparatus and system
CN101527828A (en) * 2009-04-14 2009-09-09 深圳华为通信技术有限公司 Image acquisition equipment
CN101825444A (en) * 2010-04-09 2010-09-08 上海辉格科技发展有限公司 Vehicle-mounted road spectrum testing system based on surface structured light
CN103337094A (en) * 2013-06-14 2013-10-02 西安工业大学 Method for realizing three-dimensional reconstruction of movement by using binocular camera
FR3023910A1 (en) * 2014-07-16 2016-01-22 Cie Maritime D Expertises IMAGE RECORDING SYSTEM FOR REAL-TIME ODOMETRY AND THE PRODUCTION OF A THREE-DIMENSIONAL MODEL
JP2016181148A (en) * 2015-03-24 2016-10-13 日本原子力防護システム株式会社 Virtual monitoring image creation system, information setting system, and simulation system
CN106851190A (en) * 2015-12-04 2017-06-13 国网陕西省电力公司渭南供电公司 A kind of low-power consumption electric power facility visualization of 3 d monitoring technology
CN106954012A (en) * 2017-03-29 2017-07-14 武汉嫦娥医学抗衰机器人股份有限公司 A kind of high definition polyphaser full-view stereo imaging system and method
CN207976923U (en) * 2018-01-12 2018-10-16 东莞前沿技术研究院 It is a kind of based on the three-dimensional modeling apparatus for being tethered at aerostatics
CN108171758A (en) * 2018-01-16 2018-06-15 重庆邮电大学 Polyphaser scaling method based on minimum time principle and transparent glass scaling board
CN110223354A (en) * 2019-04-30 2019-09-10 惠州市德赛西威汽车电子股份有限公司 A kind of Camera Self-Calibration method based on SFM three-dimensional reconstruction
KR102033570B1 (en) * 2019-07-16 2019-10-17 한국교통대학교산학협력단 A Camera System For Remote Safety Management of Construction Site
CN112907676A (en) * 2019-11-19 2021-06-04 浙江商汤科技开发有限公司 Calibration method, device and system of sensor, vehicle, equipment and storage medium
CN111741255A (en) * 2020-05-14 2020-10-02 中国电力工程顾问集团西南电力设计院有限公司 Method for adjusting position of camera based on three-dimensional scene of power transmission line
CN112396663A (en) * 2020-11-17 2021-02-23 广东电科院能源技术有限责任公司 Visual calibration method, device, equipment and medium for multi-depth camera
WO2022222121A1 (en) * 2021-04-23 2022-10-27 华为技术有限公司 Panoramic image generation method, vehicle-mounted image processing apparatus, and vehicle
KR102405647B1 (en) * 2022-03-15 2022-06-08 헬리오센 주식회사 Space function system using 3-dimensional point cloud data and mesh data
CN114637026A (en) * 2022-03-18 2022-06-17 福建和盛高科技产业有限公司 A method for online monitoring and intelligent inspection of transmission lines based on three-dimensional simulation technology
CN114723271A (en) * 2022-03-31 2022-07-08 国网山东省电力公司经济技术研究院 Power transmission project quality detection method and system based on image recognition
CN115002353A (en) * 2022-06-30 2022-09-02 天翼数字生活科技有限公司 Camera scheduling method and system under video monitoring cooperative coverage scene
CN115205466A (en) * 2022-07-25 2022-10-18 江苏濠汉信息技术有限公司 Structured light-based three-dimensional reconstruction method and system for power transmission channel
CN116188591A (en) * 2022-12-28 2023-05-30 合肥工业大学 Multi-camera global calibration method and device and electronic equipment
CN116433573A (en) * 2022-12-31 2023-07-14 中国民航大学 Aircraft Surface Ice Detection Method, Reconstruction System and Equipment Using Light Field Speckle Imaging
CN116310891A (en) * 2023-02-16 2023-06-23 云南电力试验研究院(集团)有限公司 Cloud-edge cooperative transmission line defect intelligent detection system and method
CN116337101A (en) * 2023-03-29 2023-06-27 博雷顿科技股份公司 Unmanned environment sensing and navigation system based on digital twin technology

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于三维点云分析的智能汽车目标检测方法研究;胡方超;中国博士学位论文全文数据库(电子期刊);全文 *

Also Published As

Publication number Publication date
CN116962649A (en) 2023-10-27

Similar Documents

Publication Publication Date Title
US11863857B2 (en) Photographing control method, apparatus, and control device
KR102007567B1 (en) Stereo drone and method and system for calculating earth volume in non-control points using the same
CN113887641B (en) A method, device and medium for determining hidden danger targets based on power transmission channels
CN105120242B (en) A kind of panoramic camera and high-speed ball-forming machine intelligent linkage method and device
US11073830B2 (en) System and method for mission planning and flight automation for unmanned aircraft
US8189962B2 (en) Image processing apparatus
TW201328344A (en) System and method for controlling a unmanned aerial vehicle to capture images of a target location
CN103578109A (en) Method and device for monitoring camera distance measurement
CN113309674B (en) Method and device for determining clearance distance of wind generating set
CN106603900A (en) Control system and method of Pan/Tilt/Zoom (PTZ) camera
KR101771492B1 (en) Method and system for mapping using UAV and multi-sensor
CN111123962A (en) Rotor unmanned aerial vehicle repositioning photographing method for power tower inspection
JP2006304342A (en) Detection area adjustment device
CN106973221A (en) Unmanned plane image capture method and system based on aesthetic evaluation
CN111246174A (en) Video-based remote tower intelligent telescope implementation method and system
WO2005076620A1 (en) Detection range adjustment device
CN114018244A (en) Target tracking route generation method based on unmanned aerial vehicle photoelectric platform
CN116962649B (en) Image monitoring and adjustment system and line construction model
CN108347577A (en) A kind of imaging system and method
JP2024084136A (en) Method and system for estimating CCTV camera attitude and object coordinates based on precise road map
CN116782034A (en) Visual auxiliary shooting method and device for power distribution network target objects and storage medium
CN120182918B (en) Dynamic area matching and strategy automatic association method based on camera PTZ value
CN112947570A (en) Unmanned aerial vehicle obstacle avoidance method and device and storage medium
CN120451325B (en) A UAV-based mapping method
CN118918177B (en) Tethered unmanned aerial vehicle visual positioning method, tethered unmanned aerial vehicle visual positioning system, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant