[go: up one dir, main page]

CN116473674A - Surgical navigation system and surgical navigation method - Google Patents

Surgical navigation system and surgical navigation method Download PDF

Info

Publication number
CN116473674A
CN116473674A CN202310363723.7A CN202310363723A CN116473674A CN 116473674 A CN116473674 A CN 116473674A CN 202310363723 A CN202310363723 A CN 202310363723A CN 116473674 A CN116473674 A CN 116473674A
Authority
CN
China
Prior art keywords
coordinates
calibration body
calibration
cloud server
probe
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310363723.7A
Other languages
Chinese (zh)
Inventor
李严
戈保仓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hebei Ruihe Medical Devices Co ltd
Original Assignee
Hebei Ruihe Medical Devices Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hebei Ruihe Medical Devices Co ltd filed Critical Hebei Ruihe Medical Devices Co ltd
Priority to CN202310363723.7A priority Critical patent/CN116473674A/en
Publication of CN116473674A publication Critical patent/CN116473674A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25User interfaces for surgical systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2055Optical tracking systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2055Optical tracking systems
    • A61B2034/2057Details of tracking cameras
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2068Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis using pointers, e.g. pointers having reference marks for determining coordinates of body points
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25User interfaces for surgical systems
    • A61B2034/252User interfaces for surgical systems indicating steps of a surgical procedure

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Robotics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Human Computer Interaction (AREA)
  • Image Processing (AREA)

Abstract

The invention provides a surgical navigation system and a surgical navigation method. The surgical navigation system includes: the cloud server is in communication connection with the display screen and is used for sending a processing command to the display screen according to a preset processing flow; the calibration body is fixed at a first preset position of a patient through fixing equipment, and is an optical calibration body; the binocular camera is arranged in a preset distance range from the calibration body, is in communication connection with the cloud server, is used for collecting images of the calibration body in real time, calculates coordinates of the calibration body according to the images of the calibration body, and sends the coordinates to the display screen and the cloud server; the cloud server is also used for receiving the coordinates of the calibration body, performing data processing according to the coordinates of the real-time calibration body, and sending the data processing result to the display screen to assist doctors in operation; and the display screen is used for displaying the position of the coordinates of the calibration body, the processing flow corresponding to the processing command and the data processing result. The invention can reduce the equipment cost and improve the treatment efficiency.

Description

手术导航系统及手术导航的方法Surgical navigation system and method for surgical navigation

技术领域technical field

本发明涉及医疗技术领域,尤其涉及一种手术导航系统及手术导航的方法。The invention relates to the field of medical technology, in particular to a surgical navigation system and a surgical navigation method.

背景技术Background technique

近年来,截骨、骨矫形手术时一般采用一台整机设备进行导航,协助医生进行手术,这台整机设备上设置一个专业的高精度摄像头、主机服务器和显示屏,高精度摄像头用来拍摄手术过程中的实时场景,主机服务器,用来接收高精度摄像头拍摄的影像,并根据预存的患者的CT影片进行三维模型重建,重建的影像在显示屏上进行显示,医生可以通过查看显示屏上的影像,定位患处进行处理。In recent years, during osteotomy and orthopedic surgery, a complete device is generally used for navigation and to assist doctors in the operation. This complete device is equipped with a professional high-precision camera, a host server and a display screen. The high-precision camera is used to capture real-time scenes during the operation, and the host server is used to receive the images captured by the high-precision camera and reconstruct the 3D model based on the pre-stored patient's CT film. The reconstructed image is displayed on the display screen.

然而,现有技术中的整机设备协助医生进行处理时,需要对影像进行三维模型重建,图像处理导致处理速度较低,效率慢,另外整机设备上设置的高精度摄像头成本高。However, when the complete device in the prior art assists the doctor in processing, it needs to reconstruct the 3D model of the image. Image processing results in low processing speed and low efficiency. In addition, the cost of the high-precision camera installed on the complete device is high.

发明内容Contents of the invention

本发明实施例提供了一种手术导航系统及手术导航的方法,以解决现有技术中整机设备成本高且图像处理效率慢的问题。Embodiments of the present invention provide a surgical navigation system and a surgical navigation method to solve the problems of high equipment cost and slow image processing efficiency in the prior art.

第一方面,本发明实施例提供了一种手术导航系统,包括:云服务器、显示屏、标定体、固定设备和双目摄像头;In the first aspect, an embodiment of the present invention provides a surgical navigation system, including: a cloud server, a display screen, a calibration body, a fixing device, and a binocular camera;

所述云服务器与所述显示屏通讯连接,用于根据预设处理流程向所述显示屏发送处理命令,以便医生根据所述显示屏显示的所述处理命令对应的处理流程进行操作;The cloud server communicates with the display screen, and is used to send a processing command to the display screen according to a preset processing flow, so that the doctor can operate according to the processing flow corresponding to the processing command displayed on the display screen;

所述标定体通过所述固定设备固定在患者的第一预设位置,所述标定体为光学标定体;The calibration body is fixed at a first preset position of the patient by the fixing device, and the calibration body is an optical calibration body;

所述双目摄像头设置在距离所述标定体的预设距离范围内,并与所述云服务器建立通讯连接,用于实时采集所述标定体的影像,并根据所述标定体的影像计算得到所述标定体的坐标,将所述标定体的坐标发送给所述显示屏和所述云服务器;The binocular camera is set within a preset distance from the calibration body, and establishes a communication connection with the cloud server for real-time collection of the image of the calibration body, and calculates the coordinates of the calibration body according to the image of the calibration body, and sends the coordinates of the calibration body to the display screen and the cloud server;

所述云服务器,还用于接收所述标定体的坐标,并根据所述标定体的坐标进行数据处理,将数据处理结果发送给所述显示屏,协助医生操作;The cloud server is also used to receive the coordinates of the calibration body, perform data processing according to the coordinates of the calibration body, and send the data processing results to the display screen to assist doctors in operation;

所述显示屏,用于显示所述标定体的坐标的位置、所述处理命令对应的处理流程以及数据处理结果。The display screen is used to display the coordinate position of the calibration body, the processing flow corresponding to the processing command, and the data processing result.

在一种可能的实现方式中,所述显示屏为一透明镜片,所述透明镜片设置在眼镜框架上。In a possible implementation manner, the display screen is a transparent lens, and the transparent lens is arranged on a spectacle frame.

在一种可能的实现方式中,所述双目摄像头分别吸附在所述眼镜框架的左右镜框上。In a possible implementation manner, the binocular cameras are respectively attached to the left and right frames of the spectacle frame.

在一种可能的实现方式中,还包括:探针;In a possible implementation manner, it also includes: a probe;

所述探针上设置预设数量的光学标定球,用于对患者的第二预设位置进行标定;所述第二预设位置为所述第一预设位置的预设范围内的位置;A preset number of optical calibration balls are set on the probe to calibrate the second preset position of the patient; the second preset position is a position within a preset range of the first preset position;

所述双目摄像头用于采集所述探针和所述标定体的影像,并根据所述探针和所述标定体的影像计算得到所述探针的坐标和所述标定体的坐标,将所述探针的坐标和所述标定体的坐标发送给所述显示屏和所述云服务器。The binocular camera is used to collect the images of the probe and the calibration body, and calculate the coordinates of the probe and the coordinates of the calibration body according to the images of the probe and the calibration body, and send the coordinates of the probe and the coordinates of the calibration body to the display screen and the cloud server.

在一种可能的实现方式中,所述标定体的数量为两个及以上;In a possible implementation manner, the number of the calibration bodies is two or more;

所述标定体上包括至少三个光学标定球,且至少三个光学标定球不在同一条直线上;The calibration body includes at least three optical calibration balls, and at least three optical calibration balls are not on the same straight line;

所述探针上包括至少三个光学标定球,且至少三个光学标定球的高度不同。The probe includes at least three optical calibration balls, and the heights of the at least three optical calibration balls are different.

第二方面,本发明实施例提供了一种手术导航的装置,包括:采用上述任一项可能的实现方式中所述的手术导航系统,所述手术导航的方法包括:In a second aspect, an embodiment of the present invention provides a surgical navigation device, including: using the surgical navigation system described in any of the above possible implementation manners, the surgical navigation method includes:

云服务器向显示屏发送处理命令,以便所述显示屏显示所述处理命令对应的处理流程,医生根据所述处理流程进行操作,所述处理命令为根据预设处理流程生成的命令;The cloud server sends a processing command to the display screen, so that the display screen displays the processing flow corresponding to the processing command, and the doctor operates according to the processing flow, and the processing command is an order generated according to a preset processing flow;

双目摄像头实时拍摄标定体的影像,计算得到标定体的坐标,并将所述标定体的坐标发送给所述云服务器;The binocular camera captures the image of the calibration body in real time, calculates the coordinates of the calibration body, and sends the coordinates of the calibration body to the cloud server;

所述云服务器根据所述标定体的坐标进行数据处理,并将数据处理结果发送给显示屏,以便医生进行数据参考,协助医生操作。The cloud server performs data processing according to the coordinates of the calibration body, and sends the data processing result to the display screen, so that the doctor can refer to the data and assist the doctor in operation.

在一种可能的实现方式中,还包括:In a possible implementation, it also includes:

所述双目摄像头实时拍摄包括探针和标定体的影像,计算得到所述探针的坐标和所述标定体的坐标,并将所述探针的坐标和标定体的坐标发送给所述云服务器;The binocular camera shoots images including the probe and the calibration body in real time, calculates the coordinates of the probe and the coordinates of the calibration body, and sends the coordinates of the probe and the calibration body to the cloud server;

所述云服务器根据所述标定体的坐标进行数据处理,包括:The cloud server performs data processing according to the coordinates of the calibration body, including:

所述云服务器根据所述探针的坐标和所述标定体的坐标进行数据处理。The cloud server performs data processing according to the coordinates of the probe and the coordinates of the calibration body.

在一种可能的实现方式中,所述双目摄像头实时拍摄包括探针和标定体的影像,计算得到所述探针的坐标和所述标定体的坐标,包括:In a possible implementation, the binocular camera shoots images including the probe and the calibration body in real time, and calculates the coordinates of the probe and the calibration body, including:

当探针的尖端按在预设位置时,所述双目摄像头实时拍摄多幅包括所述探针和标定体的图像,并计算得到多个探针的坐标和多个标定体的坐标;When the tip of the probe is at a preset position, the binocular camera captures multiple images including the probe and the calibration body in real time, and calculates the coordinates of the multiple probes and the coordinates of the multiple calibration bodies;

当得到的连续多个探针的坐标均相同,连续多个标定体的坐标均相同时,确定得到预设位置的坐标,并将所述探针的坐标和标定体的坐标发送给云服务器。When the obtained coordinates of multiple consecutive probes are the same, and the coordinates of multiple consecutive calibration bodies are the same, determine the coordinates of the preset position, and send the coordinates of the probes and the coordinates of the calibration body to the cloud server.

在一种可能的实现方式中,所述云服务器根据所述标定体的坐标进行数据处理,包括:In a possible implementation manner, the cloud server performs data processing according to the coordinates of the calibration body, including:

当医生根据所述处理命令对应的获取股骨头旋转中心坐标流程在髋关节中旋转腿部的过程中,接收到所述双目摄像头实时发送的多个标定体的坐标;When the doctor rotates the leg in the hip joint according to the process of obtaining the coordinates of the center of rotation of the femoral head corresponding to the processing command, the doctor receives the coordinates of multiple calibration bodies sent by the binocular camera in real time;

所述云服务器接收到当前标定体的坐标时,将所述当前标定体的坐标与之前接收到的标定体的坐标进行比较,当所述当前标定体的坐标与之前标定体的坐标均不相同时,确定当前标定体的坐标为目标坐标;When the cloud server receives the coordinates of the current calibration body, it compares the coordinates of the current calibration body with the coordinates of the calibration body received before, and when the coordinates of the current calibration body are different from the coordinates of the previous calibration body, it is determined that the coordinates of the current calibration body are the target coordinates;

根据上述确定目标坐标的方式,得到预设数量的目标坐标时,根据所有目标坐标,计算得到股骨头旋转中心的坐标。According to the above method of determining the target coordinates, when a preset number of target coordinates are obtained, the coordinates of the rotation center of the femoral head are calculated according to all the target coordinates.

在一种可能的实现方式中,所述云服务器根据所述标定体的坐标进行数据处理,包括:In a possible implementation manner, the cloud server performs data processing according to the coordinates of the calibration body, including:

所述云服务器根据所述探针的坐标、所述标定体的坐标和所述股骨头旋转中心的坐标进行预设计算,得到数据处理结果。The cloud server performs preset calculations according to the coordinates of the probe, the coordinates of the calibration body, and the coordinates of the center of rotation of the femoral head to obtain data processing results.

本发明实施例提供一种手术导航系统及手术导航的方法,通过云服务器、显示屏、标定体、固定设备和双目摄像头即可完成手术过程中的导航操作,较现有技术中采用高精度摄像头和需要进行复杂图像处理的物理服务器相比,本实施例中设备成本低,且手术导航过程中不需要进行图像的传输,仅需要进行坐标数据的传输,从而降低图像处理量,提高处理效率。The embodiment of the present invention provides a surgical navigation system and a surgical navigation method. The navigation operation in the surgical process can be completed through a cloud server, a display screen, a calibration body, a fixed device, and a binocular camera. Compared with the prior art that uses a high-precision camera and a physical server that requires complex image processing, the cost of the equipment in this embodiment is low, and there is no need for image transmission during the surgical navigation process, only coordinate data transmission is required, thereby reducing the amount of image processing and improving processing efficiency.

附图说明Description of drawings

为了更清楚地说明本发明实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings used in the embodiments or prior art descriptions. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other accompanying drawings can also be obtained based on these drawings without creative work.

图1是本发明实施例提供的手术导航系统的示意图;FIG. 1 is a schematic diagram of a surgical navigation system provided by an embodiment of the present invention;

图2是本发明实施例提供的显示屏、双目摄像头的示意图;2 is a schematic diagram of a display screen and a binocular camera provided by an embodiment of the present invention;

图3-1是本发明实施例提供的探针的示意图;Figure 3-1 is a schematic diagram of the probe provided by the embodiment of the present invention;

图3-2是本发明实施例提供的标定体的示意图;Figure 3-2 is a schematic diagram of the calibration body provided by the embodiment of the present invention;

图4是本发明实施例提供的手术导航的方法的实现流程图。Fig. 4 is a flow chart of the implementation of the surgical navigation method provided by the embodiment of the present invention.

具体实施方式Detailed ways

以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、技术之类的具体细节,以便透彻理解本发明实施例。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本发明。在其它情况中,省略对众所周知的系统、装置、电路以及方法的详细说明,以免不必要的细节妨碍本发明的描述。In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present invention. It will be apparent, however, to one skilled in the art that the invention may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

为使本发明的目的、技术方案和优点更加清楚,下面将结合附图通过具体实施例来进行说明。In order to make the purpose, technical solution and advantages of the present invention clearer, specific embodiments will be described below in conjunction with the accompanying drawings.

图1为本发明实施例提供的一种手术导航系统的示意图,详述如下:FIG. 1 is a schematic diagram of a surgical navigation system provided by an embodiment of the present invention, which is described in detail as follows:

手术导航系统包括:云服务器10、显示屏20、标定体30、固定设备40和双目摄像头50;The surgical navigation system includes: a cloud server 10, a display screen 20, a calibration body 30, a fixed device 40 and a binocular camera 50;

云服务器10与显示屏20通讯连接,用于根据预设处理流程向显示屏20发送处理命令,以便医生根据显示屏20显示的处理命令对应的处理流程进行操作;The cloud server 10 is connected in communication with the display screen 20, and is used to send processing commands to the display screen 20 according to the preset processing flow, so that the doctor can operate according to the processing flow corresponding to the processing command displayed on the display screen 20;

标定体30通过固定设备40固定在患者的第一预设位置,标定体30为光学标定体;The calibration body 30 is fixed at the first preset position of the patient by the fixing device 40, and the calibration body 30 is an optical calibration body;

双目摄像头50设置在距离标定体30的预设距离范围内,并与云服务器10建立通讯连接,用于实时采集标定体30的影像,并根据标定体30的影像计算得到标定体30的坐标,将标定体30的坐标发送给显示屏20和云服务器10;The binocular camera 50 is set within the preset distance range from the calibration body 30, and establishes a communication connection with the cloud server 10 for real-time collection of the image of the calibration body 30, and calculates the coordinates of the calibration body 30 according to the image of the calibration body 30, and sends the coordinates of the calibration body 30 to the display screen 20 and the cloud server 10;

云服务器10,还用于接收标定体30的坐标,并根据标定体30的坐标进行数据处理,将数据处理结果发送给显示屏20,协助医生操作;The cloud server 10 is also used to receive the coordinates of the calibration body 30, and perform data processing according to the coordinates of the calibration body 30, and send the data processing results to the display screen 20 to assist the doctor in operation;

显示屏20,用于显示标定体30的坐标的位置、处理命令对应的处理流程以及数据处理结果。The display screen 20 is used to display the coordinate position of the calibration body 30 , the processing flow corresponding to the processing command and the data processing result.

可选的,云服务器10中预先存储当前手术对应的标准处理流程,需要说明的是,不同手术对应的标准处理流程不同,但同一手术对应的标准处理流程相同,与现有技术中,需要在服务器上预置患者的CT片和对应处理流程不同,本实施例中仅需设置标准处理流程,进行手术过程中数据的获取提示,并不需要提前获取CT片,从而降低了手术过程中图像的处理量,提高数据处理速度。Optionally, the cloud server 10 pre-stores the standard processing flow corresponding to the current operation. It should be noted that the standard processing flow corresponding to different operations is different, but the standard processing flow corresponding to the same operation is the same. Unlike the prior art, the CT film of the patient and the corresponding processing flow need to be preset on the server.

显示屏20用于显示手术处理流程,需要说明的是,可以一个一个处理流程显示,也可以在显示屏20的预设位置显示全部标准处理流程,并对当前处理流程着重显示,以便医生可以更直观的看到整个手术流程,把握手术进度。例如在显示屏20的左侧一一显示全部标准处理流程,在本实施例中不限定标准处理流程的具体步骤。The display screen 20 is used to display the operation process. It should be noted that the processing process can be displayed one by one, or all the standard processing processes can be displayed at the preset position of the display screen 20, and the current processing process is displayed emphatically, so that the doctor can see the entire operation process more intuitively and grasp the progress of the operation. For example, all standard processing procedures are displayed one by one on the left side of the display screen 20, and the specific steps of the standard processing procedures are not limited in this embodiment.

示例性的,当前手术可以为截骨矫形手术,其对应的标准处理流程可以包括标定体的坐标确定、获取股骨头旋转中心坐标、注册和导航四个步骤。Exemplarily, the current operation may be an osteotomy orthopedic operation, and its corresponding standard processing flow may include four steps of determining the coordinates of the calibration body, obtaining the coordinates of the center of rotation of the femoral head, registering and navigating.

标定体30可以为光学标定体,可以通过反射照射到标定体30上的光被摄像头的捕捉。在本实施例中,标定体30可以设置至少两个,且标定体30通过固定设备40固定在患者的第一预设位置,防止手术过程中被移动,影响云服务器的计算结果。The calibration body 30 may be an optical calibration body, and the light irradiated on the calibration body 30 may be captured by the camera through reflection. In this embodiment, at least two calibration bodies 30 can be provided, and the calibration bodies 30 are fixed at the first preset position of the patient by the fixing device 40 to prevent them from being moved during the operation and affecting the calculation results of the cloud server.

示例性的,在进行截骨矫形手术时,标定体30可以分别设置在股骨和胫骨的中间位置。由于整个手术导航过程长并不处理图像,因此并不清楚患者的股骨和胫骨的位置,因此采用两个标定体30分别代表股骨和胫骨,进行后续的计算处理。Exemplarily, during osteotomy orthopedic surgery, the calibration body 30 can be respectively set in the middle of the femur and the tibia. Since the entire surgical navigation process does not process images, the positions of the patient's femur and tibia are unclear, so two calibration bodies 30 are used to represent the femur and tibia respectively for subsequent calculation and processing.

双目摄像头50为具有简单计算功能的便捷摄像头,成本较现有技术中的整机设备上的高精度摄像头低。The binocular camera 50 is a convenient camera with a simple calculation function, and the cost is lower than that of the high-precision camera on the complete machine equipment in the prior art.

双目摄像头50设置在可以实时拍摄标定体的范围内,例如双目摄像头50设置在距离标定体30的1.5米至2米的范围内。The binocular camera 50 is set within a range where the calibration object can be photographed in real time, for example, the binocular camera 50 is set within a range of 1.5 meters to 2 meters from the calibration object 30 .

在本实施例中,双目摄像头50拍摄到包含标定体的影像后,并不直接将影像发送给云服务器10进行后续处理,而是根据影像计算标定体的坐标,将标定体的坐标发送给云服务器10,这样传输的数据量会明显小于现有技术中图像数据传输量,提高处理效率和传输速度。In this embodiment, after the binocular camera 50 captures the image containing the calibration object, it does not directly send the image to the cloud server 10 for subsequent processing, but calculates the coordinates of the calibration object based on the image, and sends the coordinates of the calibration object to the cloud server 10. In this way, the amount of data transmitted will be significantly smaller than the amount of image data transmission in the prior art, and the processing efficiency and transmission speed will be improved.

在一实施例中,参见图2所示,显示屏20为一透明镜片,透明镜片设置在眼镜框架上。In one embodiment, as shown in FIG. 2 , the display screen 20 is a transparent lens, and the transparent lens is arranged on the frame of the glasses.

透明镜片作为显示屏,戴到主治医生头上,这样主治医生可以不用转头或者抬头专门看手术室内的显示屏,可以随时看到显示屏显示的内容。这里设置为透明镜片的目的是,不阻挡主治医生的视野,使得主治医生可以方便的看到患者的患处,方便操作,较现有技术中AI眼镜实时显示场景相比,虚拟和现实相结合,提高操作效率,适用性更强。The transparent lens is used as a display screen and is worn on the head of the attending doctor, so that the attending doctor can look at the display screen in the operating room without turning or looking up, and can see the content displayed on the screen at any time. The purpose of setting the transparent lens here is not to block the doctor's field of vision, so that the doctor can easily see the patient's affected area and operate conveniently. Compared with the real-time display scene of the AI glasses in the prior art, the combination of virtual and reality improves the operation efficiency and has stronger applicability.

在一实施例中,参见图2所示,双目摄像头50分别吸附在眼镜框架的左右镜框上。双目摄像头50为便携摄像头,重量很轻,可以吸附在眼镜框上,戴到主治医生头上。主治医生的视野是手术过程中视野最好的,因此双目摄像头50可以随主治医生的移动实时拍摄到更好更清楚的影像,提供更好的数据基础,使得云服务器10的数据处理结果更准确。图2中,眼睛框架采用绑带21替代通常眼镜上的眼镜腿,这样可以更好的将眼镜固定在医生眼睛上,防止头晃动时眼镜移动。In one embodiment, as shown in FIG. 2 , the binocular camera 50 is respectively attached to the left and right frames of the spectacle frame. The binocular camera 50 is a portable camera with light weight, which can be attached to the glasses frame and worn on the head of the attending doctor. The field of vision of the attending doctor is the best during the operation, so the binocular camera 50 can capture better and clearer images in real time with the movement of the attending doctor, providing a better data basis and making the data processing results of the cloud server 10 more accurate. In Fig. 2, the eye frame adopts strap 21 to replace the spectacle legs on the usual glasses, which can better fix the glasses on the doctor's eyes and prevent the glasses from moving when the head shakes.

在一实施例中,手术导航系统还可以包括:探针60;In one embodiment, the surgical navigation system may further include: a probe 60;

探针60上设置预设数量的光学标定球,用于对患者的第二预设位置进行标定。A preset number of optical calibration balls are arranged on the probe 60 for calibration of the second preset position of the patient.

如图3-1所示探针60的示意图,探针60的尖端用于按住患者的第二预设位置,探针60的笔杆端上设置光学标定球,用于标定所示第二预设位置对应的坐标。双目摄像头50通过采集探针60的光学标定球的影像,计算探针60的坐标,标定探针60的位置。3-1 is a schematic diagram of the probe 60 , the tip of the probe 60 is used to hold down the second preset position of the patient, and an optical calibration ball is set on the pen end of the probe 60 to mark the coordinates corresponding to the second preset position shown. The binocular camera 50 collects the image of the optical calibration sphere of the probe 60 , calculates the coordinates of the probe 60 , and calibrates the position of the probe 60 .

可选的,在标定探针60的位置时,需要根据标定体30的坐标进行标定,由于本实施例中不进行图像的处理,整个过程中并不清楚患者的股骨和胫骨的位置,通过两个标定体30代表股骨和胫骨的位置,因此标定体30的位置相对固定,在标定探针60的位置时,需要第二预设位置为第一预设位置的预设范围内的位置,双目摄像头50同时拍摄标定体30和探针60的影像,通过标定体30的位置,确定探针60的位置。Optionally, when the position of the probe 60 is calibrated, it needs to be calibrated according to the coordinates of the calibration body 30. Since no image processing is performed in this embodiment, the positions of the femur and the tibia of the patient are not clear during the whole process. The positions of the femur and the tibia are represented by the two calibration bodies 30, so the position of the calibration body 30 is relatively fixed. The position of the probe 60 is determined through the position of the calibration body 30 .

双目摄像头50用于采集探针和标定体的影像,并根据探针和标定体的影像计算得到探针的坐标和标定体的坐标,将探针的坐标和标定体的坐标发送给显示屏20和云服务器10。The binocular camera 50 is used to collect the images of the probe and the calibration body, and calculate the coordinates of the probe and the calibration body according to the images of the probe and the calibration body, and send the coordinates of the probe and the calibration body to the display screen 20 and the cloud server 10.

此时显示屏20中除显示上述标准处理流程之外,还显示标定体的坐标和探针的坐标,需要注意的是,这里显示的标定体的坐标和探针的坐标并不是显示坐标数据,而是显示坐标之间的相对位置,例如显示屏20相当于一个二维平面图,二维平面图上采用预设标记显示各个坐标的位置,这里预设标记可以为实心圆点、空心圆点等图形。At this time, in addition to displaying the above-mentioned standard processing flow, the display screen 20 also displays the coordinates of the calibration body and the coordinates of the probe. It should be noted that the coordinates of the calibration body and the probe displayed here do not display coordinate data, but display the relative positions between the coordinates.

其中,不同类型的坐标可以采用相同的标记表示,也可以采用不同的标记表示,例如标定体的坐标采用实心圆点表示,探针的坐标采用空心圆点表示。Wherein, different types of coordinates may be represented by the same mark, or may be represented by different marks, for example, the coordinates of the calibration body are represented by solid circles, and the coordinates of the probe are represented by hollow circles.

示例性的,当标准处理流程中着重显示注册流程时,医生拿着探针60在患者身上的预设位置按住,此时双目摄像头50采集探针和标定体的影像。需要说明的是,这里探针60的标定仅仅是为了采集数据,进行手术协助,医生可以根据自己的经验在任意需要的位置进行标定。Exemplarily, when the registration process is emphatically displayed in the standard processing flow, the doctor holds the probe 60 at a preset position on the patient and presses it, and the binocular camera 50 collects images of the probe and the calibration body. It should be noted that the calibration of the probe 60 here is only for data collection and surgical assistance, and doctors can perform calibration at any desired position according to their own experience.

可选的,标定体30的数量为两个及以上,标定体30上包括至少三个光学标定球,且至少三个光学标定球不在同一条直线上;Optionally, the number of calibration bodies 30 is two or more, the calibration body 30 includes at least three optical calibration spheres, and at least three optical calibration spheres are not on the same straight line;

探针60上包括至少三个光学标定球,且至少三个光学标定球的高度不同。The probe 60 includes at least three optical calibration balls, and the heights of the at least three optical calibration balls are different.

参见图3-2所示,每个标定体30上设置三个光学标定球,为了医生可以明显区分不同的标定体30,可以将不同标定体30上的三个光学标定球的任两个光学标定球之间的连接杆设为不同形状的连接杆。如图3-2中,将一个标定体30上两个光学标定球之间的连接杆设置为直杆,将另一标定体30上两个光学标定球之间的连接杆设置为弯杆。Referring to Fig. 3-2, three optical calibration spheres are arranged on each calibration body 30. In order for doctors to clearly distinguish different calibration bodies 30, the connecting rods between any two of the three optical calibration spheres on different calibration bodies 30 can be set as connecting rods of different shapes. As shown in Figure 3-2, the connecting rod between the two optical calibration spheres on one calibration body 30 is set as a straight rod, and the connecting rod between the two optical calibration spheres on the other calibration body 30 is set as a curved rod.

采用三个光学标定球的原因为,三点确定的三角形的形状的固定性更高,在手术过程中不容易由于碰撞或其他突发事件而变形。The reason for using three optical calibration spheres is that the shape of the triangle determined by the three points has higher fixity, and it is not easy to be deformed due to collision or other emergencies during the operation.

例如,在进行截骨矫形手术时,云服务器10打开后,选定预设手术对应的标准处理流程发送到显示屏20上进行显示,预先在患者的第一预设位置固定上固定设备40,并将标定体30固定到固定设备40上,调整标定体30的三个光学标定球所在平面的位置,使得双目摄像头50可以方便捕捉到三个光学标定球的影像。For example, when performing osteotomy orthopedic surgery, after the cloud server 10 is turned on, the standard processing flow corresponding to the selected preset operation is sent to the display screen 20 for display, and the fixing device 40 is fixed in advance at the first preset position of the patient, and the calibration body 30 is fixed on the fixing device 40, and the positions of the planes where the three optical calibration spheres of the calibration body 30 are adjusted, so that the binocular camera 50 can conveniently capture the images of the three optical calibration spheres.

手术开始后,云服务器10下发第一处理流程对应的处理命令,显示屏20上显示或者着重显示第一处理流程。例如第一处理流程为标定体位置获取。After the operation starts, the cloud server 10 issues a processing command corresponding to the first processing flow, and the display screen 20 displays or emphatically displays the first processing flow. For example, the first processing procedure is to obtain the position of the calibration body.

双目摄像头50实时拍摄两个标定体30的影像,并计算标定体30的坐标,具体的,计算标定体30上每个光学标定球的坐标,发送给云服务器10和显示屏20,显示屏20显示所有光学标定球的坐标,即6个坐标。The binocular camera 50 captures the images of the two calibration bodies 30 in real time, and calculates the coordinates of the calibration bodies 30, specifically, calculates the coordinates of each optical calibration ball on the calibration body 30, and sends them to the cloud server 10 and the display screen 20, and the display screen 20 displays the coordinates of all optical calibration balls, that is, 6 coordinates.

云服务器10在下发第一处理流程对应的处理命令后,接收双目摄像头50发送的每个标定体30的坐标,进行保存。After issuing the processing command corresponding to the first processing flow, the cloud server 10 receives and saves the coordinates of each calibration body 30 sent by the binocular camera 50 .

云服务器10下发第二处理流程对应的处理命令,显示屏20上显示或者着重显示第二处理流程。例如第二处理流程为获取股骨头旋转中心坐标。The cloud server 10 issues a processing command corresponding to the second processing flow, and the display screen 20 displays or emphatically displays the second processing flow. For example, the second processing procedure is to obtain the coordinates of the rotation center of the femoral head.

医生看到显示屏20上显示的第二处理流程后,执行对应的操作。例如,抬起患者的腿,在髋关节中旋转腿部,双目摄像头50实时拍摄两个标定体30的影像,并将多个标定体30的坐标发送给云服务器10;After seeing the second processing flow displayed on the display screen 20, the doctor performs corresponding operations. For example, lift the patient's leg, rotate the leg in the hip joint, the binocular camera 50 takes real-time images of two calibration bodies 30, and sends the coordinates of multiple calibration bodies 30 to the cloud server 10;

云服务器10根据接收到的多个标定体30的坐标,计算得到股骨头旋转中心的坐标。The cloud server 10 calculates the coordinates of the center of rotation of the femoral head according to the received coordinates of the plurality of calibration bodies 30 .

在得到股骨头旋转中心的坐标后,云服务器10发送给显示屏20进行显示,医生看到显示屏显示的股骨头旋转中心的坐标后,停止操作。云服务器10下发第三处理流程对应的处理命令,显示屏20上显示或者着重显示第三处理流程。例如第三处理流程为注册流程。这里注册流程指的是其他点位的获取,以便标定股骨和胫骨的具体位置。After obtaining the coordinates of the center of rotation of the femoral head, the cloud server 10 sends it to the display screen 20 for display, and the doctor stops the operation after seeing the coordinates of the center of rotation of the femoral head displayed on the display screen. The cloud server 10 issues a processing command corresponding to the third processing flow, and the display screen 20 displays or emphatically displays the third processing flow. For example, the third processing flow is a registration flow. The registration process here refers to the acquisition of other points in order to calibrate the specific positions of the femur and tibia.

医生看到显示屏20上显示的第三处理流程后,用探针60按住患者的内侧上髁点,双目摄像头50实时拍摄探针60和两个标定体30的影像,并将探针60的坐标和标定体30的坐标发送给云服务器10;After the doctor sees the third processing flow shown on the display screen 20, he presses the patient's medial epicondyle point with the probe 60, and the binocular camera 50 takes real-time images of the probe 60 and the two calibration bodies 30, and sends the coordinates of the probe 60 and the calibration body 30 to the cloud server 10;

云服务器10根据探针60的坐标和标定体30的坐标,确定探针的位置,将探针的位置标定为内侧上髁点的位置,并将确定的探针的坐标发送给显示屏20进行显示,医生看到显示屏显示的探针60的坐标后,用探针60进行下一个点位的操作。按照上述方式,采用探针60标定外侧上髁点的位置、内侧踝位置和外侧踝位置,完成注册流程。The cloud server 10 determines the position of the probe according to the coordinates of the probe 60 and the coordinates of the calibration body 30, calibrates the position of the probe as the position of the medial epicondyle point, and sends the determined coordinates of the probe to the display screen 20 for display. After seeing the coordinates of the probe 60 displayed on the display screen, the doctor uses the probe 60 to perform the operation of the next point. In the manner described above, the probe 60 is used to calibrate the position of the lateral epicondyle point, the position of the medial malleolus, and the position of the lateral malleolus to complete the registration process.

云服务器10根据接收到的所有坐标,进行预设计算,例如计算股骨和胫骨之间的夹角。The cloud server 10 performs preset calculations according to all received coordinates, for example, calculating the angle between the femur and the tibia.

示例性的,预设计算方式可以包括:根据内侧上髁点的位置和外侧上髁点的位置确定膝关节中心位置;根据内侧踝位置和外侧踝位置确定胫骨远端中心位置,计算股骨头旋转中心到膝关节中心位置的线段,与膝关节中心位置到胫骨远端中心位置的线段之间的夹角,得到股骨和胫骨之间的夹角。Exemplarily, the preset calculation method may include: determining the center position of the knee joint according to the position of the medial epicondyle point and the position of the lateral epicondyle point; determining the center position of the distal end of the tibia according to the position of the medial malleolus and the position of the lateral malleolus, calculating the angle between the line segment from the center of rotation of the femoral head to the center position of the knee joint, and the line segment from the center position of the knee joint to the center position of the distal end of the tibia, to obtain the angle between the femur and the tibia.

现有技术中,一般通过医生的直接用眼睛观察股骨和胫骨是否在一条直线上,人眼观察与经验有关,且不精准,细小的夹角看不出来,而云服务器10计算股骨和胫骨之间的夹角,则可以精确到需要的精度,准确度高,且不依赖医生的经验。In the prior art, the doctor directly observes whether the femur and the tibia are in a straight line. The human eye observation is related to experience, and it is not accurate, and the small angle cannot be seen. However, the cloud server 10 can calculate the angle between the femur and the tibia, which can be accurate to the required accuracy, with high accuracy, and does not rely on the doctor's experience.

上述手术导航系统,通过云服务器、显示屏、标定体、固定设备和双目摄像头即可完成手术过程中的导航操作,设备成本低,且手术导航过程中不需要进行图像的传输,仅需要进行坐标数据的传输,从而降低图像处理量,提高处理效率。通过增加探针,可以与标定体结合标定需要的位置,使得手术导航过程中可以通过云服务器的计算替代现有技术中需要医生根据经验进行判断的数据,提高数据处理精确度,协助医生更快更方便的进行操作。The above-mentioned surgical navigation system can complete the navigation operation during the operation through the cloud server, the display screen, the calibration body, the fixed equipment and the binocular camera. The cost of the equipment is low, and the transmission of the image is not required during the surgical navigation process, only the transmission of the coordinate data is required, thereby reducing the amount of image processing and improving the processing efficiency. By adding the probe, it can be combined with the calibration body to calibrate the required position, so that the calculation of the cloud server can replace the data in the prior art that requires doctors to judge based on experience in the surgical navigation process, improve the accuracy of data processing, and assist doctors to operate faster and more conveniently.

图4为本发明实施例提供的一种手术导航的方法的实现流程图,采用上述任一实施例的手术导航系统,手术导航的方法详述如下:FIG. 4 is a flow chart of a surgical navigation method provided by an embodiment of the present invention. Using the surgical navigation system of any of the above-mentioned embodiments, the surgical navigation method is described in detail as follows:

步骤401,云服务器向显示屏发送处理命令,以便显示屏显示处理命令对应的处理流程,医生根据处理流程进行操作,处理命令为根据预设处理流程生成的命令。In step 401, the cloud server sends a processing command to the display screen, so that the display screen displays the processing flow corresponding to the processing command, and the doctor operates according to the processing flow, and the processing command is an order generated according to a preset processing flow.

云服务器10根据标准处理流程依次向显示屏20发送处理命令,以便医生根据显示屏显示的处理流程进行对应的操作。The cloud server 10 sequentially sends processing commands to the display screen 20 according to the standard processing flow, so that the doctor can perform corresponding operations according to the processing flow displayed on the display screen.

步骤402,双目摄像头实时拍摄标定体的影像,计算得到标定体的坐标,并将标定体的坐标发送给云服务器。Step 402, the binocular camera shoots the image of the calibration object in real time, calculates the coordinates of the calibration object, and sends the coordinates of the calibration object to the cloud server.

在医生操作过程中,双目摄像头实时拍摄标定体的影像,并根据标定体的影像计算标定体的坐标,用标定体的坐标代表患者的对应位置。During the doctor's operation, the binocular camera captures the image of the calibration body in real time, and calculates the coordinates of the calibration body based on the image of the calibration body, and uses the coordinates of the calibration body to represent the corresponding position of the patient.

例如,在进行截骨矫形手术时,云服务器10打开后,选定预设手术对应的标准处理流程发送到显示屏20上进行显示,预先在患者的第一预设位置固定上固定设备40,并将标定体30固定到固定设备40上,调整标定体30的三个光学标定球所在平面的位置,使得双目摄像头50可以方便捕捉到三个光学标定球的影像。For example, when performing osteotomy orthopedic surgery, after the cloud server 10 is turned on, the standard processing flow corresponding to the selected preset operation is sent to the display screen 20 for display, and the fixing device 40 is fixed in advance at the first preset position of the patient, and the calibration body 30 is fixed on the fixing device 40, and the positions of the planes where the three optical calibration spheres of the calibration body 30 are adjusted, so that the binocular camera 50 can conveniently capture the images of the three optical calibration spheres.

手术开始后,云服务器10下发第一处理流程对应的处理命令,显示屏20上显示或者着重显示第一处理流程。例如第一处理流程为标定体位置获取。After the operation starts, the cloud server 10 issues a processing command corresponding to the first processing flow, and the display screen 20 displays or emphatically displays the first processing flow. For example, the first processing procedure is to obtain the position of the calibration body.

双目摄像头50实时拍摄两个标定体30的影像,并计算标定体30的坐标,具体的,计算标定体30上每个光学标定球的坐标,发送给云服务器10和显示屏20,显示屏20显示所有光学标定球的坐标,即6个坐标。可选的,在进行截骨矫形手术时,一个标定体30用来标定股骨,另一个标定体30标定胫骨。The binocular camera 50 captures the images of the two calibration bodies 30 in real time, and calculates the coordinates of the calibration bodies 30, specifically, calculates the coordinates of each optical calibration ball on the calibration body 30, and sends them to the cloud server 10 and the display screen 20, and the display screen 20 displays the coordinates of all optical calibration balls, that is, 6 coordinates. Optionally, when performing osteotomy orthopedic surgery, one calibration body 30 is used to demarcate the femur, and the other calibration body 30 is used to demarcate the tibia.

在本实施例中,双目摄像头50拍摄的影像并不直接传输给云服务器10,而是将计算得到的标定体的坐标发送给云服务器10,这样云服务器10并不能获得患者腿部的图像,而是将标定体30分别固定到患者腿部的预设位置,当患者腿部运动时,标定体30的坐标也对应变化,这样就可以采用标定体30标定患者腿部。In this embodiment, the images captured by the binocular camera 50 are not directly transmitted to the cloud server 10, but the calculated coordinates of the calibration body are sent to the cloud server 10, so that the cloud server 10 cannot obtain images of the patient's legs, but fix the calibration bodies 30 to preset positions of the patient's legs.

可选的,通过标定体30标定患者的预设位置后,可以根据标定体30计算一些位置的坐标。Optionally, after the preset position of the patient is calibrated by the calibration body 30 , the coordinates of some positions can be calculated according to the calibration body 30 .

例如,云服务器10下发第二处理流程对应的处理命令,显示屏20上显示或者着重显示第二处理流程。例如第二处理流程为获取股骨头旋转中心坐标。For example, the cloud server 10 issues a processing command corresponding to the second processing flow, and the display screen 20 displays or emphatically displays the second processing flow. For example, the second processing procedure is to obtain the coordinates of the rotation center of the femoral head.

医生抬起患者的腿,在髋关节中旋转腿部,双目摄像头50实时拍摄两个标定体30的影像,并将多个标定体30的坐标发送给云服务器10。The doctor lifts the patient's leg, rotates the leg in the hip joint, and the binocular camera 50 captures the images of the two calibration bodies 30 in real time, and sends the coordinates of the multiple calibration bodies 30 to the cloud server 10 .

云服务器10根据接收到的多个标定体30的坐标,计算得到股骨头旋转中心的坐标。The cloud server 10 calculates the coordinates of the center of rotation of the femoral head according to the received coordinates of the plurality of calibration bodies 30 .

所述云服务器10根据所述预设数量的目标坐标,计算股骨头旋转中心的坐标。这里预设数量可以根据实际需求进行设置,例如预设数量可以为30、50等数据。预设数量的目标坐标构成一个点云数据矩阵,其形状为一个以股骨头旋转中心的坐标为中心的圆锥体,通过现有技术中的计算方式计算中心的坐标,即可得到股骨头旋转中心的坐标。The cloud server 10 calculates the coordinates of the center of rotation of the femoral head according to the preset number of target coordinates. The preset number here can be set according to actual needs, for example, the preset number can be 30, 50 and other data. A preset number of target coordinates constitute a point cloud data matrix, which is shaped like a cone centered on the coordinates of the femoral head rotation center, and the coordinates of the femoral head rotation center can be obtained by calculating the coordinates of the center through the calculation method in the prior art.

在得到股骨头旋转中心的坐标后,云服务器10发送股骨头旋转中心的坐标给显示屏20进行显示。下发第三处理流程对应的处理命令,显示屏20上显示或者着重显示第三处理流程。例如第三处理流程为注册流程。这里注册流程指的是其他点位的获取,以便标定股骨和胫骨的具体位置。After obtaining the coordinates of the center of rotation of the femoral head, the cloud server 10 sends the coordinates of the center of rotation of the femoral head to the display screen 20 for display. A processing command corresponding to the third processing flow is issued, and the display screen 20 displays or emphatically displays the third processing flow. For example, the third processing flow is a registration flow. The registration process here refers to the acquisition of other points in order to calibrate the specific positions of the femur and tibia.

在一实施例中,注册时需要采用探针60标定股骨和胫骨。In one embodiment, registration requires calibration of the femur and tibia with probe 60 .

在采用探针60标定时,双目摄像头50实时拍摄包括探针60和标定体30的影像,计算得到探针60的坐标和标定体30的坐标,并将探针60的坐标和标定体30的坐标发送给云服务器10;云服务器10根据探针60的坐标和标定体30的坐标进行数据处理。When the probe 60 is used for calibration, the binocular camera 50 captures images including the probe 60 and the calibration body 30 in real time, calculates the coordinates of the probe 60 and the calibration body 30, and sends the coordinates of the probe 60 and the calibration body 30 to the cloud server 10; the cloud server 10 performs data processing according to the coordinates of the probe 60 and the calibration body 30.

在一实施例方式中,在双目摄像头50计算探针60的坐标时,需要医生用探针按住患者的待标定点稳定预设时间,即双目摄像头50计算得到的多个探针60的坐标相同时,确定待标定坐标为当前探针60的坐标。In one embodiment, when the binocular camera 50 calculates the coordinates of the probe 60, the doctor needs to press the probe to hold the patient's point to be calibrated to stabilize for a preset time, that is, when the coordinates of multiple probes 60 calculated by the binocular camera 50 are the same, it is determined that the coordinates to be calibrated are the coordinates of the current probe 60.

可选的,双目摄像头实时拍摄包括探针和标定体的影像,计算得到探针的坐标和标定体的坐标,包括:Optionally, the binocular camera shoots images including the probe and the calibration body in real time, and calculates the coordinates of the probe and the calibration body, including:

当探针的尖端按在预设位置时,双目摄像头实时拍摄多幅包括探针和标定体的图像,并计算得到多个探针的坐标和多个标定体的坐标;When the tip of the probe is pressed at the preset position, the binocular camera will capture multiple images including the probe and calibration body in real time, and calculate the coordinates of multiple probes and multiple calibration bodies;

当得到的连续多个探针的坐标均相同,多个标定体的坐标均相同时,确定得到预设位置的坐标,并将探针的坐标和标定体的坐标发送给云服务器。When the obtained continuous coordinates of multiple probes are the same and the coordinates of multiple calibration bodies are the same, determine the coordinates of the preset position, and send the coordinates of the probes and the coordinates of the calibration body to the cloud server.

按照上述方式,采用探针标定内侧上髁点的位置、外侧上髁点的位置、内侧踝位置和外侧踝位置,完成注册流程。According to the above method, the probe is used to calibrate the position of the medial epicondyle point, the position of the lateral epicondyle point, the position of the medial malleolus, and the position of the lateral malleolus to complete the registration process.

步骤403,云服务器根据标定体的坐标进行数据处理,并将数据处理结果发送给显示屏,以便医生进行数据参考,协助医生操作。Step 403, the cloud server performs data processing according to the coordinates of the calibration body, and sends the data processing result to the display screen, so that the doctor can refer to the data and assist the doctor in operation.

可选的,云服务器根据标定体的坐标进行数据处理,可以包括云服务器根据标定体的坐标,计算得到股骨头旋转中心的坐标,具体参见步骤402的详述,在此不再一一赘述。Optionally, the cloud server performs data processing according to the coordinates of the calibration body, which may include calculating the coordinates of the center of rotation of the femoral head by the cloud server according to the coordinates of the calibration body. For details, refer to the detailed description of step 402, which will not be repeated here.

可选的,云服务器根据标定体的坐标进行数据处理,可以包括云服务器根据探针的坐标、标定体的坐标和股骨头旋转中心的坐标进行预设计算,得到数据处理结果。Optionally, the cloud server performs data processing according to the coordinates of the calibration body, which may include the cloud server performing preset calculations according to the coordinates of the probe, the coordinates of the calibration body, and the coordinates of the femoral head rotation center to obtain data processing results.

云服务器10根据接收到的所有坐标,进行预设计算,例如计算股骨和胫骨之间的夹角。The cloud server 10 performs preset calculations according to all received coordinates, for example, calculating the angle between the femur and the tibia.

示例性的,预设计算方式可以包括:根据内侧上髁点的位置和外侧上髁点的位置确定膝关节中心位置;根据内侧踝位置和外侧踝位置确定胫骨远端中心位置,计算股骨头旋转中心到膝关节中心位置的线段,与膝关节中心位置到胫骨远端中心位置的线段之间的夹角,得到股骨和胫骨之间的夹角。Exemplarily, the preset calculation method may include: determining the center position of the knee joint according to the position of the medial epicondyle point and the position of the lateral epicondyle point; determining the center position of the distal end of the tibia according to the position of the medial malleolus and the position of the lateral malleolus, calculating the angle between the line segment from the center of rotation of the femoral head to the center position of the knee joint, and the line segment from the center position of the knee joint to the center position of the distal end of the tibia, to obtain the angle between the femur and the tibia.

现有技术中,一般通过医生的直接用眼睛观察股骨和胫骨是否在一条直线上,人眼观察与经验有关,且不精准,较小的夹角看不出来,而云服务器10计算股骨和胫骨之间的夹角,则可以精确到需要的精度,准确度高,且不依赖医生的经验。In the prior art, the doctor usually directly observes whether the femur and the tibia are in a straight line with the eyes. The human eye observation is related to experience, and it is not accurate, and the small angle cannot be seen. However, the cloud server 10 can calculate the angle between the femur and the tibia, which can be accurate to the required accuracy, with high accuracy, and does not rely on the doctor's experience.

云服务器上还可以根据接收到的标定体的坐标和/或探针的坐标进行其他的预设计算,在本实施例中不对计算方式进行限定。Other preset calculations can also be performed on the cloud server according to the received coordinates of the calibration body and/or the coordinates of the probe, and the calculation method is not limited in this embodiment.

本发明实施例通过云服务器向显示屏发送处理命令,显示屏显示处理命令对应的处理流程,医生根据处理流程进行操作,标定体随医生的操作,位置发生变化,双目摄像头实时拍摄标定体的影像,计算得到标定体的坐标,并将标定体的坐标发送给云服务器;云服务器根据标定体的坐标进行数据处理,并将数据处理结果发送给显示屏,以便医生进行数据参考,协助医生操作,手术导航过程中不需要进行图像的传输,仅需要进行坐标数据的传输,从而降低图像处理量,提高处理效率。手术导航过程中采用双目摄像头和云服务器交互完成,较现有技术中采用高清摄像头和需要进行图像处理的物理服务器相比,设备成本较低,操作更方便,适用性更广。且手术导航过程中可以通过云服务器的计算替代现有技术中需要医生根据经验进行判断的数据,提高数据处理精确度,协助医生更快更方便的进行操作。In the embodiment of the present invention, the cloud server sends a processing command to the display screen, and the display screen displays the processing flow corresponding to the processing command. The doctor operates according to the processing flow. The position of the calibration body changes with the operation of the doctor. The binocular camera captures the image of the calibration body in real time, calculates the coordinates of the calibration body, and sends the coordinates of the calibration body to the cloud server. Image processing capacity, improve processing efficiency. In the surgical navigation process, the interaction between the binocular camera and the cloud server is used. Compared with the high-definition camera and the physical server that needs image processing in the prior art, the equipment cost is lower, the operation is more convenient, and the applicability is wider. In addition, in the process of surgical navigation, the calculation of the cloud server can replace the data that requires doctors to judge based on experience in the existing technology, improve the accuracy of data processing, and assist doctors to operate faster and more conveniently.

应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本发明实施例的实施过程构成任何限定。It should be understood that the sequence numbers of the steps in the above embodiments do not mean the order of execution, and the execution order of each process should be determined by its functions and internal logic, and should not constitute any limitation to the implementation process of the embodiment of the present invention.

以上所述实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围,均应包含在本发明的保护范围之内。The above-described embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention, and should be included within the protection scope of the present invention.

Claims (10)

1. A surgical navigation system, comprising: the system comprises a cloud server, a display screen, a calibration body, fixed equipment and a binocular camera;
the cloud server is in communication connection with the display screen and is used for sending a processing command to the display screen according to a preset processing flow so that a doctor can operate according to the processing flow corresponding to the processing command displayed by the display screen;
the calibration body is fixed at a first preset position of a patient through the fixing equipment, and is an optical calibration body;
the binocular camera is arranged in a preset distance range from the calibration body, is in communication connection with the cloud server, and is used for collecting images of the calibration body in real time, calculating coordinates of the calibration body according to the images of the calibration body and sending the coordinates of the calibration body to the display screen and the cloud server;
the cloud server is also used for receiving the coordinates of the calibration body, performing data processing according to the coordinates of the calibration body, and sending a data processing result to the display screen to assist a doctor to operate;
the display screen is used for displaying the position of the coordinates of the calibration body, the processing flow corresponding to the processing command and the data processing result.
2. The surgical navigation system of claim 1, wherein the display screen is a transparent lens disposed on the eyeglass frame.
3. A surgical navigation system according to claim 2, wherein the binocular cameras are respectively attached to left and right rims of the eyeglass frame.
4. A surgical navigation system according to any one of claims 1-3, further comprising: a probe;
the probe is provided with a preset number of optical calibration balls for calibrating a second preset position of the patient; the second preset position is a position within a preset range of the first preset position;
the binocular camera is used for acquiring images of the probe and the calibration body, calculating coordinates of the probe and coordinates of the calibration body according to the images of the probe and the calibration body, and sending the coordinates of the probe and the coordinates of the calibration body to the display screen and the cloud server.
5. The surgical navigation system of claim 4, wherein the number of calibration bodies is two or more;
the calibration body comprises at least three optical calibration balls, and the at least three optical calibration balls are not on the same straight line;
the probe comprises at least three optical calibration balls, and the heights of the at least three optical calibration balls are different.
6. A method of surgical navigation employing the surgical navigation system of any of claims 1-5, the method comprising:
the cloud server sends a processing command to a display screen so that the display screen displays a processing flow corresponding to the processing command, a doctor operates according to the processing flow, and the processing command is a command generated according to a preset processing flow;
the binocular camera shoots an image of the calibration body in real time, calculates the coordinates of the calibration body, and sends the coordinates of the calibration body to the cloud server;
and the cloud server performs data processing according to the coordinates of the calibration body and sends a data processing result to a display screen so as to facilitate data reference of a doctor and assist the doctor in operation.
7. The method of surgical navigation of claim 6, further comprising:
the binocular camera shoots an image comprising a probe and a calibration body in real time, calculates coordinates of the probe and coordinates of the calibration body, and sends the coordinates of the probe and the coordinates of the calibration body to the cloud server;
the cloud server performs data processing according to the coordinates of the calibration body, and the data processing comprises:
and the cloud server performs data processing according to the coordinates of the probe and the coordinates of the calibration body.
8. The method of claim 7, wherein the binocular camera captures images of the probe and the calibration volume in real time, and calculating coordinates of the probe and coordinates of the calibration volume comprises:
when the tip of the probe is pressed at a preset position, the binocular camera shoots a plurality of images comprising the probe and the calibration body in real time, and coordinates of the plurality of probes and coordinates of the plurality of calibration bodies are obtained through calculation;
and when the obtained coordinates of the continuous multiple probes are the same, determining the coordinates of the preset positions, and sending the coordinates of the probes and the coordinates of the calibration bodies to a cloud server.
9. The method of claim 8, wherein the cloud server performs data processing according to coordinates of the calibration body, comprising:
when a doctor rotates the leg in the hip joint according to a procedure of acquiring the rotation center coordinates of the femoral head corresponding to the processing command, coordinates of a plurality of calibration bodies sent by the binocular camera in real time are received;
when the cloud server receives the coordinates of the current calibration body, comparing the coordinates of the current calibration body with the coordinates of the previously received calibration body, and when the coordinates of the current calibration body are different from the coordinates of the previous calibration body, determining the coordinates of the current calibration body as target coordinates;
and when the preset number of target coordinates are obtained according to the mode of determining the target coordinates, calculating the coordinates of the rotation center of the femoral head according to all the target coordinates.
10. The method of claim 9, wherein the cloud server performs data processing according to coordinates of the calibration body, comprising:
and the cloud server performs preset calculation according to the coordinates of the probe, the coordinates of the calibration body and the coordinates of the femoral head rotation center to obtain a data processing result.
CN202310363723.7A 2023-04-07 2023-04-07 Surgical navigation system and surgical navigation method Pending CN116473674A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310363723.7A CN116473674A (en) 2023-04-07 2023-04-07 Surgical navigation system and surgical navigation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310363723.7A CN116473674A (en) 2023-04-07 2023-04-07 Surgical navigation system and surgical navigation method

Publications (1)

Publication Number Publication Date
CN116473674A true CN116473674A (en) 2023-07-25

Family

ID=87216985

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310363723.7A Pending CN116473674A (en) 2023-04-07 2023-04-07 Surgical navigation system and surgical navigation method

Country Status (1)

Country Link
CN (1) CN116473674A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040106861A1 (en) * 2002-12-03 2004-06-03 Francois Leitner Method of determining the position of the articular point of a joint
US20160106515A1 (en) * 2013-08-13 2016-04-21 Brainlab Ag Determining the Positional Information of Characteristic Points of a Leg for Osteotomy
CN218572207U (en) * 2022-06-30 2023-03-07 北京唯迈医疗设备有限公司 Adopt space positioning X ray real-time supervision device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040106861A1 (en) * 2002-12-03 2004-06-03 Francois Leitner Method of determining the position of the articular point of a joint
US20160106515A1 (en) * 2013-08-13 2016-04-21 Brainlab Ag Determining the Positional Information of Characteristic Points of a Leg for Osteotomy
CN218572207U (en) * 2022-06-30 2023-03-07 北京唯迈医疗设备有限公司 Adopt space positioning X ray real-time supervision device

Similar Documents

Publication Publication Date Title
CN110353806B (en) Augmented reality navigation method and system for minimally invasive total knee replacement surgery
US12059215B2 (en) Navigation system and method for joint replacement surgery
CN103211655B (en) A kind of orthopaedics operation navigation system and air navigation aid
US20190090955A1 (en) Systems and methods for position and orientation tracking of anatomy and surgical instruments
CN101904770B (en) Operation guiding system and method based on optical enhancement reality technology
US20220054200A1 (en) Calibration method and device for dental implant navigation surgery, and tracking method and device for dental implant navigation surgery
CN111281540A (en) Real-time visual navigation system based on virtual-actual fusion in minimally invasive surgery of orthopedics department
US20150077528A1 (en) Surgical navigation system and method
US8666476B2 (en) Surgery assistance system
CN104939925A (en) Triangulation-based depth and surface visualisation
CN109498156A (en) A kind of head operation air navigation aid based on 3-D scanning
TWI697317B (en) Digital image reality alignment kit and method applied to mixed reality system for surgical navigation
WO2017107116A1 (en) Navigation system for minimally invasive operation
CN106420054A (en) Anterior cruciate ligament stopping location and ligament tunnel location device combining with preoperative 3D planning information
CN204655073U (en) A kind of orthopaedics operation navigation system
CN103948432A (en) Algorithm for augmented reality of three-dimensional endoscopic video and ultrasound image during operation
US10383692B1 (en) Surgical instrument guidance system
CN107510504A (en) A kind of non-radioactive line perspective vision navigation methods and systems for aiding in bone surgery
CN110169821A (en) A kind of image processing method, apparatus and system
CN114668534A (en) Intraoperative implantation precision detection system and method for oral dental implant surgery
CN115836914A (en) A navigation method and device for endoscopic surgery based on video image augmented reality
TWI741196B (en) Surgical navigation method and system integrating augmented reality
TWI679960B (en) Surgical instrument guidance system
CN110638524B (en) A real-time simulation system for tumor puncture based on VR glasses
CN116473674A (en) Surgical navigation system and surgical navigation method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination