[go: up one dir, main page]

CN107146284A - Immersive VR medical treatment endoscope system and method - Google Patents

Immersive VR medical treatment endoscope system and method Download PDF

Info

Publication number
CN107146284A
CN107146284A CN201710305988.6A CN201710305988A CN107146284A CN 107146284 A CN107146284 A CN 107146284A CN 201710305988 A CN201710305988 A CN 201710305988A CN 107146284 A CN107146284 A CN 107146284A
Authority
CN
China
Prior art keywords
faultage image
human body
human
immersive
anatomic structure
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710305988.6A
Other languages
Chinese (zh)
Inventor
龚晓焰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiaao Information Technology Development Co Ltd
Original Assignee
Shanghai Jiaao Information Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiaao Information Technology Development Co Ltd filed Critical Shanghai Jiaao Information Technology Development Co Ltd
Priority to CN201710305988.6A priority Critical patent/CN107146284A/en
Publication of CN107146284A publication Critical patent/CN107146284A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/10Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/003Reconstruction from projections, e.g. tomography
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/08Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/32Image data format
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/41Medical

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Endoscopes (AREA)

Abstract

The invention discloses a kind of medical endoscope system of immersive VR, including:Faultage image placement unit;Human anatomic structure demarcates unit;Multi-source and multiple batches of faultage image integrated unit;Human anatomic structure electronic 3-D model reconstruction unit;Immersive VR endoscopic unit.The invention also discloses peep method in a kind of medical treatment of immersive VR.Operation is peeped in present invention implementation more to facilitate, simply;Operation is peeped in implementing need not increase patient's pain;Visual angle and visual field ratio existing scheme are wide.

Description

Immersive VR medical treatment endoscope system and method
Technical field
The present invention relates to a kind of medical imaging techniques, more particularly to a kind of medical endoscope system of immersive VR and side Method.
Background technology
Endoscope is to have concentrated traditional optical, ergonomics, precision optical machinery, hyundai electronicses, mathematics, software etc. in one Detecting instrument.One has imaging sensor, optical lens, light source illumination, mechanical device etc., and it can enter stomach with direct oral cavity It is interior or internal through the entrance of other natural holes.Using endoscope it can be seen that the lesion that X-ray can not be shown, therefore it is to doctor It is highly useful.
Endoscope operation is the technology that the sight glass that application can be sent into body cavities is checked and treated under directly perceived.It is divided into Non-invasive and traumatic two kinds.The former, which refers to, is inserted directly into endoscope, for check the cavity communicated with extraneous (such as alimentary canal, Respiratory tract, the urinary tract etc.);The latter is to send into endoscope by otch, for checking closed body cavity (such as thoracic cavity, abdominal cavity, joint Chamber etc.).
Electro-photographic formula is imaged with microelectric technique, imaged.Its profile is identical with fiber optic conduction endoscope.In will be various Peep eye-lens of the eyepiece with the connector of minisize pick-up head to be connected, you can include being observed image on video screen, imitate Fruit is similar to fujinon electronic video endoscope.Endoscope is divided into alimentary canal, urogenital tract, respiratory tract, body cavity and head member by purposes to be peeped Mirror etc..
In current endoscopic technique in place of Shortcomings, i.e.,:1st, area occupied is big, mobile inconvenient, not Portable belt.2、 Camera lens is stretched into patient body, and patient can be more painful.3rd, using camera lens variation, every kind of camera lens can only observe specific feature. If case needs to observe multiple features, it is necessary to repeatedly change camera lens, perform in repeatedly and peep operation, increase patient's pain.4th, grasp Make not intelligent enough.5th, trick can not be realized when doctor operates in the same direction, learning difficulty is very big.6th, have tunnel vision, it is difficult to it is determined that Observed position and the relative space relation of its hetero-organization.
The content of the invention
The purpose of the present invention be exactly in order to solve the above problems there is provided a kind of medical endoscope system of immersive VR, Effectively solve hold facility area greatly, movement is inconvenient, not Portable belt;Camera lens is stretched into patient body, and patient can be more painful;Doctor Trick can not be realized during raw operation in the same direction, learning difficulty is very big;Have tunnel vision, it is difficult to it is determined that observed position and its hetero-organization Relative space relation the problem of.
To achieve these goals, the present invention is adopted the following technical scheme that:Peeped in a kind of immersive VR medical treatment and be System, including:
Faultage image placement unit, for obtaining human body faultage image from medical imaging device;
Human anatomic structure demarcates unit, for demarcating different human body anatomical regions on faultage image;
Multi-source and multiple batches of faultage image integrated unit, for by the different medical imaging devices of same human body and not Faultage image fusion with imaging time is superimposed to form new faultage image;
Human anatomic structure electronic 3-D model reconstruction unit, is same as, by handling human body faultage image, rebuilding human body The electronic 3-D model of anatomical structure;
Immersive VR endoscopic unit, is same as three-dimensional comprising human anatomic structure to create one by computer Model virtual outdoor scene, allows visual angle of the user from endoscope, is entered in the way of immersing and is seen inside human anatomic structure Examine.
On the other hand, method is peeped in a kind of immersive VR medical treatment, comprised the following steps:
The step of for obtaining human body faultage image from medical imaging device;
The step of for demarcating different human body anatomical regions on faultage image;
For the faultage image fusion of the different medical imaging devices of same human body and different imaging times to be superimposed upon The step of forming new faultage image together;
It is same as by handling human body faultage image, the step of rebuilding the electronic 3-D model of human anatomic structure;
Be same as by computer with create one include human anatomic structure threedimensional model virtual reality, allow user from The visual angle of endoscope, enters the step of being observed inside human anatomic structure in the way of immersing.
Compared with prior art, the present invention has the advantages that:Operation is peeped in present invention implementation more to facilitate, letter Easily;Operation is peeped in implementing need not increase patient's pain;Visual angle and visual field ratio existing scheme are wide.
Brief description of the drawings
Fig. 1 is the medical endoscope system module map of immersive VR in embodiment.
Embodiment
Embodiment 1:Referring to Fig. 1, a kind of medical endoscope system of immersive VR, including:Faultage image placement unit, For obtaining human body faultage image from medical imaging device;Human anatomic structure demarcates unit, for being demarcated on faultage image Different human body anatomical regions;Multi-source and multiple batches of faultage image integrated unit, for the difference of same human body to be cured The faultage image fusion for learning image documentation equipment and different imaging times is superimposed to form new faultage image;Human anatomic structure Electronic 3-D model reconstruction unit, is same as, by handling human body faultage image, rebuilding the Computerized three-dimensional of human anatomic structure Model;Immersive VR endoscopic unit, is same as including the three-dimensional mould of human anatomic structure by computer to create one Type virtual reality, allows visual angle of the user from endoscope, is entered in the way of immersing and is observed inside human anatomic structure. It is described to be used to from the form that medical imaging device obtains human body faultage image be DICOM format.
Embodiment 2:Method is peeped in a kind of immersive VR medical treatment, is comprised the following steps:For being set from medical image The step of standby acquisition human body faultage image;The step of for demarcating different human body anatomical regions on faultage image;For The faultage image fusion of the different medical imaging devices of same human body and different imaging times is superimposed to form new The step of faultage image;It is same as, by handling human body faultage image, rebuilding the step of the electronic 3-D model of human anatomic structure Suddenly;It is same as including human anatomic structure threedimensional model virtual reality by computer to create one, user is peeped from interior The visual angle of mirror, enters the step of being observed inside human anatomic structure in the way of immersing.For being obtained from medical imaging device In the step of taking human body faultage image, the form of human body faultage image is DICOM format.
The preferred embodiment of the present invention is the foregoing is only, protection scope of the present invention is not limited in above-mentioned embodiment party Formula, every technical scheme for belonging to the principle of the invention belongs to protection scope of the present invention.For those skilled in the art Speech, some improvement carried out on the premise of the principle of the present invention is not departed from, these improvement also should be regarded as the protection model of the present invention Enclose.

Claims (4)

1. a kind of medical endoscope system of immersive VR, it is characterised in that including:
Faultage image placement unit, for obtaining human body faultage image from medical imaging device;
Human anatomic structure demarcates unit, for demarcating different human body anatomical regions on faultage image;
Multi-source and multiple batches of faultage image integrated unit, for by the different medical imaging devices of same human body and it is different into As the faultage image fusion of time is superimposed to form new faultage image;
Human anatomic structure electronic 3-D model reconstruction unit, is same as, by handling human body faultage image, rebuilding human dissection The electronic 3-D model of structure;
Immersive VR endoscopic unit, is same as including human anatomic structure threedimensional model by computer to create one Virtual reality, allows visual angle of the user from endoscope, is entered in the way of immersing and is observed inside human anatomic structure.
2. the medical endoscope system of immersive VR according to claim 1, it is characterised in that:It is described to be used for from medical science The form that image documentation equipment obtains human body faultage image is DICOM format.
3. peep method in a kind of immersive VR medical treatment, it is characterised in that comprise the following steps:
The step of for obtaining human body faultage image from medical imaging device;
The step of for demarcating different human body anatomical regions on faultage image;
For the faultage image fusion of the different medical imaging devices of same human body and different imaging times to be superimposed The step of forming new faultage image;
It is same as by handling human body faultage image, the step of rebuilding the electronic 3-D model of human anatomic structure;
It is same as including human anatomic structure threedimensional model virtual reality by computer to create one, user is peeped from interior The visual angle of mirror, enters the step of being observed inside human anatomic structure in the way of immersing.
4. method according to claim 3, it is characterised in that for obtaining human body faultage image from medical imaging device In step, the form of human body faultage image is DICOM format.
CN201710305988.6A 2017-05-03 2017-05-03 Immersive VR medical treatment endoscope system and method Pending CN107146284A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710305988.6A CN107146284A (en) 2017-05-03 2017-05-03 Immersive VR medical treatment endoscope system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710305988.6A CN107146284A (en) 2017-05-03 2017-05-03 Immersive VR medical treatment endoscope system and method

Publications (1)

Publication Number Publication Date
CN107146284A true CN107146284A (en) 2017-09-08

Family

ID=59774999

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710305988.6A Pending CN107146284A (en) 2017-05-03 2017-05-03 Immersive VR medical treatment endoscope system and method

Country Status (1)

Country Link
CN (1) CN107146284A (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060235671A1 (en) * 2005-04-19 2006-10-19 Kirchberg Klaus J Real-time virtual endoscopy
CN101849813A (en) * 2009-03-31 2010-10-06 上海交通大学医学院附属新华医院 3D Cardiac Ultrasound Virtual Endoscopy System

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060235671A1 (en) * 2005-04-19 2006-10-19 Kirchberg Klaus J Real-time virtual endoscopy
CN101849813A (en) * 2009-03-31 2010-10-06 上海交通大学医学院附属新华医院 3D Cardiac Ultrasound Virtual Endoscopy System

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
王永奋: "基于三维可视化技术的虚拟内窥镜研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
薛海虹 等: "先天性心脏病三维超声虚拟内窥镜可视化研究", 《中华超声影像学杂志》 *
邱明国 等: "医学图像融合", 《国外医学(临床放射学分册)》 *
陈家新: "《医学图像处理及三维重建技术研究》", 31 May 2010, 科学出版社 *

Similar Documents

Publication Publication Date Title
CN105942959B (en) Capsule endoscope system and its three-D imaging method
CN103298391B (en) disposable endoscopic access device and portable display
KR101971935B1 (en) Single-use, port deployable articulating endoscope
CN114795472B (en) Apparatus and method for tracking the position of an endoscope within a patient's body
WO2016195401A1 (en) 3d glasses system for surgical operation using augmented reality
US8858425B2 (en) Disposable endoscope and portable display
US9033870B2 (en) Pluggable vision module and portable display for endoscopy
CN101212926A (en) Portable Image Processing Device
WO2015156442A1 (en) 3d video microscope device
WO2016039915A2 (en) Systems and methods using spatial sensor data in full-field three-dimensional surface measurment
CN110169821A (en) A kind of image processing method, apparatus and system
CN113795187A (en) Single use endoscope, cannula and obturator with integrated vision and illumination
EP1705513A1 (en) System for the stereoscopic viewing of real-time or static images
CN206372021U (en) A kind of wireless visible endoscope
Hanna et al. Image display technology and image processing
TWI664950B (en) Vein detection device
CN114943802B (en) Knowledge-guided surgical interaction method based on deep learning and augmented reality
CN209750986U (en) Medical endoscope of virtual reality panorama
CN118280173A (en) Endoscope handle signal simulator and injection type digestive endoscope diagnosis and treatment simulation system
CN107146284A (en) Immersive VR medical treatment endoscope system and method
US11026560B2 (en) Medical display control apparatus and display control method
CN203736155U (en) Wireless visual ear-nose-throat endoscope
CN111193830B (en) A portable augmented reality medical image observation aid device based on smartphone
CN206372024U (en) A kind of wireless visible laryngoscope
CN109349988A (en) Portable ENT endoscope

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170908