KR101837763B1 - Medical video display device and the display method thereof - Google Patents

Abstract

A medical image display apparatus and a display method are disclosed. The medical image display apparatus of the present invention displays CT medical images on divided screens of the display device and displays 3D medical images of the same modality as those of the CT medical images on the other screens, , It is possible to improve the understanding of the patient and to make accurate diagnosis and to shorten the consultation time.

Description

[0001] MEDICAL VIDEO DISPLAY DEVICE AND DISPLAY METHOD THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video display device, and more particularly, to a medical image display device and a display method capable of dividing and displaying two related medical images into one display device.

Recently, methods and apparatuses for observing the internal structure of a body such as human tissue or various materials have been widely used in various fields.

Various internal transmission and tomographic imaging equipment such as an X-ray system, a computerized tomography (CT) scanner, a magnetic resonance image (MRI) apparatus and an ultrasound system These are examples.

These devices occupy an important position in the medical field by not directly cutting the internal structure of human body and organism, but also by understanding the cause, location and progress of various diseases.

Therefore, in such diagnostic equipment, low harmfulness to living things, high resolution image acquisition, reasonable price, and convenience of use and movement are recognized as important factors.

Medical imaging is a very important tool in the diagnosis of more effective diseases and treatment of patients. As the medical imaging technology develops, the types of medical images are becoming diverse and enormous.

In order to diagnose a disease more accurately, two or more medical images should be compared and analyzed in a complex manner.

However, in general, since a medical image display device displays only one image on one screen, it can not be judged by comparing two or more images.

KR Patent Publication No. 10-2014-0025639 (Apr.

In order to solve these problems, it is an object of the present invention to provide a medical image display apparatus and a display method which can display images related to two medical images in a multi-view manner.

It is another object of the present invention to provide a medical image display apparatus and a display method in which a screen displayed on a display device is automatically divided according to the number of input images.

In order to solve such a problem, in a medical image display apparatus for displaying a selected medical image of the present invention on one display device, the display device displays a 2D medical image on a divided screen, And display the 3D medical images of the modality, respectively.

The 2D image is a CT medical image, and includes an image input unit for inputting a 3D medical image and a 2D medical image, a coordinate analyzing unit for analyzing the 2D medical image and the 3D medical image input from the image input unit, When one medical image display is selected on the display device, any one of the two images is displayed, and when two medical image displays are selected, the control unit divides the display device into two, And a control unit for displaying two images, respectively.

The control unit divides and displays the two medical images input to the image input unit on the display device. When the selection unit is located in the displayed CT medical image, the coordinate of the selection unit is read by the image matching unit, Thereby displaying the region on the 3D medical image.

The control unit may divide and display the two medical images input to the image input unit on the display device, and enlarge the image of the area where the enlarged window is displayed, In a pop-up window.

Meanwhile, a medical image display method for displaying a selected medical image on a divided screen of a display device includes the steps of: (a) determining the number of images input to the image input unit; and (b) (C) when the two images are input in the step (a), dividing the display device into two and inputting two images to be displayed on the divided screen, respectively, And a step of performing the step of:

(C-1) determining whether the image input in the step (a) is a 3D medical image having the same modality as the CT medical image, (c-2) (2) dividing the display device into two images and displaying the two images input on the divided screen, and (c-3) if the two images input in the step if it is determined that the two images input in the step (c-1) are not the 3D medical images having the same modality as the CT medical image, the step of displaying the input image on the display device without dividing the display device into two parts can do.

In the step (c), the two medical images input to the image input unit are divided and displayed on the display device. When the enlarged window is positioned on any one of divided images, the enlarged image of the enlarged window is enlarged and displayed And displaying a different image with a pop-up window.

Therefore, according to the medical image display apparatus and the display method of the present invention, since related images are simultaneously displayed and combined, it is possible to diagnose one disease more accurately.

In addition, according to the medical image display apparatus and the display method of the present invention, since images to be compared can be selected and compared with each other, misdiagnosis can be reduced by comparing various images.

Further, according to the medical image display apparatus and the display method of the present invention, since the image is displayed in multi-image, the understanding degree of the patient can be improved and the examination time can be shortened due to complex findings.

According to the medical image display apparatus and the display method of the present invention, the screen of the display device is divided according to the number of images to be selected, and the selected image is displayed. Therefore, the image can be efficiently compared and diagnosed.

1 is a main configuration diagram of a medical image display apparatus according to an embodiment of the present invention,
2 is a diagram illustrating an example of displaying a first image according to an exemplary embodiment of the present invention on a display device,
3 is a diagram illustrating an example of displaying two images on a display device according to an embodiment of the present invention,
4 is a diagram illustrating an example of displaying an enlarged image according to an exemplary embodiment of the present invention on a display device,
5 is a diagram illustrating an example of displaying a coordinate image according to an embodiment of the present invention on a display device,
And
6 is a flowchart illustrating a medical image display method according to an embodiment of the present invention.

It is to be understood that the words or words used in the present specification and claims are not to be construed in a conventional or dictionary sense and that the inventor can properly define the concept of a term in order to describe its invention in the best possible way And should be construed in light of the meanings and concepts consistent with the technical idea of the present invention.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise. It should be noted that the terms such as " part, "" module, " .

It is to be understood that the term "and / or" throughout the specification includes all possible combinations from one or more related items. For example, the meaning of "first item, second item and / or third item" may be presented from two or more of the first, second or third items as well as the first, second or third item It means a combination of all the items that can be.

Identification codes (e.g., a, b, c, ...) in each step throughout the specification are used for convenience of description, and the identification codes do not limit the order of each step, Unless the context clearly states a particular order, it may take place differently from the stated order. That is, each step may occur in the same order as described, may be performed substantially concurrently, or may be performed in reverse order.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a main configuration diagram of a medical image display apparatus according to an embodiment of the present invention. As shown in FIG. 1, the image display apparatus of the present invention divides a display device into two, In order to make a more accurate diagnosis of a disease.

To this end, the medical image display apparatus of the present invention includes a first image input unit 120 and an Nth image input unit 130, which receive a plurality of medical images, and a medical image And a control unit 110 for displaying the divided information on the display device 140 in a divided manner.

In the present invention, there may be a plurality of images having the same modality, but for convenience of description, a 3D medical image and a CT as a 2D medical image will be described as an example.

The first image input unit 120 and the Nth image input unit 130 may be configured to receive different medical images, or may receive input of images through communication, or may be a USB, a CD, or an image stored in the storage unit 170 To the control unit 110, as shown in FIG.

The control unit 110 counts the number of images input from the image input units 120 and 130 and displays one image on the display unit 140 when one image is input and judges that two images are input The display device 140 is controlled so as to be divided into two, and two images input from the image input units 120 and 130 are displayed on divided screens on the two divided screens.

The control unit 110 divides the display device 140 into two parts when two medical images having the same modality are input to the respective video input parts 120 and 130. When the medical images have different modalities, (140).

Of course, the controller 110 may display one medical image according to the selection of the screen, or display two medical images having the same modality at the same time, or two images having different modalities.

That is, the button menu is displayed on the display device 140, and the selected menu is divided into one screen or two screens according to the selection of the button, and the selected image is displayed.

In the present invention, for convenience of description, two images are automatically displayed on the screen. However, the present invention is not limited thereto.

To this end, the present invention includes a selecting unit 180 for displaying a selected image on the display device 140 when a plurality of images having different modalities are input.

That is, the selector 180 selects a specific medical image and displays it on the display device 140 when images having different modalities are inputted through the image input units 120 and 130.

Referring to FIG. 2, a first image according to an exemplary embodiment of the present invention is displayed on a display device. Referring to FIG. 2, The screen is displayed without being divided.

3, the display device 140 may be divided into a first divided screen 141 and a second divided screen (i.e., a first divided screen 141 and a second divided screen 142) 142, and a CT image, which is a 2D image, is displayed on the first divided screen 141, and a 3D image of a mandible is displayed on the second divided screen 142. [

That is, the 2D CT image and the 3D mandible image have the same modality.

In this case, if the control unit 110 is a CT image having the same modality as the image (mandible 3D image) shown in FIG. 2, the display unit 140 is divided and displayed as shown in FIG. 3. However, So that the selected image is displayed without dividing the display device 140.

As described above, since the display device 140 of the present invention is required to display a 3D image, it can naturally be configured as a device capable of 3D image representation.

When the two medical images inputted to the image input units 120 and 130 are divided and displayed on the display device 140 and the enlarged window is located in any one of the divided images, A selection unit 180 is provided with a button for enlarging the image and displaying it in a pop-up window on another divided image.

Referring to FIG. 4, an enlarged image according to an embodiment of the present invention is displayed on a display device. When an enlarged window 143 is positioned on a mandible CT image displayed on a first divided screen 141 , And the enlarged image display screen 144 is displayed as a pop-up window on the second divided screen 142.

The image display apparatus is generally mounted on a PC, and therefore, it is preferable that the enlarged image button of the selection unit 180 is displayed using the right button of the mouse.

In addition, when the CT image and the 3D image are displayed on the divided screen, when the mouse is positioned at a predetermined position of the CT image using the mouse window of the PC, the controller 110 may determine that a pointer to the position of the mouse It is possible to display the exact position on the 3D image to be compared and easily understand the disease location.

To this end, the present invention further includes a coordinate analysis unit 160 for analyzing and matching the coordinates of an input image when the same medical image but different medical images are displayed on the display device 140.

The coordinate analysis unit 160 analyzes the coordinates of the two medical images input from the image input units 120 and 130, and when a predetermined region is selected from the CT image, the coordinate analysis unit 160 displays a region corresponding to the coordinates in the 3D image.

Referring to FIG. 3, a mandibular CT image is displayed on the first divided screen 141 on the left side, and a 3D image of the mandible is displayed on the second divided screen 142.

In this screen, if the mouse of the selection unit 180 is positioned at a specific portion of the CT image displayed on the first divided screen 141, the coordinates of the portion where the mouse is positioned on the 3D image of the second divided screen 142 So that the corresponding position is displayed.

5, when a mouse is placed on the CT image of the first divided screen 141, the second divided screen (the left divided screen) A pointer to the place where the mouse is located is displayed.

In addition, when the position of the mouse indicates a predetermined position inside the 3D image, the pointer can be indicated by a dotted line to indirectly indicate that the 3D image is located inside the 3D image.

For example, the coordinate analysis unit 160 first sets reference points in the respective CT images, and analyzes the images based on the reference points to obtain coordinates of X, Y, and Z.

Referring to FIG. 5, CT images are displayed as four images. Since the individual images are located on the same plane, for example, individual images have the same Z coordinate. Therefore, By analyzing only Y coordinates, you can obtain X, Y, Z for all images.

After determining the position of the reference point of the CT image at the corresponding position in the 3D image, the X, Y and Z coordinates of each image can be obtained.

Accordingly, when the mouse is positioned on a predetermined portion of the CT image, the controller 110 reads the X, Y, and Z coordinates of the location of the mouse at the coordinate analyzer 160, and displays the pointer at the corresponding position on the 3D image You can.

Preferably, the 3D image is automatically three-dimensionally moved according to the movement of the mouse so that the position indicated by the mouse can be easily identified on the 3D screen.

The coordinate analysis unit 160 corresponds to a kind of image matching. In order to perform more specific image matching, the present invention may be configured to further include the image matching unit 150.

The image matching unit 150 may include a first matching step in which the 3D image and the CT image are roughly matched and a second matching step in which the matched image is refined in detail in the first matching, .

For example, in the first matching step, the 3D image is entirely matched with the CT image through the 3D image movement and rotation method.

More specifically, first, the size of the image is reduced to a predetermined size in one step.

Feature points are extracted for the image reduced to two steps. A Harris corner detector may be used as the extraction method.

After the feature points are extracted, the feature points of the CT image and the 3D image are matched in three steps. Points that match in the image can be obtained using Nearest-Neighborhood Distance Ratio (NNDR).

After the minutiae points are extracted, the image matching step can be completed by performing an algorithm of eliminating the mismatch in four steps and enlarging the reduced image to the final stage and displaying it as an original image.

The outlier removal by RANSAC using RANSAC SAmple Consensus (RANSAC) in the 4th step is an advantage of saving time and increasing the accuracy of the matching process. You can expect.

This can fundamentally eliminate the cause of the misalignment that may occur due to the different size of the CT image and the 3D image.

After the misalignment is removed, the image is matched as a whole through the movement and rotation method, and then the reduced image is enlarged to the original size to complete the image matching.

Needless to say, the image registration information at each stage is preserved.

Accordingly, the position of the mouse displayed on the CT image can be more accurately displayed on the 3D image by using the functions of the coordinate analysis unit 160 and the image matching unit 150. [

Hereinafter, a display method of the video display device having the above-described configuration will be described with reference to the drawings.

FIG. 6 is a flowchart illustrating a medical image display method according to an embodiment of the present invention. As shown in FIG. 6, the image display method of the present invention first determines the number of input images (S110).

In step S110, the controller 110 determines whether one image input through the one or more image input units 120 and 130 is input, that is, the first image.

For example, in step S110, when one image is input as the first image, the controller 110 displays the input first image on the display device 140 (S111).

It is determined whether the second image is input while the first image is displayed on the display device 140 in step S111. If it is determined that the second image is input, the first image and the second image are simultaneously displayed on the display device 140, (Step S113).

That is, in step S113, when two images are input, the display device 140 may divide two screens and display the two input images on the divided screens.

In addition, in step S113, it is determined whether the two images inputted by the control unit 110 have the same modality. If the modalities are the same, the display unit 140 is divided to display the input images.

That is, it is determined whether the input image is a 3D medical image having the same modality as the CT medical image. If the input two images are a 3D medical image having the same modality as the CT medical image, the display device 140 is divided into two, Are displayed on divided screens, respectively.

Accordingly, if it is determined that the two images have the same modality, the control unit 110 displays the input image on the display device 140 without dividing the display device into two parts.

In addition, the control unit 110 may control the coordinate analysis unit 160 and / or the image matching unit 150 to perform coordinate analysis and image matching when two input images have the same modality (S114).

If the first image and the second image are displayed on the divided screen in step S113, when the enlargement function is input, the enlarged image is displayed on the opposite image as a pop-up window (S115 to S116).

4, when the enlarged window 143 is displayed on the CT image displayed on the first divided screen 141, the enlarged image display screen 144 is displayed in the pop-up window on the 3D image displayed on the second divided screen will be.

As described above, according to the medical image display apparatus and the display method of the present invention, two images are displayed in a divided manner to increase the understanding degree of the patient, to enable accurate diagnosis with complex findings, and shorten the examination time .

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art.

110: control unit 120: first image input unit
130: Nth image input unit 140: Display device
141: first divided screen 142: second divided screen
143: Magnification window 144: Magnification image display screen
150: image matching unit 160: coordinate analyzing unit
170: storage unit 180:

Claims (7)

delete A medical image display device for dividing and displaying two or more selected medical images on one display device,
A 2D image is a CT medical image, an image input unit for inputting a 3D medical image and a 2D medical image;
A coordinate analyzer for analyzing the 2D medical image and the 3D medical image input from the image input unit and for matching coordinates;
When one medical image display is selected on the display device, any one of the two images is displayed, and when two medical image displays are selected, the control unit divides the display device into two, A control unit for displaying two images, respectively;
, ≪ / RTI &
The display device includes:
A 2D medical image is displayed on one divided screen and a 3D medical image having the same modality as the 2D medical image is displayed on another screen,
The control unit determines the number of images input to the image input unit, displays one image on the display device when one image is input, and divides the display device into two images Are displayed on the divided screens, respectively,
If the two images input through the control unit are 3D medical images having the same modality as the CT medical image, the display unit is divided into two and input Two images are displayed on divided screens, and if it is determined through the control unit that the two images inputted at the step are not 3D medical images having the same modality as the CT medical images, A medical image display device for displaying on a display device.
The method of claim 2,
The control unit
The two medical images input to the image input unit are divided and displayed on the display device, and when the selection unit is positioned in the displayed CT medical image, the coordinates of the selection unit are read by the coordinate analysis unit, A medical image display device for displaying on a video image.
The method of claim 3,
The control unit
When two medical images input to the image input unit are divided and displayed on the display device and an enlarged window is positioned on one of the divided images, the enlarged image of the enlarged window is enlarged and displayed in a pop- A medical image display device.
delete A medical image display method for displaying a selected medical image on a divided screen of a display device,
(a) determining the number of images input to the image input unit;
(b) displaying one image on the display device when one image is input in the step (a); And
(c) if the two images are input in the step (a), dividing the display device into two and displaying the input two images on the divided screens, respectively;
, ≪ / RTI &
The step (c)
(c-1) determining whether the image input in the step (a) is a 3D medical image having the same modality as the CT medical image through the controller;
(c-2) If the two images inputted in the step (c-1) through the controller are a 3D medical image of the same modality as the CT medical image, the display device is divided into two, Respectively; and
(c-3) If it is determined through the control unit that the two images inputted in the step (c-1) are not the 3D medical images having the same modality as the CT medical image, Displaying on the display device;
And displaying the medical image.
The method of claim 6,
The step (c)
When two medical images input to the image input unit are divided and displayed on the display device and an enlarged window is positioned on one of the divided images, the enlarged image of the enlarged window is enlarged and displayed in a pop- And displaying the medical image.

Images