WO2018195946A1

WO2018195946A1 - Method and device for displaying ultrasonic image, and storage medium

Info

Publication number: WO2018195946A1
Application number: PCT/CN2017/082485
Authority: WO
Inventors: 邹耀贤; 林穆清; 黄永; 陈志杰
Original assignee: 深圳迈瑞生物医疗电子股份有限公司
Priority date: 2017-04-28
Filing date: 2017-04-28
Publication date: 2018-11-01
Also published as: CN110087550B; CN110087550A

Abstract

A method and device for displaying an ultrasonic image, and a storage medium. The method for displaying an ultrasonic image comprises: matching three-dimensional volume data which is obtained by means of an ultrasonic probe (110) scanning a target tissue with imported organ model data corresponding to the target tissue, so as to obtain a correlation; obtaining, according to the correlation, the section position, relative to the organ model data, of at least one of one or more section images in the three-dimensional volume data; and then displaying a planar image mark at a corresponding position, on an organ map, of a plurality of section positions. Thus, the section position, in a real organ, of a section image of displayed three-dimensional volume data is hinted by means of displaying a planar image mark on an organ map, thereby facilitating a doctor in understanding the section position, in the real organ, of the section image of the three-dimensional volume data.

Description

Ultrasound image display method, device and storage medium

Technical field

[0001] The present invention relates to an ultrasonic image display method and apparatus.

Background technique

[0002] Ultrasonic instruments are generally used by doctors to observe the internal tissue structure of the human body. The doctor places the ultrasound probe on the surface of the skin corresponding to the human body part, and an ultrasound image of the part can be obtained. Ultrasound has become one of the main aids for doctors' diagnosis because of its safety, convenience, losslessness and low cost.

[0003] In recent years, three-dimensional ultrasound has been widely used in clinical practice. The reason is that three-dimensional ultrasound can completely detect a tissue or an organ with a scan, and then the doctor can perform the clinical needs by post-processing such as rotation and translation. The cut surface is adjusted, which greatly reduces the doctor's scan time, and also facilitates data storage.

[0004] However, the three-dimensional space is relatively abstract, and the existing ultrasound equipment lacks a clear orientation indication, which makes it difficult for many doctors to associate the three-dimensional spatial position with the actual organ, which limits the three-dimensional ultrasound to a certain extent in clinical practice. use.

technical problem

[0005] The present invention mainly provides an ultrasonic image display method and apparatus, which can display a cut surface image in a real organ by displaying a planar image mark on an organ map, so that the doctor can associate the cut image with the actual organ. Visually capture the cut surface position of the cut image in the real organ, which helps the doctor diagnose the cut image.

Problem solution

Technical solution

[0006] According to a first aspect, an embodiment provides an ultrasound image display method, including:

[0007] controlling the probe to scan the target tissue to obtain three-dimensional volume data;

Importing organ model data corresponding to the target tissue;

[0009] matching the three-dimensional volume data with the organ model data to obtain a correspondence relationship;

[0010] displaying one or more cut surface images in the three-dimensional volume data; [0011] obtaining, according to the correspondence relationship, a cut surface position of at least one of the one or more slice images relative to the organ model data;

[0012] displaying the organ model data to obtain an organ map;

[0013] A planar image marker is displayed at a corresponding location on the organ map at the location of the slice.

[0014] In an embodiment, the planar image marker comprises a planar region and/or a line segment, wherein the planar region is enclosed by a line segment and/or a curved segment.

[0015] In an embodiment, the organ map is a three-dimensional map or a two-dimensional plan.

[0016] In an embodiment, the ultrasound image display method further includes:

[0017] activating the facet image;

[0018] obtaining a current slice location of the activated slice image relative to the organ model data according to the correspondence relationship;

[0019] A planar image mark is displayed at a corresponding position on the organ map at the current slice position.

[0020] In an embodiment, the organ map and the planar image indicia are distinguished by setting transparency and/or color on the organ map.

[0021] In an embodiment, when a plurality of planar image marks 包括 are included, different planar image marks are distinguished by setting transparency and/or color.

[0022] In an embodiment, the method for displaying an ultrasound image further includes: receiving an instruction for a position change of the slice image by a user, and when the position of the slice image is changed, a plane image corresponding to the slice image is associated The position of the marker on the organ map is also updated.

[0023] In an embodiment, the importing the organ model data corresponding to the target tissue includes:

[0024] acquiring an organ type corresponding to the target tissue, which includes at least one of the following ways:

[0025] providing a selection or input interface for the user to select or input an organ type;

[0026] automatically identifying an organ type corresponding to the target tissue according to the three-dimensional volume data;

[0027] The organ model data of the organ type is introduced according to the acquired organ type.

[0028] In an embodiment, the method further includes:

[0029] obtaining an ultrasound image according to the three-dimensional volume data, the ultrasound image comprising a two-dimensional ultrasound image or a three-dimensional ultrasound image;

Receiving an instruction by a user to adjust the ultrasound image or the organ map, adjusting the organ according to the instruction Figure or display orientation of the ultrasound image.

[0031] According to a second aspect, an ultrasound image display device is provided in an embodiment, including:

[0032] a probe;

[0033] a transmit/receive control circuit, configured to control the probe to scan the target tissue to obtain three-dimensional volume data;

[0034] a data processor, configured to generate one or more aspect images in the three-dimensional volume data; import organ model data corresponding to the target tissue, and generate an organ map according to the organ model data; The three-dimensional volume data is matched with the organ model data to obtain a correspondence relationship, and according to the correspondence relationship, a cut surface position of at least one of the one or more aspect images relative to the organ model data is obtained, and the organ is A plane image mark is generated on the map at a corresponding position of the cut surface position;

And [0035] a display for displaying one or more aspect images generated by the data processor, displaying the organ map and displaying the planar image mark at a corresponding position on the organ map at the cut surface position.

[0036] In an embodiment, the planar image marker comprises a planar region and/or a line segment, wherein the planar region is surrounded by a line segment and/or a curved segment.

[0037] In an embodiment, the organ map is a three-dimensional map or a two-dimensional plan.

[0038] In an embodiment, the data processor is further configured to acquire an instruction to activate a slice image, and obtain a current slice position of the current slice image relative to the organ model data according to the corresponding relationship;

[0039] The display is further configured to display a planar image mark at a corresponding position of the current slice position on the organ map.

[0040] In an embodiment, the data processor is further configured to distinguish the organ map and the planar image marker by setting a transparency and/or a color.

[0041] In an embodiment, when a plurality of planar image marks are included, the data processor is further configured to distinguish different planar image marks by setting transparency and/or color.

[0042] In an embodiment, the ultrasonic image display device further includes an input unit, configured to receive an instruction that the user performs a position change on the slice image, and when the position of the slice image changes, the data processor is to be The position of the corresponding planar image mark associated with the facet image on the organ map is also updated and displayed by the display.

[0043] In an embodiment, the data processor is further configured to automatically identify the target organization according to the three-dimensional volume data. The organ type data of the organ type is imported according to the type of the organ that is automatically recognized.

[0044] In an embodiment, the data processor obtains an ultrasound image according to the three-dimensional volume data, receives an instruction of a user to adjust the ultrasound image or the organ map, and adjusts the organ map or the location according to the instruction. The display orientation of the ultrasound image, wherein the ultrasound image comprises a two-dimensional ultrasound image or a three-dimensional ultrasound image

[0045] In an embodiment, the display is further configured to provide a selection or input interface for the user to select or input an organ type, and the data processor imports the organ model data of the organ type according to the organ type input by the user.

According to a third aspect, an embodiment provides a storage medium storing a program executable by the processor to implement the ultrasound image display method disclosed in any of the above embodiments.

Advantageous effects of the invention

Beneficial effect

[0047] According to the ultrasonic image display method, device and storage medium of the above embodiment, the three-dimensional volume data is matched with the organ model data to obtain a correspondence relationship; and the one or more slice images are obtained according to the correspondence relationship a cut surface position of at least one of the cut surface images relative to the organ model data; and at the corresponding position of the cut surface position on the organ map, displaying the planar image mark, thereby displaying the cut surface image of the displayed three-dimensional volume data in the real organ The position of the cut surface is indicated by displaying a flat image mark on an organ map, which is convenient for the doctor to understand the cut surface position of the cut image of the three-dimensional volume data in the actual organ.

Brief description of the drawing

DRAWINGS

1 is a flow chart of an ultrasonic image display method according to an embodiment of the present invention;

2 is a flowchart of a method for displaying an ultrasound image according to an embodiment of the present invention, and importing data of an official model corresponding to the target tissue;

3 is a partial flow chart of an ultrasonic image display method according to another embodiment of the present invention;

4 is a schematic structural diagram of an ultrasonic image display device according to an embodiment of the present invention;

[0052] FIG. 5 is a schematic diagram of an effect in an embodiment of the present invention;

6 is a diagram showing changes in a planar marker image after positional movement of a sliced image according to an embodiment of the present invention; Schematic diagram

7 is a schematic diagram showing the effect of the organ image as a two-dimensional plan 吋 in an embodiment of the present invention, wherein FIG. 7( a) is a section image, and FIG. 7 (b) is a plane on the organ diagram and the organ diagram. Image tag

8 is a schematic diagram showing the effect of organ images in a plurality of plane image marks in an embodiment of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

[0056] The description of the preferred embodiment of the invention is entered here.

Embodiments of the invention

DETAILED DESCRIPTION

[0058] The present invention will be further described in detail below with reference to the accompanying drawings. Similar elements in different embodiments employ associated similar component numbers. In the following embodiments, many detailed descriptions are made to enable the present application to be better understood. However, those skilled in the art can easily recognize that some of the features may be omitted in different situations, or may be replaced by other components, materials, and methods. In some cases, some of the operations related to the present application are not shown or described in the specification, in order to avoid that the core portion of the present application is overwhelmed by excessive description, and those skilled in the art will describe these in detail. Related operations are not necessary, they can fully understand the relevant operations according to the description in the manual and the general technical knowledge in the field.

In addition, the features, operations, or characteristics described in the specification may be combined in any suitable manner to form various embodiments. In the meantime, the steps or actions in the method description can also be sequentially changed or adjusted in a manner apparent to those skilled in the art. Therefore, the various orders in the specification and the drawings are only for the purpose of describing a particular embodiment, and are not intended to be a necessary order unless otherwise indicated.

[0060] The serial numbers themselves, such as "first", "second", etc., are used herein to distinguish only the described objects, and do not have any order or technical meaning. The terms "connection" and "connection" as used in this application include direct and indirect connections (connections) unless otherwise stated.

[0061] In ultrasound imaging, three-dimensional volume data can be acquired, and then its slice image is displayed. A cut image is an image of a plane in which a certain slice is located in three-dimensional volume data. Similar to 2D ultrasound images, 3D volume According to the cut-off image, a cross-sectional image is displayed, so the lack of spatial information, coupled with the complicated operation of the ultrasound, makes it difficult for the doctor to map the cut-off image of the three-dimensional volume data with the actual organ. By matching the three-dimensional volume data with the organ model data, the present invention further obtains the cut surface position of the displayed three-dimensional volume data with respect to the organ model data, and finally displays the cut surface image of the displayed three-dimensional volume data in the real organ. The position is indicated by displaying a flat image mark on an organ map, which is convenient for the doctor to understand the cut surface position of the cut image of the three-dimensional volume data in the actual organ.

[0062]

Embodiment 1

[0064] Please refer to FIG. 1, an embodiment of the present invention provides an ultrasonic image display method, including steps S10~S70.

[0065] Step S10: The control probe scans the target tissue to obtain three-dimensional volume data. The ultrasound probes mentioned in this article can be either 1D probes or area array probes. The three-dimensional volume data may be volume data obtained by the area array probe, or three-dimensional volume data obtained by three-dimensional reconstruction after obtaining multi-frame two-dimensional ultrasound images by other types of probes, or may be STIC (Skull associated imaging, Spatiotemporal) Image

Correlation) Data acquired by technology or one or more volumes of 3D volume data in 4D ultrasound data

[0066] Step S20: Importing organ model data corresponding to the target tissue. Referring to FIG. 2, in an embodiment, step S20 includes step S21 and step S23.

[0067] Step S21: Obtain an organ type corresponding to the target tissue. Commonly used organ types can be fetal heart, fetal brain, adult heart, liver, pelvic floor and endometrium. The determination of the organ type can be determined by a manual method, for example, providing an interface for the user to select the type of the organ; or automatically identifying the organ type of the target tissue based on the acquired three-dimensional volume data, for example, some machine learning methods can be employed. To classify three-dimensional volume data, specifically, collect a large amount of target data (called a positive sample) and non-target data (called a negative sample), and then learn a feature that can distinguish between positive and negative samples by designing a machine learning algorithm. These features are used to determine which type of organ the input 3D volume data belongs to. Common machine learning methods include support vector machine, neural network, convolutional neural network (CNN), and recurrent neural network (RNN). Therefore, in an embodiment, step S21 acquires an organ type corresponding to the target tissue, and at least includes one of the following methods: [0068] (1) Providing a selection or input interface for the user to select or input an organ type.

[0069] (2) automatically identifying the organ type corresponding to the target tissue based on the three-dimensional volume data.

[0070] Step S23: Importing organ model data of the organ type according to the acquired organ type.

[0071] Step S30: Matching the foregoing three-dimensional volume data with the organ model data to obtain a correspondence relationship.

[0072] After the organ model data is imported in step S20, the three-dimensional volume data can be matched with the organ model data in the next step. There are many ways to match. For example, in the imported organ model data, the position of some key anatomical structures in the organ model data can be obtained. Because the corresponding image position on the organ model is displayed, it is used to help The doctor understands the position of the cut surface image of the three-dimensional volume data in the actual organ, so it is not necessary to display the position of the cut surface on the organ model. In order to reduce the calculation amount of the matching, it is assumed that the three-body data and the organ model data are linearly transformed. Relationship, the linear transformation relationship may be a rigid body transformation or a non-rigid body transformation. By obtaining the corresponding positions of some key anatomical structures in the three-dimensional volume data in the organ model data, the transformation relationship between the two can be calculated by least squares estimation, data fitting, Ransac and the like. It may be assumed that the three-body data and the organ model data are rigid body transformations, and the transformation relationship between the two can be represented by a matrix. If the organ model data is data of a three-dimensional model, then at least three points are determined in space. The transformation relationship between the two can be established. If the organ model data is the data of a two-dimensional model, then at least the position of the two points can be determined to establish a transformation relationship between the two.

[0073] It can be seen that the matching relationship between the three-dimensional volume data and the organ model data is established by matching, or the corresponding relationship, the key is to acquire the spatial position of some specific anatomical structures in the three-dimensional volume data, which can be based on the three-dimensional volume data. Actually corresponding organs to select some anatomical structures in the organ that are easy to locate and identify. For example, in the three-dimensional body data of the fetal brain, the anatomical features of the skull aura, sagittal plane, cerebellum and transparent compartment are relatively obvious. It is easier to identify. After knowing the spatial position of these anatomical structures, the matching relationship and correspondence between the three-dimensional volume data and the brain organ model data can be established. For example, in the three-dimensional data of fetal heart, the anatomical features of the aorta, the four-chamber heart and the gastric vesicle are more obvious, and it is easier to identify. After knowing the spatial position of the aorta, the four-chamber heart and the stomach bubble, the fetus can be established. The matching relationship and correspondence relationship between the three-dimensional body data of the heart and the fetal heart model data.

[0074] There are many methods for identifying and locating anatomical structures. For example, in the first method, the corresponding algorithm can be designed according to the characteristics of the anatomical structure. For example, the structure of the stomach cavity in the fetal heart volume image data is usually low. An echogenic or anechoic ellipsoidal target can be segmented by image segmentation. Specifically, the three-dimensional volume data may be firstly binarized, and some necessary morphological operations are performed to obtain a plurality of candidate regions, and then each candidate region is judged according to the shape and the like to determine the probability that the region is a gastric sac, and the probability of selection The highest area is the area of the stomach bubble. For example, in the second way, template matching can also be used to detect some key anatomical structures in the three-dimensional volume data. For example, the transparent compartment in the brain is shaped like a crescent, and the data of the transparent compartment can be collected in advance to establish a template. Detecting 吋 traversing all possible regions in the volume data, matching the template with similarity, and selecting the region with the highest similarity as the target region. For example, in the third way, a machine learning method can be used to detect some key anatomical structures in the three-dimensional body data. For example, the cerebellum in the brain can collect a certain number of cerebellum images in advance, which is called a positive sample, and collect a certain number of The non-cerebellar image, called the negative sample, then the machine learning algorithm is designed to automatically learn the features that can distinguish between the positive and negative samples. Using these features to detect all the possible regions in the 3D volume data, the region is judged as The probability of positive samples, the region with the highest probability of selection is the target region. Commonly used machine learning algorithms can include Adaboost algorithm, support vector machine (SV M), neural network algorithm, deep learning algorithm and so on.

[0075] Step S40: Display one or more aspect images in the foregoing three-dimensional volume data. For example, you can display a cut image or you can display multiple different cut images on one display.

[0076] Step S50: Obtain a tangent position of at least one of the one or more aspect images relative to the organ model data according to a matching correspondence between the three-dimensional volume data and the organ model data.

[0077] Step S60: Display the aforementioned organ model data to obtain an organ map. In one embodiment, the aforementioned organ map is a three-dimensional map or a two-dimensional plan.

[0078] Step S70: displaying a planar image mark on the aforementioned organ map at a corresponding position of the aforementioned slice position. In an embodiment, the planar image indicia may comprise planar regions and/or line segments, wherein the planar regions are enclosed by line segments and/or curved segments. In one embodiment, to better distinguish between the planar image markers on the organ map and the organ map, the aforementioned organ map and planar image markers can be distinguished by setting the transparency and/or color. Similarly, in an embodiment, when a plurality of planar image marks 包括 are included, for example, it is required to display a cut surface position 多个 of a plurality of cut image on the organ model, different plane image marks can be distinguished by setting transparency and/or color. .

[0079] In determining the position of the cut surface on which the cut image is to be displayed on the organ model, the cut surface map can be activated Like to determine. Therefore, in an embodiment, the ultrasonic image display method further includes: activating the slice image, and obtaining a current slice position of the activated slice image relative to the organ model data according to a matching correspondence between the three-dimensional volume data and the organ model data, A planar image mark is displayed at a corresponding position on the organ map at the current slice position. In the activation of the facet image, the selected slice image may be activated according to an instruction issued by a mouse or a keyboard, etc., by using a mouse as an example, the face image is activated by capturing the cursor of the mouse on the display screen, so that the user can move the mouse by moving the mouse. The cursor, to display the cut surface image that needs to be understood on the organ model's cut surface position, to help you better understand the current cut image. Therefore, referring to FIG. 3, in an embodiment, the ultrasonic image display method may further include steps S71-S77.

[0080] Step S71: Acquire the position of the current cursor.

[0081] Step S73: determining a current slice image corresponding to the position of the current cursor, for activating the current slice image. Of course, in other embodiments of the invention, it is also possible to activate a desired slice by means of a button.

[0082] Step S75: Obtain a current slice position of the current slice image relative to the organ model data according to the foregoing correspondence relationship.

[0083] Step S77: displaying a plan view image mark at a corresponding position on the aforementioned organ map at the position of the current cut surface.

[0084] In addition, the user can also change the cut surface position of the cut image by rotating and translating the displayed cut image, so that the cut image is also changed according to the actual shape, and the cut surface position on the organ model is required at this time. The change is also realized, that is, the plane image mark corresponding to the face image on the organ map is also changed, so that the user can know the actual position of the face image in the organ. Therefore, in an embodiment, the ultrasonic image display method may further include: receiving an instruction for the user to change the position of the cut image, and when the position of the cut image changes, the planar image corresponding to the cut image is marked on the organ map. The location is also updated.

[0085] Of course, in still another embodiment of the present invention, the following steps may be further included: [0086] obtaining an ultrasound image according to the foregoing three-dimensional volume data, where the ultrasound image includes a two-dimensional ultrasound image or a three-dimensional ultrasound image And then adjusting the display orientation of the aforementioned organ map according to the received instruction based on the received user's adjustment of the aforementioned ultrasound image. For example, when the user observes the three-dimensional ultrasound image displayed on the interface, If the orientation of the three-dimensional ultrasound image is adjusted, the organ map can also change the display orientation as the user adjusts the three-dimensional ultrasound image. On the other hand, when the orientation command of the aforementioned organ map is adjusted according to the received user, the orientation of the aforementioned ultrasonic image can be adjusted according to the instruction. For example, in detecting the condition of the fetus in the maternal amniotic fluid, when the user adjusts the organ map characterizing the fetus to face the user, the system automatically associates it with the three-dimensional ultrasound image, and the fetus is imaged by three-dimensional image rendering and image segmentation processing algorithms. The face is gradually rotated to the orientation facing the user, thereby realizing the linkage of the ultrasound image and the organ map azimuth adjustment, thereby facilitating image adjustment and browsing.

[0087]

[0088] Embodiment 2:

Referring to FIG. 4, the present invention also provides an ultrasonic image display apparatus including a probe 110, a transmitting/receiving control circuit 120, a data processor 130, and a display 140.

[0090] The probe 110 includes at least one array element for transmitting ultrasonic waves according to an excitation electric signal output from the transmission/reception control circuit 120, or converting the received ultrasonic waves into electrical signals. Thus each element can be used to transmit ultrasound to the target tissue, as well as to receive ultrasound echoes that are returned by the tissue. After performing an ultrasonic test, the array and the received sequence can be used to control which array elements are used to transmit ultrasonic waves, which array elements are used to receive ultrasonic waves, or to control the array element gaps for transmitting ultrasonic waves or receiving ultrasonic echoes. The array elements participating in the ultrasonic transmission may be excited by the electric signal to transmit the ultrasonic waves simultaneously; or the array elements participating in the ultrasonic beam emission may also be excited by a plurality of electrical signals having a certain inter-turn interval, so that the continuous emission has a certain inter-turn interval. Ultrasound.

[0091] The transmit/receive control circuit 120 is for controlling the probe 110 to transmit an ultrasonic beam to the target tissue, and on the other hand for controlling the probe 110 to receive the ultrasonic echo of the ultrasonic beam reflected by the tissue. In a specific embodiment, the transmit/receive control circuit 120 is configured to generate a transmit sequence and a receive sequence, the transmit sequence is configured to control part or all of the plurality of array elements to transmit ultrasonic waves to the target tissue, and the transmit sequence parameters include the number of array elements for transmission. And ultrasonic emission parameters (such as amplitude, frequency, number of waves, emission interval, emission angle, wave pattern, etc.). The receiving sequence is used to control some or all of the plurality of array elements to receive the echoes of the ultrasonic tissue, and the receiving sequence parameters include the number of array elements for receiving and the receiving parameters of the echo (eg, receiving angle, depth, etc.). The ultrasonic parameters in the transmitted sequence and the echo parameters in the received sequence are also different for different purposes of ultrasonic echo or depending on the image generated by the ultrasonic echo. In an embodiment of the invention, The transmit/receive control circuit 120 is configured to control the probe 110 to scan the target tissue to obtain three-dimensional volume data.

[0092] The data processor 130 is configured to generate one or more aspect images of the foregoing three-dimensional volume data; import organ model data corresponding to the target tissue, and generate an organ map according to the organ model data; and the foregoing three-dimensional volume data Matching with the organ model data to obtain a correspondence relationship, and obtaining, according to the foregoing correspondence relationship, a cut surface position of at least one of the one or more cut surface images relative to the organ model data, and located at the cut surface position on the organ map At the corresponding position, a planar image marker is generated.

[0093] The data processor 130 introduces the organ model data corresponding to the target organization, and there are many ways, for example, the first method, the data processor 130 automatically recognizes the organ type corresponding to the target tissue according to the three-dimensional volume data, according to the automatic identification. The organ type is imported into the organ model data of the organ type; for example, in the second mode, the data processor 130 imports the organ type data of the organ type according to the organ type input by the user, wherein the display 140 provides a selection or input interface for the user to select or input. Organ type.

[0094] The display 140 is configured to display one or more aspect images generated by the data processor, display the aforementioned organ map, and display the aforementioned planar image mark at a corresponding position on the aforementioned organ map at the aforementioned slice position. In one embodiment, the displayed organ map is a three dimensional view or a two dimensional plan view. In an embodiment, the planar image indicia comprises planar regions and/or line segments, wherein the planar regions are surrounded by line segments and/or curved segments. In one embodiment, to better distinguish between the planar image markers on the organ map and the organ map, the aforementioned organ map and planar image markers can be distinguished by setting the transparency and/or color. Similarly, in an embodiment, when a plurality of planar image marks 包括 are included, for example, it is required to display a cut surface position 多个 of a plurality of cut image on the organ model, different plane image marks can be distinguished by setting transparency and/or color.

[0095] In determining the facet position of the facet image to be displayed on the organ model, the facet image may be determined by activating the facet image, and thus, in an embodiment, the data processor 130 is further configured to acquire an instruction to activate the facet image. And obtaining, according to the correspondence relationship, a current slice position of the activated slice image relative to the organ model data, and correspondingly, the display 140 is configured to display the plane image at the corresponding position of the current slice position on the organ map. mark. For example, the data processor 130 acquires an instruction for activating the cut image, which may be issued by moving a mouse or pressing a button. For example, the mouse may be determined by capturing a cursor of the mouse on the display screen. Which aspect images are activated, In this way, the user can display the cut surface image of the cut surface on the organ model by moving the cursor of the mouse to help him better understand the current cut image. Therefore, in an embodiment, the data processor 130 is further configured to acquire a current cursor position, determine a current slice image corresponding to the position of the current cursor, and obtain the current slice image relative to the organ model data according to the foregoing correspondence. The current slice position, correspondingly, is used to display a planar image indicia at a corresponding location on the aforementioned organ map at the aforementioned current slice position.

[0096] In addition, the user can also change the cut surface position of the cut image by rotating and translating the displayed cut image, so that the cut image is also changed according to the actual shape, and the cut surface position on the organ model is required at this time. The change is also realized, that is, the plane image mark corresponding to the face image on the organ map is also changed, so that the user can know the actual position of the face image in the organ. Therefore, in an embodiment, the ultrasonic image display apparatus further includes an input unit (not shown in the drawing) for receiving an instruction of the user to change the position of the cut image, when the position of the cut image changes, The data processor 130 updates the position of the planar image associated with the slice image on the aforementioned organ map, and displays it through the display 140 described above.

[0097] Of course, in still another embodiment of the present invention, the method may further include the following steps: the data processor obtains an ultrasound image according to the foregoing three-dimensional volume data, where the ultrasound image includes a two-dimensional ultrasound image or three-dimensional The ultrasound image is then adjusted based on the received command by the user to adjust the aforementioned ultrasound image, according to which the display orientation of the aforementioned organ map is adjusted. For example, when the user observes the three-dimensional ultrasound image displayed on the interface, if the orientation of the three-dimensional ultrasound image is adjusted, the organ map can also change the display orientation as the user adjusts the three-dimensional ultrasound image. On the other hand, when the data processor adjusts the orientation command of the aforementioned organ map based on the received user, the orientation of the aforementioned ultrasonic image is adjusted according to the instruction. For example, in detecting the condition of the fetus in the maternal amniotic fluid, when the user adjusts the organ map characterizing the fetus to face the user, the system automatically associates it with the three-dimensional ultrasound image, and the fetus is imaged by three-dimensional image rendering and image segmentation processing algorithms. The face is gradually rotated to the display orientation facing the user, thereby realizing the linkage function of the ultrasound image and the organ map azimuth adjustment.

[0098]

[0099] For a better understanding of the present invention, a few examples and renderings are illustrated below.

[0100] The present invention can simultaneously display three sectional images, and the target tissue can be described as a fetal heart, please refer to In Fig. 5, the screen interface displays three orthogonal slice images, wherein the slice position of the slice image 31 in the upper left corner is displayed in the organ map 32 in the lower right corner, that is, the slice position marked by the plane image mark 33. It can be seen that the position of the cut surface in the organ map 32 by the planar image mark 33 allows the user (e.g., a doctor) to easily know the cut position of the cut image 31 in the real organ. If it is necessary to know the slice position of the slice image of the upper right corner or the lower left corner, the method of an embodiment of the present invention can be utilized, that is, by using a cursor or a button to activate the slice image, for example, when the cursor moves to the slice image in the upper right corner. Then, in the organ map 32, the corresponding planar image mark associated with the cut image of the upper right corner is displayed, so that the user can easily understand the cut surface position of the upper right corner of the cut image in the real organ.

[0101] In an embodiment, the user may also change the cut surface position of the cut image by rotating and translating the displayed cut image, so that the cut image is also changed according to the actual shape, and the time is required to be on the organ model. The position of the cut surface has also changed. Referring to FIG. 6, the cut surface image 43 is a four-chamber view, and the corresponding planar image associated with the organ map is labeled 41. When the user passes the balance or rotation operation 45, the cut image 43 becomes a cut image 44, that is, left. The chamber exits the cut surface. Correspondingly, the corresponding planar image mark associated with the cut image in the organ map also changes, that is, from the planar image mark 41 to the planar image mark 42, and the cut surface position changes.

5 and 6 are both three-dimensional views of the organ map, and in other embodiments, the displayed organ map may also be a two-dimensional plan view. For example, see Figure 7, Figure 7 (a) is a cerebellar section image, Figure 7 (b) is a brain image of the brain, a two-dimensional plan, and Figure 7 (b) is a diagonal line across the brain. The image of the cerebellum section on the left is a planar image on the organ map, indicating that the cerebellar section is perpendicular to the organ map on the right.

[0103] FIGS. 5 to 7 both show the effect of displaying a planar image mark on the organ map, and in other embodiments, a plurality of planar image marks can also be displayed on the organ map. For example, as shown in Fig. 8, four cut images are shown, which are cerebellar section, thalamic section, median sagittal plane, and lateral ventricle section. Four planar image markers are shown in the organ map in the lower right corner, indicating four The facet image of the cut image in the real organ.

[0104] Those skilled in the art may understand that all or part of the functions of the various methods in the foregoing embodiments may be implemented by hardware or by a computer program. When the above embodiment is full The program is implemented by a computer program, and the program may be stored in a computer readable storage medium. The storage medium may include: a read only memory, a random access memory, a magnetic disk, an optical disk, a hard disk, etc., and the program is executed by a computer. Implement the above functions. For example, the program is stored in the memory of the device, and when the program in the memory is executed by the processor, all or part of the above functions can be realized. In addition, when all or part of the functions in the above embodiments are implemented by a computer program, the program may also be stored in a storage medium such as a server, another computer, a magnetic disk, an optical disk, a flash disk or a mobile hard disk, and may be saved by downloading or copying. The memory of the local device is updated, or the system of the local device is updated. When the program in the memory is executed by the processor, all or part of the functions in the above embodiments may be implemented.

The present invention has been described with reference to the specific examples, which are intended to be illustrative of the invention and are not intended to limit the invention. Variations to the above specific embodiments may be made by those skilled in the art in light of the teachings of the present invention.

Claims

Claim

[Attach 1] An ultrasonic image display method, comprising:

The control probe scans the target tissue to obtain three-dimensional volume data;

Importing organ model data corresponding to the target tissue;

Matching the three-dimensional volume data with the organ model data to obtain a correspondence relationship; displaying one or more aspect images in the three-dimensional volume data; and obtaining at least one of the one or more aspect images according to the correspondence relationship The sliced position of a sliced image relative to the organ model data;

Displaying the organ model data to obtain an organ map;

Displaying a planar image marker at a corresponding position on the organ map at the location of the slice

The ultrasonic image display method according to claim 1, wherein the planar image mark comprises a planar area and/or a line segment, wherein the planar area is surrounded by a line segment and/or a curved segment.

The ultrasonic image display method according to claim 1, wherein the organ map is a three-dimensional map or a two-dimensional plan.

The method of displaying an ultrasonic image according to claim 1, further comprising:

Activate the cut image;

Obtaining a current slice position of the activated slice image relative to the organ model data according to the correspondence relationship;

A planar image mark is displayed at a corresponding position on the organ map at the current slice position.

[Aspect 5] The ultrasonic image display method according to any one of claims 1 to 4, wherein the organ map and the planar image mark are distinguished by setting transparency and/or color on the organ map .

[Attachment 6] The ultrasonic image display method according to any one of claims 1 to 4, wherein when a plurality of planar image marks 包括 are included, different plane image marks are distinguished by setting transparency and/or color . The ultrasonic image display method according to claim 1, further comprising: receiving an instruction for the user to change the position of the cut surface image, and when the position of the cut image changes, a plane image corresponding to the cut image The position of the marker on the organ map is also updated.

The ultrasound image display method according to claim 1, wherein the introducing the organ model data corresponding to the target tissue comprises:

Obtaining an organ type corresponding to the target tissue, which includes at least one of the following ways: providing a selection or input interface for the user to select or input an organ type; and, automatically identifying the organ type corresponding to the target tissue according to the three-dimensional volume data;

The organ model data of the organ type is imported according to the acquired organ type.

The ultrasonic image display method according to claim 1, wherein the method further comprises:

Obtaining an ultrasound image according to the three-dimensional volume data, the ultrasound image comprising a two-dimensional ultrasound image or a three-dimensional ultrasound image;

An instruction to adjust the ultrasound image or the organ map by a user is received, and the display orientation of the organ map or the ultrasound image is adjusted in accordance with the instruction.

An ultrasonic image display device, comprising:

Probe

a transmitting/receiving control circuit, configured to control the probe to scan the target tissue to obtain three-dimensional volume data; a data processor, configured to generate one or more aspect images in the three-dimensional volume data; and import organ model data corresponding to the target tissue And generating an organ map according to the organ model data; matching the three-dimensional volume data with the organ model data to obtain a correspondence relationship, and obtaining at least one of the one or more slice images according to the correspondence relationship a facet position of the image relative to the organ model data, and at the corresponding position of the slice position on the organ map, generating a planar image mark;

And a display for displaying one or more aspect images generated by the data processor, displaying the organ map and displaying the planar image mark at a corresponding position on the organ map at the location of the slice. [Answer 11] The ultrasonic image display apparatus according to claim 10, wherein the planar image mark comprises a planar area and/or a line segment, wherein the planar area is surrounded by a line segment and/or a curved segment.

The ultrasonic image display apparatus according to claim 10, wherein the organ map is a three-dimensional map or a two-dimensional plan.

[Attachment 13] The ultrasonic image display apparatus according to claim 10, wherein:

The data processor is further configured to acquire an instruction to activate the slice image, and obtain a current slice position of the activated slice image relative to the organ model data according to the correspondence relationship; the display is further configured to be on the organ map At a corresponding position of the current slice position, a planar image mark is displayed.

The ultrasonic image display apparatus according to any one of claims 10 to 13, wherein the data processor is further configured to distinguish the organ map and the plane by setting a transparency and/or a color. Image tag.

[Attachment 15] The ultrasonic image display apparatus according to any one of claims 10 to 13, wherein when the plurality of planar image marks are included, the data processor is further configured to distinguish between different by setting transparency and/or color Flat image tag.

The ultrasonic image display apparatus according to claim 10, further comprising an input unit, configured to receive an instruction for the user to change the position of the cut image, when the position of the cut image changes, The data processor updates the position of the planar image mark corresponding to the slice image on the organ map and displays it through the display

The ultrasonic image display method according to claim 10, wherein the data processor is further configured to automatically identify an organ type corresponding to the target tissue according to the three-dimensional volume data, according to the automatically recognized organ type Import organ model data for this organ type.

The ultrasonic image display method according to claim 10, wherein the display is further configured to provide a selection or input interface for the user to select or input an organ type, and the data processor is input according to the user. The organ type is imported into the organ model data of the organ type.

[Analysis of claim 10] The ultrasonic image display method according to claim 10, wherein the data processing Obtaining an ultrasound image according to the three-dimensional volume data, receiving an instruction of a user to adjust the ultrasound image or the organ map, and adjusting a display orientation of the organ map or the ultrasound image according to the instruction, wherein the ultrasound image Includes 2D ultrasound images or 3D ultrasound images.

[Claim 20] A storage medium characterized by storing a program executable by a processor to implement the ultrasonic image display method according to any one of claims 1 to 9.