JP2017221742A - Image analysis apparatus, control method for image analysis apparatus, and program - Google Patents

Abstract

An apparatus, method, and program for accurately measuring a layer thickness are provided. An image analyzing apparatus 10 that obtains a tomographic image of a retina of an eye to be examined, and a layer thickness in a first measurement direction at a predetermined point of a layer boundary included in the tomographic image. Based on the comparison with the layer thickness to be compared, the first measurement direction and the second measurement direction different from the first measurement direction at the predetermined point in the measurement direction determined to be output. Output means for outputting the layer thickness. [Selection] Figure 1

Description

  The present invention relates to an image analysis apparatus, a control method for the image analysis apparatus, and a program.

  An apparatus called an optical coherence tomography (hereinafter referred to as OCT (Optical Coherence Tomography)) or the like is known. According to OCT, since a tomographic image can be captured, for example, it is expected to quantitatively measure the thickness of a plurality of layers of the retina. Also, for example, since it is known that there is a correlation between the progression of glaucoma and the thickness of the layer (hereinafter sometimes referred to as layer thickness), in the field of ophthalmology, diagnosis of the disease and follow-up observation are performed. There is a demand for a technique that can accurately measure the layer thickness.

  For diagnosis of eye diseases such as glaucoma, as shown in FIG. 6, the thickness from the inner limiting membrane (ILM) to the retinal pigment epithelium (RPE) is measured. Moreover, the thickness of a nerve fiber layer (Nerve Fiver Layer: NFL) may be measured. Furthermore, the thickness of a GCC (Ganglion Cell Complex) obtained by adding a ganglion cell layer and an inner plexiform layer to NFL may be measured.

  Conventionally, the y direction (vertical direction) of a tomographic image as shown in FIG. 6 has been used as the thickness of such a layer (Patent Document 1). In addition, in order to make it easy to observe the change in the layer thickness over time, a technique has been proposed in which the pixels of the tomographic image are moved in the vertical direction in order to flatten the uneven ILM (Patent Document 2).

JP 2009-66015 A JP 2007-225349 A

  However, the shape of the retina is unique to the patient. For example, as shown in FIG. 6, the retina shown in the tomographic image is tilted obliquely or curved as shown in FIG. In this case, the value of the layer thickness obtained by measuring the image in the vertical direction is different from the original layer thickness of the retina. Therefore, there is a possibility that an incorrect layer thickness is presented when glaucoma is diagnosed, or a different layer thickness is measured for each imaging.

  Therefore, the present invention has been made in view of the above problems, and an object thereof is to accurately measure the thickness of a layer.

In order to solve the above problems, one embodiment of the present invention provides:
A tomographic image acquisition means for acquiring a tomographic image of the retina of the eye to be examined;
The first measurement direction and the first measurement direction are different based on a comparison between the layer thickness in the first measurement direction at a predetermined point of the layer boundary included in the tomographic image and the layer thickness to be compared. An output means for outputting a layer thickness at the predetermined point in the measurement direction determined to be output in the second measurement direction;
It is characterized by providing.

  According to the present invention, it is possible to accurately measure the layer thickness.

1 is a diagram illustrating an example of an overall configuration of an image processing system configured by arranging an image analysis apparatus according to an embodiment of the present invention. The figure which shows an example of a functional structure of the image analysis apparatus 10 shown in FIG. The figure which shows an example of the method of the setting of the reference point to a tomographic image. It is a figure which shows an example of the outline | summary of the measuring method of layer thickness. 3 is a flowchart showing an example of an operation in the image analysis apparatus 10 shown in FIG. The figure which shows an example of the tomographic image of a retina. The figure which shows an example of the tomographic image of a retina.

  DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of an image analysis apparatus, a measuring method thereof, and a program according to the present invention will be described in detail with reference to the accompanying drawings. In this embodiment, the case where a tomographic image of the retina is analyzed and the thickness of the layer (hereinafter sometimes referred to as layer thickness) is measured will be described as an example. The image does not necessarily need to be a retina, and may be an image including a layer.

  FIG. 1 is a diagram showing an example of the overall configuration of an image processing system configured by arranging an image analysis apparatus according to an embodiment of the present invention.

  The image processing system includes an image analysis device 10, a tomographic imaging device 22, and a data server 21. These devices are connected to be communicable via a LAN (Local Area Network) 23, for example. Note that the communication form is not limited to the LAN 23, and any communication form can be used as long as communication between apparatuses can be performed.

  The tomographic image capturing apparatus 22 is realized by, for example, OCT and captures a tomographic image of the eye. In the tomographic imaging apparatus 22, for example, a plurality of tomographic images are acquired by one imaging, and these acquired tomographic images are arranged in order. Thereby, the volume data of the retina can be reconstructed. The tomographic image capturing apparatus 22 captures a tomographic image of a subject (patient) in response to a user (for example, an engineer or doctor) operation, and outputs the tomographic image obtained by the imaging to the image analysis apparatus 10.

  The data server 21 stores various data. For example, a tomographic image captured by the tomographic image capturing device 22 is stored. Therefore, the image analysis apparatus 10 may acquire a tomographic image from the data server 21 in some cases.

  The image analysis apparatus 10 acquires a tomographic image from the tomographic imaging apparatus 22 or the data server 21 and analyzes it. Specifically, a tomographic image of the retina is acquired and the layer thickness of the retina is measured. Although details of this measurement method will be described later, for example, the direction in which the layer thickness is measured is determined based on the shape of the layer boundary, and the layer thickness is measured along that direction.

  The above is an explanation of an example of the overall configuration of the image processing system. However, the configuration of the image processing system shown in FIG. 1 is merely an example and is not limited thereto. For example, the data server 21 may be omitted. Note that the image analysis apparatus 10, the tomographic imaging apparatus 22, and the data server 21 described above incorporate a computer. The computer includes main control means such as a CPU, and storage means such as ROM (Read Only Memory), RAM (Random Access Memory), and HDD (Hard Disk Drive). In addition, the computer includes input / output means such as a keyboard, a mouse, a display, a button, or a touch panel. These constituent units are connected by a bus or the like, and are controlled by the main control unit executing a program stored in the storage unit.

  FIG. 2 is a diagram illustrating an example of a functional configuration of the image analysis apparatus 10 illustrated in FIG.

  The image analysis apparatus 10 includes an image input unit 11, a reference point setting unit 12, a measurement method determination unit 13, a direction vector calculation unit 14, a direction vector correction unit 15, and a measurement unit 16. The

  The image input unit 11 acquires a tomographic image from the tomographic imaging apparatus 22 or the data server 21 and inputs it into the apparatus.

  The reference point setting unit 12 sets a reference point used for layer thickness measurement for the tomographic image input by the image input unit 11. The reference point setting unit 12 includes a layer extraction unit 12a. The layer extraction unit 12a extracts a layer from the tomographic image. More specifically, the boundary of the layer whose thickness is to be measured is extracted from the tomographic image. In this embodiment, ILM (inner boundary membrane) and RPE (retinal pigment epithelium) are extracted. Here, the reference point setting unit 12 sets a plurality of reference points on the extracted RPE (on the boundary of the layer) as shown in FIG.

  The measurement method determination unit 13 obtains the flatness of the retina using the coordinates of the plurality of reference points set by the reference point setting unit 12. Then, it is determined whether to measure the layer thickness in the vertical direction or in the normal direction of the RPE shape based on the obtained flatness. Here, the degree of curvature is expressed using the longest distance among the shortest distances between a straight line approximated by the straight line y = ax + b and each reference point on the RPE. That is, the shorter the RPE is, the longer the shortest distance between the straight line and the reference point and the greater the degree of curvature. The measurement method determining unit 13 determines that the retina is almost flat and has a small inclination if the inclination a between the calculated curvature and the approximate straight line is equal to or less than a threshold set by the user, and measures the layer thickness. Is determined to be performed vertically. When measurement is performed in the vertical direction, the measurement direction vector is the y-axis direction of the tomographic image at all reference points. On the other hand, if the curvature or inclination a exceeds the threshold value, the measurement method determination unit 13 determines that the layer thickness is measured in the normal direction of the RPE shape as shown in FIG. In this case, it is necessary to calculate a measurement direction vector.

  The direction vector calculation unit 14 calculates a vector (measurement direction vector) indicating the direction in which the layer thickness is measured at each reference point on the RPE set by the reference point setting unit 12. Specifically, a normal vector at each reference point on the RPE is calculated, and a measurement direction vector corresponding to each reference point is obtained based on the calculated normal vector. When calculating the normal vector, first, as shown in FIG. 4, a triangular patch set (plane) having a reference point on the RPE as a vertex is generated. Then, the cross product of the two vectors constituting each patch is calculated to obtain the unit normal vector of the patch. The measurement direction vector is obtained by calculating the average of unit normal vectors of patches sharing each reference point. This process is executed at all reference points. Thereby, the measurement direction vector of the layer thickness at each reference point is calculated.

  The direction vector correction unit 15 detects an error in the measurement direction vector at each reference point, and corrects the detected error. Specifically, a condition is used that (1) the variation of a plurality of adjacent measurement direction vectors is within a predetermined range, or (2) the variation of a plurality of layer thicknesses in the vicinity is within a predetermined range. Furthermore, (3) an error is detected using at least one of the three conditions that the degree of similarity between the measurement direction vector estimated using the approximate model of the layer boundary surface and the measurement direction vector is within a predetermined range. A certain measurement direction vector is detected, and the detected error is corrected. The direction vector correction unit 15 first calculates the inner product of the measurement direction vector at the reference point and the measurement direction vector of the adjacent reference point, and determines the condition (1). If the inner product is equal to or smaller than a predetermined threshold, it is determined that the measurement direction vector is incorrect. If the measurement direction vector is continuously incorrect, it cannot be determined under the condition (1). Therefore, the condition (2) is added to the condition (1). In this case, first, the layer thickness is measured using the measurement direction vector calculated by the direction vector calculation unit 14. If the measured layer thickness differs from the layer thickness at a nearby reference point by a predetermined threshold or more, it is determined that the measurement direction vector at that reference point is incorrect. When determining using the condition (3), if the inner product of the normal vector of the approximate model and the measurement direction vector at each reference point is equal to or smaller than a predetermined threshold, it is determined that the measurement direction vector is incorrect. When it is determined that the measurement direction vector of a certain reference point is incorrect, the measurement direction vector of the reference point is replaced with a vector interpolated from the measurement direction vectors of neighboring reference points. As a result, the measurement direction vector corrected by the interpolation is output from the direction vector correction unit 15 to the measurement unit 16.

  The measurement unit 16 measures the distance to the intersection of the straight line extending from the reference point in the measurement direction and the extracted ILM. Then, the distance is output as the layer thickness at the reference point. The measurement unit 16 performs this process for all reference points.

  Next, an example of the operation in the image analysis apparatus 10 shown in FIG. 1 will be described with reference to FIG.

  In the image analysis apparatus 10, the image input unit 11 inputs a plurality of tomographic images captured by the tomographic image capturing apparatus 22 into the apparatus (S101). Specifically, retinal volume data in which a plurality of tomographic images are arranged in the order of imaging is input. As shown in FIG. 2, in the coordinate system of the retinal volume data, the horizontal direction of the tomographic image is the x axis, the vertical direction is the y axis, and the direction in which the tomographic images are arranged is the z axis. The reconstructed retinal volume data is output from the image input unit 11 to the reference point setting unit 12.

  Next, the image analysis apparatus 10 extracts ILM and RPE from the retinal volume data input in S101 in the layer extraction unit 12a (S102). In order to extract these, first, edge components are detected from retinal volume data, and some line segments are extracted as layer boundary candidates based on their connectivity. Of these candidates, the top line segment is ILM and the bottom line segment is RPE. The method for extracting the layer boundary is not particularly limited as long as the layer boundary can be extracted from the retinal volume data.

  After extracting the ILM and RPE, the image analysis apparatus 10 sets a reference point in the reference point setting unit 12 (S103). Specifically, as shown in FIG. 3, a plurality of reference points are set at equal intervals on the RPE. The coordinates of each reference point are output from the reference point setting unit 12 to the measurement method determination unit 13, the direction vector calculation unit 14, the direction vector correction unit 15, and the measurement unit 16.

  Subsequently, in the image analysis apparatus 10, the measurement method determination unit 13 calculates the curvature of the retina using the coordinates of the reference point output from the reference point setting unit 12, and measures the layer thickness based on the calculation result. A method is determined (S104). Since the method of determining the measurement method has been described above, the description thereof is omitted here.

  As a result of S104, when it is determined that the measurement of the layer thickness of the retina is performed in the vertical direction (NO in S105), the image analysis apparatus 10 measures the layer thickness of the retina based on the determination in the measurement unit 16 ( S109). On the other hand, when it is determined to measure the thickness of the retina in the normal direction (YES in S105), the image analysis apparatus 10 calculates a measurement direction vector in the direction vector calculation unit 14 (S106). As described above, a normal vector at each reference point on the RPE is calculated, and a measurement direction vector is obtained based on the calculated normal vector.

  When the calculation of the measurement direction vector is completed, the image analysis apparatus 10 corrects the erroneous measurement direction vector from the calculated measurement direction vector in the direction vector correction unit 15 (S108). Since the correction of the measurement direction vector has been described above, the description thereof is omitted here.

  Thereafter, the image analysis apparatus 10 uses the measurement direction vector calculated by the direction vector calculation unit 14 and the measurement direction vector corrected by the direction vector correction unit 15 in the measurement unit 16 to use the layer thickness at each reference point. Is measured (S109). Specifically, the intersection of each measurement direction vector and the ILM triangular patch is obtained, and it is determined by the intersection determination between the straight line and the surface that the intersection is included in the triangular patch. When the intersection is included, the 3D Euclidean distance from the intersection to the reference point is set as the layer thickness.

  As described above, according to the present embodiment, the direction in which the layer thickness is measured is determined based on the shape of the layer boundary of the retina, and the layer thickness is measured along that direction. Thereby, even when the retina is greatly inclined or curved, the layer thickness can be accurately measured. That is, the flatness of the retina is calculated from the shape of the RPE, and the layer thickness measurement method is determined. And the measurement direction vector of the layer thickness in the some reference point set on RPE is calculated, and the intersection of ILM and these vectors is calculated | required. The distance from the reference point to the intersection is the layer thickness at each reference point. By measuring the layer thickness in this way, it is possible to measure the layer thickness with high accuracy in consideration of the shape of the retina.

  In the above embodiment, the case where the layer thickness of the entire retina (from ILM to RPE) is measured has been described as an example. However, the present invention is not limited to this. For example, it is possible to measure the thickness of other layers constituting the retina such as NFL (nerve fiber layer) and GCC. In this case, for example, RPE may be replaced with the lower end of the layer whose thickness is to be measured, such as the lower end of NFL or the lower end of GCC.

  The above is an example of a typical embodiment of the present invention, but the present invention is not limited to the embodiment described above and shown in the drawings, and can be appropriately modified and implemented without departing from the scope of the present invention. .

For example, the present invention can take an embodiment as a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.
(Other embodiments)
The present invention can also be realized by executing the following processing.
That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

  10: Image analysis device, 11: Image input unit, 12: Reference point setting unit, 12a: Layer extraction unit, 13: Measurement direction determination unit, 14: Direction vector calculation unit, 15: Direction vector correction unit, 16: Measurement unit

Claims (11)

A tomographic image acquisition means for acquiring a tomographic image of the retina of the eye to be examined;
The first measurement direction and the first measurement direction are different based on a comparison between the layer thickness in the first measurement direction at a predetermined point of the layer boundary included in the tomographic image and the layer thickness to be compared. An output means for outputting a layer thickness at the predetermined point in the measurement direction determined to be output in the second measurement direction;
An image analysis apparatus comprising: A tomographic image acquisition means for acquiring a tomographic image of the retina of the eye to be examined;
The first measurement direction and the first measurement direction are different based on a comparison between the layer thickness in the first measurement direction at a predetermined point of the layer boundary included in the tomographic image and the layer thickness to be compared. Determination means for determining a measurement direction of the layer thickness based on the shape of the layer boundary in the second measurement direction;
Output means for outputting the layer thickness at the predetermined point in the measurement direction determined by the determination means;
An image analysis apparatus comprising:   The image analysis apparatus according to claim 1, wherein the first measurement direction is a normal direction of the layer boundary.   The image analysis apparatus according to claim 1, wherein the first measurement direction is a direction orthogonal to a horizontal direction of the tomographic image.   The image analysis apparatus according to claim 1, wherein the layer thickness is a layer thickness of a nerve fiber layer.   The output means outputs a layer thickness at a point included in the layer boundary other than the predetermined point in the measurement direction determined to be output even at a point included in the layer boundary other than the predetermined point. The image analysis apparatus according to claim 1. The determination means also performs the determination at a point included in the layer boundary other than the predetermined point,
The image analysis apparatus according to claim 2, wherein the output unit outputs a layer thickness at a point included in the layer boundary other than the predetermined point in the measurement direction determined by the determination unit.   The image analysis apparatus according to claim 1, further comprising an extraction unit that extracts the layer boundary. A control method for an image analysis apparatus comprising a tomographic image acquisition means and an output means,
A tomographic image acquiring step of acquiring a tomographic image of the retina of the eye to be examined by the tomographic image acquiring means;
Based on a comparison between the layer thickness in the first measurement direction at a predetermined point of the layer boundary included in the tomographic image and the layer thickness to be compared by the output means, the first measurement direction and the first An output step of outputting the layer thickness at the predetermined point in the measurement direction determined to be output among the second measurement directions different from the measurement direction;
A control method for an image analysis apparatus, comprising: A method for controlling an image analysis apparatus comprising a tomographic image acquisition means, a determination means, and an output means,
A tomographic image acquiring step of acquiring a tomographic image of the retina of the eye to be examined by the tomographic image acquiring means;
Based on the comparison between the layer thickness in the first measurement direction at a predetermined point of the layer boundary included in the tomographic image and the layer thickness to be compared by the determination means, the first measurement direction and the first A determination step of determining a measurement direction of the layer thickness based on the shape of the layer boundary among the second measurement directions different from the measurement direction;
An output step of outputting the layer thickness at the predetermined point in the measurement direction determined by the determination step by the output means;
A control method for an image analysis apparatus, comprising:   A program for causing a computer to execute the control method of the image analysis apparatus according to claim 9 or 10.

Images