JP6988058B2 - Ophthalmology image processing device, ophthalmology image processing program - Google Patents

Description

The present disclosure relates to an ophthalmic image processing apparatus and an ophthalmic image processing program for processing image data acquired by an ophthalmic examination apparatus.

A technique for superimposing image data acquired by a plurality of ophthalmic examination devices is known (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2013-116366

However, in the above background technology, the following possibilities are possible. For example, there is no degree of freedom in the types of superimposed images, and it may be difficult to make a diagnosis from a multifaceted perspective. In addition, visibility in the superimposed image is not taken into consideration, and it may be difficult for the examiner to see.

An object of the present invention is to provide an ophthalmic image processing apparatus and an ophthalmic image processing program capable of solving at least one of the problems of the prior art.

In order to solve the above problems, the present disclosure is characterized by having the following configurations.

(1)
An ophthalmologic image processing device that processes image data of an eye to be inspected acquired by a plurality of ophthalmologic examination devices.
Registration in which the first image data, which is the image data of the eye to be inspected acquired by the first ophthalmic examination apparatus, and the second image data, which is the image data acquired by the second ophthalmic examination apparatus, are superimposed. Image processing means to create images and
A setting means for setting an image type in the first image data and the second image data constituting the registration image, and
Equipped with
The first ophthalmologic examination device is a first ophthalmology examination device having at least an ophthalmic OCT, and the second ophthalmology examination device is a second ophthalmology examination device having at least a visual field measurement function.
The image processing means is
The first image data includes an OCT two-dimensional image acquired by the first ophthalmologic examination apparatus and a first front image data which is a frontal image of the eye to be inspected acquired by the first ophthalmologic examination apparatus. The first front image data associated with the OCT two-dimensional image and the data are acquired from the storage unit.
As the second image data, a field map image of the eye to be inspected acquired by the second ophthalmologic examination apparatus and a second frontal image data which is a frontal image of the eye to be inspected acquired by the second ophthalmologic examination apparatus are used. Therefore, the second front image data associated with the field map image is acquired from the storage unit.
By matching the first front image data and the second front image data, the alignment process between the first- stage OCT two-dimensional image and the field map image is performed.
It is characterized in that a registration image in which the OCT two-dimensional image corresponding to the image type set by the setting means and the field of view map image are superimposed is created and output.
(2)
An ophthalmic image processing program executed in an ophthalmic image processing device that processes image data of an eye to be inspected acquired by a plurality of ophthalmic examination devices.
By being executed by the processor of the ophthalmologic image processing device,
Registration in which the first image data, which is the image data of the eye to be inspected acquired by the first ophthalmic examination apparatus, and the second image data, which is the image data acquired by the second ophthalmic examination apparatus, are superimposed. Image processing steps to create an image and
The ophthalmic image processing apparatus is made to execute the setting step of setting the image type in the first image data and the second image data constituting the registration image.
The first ophthalmologic examination device is a first ophthalmology examination device having at least an ophthalmic OCT, and the second ophthalmology examination device is a second ophthalmology examination device having at least a visual field measurement function.
The image processing step is
The first image data includes an OCT two-dimensional image acquired by the first ophthalmologic examination apparatus and a first front image data which is a frontal image of the eye to be inspected acquired by the first ophthalmologic examination apparatus. The first front image data associated with the OCT two-dimensional image and the data are acquired from the storage unit.
As the second image data, a field map image of the eye to be inspected acquired by the second ophthalmologic examination apparatus and a second frontal image data which is a frontal image of the eye to be inspected acquired by the second ophthalmologic examination apparatus are used. Therefore, the second front image data associated with the field map image is acquired from the storage unit.
By matching the first front image data and the second front image data, the alignment process between the first-stage OCT two-dimensional image and the field map image is performed.
It is characterized in that a registration image in which the OCT two-dimensional image corresponding to the image type set by the setting step and the field of view map image are superimposed is created and output.

An embodiment of the present invention will be described with reference to the drawings. 1 to 16 are views according to an embodiment of the present embodiment. The items classified by <> below can be used independently or in relation to each other.

<Overview (see Fig. 1)>
The ophthalmologic image processing apparatus can process the image acquired by the ophthalmologic examination apparatus. The image processing may be performed by the image processing unit (for example, the processor 20). The processor 20 may be, for example, a CPU provided in an ophthalmologic examination device in addition to the CPU of a personal computer.

The instruction receiving unit (for example, the processor 20) has a function of receiving an instruction from the examiner. The instruction receiving unit can receive an operation signal from a user interface (for example, the operation unit 4) such as a touch panel, a mouse, or a keyboard.

The image processing unit (for example, the processor 20) outputs an image. The output destination may be, for example, a display unit (for example, display unit 1) / an output unit (output device) such as a printer, a storage unit (storage device) such as a hard disk / USB memory, or the like.

The storage unit (for example, the storage unit 30) may be, for example, a storage unit provided in the main body of the ophthalmologic examination device, a storage unit provided in an external server, a storage unit provided in a personal computer, or the like. good. As the ophthalmologic image processing apparatus, a personal computer may be used or a dedicated apparatus may be used. The ophthalmologic examination apparatus may also serve as an ophthalmologic image processing apparatus.

The ophthalmic image processing device and the ophthalmic examination device are connected in a state in which signals can be exchanged, and for example, an image acquired by a first ophthalmic examination device (for example, an ophthalmic OCT device 10), a second image. The image acquired by the ophthalmologic examination apparatus (for example, the visual field inspection apparatus 15) is stored in the storage unit.

<Program>
The present device may include a control unit (for example, a processor 20) that controls various control processes, and a storage unit that stores an ophthalmologic image processing program. The processor 20 can execute the process according to the program. The control unit may also serve as an image processing unit.

<Registration processing (see Fig. 2)>
The ophthalmic image processing apparatus may have a function of superimposing a plurality of image data, or may acquire a registration image which is a superposed image on which a plurality of image data are superimposed. In the following description, the function of superimposing a plurality of image data, the function of superimposing a plurality of image data, and the registration image which is a superposed image of a plurality of image data are superposed with a plurality of image data. It can be represented as a registration image.

In this case, the present apparatus may include an image processing unit (registration function) for superimposing (superimposing display) images acquired by a plurality of ophthalmologic examination devices. The image processing unit may create a registration image, which is an image obtained by superimposing the first image data and the second image data, and output the created registration image.

The first image data may be image data acquired by the first ophthalmologic examination apparatus. The second image data may be image data acquired by the second ophthalmologic examination apparatus. The second ophthalmologic examination apparatus may be an ophthalmologic examination apparatus different from the first ophthalmologic examination apparatus.

The ophthalmic image processing apparatus may include a setting unit for setting an image type in the first image data and the second image data constituting the registration image. The image processing unit may create and output a registration image in which the first image data corresponding to the set image type and the second image data are superimposed. The image processing unit may create a registration image based on each setting condition set by the setting unit.

The setting unit may include an instruction reception unit that receives instructions from the examiner, or may perform setting processing based on an instruction signal from the instruction reception unit. Further, the setting unit may set the image type according to the preset setting conditions. In this case, for example, the setting conditions are set according to the specifications of each report, and the image type may be set according to the specifications of the selected report. There may be various image types as the image types that can be set as the image data constituting the registration image. According to the image type setting, for example, the registration image desired by the examiner can be obtained. At the same time, multifaceted confirmation is possible.

<Change registration image settings (see Fig. 3)>
In a state where the registration image is displayed on the display unit, an instruction from the operation unit for changing the setting of the registration image may be received, and the setting of the registration image may be changed. The image processing unit may create a registration image based on the setting change.

<Layer order setting>
In this apparatus, the order in which the first image data and the second image data are superimposed may be changeable. For example, as the order in which the settings can be changed, the first registration image in which the second image data is superimposed on the first image data, and the first image data on which the first image data is superimposed on the second image data. Any of the second registration images to be set may be changeable. According to this, the examiner can select the superposition order in consideration of visibility, diagnostic purpose, and the like.

When creating a registration image, the instruction receiving unit may receive an instruction signal from an operation unit for setting the order of layers for superimposing the first image data and the second image data. The image processing unit may create a registration image based on the order of the selected layers. According to this, the examiner can select a desired superposition order in consideration of visibility or diagnostic purpose. When either the first image data or the second image data includes a plurality of image data, the superposition order of three or more image data may be set.

<Transmittance setting>
In this apparatus, when creating a registration image, the transmittance of at least one of the first image data and the second image data may be set and changed. The transmittance may be variable from 0 to 100%. According to this, in the registration image, the image formed behind other image data can be easily confirmed.

The instruction receiving unit may receive an instruction signal from the operation unit for setting the transmittance of at least one of the first image data and the second image data. The image processing unit may create a registration image based on the selected transmittance. According to this, a registration image set to the transmittance desired by the examiner can be obtained. The instruction receiving unit may receive selection instructions for selecting the transmittance of each image data.

<Brightness or contrast settings>
In this apparatus, when creating a registration image, the brightness or contrast of at least one of the first image data and the second image data may be set and changed. According to this, the visibility of the registration image can be adjusted.

The instruction receiving unit may receive an instruction signal from the operation unit for setting the brightness or contrast of at least one of the first image data and the second image data. The image processor may create a registration image based on the selected brightness or contrast. According to this, it is possible to set a registration image that is easy for the examiner to see.

<Selection of image data>
In this device, when the registration image is displayed on the display unit, instructions from the operation unit for selecting the image data constituting the registration image are received, and the image data constituting the registration image is discarded. It may be selectable. The image processing unit may create a registration image based on the setting conditions set by the selection.

<Setting of overlapping area (see Fig. 14)>
In this apparatus, when creating a registration image, it may be possible to set a polymerization region in which the first image data and the second image data are overlapped. According to this, the registration image desired by the examiner can be obtained, for example, the visibility of the area of interest of the examiner is improved.

The instruction receiving unit may receive an instruction signal from the operation unit for setting a polymerization region in which the first image data and the second image data are superimposed. The image processing unit may create a registration image based on the set polymerization region. According to this, a registration image set in the polymerization region desired by the examiner can be obtained.

More specifically, an arbitrary area can be set on the registration image, and the image type to be output within the set area can be arbitrarily selected from each image type constituting the registration image. The image type output for the set area is not limited to one, and may be plural. In this case, the examiner may set the region, or the polymerization region may be automatically set based on the preset setting conditions. In this case, the setting of the polymerization region may be changeable.

In the above method, as shown in FIG. 14, it may be used to complement the missing portion in the image data, or a collage with a plurality of images may be performed. In the collage of FIG. 14, at least one of a first frontal image of the fundus (for example, a spontaneously fluorescent image) and a second frontal image of the fundus (for example, a color fundus image) and a map image (for example, an OCT map image). The registration image is displayed, and the first fundus front image is displayed alone in the first display area different from the registration image, and the second display area different from the registration image is displayed. The front image of the fundus of 2 is displayed alone.

<Creation of feature image (see Fig. 15)>
The image processing unit performs difference processing (for example, difference in brightness value or difference in brightness value) between the first image data and the second image data in a state where the first image data and the second image data are superimposed. Processing to obtain the ratio) may be performed. The image processing unit may create a difference image based on the difference processing and output the difference image. According to this, a characteristic image in which other parts are subtracted is obtained.

For example, the image processing unit has a first anterior fundus image including new blood vessels (for example, an OCT motion contrast interface image, a fluorescence contrast image using a contrast agent, etc.) and a new blood vessel more than the first anterior fundus image. Characteristic that other fundus vessels are subtracted from new blood vessels by performing image difference with a second frontal image of the fundus that is not imaged (for example, OCT face image, spontaneous fluorescence image, etc.). You can get an image.

Further, the image processing unit may create a registration image in which the obtained difference image and another image are superimposed. This makes it possible to obtain a new registration image desired by the examiner. For example, the image processing unit may create a registration image in which a characteristic image in which another fundus blood vessel is subtracted from the above-mentioned new blood vessel and a color frontal image of the fundus are superimposed.

<Report (see Fig. 4)>
In this apparatus, it may be possible to create a report (for example, a custom report) including a registration image. The report containing the registration images may be a report containing only one or more registration images, or a report containing one or more registration images and other images acquired by an ophthalmologic examination apparatus. It may be. By displaying the registration image and other images acquired by the ophthalmologic examination device in an integrated manner, an integrated report is created, and the examiner can make an effective diagnosis using the registration image. It will be possible. In this case, other image types may be set.

<Overlaying map images (see Fig. 5)>
The image processing unit uses the first map image data, which is a map image of the eye to be inspected acquired by the first ophthalmic examination apparatus, as the first image data, and the eye to be inspected acquired by the first ophthalmic examination apparatus. The first front image data which is the front image and is associated with the first map image data may be acquired from the storage unit.

The image processing unit uses the second map image data, which is a map image of the eye to be inspected acquired by the second ophthalmic examination apparatus, as the second image data, and the eye to be inspected acquired by the second ophthalmic examination apparatus. The second front image data, which is a front image, may be acquired from the storage unit.

The image processing unit may create a registration image in which the first map image data, the first front image data, the second map image data, and the second front image data are superimposed. See FIG. 5).

In this case, the image type in at least one of the first map image data and the second map image data may be changeable. Further, the image processing unit performs alignment processing between the first front image data and the second front image data, so that the position between the first map image data and the second map image data is obtained. The matching process may be performed.

<OCT map image (or face image) and field of view map image (see FIGS. 5, 10, 11)>
The registration according to the present embodiment includes a first image data obtained by a first ophthalmologic examination apparatus having at least an OCT and a second image obtained by a second ophthalmologic examination apparatus having at least a visual field measurement function. This is advantageous when superimposing data.

The image processing unit includes an OCT two-dimensional image (for example, an analysis map image obtained by analyzing the fundus of the eye, an OCT interface image) acquired by the first ophthalmologic examination apparatus and an OCT eye acquired by the second ophthalmologic examination apparatus. A registration image may be created by superimposing map images.

For example, the first ophthalmologic examination apparatus may be an ophthalmologic OCT device including an OCT optical system for capturing a fundus tomographic image and a first imaging optical system for capturing a frontal fundus image. .. The first imaging optical system may be an SLO or a fundus camera. Further, the OCT optical system may also have a configuration in which the first image pickup optical system is also used.

The first image data is an OCT two-dimensional image (for example, an analysis map image obtained by analyzing the fundus, an OCT interface image) and a first frontal image of the fundus acquired by the first imaging optical system. It may be a front image associated with a dimensional image.

For example, the second ophthalmologic examination apparatus may be an ophthalmologic examination apparatus including a visual field measurement optical system for measuring a visual field and a second imaging optical system for imaging a frontal image of the fundus. The second image data is a field map image obtained by the field measurement optical system and a second frontal image of the fundus acquired by the second imaging optical system, which is a frontal image of the fundus associated with the map image. There may be.

In this case, the OCT two-dimensional image and the OCT two-dimensional image are obtained by matching the first fundus front image acquired by the first imaging optical system with the second fundus front image acquired by the second imaging optical system. Alignment with the field map image may be performed. In this case, by adjusting the magnification between the first frontal image of the fundus and the second frontal image of the fundus, the deviation of the magnification between the OCT two-dimensional image and the visual field map image is corrected. May be good.

Further, the inconsistency between the images due to the difference in the imaging optical system or the like may be corrected by deforming at least one of the frontal images of the fundus. In this case, the image processing unit may transform the first fundus front image with respect to the second fundus front image and the OCT two-dimensional image with respect to the visual field map image. In this case, since the OCT two-dimensional image is continuously formed, visibility is ensured even if the image is deformed, whereas the visual field map image (for example, the visibility map) is discretely spaced at regular intervals. It is generally displayed as, and it may be difficult to see due to deformation. Therefore, by transforming the OCT two-dimensional image with respect to the field-of-view map image, the visibility of the field-of-view map image is maintained, and as a result, the visibility of both map images is ensured.

Here, the relationship between the OCT information of the eye to be inspected and the visual field information can be determined by switching between a plurality of types of OCT two-dimensional images (analysis map image, OCT face image, etc.) to be superimposed on the visual field map image. It is possible to check from multiple sides.

<Map image of the front of the fundus and the field of view (see Fig. 6)>
The registration according to the present embodiment includes at least the first image data obtained by the first ophthalmologic examination apparatus including the first image pickup optical system for capturing the frontal image of the fundus and the second field measurement function. It is advantageous when superimposing the second image data obtained by the ophthalmologic examination apparatus of.

The first image data may be a first fundus frontal image acquired by the first imaging optical system. A plurality of first ophthalmologic examination devices may be prepared, and a frontal image of the fundus acquired by a different first ophthalmologic examination device may be selectable.

For example, the second ophthalmologic examination apparatus may be an ophthalmologic examination apparatus including a visual field measurement optical system for measuring a visual field and a second imaging optical system for imaging a frontal image of the fundus. The second image data is a field map image obtained by the field measurement optical system and a second frontal image of the fundus acquired by the second imaging optical system, which is a frontal image of the fundus associated with the map image. There may be.

In this case, by matching the first fundus front image acquired by the fundus front image pickup optical system with the second fundus front image acquired by the second image pickup optical system, the alignment between the fundus front images is performed. May be done. In this case, the magnification between the first frontal image of the fundus and the second frontal image of the fundus may be adjusted.

Here, a plurality of first fundus front images (for example, a fundus front image acquired by a fundus camera, a fundus front image acquired by SLO, and a fundus front image acquired by OCT) are superimposed on the visual field map image. By being able to switch by type, it is possible to confirm the relationship between the frontal image of the fundus of the eye to be inspected and the visual field information from multiple perspectives.

<Registration image with the third image data (see FIG. 6)>
The image processing unit is a third image which is image data of the eye to be inspected acquired by a third ophthalmologic examination apparatus (for example, a fundus photography apparatus 17) different from the first ophthalmologic examination apparatus and the second ophthalmologic examination apparatus. A registration image may be created by superimposing the data and the first image data which is the image data of the eye to be inspected acquired by the first ophthalmologic examination apparatus.

In this case, the image type of the image to be superimposed on the first image data may be set and changed between the second image data and the third image data. The first ophthalmologic examination device is an OCT device for ophthalmology, the second ophthalmology examination device is a visual field examination device, and the third ophthalmologic examination device is a fundus for photographing a frontal image of the fundus. It may be a photographing device. The third ophthalmologic examination device may be either a fundus camera or an SLO.

<Data output on an inspection date basis (see FIGS. 7 and 13)>
The image processing unit may process the image data of the eye to be inspected acquired by the ophthalmologic examination apparatus to create a report including the image data. The image processing unit may process the image data of the eye to be inspected acquired by the plurality of ophthalmologic examination devices to create a custom report including the image data by the plurality of ophthalmologic examination devices.

The ophthalmologic image processing apparatus may have a function of outputting image data based on a set examination date. With this function, it is possible to easily confirm a plurality of image data regarding the inspection date that the examiner wants to see.

For example, the present device may include a setting unit for setting an inspection date of image data output as a report. The setting unit may be able to manually set the inspection date of the image data to be output as a report, and includes an instruction receiving unit that receives an instruction signal from the operation unit for setting the inspection date, based on the instruction signal. You may set it. Further, the setting unit may set the inspection date according to the preset setting conditions. The inspection date setting method also includes a method of setting a fixed period (for example, weekly, monthly, yearly, etc.).

The image processing unit may acquire image data within a certain period based on the set inspection date or the inspection date from the storage unit. In this case, when a fixed period is set as the inspection date setting method, the image processing unit may acquire image data included in the set fixed period from the storage unit. The image processing unit may create a report based on the acquired image data.

The inspection date of the image data output as a report may be changeable. The image processing unit may acquire image data within a certain period based on the inspection date whose setting has been changed or the inspection date from the storage unit.

The image processing unit may create an examination date list that can be set by the setting unit based on the examination date data attached to the image data of the eye to be inspected stored in the storage unit. The image processing unit may display the created inspection date data in a selectable manner on the display unit. This makes it possible to smoothly set the inspection date.

The image type of the image data to be output as a report may be set. Based on the set inspection date and image type, the image processing unit stores the image data within a certain period based on the set inspection date or inspection date and the image data corresponding to the set image type. You may get it from the department. The image processing unit may create a report based on the acquired image data.

<Example>
The storage unit 30 of the ophthalmic image processing apparatus according to the present embodiment was acquired by a plurality of ophthalmic examination devices (for example, an ophthalmic OCT device 10, a visual field test device 15, and a fundus photography device 17) connected to the device. Image data is stored. The image data is classified for each patient and is stored so as to be identifiable for each patient. The stored image data can be viewed using image viewing software, and a report including analysis results for the stored image data can be created. The image data stored in the storage unit 30 may be photographed image data acquired by the ophthalmologic examination apparatus or map image data acquired by the ophthalmologic examination apparatus. The map image data is obtained, for example, by analyzing a photographed image or a measurement result.

The captured image and the map image obtained based on the captured image may be stored in the storage unit 30 in association with each other. In this case, the processor 20 may separate the captured image and the map image and store them in the storage unit 30 as two images. As a result, the captured image and the map image can be used as independent images, which is advantageous when creating a registration image. For example, when the captured image and the map image are stored in a superposed state, since they are integrated, it is difficult to independently adjust the transmittance or cancel one superposition once. .. On the other hand, storing them separately is advantageous in adjusting the transmittance independently, temporarily canceling some image types constituting the registration image, and the like.

<Template creation screen>
The type of the image (the image constituting the registration image) that is the basis of the registration image may be preset as a template. The template data is stored in, for example, the storage unit 30. The template may be created by the examiner on the software or may be prepared in advance as a default setting. Further, new template data may be registered via a communication means.

FIG. 8 is a diagram showing an example of a screen for creating a report template on software. Processor 20 can create a template for a report that includes a registration image. The report containing the registration images may be a report containing only one or more registration images, or a report containing one or more registration images and other images acquired by an ophthalmologic examination apparatus. (See FIG. 4). Examples of other images include a two-dimensional image acquired by an ophthalmic OCT device (for example, a map image, an OCT face image, an analysis chart image, a front image, etc.), and a two-dimensional image acquired by a visual field inspection device (for example, a two-dimensional image (for example, a map image, an OCT face image, an analysis chart image, a front image, etc.)). For example, a map image, a front image), a front image acquired by an ophthalmographing apparatus, and the like can be considered.

On the template creation screen, the processor 20 may display a plurality of image types on the display unit so as to be selectable, and may accept a selection instruction from the operation unit 4 for selecting the image type. The plurality of image types may be displayed as, for example, List 100.

A registration image may be selectable as the selectable image type. A plurality of image types of registration images may be provided, and one type may be selectable from a plurality of types. Various patterns can be considered as the image type pattern of the registration image (details will be described later). In this case, the selection method may be a method of selecting one of the image types related to a plurality of types of registration images, or a registration image by selecting a plurality of types of each image that is the basis of the registration image. It may be a method of selecting the image type of.

The registration image may be an image obtained by superimposing images acquired by different ophthalmic examination devices, and examples of images acquired by different ophthalmic examination devices include an ophthalmologic OCT device and another ophthalmic examination. There can be images acquired by the device, images acquired by the visual field test device and other ophthalmologic test devices. The image that is the basis of registration may be a photographed image, a map image, or the like.

On the template creation screen, the processor 20 may receive an instruction signal for selecting an image type and display an image corresponding to the selected image type on the report display area 200. In this case, at least one of the registration image and other images may be displayed in the report display area 200 according to the selected image type.

The processor 20 may add or delete an image type based on an operation signal from the operation unit 4 (for example, a click, a drag operation, etc.). The processor 20 may change the image displayed in the report display area 200 according to the addition or deletion of the image type. The processor 20 may change the layout (for example, display position, display magnification, etc.) of each image displayed in the report display area 200 based on the operation signal from the operation unit 4. Further, when a template is created, an image type may be added or deleted to a template containing at least one image type in advance, or an image type may be added or deleted to a new template. You may be disappointed.

When the image type corresponding to the registration image is selected, the processor 20 may display the image 210 including at least one of the characters and the graphic indicating the type of the registration image in the report display area 200. .. This allows the examiner to easily confirm the type of registration image. By displaying characters indicating the type of each image that is the basis of the registration image, the examiner can confirm the type of the registration image reliably and smoothly. When a graphic indicating the type of the registration image is displayed, the graphic may be an actual photographed image or a graphic image imitating the actual image.

When a report template is created based on the image type displayed in the report display area 200, the created template is stored in the storage unit 30. The created template can be output as a report.

<Template selection screen>
On the template selection screen (see FIG. 4), a selection instruction from the operation unit 4 for selecting one template from a plurality of templates may be accepted. The processor 20 may display a plurality of templates 220 as graphics on the display unit 1 and may accept a selection instruction from the operation unit 4. In this case, as the plurality of templates 220, a newly created template may be displayed in addition to the default template.

In this case, the processor 20 may accept a selection instruction from the operation unit 4 for selecting one subject from a plurality of subject information stored in the storage unit 30. When the template is selected, the processor 20 acquires an image of the selected subject and corresponding to the image type on the selected template from the storage unit 30, and based on the acquired image. You may create a report.

<Registration screen>
When the registration image is included in the selected template, the processor 20 may display a registration screen (see FIG. 2) for executing registration on the display unit 1. If the registration image is not included, the processor 20 may shift to report creation.

On the registration screen, the processor 20 may perform an alignment process or an overlay process (superposition process) between images acquired by different ophthalmologic examination devices. The processor 20 has a first image (for example, a captured image A) which is an image acquired by the first ophthalmologic examination apparatus and a second image (for example, an image) which is an image acquired by the second ophthalmologic examination apparatus. The captured image B) may be aligned with the captured image B) and the superimposition processing may be performed. Here, the type set in the registration image on the template is applied to the first image type, which is the image type of the first image, and the second image type, which is the image type of the second image. ..

<Alignment processing>
In the alignment process, if at least one of the first image and the second image is another image that is not a front image (eg, a map image obtained by an OCT or a visual field test device), the processor 20 may use the other. Alignment may be performed using a preset front image with respect to the image of. For example, in the case of a map image obtained by an ophthalmologic examination device, a pre-associated frontal image may be used. The ophthalmologic examination apparatus may have a function of associating a map image with a front image and storing it in the storage unit 30. It should be noted that the image constituting the registration image can be applied even when a front image is included together with other images.

When both the first image and the second image are front images (for example, a color fundus front image acquired by a fundus camera and a fluorescent fundus front image acquired by SLO), the front images are directly connected to each other. It may be aligned with.

In the alignment process, the processor 20 may display the front images (see captured image A and captured image B) used for alignment on the display unit 1, and / or the front images used for alignment are used. The registration image (see the result image of FIG. 2) may be displayed on the display unit 1. The front image used for alignment may be used not only for checking the alignment image but also for setting feature points for alignment. The registration image may be used as a confirmation of alignment.

The processor 20 may perform alignment (matching processing) between front images by image processing. As a specific method of alignment by image processing, various image processing methods (method using various correlation functions, method using Fourier transform, method based on matching of feature points) can be used. In the alignment process, at least one of translation, rotation, and enlargement / reduction may be performed. Further, the inconsistency between the images due to the difference in the photographing optical system or the like may be corrected by deforming at least one of the front images.

The alignment may be performed automatically, semi-automatically including manually, or manually. In the case of semi-auto, feature points common to each front image (for example, blood vessel bifurcation points, lesions, etc.) are designated by the examiner on the screen, and the processor 20 performs alignment processing using the designated feature points. You may. In the case of manual operation, the processor 20 may operate the other front image on the screen with respect to one of the front images to perform alignment according to the operation of the examiner. After the result of the alignment, the alignment may be readjusted semi-automatically or manually.

<Overlapping process>
When the alignment process is completed, the processor 20 uses the alignment result to display a registration image (see the result image in FIG. 2) in which at least the first image and the second image are superimposed. It may be displayed in 1. Completion of the alignment process may be performed automatically or manually.

When at least one of the frontal images for alignment is included as an image constituting the registration image in addition to other images that are not frontal images, the processor 20 superimposes the other images on the frontal image. The registration image may be displayed.

For example, the first image type is the first map image 300, which is a map image obtained by the first ophthalmic examination device (for example, the ophthalmic OCT device 10), and the second image type is the second image type. In the case of the second map image 310, which is a map image obtained by an ophthalmic examination device (eg, a visual field inspection device 15), the processor 20 is a first front image, which is a front image associated with the first map image. Alignment is performed between the image 320 and the second front image 330, which is a front image associated with the second map image, and the first map image 300 and the second map image 310 are overlapped with each other. In addition to the combined display, a registration image in which at least one of the first front image 320 and the second front image 330 is superimposed may be displayed on the display unit 1 (see FIG. 5). The processor 20 may be used for positioning the first front image 320 and the second front image 330, and may display an image in which only the first map image 300 and the second map image 310 are superimposed. ..

The processor 20 may display a registration image in which each front image for alignment is superimposed. In this case, the superposed image for alignment may also serve as the registration image.

The first image type is a first front image which is a front image obtained by a first ophthalmologic examination device (for example, a fundus camera), and the second image type is a second ophthalmologic examination device. In the case of the second front image, which is the front image obtained by (for example, SLO), the processor 20 aligns between the first front image and the second front image, and also performs the first front image. A registration image in which an image and a second front image are superimposed may be displayed on the display unit 1.

<Overlapping order>
On the registration screen, the processor 20 may create a registration image based on a preset superposition order, and display the created registration image on the display unit 1.

By superimposing an analysis-related image (for example, a map image) on the front image with respect to the preset overlay order, a registration image in which the analysis result is prioritized can be obtained. This makes it possible to easily confirm the correspondence between the analysis results on the front image.

For example, if the first image type is a first map image and the second image type is a second map image, the processor 20 is above the first front image and the second front image. The registration image in which the first map image and the second map image are superimposed may be displayed on the display unit 1.

Further, regarding the order of superimposing the first front image and the second front image, the front image having the smaller shooting angle of view is superposed on the front image having the larger shooting angle of view. The person can confirm the imaged portion in a wide range by the front image having the larger angle of view, and can easily confirm the correspondence between the front image and the map image having the smaller angle of view in the entire imaged area.

Further, the order of superimposing the first map image and the second map image is displayed discretely above the map image displayed comprehensively in two dimensions (for example, the map image of OCT). By superimposing the map images (for example, the map image of the visual field inspection device), the examiner can confirm the analysis result by the comprehensive map image in a wide range, and the comprehensive map image and the discrete map image with respect to the front image are used. The correspondence between the analysis results can be easily confirmed. For example, by superimposing the map image of the visual field inspection device displayed discretely on the map image of the OCT displayed comprehensively, the examiner can confirm the analysis result of the OCT in a wide range. At the same time, the correspondence between the OCT analysis result and the analysis result of the visual field inspection device for the front image can be easily confirmed. This is because the map image of the OCT is generally a color map that is two-dimensionally colored in the rectangular area, whereas the map image of the visual field inspection device is limited to the visual field measurement point, the fixed viewpoint, and the like. This is because it is common to be done.

<Change registration image settings>
On the registration screen, the processor 20 receives an instruction signal from the operation unit 4 for changing the setting of the registration image, creates a registration image according to the changed setting, and displays it on the display unit 1. It may be (see FIG. 3).

When the setting of the registration image is changed, the processor 20 may change the setting of the registration image set on the template and store it in the storage unit 30. By being able to change the settings of the registration image, the examiner can change to the desired registration image. Further, the examiner can confirm the correspondence between the images in a complex manner from the registration images having different settings by appropriately changing the settings of the registration images, which is also advantageous in diagnosis.

Regarding the setting change, for example, the processor 20 may receive an instruction signal from the operation unit 4 for changing the superposition order, create a registration image according to the changed order, and display it on the display unit 1. good. Since the examiner can change the order while looking at the registration image, the examiner can easily change to the registration image desired by the examiner. For example, when one of the first front image and the second front image is a color front image and the other is a fluorescence front image, the front image displayed above has better visibility, so that the color front image is improved. When confirming the lesion etc. on the upper image by switching the order between the image and the fluorescent front image and then confirming the correspondence between the lesion etc. and the lower image, check on both images. It can be done easily.

Regarding the setting change, for example, the processor 20 receives an instruction signal from the operation unit 4 for selecting the presence / absence of an image type applied to the registration image, and creates a registration image according to the changed image type. It may be displayed on the display unit 1.

In this case, for example, each image type applied to the registration image is displayed on the display unit 1, and the processor 20 receives a switching signal for each image type from the operation unit 4 and displays the registration image on the display unit 1. The image type to be applied may be switched (see the check box in FIG. 3). When one of the image types applied to the registration image is set as not applicable, the processor 20 deletes the image related to the image type set as not applicable from the registration image on the display unit 1. May be good. On the other hand, the processor 20 may display the registration image based on the image type set as applicable on the display unit 1.

By being able to switch the application to the registration image for each image type, the registration image desired by the examiner can be obtained, and the correspondence between the images can be confirmed more reliably. For example, when the map image in the first ophthalmologic examination device is deleted, the correspondence between the map image and the front image in the second ophthalmologic examination device can be confirmed more directly.

Regarding the setting change, for example, the processor 20 receives an instruction signal from the operation unit 4 for changing the transmittance of the image applied to the registration image, and creates a registration image according to the changed transmittance. Then, it may be displayed on the display unit 1.

In this case, for example, the transmittance of each image type applied to the registration image is variably displayed on the display unit 1, and the processor 20 receives and displays a signal for changing the transmittance from the operation unit 4. The transmittance of the image applied to the registration image on Part 1 may be changed (see the slider in FIG. 3).

By being able to change the transmittance to the registration image for each image type, the registration image desired by the examiner can be obtained, and the correspondence between the images can be confirmed more reliably. For example, when the transmittance of a certain image is changed, the display state between the images applied to the registration image is changed, and the relationship between the images is changed. By changing the transmittance, the examiner can acquire an image set to the relationship between each image desired by the examiner. For example, when the first map image (for example, the map image of the field inspection device) is displayed on the second map image (for example, the map image of OCT) and the front image is displayed below the map image. By increasing the transparency of the second map image, the examiner can easily confirm the correspondence with the front image of the first map image.

<Report display>
When the registration image setting is completed on the registration screen, the processor 20 may create a report including the set registration image. If the template does not include the registration image, the processor 20 may omit the registration screen.

The processor 20 may display the created report on the display unit 1, store it in the storage unit 30, output it to the outside, or print it (FIG. 4). reference). Here, since the registration image included in the report is a registration image selected by the examiner from a plurality of types of registration images, the examiner uses the registration image and other images for inspection. Can make the diagnosis desired by the person.

<Report creation / output based on inspection date>
In creating and outputting a report, the processor 20 receives an instruction for selecting an inspection date from the operation unit 4, and creates a report based on an image within a certain period based on the selected inspection date or inspection date. May be done (see FIG. 7). The range for a certain period may be set by the examiner. In addition, the inspection date shall include a display form that is expressed as an inspection month.

Here, by managing the images on the inspection date, the data on the inspection date desired by the examiner can be easily displayed. It is also possible to follow up by changing the inspection date. When a plurality of inspection dates are specified at the same time, the processor 20 may output a report in which images having different inspection dates are output over time as a follow-up report.

Further, since the inspection date can be selected on the same screen as the report output screen, the report of the inspection date desired by the examiner can be easily output and the report contents can be easily confirmed. Follow-up can be performed smoothly by changing the inspection date. In this case, the processor 20 may update the output contents of the report according to the selected inspection date.

The selection of the inspection date is performed by the examiner, or the inspection date may be automatically selected. For example, the inspection date in which an abnormality is found in the analysis result may be automatically selected and output as a report.

7 and 13 are diagrams showing specific examples when outputting a report according to the inspection date. The processor 20 may accept an instruction for selecting one template from a plurality of displayed report templates and select a template. The template may be created in advance by the examiner. For example, a template composed of scanning patterns (for example, "macular cross" and "macular map") when a specific imaging site is measured may be created. The created template may be displayed on the image list screen on the display unit 1.

When the template is selected, the processor 20 may acquire an image corresponding to the image type set as the template from the image of the subject stored in the storage unit 30. The processor 20 may create an inspection date list 500 from the acquired inspection data (see FIG. 7). The created inspection date list is displayed on the display unit 1. More specifically, a list of inspection dates matching the template may be created from the scanning patterns included in the template and the captured images corresponding to the scanning patterns stored in the storage unit 30.

When an inspection date is selected from the inspection date list, the processor 20 acquires an image corresponding to the selected inspection date (for example, date, time) from the storage unit 30, and reports 600 using the acquired image. You may create it. When the inspection date is changed from the created inspection date list after the report is displayed, the processor 20 may acquire an image corresponding to the changed inspection date and update the report content.
In this case, the image corresponding to the selected inspection date is displayed as a report. At the time of initial startup, the data of the date of the last shooting (most recent data) may be displayed. These processes are performed by the processor 20 based on the operation signal from the operation unit 4.

<Image type pattern of registration image>
Hereinafter, specific examples of various patterns in the registration image will be described. Each pattern example described below may be selectable as a plurality of image types in the registration image. The following examples are examples, and of course are not limited to these.

As a first example of the registration image, for example, an OCT two-dimensional image (for example, an OCT map image, an face OCT image, etc.) acquired by an ophthalmic OCT device and a map image acquired by a visual field inspection device. It may be a registration image in which and is superimposed (see FIG. 5).

As a second example of the registration image, for example, a two-dimensional image acquired by an ophthalmologic OCT device (for example, a map image, an OCT face image, etc.) and another ophthalmologic examination device different from the visual field examination device may be used. It may be a registration image in which the acquired photographed image or map image is superimposed.

As a third example of the registration image, for example, a resist obtained by superimposing a map image acquired by a visual field inspection device and a photographed image or a map image acquired by another ophthalmologic inspection device different from the visual field inspection device. It may be a ration image (see FIG. 6).

The OCT device for ophthalmology may be a fundus OCT capable of acquiring a two-dimensional image of the fundus. Further, the eye imaging device may be a fundus photography apparatus. This makes it possible to obtain a registration image relating to the image of the fundus. Further, a registration image with a map image obtained by a visual field examination device may be created by using a two-dimensional image of the fundus by the fundus OCT or a fundus image by the fundus photography apparatus. The present embodiment is not limited to the fundus, and can be applied to an image related to the anterior eye portion or an image related to the eyeball including the anterior eye portion and the fundus.

<OCT map image>
The map image of the OCT constituting the registration image may be image data of a so-called analysis map, for example, an image obtained by analyzing the OCT data obtained by the OCT optical system provided in the ophthalmic OCT device. It is data and may be displayed on the display unit 1 as an analysis map image.

The map image of OCT may be, for example, an analysis map image showing a two-dimensional distribution of measurement results for the eye to be inspected (for example, the fundus). In this case, for example, the color map may be color-coded according to the measured value. As the analysis map, for example, a thickness map showing the layer thickness, a comparison map showing the comparison result between the layer thickness of the eye to be inspected and the layer thickness of the normal eye stored in the normal eye database (normal eye DB map), and the eye to be inspected. It may be a deviation map showing the deviation between the layer thickness and the layer thickness of the normal eye stored in the normal eye database by the standard deviation. When determining the layer thickness, for example, the OCT data is divided into layers by image processing (for example, segmentation processing) on the OCT data, and the thickness of each layer is measured based on the space between the layer boundaries.

The analysis map is not limited to the layer thickness, and may be, for example, a map showing a curvature distribution or a map showing a blood vessel density distribution. A map showing the blood vessel density distribution may be obtained, for example, by analyzing OCT motion contrast data. Further, the analysis map may be a map showing the polarization characteristic distribution obtained by the polarization sensitive OCT (PS-OCT). The analysis map may be a map showing the blood flow velocity distribution obtained by Doppler-OCT.

The processor 20 may selectively display a plurality of image types related to the OCT map image as the image types constituting the registration image (see FIG. 12). For example, the processor 20 may display a thickness map, a normal eye DB map, and a deviation map in a selectable manner. In this case, for each map, maps for different layer areas may be selectable. Further, the thickness map, the normal eye DB map, and the deviation map may be acquired from the storage unit 30, a registration image may be created for each map, and each registration image may be displayed on the display unit 1. As a result, each registration image for each map image can be confirmed at the same time.

The processor 20 produces, for example, a registration image in which an OCT map image for a specific layer region and a map image acquired by a visual field test device are superimposed, so that the examiner analyzes the specific retinal layer. You can check the correspondence between the result and the visual field.

<OCT Enface Image>
The OCT emfice image on which the registration image is based may be an OCT signal frontal image generated from an OCT signal obtained by an OCT optical system, or may be a frontal image generated from three-dimensional OCT data. , It may be a front image generated from an interference signal that is the basis of OCT data. The three-dimensional OCT data may be acquired by raster scan.

The OCT emfice image, which is the basis of the registration image, is an OCT motion contrast front image (OCT motion contrast interface image; hereinafter, motion contrast is abbreviated as MC) generated from an OCT motion contrast signal obtained by the OCT optical system. ), Or an OCTMC front image generated from three-dimensional OCTMC data. MC data is acquired based on a plurality of OCT data that are temporally different with respect to the same position. As the method of calculating the OCT data for acquiring the MC data, for example, a method of calculating the intensity difference or the amplitude difference of the complex OCT data, and a method of calculating the variance or the standard deviation of the intensity or the amplitude of the complex OCT data (Speckle deviation). ), A method of calculating the phase difference or dispersion of the complex OCT data, a method of calculating the vector difference of the complex OCT data, and a method of multiplying the phase difference and the vector difference of the complex OCT signal. As one of the calculation methods, refer to, for example, Japanese Patent Application Laid-Open No. 2015-131107. The 3D OCTMC data may be acquired by arranging the motion contrast data in different scanning lines. As described above, the motion contrast data is not limited to the phase difference, but the intensity difference, the vector difference, and the like may be acquired.

The front image generated from the 3D OCT data (or 3D OCTMC data) may be acquired, for example, by imaging the 3D OCT data with respect to at least a part of the region in the depth direction. More specifically, the OCT enhanced image may be acquired by computing 3D OCT data (or 3D OCTMC data) with respect to the entire area in the depth direction. The OCT enhanced image is a 3D OCT data (or 3D OCTMC data) with respect to a part of the depth direction (for example, a specific layer region or a specific depth region). ) May be obtained. The calculation method may be an integration process or another method (for example, a histogram calculation).

The processor 20 may selectively display a plurality of image types related to the face image of the OCT as the image types constituting the registration image. For example, the face image may be classified according to different depth regions (eg, different layer regions in the depth direction), and the face images classified according to the depth region may be selectively displayed. May be good. Further, an face image having a different depth region may be acquired from the storage unit 30, a registration image may be created for each face image, and each registration image may be displayed on the display unit 1. This makes it possible to simultaneously confirm each registration for face images having different depth regions. Further, it may be possible to select between an OCT signal front image and an OCT motion contrast front image.

The processor 20 creates, for example, a registration image in which an OCT interface image relating to a specific layer region and a map image acquired by a visual field test device are superimposed, so that the examiner can obtain a specific retinal layer structure. You can check the correspondence with the visual field. In this case, by setting the registration image of the OCT front image in the specific layer region and the map image of the visual field inspection device, the correspondence between the morphological information and the visual field in the specific layer can be confirmed.

In this case, a registration image (see FIG. 10) is created by superimposing the OCT interface image (OCT signal front image in FIG. 10) 400 for a specific layer region and the map image acquired by the visual field inspection device. Thereby, the examiner can confirm the correspondence between the specific retinal layer structure and the visual field. For example, the examiner can easily confirm the relationship between the defective region by confirming the defective region from the front image of the RPE layer and collating the defective region with the visual field measurement result.

Further, by creating a registration image (see FIG. 11) in which the OCTMC front image 410 and the map image acquired by the visual field inspection device are superimposed, the examiner confirms the correspondence between the blood vessel information and the visual field. can. For example, the examiner can easily confirm the traveling state of the blood vessel with respect to the FAZ region in association with the visual field measurement result in the FAZ region.

<OCT 2D image classification method>
The OCT two-dimensional images (for example, OCT map image, OCT interface image, etc.) constituting the registration image may be classified according to the imaging site, and a plurality of OCT two-dimensional images classified according to the imaging site. One of the images may be selectable as an image type constituting the registration image. For example, an OCT two-dimensional image of the macula and an OCT two-dimensional image of the nipple may be selectable as the image type.

The OCT two-dimensional image may be an XY image having an X-axis on the horizontal axis and a Y-axis on the vertical axis, and a Y-X image having a Y-axis on the horizontal axis and an X-axis on the vertical axis. The axis relationship may be selectable. Here, the X-axis direction is defined as a horizontal direction orthogonal to the depth direction, and the Y-axis direction is defined as a vertical direction orthogonal to the depth direction.

When the OCT two-dimensional image is a map image, the map image may be classified according to the scanning pattern, or one of a plurality of map images classified according to the scanning pattern may be selectable. For example, the map image is acquired based on the OCT data acquired by the raster scan and the OCT data acquired by the radial scan. Therefore, the map image by the raster scan and the map image by the radial scan may be selectable as the image type constituting the registration image.

Further, the OCT two-dimensional image may be classified according to the model of the ophthalmic OCT device, and one of a plurality of OCT two-dimensional images classified according to the model is selected as the image type constituting the registration image. It may be possible.

For example, as an OCT device for ophthalmology, there are a multifunction device of OCT and SLO, a multifunction device of OCT and a fundus camera, and a single OCT device, so that at least two of these devices can be selected as an image type. Good (classification by frontal imaging system). Further, for example, since SD-OCT, SS-OCT, and TD-OCT exist as OCT devices for ophthalmology, at least two of these devices may be selectable as image types (classification based on the OCT principle). .. In the case of classification according to the model, the frontal imaging system and the classification based on the OCT principle may be a set.

As described above, the OCT two-dimensional image is classified according to the imaging site, the vertical / horizontal axis relationship, the scanning pattern, and the imaging device, which is convenient for the examiner to create a desired registration image. ..

In the example of FIG. 8, the types of the two-dimensional images of the OCT constituting the registration image are classified by at least the imaging site (see Listing 100), and when the imaging site is selected, the map is further divided. The type of image or the OCT-enphised image can be selected (see FIG. 12).

<Front image associated with OCT 2D image>
The frontal image associated with the OCT two-dimensional image may be an image obtained by an OCT optical system provided in the ophthalmic OCT device or another frontal imaging optical system provided in the ophthalmic OCT device. It may be used for alignment with a frontal image obtained by another ophthalmologic examination device. Further, the front image associated with the OCT two-dimensional image may form a registration image together with the OCT two-dimensional image.

It should be noted that the front image to be associated may be selectable between the image obtained by the OCT optical system and the image obtained by the front image pickup optical system. The image obtained by the OCT optical system may be any of the above-mentioned face images. That is, when the OCT two-dimensional image is an face image, it may be used for alignment with the front image acquired by another ophthalmologic examination apparatus.

The frontal imaging optical system may be, for example, an SLO optical system or a fundus camera optical system. The front image obtained by the front image pickup optical system may be a visible front image taken by visible light, an infrared front image taken by infrared light, or a fluorescence front image acquired by fluorescence photography. .. The front image may be classified according to the shooting wavelength, or one of a plurality of front images classified according to the shooting wavelength may be selectable.

<Map image of visual field inspection device>
The map image of the visual field inspection device (hereinafter referred to as the visual field map image) constituting the registration image may be image data showing the analysis result obtained by the visual field inspection, and is displayed on the display unit 1 as the visual field analysis map image. May be done.

The map image of the visual field may be a visual field analysis map image showing a two-dimensional distribution of the visual field measurement results for the eye to be inspected. The visual field analysis map may be a visual sensitivity map in which measured values at a plurality of visual field measurement points (for example, luminosity factor) are displayed two-dimensionally, or measured values at a plurality of visual field measurement points (for example, visual sensitivity). , Visibility) may be a color-coded color map. In this case, the color map may be a luminosity factor (corresponding to the color of the sensitivity scale) color map that complements the intervals between the optotypes. In addition, the visual field analysis map may be a map related to the fixation test, for example, a map showing the fixation stability obtained from the fixation distribution in the fovea centralis, and a map showing the position of the fixation. You may. The visual field inspection device may be a microperimeter or a Humphrey perimeter.

The processor 20 may selectively display a plurality of image types related to the map image of the field of view as the image types constituting the registration image (see FIG. 16). For example, the processor 20 may selectively display a luminosity factor map, a color map, a map related to a fixation test, and the like. By selecting the type of the map image of the visual field, the examiner can confirm the analysis result of the OCT and the analysis result of the visual field from various aspects.

The front image associated with the map image of the visual field may be an image obtained by the fundus frontal imaging optical system provided in the visual field inspection device. As the frontal imaging optical system, for example, a fundus camera optical system and an SLO optical system can be considered. The front image obtained by the front image pickup optical system may be a visible front image taken by visible light, an infrared front image taken by infrared light, or a fluorescence front image acquired by fluorescence photography. .. The front image may be classified according to the shooting wavelength, or one of a plurality of front images classified according to the shooting wavelength may be selectable.

When creating a report including a registration image obtained by superimposing an OCT two-dimensional image and a map image of a visual field inspection device and another image, the processor 20 corresponds to an imaged portion output as a registration image. You may create a report containing other images. In this case, such a report may be pre-created as the default template.

The other image may be, for example, a B-scan OCT image, a three-dimensional OCT image, an analysis chart, an analysis graph, or a map image or an face image different from the OCT two-dimensional image constituting the registration. As another image, the processor 20 may create a report including at least one of the original image of the OCT two-dimensional image constituting the registration image and the front image associated with the OCT two-dimensional image.

<Ophthalmology OCT device, third ophthalmology inspection device different from visual field inspection device>
The third ophthalmologic examination apparatus (another ophthalmologic examination apparatus) may be, for example, an ophthalmologic imaging apparatus (for example, a fundus imaging apparatus 17) for photographing an eye to be inspected (for example, a fundus), and a registration image. As the image type constituting the above, the photographed image acquired by the ophthalmologic photographing apparatus may be selectable. The fundus photography device may be, for example, a single fundus photography device for photographing a front image such as a fundus camera or an SLO. The ophthalmologic imaging device may be a stationary type or a handheld type.

The processor 20 includes a third fundus front image 350 acquired by the fundus photography apparatus 17, a map image 310 acquired by the visual field inspection apparatus 15, and a second front image 330 associated with the map image 310. A registration image may be created by superimposing the above (see FIG. 6).

The front image obtained by the ophthalmographing apparatus may be a visible front image taken by visible light, an infrared front image taken by infrared light, or a fluorescence front image obtained by fluorescence photography. The front image may be classified according to the shooting wavelength, or one of a plurality of front images classified according to the shooting wavelength may be selectable.

The other ophthalmic examination device may be, for example, an ophthalmologic blood flow velocity measuring device (for example, a fundus blood flow measuring device) for measuring the blood flow velocity of the eye to be inspected, and the image type constituting the registration image. The blood flow map image acquired by the ophthalmologic blood flow velocity measuring device may be selectable. The blood flow map image may be, for example, a blood flow map image showing a two-dimensional distribution of measurement results regarding the blood flow velocity of the eye, or may be a color map color-coded according to the measured values. As an ophthalmic blood flow velocity measuring device, for example, a blood flow velocity measuring device (LSFG: laser speckle flow graph) for measuring a blood flow velocity based on a speckle signal reflected from a blood cell of an eye. (For example, Japanese Patent Application Laid-Open No. 2003-180641).

In this case, by setting the registration image of the blood flow map image and the OCT two-dimensional image, the examiner can confirm the correspondence between the OCT and the blood flow velocity. Further, by setting a registration image between the blood flow map image and the visual field map image, the correspondence between the visual field measurement result and the blood flow velocity can be confirmed.

<Example of transformation>
In the above description, the registration image is provided in the report template, but the present invention is not limited to this, and the registration image is created based on the images obtained by a plurality of different ophthalmologic examination devices. , The present embodiment can be applied.

In the above description, an example of creating a registration image based on images obtained by a plurality of different ophthalmologic examination devices has been shown, but a multifunction device having a plurality of functions (for example, an OCT and a visual field test device) has been shown. This embodiment may be applied in the case of creating a registration image between images obtained by a multifunction device).

It is a block diagram which shows an example of the ophthalmologic image processing apparatus which concerns on this Example. It is a figure which shows an example of the registration screen which concerns on this Example. It is a figure which shows an example of the setting screen in the registration screen which concerns on this Example. It is a figure which shows an example of the report which concerns on this Example. It is a figure which shows an example of the registration image which concerns on this Example. It is a figure which shows an example of the registration image which concerns on this Example. It is a figure which shows an example of the screen which outputs the report based on the inspection day which concerns on this Example. It is a figure which shows an example of a template creation screen. It is a figure which shows an example of the selection screen for selecting one of the reports in this Example. It is a figure which shows an example of the registration image which concerns on this Example. It is a figure which shows an example of the registration image which concerns on this Example. It is a figure which shows an example of the selection screen which selects the OCT two-dimensional image which concerns on this Example. It is a figure which shows an example of the screen which outputs the image data based on the inspection day which concerns on this Example. It is a figure which shows an example in the case of setting the polymerization region which concerns on this Example. It is a figure which shows an example of the case of making the feature image which concerns on this Example. It is a figure which shows an example of the selection screen which selects the map image of the perimeter according to this Example.

1 Output section (display section)
4 Operation unit 10 Ophthalmic OCT device (first ophthalmic examination device)
15 Visual field test device (second ophthalmic test device)
17 Fundus photography device (third fundus inspection device)
20 CPU (processor 20)
30 Memory

Claims (5)

An ophthalmologic image processing device that processes image data of an eye to be inspected acquired by a plurality of ophthalmologic examination devices.
Registration in which the first image data, which is the image data of the eye to be inspected acquired by the first ophthalmic examination apparatus, and the second image data, which is the image data acquired by the second ophthalmic examination apparatus, are superimposed. Image processing means to create images and
A setting means for setting an image type in the first image data and the second image data constituting the registration image, and
Equipped with
The first ophthalmologic examination device is a first ophthalmology examination device having at least an ophthalmic OCT, and the second ophthalmology examination device is a second ophthalmology examination device having at least a visual field measurement function.
The image processing means is
The first image data includes an OCT two-dimensional image acquired by the first ophthalmologic examination apparatus and a first front image data which is a frontal image of the eye to be inspected acquired by the first ophthalmologic examination apparatus. The first front image data associated with the OCT two-dimensional image and the data are acquired from the storage unit.
As the second image data, a field map image of the eye to be inspected acquired by the second ophthalmologic examination apparatus and a second frontal image data which is a frontal image of the eye to be inspected acquired by the second ophthalmologic examination apparatus are used. Therefore, the second front image data associated with the field map image is acquired from the storage unit.
By matching the first front image data and the second front image data, the alignment process between the first- stage OCT two-dimensional image and the field map image is performed.
An ophthalmic image processing apparatus characterized in that a registration image in which the OCT two-dimensional image corresponding to the image type set by the setting means and the field of view map image are superimposed is created and output. The setting means can further set and change the order in which the first image data and the second image data are superimposed in the creation of the registration image.
The ophthalmologic image processing apparatus according to claim 1, wherein the image processing means creates a registration image based on the order in which the settings are changed. In the ophthalmic image processing apparatus of claim 1,
By adjusting the magnification between the first front image data and the second front image data, it is characterized in that the deviation of the magnification between the early OCT two-dimensional image and the field map image is corrected. Ophthalmology image processing device. In the ophthalmic image processing apparatus of claim 1,
The ophthalmologic image processing apparatus, characterized in that the OCT two-dimensional image is OCT enhanced image data. An ophthalmic image processing program executed in an ophthalmic image processing device that processes image data of an eye to be inspected acquired by a plurality of ophthalmic examination devices.
By being executed by the processor of the ophthalmologic image processing device,
Registration in which the first image data, which is the image data of the eye to be inspected acquired by the first ophthalmic examination apparatus, and the second image data, which is the image data acquired by the second ophthalmic examination apparatus, are superimposed. Image processing steps to create an image and
The ophthalmic image processing apparatus is made to execute the setting step of setting the image type in the first image data and the second image data constituting the registration image.
The first ophthalmologic examination device is a first ophthalmology examination device having at least an ophthalmic OCT, and the second ophthalmology examination device is a second ophthalmology examination device having at least a visual field measurement function.
The image processing step is
The first image data includes an OCT two-dimensional image acquired by the first ophthalmologic examination apparatus and a first front image data which is a frontal image of the eye to be inspected acquired by the first ophthalmologic examination apparatus. The first front image data associated with the OCT two-dimensional image and the data are acquired from the storage unit.
As the second image data, a field map image of the eye to be inspected acquired by the second ophthalmologic examination apparatus and a second frontal image data which is a frontal image of the eye to be inspected acquired by the second ophthalmologic examination apparatus are used. Therefore, the second front image data associated with the field map image is acquired from the storage unit.
By matching the first front image data and the second front image data, the alignment process between the first-stage OCT two-dimensional image and the field map image is performed.
An ophthalmic image processing program characterized by creating and outputting a registration image in which the OCT two-dimensional image corresponding to the image type set by the setting step and the field of view map image are superimposed.

Images