Disclosure of Invention
In view of the above, the present invention provides a retinal exposure method, a retinal exposure apparatus, an electronic device, and a readable storage medium, which provide suitable light-emitting brightness for different patients, and make the generated retinal image clearer while shortening the exposure time.
In a first aspect, an embodiment of the present invention provides a retina exposure method applied to a fundus camera, including:
under the condition that infrared light irradiates a retina through a pupil, acquiring a pixel average value of a retina histogram in real time, comparing the pixel average value with a preset pixel average range value of a preset histogram sequence, and obtaining first brightness of the retina histogram corresponding to the pixel average value when the pixel average value falls within the preset pixel average range value;
searching a corresponding relation function in a database through the first reflectivity and the first wavelength value of the infrared light;
and setting the light emission quantity of the multispectral light source according to the relation function so that the second brightness of the acquired retina histogram is the same as the first brightness when the multispectral light source irradiates the retina through the pupil.
With reference to the first aspect, the present invention provides a first possible implementation manner of the first aspect, wherein the setting the light emission amount of the multispectral light source according to the relationship function includes:
acquiring a second wavelength value of the multispectral light source;
obtaining a second reflectivity of the multi-spectral light source according to the relation function and the second wavelength value;
and setting the light emission quantity of the multispectral light source through the second reflectivity, the first brightness and a reflectivity relation formula.
With reference to the first aspect, the present invention provides a second possible implementation manner of the first aspect, wherein the setting, by using the second reflectance, the first brightness, and a reflectance relation formula, the light emission amount of the multispectral light source includes:
calculating the luminescence amount of the multispectral light source according to the following reflectivity relation formula;
Ne=Np*(Ap/f2)*te 2*(r/π)*ti*h
wherein N iseFor photoelectron counting per pixel, NpFor event photon illumination count for each pixel characterizing said amount of luminescence, ApIs the area of the pupil (measurement), f is the characteristic length of the eye, teIs the one-way transmission of the eye, r is the retinal reflectance, tiH is the quantum efficiency of the image sensor, which is the collection coefficient of the fundus camera.
With reference to the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where the method further includes: in the case where the average value of the pixels of the retina histogram does not fall within the preset average range of pixels value, the exposure level and the exposure time are adjusted so that the average value of the pixels of the retina histogram falls within the preset average range of pixels value, and a first luminance of the retina histogram corresponding to the average value of the pixels is acquired.
With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, wherein, in a case that the average value of the pixels of the retina histogram does not fall within the preset average range of pixels, the adjusting the exposure level and the exposure time includes:
when the pixel average value is higher than the highest value in the preset pixel average range values of the preset histogram sequence, reducing the exposure time and/or reducing the exposure;
increasing the exposure time and/or increasing the exposure level when the pixel average value is lower than the lowest value of the preset pixel average range values of the preset histogram sequence.
With reference to the first aspect, an embodiment of the present invention provides a fifth possible implementation manner of the first aspect, wherein both the pixel average value of the retina histogram and the preset pixel average range value are lower than the saturation level.
With reference to the first aspect, an embodiment of the present invention provides a sixth possible implementation manner of the first aspect, where the method further includes: the exposure time is increased by increasing the pulse width.
In a second aspect, an embodiment of the present invention also provides a retinal exposure apparatus applied to a fundus camera, including:
the comparison unit is used for acquiring a pixel average value of a retina histogram in real time under the condition that infrared light irradiates the retina through a pupil, comparing the pixel average value with a preset pixel average range value of a preset histogram sequence, and obtaining first brightness of the retina histogram corresponding to the pixel average value when the pixel average value falls within the preset pixel average range value;
the searching unit is used for searching a corresponding relation function in a database through the first reflectivity and the first wavelength value of the infrared light;
and the setting unit is used for setting the light emission quantity of the multispectral light source according to the relation function so that the second brightness of the acquired retina histogram is the same as the first brightness when the multispectral light source irradiates the retina through the pupil.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
a storage medium;
a processor; and
a retinal exposure apparatus stored in the storage medium and including software functional modules executed by the processor, the apparatus comprising:
the comparison unit is used for acquiring a pixel average value of a retina histogram in real time under the condition that infrared light irradiates the retina through a pupil, comparing the pixel average value with a preset pixel average range value of a preset histogram sequence, and obtaining first brightness of the retina histogram corresponding to the pixel average value when the pixel average value falls within the preset pixel average range value;
the searching unit is used for searching a corresponding relation function in a database through the first reflectivity and the first wavelength value of the infrared light;
and the setting unit is used for setting the light emission quantity of the multispectral light source according to the relation function so that the second brightness of the acquired retina histogram is the same as the first brightness when the multispectral light source irradiates the retina through the pupil.
In a fourth aspect, embodiments of the present invention further provide a readable storage medium, in which a computer program is stored, the computer program, when executed, implementing the retinal exposure method as described above.
The embodiment of the invention provides a retina exposure method, a retina exposure device, electronic equipment and a readable storage medium, wherein the retina exposure method comprises the following steps: under the condition that infrared light irradiates the retina through a pupil, acquiring a pixel average value of a retina histogram in real time, comparing the pixel average value with a preset pixel average range value of a preset histogram sequence, and obtaining first brightness of the retina histogram corresponding to the pixel average value when the pixel average value falls within the preset pixel average range value; searching a corresponding relation function in a database through the first reflectivity and the first wavelength value of the infrared light; the light emission quantity of the multispectral light source is set according to the relation function, so that the second brightness of the obtained retina histogram is the same as the first brightness under the condition that the multispectral light source irradiates the retina through the pupil, the appropriate light emission brightness is provided for different patients, and the generated retina image is clearer while the exposure time is shortened.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Existing fundus cameras utilize xenon white light for retinal illumination, and the camera operator adjusts the retinal illumination intensity using a light intensity knob. Bright flickering white light reduces pupil size, requiring an increased exposure time before a second image can be taken, which can cause the patient to feel uncomfortable with the exposure process, while increasing the likelihood of obtaining an overexposed retinal image with areas of the retinal image where the sensor's saturated retinal features are not visible, severely affecting the quality of the retinal image.
Based on this, the retina exposure method, the retina exposure device, the electronic device and the readable storage medium provided by the embodiment of the invention provide suitable light-emitting brightness for different patients, and the generated retina image is clearer while the exposure time is shortened.
To facilitate understanding of the present embodiment, a retina exposure method disclosed in the present embodiment will be described in detail first.
Fig. 1 is a flowchart of a retinal exposure method according to an embodiment of the present invention.
Referring to fig. 1, a retinal exposure method, applied to a fundus camera, includes the steps of:
step S110, under the condition that infrared light irradiates the retina through the pupil, acquiring the pixel average value of the retina histogram in real time, comparing the pixel average value with the preset pixel average range value of a preset histogram sequence, and when the pixel average value falls within the preset pixel average range value, obtaining the first brightness of the retina histogram corresponding to the pixel average value;
step S120, searching a corresponding relation function in a database through the first reflectivity and the first wavelength value of the infrared light;
step S130, setting the light emitting amount of the multispectral light source according to the relationship function, so that the second brightness of the obtained retinal histogram is the same as the first brightness when the multispectral light source irradiates the retina through the pupil.
Specifically, the diameter of the pupil of the human eye and the pigmentation behind the eye seriously affect the spectral reflectivity of different wavelengths, so that different patients can obtain fundus retinal images with different definitions when receiving the same light source brightness;
wherein, the retina histogram refers to a histogram image obtained by an image sensor of the retina exposure device in the application;
here, the retina exposure method provided by the application can shorten the exposure time to 10ms-40ms, and compared with the prior art, the retina exposure method shortens the exposure time and reduces the discomfort of patients in the exposure process;
further, in the above embodiment, the step S130 of setting the light emitting amount of the multispectral light source according to the relationship function may further be implemented by the following steps, including:
step S202, acquiring a second wavelength value of the multispectral light source;
step S204, obtaining a second reflectivity of the multispectral light source according to the relation function and the second wavelength value;
in step S206, the light emission amount of the multispectral light source is set according to the second reflectivity, the first brightness and the reflectivity relation formula.
Here, the retina has different levels of pigment and variable components, which are associated with different ethnic groups and ages, and these characteristics can be observed in the retinal reflectance curve, as shown in FIG. 2. We can see that the spectral reflectance varies across the range, while we can observe from the attached retinal reflectance curve that in the short wavelength range of 400nm to 580nm, the reflectance ranges from 2% to 3% for different skin types (from light to dark skin), the retinal reflectance increases by over 20% above 600nm, and varies dramatically for different skin types;
specifically, the pupil is irradiated by invisible infrared light without changing the size of the pupil, and then the pixel average value of the generated retina image is compared with a preset evaluation range value capable of generating a clear image, when the pixel average value falls into the range, the retina image with the pixel average value is clear, and physiological or pathological characteristics of a patient can be displayed, at the moment, the brightness of the retina image can be obtained, namely, the first brightness of a histogram image capable of generating clear medical characteristics for the patient;
in addition, the first wavelength value of the infrared light and the first reflectivity of the infrared light obtained through the retina of the patient can be obtained;
it should be noted that, by searching a plurality of preset relationship functions in the database, as shown in fig. 2, for example, when a first wavelength value (abscissa) and a first reflectivity (ordinate) are known, a curve, i.e., the found relationship function, can be determined without any problem, and then a second wavelength value (abscissa) of a light source selected to be applied in the multispectral light source is used to find a corresponding second reflectivity (ordinate) corresponding to the curve;
here, the multispectral light source includes light sources with various wavelengths, and one or more light sources can be selectively applied according to the situation or need;
each retina image corresponds to a retina histogram so as to obtain a pixel average value according to the retina histograms;
further, step S206 in the above embodiment may also be implemented by the following steps, including:
step S302, calculating the light emission quantity of the multispectral light source according to a reflectivity relation formula (1);
Ne=Np*(Ap/f2)*te 2*(r/π)*ti*h (1)
wherein N iseFor photoelectron counting per pixel, NpFor event photon illumination counting for each pixel characterizing the amount of emitted light, ApIs the area of the pupil (measurement), f is the characteristic length of the eye, teIs the one-way transmission of the eye, r is the retinal reflectance, tiIs the collection coefficient of the fundus camera, and h is the quantum efficiency of the image sensor.
Here, the photoelectron count of each pixel of the histogram is calculated according to the luminance of the histogram to be achieved, and the second reflectance and the photoelectron count of each pixel obtained in the above embodiment are substituted into the above reflection relational expression, so that the light emission amount of the multispectral light source can be obtained, that is, the multispectral light source is set according to the light emission amount, so that when the multispectral light source of the light emission amount irradiates the retina, a clear retina image can be quickly presented;
it should be noted that, the remaining parameters in the above formula (1) are as follows: a. thep、f、te、tiH is changed in real time according to the condition of light irradiation, namely the light emission quantity of the multispectral light source set by people is also adjusted in real time, so that the second brightness of the histogram image at the moment reaches the first brightness, and a clear retina image is presented in real time;
further, the method further comprises: in step S140, in a case where the average value of the pixels of the retina histogram does not fall within the preset average range of pixels value, the exposure level and the exposure time are adjusted so that the average value of the pixels of the retina histogram falls within the preset average range of pixels value, and the first brightness of the retina histogram corresponding to the average value of the pixels is acquired.
Further, in the above embodiment, the step S140 may be implemented by the following steps when the average value of the pixels of the retina histogram does not fall within the preset average range of the pixels, and the exposure level and the exposure time are adjusted, including:
step S402, when the pixel average value is higher than the highest value in the preset pixel average range value of the preset histogram sequence, reducing the exposure time and/or reducing the exposure;
in step S404, when the pixel average value is lower than the lowest value in the preset pixel average range values of the preset histogram sequence, the exposure time is increased and/or the exposure level is increased.
Further, the method further comprises: in step S150, the exposure time is increased by increasing the pulse width.
Here, we make the brightness of the retinal image within a range by adjusting the exposure and the exposure time by adjusting the pulse width sent to the illumination module, the physiological or pathological features are displayed more clearly, and a first exposure is obtained which makes the retinal image of the patient clear;
further, the average value of the pixels of the retinal histogram and the preset average range value of the pixels are both below the saturation level.
Here, the embodiment of the present invention may also make the average value of the pixels of the retinal histogram at different gray levels by manually setting the exposure level;
further, an embodiment of the present invention also provides a retinal exposure apparatus applied to a fundus camera, including:
the comparison unit is used for acquiring the pixel average value of the retina histogram in real time under the condition that infrared light irradiates the retina through the pupil, comparing the pixel average value with the preset pixel average range value of the preset histogram sequence, and obtaining the first brightness of the retina histogram corresponding to the pixel average value when the pixel average value falls within the preset pixel average range value;
the searching unit is used for searching a corresponding relation function in the database through the first reflectivity and the first wavelength value of the infrared light;
and the setting unit is used for setting the light emission quantity of the multispectral light source according to the relation function, so that the second brightness of the acquired retina histogram is the same as the first brightness under the condition that the multispectral light source irradiates the retina through the pupil.
Further, the setting unit is also used for acquiring a second wavelength value of the multispectral light source; obtaining a second reflectivity of the multispectral light source according to the relation function and the second wavelength value; and setting the light emitting quantity of the multispectral light source through a second reflectivity, the first brightness and a reflectivity relation formula.
Further, the setting unit is also used for calculating the light emission quantity of the multispectral light source according to the following reflectivity relation formula;
Ne=Np*(Ap/f2)*te 2*(r/π)*ti*h
wherein N iseFor photoelectron counting per pixel, NpFor event photon illumination counting for each pixel characterizing the amount of emitted light, ApIs the area of the pupil (measurement), f is the characteristic length of the eye, teIs the one-way transmission of the eye, r is the retinal reflectance, tiIs the collection coefficient of the fundus camera, and h is the quantum efficiency of the image sensor.
Further, the apparatus may further include an adjusting unit for adjusting the exposure level and the exposure time so that the average value of the pixels of the retina histogram falls within the preset average range of pixels in a case where the average value of the pixels of the retina histogram does not fall within the preset average range of pixels, and acquiring the first luminance of the retina histogram corresponding to the average value of the pixels.
Further, the adjusting unit is further configured to reduce the exposure time and/or reduce the exposure level when the pixel average value is higher than a highest value in a preset pixel average range value of the preset histogram sequence; the exposure time is increased and/or the exposure level is increased when the pixel average value is lower than the lowest value of the preset pixel average range values of the preset histogram sequence.
Fig. 3 is a schematic view of an application scenario of the retinal exposure apparatus according to the embodiment of the present invention.
Here, the single wavelength camera exposure is more challenging due to the complex retinal tissue and pigment distribution, so the retinal exposure device provided by the present application is mainly applied to a multispectral camera imaging system (multispectral fundus camera) which utilizes a light source with a wavelength range from 480nm to 980nm to obtain a clear cornea image of a patient faster;
through the retina exposure method in the embodiment, the control module sets the light emitting quantity of the LED source module in real time, and the retina exposure method is not described again;
referring to fig. 3, the LED source module irradiates the retina through the anterior illumination and imaging alignment structure, and then acquires a retinal image transmitted from the fundus through the beam splitter, the auto-focus adjustment mechanism structure, the astigmatism correction lens, and the FAF filter (autofluorescence filter) through the image sensor;
the fundus camera provided by the embodiment of the invention comprises: an illumination module 300, a main optical assembly (not shown), a focusing module 500 and an image sensing acquisition module 600; the illumination module 300 includes a plurality of light sources for emitting lights with different wavelengths, the illumination light emitted from the light sources enters the patient's eye through the main optical assembly, and the light reflected by the patient's fundus enters the image sensing and collecting module 600 through the main optical assembly and the focusing module 500.
Further, the main optical assembly includes an annular mirror 410 and an objective lens 420, the annular mirror 410 being disposed obliquely; the illumination light emitted by the illumination module 300 is reflected to the objective lens 420 via the annular reflective mirror 410 and then enters the patient's eye; the light reflected by the fundus of the patient passes through the objective lens 420, the center of the annular reflecting mirror 410, and the focusing module 500 in sequence, and then reaches the image sensing and collecting module 600.
Here, the main optical assembly further includes an optical path folding mirror 430, the objective lens 420 is disposed on one side of the optical path folding mirror 430, and the focusing module 500 and the image sensing and collecting module 600 are disposed on the other side of the optical path folding mirror 430; an axial compensator 440 is arranged between the annular reflective mirror 410 and the optical path folding reflective mirror 430, and a transverse compensator 450 is arranged between the focusing module 500 and the image sensing acquisition module 600.
The illumination module 300 transmits light emitted by triggering to the input end of the illumination light path of the main optical assembly through the optical coupling unit of the illumination module, and the light is imaged on the pupil of the patient through the illumination light path aperture 320, the illumination light path eyepiece and the field lens 310, and then the whole retina is irradiated in a preset solid angle (field of view).
Further, the fundus camera also includes a sighting mark module 700 for guiding the patient's eye to look in different directions.
Specifically, the sighting target module 700 is located at the right side of the light splitting reflector 710 in the imaging optical path of the main optical component, the sighting target module 700 and the image sensor are located on the same imaging plane, but the sighting target module 700 and the image sensor are separately arranged by separating the optical path through a light beam combiner (the light splitting reflector 710), and light emitted by the sighting target module 700 is reflected to the main optical component through the light splitting reflector 710. Specifically, in the retinal imaging behind the eyes, the first step is to observe the iris, find its pupil and measure the pupil diameter to inform the operator whether the size of the pupil is larger than the minimum diameter of the designed camera, and to make timely adjustment;
here, after the pupil measurement, the operator will move the camera forward to view the retina. During the process of moving the camera from the pupil to the retinal view, the patient must adjust the energy level of the light to view the retina. To accomplish this, real-time viewing is performed with infrared illumination nominally above 800nm while focused;
the spectral absorption components in the retina mainly include melanin, blood and other components. The main component is melanin in the whole spectral range, but in the range of 400-580nm, we can see that various components such as blood, crystalline lens and the like have remarkable absorption effect on short-wavelength light.
Here, in order to ensure that the LED source module and the camera are installed within a safe range, and have a hard-wired LED source module.
Among the key variables that affect retinal image quality include: pupil size, melanin pigment, wavelength and at different spectra, working distances and pulse sequence lengths;
further, as shown in fig. 4, it is a schematic diagram of an electronic device 100 for implementing the retina exposure method according to an embodiment of the present invention. In this embodiment, the electronic device 100 may be, but is not limited to, a computer device with retina exposure and processing capabilities, such as a Personal Computer (PC), a notebook computer, a monitoring device, and a server.
The electronic device 100 further comprises a retinal exposure apparatus 200, a storage medium 110, and a processor 120. In a preferred embodiment of the present invention, the retinal exposure device 200 includes at least one software functional module which can be stored in the storage medium 110 in the form of software or Firmware (Firmware) or solidified in an Operating System (OS) of the electronic device 100. The processor 120 is configured to execute executable software modules stored in the storage medium 110, for example, software functional modules and computer programs included in the retina exposure apparatus 200. In this embodiment, the retinal exposure device 200 may be integrated into the operating system as a part of the operating system. Specifically, the retina exposure apparatus 200 includes:
the comparison unit 210 is configured to obtain a pixel average value of the retinal histogram in real time under the condition that infrared light irradiates the retina through a pupil, compare the pixel average value with a preset pixel average range value of a preset histogram sequence, and obtain a first brightness of the retinal histogram corresponding to the pixel average value when the pixel average value falls within the preset pixel average range value;
the searching unit 220 is configured to search a corresponding relation function in the database according to the first reflectivity and the first wavelength value of the infrared light;
the setting unit 230 is configured to set the light emission amount of the multispectral light source according to the relationship function, so that the second luminance of the acquired retinal histogram is the same as the first luminance when the multispectral light source irradiates the retina through the pupil.
It can be understood that, for the specific operation method of each functional module in this embodiment, reference may be made to the detailed description of the corresponding step in the foregoing method embodiment, and no repeated description is provided herein.
In summary, embodiments of the present invention provide a retinal exposure method, a retinal exposure apparatus, an electronic device, and a readable storage medium, including: under the condition that infrared light irradiates the retina through a pupil, acquiring a pixel average value of a retina histogram in real time, comparing the pixel average value with a preset pixel average range value of a preset histogram sequence, and obtaining first brightness of the retina histogram corresponding to the pixel average value when the pixel average value falls within the preset pixel average range value; searching a corresponding relation function in a database through the first reflectivity and the first wavelength value of the infrared light; the light emission quantity of the multispectral light source is set according to the relation function, so that the second brightness of the obtained retina histogram is the same as the first brightness under the condition that the multispectral light source irradiates the retina through the pupil, the appropriate light emission brightness is provided for different patients, and the generated retina image is clearer while the exposure time is shortened.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus and method embodiments described above are illustrative only, as the flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in the embodiments of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.