CN106680992B - Imaging system based on double DMD - Google Patents
Imaging system based on double DMD Download PDFInfo
- Publication number
- CN106680992B CN106680992B CN201611055977.9A CN201611055977A CN106680992B CN 106680992 B CN106680992 B CN 106680992B CN 201611055977 A CN201611055977 A CN 201611055977A CN 106680992 B CN106680992 B CN 106680992B
- Authority
- CN
- China
- Prior art keywords
- dmd
- microprocessor
- modulation
- domain
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 155
- 241000826860 Trapezium Species 0.000 claims description 5
- 229920006395 saturated elastomer Polymers 0.000 abstract 4
- 230000009977 dual effect Effects 0.000 abstract 1
- 101100277918 Caenorhabditis elegans dmd-4 gene Proteins 0.000 description 34
- 238000010586 diagram Methods 0.000 description 16
- 238000000034 method Methods 0.000 description 13
- 230000008569 process Effects 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 8
- 230000004075 alteration Effects 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 4
- 239000000470 constituent Substances 0.000 description 4
- 238000003786 synthesis reaction Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 239000000243 solution Substances 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 229910044991 metal oxide Inorganic materials 0.000 description 2
- 150000004706 metal oxides Chemical class 0.000 description 2
- 230000001105 regulatory effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/0816—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more reflecting elements
- G02B26/0833—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more reflecting elements the reflecting element being a micromechanical device, e.g. a MEMS mirror, DMD
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
Abstract
本发明提供了一种基于双DMD的成像系统，通过微处理器对接收到的当前图像进行分析，判断当前图像中是否存在饱和区域，微处理器在判断出接收到的当前图像中存在饱和区域时，对第一DMD进行时间域调光，微处理器对经过时间域调光后获取的当前图像进行分析，判断当前图像是否仍然存在饱和区域，微处理器在判断出经时间域调光后接收到的当前图像中仍然存在饱和区域时，对第二DMD进行空间域调光。本发明实施例中，利用两个DMD将时间域调光和空间域调光进行结合，不仅保证图像质量，扩大了图像动态范围，而且能够最大化地保证成像的分辨率，实现了兼顾调制时间和空间分辨率的目的。
The present invention provides an imaging system based on dual DMD. The microprocessor analyzes the received current image to determine whether there is a saturated area in the current image, and the microprocessor determines whether there is a saturated area in the received current image. When the time domain dimming is performed on the first DMD, the microprocessor analyzes the current image obtained after the time domain dimming to determine whether the current image still has a saturated area. When there is still a saturated area in the received current image, spatial domain dimming is performed on the second DMD. In the embodiment of the present invention, two DMDs are used to combine the time-domain dimming and the spatial-domain dimming, which not only ensures the image quality, but also expands the dynamic range of the image, and maximizes the resolution of the imaging, realizing the consideration of the modulation time. and spatial resolution purposes.
Description
Technical field
The invention belongs to field of image processing more particularly to a kind of imaging systems based on double DMD.
Background technique
High dynamic range images (High-Dynamic Range, abbreviation HDR), compared to common image, can provide more
More dynamic ranges and image detail, according to LDR (Low-Dynamic Range) image of different exposure time, using each
The LDR image of time for exposure corresponding best details synthesizes final HDR image, can preferably reflect in people's true environment
Visual effect.
In order to obtain the image of high dynamic range, digital micro-mirror device (Digital is mostly used at present
Micromirror Device, DMD) optical modulation techniques are modulated image formed by imaging system.As shown in Figure 1, its
Schematic illustration as the existing light regulating technology based on DMD.As shown in Figure 1, scene passes through target imaging device
Light is incident on DMD by (Imaging lens), and the light of transmitting is passed through a relay imaging device (Relay by DMD
Imaging lens) it is incident on detector thus by scene imaging.Under normal circumstances, this detector can be complementary metal
Oxide semiconductor (Complementary Metal Oxide Semiconductor, abbreviation CMOS), or charge coupling
It closes element (Charge-coupled Device, abbreviation CCD).
In practical application, when light is stronger, or has the interference of strong light, saturation region can occur more by force due to light on detector
Domain makes user that can not get image.Field especially is explored in deep space, for space-based telescope, to observe that 0 waits the same of stars
When, moreover it is possible to observe the stars such as 8-10, it is necessary to which detector has wider dynamic range.In order to allow users to get compared with
The normal image of wide dynamic range, microprocessor time-domain light modulation can be carried out to DMD and spatial domain dims.
The essence of time-domain light modulation is to take multiple exposure, and exposure selects different light exposures every time, obtains different light intensity
Then information in range combines these information, one width of synthesis has the image of high dynamic range.Time-domain light modulation tool
There is acquisition image uniform naturally, determining the dynamic range of image after light modulation by modulation number, modulation number is more, is not shared the same light
Information under by force is also more, and the image finally synthesized is truer, but modulating time length is its unavoidable defect.Spatial domain tune
Light is obtained high dynamic by reducing the information content on unit area, that is, the spatial resolution of reduction imaging system
State range scene information.It is fast to dim speed, modulated in real time imaging may be implemented, but modulated image's authenticity is compared with time-domain tune
Light algorithm is poor.
Existing time-domain light modulation or spatial domain light modulation based on DMD, can not improve tune under the premise of guaranteeing resolution ratio
Time processed.
Summary of the invention
The present invention provides a kind of imaging system based on double DMD, time-domain light modulation is combined with spatial domain light modulation, substantially
Improve imaging system dynamic range, shorten modulation the time, for solve it is existing based on list DMD can be only done time-domain dim or
Spatial domain light modulation, and the problem of modulating the time can not be improved under the premise of guaranteeing resolution ratio.
To achieve the goals above, the present invention provides a kind of imaging systems based on double DMD, comprising:
Target imaging device, the first DMD and the 2nd DMD, the first off-axis relay imaging device and the second off-axis relay imaging
Device, imaging sensor and microprocessor；
Wherein, the light that scene is issued is incident on the first DMD, the first DMD hair by target imaging device
Reflected light out is incident on the 2nd DMD by the described first off-axis relay imaging device, and the 2nd DMD is issued anti-
Light is penetrated by the described second off-axis relay imaging device, is imaged in described image sensor, described image sensor will be described
Image is sent to the microprocessor；
The microprocessor analyzes the present image received, judges in present image with the presence or absence of saturation region
Domain；
The microprocessor in the present image for judging to receive there are when zone of saturation, to the first DMD into
The light modulation of row time-domain；
The microprocessor analyzes the present image obtained after time-domain light modulation, judges present image
Whether zone of saturation is still had；
There are still saturations in the present image for judging to receive after the time-domain dims for the microprocessor
When region, spatial domain light modulation is carried out to the 2nd DMD.
Imaging system provided by the invention based on double DMD divides the present image received by microprocessor
Analysis judges that, with the presence or absence of zone of saturation in present image, microprocessor has saturation in the present image for judging to receive
When region, time-domain light modulation is carried out to the first DMD, microprocessor divides the present image obtained after time-domain dims
Analysis judges whether present image still has zone of saturation, and microprocessor is judging that is received after time-domain dims work as
When still having zone of saturation in preceding image, spatial domain light modulation is carried out to the 2nd DMD.In this way, by utilizing two DMD by the time
Domain light modulation and spatial domain light modulation are combined, and are not only guaranteed picture quality, are expanded dynamic range of images, and can maximize
Ground guarantees the resolution ratio of imaging, realizes the purpose that the modulation time is improved under the premise of guaranteeing resolution ratio.
Detailed description of the invention
Fig. 1 is the schematic illustration of the existing light regulating technology based on DMD；
Fig. 2 is the structural schematic diagram for the imaging system based on double DMD that the embodiment of the present invention one provides；
Fig. 3 is the structural schematic diagram of the imaging system provided by Embodiment 2 of the present invention based on double DMD；
Fig. 4 is the schematic diagram in the embodiment of the present invention two in binary group TIR prism opticpath；
Fig. 5 is the schematic diagram in the embodiment of the present invention two in triple TIR prism opticpath；
Fig. 6 is the flow diagram that microprocessor dims a kind of time-domain of the first DMD in the embodiment of the present invention two；
Fig. 7 is the flow diagram that microprocessor dims another time-domain of the first DMD in the embodiment of the present invention two；
Fig. 8 is the flow diagram that microprocessor dims the spatial domain of the 2nd DMD in the embodiment of the present invention two；
The setting figure of pixel unit when Fig. 9 is spatial domain light modulation in the embodiment of the present invention two；
Figure 10 is the structural schematic diagram for the imaging system based on double DMD that the embodiment of the present invention three provides.
Specific embodiment
The imaging system provided in an embodiment of the present invention based on double DMD is described in detail with reference to the accompanying drawing.
Embodiment one
As shown in Fig. 2, the structural schematic diagram of its imaging system based on double DMD provided for the embodiment of the present invention one.It should
Imaging system based on double DMD includes: target imaging device 1, the first DMD 2, the first off-axis relay imaging device 3, the 2nd DMD
4, the second off-axis relay imaging device 5, imaging sensor 6 and microprocessor 7.
Wherein, the light that scene is issued enters target imaging device 1, is incident on by light after target imaging device 1
First DMD 2.It include multiple micro-reflectors on first DMD 2, micro-reflector can be reflected the light come in is entered.Through
The reflected light that first DMD 2 is issued, into the first off-axis relay imaging device 3, then by the first off-axis relay imaging dress
3 are set to be incident on the 2nd DMD 4.Micro-reflector on 2nd DMD 4 can be reflected the light come in is entered, through second
The reflected light that DMD 4 is issued enters the second off-axis relay imaging device 5, then passes through the second off-axis relay imaging device 5,
It is imaged on imaging sensor 6, which can send an image to microprocessor 7.In the present embodiment, image is passed
Sensor 6 can be cmos detector, or charge coupled cell (Charge-coupled Device, abbreviation CCD) detection
Device.
In practical application, target imaging device 1 can be one group of image-forming objective lens, and off-axis relay imaging device is one group of relaying
Imaging lens, for the image of an image device to be imaged on another image device, wherein two image devices
Optical axis it is not coaxial.
In the present embodiment, the first DMD 2 and the 2nd DMD 4 due to optical path design, the first DMD 2 and the 2nd DMD's 4
Optical axis is not coaxial, in order to reflect the reflected light issued on the first DMD 2 on the 2nd DMD 4, in the first DMD 2
And the 2nd be provided with the first off-axis relay imaging device 3 between DMD 4.Further, due to the first DMD 2 and the 2nd DMD 4
Optical axis it is not coaxial, can have off-axis aberration during imaging, the first off-axis relay imaging device 3 can be used to be imaged
Off-axis aberration present in journey.
Can also there are problems that optical axis out-of-alignment before 2nd DMD 4 and imaging sensor 6, in order to make on the 2nd DMD 4
Reflected light can be imaged on imaging sensor 6, in the present embodiment, set between the 2nd DMD 4 and imaging sensor 6
It is equipped with the second off-axis relay imaging device 5, the focusing that the second off-axis relay imaging device 5 can be used to reflect the 2nd DMD 4
It is transmitted on imaging sensor 6 and is imaged.From the 2nd DMD 4 to the process of the imaging of imaging sensor 6, as optical axis
Coaxially there is no off-axis aberration, the second off-axis relay imaging device 5 can be used to correct the off-axis aberration of optical system.
In practical application, when light is stronger, imaging sensor 6, which is formed by image, has zone of saturation, can not show
The details of actual scene is shown.In the present embodiment, after the imaging of imaging sensor 6, microprocessor 7 can be sent an image to,
Microprocessor 7 can analyze the present image received, judge in present image with the presence or absence of zone of saturation.Micro process
Device 7, there are when zone of saturation, carries out time-domain light modulation to the first DMD 2 in the present image for judging to receive.This implementation
In example, time-domain light modulation is carried out to the first DMD 2, exactly increases the exposure frequency of the first DMD 2, and set each exposure
Amount, after exposure frequency reaches the number of setting, so that it may trigger imaging sensor 6 and be imaged.When being carried out to the first DMD 2
Between domain dim, essence is to take multiple exposure, and exposure selects different light exposure every time, obtains the letter in different range of light intensity
Breath, then combines these information, and one width of synthesis has the image of high dynamic range.In practical application, when prolonged exposure
Between can also have certain limit value, upon exposure between beyond the phenomenon that after limit value, image will appear Caton in user's vision, use
Family experience is bad.
After the completion of being modulated to the first DMD 2, it can be imaged in imaging sensor 6, imaging sensor 6 can will scheme
As continuing to be sent to microprocessor 7,7 pairs of present images received after time-domain dims of microprocessor are analyzed, are sentenced
Whether disconnected present image still has zone of saturation, if continuing to adjust the first DMD 2 with prolonging exposure time, will lead to figure
As there is Caton phenomenon in user's vision.
In the present embodiment, in order to avoid there is the phenomenon that image Caton, microprocessor 7 is being judged after time-domain dims
When still having zone of saturation in received present image, so that it may by reducing the spatial resolution of zone of saturation image, come
Spatial domain light modulation is carried out to the 2nd DMD 4.Spatial domain light modulation is carried out to the 2nd DMD 4, is exactly by reducing saturation region in image
Spatial resolution on the corresponding unit area in domain, after spatial resolution reduces, the corresponding unit plane in zone of saturation in image
Information content in product can reduce, so that the saturation degree in the region is reduced, to obtain clearly image.
In the present embodiment after the spatial domain light modulation to the light modulation of 2 time-domain of the first DMD and the 2nd DMD 4, it can scheme
Image as getting high dynamic range on sensor 6.
Imaging system provided in this embodiment based on double DMD carries out the present image received by microprocessor
Analysis judges that with the presence or absence of zone of saturation in present image, microprocessor exists full in the present image for judging to receive
When with region, time-domain light modulation is carried out to the first DMD, microprocessor carries out the present image obtained after time-domain dims
Analysis judges whether present image still has zone of saturation, and microprocessor is being judged to receive after time-domain dims
When still having zone of saturation in present image, spatial domain light modulation is carried out to the 2nd DMD.It, will using two DMD in the present embodiment
Time-domain light modulation and spatial domain light modulation are combined, and are not only guaranteed picture quality, are extended the time for exposure, and image dynamic is expanded
Range, and can maximumlly guarantee the resolution ratio of imaging, it realizes and improves the modulation time under the premise of guaranteeing resolution ratio
Purpose.
Embodiment two
As shown in figure 3, it is the structural schematic diagram of the imaging system provided by Embodiment 2 of the present invention based on double DMD.It should
Imaging system based on double DMD includes target imaging device 1 in above-described embodiment one, the first DMD 2, the first off-axis relay imaging
Except device 3, the 2nd DMD 4, the second off-axis relay imaging device 5, imaging sensor 6 and microprocessor 7, further includes: first
Inner total reflection (Total Internal Reflection, abbreviation TIR) prism apparatus 8 and the second TIR prism device 9.
Wherein, the light that scene is issued enters target imaging device 1, is entered by light after target imaging device 1
In first TIR prism device 8.In the present embodiment, the first TIR prism device 8 is arranged in target imaging device 1 and the first DMD
Between 2.Wherein, it needs to guarantee from the light that target imaging device 1 issues to when the incidence of the first TIR prism device 8, light
Incidence angle is greater than critical angle, and being incident on the first TIR prism device 8 in this way can all reflect light, is incident on
First DMD 2.Since the tilt angle of 2 micro-reflector of the first DMD is smaller, when the light that the first DMD 2 is reflected is to first
When TIR prism device 8 is incident, the incidence angle of light is then less than critical angle, then light will be by the first TIR prism device 8 thoroughly
It is shot out.The light that first TIR prism device 8 transmits away enters in the first off-axis relay imaging device 3.
Further, the light transmitted through the first off-axis relay imaging device 3 enters in the second TIR prism device 9, by
It is less than critical angle in the angle of the light come from the second off-axis transmission of relay imaging device 5, then light is filled through the second TIR prism
It sets 9 to be incident on the 2nd DMD 4, after the micro-reflector of the 2nd DMD 4 itself reflects incident light, light enters
To the second off-axis relay imaging device 5, the light then through the second off-axis relay imaging device 5 is finally in imaging sensor 6
On be imaged.
In the present embodiment, the first TIR prism device 8 and the second TIR prism device 9 are two group of components TIR prisms, respectively
Including a rectangular prism and right-angled trapezium prism.
Fig. 4 is the schematic diagram in the present embodiment in binary group TIR prism opticpath.As shown in figure 4, light is by rectangle rib
The face AB of mirror is incident, is totally reflected in the face AC, and then light is incident on DMD by the face AC.Wherein, the face AC is rectangular prism
With the coincidence face of right-angled trapezium prism.When DMD is in ON state, reflection light is after the face AC transmits by the AE of right-angled trapezium prism
Face outgoing, is partially emitted through the face DE, and enters in the follow up device of imaging system.When DMD is in OFF state, through DMD reflection
Light is emitted after the face AC transmits by the face AB of right-angled trapezium prism, is partially emitted through the face DE.
Optionally, in the present embodiment, the first TIR prism device 8 and the second TIR prism device 9 are triple TIR rib
Mirror respectively includes three prisms at any angle.
Fig. 5 its for DMD combined with triple TIR prism after light path schematic diagram.As shown in figure 5, triple TIR rib
Mirror structure includes: prism I, prism II and prism III.Light is incident from the face BC of prism I, when DMD ON state, by prism III
The outgoing of the face ML is emitted when the flat state of DMD and OFF state by the face FG of prism II.The flat state of the DMD or not working condition of,
System has the process of a reset when DMD is switched to OFF state by ON state, this process is very short.Three constituent element TIR prisms are compared to two
Constituent element TIR prism has certain advantage, and the light of flat state can be reflected imaging system by three constituent element TIR prisms, but three
The structure of constituent element TIR prism is more complicated, and whole system can be than cumbersome and huge.
In the present embodiment, the size of the first TIR prism is big compared with reflecting mirror, and the light that target imaging device 1 issues exists
Inner total reflection is carried out in first TIR prism device 8, to improve the light reached on the first DMD 2, the 2nd DMD 4 is anti-
After the light of injection passes through the second TIR prism device 9, also all it is reflected on imaging sensor 6.By in the present embodiment
First TIR prism device 8 and the second TIR prism device 9 are set, more incident rays can be made to enter imaging system, it can
To improve the light acquisition capacity of the imaging system.In the present embodiment, recycle what aperture was reflected to improve micro mirror by increasing
The incident angle of light reaches critical angle, and then reduces effective F number, and in the present embodiment, effective F number can be reached
1.97。
In practical application, when light is stronger, imaging sensor 6, which is formed by image, will appear zone of saturation, can not
Show the details of actual scene.Micro-reflector on first DMD 2 and the 2nd DMD 4 includes open state and light state, is
Realize the adjustment to image, to obtain high-dynamics image, in the present embodiment, to scene carry out Image Acquisition it is initial when
It carves, all micro-reflectors on the first DMD 2 and the 2nd DMD 4 is arranged to open state, so that whole light can be into
Enter into imaging system.
After the imaging of imaging sensor 6, microprocessor 7 can be sent an image to, microprocessor 7 can be to receiving
Present image is analyzed, and is judged in present image with the presence or absence of zone of saturation.Microprocessor 7 judges judging to receive
There are when zone of saturation in present image, time-domain light modulation is carried out to the first DMD 2.
Fig. 6 is the flow diagram that microprocessor dims a kind of time-domain of the first DMD in the embodiment of the present invention two.
The microprocessor 7 to the first DMD 2 carry out time-domain light modulation detailed process include:
S101, microprocessor are believed according to the first modulation that present image is generated for carrying out time-domain light modulation to the first DMD
Breath.
Wherein, the first modulation intelligence includes at least one first pattern and each first pattern pair for being used for gray modulation
The modulation duration answered.
Microprocessor 7 analyzes present image, and there are zones of saturation, and in order to can show that image, the vision of scene is thin
Section, needs the state of corresponding micro-reflector on the first DMD 2 corresponding to pixel in zone of saturation to could be adjusted to reduction figure
The saturation degree of the image as formed by sensor 6.
Microprocessor 7 can generate the first modulation for carrying out time-domain light modulation to the first DMD 2 according to present image
Information, first modulation intelligence may include that at least one is corresponding for the first pattern of gray modulation and first pattern
Modulation duration.
First modulation intelligence is sent to the first DMD by S102, microprocessor.
Time-domain light modulation is carried out to the first DMD 2 in order to realize, microprocessor 7 can send above-mentioned first modulation intelligence
To the first DMD 2, so that the first DMD 2 can be adjusted according to state of first modulation intelligence to the micro-reflector of itself.
S103, the first DMD adjust itself upper micro-reflector state according to the first pattern, and in tune corresponding with the first pattern
The state of each micro-reflector is maintained in duration processed, with the light modulation of deadline domain.
First DMD 2 is after the first modulation intelligence for receiving the transmission of microprocessor 7, so that it may according to each first pattern tune
The state of itself whole upper micro-reflector.In the present embodiment, all micro-reflectors on the first DMD 2 all have open state and light
State.First DMD 2 can be correspondingly arranged the state of each micro-reflector according to information shown on the first pattern, for example, the
Black picture element indicates that corresponding micro-reflector should be arranged to off status in one pattern, and white pixel expression pair in the first pattern
The micro-reflector answered should be arranged to open state.
Further, after the micro-reflector of itself is respectively provided with into corresponding state according to the first pattern by the first DMD 2,
First DMD 2 maintains to be constantly in the state in each micro-reflector in the corresponding modulation duration of the first pattern.
It is incident when light is irradiated on the first DMD 2 after the completion of being adjusted to the micro-reflector state on the first DMD 2
Light is reflected into different location respectively by two "ON" of micro-reflector, "Off" states with different angle, in the anti-of "On" state
It penetrates light to go out to reach imaging system by projecting lens, forms bright pixel.And the reflected light when micro mirror is in "Off" state
It reaches and is absorbed in the absorption means of imaging system to which image corresponding position forms dark pixel.
In the present embodiment, after the first DMD 2 is successively adjusted according to state of first pattern to the micro-reflector of itself,
Multiple exposure actually is carried out to the first DMD 2, and sets each light exposure, to obtain in different range of light intensity
Information, then by these information composition get up, synthesis one width have high dynamic range image.
In the present embodiment, the first DMD 2 and the 2nd DMD 4 can select the dmd chip of 0.7XGA series.The DMD core
Chip size is 40.6mm × 31.8mm × 6.0mm, and resolution ratio is 1024 × 768, and tilt angle is ± 12 °.
Fig. 7 is the flow diagram that microprocessor dims another time-domain of the first DMD in the embodiment of the present invention two.
The microprocessor 7 to the first DMD 2 carry out time-domain light modulation detailed process include:
S201, microprocessor are believed according to the second modulation that present image is generated for carrying out time-domain light modulation to the first DMD
Breath.
Wherein, the second modulation intelligence includes the corresponding pulse signal of each pixel.
In order to make image can show that the visual details of scene, first DMD corresponding to pixel in zone of saturation is needed
The state of corresponding micro-reflector could be adjusted to reduce the saturation degree of image formed by imaging sensor 6 on 2.
Specifically, microprocessor 7 can generate the corresponding pulse signal of each pixel according to present image, in pulse signal
High level can be used for controlling micro-reflector on the first DMD 2 and be in open state, and low level can control it is micro- on the first DMD 2
Reflecting mirror is in off status.
Second modulation intelligence is sent to the first DMD by S202, microprocessor.
S203, the first DMD adjust itself upper micro-reflector state according to the corresponding pulse signal of each pixel, with the deadline
Domain light modulation.
After first DMD 2 receives the pulse signal of each pixel, itself upper micro- reflection can be adjusted according to the pulse signal
The state of mirror, when pulse signal switches between low and high level, the state that the first DMD then controls micro-reflector can be ensued
Variation, and when pulse signal is in high level or low level, the corresponding state of micro-reflector can remain unchanged always.This implementation
In example, time-domain light modulation is carried out to the first DMD 2, is substantially exactly to take multiple exposure, exposure selects different exposures every time
Amount, obtains the information in different range of light intensity, then these information combines, and one width of synthesis has the figure of high dynamic range
Picture.
After the completion of being modulated to the first DMD 2, it can be imaged in imaging sensor 6, imaging sensor 6 can will scheme
As continuing to be sent to microprocessor 7,7 pairs of present images received after time-domain dims of microprocessor are analyzed, are sentenced
Whether disconnected present image still has zone of saturation, if continuing to adjust the first DMD 2 with prolonging exposure time, will lead to figure
As there is Caton phenomenon in user's vision.
In the present embodiment, in order to avoid there is the phenomenon that image Caton, microprocessor 7 is being judged after time-domain dims
When still having zone of saturation in received present image, so that it may by reducing the spatial resolution of image, to the 2nd DMD
4 carry out spatial domain light modulation.
Fig. 8 is the flow diagram that microprocessor dims the spatial domain of the 2nd DMD in the embodiment of the present invention two.
The microprocessor 7 to the 2nd DMD 4 carry out spatial domain light modulation detailed process include:
S301, microprocessor are generated according to the present image after time-domain dims for carrying out gray scale tune to the 2nd DMD
Second pattern of system.
Wherein, in the second pattern include several pixel units, each pixel unit by adjacent predetermined number pixel structure
At, and each pixel corresponds to preset gray value.
The setting figure of pixel unit when Fig. 9 is spatial domain light modulation in the embodiment of the present invention two.As shown in fig. 7, the present embodiment
In, with adjacent 4 pixels of field word row for one group of pixel unit, i.e., one " big " pixel is formed using adjacent four 4 pixels,
And different gray values is assigned respectively for each pixel in the pixel unit.As shown in fig. 7, in order to reduce spatial resolution,
The gray value of four adjacent pixels is configured in advance, the gray value of first pixel is arranged to the corresponding number of black
The corresponding numerical value of white, remaining two pictures can be set into value, the gray value of the pixel on first pixel diagonal line
The corresponding numerical value of gray value setting grey of element.
In the present embodiment, in order to avoid there is the phenomenon that image Caton, microprocessor 7 is being judged after time-domain dims
When still having zone of saturation in received present image, so that it may by reducing the spatial resolution of image, to the 2nd DMD
4 carry out spatial domain light modulation.
Specifically, 7 pairs of microprocessor after time-domain dims received present image analyze, according to present image
Corresponding second pattern of middle saturation Area generation.During generating the second pattern, by image in zone of saturation pixel into
Row grouping, generates multiple pixel units.
It is herein it is to be appreciated that each in the corresponding pixel unit in unsaturation region in present image in the second pattern of generation
The gray value of pixel remains unchanged.That is, due in unsaturation region pixel meet high quality imaging demand, can continue
Current gray value is maintained, and pixel is not able to satisfy imaging demand in zone of saturation, needs to reset the gray value of pixel, with
Reduce the saturation degree of zone of saturation.
Second pattern is sent to the 2nd DMD by S302, microprocessor.
S303, the 2nd DMD are grouped all micro-reflectors according to each pixel unit in the second pattern, and according to pixel unit
The state of micro-reflector corresponding with each pixel in the gray value adjustment group of middle pixel, to complete spatial domain light modulation.
After 2nd DMD 4 receives the second pattern, micro-reflector can be adjusted according to the second pattern, specifically,
All micro-reflectors are grouped first, in accordance with pixel unit, according to each pixel in the corresponding pixel unit of each group after grouping
Gray value is adjusted the state of micro-reflector.
Spatial domain light modulation is carried out to the 2nd DMD 4, is exactly by reducing in image on the corresponding unit area in zone of saturation
Spatial resolution, information content after spatial resolution reduces, in image on the corresponding unit area in zone of saturation
It reduces, so as to reduce the saturation degree in the region, to obtain clearly image.
Imaging system provided in this embodiment based on double DMD carries out the present image received by microprocessor
Analysis judges that with the presence or absence of zone of saturation in present image, microprocessor exists full in the present image for judging to receive
When with region, time-domain light modulation is carried out to the first DMD, microprocessor carries out the present image obtained after time-domain dims
Analysis judges whether present image still has zone of saturation, and microprocessor is being judged to receive after time-domain dims
When still having zone of saturation in present image, spatial domain light modulation is carried out to the 2nd DMD.It, will using two DMD in the present embodiment
Time-domain light modulation and spatial domain light modulation are combined, and are not only guaranteed picture quality, are expanded dynamic range of images, and can be most
Bigization ground guarantees the resolution ratio of imaging, realizes the purpose that the modulation time is improved under the premise of guaranteeing resolution ratio.
Further, two prism apparatus are increased in the imaging system based on double DMD, can make more incident lights
Line enters imaging system, and the light acquisition capacity of the imaging system can be improved, and reduces F number, increases imaging system
The numerical aperture of system.
Embodiment three
As shown in Figure 10, the structural schematic diagram of the imaging system based on double DMD provided for the embodiment of the present invention three.It should
Imaging system based on double DMD include target imaging device 1 in above-described embodiment one, the first DMD 2, first off axis relaying at
As device 3, the 2nd DMD 4, the second off-axis relay imaging device 5, imaging sensor 6 and microprocessor 7, further includes: first is anti-
Penetrate mirror light-dividing device 10 and the second reflection lens one-shot device 11.
The light that scene is issued enters target imaging device 1, and it is anti-to enter first by light after target imaging device 1
It penetrates in mirror light-dividing device 10.In the present embodiment, the first reflection lens one-shot device 10 is arranged in target imaging device 1 and first
Between DMD 2.From the light that target imaging device 1 issues to when 10 incidence of the first reflection lens one-shot device, the first reflecting mirror divides
Light can be reflected away and is incident in the first DMD 2 by electro-optical device 10.The light reflected through the first DMD 2 enters first
In off-axis relay imaging device 3.
Specifically, the first reflection lens one-shot device 10 includes: the first reflecting mirror 101 and the first field lens 102.Target imaging dress
Light that 1 is issued is set by the first reflecting mirror 101, light is turned back into the first DMD 2, is in the first DMD 2 and open state
Micro-reflector, light is directly incident in the first off-axis relay imaging device 3.In the present embodiment, the first reflecting mirror is utilized
101 light splitting, need to be added the first field lens 102 before the first DMD 2, on the one hand can guarantee that incident light can be all incident
Onto the working surface of the first DMD 2, on the other hand changes the angle of 2 reflection light of the first DMD, guarantee that it will not be incident on
Secondary reflection occurs on first reflecting mirror 101,2 reflection light of the first DMD is made to be directly incident on the first off-axis relay imaging device
In 3.
Further, the light transmitted through the first off-axis relay imaging device 3 enters the second reflection lens one-shot device 11
In, light is incident on the 2nd DMD 4 by the second reflection lens one-shot device 11, light is in open state through the 2nd DMD 4
After micro-reflector reflection, the second off-axis relay imaging device 5 is entered, the light then through the second off-axis relay imaging device 5
Line is finally imaged on imaging sensor 6.
Wherein, the second reflection lens one-shot device 11 includes: the second reflecting mirror 111 and the second field lens 112.
The light that first off-axis relay imaging device 3 is issued is turned back light into the 2nd DMD by the second reflecting mirror 111
In the micro-reflector with open state in 4, the 2nd DMD 4, light is directly incident in the second off-axis relay imaging device 5.
In the present embodiment, the light engine being divided using the second reflecting mirror 111 needs to be added the second field lens 112 before the 2nd DMD 4.
By the way that the first reflection lens one-shot device 10 and the second reflection lens one-shot device 11 are arranged in the present embodiment, can make
It obtains input path and transmitted light path relatively far apart, interferes and limit in design and is also few.
In practical application, when light is stronger, imaging sensor 6, which is formed by image, will appear zone of saturation, can not
Show the details of actual scene.In order to realize the adjustment to image, in the present embodiment, to obtain high-dynamics image, this implementation
In example, after the imaging of imaging sensor 6, microprocessor 7 can be sent an image to, microprocessor 7 can work as to what is received
Preceding image is analyzed, and is judged in present image with the presence or absence of zone of saturation.Microprocessor 7 judges to work as judge to receive
There are when zone of saturation in preceding image, time-domain light modulation is carried out to the first DMD 2.
Microprocessor 7 is when judging to still have zone of saturation in received present image after time-domain dims, just
Spatial domain light modulation can be carried out to the 2nd DMD 4 by the spatial resolution of reduction image.
Light in time-domain light modulation and spatial domain light modulation process, reference can be made in above-described embodiment related content record, this
Place repeats no more.
Imaging system provided in this embodiment based on double DMD passes through micro process by the imaging system based on double DMD
Device analyzes the present image received, judges that, with the presence or absence of zone of saturation in present image, microprocessor is being judged
There are when zone of saturation in the present image received, time-domain light modulation is carried out to the first DMD, microprocessor is to by time-domain
The present image obtained after light modulation is analyzed, and judges whether present image still has zone of saturation, and microprocessor is judging
When still having zone of saturation in the present image received after time-domain dims out, spatial domain light modulation is carried out to the 2nd DMD.
In the present embodiment, time-domain light modulation and spatial domain light modulation are combined using two DMD, not only guarantees picture quality, expands
Dynamic range of images, and can maximumlly guarantee the resolution ratio of imaging, it realizes and is mentioned under the premise of guaranteeing resolution ratio
The purpose of high modulation time.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above-mentioned each method embodiment can lead to
The relevant hardware of program instruction is crossed to complete.Program above-mentioned can be stored in a computer readable storage medium.The journey
When being executed, execution includes the steps that above-mentioned each method embodiment to sequence；And storage medium above-mentioned include: ROM, RAM, magnetic disk or
The various media that can store program code such as person's CD.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement；And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution
The range of scheme.
Claims (10)
1. a kind of imaging system based on double DMD characterized by comprising
Target imaging device, the first DMD and the 2nd DMD, the first off-axis relay imaging device and the second off-axis relay imaging device,
Imaging sensor and microprocessor；
Wherein, the light that scene is issued is incident on the first DMD by target imaging device, what the first DMD was issued
Reflected light is incident on the 2nd DMD by the described first off-axis relay imaging device, the reflected light that the 2nd DMD is issued
It by the described second off-axis relay imaging device, is imaged in described image sensor, described image sensor is by described image
It is sent to the microprocessor；
The microprocessor analyzes the present image received, judges in present image with the presence or absence of zone of saturation；
The microprocessor in the present image for judging to receive there are when zone of saturation, when being carried out to the first DMD
Between domain dim；
The microprocessor analyzes the present image obtained after time-domain light modulation, whether judges present image
There are still zones of saturation；
There are still zones of saturation in the present image for judging to receive after the time-domain dims for the microprocessor
When, spatial domain light modulation is carried out to the 2nd DMD.
2. the imaging system according to claim 1 based on double DMD, which is characterized in that the microprocessor is being judged
There are when zone of saturation in the present image received, time-domain light modulation is carried out to the first DMD, comprising:
The microprocessor is believed according to the first modulation that present image is generated for carrying out time-domain light modulation to the first DMD
Breath, wherein first modulation intelligence includes the first pattern and first pattern pair that at least one is used for gray modulation
The modulation duration answered；
First modulation intelligence is sent to the first DMD by the microprocessor；
First DMD adjusts itself micro-reflector state according to first pattern, and corresponding with the pattern described
The state that each micro-reflector is maintained in duration is modulated, to complete the time-domain light modulation.
3. the imaging system according to claim 1 based on double DMD, which is characterized in that the microprocessor is being judged
There are when zone of saturation in the present image received, time-domain light modulation is carried out to the first DMD, comprising:
The microprocessor is believed according to the second modulation that present image is generated for carrying out time-domain light modulation to the first DMD
Breath, second modulation intelligence includes the corresponding pulse signal of each pixel；
Second modulation intelligence is sent to the first DMD by the microprocessor；
First DMD adjusts itself micro-reflector state according to the corresponding pulse signal of each pixel, to complete the time-domain
Light modulation.
4. the imaging system according to claim 2 or 3 based on double DMD, which is characterized in that the microprocessor is judging
There are still when zone of saturation in the present image received after time-domain light modulation out, the 2nd DMD is carried out empty
Between domain dim, comprising:
The microprocessor is generated according to the present image after time-domain light modulation for carrying out gray modulation to the 2nd DMD
The second pattern；It wherein, include several pixel units in second pattern, each pixel unit is by adjacent predetermined number
Pixel is constituted, and each pixel corresponds to preset gray value；
Second pattern is sent to the 2nd DMD by the microprocessor；
2nd DMD is grouped all micro-reflectors according to each pixel unit in second pattern, and according to the pixel
The state of the interior micro-reflector corresponding with each pixel of the gray value adjustment group of pixel in unit, to complete the spatial domain light modulation.
5. the imaging system according to claim 4 based on double DMD, which is characterized in that further include: the first TIR prism dress
It sets and the second TIR prism device；
Wherein, the first TIR prism device is arranged between the target imaging device and the first DMD, and described second
TIR prism device is arranged between the described first off-axis relay imaging device and the 2nd DMD；
The light of the target imaging device projection is incident on the first DMD by the first TIR prism device；
The first off-axis relay imaging device fills the reflection light from the first DMD by second TIR prism
Merging is mapped on the 2nd DMD.
6. the imaging system according to claim 5 based on double DMD, which is characterized in that the first TIR prism device and
Second TIR prism is two tuple TIR prisms, respectively includes a rectangular prism and a right-angled trapezium prism.
7. the imaging system according to claim 5 based on double DMD, which is characterized in that the first TIR prism device and
Second TIR prism is triple TIR prism, respectively includes three prisms at any angle.
8. the imaging system according to claim 4 based on double DMD, which is characterized in that further include: the first reflection lens one-shot
Device and the second reflection lens one-shot device；
The first reflection lens one-shot device is arranged between the target imaging device and the first DMD, and described second is anti-
Mirror light-dividing device is penetrated to be arranged between the described first off-axis relay imaging device and the 2nd DMD；
The light of the target imaging device projection is incident on the first DMD by the first reflection lens one-shot device；
The first off-axis relay imaging device is by the reflection light from the first DMD, by second reflecting mirror point
Electro-optical device is incident on the 2nd DMD.
9. the imaging system according to claim 8 based on double DMD, which is characterized in that the first reflection lens one-shot dress
It sets and respectively includes a reflecting mirror and a field lens with the second reflection lens one-shot device.
10. the imaging system according to claim 5 based on double DMD, which is characterized in that the imaging based on double DMD
The effective F number of system is 1.97.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611055977.9A CN106680992B (en) | 2016-11-22 | 2016-11-22 | Imaging system based on double DMD |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611055977.9A CN106680992B (en) | 2016-11-22 | 2016-11-22 | Imaging system based on double DMD |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106680992A CN106680992A (en) | 2017-05-17 |
| CN106680992B true CN106680992B (en) | 2019-03-26 |
Family
ID=58865894
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611055977.9A Expired - Fee Related CN106680992B (en) | 2016-11-22 | 2016-11-22 | Imaging system based on double DMD |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106680992B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107302667B (en) * | 2017-08-17 | 2019-05-07 | 中国人民解放军国防科技大学 | Camera-interchangeable dynamic spectral imaging system and method for applying same to high dynamic imaging |
| CN108322667B (en) * | 2018-02-22 | 2020-12-29 | 长春车格斯科技有限公司 | An imaging system and imaging method thereof |
| CN110874006B (en) | 2018-09-03 | 2021-12-21 | 深圳光峰科技股份有限公司 | Light source system and control method thereof, and display device and control method thereof |
| CN109903370A (en) * | 2019-01-17 | 2019-06-18 | 哈尔滨工业大学 | Single-shot stacked phase recovery technology based on dual DMD |
| CN110022468B (en) * | 2019-04-19 | 2021-10-22 | 西安应用光学研究所 | Infrared projector optical system based on double DMDs |
| CN110375651A (en) * | 2019-08-21 | 2019-10-25 | 湖北工业大学 | High reflecting surface dynamic 3 D surface shape measurement system and method based on double DMD |
| CN113063503B (en) * | 2021-03-17 | 2022-11-22 | 北京安酷智芯科技有限公司 | High-temperature target detection method and device based on detector |
| CN115633264B (en) * | 2022-09-30 | 2024-07-30 | 苏州大学 | A high dynamic range imaging method based on spectral modulation |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103559865A (en) * | 2008-01-28 | 2014-02-05 | 杜比实验室特许公司 | Serial modulation display having binary light modulation stage |
| CN103716538A (en) * | 2013-12-16 | 2014-04-09 | 天津大学 | DMD-based imaging pre-processing device and method |
| CN104054266A (en) * | 2011-10-25 | 2014-09-17 | 中国科学院空间科学与应用研究中心 | Time-resolved single-photon or ultra-weak light multi-dimensional imaging spectrum system and method |
| CN104618699A (en) * | 2013-11-04 | 2015-05-13 | 加拿大科视数字系统公司 | Two-stage light modulation for high dynamic range |
| CN104950436A (en) * | 2014-03-24 | 2015-09-30 | 徐熙平 | DMD modulation imaging system |
| CN105588645A (en) * | 2014-10-20 | 2016-05-18 | 哈尔滨新光光电科技有限公司 | Method and system for producing high-contrast infrared scene based on stack imaging of four sets of DMDs (Digital Micromirror Device) |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070229993A1 (en) * | 2006-03-30 | 2007-10-04 | Hamid Hemmati | Compensating for a telescope's optical aberrations using a deformable mirror |
-
2016
- 2016-11-22 CN CN201611055977.9A patent/CN106680992B/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103559865A (en) * | 2008-01-28 | 2014-02-05 | 杜比实验室特许公司 | Serial modulation display having binary light modulation stage |
| CN104054266A (en) * | 2011-10-25 | 2014-09-17 | 中国科学院空间科学与应用研究中心 | Time-resolved single-photon or ultra-weak light multi-dimensional imaging spectrum system and method |
| CN104618699A (en) * | 2013-11-04 | 2015-05-13 | 加拿大科视数字系统公司 | Two-stage light modulation for high dynamic range |
| CN103716538A (en) * | 2013-12-16 | 2014-04-09 | 天津大学 | DMD-based imaging pre-processing device and method |
| CN104950436A (en) * | 2014-03-24 | 2015-09-30 | 徐熙平 | DMD modulation imaging system |
| CN105588645A (en) * | 2014-10-20 | 2016-05-18 | 哈尔滨新光光电科技有限公司 | Method and system for producing high-contrast infrared scene based on stack imaging of four sets of DMDs (Digital Micromirror Device) |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106680992A (en) | 2017-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106680992B (en) | Imaging system based on double DMD | |
| CN104954777B (en) | Method and device for displaying video data | |
| US7428997B2 (en) | Method and apparatus for illuminating a field-of-view and capturing an image | |
| US7355648B1 (en) | Camera having a through the lens pixel illuminator | |
| CN108965841B (en) | Projection optical system and projection display method | |
| US10359277B2 (en) | Imaging system with synchronized dynamic control of directable beam light source and reconfigurably masked photo-sensor | |
| JP2004503188A (en) | Camera with through-the-lens illuminator | |
| KR100958478B1 (en) | Projection display | |
| CN105589288B (en) | laser projection light source control method and device | |
| US11228742B2 (en) | Projection system and projection method | |
| US10880490B2 (en) | Imaging method, imaging device, rearview mirror and storage medium | |
| CN110830785B (en) | Beam combining for highlight projection | |
| Mannami et al. | High dynamic range camera using reflective liquid crystal | |
| CN106773490A (en) | Optical texture, optical system and optical means for eliminating laser projection speckle | |
| US9069241B2 (en) | Method and device for optical focusing | |
| CN209488691U (en) | A kind of local auto-adaptive imaging system | |
| CN108322667B (en) | An imaging system and imaging method thereof | |
| Zhou et al. | Design of a dual DMDs camera for high dynamic range imaging | |
| CN113900328A (en) | Device and method for long-distance projection through scattering medium based on spatial light modulation device | |
| CN113364982A (en) | Image generation method, device, equipment and storage medium based on LCD liquid crystal device | |
| CN111965664A (en) | Light emitting device, imaging system, and emission light modulation method | |
| US20170180717A1 (en) | Bilateral distance automatic control display apparatus providing a multi-focus video and method therefor | |
| CN109951649A (en) | A kind of local auto-adaptive imaging system and local auto-adaptive image formation control method | |
| US12368827B2 (en) | Method for actuating an actuable deflection device of an optical system for a virtual retinal display | |
| US7360902B2 (en) | System and method for light source modulation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190326 Termination date: 20191122 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |