[go: up one dir, main page]

WO2018160765A1 - Systèmes et procédés de visualisation tête haute à pupille de sortie fendue - Google Patents

Systèmes et procédés de visualisation tête haute à pupille de sortie fendue Download PDF

Info

Publication number
WO2018160765A1
WO2018160765A1 PCT/US2018/020324 US2018020324W WO2018160765A1 WO 2018160765 A1 WO2018160765 A1 WO 2018160765A1 US 2018020324 W US2018020324 W US 2018020324W WO 2018160765 A1 WO2018160765 A1 WO 2018160765A1
Authority
WO
WIPO (PCT)
Prior art keywords
eye
pixels
hud
box
image
Prior art date
Application number
PCT/US2018/020324
Other languages
English (en)
Inventor
Hussein S. El-Ghoroury
Jingbo Cai
Chih-Li Chuang
Marty MAIERS
Original Assignee
Ostendo Technologies, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/449,679 external-priority patent/US10539791B2/en
Application filed by Ostendo Technologies, Inc. filed Critical Ostendo Technologies, Inc.
Priority to EP18710721.4A priority Critical patent/EP3615981A1/fr
Priority to KR1020197026913A priority patent/KR20190119093A/ko
Priority to JP2019547678A priority patent/JP7025439B2/ja
Priority to CN201880029162.4A priority patent/CN110573930B/zh
Publication of WO2018160765A1 publication Critical patent/WO2018160765A1/fr

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0081—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. enlarging, the entrance or exit pupil
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10—Beam splitting or combining systems
    • G02B27/1066—Beam splitting or combining systems for enhancing image performance, like resolution, pixel numbers, dual magnifications or dynamic range, by tiling, slicing or overlapping fields of view
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/08—Mirrors
    • G02B5/10—Mirrors with curved faces
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/011—Head-up displays characterised by optical features comprising device for correcting geometrical aberrations, distortion
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0112—Head-up displays characterised by optical features comprising device for genereting colour display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
    • G02B2027/0125—Field-of-view increase by wavefront division
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0127—Head-up displays characterised by optical features comprising devices increasing the depth of field
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0136—Head-up displays characterised by optical features comprising binocular systems with a single image source for both eyes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0185—Displaying image at variable distance

Definitions

  • This invention relates generally to heads-up displays (HUD) and, more particularly to HUD systems that generates one or more virtual images.
  • Heads-up displays are being sought after as a visual aide technology that contributes to automotive safety by making automobile drivers more visually aware and informed of automobile dashboard information without taking a driver's sight and attention off the road.
  • currently available heads-up displays are volumetrically large and too expensive to be a viable option for use in most automobiles.
  • These same obstacle, though to a lesser extent the cost factor, are encountered in applications for heads-up displays in aircraft and helicopters.
  • the volumetric and cost constraints are further exacerbated by the wide range of vehicle sizes, types and cost requirements. Therefore, there is a need for low-cost and non-bulky heads-up displays that are suitable for use in small vehicles such as automobiles, small aircraft and helicopters.
  • Pupil imaging HUD are typically comprised of a relay module, which is responsible for intermediate image delivery and pupil formation, and a collimation module, which is responsible for image collimation and pupil imaging at the viewer's eye location (herein referred to as the eye-box).
  • the collimation module of a pupil imaging HUD is typically realized as a tilted curved or planar reflector or a holographic optical element (HOE) and the relay module is typically tilted for bending the light path and to compensate for optical aberrations.
  • Non-pupil imaging HUD defines the system aperture by the light cone angle at the display or at the intermediate image location by diffusion.
  • a relay module is also needed, but the HUD aperture is decided by collimation optics alone.
  • the collimation optics usually have axial symmetry but with folding mirrors to meet required volumetric constraints. This is decided by aberration correction needs and system volumetric aspects.
  • the prior art described in Ref [8], shown in FIG. 1 -1 uses a concave HOE reflector (1 1 in FIG 1 -1 ) as a combiner and collimator to minimize collimation optics and reduce the HUD system volumetric aspect.
  • the resultant HUD system needs complicated tilted relay optics (10 in FIG. 1 -1 ) to compensate aberration and deliver an intermediate image.
  • this HUD system works only for a narrow spectrum.
  • Ref [9] shown in FIG. 1 -2, uses a relay optics (REL) module to deliver an intermediate image at the focal plane of convergent combiner (CMB) mirror (CMB in FIG. 1 -2) and defines the system pupil.
  • the CMB mirror collimates the intermediate image and images the system pupil onto the viewer's eye to facilitate viewing.
  • This pupil imaging HUD approach necessarily involves a complicated REL module for packaging and aberration compensation.
  • the prior art described in Ref [10], shown in FIG. 1 -3, uses a projection lens (3) to project an intermediate image on a diffusive surface (51 in FIG. 1 -3) as an image source and a semi-transparent collimating mirror (7 in FIG. 1 -3).
  • the collimating mirror forms an image at infinity and the aperture of the collimation optics is defined by the angular width of the diffuser.
  • the prior art described in Ref [1 1 ], shown in FIG. 1 -4, uses an image forming source comprised of two liquid crystal display (LCD) panels (23 in FIG. 1 -4) to form an intermediate image on a diffusive screen (5 in FIG. 1 -4) which is placed at the focal plane of the collimation optics module (1 in FIG. 1 -4).
  • LCD liquid crystal display
  • the main purpose of the two LCD panels in the image-forming source is to achieve sufficient brightness for viewablity of the formed image.
  • the two LCD panels in the image-forming source are configured to either form two contiguous side-by-side images at the diffusive screen or two images are overlapped and shifted from each other horizontally and vertically by a half pixel at the diffusive screen.
  • the prior art described in Ref [12] uses a pair of reflective holographic optical elements (HOE) to achieve holographic dispersion correction and to project a virtual image of a broadband display source within the observer's field of view.
  • the prior art described in Ref [13] also uses a pair of holographic optical elements (HOE); one transmissive and another that is reflective to project an image onto the vehicle windshield.
  • the prior art described in Ref [14], shown in FIG. 1 -5, uses an image projector (14 in FIG. 1 -5) mounted on the topside of the vehicle windshield configured to project an image onto the vehicle dashboard equipped with a faceted reflective surface (18 in FIG. 1 -5) with the latter being configured to reflect the image from the image projector onto the windshield of the vehicle.
  • the vehicle windshield surface is oriented to reflect the image from the dashboard faceted reflective surface toward the viewer.
  • FIG. 1 -1 Illustrates a prior art Heads-up Display (HUD) system that uses a concave HOE reflector as a combiner and collimator to minimize collimation optics and reduce the HUD system volumetric aspect.
  • HUD Heads-up Display
  • FIG. 1 -2 illustrates a prior art Heads-up Display (HUD) system that uses a relay optics (REL) module to deliver an intermediate image at the focal plane of convergent combiner (CMB) mirror and defines the system pupil.
  • FIG. 1 -3 illustrates a prior art Heads-up Display (HUD) system that uses a projection lens (3) to project an intermediate image on a diffusive surface as an image source and a semi-transparent collimating mirror.
  • REL relay optics
  • CMB convergent combiner
  • FIG. 1 -4 illustrates a prior art Heads-up Display (HUD) system that uses an image-forming source comprised of two liquid crystal display (LCD) panels to form an intermediate image on a diffusive screen which is placed at the focal plane of the collimation optics module.
  • HUD Heads-up Display
  • FIG. 1 -5 illustrates a prior art Heads-up Display (HUD) system that uses an image projector mounted on the topside of the vehicle windshield configured to project an image onto the vehicle dashboard equipped with a faceted reflective surface with the latter being configured to reflect the image from the image projector onto the windshield of the vehicle.
  • HUD Heads-up Display
  • FIG. 2 illustrates an exemplary modular HUD (MHUD) system of this invention.
  • FIG. 3 illustrates the relationships among design parameters and constraints of the MHUD system of FIG. 2.
  • FIG. 4 illustrates the optical design aspects and ray trace diagram of the HUD module comprising the MHUD assembly of the embodiment of FIG. 2.
  • FIG. 5 illustrates the optical performance of the HUD module comprising the MHUD assembly of the embodiment of FIG. 2.
  • FIG. 6 illustrates a multi-view perspective of the MHUD assembly design example of the MHUD system of the embodiment of FIG. 2.
  • FIG. 7 illustrates a functional block diagram of the interface and control electronics design element (board) of the MHUD system of the embodiment of FIG. 2.
  • FIG. 8 illustrates the novel split eye-box design method of the MHUD system 200 of the embodiment of FIG. 2.
  • FIG. 9 illustrates the actual volume of the MHUD assembly design example illustrated in FIG. 6 installed in the dashboard of a sub-compact automobile.
  • FIG. 10 illustrates the ray path of the MHUD system 200 of this invention including the sunlight loading.
  • FIGS. 1 1 A and 1 1 B illustrate a front and side view respectively of a solid state emissive pixel array imager (i.e., display element) in a multi-image HUD system embodiment of this invention, depicting the odd rows of pixels having an output that will create a first image that is generally projected outward from the surface of the imager and depicting the even rows of pixels having an output that will create a second image that is generally projected somewhat downward relative to the first image.
  • a solid state emissive pixel array imager i.e., display element
  • FIGS. 1 1 C and 1 1 D illustrate a front and side view respectively of a solid state emissive pixel array imager in a multi-image HUD system embodiment of this invention, depicting the pixels in the upper region of the solid state emissive pixel array imager (i.e., display element) having an output that will create the second image as described above and the pixels in the lower region of the solid state emissive pixel array imager having an output that will create the first image as described above.
  • FIG. 12 illustrates the multiple ray paths of the multi-image HUD system embodiment of this invention.
  • FIG. 13 illustrates the nominal positions of a near field virtual image and far field virtual image in a low-volumetric package design in the multi-image HUD system embodiment of this invention installed in the dashboard of a sub-compact automobile.
  • FIG. 14 is a side view of a display element of the invention comprising a plurality of non-telecentric refractive micro optical elements.
  • FIG. 15 is a side view of a display element of the invention comprising a plurality of tilted refractive micro optical elements.
  • SSL solid state light
  • LED light emitting diode
  • LD laser diode
  • the size of the pixels comprising the emissive array of such imager devices would typically be in the range of approximately 5-20 microns with the typical emissive surface area of the device being in the range of approximately 15-150 square millimeters.
  • the pixels within the emissive micro-scale pixel array device are individually addressable spatially, chromatically and temporally, typically through the drive circuitry of its CMOS chip.
  • the brightness of the light generate by such imager devices can reach multiple 100,000 cd/m2 at reasonably low power consumption.
  • QPI® imagers see Ref. [1 -7]
  • QPI® imagers are merely an example of the types of devices that may be used in the present invention.
  • QPI is a registered trademark of Ostendo Technologies, Inc.
  • any references to a QPI® imager is to be understood to be for purposes of specificity in the
  • imager solid state emissive pixel array imager
  • the present invention combines the emissive micro pixel array device unique capabilities of such imagers with a novel split exit pupil HUD system architecture in order to realize a low-cost and small volume modular HUD (MHUD) system that can be readily used in applications where the cost and volumetric constraints are paramount, such as for example an automotive HUD.
  • MHUD low-cost and small volume modular HUD
  • the combination of the emissive high brightness micro emitter pixel array of imagers such as the QPI® imagers and the split exit pupil HUD architecture of this invention enables HUD systems that operate effectively in high brightness ambient sunlight yet are volumetrically small enough to fit behind the dashboard or instrument panel of a wide range of vehicle sizes and types.
  • the word "vehicle” as used herein is used in the most general sense, and includes any means in or by which someone travels, including but not limited to travel on land, water, underwater and through the air.
  • vehicle includes any means in or by which someone travels, including but not limited to travel on land, water, underwater and through the air.
  • the low cost and modularity of the split exit pupil HUD architecture enabled by the such imagers enables a modular HUD system that can be tailored to fit the volumetric constraints of a wide range of vehicles.
  • the virtues of the split exit pupil HUD system will become more apparent from the detailed description provided herein within the context of the embodiments described in the following paragraphs.
  • FIG. 2 illustrates the design concept of the modular HUD (MHUD) system 200 of one embodiment of this invention.
  • the MHUD system 200 of the invention is comprised of the MHUD assembly 210 which in turn is comprised of multiplicity of the modules 215 assembled together to form the MHUD 210 whereby each module 215 is comprised of a single imager with associated optics 220 and a concave mirror 230.
  • each module 215 is comprised of a single imager with associated optics 220 and a concave mirror 230.
  • each single imager with associated optics 220 is collimated, magnified and reflected by its associated concave mirror 230, then partially reflected off the vehicle windshield 240 to form the virtual image 260 which is viewable within the eye-box segment 255 located at the nominal head position of the vehicle's driver (operator).
  • each of the modules 215 of the MHUD assembly 210 are disposed to form the same virtual image 260 at any one time and at the same location from the vehicle windshield 240, but each at its corresponding eye-box segment 255, such that the multiplicity of modules 215 of the MHUD assembly 210 collectively form the collective eye-box 250 of the MHUD system 200.
  • the virtual image 260 is partially viewable from each of the eye-box segments 255 but fully viewable in the collective eye-box 250. Accordingly, the overall size of the MHUD system 200 eye-box segments 255 can be tailored by selecting the appropriate number of the modules 215 comprising the MHUD assembly 210, which number of eye-box segments and modules is user definable.
  • each of the modules 215 of the MHUD assembly 210 is disposed to form the same virtual image 260 at any one time; those images of course will change with time, and may change slowly, as will for example a fuel gauge image, or may change more rapidly, such as in the display of a GPS navigation system display image, though the MHUD system 200 of the present invention may operate at frequencies at least up to a typical video rate if the image data is available at such a rate.
  • the eye-box segments 255 of the modules 215 of the MHUD assembly 210 are each located at the exit pupil of the light ray bundle reflected by their corresponding concave mirror 230.
  • the collective eye-box 250 of the MHUD system 200 is in effect a split exit pupil eye-box that is formed by the overlap of the eye-box segments 255 of the modules 215 of the MHUD assembly 210.
  • This split exit pupil design method of the MHUD system 200 of this invention is further explained in more detail in the following paragraphs.
  • the MHUD system 200 of this invention the
  • MHUD assembly 210 is comprised of a multiplicity of modules 215 assembled together to form the MHUD assembly 210 whereby each module 215 is comprised of an imager such as a QPI® imager or other suitable light emitting structure such as an OLED device with associated optics 220 and a concave mirror 230.
  • imager such as a QPI® imager or other suitable light emitting structure
  • OLED device with associated optics 220 and a concave mirror 230.
  • the design method of the MHUD assembly 210 of the MHUD system 200 of this embodiment of the invention and its respective modules 215 are described in more detail in the following paragraph preceded by an explanation of the pertinent advantages and related design parameters tradeoff of the MHUD system 200 of this invention.
  • MHUD system 200 Optical Design Parameters Tradeoffs
  • the virtual image generated by a HUD system is typically
  • the important parameters to consider in the design of a HUD system include; the target size of the collective eye-box, the desired field of view (FOV), the formed virtual image size, the virtual image resolution and the system volumetric constraints. The relationships among these design parameters and constraints are illustrated in FIG. 3.
  • a reduction of MHUD system 200 imager 220 size leads to a smaller effective focal length (EFL), which is the characteristic optical track length of the system and generally contributes to the reduction of system volume.
  • EDL effective focal length
  • the reduction of imager aperture size leads to a lower system F/# accompanied by an increase of optical complexity. This generally results in larger system volume.
  • the size of the eye-box segment 255 for each module 215 is scaled along with the imager 220 size to avoid the increase of optical complexity. This leads to the scaling of the volume of each of the modules 215 by the imager 220 size ratio.
  • a multiplicity of modules 215 is combined to form a MHUD assembly 210 that can provide an arbitrary sized collective eye-box 250.
  • This novel multi-segmented eye-box design concept of the MHUD system 200 of this invention is realized by splitting the exit pupil of the system formed at the viewer's eye-box into multiple segments, each corresponding with one of the eye- box segments 255 comprising the collective eye-box 250 of the MHUD system 200 of this invention.
  • This split exit pupil design method of the MHUD system 200 of this invention thus achieves smaller overall volumetric aspects than a prior art HUD system providing the same size eye-box. This desirable leads to a reduction in the overall HUD volume, complexity and cost.
  • each module is emitting the same image at any one time, so a vehicle operator will see the same virtual image at the same position, independent of which eye-box segment 255 or eye-box segments 255 the operator views.
  • the primary contributor to the volume of prior art HUD systems that use a mirror reflector Ref [8-10] has been identified as the concave mirror.
  • the size of the image source is also proportionally large, which dictates the use of either a large size imager, such as an LCD panel, or forming a large size intermediate image that is projected on a diffusive screen, which adds even more volume for incorporating the projector imager and its associated projection optics.
  • the MHUD system 200 of this invention achieves substantially smaller volumetric aspects than prior art HUD systems that use a single concave mirror as the main reflector by using the MHUD assembly 210 that is comprised of the multiple modules 215 each using a smaller size concave mirror 230 that are assembled together to form the overall reflector 235 of the MHUD assembly 210, which is much smaller in size and achieves a much smaller optical track length.
  • the MHUD assembly 210 using the smaller aperture size imagers 220 enables the use of smaller aperture size concave mirrors 230 with smaller optical track length which results in the
  • FIG. 4 illustrates the optical design aspects and ray trace diagram of the module 215 comprising the MHUD assembly 210.
  • the module 215 of a preferred embodiment is comprised of one imager together with its associated optics 220 and the concave mirror 230.
  • the optics 420 associated with the imager 410 is shown as a separate lens optical element, in an alternate embodiment of this invention the imager associated optics 420 may be attached directly on top of the emissive surface of the imager 410 to form the integrated imager assembly 220.
  • the reflective concave mirror 230 magnifies and collimates the image generated by its corresponding imager (or other imager) 220 to form one eye-box segment 255 of collective eye-box 250, while the optical element 420 associated with the imager 410 in FIG. 4 balances the off-axis distortion and tilting aberrations arising from the reflective concave mirrors 230.
  • FIG. 4 the optical element 420 associated with the imager 410 in FIG. 4 balances the off-axis distortion and tilting aberrations arising from the reflective concave mirrors 230.
  • the role of the optical element 420 associated with the imager 410 is to balance the off-axis distortion and tilting aberrations arising from the reflective concave mirrors 230 in order to minimize the image swimming effect while maintaining the modulation transfer function (MTF) at a sufficiently high level.
  • the image swimming effect is typically caused by variations in the direction of the light entering the viewer's pupil due to optical distortion caused by the mirror aberrations and result in a perceived false motion of the virtual image (known as "swimming effect") as the viewer's head moves (or gazes) about in the HUD system eye-box [Ref 6].
  • Minimizing the swimming effect in binocular optical systems such as a HUD is very important, as in extreme cases, excessive swimming effect in a virtual image can lead to motion sickness, vertigo or nausea which are caused by a conflict between vestibular and oculo-motor aspects of the human visual and perception systems, Ref [16, 17].
  • Another advantage of the split exit pupil method of the MHUD system 200 of this invention is that it achieves a substantially reduced swimming effect when compared to prior art HUD systems that use a single mirror with a larger optical aperture.
  • the aberrations of the smaller optical aperture of the reflective concave mirrors 230 are much smaller than the aberrations of the relatively larger optical aperture reflective mirrors used in prior art single mirror HUD systems. Since the swimming effect is directly proportional with the magnitude of the optical
  • the multiplicity of smaller optical aperture concave mirrors 230 of the MHUD system 200 of this invention achieve a substantially smaller swimming effect when compared with prior art HUD systems.
  • the angular overlap between the eye-box segments 255 of the MHUD modules 215 cause the perception of any point in the virtual image 260 to incorporate optical contributions from the multiple MHUD modules 215.
  • the optical distortion (or ray direction deviation) caused by the aberrations of the individual concave mirrors 230 of the multiple MHUD modules 215 tend to be averaged at any point in the virtual image 260, consequently causing a reduction in the overall swimming effect perceived by the viewer of the MHUD system 200.
  • the imagers 220 of the MHUD assembly 210 have a resolution that is higher than what the human visual system (HVS) is able to resolve, with the added resolution being dedicated to a digital image warping pre-compensation of the residual optical distortion caused by the aberrations arising from the concave mirrors 230.
  • the virtual image would be formed at a distance of approximately 2.5m.
  • the lateral acuity of the HVS is approximately 200 micro-radians.
  • the imagers 220 used in the exemplar MHUD assembly 210 can provide a much higher resolution than this limit, for example 640x360 resolution or even 1280x720 with the same size optical aperture.
  • the imagers 220 providing a higher resolution with the same size optical aperture enable the use of concave mirrors 230 with the same size optical aperture, thus maintaining the volumetric advantage of the MHUD assembly 200.
  • the added resolution of imagers 220 allows the use of digital image warping pre-compensation that virtually eliminates the optical distortion arising from the concave mirrors 230 aberration and the resultant swimming effect while maintaining the maximum achievable resolution at the virtual image 260 and the same volumetric advantages.
  • Each of the reflective concave mirrors 230 can be either aspheric or free- form whereby the aspherical or free-form factor of the concave mirror 230 is selected to minimize the optical aberrations of the concave mirror 230, and if necessary, the curvature of the windshield. It should be noted that the position of each of the imagers 220 is preferably axially symmetric relative to their associated concave mirror 230 to ensure optimally balanced (somewhat equal) aberration at adjacent edges of any two of the concave mirrors 230. This is an important design aspect of the MHUD system 200 of this invention because it ensures uniform viewing transition of the virtual image 260 between the multiple eye-box segments 255 of the collective eye-box 250 of the MHUD system 200.
  • FIG. 6 illustrates a multi-view perspective of the MHUD assembly 210.
  • the MHUD assembly 210 is comprised of three reflective concave mirrors 230 assembled together within the enclosure 600.
  • the three concave mirrors 230 can be either fabricated separately then fitted together within the enclosure 600 or can be fabricated as a single part then fitted within the enclosure 600.
  • the three concave mirrors 230, whether assembled separately or as a single optical part, may be fabricated using embossed polycarbonate plastic with the optical surface being subsequently coated with a thin layer of reflective metal, such as silver or aluminum, using sputter techniques. As illustrated in FIG.
  • the back sidewall of the enclosure is comprised of three separate sections 610, each incorporating an optical window 615 which, when the back sidewall sections 610 are assembled together each with its respective concave mirror 230, would be aligned with the optical axis of their respective concave mirror 230.
  • the top edge 617 of each of the back sidewall sections 610 is angled toward the concave mirror 230 to allow the imagers 220, which would be mounted on the angled edge surface 617 of the back sidewall sections 610, to be aligned with the optical axis of their respective concave mirror 230.
  • the back sidewall sections 610 would be assembled together on one side of the back plate 630 with the control and interface electronics (printed circuit board) 620 of the MHUD assembly 210 mounted on the opposite side of the back plate 630.
  • the back plate 630 also incorporates thermal cooling fins to dissipate the heat generated by the imagers 220 and the interface electronics element 620 of the MHUD assembly 210.
  • each of the imagers 220 would typically be mounted on a flexible electrical board 618 that connects the imagers 220 to the control and interface electronics 620.
  • the centers of the interface edges of the each pair of the concave mirrors 230 and the back sidewall sections 610 may incorporate the photo detectors (PD) 640, typically photo-diodes, each positioned and oriented to detect the light emitted from the imagers 220 onto their respective concave mirror 230. Typically three photo-diodes would be used in each module, one for each color of light emitted.
  • the output of the photo detectors (PD) 640 is connected to the control and interface electronics 620 of the MHUD assembly 210 and is used as input to the uniformity control loop (described in the discussion below), implemented within the hardware and software design elements of the interface electronics element 620.
  • the uniformity control loop described in the discussion below
  • the output of the ambient light photo detector sensor 660 is typically an integral part of most vehicles' dashboard brightness control.
  • the control and interface electronics 620 of the MHUD assembly 210 incorporates the hardware and software design functional elements illustrated in the block diagram of FIG. 7, which include the MHUD interface function 710, the control function 720 and the uniformity loop function 730.
  • the MHUD interface function 710 of the control and interface electronics 620 of the MHUD assembly 210 which is typically implemented in a combination of hardware and software, receives the image input 715 from the vehicle's Driver Assistance System (DAS) and incorporates into the image the color and brightness corrections 735 provided by the control function 720, then provides image inputs 744, 745 and 746 to the imagers 220 of the MHUD assembly 210.
  • DAS Driver Assistance System
  • the MHUD interface function 710 incorporates each imager 220 specific color and brightness corrections in their respective image inputs 744, 745 and 746 based on the color and brightness corrections 735 received from the control function 720.
  • the uniformity loop function 730 of the control and interface electronics 620 receives the input signals 754, 755 and 756 from the photo detectors (PD) 640 of each of the modules 215 of the MHUD assembly 210, computes the color and brightness associated with each of the modules 215 of the MHUD assembly 210 then calculates the color and brightness corrections required to make the color and brightness become more uniform across the multiple segments 255 of the collective eye-box 250. This would be
  • the color and brightness corrections calculated by the uniformity loop function 730 are then provided to the control function 720 which combines these corrections with input received from the ambient light sensor 650 and the external color and brightness adjustment input command 725 to generate the color and brightness corrections 735 which then are incorporated into the image data by the MHUD interface function 710 before the corrected image data is provided as the image inputs 744, 745 and 746 to the imagers 220.
  • image data as used herein means image information in any form whatsoever, whether as received as an input to the heads-up display, as provided to the imagers or as in any other form.
  • one embodiment of the MHUD system 200 uses imagers 220 with higher resolution than the maximum HVS resolvable resolution at the virtual image 260 and incorporates means to eliminate or substantially reduce optical distortion and the swimming effect it causes by digitally warping the image input to the imagers 220.
  • the MHUD interface function 710 of the MHUD assembly 210 of the MHUD system 200 of that embodiment may also incorporate a
  • These parameters are used by the MHUD interface function 710 to warp the digital image input of each of the imagers 220 in such a way that the image data input to each of the imagers 220 pre-compensates for their corresponding concave mirror 230 residual distortion.
  • the digital image warping parameters incorporated in the look up tables of the MHUD interface function 710 would be preliminarily generated from the optical design simulation of the MHUD assembly 210, then augmented with optical test data that is based on measurements of the residual optical distortion of each module 215 after the digital image warping pre-compensation is applied by the MHUD interface function 710.
  • the resultant digitally warped image data is then combined with the color and brightness corrections 735 provided by the control function 720, then the color and brightness corrected and distortion pre-compensated image data is provided as the image inputs 744, 745 and 746 to the imagers 220 of the MHUD assembly 210.
  • the residual optical distortion caused by the concave mirrors 230 and its resultant swimming effect may be substantially reduced or eliminated altogether, thus enabling a distortion-free MHUD system 200.
  • the top side of the MHUD assembly 210 is a glass cover 430, which functions as the optical interface window of the MHUD assembly 210 at the top surface of the vehicle dashboard and functions as a filter that attenuates the sunlight infrared emission to prevent sunlight thermal loading at the imagers 220.
  • the glass used should be selected to also be substantially transparent to the wavelengths of the light of interest.
  • the design method of the MHUD assembly 210 leverages the characteristics of the human visual system (HVS) to simplify the design implementation and assembly tolerances of the MHUD assembly 210.
  • HVS human visual system
  • the eye pupil being approximately 5mm in diameter(3-5 mm in daytime and 4-9 mm in night time) and resultant lateral acuity in viewing the virtual image 260 would allow an indiscernibly small gap between the MHUD assembly 210 concave mirrors 230 that can reach as much as 1 mm in width.
  • the eye angular difference accommodation limit of approximately 0.5 degree would allow a small angular tilt between the MHUD assembly 210 concave mirrors 230 that can reach approximately 0.15 degree.
  • FIG. 8 illustrates the novel split eye-box design method of the MHUD system 200 of this invention.
  • the illustration of FIG. 8 is meant to show the relationship between collective eye-box 250 and the virtual image 260 of the MHUD system 200.
  • FIG. 8 also illustrates an example object 810, the arrow shown on the virtual image 260, displayed by the MHUD system 200.
  • each of the eye-box segments 255 would typically be positioned at the exit pupil of its respective module 215.
  • the image information presented to the viewer's eyes within each of the eye-box segments 255 would be in the angular space.
  • the virtual image 260 arrow object 810 presented to the viewer within each of the eye-box segments 255 separately would typically be fully visible to the viewer when the viewer's head is positioned within the central region of the respective eye-box segment 255, but the tip or tail ends of the arrow object 810 of the virtual image 260 would gradually vignette (or fade away) when the viewer's head is moved to the right side or left side of the eye-box segment 255,
  • the eye-box segments 255 of the modules 215 would be made to overlap, as illustrated in FIG. 8, to produce the collective eye-box 250 of the MHUD system 200.
  • the collective eye-box 250 of the MHUD system 200 is formed by the overlap of the exit pupil areas forming the eye-box segments 255 of the multiplicity of modules 215, thus making the image information presented to the viewer's eyes within the collective eye-box 250 be an angularly multiplexed view of the virtual image 260 extending over the combined angular field of view of the MHUD modules 215. As illustrated in FIG.
  • the arrow object 810 of the virtual image 260 becomes fully visible (or viewable) within the overlap area of the eye- box segments 255 defining the collective eye-box 250 of the MHUD system 200 with the arrow object 810 of the virtual image 260 gradually vignetting (or fading away) when the viewer's head is moved to the right side or left side of the peripheral regions of the collective eye-box 250, respectively.
  • the size of overlap between the eye-box segments 255 of the modules 215 is dependent upon their angular vignetting profiles, 820 in FIG. 8, and determines the ultimate size of the collective eye-box 250 of the MHUD system 200.
  • FIG. 8 also illustrates the resultant angular vignetting profile shield of the MHUD assembly 210 across the overall area of the overlapping eye-box segments 255 of the modules 215.
  • the brightness of the virtual image 260 that is perceived by the viewer includes brightness contributions of A R , A c , and A L (left, center and right) from each of the modules 215; respectively.
  • the criterion for defining the boundaries of the collective eye-box 250 is the area A of the overlap of the eye-box segments 255 within which the virtual image 260 brightness is uniform within a given threshold ⁇ (for example, less than 25%) across the selected region; i.e., Var A (A R + A c + A L ) ⁇ ⁇ , the desired uniformity threshold.
  • ⁇ for example, less than 25%
  • the perceived brightness across the virtual image 260 includes a contribution of at least 50% from one of the modules 215.
  • each of the modules 215 contributes at least 50% of the perceived brightness of the virtual image 260.
  • the desired brightness uniformity of the virtual image 260 becomes the criterion that defines the size of the collective eye-box 250.
  • the arrow object 810 of the virtual image gradually vignettes or fades away as the viewer's head moves into these regions; respectively.
  • the addition of a module 215 to either the right or left sides of the MHUD assembly 210, illustrated in FIG. 6, would extend the lateral width of the collective eye-box 250 of the MHUD system 200, as defined by the design criterion defined earlier, to the right or left sides; respectively, where the arrow object 810 of the virtual image 260 would become fully visible at a desired brightness uniformity.
  • a similar effect of extending the height of the collective eye-box 250 occurs in the orthogonal direction when another row of modules 215 is added to the MHUD assembly 210.
  • any arbitrary size collective eye-box 250 with any design selected width and height dimensions can be realized by adding more of the modules 215 into the MHUD assembly 210.
  • the split exit pupil modular design method of the MHUD system 200 of this invention enables the use of a multiplicity of imagers 220 and concave mirrors 230, each with relatively smaller apertures and each achieving a short optical track length to replace the much longer optical length of the larger image source and the single mirror used in prior art HUD systems.
  • the smaller apertures imagers 220 and concave mirrors 230 of the MHUD modules 215 collectively enable a substantially smaller volumetric aspect than can be achieved by prior art HUD systems that use a larger single image source and a single mirror to achieve the same size eye-box.
  • the size of the achieved collective eye-box 250 of the MHUD system 200 can be tailored by using the appropriate number of modules 215 basic design elements.
  • the volumetric aspects of the MHUD system 200 can be made to match the volume available in the vehicle dashboard area while achieving a larger size collective eye-box 250 than can be achieved by a prior art HUD system that can fit in the same available volume.
  • FIG. 9 illustrates the volume of the MHUD assembly 210 design example illustrated in FIG. 6 installed in the dashboard of a sub-compact automobile.
  • the volumetrically efficient design of the MHUD system 200 of this invention enables the addition of HUD capabilities in an automobile with very constrained dashboard volume in which prior art HUD systems would simply not fit.
  • FIG. 10 illustrates the ray path of the MHUD system 200.
  • the three imagers 220 comprising the MHUD assembly 210 would each generate the same image at the same resolution (for example 640x360 pixels) with the three images, and, after being reflected by their three respective concave mirrors 230, would angularly address the entire 120x60 mm collective eye-box 250 of the earlier described design example and would collectively provide 640x360 spatial resolution across the 125x225 mm virtual image 260 of the earlier described design example.
  • FIG. 10 illustrates a design requirement to generate 10,000 cd/m2 of brightness at the virtual image 260.
  • each of the three imagers 220 would generate approximately 25,000 cd/m2 of brightness.
  • the three imagers 220 plus the control and interface electronics 620 of the MHUD assembly 210 would collectively consume approximately 2 W to generate 25,000 cd/m2 of brightness, which is approximately 25% of the power consumption of a prior art HUD system.
  • the encircled energy plot of FIG. 5 shows the geometrical blur radius of the collimated light beam from the concave mirror 230 optical aperture of 180 micron in size.
  • the 180 micron blur size indicated in the encircled energy plot of FIG. 5 gives each of the modules 215 an angular spread of 0.143 deg for a light beam originating at a pixel of the imager 220 and collimated by its
  • the swimming effect associated with an angular spread of 0.143 deg over the full beam width from a pixel while resolution (MTF) is decided by the effective beam width sampled by eye pupil size.
  • the MTF plot of FIG. 5 shows the MTF of each of the modules 215 calculated for a typical eye pupil aperture of 4mm diameter. The smaller this angular spread angle, the smaller the swimming radius at the virtual image 260. For a virtual image 260 viewed 2.5m from the collective eye-box 250 of the MHUD system 200, the corresponding swimming radius for the MHUD system 200 design example would be 6.2mm.
  • a prior art HUD system that uses a single mirror and having an optical aperture size equal to the full aperture size of the MHUD assembly 210 design example would have an optical aperture that is approximately 2.4x larger than the optical aperture of the module 215. Since the aberration blur size is directly proportional to the aperture size raised to the third power Ref [18], the prior art single mirror HUD system having an optical aperture size equal to the full aperture size of the MHUD assembly 210 design example would have a corresponding swimming radius approximately 14.3mm if the 5 th order aberration happens to compensate for the large 3 rd order aberration, which cannot be achieved purposefully by design, otherwise the prior art single mirror HUD system would typically have a
  • the MHUD system 200 swimming radius can be substantially reduced below the stated values of this design example or even eliminated altogether.
  • FIG. 10 also illustrates the ray path of the MHUD system 200 with the sunlight loading included.
  • the reverse optical path of the sunlight that strikes the windshield of the vehicle would reach the collective eye-box 250 area possibly causing a glare in the virtual image 260.
  • the amount of sunlight capable of reaching the collective eye-box 250 is much less in comparison to prior art HUD systems.
  • the windshield 240 optical transmission is 80%, the light rays from the sun are attenuated by the windshield 240 to at most 80% of its brightness.
  • the sun rays transmitted through the windshield 240 and reflected by one of the concave mirrors 230 toward its corresponding imager 220 would be further attenuated by the anti-reflective (AR) coating on the optical aperture of the imager 220 to at most 5% of its brightness before it is reflected back toward the concave mirrors 230 assembly.
  • this reverse path sunlight would then be further attenuated to at most by 20% of its brightness when it is reflected by windshield 240 toward the collective eye-box 250.
  • the imager 220 and concave mirror 230 of each of the modules 215 contributes at most 50% to the brightness of the virtual image 260, the sunlight glare reflected from the modules 215 stricken by the sunlight would appear further attenuated by 50% at the virtual image 260.
  • the sunlight that would reach the collective eye-box 250 would be attenuated to at most to 0.4% (much less than 1 %) of its brightness.
  • the MHUD system 200 With the MHUD system 200 being able to generate more than 10,000 cd/m2 of brightness and 0.4% sunlight glare at the virtual image 260, the MHUD system 200 can tolerate a sunlight brightness of more than
  • the glass cover 430 would be infrared absorbing, but transparent to light of the wavelengths used in the heads-up display of the present invention to prevent the sun loading heat from being concentrated by the concave mirror 230 assembly back to the imagers 220.
  • modules were disposed side by side to provide overlapping eye-box segments to provide a wider collective eye- box 250 than the eye-box segments 255 themselves.
  • the modules may be disposed so that the eye-box segments of modules 215 are also stacked to provide a taller collective eye-box 250, again all modules displaying the same virtual image at the same position in front of the vehicle.
  • the stacking to provide a taller collective eye-box 250 is in general not a stacking of modules, but rather because of the slope of the typical windshield, the stacking of the eye-box segments may be accomplished by simply using a larger, substantially horizontal area of the dashboard for the additional modules.
  • each single imager with associated optics 220 is collimated, magnified and reflected by its associated concave mirror 230, then partially reflected off the vehicle windshield 240 to form the virtual image
  • the extent of collimation achieved by the concave mirror will necessarily be less than perfect, and may be intentionally set to limit how far ahead of the vehicle the virtual image will be formed.
  • the concave mirrors may in fact be purposely designed to distort the collimation to offset any following sources of aberrations, the curvature of a windshield, if any, being the most obvious example.
  • off-axis distortion and tilting aberrations and color and brightness corrections can be made in the control and interface electronics 620 of the MHUD assembly 210 of Fig. 2 (see also Fig. 6).
  • lateral position correction of each image or image segment from each module 215 may also be made in the control and interface electronics 620(or mechanically) so that double images or double image portions are not displayed.
  • "brightness corrections" have at least two primary aspects. The first and most obvious is the correction of brightness variations, module to module, so that an image brightness (and color) from different modules will not be different.
  • Table 1 below presents the salient performance characteristics of the imager based MHUD system 200 of certain embodiments of the invention illustrating their performance advantages in comparison to prior art HUD system that uses a single larger mirror and a single larger image source.
  • the split exit pupil MHUD system of this invention outperforms prior art HUD systems by multiple factors in every performance category.
  • the MHUD systems 200 of this invention are expected to be much more cost-effective than prior art with comparable eye-box size.
  • the HUD system display multiple virtual images to the viewer, preferably directly in front of the viewer so as not to distract the viewer's attention from driving while at the same time offering safe viewablity of additional information.
  • multiple virtual images may be displayed by the HUD system where, for instance, a first virtual image is displayed at a far-field distance, which is typically adopted in conventional HUD systems, and a second virtual image is displayed at a near-field distance.
  • both virtual images are viewable to the HUD system viewer without the need for the viewer to turn his or her head away from the road and to permit the driver to continue to pay attention to driving conditions.
  • the split exit pupil design architecture earlier described may be used in conjunction with a multiplicity of display elements 220 (i.e., imagers and associated optics 220), as illustrated in FIG. 2, whereby each display element 220 is configured so as to modulate multiple images in different output angles.
  • display elements 220 i.e., imagers and associated optics 220
  • the system may comprise a multiplicity of modules 215, each having a solid state emissive pixel array imager (i.e., display element) 220 and concave mirror 230 configured to collimate, magnify and reflect first and second images generated by the solid state emissive pixel array imager 220 toward a vehicle windshield to form first and second virtual images that are viewable within an eye-box segment.
  • the multiplicity of modules are disposed so that the eye-box segments 255 combine to provide a heads-up display as having a collective eye-box 250 that is larger than the eye-box segment 255 of each module 215 and so that the collective eye-box 250 is located at a nominal head position of a vehicle's driver.
  • the solid state emissive pixel array imager 220 comprises a first set of pixels associated with a respective first set of micro optical elements and second set of pixels associated with a respective second set of micro optical elements.
  • the first set of micro optical elements are configured to direct an output from the respective first set of pixels to create the first image described above, whereby a first virtual image is generated that is viewable at a first distance from the collective eye-box 250.
  • the second set of micro optical elements are configured to direct an output from the respective second set of pixels to create the second image described above, whereby a second virtual image is generated that is viewable at a second distance from the collective eye box 250.
  • the micro optical element may include a non-telecentric lens or non-telecentric optical element configured to enable the generally inclined pixel output relative to the surface of the solid state emissive pixel array imager 220.
  • the first distance may be a far field distance and the second distance may be a near field distance.
  • the first set of pixels may be a user-defined first set of pixels of the solid state emissive pixel array imager 220 and the second set of pixels may be a user defined second set of pixels of the solid state emissive pixel array imager 220.
  • the first set of pixels may be the odd numbered rows of pixels of the solid state emissive pixel array imager 220 and the second set of pixels may be the even numbered rows of the solid state emissive pixel array imager 220.
  • the first set of pixels may be the even numbered rows of the solid state emissive pixel array imager 22 and the second set of pixels may be the odd numbered rows of the solid state emissive pixel array imager 220.
  • the first set of pixels may be the pixels comprising at least 50% of the pixel area of the solid state emissive pixel array imager 22 and the second set of pixels may be the balance of the remaining pixel area of the solid state emissive pixel array imager 220.
  • the first set of pixels may be the upper region or portion of the solid state emissive pixel array imager 220 and the second set of pixels may be the lower region or portion of the solid state emissive pixel array imager 220.
  • FIGS. 1 1A-B and 1 1 C-D illustrate non-limiting examples of such multiple- image light modulation display elements 220 configured whereby predetermined sets of individual pixels, such as predetermined sets of pixel rows or pixel columns, in a 2D array of pixels on a display element 220, each individually incorporate a micro optical element that directs, or directionally modulates, the light emitted from the respective pixels in a predetermined unique direction.
  • FIGS. 1 1A-B and 1 1 C-D illustrate examples in which a multi-image display element 220 is designed to modulate two images simultaneously, with each first and second image being emitted from the display element 220 surface at a different direction.
  • the first image (described above) that is modulated generates a first virtual image that is viewable at the far-field distance (e.g., approximately 2.5m) from the HUD system eye-box 250, while the second image that is modulated generates a second virtual image that is viewable at the near-field distance (e.g., approximately 0.5m).
  • These two viewable virtual images may be modulated by the multi-image split exit pupil HUD system simultaneously and the HUD system viewer can selectively view either of the first or second virtual images simply by redirecting his/her line of sight in the plane of the vertical axis by an angle that is proportional with the angular inclination (or separation) of the modulation direction of the two virtual images modulated by the multiple display elements 220 of the split exit pupil HUD system.
  • FIGS. 1 1 A and 1 1 B illustrate a top and side view of a display element 220 in one embodiment of the invention in which a multiplicity of display elements 220 of the split exit pupil HUD system are configured modulate the first and second images by having their optical aperture partitioned into two groups of display pixels, for example the odd-numbered and the even-numbered rows of display pixels, whereby one group of pixels, the odd numbered row of pixels modulates the first image while the second group of pixels, the even numbered row of pixels
  • Such a directional modulation capability of the HUD system display elements 220 may be realized by designing the micro optical elements or micro lens elements associated with each of the image modulation pixel groups to directionally modulate the light emitted from their associated pixels in a predetermined image directions. For example, in the case illustrated in FIGS. 1 1 A and 1 1 B, the micro optical elements associated with the odd numbered rows of pixels direct the light emitted from the associated group of pixels to form the first image while the micro optical elements associated with the even numbered rows of pixels direct the light emitted from that group of pixels to form the second image. Note that while the light rays are illustrated as being parallel for each image in Figs.
  • the multiplicity of imagers 220 modulate the same two images, each in a different direction, in order to present in the collective eye-box 250 of the split exit pupil HUD system both virtual images, with each of the modulated two resulting virtual images being viewable across the collective eye-box 250, but at a different vertical (or azimuth) direction.
  • the multiplicity of display elements 220 of the split exit pupil multi-image HUD system each has an optical aperture that is divided into two regions or areas of pixels, namely, an upper region of pixels and a lower region of pixels in the illustrated example.
  • the two images that are modulated in different directions are each modulated by a single dedicated pixel region. For example, as illustrated in FIGS.
  • the display elements 220 optical aperture upper region (which may be any user-defined portion of the imager pixel set) of pixels have their micro optical elements designed to direct the light emitted from each of the display element 220 pixels comprising the upper region of pixels to form the first image as defined above, while the display elements 220 optical aperture lower region of pixels have their micro optical elements designed to direct the light emitted from each of the display element 220 pixels comprising the lower region of pixels to form the second image as defined above.
  • the pixel emission angles may be provided by the use of non-telecentric micro optical elements in the form of a non-telecentric imager 220 as is discussed in greater detail below.
  • FIG. 12 illustrates a preferred embodiment of the multi-image split exit pupil HUD system of the invention.
  • the multiplicity of display elements (or imagers) 220 may each modulate two virtual images, with the first image being modulated in an upper direction while the second image is modulated in a lower direction.
  • the multiplicity of display elements 220 simultaneously modulate both first and second images in order to angularly fill-in the multi-image split exit pupil HUD system eye-box 250 as illustrated in FIG. 8.
  • the collimated light ray bundles comprising the two first and second images modulated (generated) by the multiplicity of display elements 220 are viewable at two different inclination angles within the eye-box 250 to enable the multi-image split exit pupil HUD system viewer to focus on two independently and simultaneously modulated virtual images with a first virtual image viewable at the far-field 260-1 and a second virtual image being viewable at the near-field 260-2, whereby the two virtual images are angularly separated in the vertical (azimuth) direction, by the angle 220-3 that is proportional to the directional separation angle 220-4 between the two images modulated by the multiplicity of display elements 220.
  • the two virtual images are at different first and second virtual distances because their light ray bundles are collimated at different levels (to different extents).
  • the concave mirrors 230 collimation is designed to achieve the far-field virtual image distance from the eye-box 250.
  • the micro-optical elements of the non- telecentric QPI® imagers discussed below as specific examples of specific embodiments, are designed to introduce additional collimation of the light emitted from the respective pixels associated with the non-telecentric QPI® elements.
  • the combined collimation achieved by the non-telecentric micro-optical elements in cooperation with the concave mirrors 230 thus achieves the far-field and near-field virtual image distances from the eye-box 250 to enable a multi-image HUD displaying both a far field and a near field virtual image simultaneously.
  • the multi-image split exit pupil HUD system viewer can view (or focus on) either of the two first or second virtual images modulated by the HUD system merely by redirecting his/her line of sight in the vertical (azimuth) direction by the angle 220-3 (see also FIG. 12). Since the two virtual images are modulated independently and separately by two separate groups of pixels comprising the display elements (imagers) 220, each of the first and second images displayed to the viewer may contain different information that may be of interest to the viewer.
  • FIG. 13 also illustrates the nominal position of the two virtual first and second images modulated by the multi-image split exit pupil HUD system with the far-field virtual image being focusable by the viewer at approximately 2.5m distance in the non-limiting illustrated example (approximately at the end of the vehicle's front hood), while the near-field virtual image is focusable by the viewer at approximately 0.5m distance (approximately at the outer lower edge of the vehicle's windshield).
  • the described HUD multi-image capabilities beneficially do not result in an increase in the multi-image split exit pupil HUD system volumetric aspects outlined in FIG. 6.
  • the display elements' (imagers) 220 interfaces 710, control function 720 and uniformity loop 730 also remain unchanged as illustrated in FIG. 7.
  • the main differences in the implementation and design methods of the multi- image split exit pupil HUD system in comparison with the single image split exit pupil HUD system described are:
  • the multiplicity of display elements (imagers) 220 have the capability of modulating multiple images in different directions as described in the previous embodiments,
  • the vertical field of view (FOV) the multi-image split exit pupil HUD system is angularly split into two directional regions to enable the simultaneous modulation of two angularly separated images; and;
  • the image input 715 to the multiplicity of display emblements (imagers) 220 is comprised of two images each being addressed (digitally) to the
  • FIG. 14 illustrates an exemplar instantiation of a non-telecentric QP imager referenced above in which the non-telecentric micro optical elements 1250-1 may be realized as refractive optical elements (ROE) and used to direct selected pixel light outputs at angles generally inclined relative to the display element 220 surface to provide a near field virtual image.
  • ROE refractive optical elements
  • the pixel level refractive non-telecentric micro optical elements 1250-1 directional modulation aspects may be realized using de- centered micro lenses 1250-1 formed by successive layers of dielectric materials 1310 and 1320 having different indexes of refraction.
  • FIG. 14 is a schematic cross section of display element 220 comprising a plurality of non-telecentric refractive micro optical elements 1250-1 .
  • the array of pixel level non- telecentric micro optical elements 1250-1 may be fabricated monolithically at the wafer level as multiple layers of semiconductor dielectric materials, such silicon oxide for the low index layer 1310 and silicon nitride for the high index layer 1320, using semiconductor lithography, etch and deposition techniques. As illustrated in FIG.
  • the array pixel level micro optical elements 1250-1 are realized using multiple layers, the dielectric materials 1310 and 1320 with different indexes of refraction successively (sequentially) deposited to form the refractive surfaces of the pixel level micro optical elements 1250-1 , which progressively vary in refractive micro-lens element center position across the micro-lens array as required to obtain the desired non-telecentric characteristics and image projection directions.
  • FIG. 15 illustrates an alternative exemplar instantiation of a non-telecentric QPI® imager referenced above, in which the non-telecentric micro optical elements 1250-2 are realized as tilted refractive optical elements (ROE) again progressively varying across the micro-lens array as required to obtain the desired non-telecentric characteristics and image projection directions, and may be used to direct selected pixel light outputs at angles generally inclined relative to the imager 220 surface to provide the near field or second image.
  • the pixel level refractive non-telecentric micro optical elements 1250-2 directional modulation aspects are realized using tilted micro lenses 1250-2 formed by successive layers of dielectric materials 1410 and 1420 with different indexes of refraction.
  • FIG. 15 is a side view of display element 220 comprising a plurality of tilted refractive micro optical elements 1250-2.
  • the array of pixel level non-telecentric micro optical elements 1250-2 may be fabricated monolithically at the wafer level as multiple layers of semiconductor dielectric materials, such as silicon oxide for the low index layer 1410 and silicon nitride for the high index layer 1420, using semiconductor lithography, etch and deposition techniques.
  • the array of pixel level non-telecentric micro optical elements 1250-2 may be realized using multiple layers dielectric materials 1410 and 1420 with different indexes of refraction successively (sequentially) deposited to form the refractive surfaces of the pixel level non-telecentric micro optical elements 1250-2.
  • the present invention has a number of aspects, which aspects may be practiced alone or in various combinations or sub-combinations, as desired. While certain preferred embodiments of the present invention have been disclosed and described herein for purposes of illustration and not for purposes of limitation, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the full breadth of the following claims.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Instrument Panels (AREA)

Abstract

L'invention concerne des systèmes et des procédés de visualisation tête haute (VTH) à pupille de sortie divisée (ou boîte à oeil divisée). Les procédés de système VTH décrits utilisent un procédé de conception de pupille de sortie divisée qui permet à un système VTH modulaire et permet au système VTH de visualiser la taille de la boîte oculaire d'être personnalisé tout en réduisant les aspects volumétriques globaux VTH. Un module VTH utilise un imageur à micro-pixels de petite taille à haute luminosité pour générer une ou plusieurs images virtuelles VTH avec une ou plusieurs tailles de segments de boîte à oeil de visualisation données. Lorsqu'ils sont intégrés ensemble dans un système VTH, une multiplicité de tels modules VTH affichant la même image permettrait à un tel système VTH intégré d'avoir une taille de boîte à œil qui est sensiblement plus grande que la taille de boîte à œil d'un module VTH. Le volume de système HUD intégré résultant est sensiblement plus petit de manière volumétrique qu'un système HUD qui utilise un seul imageur plus grand. Le système HUD intégré peut être constitué d'une pluralité de modules HUD uniques pour mettre à l'échelle la taille de boîte oculaire afin qu'elle corresponde à l'application prévue tout en maintenant la luminosité du système.
PCT/US2018/020324 2017-03-03 2018-02-28 Systèmes et procédés de visualisation tête haute à pupille de sortie fendue WO2018160765A1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP18710721.4A EP3615981A1 (fr) 2017-03-03 2018-02-28 Systèmes et procédés de visualisation tête haute à pupille de sortie fendue
KR1020197026913A KR20190119093A (ko) 2017-03-03 2018-02-28 스플릿 사출 동공 헤드업 디스플레이 시스템 및 방법
JP2019547678A JP7025439B2 (ja) 2017-03-03 2018-02-28 分割射出瞳ヘッドアップディスプレイシステム及び方法
CN201880029162.4A CN110573930B (zh) 2017-03-03 2018-02-28 分割出瞳平视显示器系统和方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/449,679 2017-03-03
US15/449,679 US10539791B2 (en) 2014-09-02 2017-03-03 Split exit pupil multiple virtual image heads-up display systems and methods

Publications (1)

Publication Number Publication Date
WO2018160765A1 true WO2018160765A1 (fr) 2018-09-07

Family

ID=61622805

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2018/020324 WO2018160765A1 (fr) 2017-03-03 2018-02-28 Systèmes et procédés de visualisation tête haute à pupille de sortie fendue

Country Status (6)

Country Link
EP (1) EP3615981A1 (fr)
JP (1) JP7025439B2 (fr)
KR (1) KR20190119093A (fr)
CN (1) CN110573930B (fr)
TW (1) TWI766954B (fr)
WO (1) WO2018160765A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114967150A (zh) * 2022-06-13 2022-08-30 海信集团控股股份有限公司 车辆及光学自由曲面的确定方法
EP4141521A1 (fr) * 2021-08-26 2023-03-01 Envisics Ltd. Optimisation du champ de vision d'un dispositif d'affichage tete haute
EP4396624A4 (fr) * 2021-08-31 2024-12-25 Spectralics Ltd. Projection monoculaire parallèle dynamique
US12328534B2 (en) 2020-05-15 2025-06-10 Huawei Technologies Co., Ltd. Display apparatus and method, and vehicle

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4120004B1 (fr) 2021-07-16 2024-11-06 Coretronic Corporation Affichage tête haute
KR102697105B1 (ko) * 2021-09-17 2024-08-20 네이버 주식회사 헤드업 디스플레이 및 그 제어방법
CN117130158A (zh) * 2022-05-20 2023-11-28 中强光电股份有限公司 抬头显示装置
CN114815264B (zh) * 2022-05-26 2023-11-07 业成科技（成都）有限公司 图像生成单元、其装配方法、抬头显示系统及交通工具
KR102851639B1 (ko) * 2022-12-28 2025-08-27 현대모비스 주식회사 헤드업 디스플레이용 화상형성장치

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4218111A (en) 1978-07-10 1980-08-19 Hughes Aircraft Company Holographic head-up displays
US4613200A (en) 1984-07-09 1986-09-23 Ford Motor Company Heads-up display system with holographic dispersion correcting
US5729366A (en) 1993-12-23 1998-03-17 Hyundas Electronics Industries Co., Ltd. Heads-up display for vehicle using holographic optical elements
US6014259A (en) * 1995-06-07 2000-01-11 Wohlstadter; Jacob N. Three dimensional imaging system
US6813086B2 (en) 2000-12-19 2004-11-02 Thales Head-up display adaptable to given type of equipment
US7391574B2 (en) 2005-12-15 2008-06-24 Saab Ab Head-up display
US7623560B2 (en) 2007-09-27 2009-11-24 Ostendo Technologies, Inc. Quantum photonic imagers and methods of fabrication thereof
US7982959B1 (en) 2010-08-02 2011-07-19 Matvey Lvovskiy Head-up display
US8098265B2 (en) 2008-10-10 2012-01-17 Ostendo Technologies, Inc. Hierarchical multicolor primaries temporal multiplexing system
US20130021226A1 (en) * 2011-07-21 2013-01-24 Jonathan Arnold Bell Wearable display devices
US8553334B2 (en) 2011-11-16 2013-10-08 Delphi Technologies, Inc. Heads-up display system utilizing controlled reflections from a dashboard surface
US8629903B2 (en) 2009-04-02 2014-01-14 GM Global Technology Operations LLC Enhanced vision system full-windshield HUD
US20160065921A1 (en) * 2013-05-10 2016-03-03 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Multi-aperture projection display and single image generator for the same
US20160062113A1 (en) * 2014-09-02 2016-03-03 Ostendo Technologies, Inc. Split Exit Pupil Heads-Up Display Systems and Methods

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63502933A (ja) * 1986-03-31 1988-10-27 ヒユーズ・エアクラフト・カンパニー 一体形ヘッドアップおよびパネルデイスプレイユニット
JPH07257228A (ja) * 1994-03-18 1995-10-09 Nissan Motor Co Ltd 車両用表示装置
JPH08122737A (ja) * 1994-10-28 1996-05-17 Shimadzu Corp 車両用ヘッドアップディスプレイ装置
JPH11513129A (ja) * 1995-06-07 1999-11-09 ウオルスタドター，ジャコブ，エヌ． ３次元画像形成システム
JP2004272230A (ja) * 2003-02-19 2004-09-30 Pentax Corp 走査光学系
US7334901B2 (en) * 2005-04-22 2008-02-26 Ostendo Technologies, Inc. Low profile, large screen display using a rear projection array system
US20100033813A1 (en) * 2008-08-05 2010-02-11 Rogoff Gerald L 3-D Display Requiring No Special Eyewear
US9244275B1 (en) * 2009-07-10 2016-01-26 Rockwell Collins, Inc. Visual display system using multiple image sources and heads-up-display system using the same
WO2011015843A2 (fr) * 2009-08-07 2011-02-10 Light Blue Optics Ltd Affichages tête haute
CN102640035B (zh) * 2009-09-14 2017-01-04 王晓光 裸眼3d立体图像还原显示方法
CN102656501B (zh) * 2009-12-14 2014-07-02 松下电器产业株式会社 透过型显示装置
TW201144861A (en) * 2010-06-07 2011-12-16 Cheng Uei Prec Ind Co Ltd Head-up Display System
KR101883221B1 (ko) * 2010-12-16 2018-08-30 록히드 마틴 코포레이션 픽셀 렌즈를 갖춘 콜리메이팅 디스플레이
US20120224060A1 (en) * 2011-02-10 2012-09-06 Integrated Night Vision Systems Inc. Reducing Driver Distraction Using a Heads-Up Display
TW201245764A (en) * 2011-05-13 2012-11-16 New Young Optical Tech Co Ltd Semi-reflective concave mirror head-up display
JP5370427B2 (ja) * 2011-07-24 2013-12-18 株式会社デンソー ヘッドアップディスプレイ装置
JP6031741B2 (ja) * 2011-10-06 2016-11-24 日本精機株式会社 表示装置
US8854724B2 (en) * 2012-03-27 2014-10-07 Ostendo Technologies, Inc. Spatio-temporal directional light modulator
JP6004706B2 (ja) * 2012-04-04 2016-10-12 三菱電機株式会社 表示装置及びこれを備えたヘッドアップディスプレイシステム
US10215583B2 (en) * 2013-03-15 2019-02-26 Honda Motor Co., Ltd. Multi-level navigation monitoring and control
US9429757B1 (en) * 2013-11-09 2016-08-30 Jonathan Peeri System for providing projected information combined with outside scenery
JP6497158B2 (ja) * 2014-05-16 2019-04-10 株式会社リコー 表示装置、移動体
JP6658529B2 (ja) * 2014-09-08 2020-03-04 ソニー株式会社 表示装置、表示装置の駆動方法、及び、電子機器
JP6262111B2 (ja) * 2014-09-29 2018-01-17 矢崎総業株式会社 車両用表示装置
US10247941B2 (en) * 2015-01-19 2019-04-02 Magna Electronics Inc. Vehicle vision system with light field monitor
CN205281018U (zh) * 2015-12-24 2016-06-01 深圳点石创新科技有限公司 一种抬头显示装置

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4218111A (en) 1978-07-10 1980-08-19 Hughes Aircraft Company Holographic head-up displays
US4613200A (en) 1984-07-09 1986-09-23 Ford Motor Company Heads-up display system with holographic dispersion correcting
US5729366A (en) 1993-12-23 1998-03-17 Hyundas Electronics Industries Co., Ltd. Heads-up display for vehicle using holographic optical elements
US6014259A (en) * 1995-06-07 2000-01-11 Wohlstadter; Jacob N. Three dimensional imaging system
US6813086B2 (en) 2000-12-19 2004-11-02 Thales Head-up display adaptable to given type of equipment
US7391574B2 (en) 2005-12-15 2008-06-24 Saab Ab Head-up display
US7767479B2 (en) 2007-09-27 2010-08-03 Ostendo Technologies, Inc. Quantum photonic imagers and methods of fabrication thereof
US20100066921A1 (en) 2007-09-27 2010-03-18 Ostendo Technologies, Inc. Quantum Photonic Imagers and Methods of Fabrication Thereof
US7623560B2 (en) 2007-09-27 2009-11-24 Ostendo Technologies, Inc. Quantum photonic imagers and methods of fabrication thereof
US7829902B2 (en) 2007-09-27 2010-11-09 Ostendo Technologies, Inc. Quantum photonic imagers and methods of fabrication thereof
US8049231B2 (en) 2007-09-27 2011-11-01 Ostendo Technologies, Inc. Quantum photonic imagers and methods of fabrication thereof
US20120033113A1 (en) 2007-09-27 2012-02-09 Ostendo Technologies, Inc. Quantum Photonic Imagers and Methods of Fabrication Thereof
US8098265B2 (en) 2008-10-10 2012-01-17 Ostendo Technologies, Inc. Hierarchical multicolor primaries temporal multiplexing system
US8629903B2 (en) 2009-04-02 2014-01-14 GM Global Technology Operations LLC Enhanced vision system full-windshield HUD
US7982959B1 (en) 2010-08-02 2011-07-19 Matvey Lvovskiy Head-up display
US20130021226A1 (en) * 2011-07-21 2013-01-24 Jonathan Arnold Bell Wearable display devices
US8553334B2 (en) 2011-11-16 2013-10-08 Delphi Technologies, Inc. Heads-up display system utilizing controlled reflections from a dashboard surface
US20160065921A1 (en) * 2013-05-10 2016-03-03 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Multi-aperture projection display and single image generator for the same
US20160062113A1 (en) * 2014-09-02 2016-03-03 Ostendo Technologies, Inc. Split Exit Pupil Heads-Up Display Systems and Methods

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
B. H. WALKER: "Optical Design of Visual Systems, Tutorial tests in optical engineering", 2000, THE INTERNATIONAL SOCIETY OF OPTICAL ENGINEERING (SPIE, pages: 139 - 150
C. GUILLOUX ET AL., VARILUX S SERIES BRAKING THE LIMITS
M. BORN: "Principles of Optics", 1999, CAMBRIDGE UNIVERSITY PRESS, pages: 236 - 244

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12328534B2 (en) 2020-05-15 2025-06-10 Huawei Technologies Co., Ltd. Display apparatus and method, and vehicle
EP4141521A1 (fr) * 2021-08-26 2023-03-01 Envisics Ltd. Optimisation du champ de vision d'un dispositif d'affichage tete haute
GB2610205A (en) * 2021-08-26 2023-03-01 Envisics Ltd Field of view optimisation
GB2610205B (en) * 2021-08-26 2024-08-14 Envisics Ltd Field of view optimisation
EP4396624A4 (fr) * 2021-08-31 2024-12-25 Spectralics Ltd. Projection monoculaire parallèle dynamique
CN114967150A (zh) * 2022-06-13 2022-08-30 海信集团控股股份有限公司 车辆及光学自由曲面的确定方法

Also Published As

Publication number Publication date
JP7025439B2 (ja) 2022-02-24
JP2020510236A (ja) 2020-04-02
CN110573930A (zh) 2019-12-13
KR20190119093A (ko) 2019-10-21
CN110573930B (zh) 2022-07-22
EP3615981A1 (fr) 2020-03-04
TW201837539A (zh) 2018-10-16
TWI766954B (zh) 2022-06-11

Similar Documents

Publication Publication Date Title
US10539791B2 (en) Split exit pupil multiple virtual image heads-up display systems and methods
EP3189366B1 (fr) Procédés et systèmes d'affichage tête haute à pupille de sortie fendue
TWI766954B (zh) 分裂出射瞳孔抬頭顯示系統及方法
US10845591B2 (en) Split exit pupil heads-up display systems and methods
TWI728094B (zh) 分裂出射光瞳抬頭顯示系統及方法
US5379132A (en) Display apparatus for a head-up display system
JP6653380B2 (ja) 情報表示装置
US8094377B2 (en) Head-mounted optical apparatus using an OLED display
WO2018042844A1 (fr) Dispositif d'affichage d'informations
JP7200317B2 (ja) ヘッドアップディスプレイ装置
KR20230152040A (ko) 홀로그래픽 소자, 광학 장치 및 헤드업 디스플레이를 장착한, 헤드업 디스플레이용 파면 제어장치
WO2020026841A1 (fr) Dispositif d'affichage d'informations et procédé d'affichage d'informations
JP7021939B2 (ja) 情報表示装置
HK1237421A1 (en) Split exit pupil heads-up display systems and methods
HK1237421B (zh) 分割出瞳平视显示系统和方法
CN117518465A (zh) 像源装置、折射件、显示装置、交通设备及显示方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18710721

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019547678

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20197026913

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2018710721

Country of ref document: EP

Effective date: 20191004