CN104007552B - A kind of light field helmet-mounted display system of true stereo sense - Google Patents

Abstract

The invention discloses a kind of light field helmet-mounted display system of true stereo sense, comprise a set of above light field helmet mounted display device, often cover light field helmet mounted display device includes optics and plays up the micro-display device realizing module and be arranged in order, micro structure array device and optical eyepiece system, beam splitting is carried out by the light adopting micro structure array device the different pixels of micro-display device to be sent, form spatial light field, the requirement of the characteristic dimension p of array ensure that the direction of the light beam that at least two pixels are formed is different, the dense spatial light field meeting human eye natural vision can be provided in this way, spatial light field is changed by optical eyepiece system, spatial light field is only generated in the emergent pupil of optical eyepiece, that is the viewing area of this light field display system is controlled in simple eye observable scope, thus solve the convergence of the human eye occurred in Helmet Mounted Display and converge like the spokes of a wheel at the hub inconsistence problems.

Description

A real three-dimensional light field helmet display system

technical field

The invention relates to the field of virtual reality and augmented reality, in particular to a light field helmet display system for realizing real stereoscopic effect.

Background technique

The display device is an important part of the human-computer interaction interface in the field of virtual reality and augmented reality. On the one hand, the helmet-mounted display, as a near-eye display device, has become a research and development in the field of display in recent years due to its mobility, convenience and privacy. On the other hand, with the emergence of 3D movies, three-dimensional display has entered people's field of vision, and people have begun to apply head-mounted displays to the field of three-dimensional display.

In the field of three-dimensional display, the image to be displayed provided has stereoscopic information, that is to say, the provided image has a certain depth, and the virtual object to be displayed is imaged in the front and back of the focal plane. The traditional head-mounted display can only give human eyes Provide the display information of a single focal plane. In order to see the object clearly, the human eye needs to adjust the lens of the human eye to make the human eye focus on this focal plane. The greater the difference between the depth of the virtual object and the depth of the focal plane, the difference between the convergence and convergence of the human eye It will be bigger, which will cause discomfort when people observe. Especially when the head-mounted display has an optical transmission function, that is, when the human eye can see the objects in the virtual scene while viewing the objects in the real environment, due to the real objects in the outside world as a comparison, the difference in convergence and convergence is caused The discomfort will be more pronounced.

In order to alleviate the convergence and convergence inconsistencies of the human eye, a display device capable of providing a true three-dimensional sense is needed. Currently, the display devices with a true three-dimensional sense proposed by scientists mainly include a head-mounted display with a zoom plane and a head-mounted display with a multi-focal plane.

Among them, the main method of the zoom surface helmet display is to quickly change the position of the imaging focal plane in the helmet display device during the use of the helmet display, so as to realize the rapid change of the position of the screen observed by the human eye along the depth direction. Specifically, it can be changed by changing The position of the image plane and the position of the optical system can be achieved by using liquid lenses, deformable mirrors, birefringent lenses or other electrically controllable ways to change the focal length of the optical system in the head-mounted display, but if the period of rapidly changing the position of the imaging plane is short Due to the persistence of vision of the human eye, there will be a problem of reconstructing multiple focal planes in front of the human eye.

The solution of the multi-focal head-mounted display is to use multiple display devices in the head-mounted display, or to split one display device into multiple ones for use. In the process of designing the entire system, multiple display devices are stacked. In use, and multiple display devices form observation planes with different depths in space, increasing the number of display devices will alleviate the problem of convergence and inconsistency of the human eye, but the focal plane established in space is limited. It still does not reach the amount of spatial depth that the human eye can perceive, and it does not fully conform to the attributes of real objects in the space observed by the human eye, and it cannot completely solve the contradiction caused by the inconsistency of convergence and convergence of the human eye.

Whether it is a head-mounted display with zoom plane or a multi-focal plane, it realizes three-dimensional display based on the principle of binocular parallax. A display device, or inserting a beam splitter or an electrically controllable zoom device will increase the complexity, volume and weight of the system, and will increase the discomfort perceived by the human body due to the increase in the complexity, volume and weight of the system, and even cause The system is too bulky to be worn.

Contents of the invention

In view of this, the present invention proposes a light field helmet display system that realizes a real three-dimensional sense, and uses a microstructure array device to split the light emitted by different pixels of the microdisplay device to provide a dense space that conforms to the natural vision of the human eye. The light field changes the spatial light field through the optical eyepiece system, so that the spatial light field is only generated in the exit pupil of the helmet display device, that is, the visible area of the light field display system is controlled in the range that can be observed by one eye, thus solving the problem of the helmet Convergence and convergence inconsistencies in the human eye that occur in displays.

A real three-dimensional light field helmet display system of the present invention, the light field helmet display system includes more than one set of light field helmet display devices, each set of light field helmet display devices includes an optical rendering realization module and sequentially arranged micro A display device, a microstructure array device and an optical eyepiece system, the optical rendering implementation module is connected to the input end of the microdisplay device;

The microstructure array device refracts or filters the light waves emitted by each pixel on the microdisplay device to form a spatial beam, and the spatial beams corresponding to at least two pixels in the microdisplay device have different directions, and all pixels correspond to The space light beams form a space light field;

The optical eyepiece system in each light field helmet display device converges the respective spatial light fields in the exit pupil of the light field helmet display system;

The diameter of the largest inscribed circle of the light spot formed by the spatial beam corresponding to each pixel of the micro-display device on the exit pupil plane of the helmet display device is not greater than 2mm;

When displaying a three-dimensional virtual object, the optical rendering implementation module calculates the relationship between the light and the three-dimensional virtual object to be displayed according to the distribution of the spatial light field, that is, the corresponding relationship between the pixels of the micro-display device and the light in the space beam The gray value at the intersection point of the surface, then the gray value at the intersection point is the gray value of the pixel on the micro-display device corresponding to the light; the optical rendering implementation module sends the gray value of each pixel to the micro-display device, the micro-display device displays according to the received gray value.

Preferably, the F number of the optical eyepiece system is F#, which satisfies the relationship: 0.5F#≤g/p≤2F#;

Wherein, g is the distance between the beam splitting plane of the microstructure array device and the display plane of the microdisplay device;

The exit pupil diameter D of the optical eyepiece system satisfies 4mm≤D≤25mm; the exit pupil distance L of the optical eyepiece system satisfies the relation 12mm≤L≤45mm.

The characteristic size p of the microstructure of the microstructure array device is not smaller than 2 pixels on the microdisplay device.

Preferably, the optical eyepiece system adopts an off-axis optical eyepiece system, and the off-axis optical eyepiece system has three optical surfaces, the first optical surface, the second optical surface and the third optical surface, wherein the third optical surface is coated with With reflective film;

The light wave emitted by each pixel on the micro-display device is refracted or filtered by the microstructure array device, and then hits the first optical surface of the optical eyepiece system, enters the optical eyepiece system through refraction, and is totally reflected on the second optical surface to the first optical surface. The three optical surfaces are reflected back to the second optical surface through the third optical surface, and then refracted into the human eye through the second optical surface (302).

Preferably, the optical eyepiece system adopts an optical transmissive off-axis reflective optical system, and the optical transmissive off-axis reflective optical system includes four optical surfaces: a first surface, a second surface, a third surface and a fourth surface, Wherein, the third surface is coated with a semi-transparent and semi-reflective film;

The light wave emitted by each pixel on the micro-display device is refracted or filtered by the micro-structure array device, and then first refracted by the first surface of the optical eyepiece system, then reaches the second surface, and then reaches the third surface after total reflection on the second surface , returns to the second surface after being reflected by the third surface, and enters the human eye through the refraction of the second surface. After transmission, it enters the human eye.

Further, the light field helmet display system of the present invention also includes a half-mirror, and the sequentially arranged micro-display device, micro-structure array device and optical eyepiece system are placed obliquely above the human eye, and the half-mirror The mirror is placed in front of the human eye and is located in the transmitted light path of the optical eyepiece system; the half-reflective and semi-transparent surface of the half mirror receives the spatial light field transmitted by the optical eyepiece system and reflects it into the human eye, At the same time, the semi-reflective and semi-transparent surface transmits the real scene of the outside world to the human eye.

The light field helmet display system of the present invention further includes a relay optical system, the relay optical system is located between the micro-display device and the micro-array device, and forms a real image of the light beam emitted by the micro-display device on the surface of the micro-structure array.

The light field helmet display system includes more than two sets of light field helmet display devices with continuous field of view. The multiple sets of light field helmet display devices are distributed in front of the human eye and are symmetrical with respect to the optical axis. The optical eyepiece system of the helmet display device converges the respective light fields in the exit pupil of the light field helmet display system.

The light field helmet display system of the present invention includes two sets of light field helmet display devices with continuous fields of view, wherein the optical eyepiece system of each set of light field helmet display devices includes four surfaces, respectively the first surface, the second surface, the third The surface and the fourth surface; the light wave emitted by each pixel of the micro-display device is refracted or filtered by the microstructure array device, and then reaches the second surface after being refracted by the first surface, and then reaches the third surface after being totally reflected by the second surface. The third surface reflects back to the second surface, and enters the human eye after being refracted by the second surface. At the same time, the real scene outside enters the human eye through the refraction of the fourth surface, the third surface and the second surface in turn.

The light field helmet display system of the present invention includes two sets of light field helmet display devices whose fields of view overlap, and further includes a half-transparent mirror:

The first set of light field helmet display device is located obliquely above the human eye, the second set of light field helmet display device is located directly in front of the human eye, the half-transparent and half-reflective mirror is located directly in front of the human eye, and at the same time is located in the first set of light field field helmet display device and the transmitted light path of the second set of light field helmet display device;

The first optical eyepiece system in the first set of light field helmet display device will reflect the spatial light field of each pixel of the first micro display device into the exit pupil through the reflective surface of the half mirror; the second The second optical eyepiece system in the light-field helmet display device converges the spatial light field of each pixel of the second micro-display device and then transmits it into the exit pupil through the transmission surface of the half-transparent mirror.

The light field helmet display system of the present invention includes two sets of light field helmet display devices, and the two sets of devices share an optical eyepiece system. The optical eyepiece system is an off-axis reflective optical eyepiece system, including five optical surfaces, respectively The first optical surface, the second optical surface, the third optical surface, the fourth optical surface, and the fifth optical surface, wherein the third optical surface is coated with a semi-transparent and semi-reflective film, and the fourth optical surface is coated with a reflective film; the first micro The display device, the first microstructure array device, the first optical surface, the second optical surface, and the third optical surface constitute the first light field helmet display device; the second microdisplay device, the second microstructure array device, and the second optical surface surface, the third optical surface, the fourth optical surface and the fifth optical surface constitute a second light field helmet display device;

The light wave emitted by each pixel on the first micro-display device is refracted or filtered by the first microstructure array device, and then first refracted by the first optical surface, totally reflected on the second optical surface, and then reflected by the third optical surface , and finally return to the second optical surface, and enter the human eye through the refraction of the second optical surface;

The light wave emitted by each pixel on the second micro-display device is refracted or filtered by the second microstructure array device, and then refracted by the fourth optical surface to the third optical surface, and then reaches the fifth optical surface after being reflected, and then reflected to the third optical surface. The third optical surface is transmitted to the second optical surface through the third optical surface, and finally enters the human eye through the refraction of the second optical surface.

The present invention has following beneficial effects:

1) The present invention realizes the real three-dimensional display by reconstructing the light field of the three-dimensional virtual object to be displayed, instead of realizing three-dimensional display based on the principle of binocular parallax, and there is no problem of inconsistency of convergence and convergence of human eyes, thereby solving the problem of Discomfort caused when the human eye observes images through a helmet-mounted display.

2) The present invention uses a microstructure array device to split the light emitted by different pixels of the microdisplay device to form a spatial light field. The requirement of the characteristic size p of the array ensures that the directions of the beams formed by at least two pixels are different. Through this This method can provide a dense spatial light field that conforms to the natural vision of the human eye, and the spatial light field is changed through the optical eyepiece system so that the spatial light field is only generated in the exit pupil of the optical eyepiece, that is to say, the light field display system The viewing area is controlled within the observable range of a single eye, thus solving the problem of inconsistency of convergence and vergence of human eyes in the head-mounted display.

3) The maximum inscribed circle diameter of the space beam exit pupil plane corresponding to each pixel on the microdisplay of the present invention is ≤2mm, so that the beam controlled by a single pixel is smaller than the pupil size when it enters the human eye, and a dense light field is realized by multiple pixels. Through the control of the light field information, more than one light beam enters the pupil of the human eye for each display information on each display object when the human eye observes the object to be displayed, which is in line with the characteristics of the normal observation of the human eye and can solve the convergence of the human eye Solve the problem of inconsistency with convergence and achieve realistic 3D display.

4) The distance between the light-splitting plane of the microstructure array device of the present invention and the display plane of the micro-display device is g, and the F number of the optical eyepiece system is F#, which satisfies the relationship: 0.5F#≤g/p≤2F#, ensuring that the eyepiece system The matching with the microstructure array device enables the pixels on the microdisplay device to be fully utilized. The exit pupil diameter D of the optical eyepiece system satisfies 4mm≤D≤25mm, and compresses the area required for the generated spatial light field spatially. To ensure that the system displays for a single eye, the exit pupil distance L of the optical eyepiece system satisfies the relationship 12mm≤L≤45mm, which ensures that the system can be worn conveniently.

6) The optical eyepiece system of the preferred embodiment of the present invention uses an off-axis reflection optical system to simplify the optical eyepiece system on the basis of ensuring the viewing angle and imaging quality.

7) The light field helmet display system of the preferred embodiment of the present invention adds a half mirror so that the human eye can see the real scene and the virtual three-dimensional object at the same time.

8) The optical eyepiece system of the preferred embodiment of the present invention adopts the structural form of three surface prisms, which reduces the volume of the system and beautifies the appearance of the system. When the optical eyepiece system has the function of optical transmission, the fourth surface is used The design is to eliminate the aberration and distortion caused by the third surface and the second surface when the user observes the real space object.

9) The preferred embodiment of the present invention adds a relay optical system, so that the system design is not limited by the thickness of devices such as protection devices and optical engines in the micro-display system, and the light-splitting plane of the microstructure array can be better controlled and the distance g between the display surface, thereby improving the resolution of the system.

10) In the present invention, multiple sets of light-field helmet-mounted display devices with overlapping or continuous fields of view are used to form a light-field helmet-mounted display system. The three-dimensional light fields of these devices continuously expand on the field of view, which can further expand the field of view of the helmet-mounted display system horn.

Description of drawings

Fig. 1 is a schematic structural diagram of a real three-dimensional photosensitive field helmet display system in the present invention;

Fig. 2 is a microstructure array light-splitting schematic diagram when the characteristic size p of the microarray structure in the present invention is less than two pixels;

Fig. 3 is a microstructure array light-splitting schematic diagram when the characteristic size p of the microarray structure in the present invention is not less than two pixels;

Fig. 4 is a schematic diagram of the spectral characteristics of a one-dimensional microstructure array device in the present invention;

5 is a schematic diagram of the spectral characteristics of a two-dimensional microstructure array device in the present invention;

Fig. 6 is the spatial light beam schematic diagram of each pixel of the micro display device in the present invention;

7 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 2 of the present invention;

Fig. 8 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 3 of the present invention;

9 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 4 of the present invention;

Fig. 10 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 5 of the present invention;

Fig. 11 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 6 of the present invention;

Fig. 12 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 7 of the present invention;

Fig. 13 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 8 of the present invention;

Fig. 14 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 9 of the present invention;

15 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 10 of the present invention;

Fig. 16 is a schematic diagram of a real three-dimensional photosensitive field helmet display system in Embodiment 11 of the present invention;

1-microdisplay device, 2-microstructure array device, 3-optical eyepiece system, 4-half-transparent mirror, 5-relay lens, 7-human eye.

detailed description

The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

A real three-dimensional light field helmet display system, the light field helmet display system includes more than one set of light field helmet display devices, as shown in Figure 1, each set of light field helmet display devices includes an optical rendering realization module and sequentially Arranged micro-display device 1 , micro-structure array device 2 and optical eyepiece system 3, wherein the optical rendering implementation module is connected to the input end of micro-display device 1.

The optical rendering implementation module calculates the gray value of each pixel of the micro-display device 1 according to the three-dimensional object to be displayed and outputs it to the micro-display device 1;

Each pixel of the micro-display device 1 displays according to the received gray value;

The microstructure array device 2 refracts or filters the light waves emitted by each pixel on the microdisplay device 1 to form a spatial beam, and the spatial beams corresponding to at least two pixels in the microdisplay device 1 have different directions, and all pixels The corresponding spatial light beams form a spatial light field;

The optical eyepiece system 3 in each light field helmet display device converges the respective spatial light fields in the exit pupil of the light field helmet display system.

In order to realize a real three-dimensional display, more than two light beams entering the pupil of the human eye are required. Therefore, the spatial light beam corresponding to each pixel of the micro-display device 1 has the maximum inner diameter of the light spot formed on the exit pupil plane of the head-mounted display device. The diameter of the tangential circle is not greater than 2mm, so that at least two light beams enter the human eye 7 . The pupil size of the human eye is 2mm-8mm. The diameter of the largest inscribed circle of the light spot on the exit pupil plane of the space beam is ≤2mm, which can ensure that the light beam emitted by a single pixel is smaller than the pupil size when it enters the human eye. Each pixel is in the exit pupil of the human eye. A light beam smaller than the pupil of the human eye is formed in the position, and what is formed in space is no longer a plane image with only two-dimensional information, but a spatial light field composed of dense light beams in different directions, thus ensuring the safety of the helmet display device. form a dense light field. Since the beam formed by the spatial beam at the pupil of the human eye is smaller than the size of the pupil, when the image is displayed, each point in the displayed image can form beams from different directions in the pupil of the human eye, so that the human eye can focus to Different positions can be displayed in three dimensions only by observing with one eye, which is completely in line with the way the human eye naturally observes real objects, and there is no phenomenon that the convergence positions of the two eyes do not coincide due to the focus position of the human eye and parallax.

The position observed by the human eye is the exit pupil position of the real three-dimensional light field helmet display system, and the optical rendering implementation module also renders the light field based on this position.

It should be noted that, in order to make the spatial light beams corresponding to at least two pixels in the microdisplay device 1 have different directions, the center-to-center distance between two adjacent array units of the microstructure array, that is, the characteristic size p of the microstructure must be at least greater than that of the microstructure. 2 pixels of display device 1, as shown in Figure 2, when p is less than 2 pixels of micro display device 1, the light that each pixel of micro display 1 sends is all the same after microarray device 2; As shown in Figure 3 As shown, when p is greater than or equal to 2 pixels of the microdisplay device 1, it can be guaranteed that the light beams emitted by at least two pixels pass through the array device 2 and form beams in different directions. In the figure, the size of p is equal to the size of 3 pixels, as can be seen After the first three pixels pass through the microarray device 2, three different directions are generated, and the last three pixels also generate three different directions. The light beams in multiple different directions form a light field in space, thereby realizing a real three-dimensional display .

Further, the F number of the optical eyepiece system in the present invention is F#, which satisfies the relationship: 0.5F#≤g/p≤2F#, which ensures the matching of the optical eyepiece system 3 and the microstructure array device 2, so that the microdisplay device 1 Each pixel on is fully utilized, when g/p<0.5F#, the pixel is not fully utilized, which reduces the resolution; when g/p>2F#, the exit pupil of the optical eyepiece system becomes smaller, when the human eye 7 produces A slight shaking will cause the human eye 7 to stagger the position of the exit pupil, which will affect the observation of the three-dimensional object by the human eye 7 . Since 4mm is the pupil size of the human eye, and 25mm is about half of the interpupillary distance of the human eye, the exit pupil diameter D of the optical eyepiece system 3 satisfies 4mm≤D≤25mm, which ensures that the light field helmet display system can display for a single eye. It can compress the spatial light field to the required size; the exit pupil distance L of the optical eyepiece system 3 satisfies the relationship 12mm≤L≤45mm, the minimum size of 12mm allows users to wear frame glasses, and the size less than 45mm ensures that the system volume will not be too large .

The light-splitting plane is the plane where the microstructure array device 2 has the light-splitting effect; the display plane is the surface where the micro-display device 1 performs light-emitting display; the light-splitting effect is realized by the microstructure of the microstructure array device 2 refracting or spatially filtering the light beam.

The micro-display device 1 can be a single micro-display device, such as OLED, LCD, or a micro-display system composed of an independent micro-display unit and an illumination optical engine, such as LCOS, DMD.

The microstructure array device 2 is a one-dimensional array, such as a cylindrical grating, or a two-dimensional array, such as a microlens array, a pinhole array, and the one-dimensional array arrangement can be oblique, vertical or horizontal , as shown in Figure 4, which is a schematic diagram of a one-dimensional array microstructure array and the direction of light beam splitting. The two-dimensional array can be arranged in a rectangle, a hexagon, or a triangle or other polygonal shapes. As shown in FIG. 5 , it is a schematic diagram of the direction of the two-dimensional array microlens array and the light beam splitting.

The method for calculating the color gray value of each pixel of the micro-display device 1 by the optical rendering implementation module is introduced below:

Firstly, each pixel of the micro-display device 1 is traced to the exit pupil position through the microstructure array device 2 and the optical eyepiece system 3 to obtain the spatial light field of each pixel, and then use the spatial light field and the to-be-displayed The light field rendering of the 3D image is performed on the 3D virtual object, as shown in Figure 6, the specific method is as follows:

The light emitted by each pixel on the micro-display device 1 in the head-mounted display device passes through the microstructure array device 2 and the optical eyepiece system 3 to form a beam with a specific direction at the exit pupil position (the direction of the beam formed by at least two pixels is different) ). As shown in Figure 6, it is assumed that each pixel on the microdisplay device 1 passes through the microstructure array 2 to form a spatial light beam, and the spatial light beam corresponding to each pixel is composed of countless light rays. The surface forms an intersection point, and the gray value at the intersection point is the gray value that the pixel of the micro-display device 1 corresponding to the light should render. Therefore, when the helmet display device displays a three-dimensional virtual object for the present invention, if you want to obtain a three-dimensional To display the gray value of the pixel required by the virtual object, it is necessary to sample the rays in the spatial light beam formed by the pixel, and use the ray tracing method or other computer graphics rendering methods to calculate the gray value of each light that needs to be rendered, and then The obtained gray value is weighted average to obtain the gray value of the corresponding pixel on the micro-display device 1 in the device, and the number of sampling rays can be one or more. In addition, each pixel on the micro-display device 1 should display When the gray value is high, sub-pixels can be used to replace the calculation process of the entire pixel to increase the resolution of the spatial light field, and the geometric relationship of the spatial beam can also be used to perform the above process using a batch processing method or a GPU parallel computing method. But the core idea of the proposed method of the present invention is not changed.

Using the above method, assign the grayscale value that each pixel should display to the micro-display device 1, that is, the three-dimensional light field of the three-dimensional virtual object to be displayed can be rendered at the exit pupil of the system, and the human eye performs the display at the exit pupil of the system. When observing, what is obtained is no longer the image information of a single display plane, but a dense light field. The control of the light field information by the module through optical rendering can make more than one light beam enter the pupil of the human eye when observing the three-dimensional virtual object to be displayed, which is in line with the characteristics of the normal observation of the human eye, thus solving the convergence and convergence of the human eye Inconsistencies.

Embodiment one:

A real three-dimensional photosensitive field helmet display system, comprising a micro-display device 1, a micro-structure array device 2, an optical eyepiece system 3 and an optical rendering realization module arranged in sequence, and the optical rendering realization module is connected to the micro-display device 1.

The optical eyepiece system 3 in this embodiment is a transmission rotationally symmetric optical system, which is a lens group including multiple coaxial lenses, and the optical eyepiece system 3 is not limited to a transmission rotationally symmetric optical system during actual use.

The light waves emitted by each pixel on the micro-display device 1 are divided into light waves in different directions after passing through the microstructure array device 2 to form a spatial light field, which converges into the human eye after passing through the optical eyepiece system 3 .

Embodiment two

A real three-dimensional photosensitive field helmet display system, including an optical rendering realization module and a micro-display device 1, a micro-structure array device 2, and an optical eyepiece system 3 arranged obliquely above the human eye 7, the optical rendering realization module and the micro-display device 1 connected to the input.

As shown in Figure 7, the optical eyepiece system 3 in this embodiment is an off-axis reflective optical eyepiece system, and the off-axis reflective optical eyepiece system has three surfaces, the first optical surface 301, the second optical surface 302 and the third optical eyepiece system. Surface 303, wherein the third optical surface 303 is coated with a reflective film, the three optical surfaces can be plane, spherical, aspheric, or free-form surface without symmetry, the optical eyepiece is not limited to three surfaces in actual use Off-axis reflective optics. The optical eyepiece system 3 uses an off-axis reflective optical system to simplify the optical eyepiece system on the basis of ensuring the viewing angle and imaging quality.

The light wave emitted by each pixel of the micro-display device 1 passes through the microstructure array device 2 for splitting light, then hits the first optical surface 301 of the optical eyepiece system 3, and then refracts into the optical eyepiece system 3, where total reflection occurs on the second optical surface 302 to the third optical surface 303, reflected back to the second optical surface 302 through the third optical surface 303, and refracted into the human eye.

Embodiment Three

A real three-dimensional photosensitive field helmet display system, including an optical rendering realization module and a micro-display device 1, a micro-structure array device 2, and an optical eyepiece system 3 arranged obliquely above the human eye 7, the optical rendering realization module and the micro-display device 1 connected to the input. As shown in FIG. 8 , it also includes a half-mirror 4 positioned in front of the human eye. The micro-structure array device 2 refracts or filters the light waves emitted by each pixel of the micro-display device 1 to form a spatial light field. The spatial light field enters the human eye after being collimated by the optical eyepiece system 3 and reflected by the half-mirror 4 , and at the same time the real scene is transmitted into the human eye through the half mirror 4, so that the human eye can see the real scene and the virtual three-dimensional object at the same time.

Embodiment four

A real three-dimensional photosensitive field helmet display system, including an optical rendering realization module and a micro-display device 1, a micro-structure array device 2, and an optical eyepiece system 3 arranged obliquely above the human eye 7, the optical rendering realization module and the micro-display device 1 connected to the input.

As shown in Figure 9, the optical eyepiece system 3 in this embodiment is an optical transmission type off-axis reflection optical system, and the optical transmission type off-axis reflection optical system has four surfaces, the first surface 401, the second surface 402, the second surface Three surfaces 403 and a fourth surface 404, wherein the third surface 403 is coated with a semi-transparent and semi-reflective film. The four surfaces can be planar, spherical, aspherical, and free-form surfaces without symmetric properties. However, in actual use, the optical transmission optical eyepiece is not limited to the off-axis reflection optical system with four surfaces. The optical eyepiece system 3 uses an optical transmissive off-axis reflective optical system to simplify the optical eyepiece system on the basis of ensuring the viewing angle and imaging quality.

The light waves emitted by each pixel on the micro-display device 1 pass through the microstructure array device 2 for light splitting, first pass through the refraction of the first surface 401 of the optical eyepiece system 3, and then reach the second surface 402, and then undergo total reflection on the second surface 402 Reach the third surface 403, after being reflected by the third surface 403, return to the second surface 402 and enter the human eye through the refraction of the second surface 402, and at the same time, the three-dimensional objects in the real world of the outside world are transmitted to the human eye through the fourth surface 404 of the optical eyepiece. The third surface 403 then transmits to the second surface 402, and finally enters the human eye 7 after transmission, and the human eye 7 can see the real scene and the virtual three-dimensional object at the same time. The design of the fourth surface 404 is to eliminate the aberration and distortion caused by the third surface 403 and the second surface 402 .

Embodiment five

A real three-dimensional photosensitive field helmet display system, including a micro-display device 1, a micro-structure array device 2, an optical eyepiece system 3 and an optical rendering realization module arranged in sequence, and also includes a relay optical system 5, the optical rendering realization module is connected to the micro Device 1 is displayed. The relay optical system 5 is located between the micro-display device 1 and the micro-structure array device 2, and displays the light beam emitted by the micro-display device 1 as a real image on the surface of the micro-structure array device 2, and the optical rendering realizes that the module is connected to the micro-display device 1, such as Figure 10 shows.

The light waves emitted by each pixel of the micro-display device 1 pass through the relay optical system 5 to form a virtual display plane, as shown by the dotted line in Figure 10, the light waves on the virtual display plane pass through the microstructure array device 2 for beam splitting, Spatial light beams in different directions are formed, collimated by the optical eyepiece 3 and enter human eyes. Due to the existence of the relay optical system 5, the display surface of the micro-display device 1 can be imaged at any position, so that the system design is not limited by the thickness of devices such as protective devices and optical engines in the micro-display device 1, and can be better. The distance g between the light-splitting plane of the microstructure array and the display surface is controlled, thereby improving the resolution of the system.

Embodiment six

A real three-dimensional photosensitive field helmet display system, comprising an optical rendering implementation module and a microdisplay device 1, a microstructure array device 2, and an optical eyepiece system 3 arranged obliquely above human eyes 7, and the optical rendering implementation module is connected to the microdisplay device 1. As shown in Figure 11, the display device in the present embodiment also includes half mirror 4 and relay optical system 5, and relay optical system 5 is positioned between microdisplay device 1 and microarray device 2, half mirror The mirror 4 is located in front of the human eye, and forms a real image of the light beam emitted by the micro-display device 1 on the surface of the micro-structure array 2, and the light waves on the virtual display plane are split by the micro-structure array device 2 to form spatial beams in different directions. After the optical eyepiece system 3 is collimated, it enters the human eye through the reflection of the half-mirror 4, and the real scene enters the human eye through the transmission of the half-mirror 4, so that the human eye can see the real scene and the virtual three-dimensional object at the same time .

Embodiment seven

A real three-dimensional light-sensitive field helmet display system, as shown in Figure 12, includes two sets of light-field helmet display devices, and the spatial light field formed by the two sets of real three-dimensional light-sensitive field helmet display devices continuously expands in the field of view, specifically including the first A microdisplay device 1, a first microstructure array device 2, a first optical eyepiece system 3, a first optical rendering and realization module, a second microdisplay device 1', a second microstructure array device 2', a second The optical eyepiece system 3' and the second optical rendering and realization module. Both the first optical eyepiece system 3 and the second optical eyepiece system 3' in this embodiment are coaxial transmission systems.

The first microstructure array device 2 splits the light waves emitted by each pixel of the first microdisplay device 1 to form a spatial light field, and the spatial light field enters the human eye after being collimated by the first optical eyepiece system 3, while the second The microstructure array device 2' splits the light waves emitted by each pixel of the second microdisplay device 1' to form a spatial light field. The spatial light field enters the human eye after being collimated by the second optical eyepiece system 3'. Two sets of real The spatial light field formed by the three-dimensional photosensitive field helmet display device continuously expands in the viewing angle, thereby enlarging the viewing field angle of the real three-dimensional photosensitive field helmet display device.

Embodiment eight

A real three-dimensional light-sensitive field helmet display system, as shown in FIG. 13 , includes three sets of real three-dimensional light-sensitive field helmet display devices shown in FIG. 1 . The three-dimensional light field of these devices expands continuously on the field of view, which can further expand the angle of view.

Embodiment nine

A real three-dimensional light-sensitive field helmet display system, as shown in Figure 14, includes two sets of light-field helmet display devices, and the three-dimensional light field of the two sets of devices continuously expands on the field of view, specifically including a first micro-display device 1, a first micro-display Structure array device 2, first optical eyepiece system 3, first optical rendering and realization module, second microdisplay device 1', second microstructure array device 2', second optical eyepiece system 3', second Optical rendering and realization module. The first optical eyepiece system 3 and the second optical eyepiece system 3' in this embodiment are optical transmissive off-axis reflective optical systems. The first optical eyepiece system 3 has four surfaces, which are respectively the first surface 1201, the second surface 1202, the third surface 1203 and the fourth surface 1204, and the second optical eyepiece 3' has four surfaces, which are respectively the first surface 1201 ', the second surface 1202', the third surface 1203' and the fourth surface 1204'.

The light waves emitted by each pixel of the first micro-display device 1 are split by the first microstructure array device 2 and then refracted on the first surface 1201 of the first optical eyepiece system 3 to reach the second surface 1202, and then pass through the third surface after total reflection. The surface 1203 reflects back to the second surface 1202, enters the human eye after being refracted by the second surface 1202, and at the same time, the external real world is transmitted to the third surface 1203 through the fourth surface 1204 of the optical eyepiece system 3, and finally transmitted to the second surface The refraction of 1202 enters the human eye.

The light wave emitted by each pixel of the second micro-display device 1' is split by the second microstructure array device 2', then refracted by the first surface 1201' of the second optical eyepiece system 3', and then reaches the second surface 1202'. After being reflected, it is reflected back to the second surface 1202' through the third surface 1203', refracted by the second surface 1202', and then enters the human eye. The third surface 1203', the refraction transmitted to the second surface 1202' finally enters the human eye.

The fourth surfaces 1204 and 1204' are designed to eliminate the aberration and distortion caused by the surface of the optical path displayed by the virtual three-dimensional object. Human eyes can see different three-dimensional light fields formed by two microdisplay devices at the same time, and at the same time, the three-dimensional light field continuously expands on the field of view, expanding the angle of view. In this embodiment, the optical eyepiece system uses an off-axis reflection optical system The optical eyepiece can be simplified on the basis of ensuring the field of view and imaging quality, and at the same time, the human eye can see real scenes and virtual three-dimensional objects at the same time.

Embodiment ten

A real three-dimensional photosensitive field helmet display system, the light field helmet display system includes two sets of light field helmet display devices with overlapping viewing fields, and further includes a half mirror 4, as shown in FIG. 15 .

The first set of light field helmet display device is located obliquely above the human eye 7, the second set of light field helmet display device is located directly in front of the human eye 7, the half-transparent mirror 4 is located directly in front of the human eye 7, and is located at the same time In the transmission light path of the first set of light field helmet display device and the second set of light field helmet display device.

The first optical eyepiece system 3' in the first set of light field head-mounted display device converges the spatial light field of each pixel of the first micro-display device 1' and reflects it to the outlet through the reflective surface of the half-mirror 4. In the pupil; the second optical eyepiece system 3 "in the second set of light field helmet display device "converges the spatial light field of each pixel of the second microdisplay device 1" and then transmits the transmission surface of the half mirror 4 to the within the exit pupil.

Two sets of real three-dimensional photosensitive field helmet display devices are used to form two different spatial light fields entering human eyes, and the viewing angles of the two spatial light fields overlap each other to increase the resolution of the real three-dimensional photosensitive field helmet display device.

Embodiment Eleven

A real three-dimensional photosensitive field helmet display system, as shown in Figure 16, includes two sets of light field helmet display devices, specifically including a first microdisplay device 1, a first microstructure array device 2, a first optical rendering and realization module No. Two microdisplay devices 1', a second microstructure array device 2', a second optical rendering and realization module, and an optical eyepiece system 3, the optical eyepiece system 3 is an off-axis reflective optical eyepiece, and the optical eyepiece system 3 has five surfaces , are respectively the first optical surface 1001, the second optical surface 1002, the third optical surface 1003, the fourth optical surface 1004, and the fifth optical surface 1005, wherein the third optical surface 1003 is coated with a semi-transparent and semi-reflective film, and the fourth The surface of the optical surface 1004 is coated with a reflective film. The first microdisplay device 1, the first microstructure array device 2, the first optical surface 1001, the second optical surface 1002, and the third optical surface 1003 constitute the first set of real three-dimensional photosensitive field helmet display device, and the second microdisplay device 1', the second microstructure array device 2', the second optical surface 1002, the third optical surface 1003, the fourth optical surface 1004, and the fifth optical surface 1005 constitute a second real three-dimensional photosensitive field helmet display device.

The light waves emitted by each pixel on the first microdisplay device 1 pass through the first microstructure array device 2 for light splitting, and then first pass through the refraction of the first optical surface 1001, undergo total reflection on the second optical surface 1002, and then pass through the third optical surface 1002. The surface 1003 reflects, and finally returns to the second optical surface 1002, and enters the human eye through the refraction of the second optical surface 1002. The light waves emitted by each pixel on the second micro-display device 1' pass through the second microstructure array device 2' for light splitting, first pass through the fourth optical surface 1004, refract on the third optical surface 1003, reflect on the third optical surface 1003, and then reach the fifth optical The surface 1005 is then reflected to the third optical surface 1003, transmitted to the second optical surface 1002 through the third optical surface 1003, and then enters the human eye through the refraction of the second optical surface 1002.

To sum up, the above are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (9)

1. A real three-dimensional light field helmet display system, characterized in that: the light field helmet display system includes more than one set of light field helmet display devices, each set of light field helmet display devices includes an optical rendering realization module and sequentially Arranged micro-display devices (1), micro-structure array devices (2) and optical eyepiece systems (3), the optical rendering implementation module is connected to the input end of the micro-display device (1); The microstructure array device (2) refracts or filters light waves emitted by each pixel on the microdisplay device (1) to form a spatial light beam, and at least two pixels in the microdisplay device (1) correspond to a space The light beams have different directions, and the spatial light beams corresponding to all pixels form a spatial light field; The optical eyepiece system (3) in each set of light field helmet display device converges the respective spatial light fields in the exit pupil of the light field helmet display system; The diameter of the largest inscribed circle of the light spot formed by the spatial beam corresponding to each pixel of the micro-display device (1) on the exit pupil plane of the head-mounted display device is not greater than 2mm; When displaying a three-dimensional virtual object, the optical rendering implementation module calculates the relationship between the light and the light to be displayed according to the distribution of the spatial light field, that is, the correspondence between the pixels of the micro-display device (1) and the light in the space light beam. The gray value at the intersection of the surface of the three-dimensional virtual object, then the gray value at the intersection is the gray value of the pixel on the micro-display device (1) corresponding to the light; the optical rendering implementation module converts the gray value of each pixel The intensity value is sent to the micro-display device (1), and the micro-display device (1) displays according to the received gray value; the F number of the optical eyepiece system (3) is F#, which satisfies the relationship: 0.5F#≤g/p ≤2F#; Wherein, g is the distance between the light splitting plane of the microstructure array device (2) and the display plane of the microdisplay device (1); The exit pupil diameter D of the optical eyepiece system (3) satisfies 4mm≤D≤25mm; the exit pupil distance L of the optical eyepiece system (3) satisfies the relationship 12mm≤L≤45mm; The characteristic size p of the microstructure of the microstructure array device (2) is not less than 2 pixels on the microdisplay device (1), wherein the characteristic size p refers to two adjacent arrays of the microstructure array device (2). The center distance of the unit. 2. The light field helmet display system according to claim 1, wherein the optical eyepiece system (3) adopts an off-axis optical eyepiece system, and the off-axis optical eyepiece system has three optical surfaces, the first optical A surface (301), a second optical surface (302) and a third optical surface (303), wherein the third optical surface (303) is coated with a reflective film; The light wave emitted by each pixel on the micro-display device (1) is refracted or filtered by the micro-structure array device (2), and then hits the first optical surface (301) of the optical eyepiece system (3), and enters the optical eyepiece system through refraction (3), total reflection occurs on the second optical surface (302) to the third optical surface (303), reflected back to the second optical surface (302) through the third optical surface (303), and then through the second optical surface (302) refracts into the human eye (7). 3. The light field helmet display system according to claim 1, characterized in that: the optical eyepiece system (3) adopts an optical transmissive off-axis reflective optical system, and the optical transmissive off-axis reflective optical system includes four optical Surface: the first surface (401), the second surface (402), the third surface (403) and the fourth surface (404), wherein the third surface (403) is coated with a semi-transparent and semi-reflective film; The light waves emitted by each pixel on the micro-display device (1) are refracted or filtered by the micro-structure array device (2), firstly refracted by the first surface (401) of the optical eyepiece system (3), and then reach the second surface (402) ), arrive at the third surface (403) after being totally reflected on the second surface (402), return to the second surface (402) after being reflected by the third surface (403), enter into the The human eye (7), meanwhile, the three-dimensional objects in the external real world pass through the fourth surface (404), the third surface (403) and the second surface (402) successively, and finally enter the human eye after being transmitted. 4. The light field head-mounted display system as claimed in claim 1, characterized in that: it also includes a half-mirror (4), the micro-display device (1), the micro-structure array device (2) and the micro-display device (2) arranged in sequence The optical eyepiece system (3) is placed obliquely above the human eye (7), and the half mirror (4) is placed in front of the human eye (7) and in the transmission light path of the optical eyepiece system (3) ; The semi-reflective and semi-transparent surface of the half-transparent and half-mirror (4) receives the space light field transmitted by the optical eyepiece system (3), and it is reflected into the human eye (7). The real scene is projected to the human eye (7). 5. The light field helmet display system as claimed in claim 1, characterized in that: the light field helmet display system further comprises a relay optical system (5), and the relay optical system (5) is located at the micro display device (1 ) and the microstructure array device (2), the light beam emitted by the microdisplay device (1) is formed into a real image on the surface of the microstructure array device (2). 6. The light field helmet display system according to claim 1, characterized in that: the light field helmet display system comprises more than two sets of light field helmet display devices with continuous field of view, and the more than two sets of light field helmet display devices The helmet display devices are distributed in front of the human eyes (7) and are symmetrical with respect to the optical axis. The optical eyepiece systems of multiple sets of light field helmet display devices converge their respective light fields in the exit pupil of the light field helmet display system. 7. The light field helmet display system according to claim 6, characterized in that: the light field helmet display system comprises two sets of light field helmet display devices with continuous field of view, wherein the optical eyepiece system of each set of light field helmet display devices (3) include four surfaces, respectively the first surface (1201), the second surface (1202), the third surface (1203) and the fourth surface (1204); each pixel of the microdisplay device (1) emits After being refracted or filtered by the microstructure array device (2), the light wave reaches the second surface (1202) after being refracted by the first surface (1201), and reaches the third surface (1203) after being totally reflected by the second surface (1202). The third surface (1203) reflects back to the second surface (1202), enters the human eye (7) after being refracted by the second surface (1202), and at the same time, the real scene outside passes through the fourth surface (1204), the third surface (1203) ) and the refraction of the second surface (1202) into the human eye (7). 8. The light field helmet display system as claimed in claim 1, characterized in that: the light field helmet display system includes two sets of light field helmet display devices whose fields of view overlap, and further includes a half-transparent mirror (4): The first light field helmet display device is located obliquely above the human eye (7), the second light field helmet display device is located directly in front of the human eye (7), and the half mirror (4) is located at the human eye ( 7) directly in front of, and simultaneously located in the transmitted light paths of the first set of light field helmet display devices and the second set of light field helmet display devices; The first optical eyepiece system (3') in the first set of light field helmet display device converges the spatial light field of each pixel of the first microdisplay device (1') and is reflected by the half mirror (4) surface reflected into the exit pupil; the second optical eyepiece system (3") in the second set of light field helmet display device converges the spatial light field of each pixel of the second microdisplay device (1") The transmission surface of the half-mirror (4) transmits into the exit pupil. 9. The light field helmet display system according to claim 1, characterized in that: the light field helmet display system comprises two sets of light field helmet display devices, and the two sets of devices share an optical eyepiece system (3), the The optical eyepiece system (3) is an off-axis reflective optical eyepiece system, including five optical surfaces, respectively the first optical surface (1001), the second optical surface (1002), the third optical surface (1003), and the fourth optical surface surface (1004), the fifth optical surface (1005), wherein the third optical surface (1003) is coated with a transflective film, and the fourth optical surface (1004) is coated with a reflective film; the first microdisplay device (1') , the first microstructure array device (2'), the first optical surface (1001), the second optical surface (1002), and the third optical surface (1003) constitute the first light field helmet display device; the second microdisplay device (1"), the second microstructure array device (2"), the second optical surface (1002), the third optical surface (1003), the fourth optical surface (1004) and the fifth optical surface (1005) constitute the second A light field helmet display device; The light waves emitted by each pixel on the first microdisplay device (1') are refracted or filtered by the first microstructure array device (2'), and then firstly refracted by the first optical surface (1001), and then on the second optical surface ( Total reflection occurs on 1002), then reflected by the third optical surface (1003), finally returns to the second optical surface (1002), and enters the human eye (7) through the refraction of the second optical surface (1002); The light waves emitted by each pixel on the second micro-display device (1") are refracted or filtered by the second microstructure array device (2"), and then refracted by the fourth optical surface (1004) to the third optical surface (1003) ), after reflection, it reaches the fifth optical surface (1005), then reflects to the third optical surface (1003), passes through the third optical surface (1003), transmits to the second optical surface (1002), and finally passes through the second optical surface ( 1002) into the human eye (7).