WO2023040662A1

WO2023040662A1 - Picture generation unit, related apparatus, and image projection method

Info

Publication number: WO2023040662A1
Application number: PCT/CN2022/116119
Authority: WO
Inventors: 舒湘平; 方志方; 李和文
Original assignee: 华为技术有限公司
Priority date: 2021-09-17
Filing date: 2022-08-31
Publication date: 2023-03-23
Also published as: CN115826332A

Abstract

A picture generation unit, a related apparatus, and an image projection method, which belong to the technical field of display. The picture generation unit comprises a light source (110), a light beam splitting unit (120), a modulation unit (130), and a projection device (140). The light source (110) is used to provide a light beam (B0). The light beam splitting unit (120) is used to divide the light beam into at least two sub-beams (B1), and separately input the sub-beams into the modulation unit (130). The modulation unit (130) is used to separately perform light modulation on the at least two sub-beams (B1) according to picture data, and output at least two paths of imaging light (B2). The projection device (140) is used to project the at least two paths of imaging light (B2). The projection of the at least two paths of imaging light is realized by means of one light source, so that the amount of space occupied by the picture generation unit is reduced, and mounting is facilitated.

Description

Image generating device, related equipment, and image projection method

This application claims priority to a Chinese patent application with application number 202111093756.1 and titled "Image generating device, related equipment, and image projection method" filed with the State Intellectual Property Office of China on September 17, 2021, the entire contents of which are incorporated by reference incorporated in this application.

technical field

The present application relates to the field of display technology, and in particular to an image generating device, a display device, a vehicle, and an image projection method.

Background technique

With the development of display technologies, display devices are more and more widely used, such as projectors, head-up display devices (head-up device, HUD) and so on. The display device projects light carrying image information (hereinafter referred to as imaging light) onto an imaging device (such as a screen) through a picture generation unit (PGU), and uses the imaging device to form an image for users to watch.

In related technologies, a PGU includes a light source and a modulation unit. Wherein, the light source is used to provide a light beam, and the modulating unit is used to light modulate the light beam according to the data of an image to obtain a path of imaging light, and project the path of imaging light onto the imaging device to form an image.

If you need to project multiple images at the same time, you need to use multiple PGUs, which take up a lot of space and are cumbersome to install.

Contents of the invention

The present application provides a PGU, a display device, a vehicle and an image projection method, which can provide at least two images through one PGU.

On the one hand, the present application provides a PGU, also known as an optical machine. The PGU includes a light source, a light splitting unit, a modulation unit and a projection device. The light source is used to provide a light beam. The light splitting unit is used for splitting the light beam into at least two sub-beams and inputting them into the modulation unit respectively. The modulating unit is used to respectively perform light modulation on the at least two sub-beams according to the image data, and output at least two paths of imaging light. The projection device (may be referred to as a projection device) is used for projecting the at least two paths of imaging light.

A light beam provided by the light source is divided into at least two sub-beams by the light splitting unit, and the at least two sub-beams are respectively optically modulated according to the image data by the modulation unit to obtain at least two imaging lights, and project the at least two imaging lights Go out to form at least two images. The formation of at least two images can be realized by using one light source and the data of at least two images, which reduces the space occupied by the image generating device and facilitates installation.

In the embodiment of the present application, the quantity of imaging light output by the modulation unit is equal to the quantity of images. In some examples, the number of sub-beams output by the light splitting unit is greater than the number of images. In some other examples, the number of sub-beams output by the light splitting unit is equal to the number of images.

In some examples, the light splitting unit implements light splitting based on the polarization state of the light, which is beneficial to simplify the design of the optical path, and is beneficial to reduce the structural complexity of the image generating device and improve space utilization. For example, the light beam provided by the light source is circularly polarized light or elliptically polarized light, one of the at least two sub-beams is the first linearly polarized light, and the other of the at least two sub-beams is the second linearly polarized light. polarized light. Wherein, the polarization direction of the first linearly polarized light is perpendicular to the polarization direction of the second linearly polarized light.

Exemplarily, the light splitting unit includes: a first polarization beam splitter. The first polarizing beam splitter is used to divide the circularly polarized light or elliptically polarized light provided by the light source into the first linearly polarized light and the second linearly polarized light, and split the first linearly polarized light and the second linearly polarized light respectively directed to the modulation unit. The light splitting unit includes a component of the first polarization beam splitter, and the number of components contained in the PGU is small, so that the structure of the PGU is simple and the cost is low.

Exemplarily, the light splitting unit includes: a first polarization beam splitter and an optical guiding structure. The first polarized beam splitter is used to divide the circularly polarized light or elliptically polarized light provided by the light source into the first linearly polarized light and the second linearly polarized light, and guide the first linearly polarized light to the modulation unit an optical guiding structure is located on the optical path between the first polarization beam splitter and the modulation unit, and is used to guide the second linearly polarized light to the modulation unit.

In a possible implementation manner, the optical guiding structure includes: a second polarization beam splitter, and the second polarization beam splitter is configured to guide the second linearly polarized light to the modulation unit. In this embodiment, the number of devices contained in the optical guiding structure is small, which further simplifies the structure of the image generating device.

In some examples, the modulation unit outputs corresponding imaging light through the first polarization beam splitter and the second polarization beam splitter, so as to control the output direction of the imaging light.

In another possible implementation manner, the optical guiding structure includes: an optical rotator and a second polarizing beam splitter, and the optical rotator is located between the first polarizing beam splitter and the second polarizing beam splitter. On the road, it is used to rotate the polarization direction of the incident second linearly polarized light to set an angle to obtain a third linearly polarized light, and guide the third linearly polarized light to the second polarization beam splitter; the second polarization beam splitter The device is used to guide the third linearly polarized light to the modulation unit.

In yet another possible implementation manner, the optical guiding structure includes: an optical rotator and a second polarizing beam splitter, and the second polarizing beam splitter is located between the first polarizing beam splitter and the optical rotator. On the road, it is used to guide the second linearly polarized light to the optical rotator; the optical rotator is used to rotate the polarization direction of the second linearly polarized light to set an angle to obtain the third linearly polarized light, and guide the third linearly polarized light to The second polarization beam splitter; the second polarization beam splitter is also used to guide the third linearly polarized light to the modulation unit.

Through the cooperation of the optical rotator and the second polarization beam splitter, the polarization direction and/or propagation direction of the second linearly polarized light can be changed, so that the arrangement of the modulation unit is more flexible.

Exemplarily, the first polarizing beam splitter and the second polarizing beam splitter are integrated structures, for example, two beam-splitting surfaces are arranged in a polarization beam-splitting prism, one beam-splitting surface is used for light splitting, and the other beam-splitting surface is used for guiding, so as to further reduce the Difficulty of PGU assembly.

In some examples, the beam splitting plane of the second polarizing beam splitter is parallel to the beam splitting plane of the first polarizing beam splitter.

In some other examples, the light-splitting plane of the second polarizing beam splitter and the light-splitting plane of the first polarizing beam splitter form an included angle, such as being perpendicular.

Optionally, the optical rotator includes at least one of the following devices: a Faraday rotation mirror and a wave plate.

In some examples, the propagation direction of the polarized light output by the light splitting unit to the modulation unit is the same, and the modulation unit includes a spatial light modulator, and the spatial light modulator has at least two modulation regions, and the at least two modulation regions and are respectively used for optical modulation of the at least two sub-beams to obtain the at least two paths of imaging light.

In some other examples, the modulation unit includes at least two spatial light modulators, and the at least two spatial light modulators are respectively used to light-modulate the at least two sub-beams to obtain the at least two paths of imaging light . Optionally, the spatial light modulators included in the modulation unit are of the same type, or there are at least two spatial light modulators of different types in the spatial light modulators included in the modulation unit.

In some examples, when the optical guiding structure includes: a second polarization beam splitter for guiding the second linearly polarized light to the modulation unit, the modulation unit includes the first spatial light modulator and a second spatial light modulator. The first spatial light modulator is located on one side of the first polarization beam splitter and is located in the propagation direction of the first linearly polarized light; the second spatial light modulator is located on the second polarization beam splitter one side, and is located in the propagation direction of the third linearly polarized light. Wherein, the first spatial light modulator and the second spatial light modulator are of the same type, for example, both are liquid crystal on silicon modulators, so The first spatial light modulator outputs the corresponding imaging light through the first polarization beam splitter, and the second spatial light modulator outputs the corresponding imaging light through the second polarization beam splitter.

In another aspect, the present application provides a display device. The display device includes a main processor and an image generating device, the image generating device is any one of the aforementioned image generating devices, and the main processor is configured to send image data to the modulation unit.

In some examples, the display device also includes a power supply for powering the main processor and the PGU.

Optionally, the display device further includes a reflective device, configured to reflectively image the at least two paths of imaging light projected by the image generating device, so as to form at least two images.

In some examples, the display device is a projector and the reflective device is a light screen. In other examples, the display device is augmented reality (augmented reality, AR) glasses.

In yet another aspect, the present application provides a display device. The display device is a head-up display device. The display device includes any one of the aforementioned image generating devices, and the image generating device is configured to project the at least two paths of imaging light onto the windshield to form at least two images.

In yet another aspect, the present application provides a vehicle, which includes any one of the aforementioned display devices. Exemplarily, vehicles include but are not limited to automobiles, airplanes, trains, or ships.

In yet another aspect, the present application provides an image projection method. The method includes: acquiring image data; respectively performing light modulation on at least two sub-beams according to the image data to obtain at least two imaging lights; and projecting the at least two imaging lights. Wherein, the at least two sub-beams are obtained by splitting a beam provided by the light source.

In some examples, the corresponding sub-beams are optically modulated by at least two spatial light modulators, each spatial light modulator being used to optically modulate a corresponding one of the sub-beams. Then, according to the image data, performing optical modulation on at least two sub-beams respectively to obtain at least two paths of imaging light includes: performing optical modulation on the corresponding sub-beams through at least two spatial light modulators according to the image data Light modulation, where the number of spatial light modulators is equal to the number of images corresponding to the image data.

In some other examples, a spatial light modulator is used to perform light modulation on the corresponding sub-beam, and the spatial light modulator has at least two modulation regions, and each modulation region is used to perform light modulation on a corresponding one of the sub-beams. Then, according to the image data, performing light modulation on at least two sub-beams respectively to obtain at least two paths of imaging light includes: according to the image data, passing through at least two modulation regions of a spatial light modulator to correspond to the The sub-beams are light-modulated, and the number of modulation regions used for light modulation is equal to the number of images corresponding to the image data.

In the technical solution provided in any of the above aspects, the spatial light modulator is a reflective spatial light modulator and has the function of changing the polarization direction of the incident linearly polarized light, such as a liquid crystal on silicon (liquid crystal on silicon, LCoS) modulator.

In other examples, the spatial light modulator is a reflective spatial light modulator and does not have the function of changing the polarization direction of incident linearly polarized light, such as a micro-electro-mechanical system (micro-electro-mechanical system, MEMS ) or digital micromirror device (digital micromirror device, DMD).

In still some examples, the spatial light modulator is a transmissive spatial light modulator, such as a liquid crystal display (Liquid Crystal Display, LCD). Compared with the transmissive spatial light modulator, the reflective spatial light modulator has higher light utilization efficiency, which is beneficial to energy saving.

Description of drawings

FIG. 1 is a schematic diagram of a use state of a display device provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of another display device in use according to an embodiment of the present application;

FIG. 3 is a schematic structural diagram of an image generating device provided in an embodiment of the present application;

FIG. 4 is a schematic structural diagram of another image generation device provided by an embodiment of the present application;

Fig. 5 is a schematic structural diagram of another image generation device provided by an embodiment of the present application;

FIG. 6 is a schematic structural diagram of another image generation device provided by an embodiment of the present application;

FIG. 7 is a schematic structural diagram of another image generation device provided by an embodiment of the present application;

Fig. 8 is a schematic structural diagram of another image generation device provided by an embodiment of the present application;

FIG. 9 is a schematic structural diagram of another image generation device provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of another image generation device provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of the three-dimensional structure of the first polarizing beam splitter and the second polarizing beam splitter in FIG. 10;

Fig. 12 is a schematic structural diagram of a light source provided by an embodiment of the present application;

Fig. 13 is a schematic structural diagram of a HUD provided by an embodiment of the present application;

FIG. 14 is a schematic flowchart of an image projection method provided by an embodiment of the present application;

FIG. 15 is a schematic circuit diagram of a display device provided by an embodiment of the present application;

Fig. 16 is a schematic diagram of a functional framework of a vehicle provided by an embodiment of the present application.

Detailed ways

The image generating apparatus, display device, and vehicles provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings. The image generating device provided in this embodiment can project at least two paths of imaging light outward, thereby providing at least two images. The image generation device can be used alone, or can be integrated in a display device as a component, and the display device includes but is not limited to a projector, a head-up display device, and a car light with a display function. As shown in FIG. 1 , the image generating device is integrated in a projector 100a, and the projector 100a projects an image onto a wall or a projection screen. As shown in FIG. 2 , the image generation device is integrated in the head-up display device HUD100b, and the head-up display device 100b projects images onto the windshield 2 to form images S1 and S2.

Fig. 3 is a schematic structural diagram of an image generating device provided by an embodiment of the present application. As shown in FIG. 3 , the image generation device includes: a light source 110 , a light splitting unit 120 , a modulation unit 130 and a projection device 140 . The light source 110 is used for providing a light beam B0. The beam splitting unit 120 is used for splitting the light beam B0 into at least two sub-beams B1 and inputting them into the modulation unit 130 respectively. The modulating unit 130 is configured to respectively perform light modulation on at least two sub-beams B1 according to image data, and output at least two paths of imaging light B2. The projection device 140 is used for projecting the at least two paths of imaging light B2.

In the embodiment of the present application, the modulation unit performs optical modulation on each sub-beam according to the image data, which means that the modulation unit controls the modulation unit to perform optical modulation on each sub-beam based on different image sources. Different image sources correspond to different image data. For example, the modulation unit controls the modulation unit to perform optical modulation on one sub-beam based on one image source, and controls the modulation unit to perform optical modulation on another sub-beam based on another image source.

In the embodiment of the present application, imaging light refers to light carrying image information and used to form an image.

In some examples, projecting imaging light refers to directly projecting imaging light onto an imaging device to form a corresponding image (real image) on the surface of the imaging device, or to form a corresponding image (virtual image) on an image surface outside the imaging device. ). In some other examples, projecting imaging light refers to projecting imaging light onto one or more optical devices, and projecting onto the imaging device via the one or more optical devices to form a corresponding image on the surface of the imaging device, or , forming a corresponding image on the image plane outside the imaging device.

In the embodiment of the present application, a light beam provided by a light source is divided into at least two sub-beams by a light splitting unit, and the at least two sub-beams are optically modulated by a modulation unit according to image data to obtain at least two paths of imaging light, and the projection device is used to light-modulate the at least two sub-beams At least two paths of imaging light are projected to form at least two images. One light source can be used to form at least two images, which reduces the space occupied by the image generating device and facilitates installation.

In the embodiment of the present application, the number of paths of imaging light output by the modulation unit 130 is equal to the number of images corresponding to the acquired data. For example, if the modulation unit 130 acquires data corresponding to two images, the number of imaging lights output by the modulation unit 130 is two. In some examples, the maximum number of sub-beams that can be processed by the modulating unit 130 is greater than the number of acquired sub-beams, and the number of sub-beams output by the spectroscopic unit 120 is greater than the number of images corresponding to the data acquired by the modulating unit 130 . That is, the modulating unit 130 may only perform optical modulation on a part of the sub-beams output by the spectroscopic unit 120 . In other examples, the maximum number of sub-beams that can be processed by the modulation unit 130 is equal to the number of acquired sub-beams, and the number of sub-beams output by the spectroscopic unit 120 is equal to the number of images corresponding to the data acquired by the modulation unit 130. That is, the modulating unit 130 can perform optical modulation on all sub-beams output by the spectroscopic unit 120 .

Hereinafter, the embodiment of the present application will be described in detail by taking the beam splitting unit to split the light beam into two sub-beams as an example.

In some examples, the light splitting unit splits the light beam provided by the light source into two sub-beams based on the polarization state of the light. For example, the light beam provided by the light source is circularly polarized light or elliptically polarized light. One of the two sub-beams obtained after the light beam passes through the light splitting unit is the first linearly polarized light, and the other is the second linearly polarized light. Wherein, the polarization direction of the first linearly polarized light is different from that of the second linearly polarized light. For example, the polarization direction of the first linearly polarized light is perpendicular to the polarization direction of the second linearly polarized light.

Fig. 4 is a schematic structural diagram of an image generating device provided by an embodiment of the present application. As shown in FIG. 4 , the image generating device includes: a light source 110 , a light splitting unit 220 , a modulation unit 230 and a projection device 240 . The light source 110 is used for providing a light beam B0. The beam splitting unit 220 is used for splitting the beam B0 into two sub-beams B1. The modulation unit 230 is configured to respectively perform light modulation on the two sub-beams B1 according to the data of the two images, and output two paths of imaging light B2. The projection device 240 is used to project the two paths of imaging light B2 to form two images.

Wherein, the light beam B0 may be circularly polarized light or elliptically polarized light, and the two sub-beams B1 may be linearly polarized light.

The light splitting unit 220 includes a first polarizing beam splitter 221 and an optical guiding structure (the second polarizing beam splitter 222 in FIG. 4 ). The first polarized beam splitter 221 is used to split the circularly polarized light or elliptically polarized light from the light source 110 into first linearly polarized light and second linearly polarized light, and guide the first linearly polarized light to the modulation unit 230 . The optical guiding structure is located on the optical path between the first polarization beam splitter 221 and the modulation unit 230 , and is used to guide the second linearly polarized light to the modulation unit 230 .

Exemplarily, the first polarizing beam splitter 221 can reflect the first linearly polarized light B1 in the received beam B0 and transmit the second linearly polarized light in the beam B0, thereby splitting the beam B0 into two sub-beams B1, one The sub-beam B1 is the first linearly polarized light, and the other sub-beam B1 is the second linearly polarized light. Wherein, the polarization direction of the first linearly polarized light is perpendicular to the polarization direction of the second linearly polarized light. The first linearly polarized light is S light, and the second linearly polarized light is P light.

As shown in Figure 4, the beam splitting surface of the first polarizing beam splitter 221 forms an included angle of 45° with the propagation direction of the beam B0, the propagation direction of the first linearly polarized light forms an included angle of 90° with the propagation direction of the beam B0, and the second linearly polarized light The direction of propagation of the light is the same as that of the beam B0.

The optical guiding structure includes a second polarizing beam splitter 222 . The second polarization beam splitter 222 is used to guide the second linearly polarized light to the modulation unit 230 . The second polarization beam splitter 222 can transmit the second linearly polarized light, so as to guide the second linearly polarized light to the modulation unit 230 .

As shown in Figure 4, the beam splitting surface of the second polarizing beam splitter 222 is parallel to the beam splitting plane of the first polarizing beam splitter 221, and forms an included angle of 45 degrees with the propagation direction of the second linearly polarized light, so that the second linearly polarized light can directly pass through The second polarization beam splitter 221 reaches the modulation unit 230 without changing the propagation direction.

Exemplarily, the first polarization beam splitter 221 is a polarization beam splitter prism, and the second polarization beam splitter 222 is a polarization beam splitter prism.

In the embodiment of the present application, the polarization beam splitter prism includes two right-angle prisms and a dielectric layer, the slopes of the two right-angle prisms face each other, and the dielectric layer is interposed between the right-angle prisms.

Exemplarily, the modulation unit 230 includes two spatial light modulators, namely a first spatial light modulator 231 and a second spatial light modulator 232 . The first spatial light modulator 231 is located on one side of the first polarization beam splitter 221 and is located in the propagation direction of the first linearly polarized light. The first spatial light modulator 231 is configured to perform light modulation on the first linearly polarized light according to the data of one image to obtain one path of imaging light B2.

The second spatial light modulator 232 is located on one side of the second polarization beam splitter 222, and is located in the propagation direction of the outgoing light after the second linearly polarized light passes through the second spatial light modulator 222. The second spatial light modulator 232 is used to The data of another image modulates the outgoing light of the second linearly polarized light after passing through the second spatial light modulator 222 to obtain another path of imaging light B2.

Exemplarily, the projection device 240 includes lenses, such as two lenses 241 , and the two lenses 241 are used to project one imaging light B2 respectively.

In the example shown in FIG. 4 , the spatial light modulator is a reflective spatial light modulator, and can change the polarization direction of incident light. That is, the polarization directions of the incident light and the outgoing light of the spatial light modulator are different, for example, they form an included angle of 90°. In this way, the first linearly polarized light (S light) propagates in the opposite direction after passing through the first spatial light modulator 231 and the polarization direction is rotated by 90 degrees, and the obtained imaging light B2 is opposite to the propagation direction of the first linearly polarized light, and is P light . The imaging light B2 passes through the first polarization beam splitter 221 and then exits. The second linearly polarized light (P light) propagates backwards through the second spatial light modulator 232 and rotates its polarization direction by 90 degrees, and the obtained imaging light B2 has an opposite propagation direction to the second linearly polarized light, and is S light. The imaging light B2 is reflected by the beam splitting surface of the second polarization beam splitter 222 and then emitted. In this embodiment, the first polarizing beam splitter 221 and the second polarizing beam splitter 222 may be transmissive P-reflective S beam splitters, that is, transmit P light and reflect S light.

As shown in FIG. 4 , the propagation directions of the two paths of imaging light B2 are the same, so as to facilitate imaging in the same direction.

Exemplarily, the reflective spatial light modulator is a liquid crystal on silicon (LCoS) modulator. In some examples, a liquid crystal on silicon modulator may include an array substrate, a cover glass, and a liquid crystal disposed therebetween. The array substrate includes a control circuit array layer and a reflective layer. The control circuit array layer is used to control the deflection of the liquid crystal to change the polarization direction of the received linearly polarized light, and the reflective layer can reflect the received linearly polarized light to change the propagation direction of the linearly polarized light.

In this embodiment, the projection of dual images can be realized through two polarization beam splitters and two spatial light modulators, and the components used are few, the cost is low, the structure is simple and easy to assemble.

FIG. 5 is a schematic structural diagram of another image generation device provided by an embodiment of the present application. The difference between the image generating device shown in Fig. 5 and the image generating device shown in Fig. 4 lies in the structure of the modulation unit.

As shown in FIG. 5 , the modulation unit 230 includes two spatial light modulators and two optical rotators. The two spatial light modulators are respectively the first spatial light modulator 231 and the second spatial light modulator 232 , and the two optical rotators are respectively the first optical rotator 233 and the second optical rotator 234 .

The first optical rotator 233 is located on the optical path between the first polarizing beam splitter 221 and the first spatial light modulator 231, and is used to rotate the polarization direction of the first linearly polarized light by 45 degrees and guide it to the first spatial light modulator 231, And the polarization direction of the linearly polarized light from the first spatial light modulator 231 is rotated again by 45 degrees, and then directed to the first polarization beam splitter 221 . That is, the polarization direction of the polarized light output by the first polarization beam splitter 221 to the first spatial light modulator 231 and the polarization direction of the polarized light received by the first polarization beam splitter 221 from the first spatial light modulator 231 are relatively rotated 90 degrees, the S light becomes P light, and then the P light is transmitted from the first polarization beam splitter 221.

The second optical rotator 234 is located on the optical path between the second polarization beam splitter 222 and the second spatial light modulator 233, and is used to guide the polarization direction of the polarized light from the second polarization beam splitter 222 to the second space after rotating 45 degrees. light modulator 232 , and the polarization direction of the polarized light from the second spatial light modulator 232 is rotated again by 45 degrees, and then guided to the second polarization beam splitter 222 . That is, the polarization direction of the polarized light output by the second polarization beam splitter 222 to the second spatial light modulator 232 and the polarization direction of the polarized light received by the second polarization beam splitter 222 from the second spatial light modulator 232 are relatively rotated 90 degrees, the P light becomes S light, and then the S light is reflected by the second polarization beam splitter 222 . In this embodiment, the first polarizing beam splitter 221 and the second polarizing beam splitter 222 may be transmissive P-reflective S beam splitters, that is, transmit P light and reflect S light.

Exemplarily, the optical rotator includes a wave plate and/or a Faraday rotation mirror, etc., as long as the above-mentioned change of the polarization direction can be realized. When the optical rotator includes a wave plate, the wave plate is a 1/2 wave plate or a 1/4 wave plate.

In this example, the spatial light modulator is a reflective spatial light modulator, and does not change the polarization direction of the outgoing light. That is, the polarization directions of the incident light and the outgoing light of the spatial light modulator are the same. For example, the reflective spatial light modulator is MEMS or DMD.

In this example, through the cooperation of the optical rotator and the second polarization beam splitter, the polarization direction and/or propagation direction of the second linearly polarized light can be changed, so that the arrangement of the modulation unit is more flexible. In addition, in this embodiment, the cooperation of the reflective spatial light modulator that does not change the polarization direction of the outgoing light and the optical rotator is used to realize the design of the optical path. Compared with the use of LCoS, the utilization efficiency of light can be improved.

FIG. 6 is a schematic structural diagram of another image generation device provided by an embodiment of the present application. The difference between the image generating device shown in FIG. 6 and the image generating device shown in FIG. 4 lies in the structure of the modulation unit. As shown in FIG. 6 , the modulation unit 230 includes two spatial light modulators, and the spatial light modulators are transmission-type spatial light modulators. For example, LCD monitors.

The two spatial light modulators are respectively a first spatial light modulator 231 and a second spatial light modulator 232 . The first spatial light modulator 231 is located in the propagation direction of the first linearly polarized light (sub-beam B1 of S light), and is used to optically modulate the first linearly polarized light to obtain one path of imaging light B2, and image the path The light B2 is transmitted, and the propagation direction of the imaging light B2 is the same as that of the first linearly polarized light. The second spatial light modulator 232 is located in the propagation direction of the outgoing light of the second linearly polarized light (sub-beam B1 of P light) passing through the second polarizing beam splitter 222, and is used for light modulation of the outgoing light to obtain another path imaging light B2, and transmit the other path of imaging light B2, and the propagation direction of the other path of imaging light B2 is the same as that of the outgoing light after the second linearly polarized light passes through the second polarizing beam splitter 222.

As shown in FIG. 6 , the propagation directions of the two paths of imaging light B2 are vertical. In this way, two images can be formed in different directions. Optionally, if two paths of imaging light need to be imaged in the same direction, at least one optical device can also be used to change the propagation direction of one or two paths of imaging light, for example, increase reflection in the propagation direction of one or two paths of imaging light B2 mirror.

It should be noted that, in the example shown in FIG. 6 , the second polarization beam splitter 222 may be removed, and the second linearly polarized light directly enters the second spatial light modulator 232 . That is, the light splitting unit includes the first polarizing beam splitter 221 but does not include an optical guiding structure. The first polarized beam splitter 221 is used to divide the circularly polarized light or elliptically polarized light provided by the light source 110 into first linearly polarized light and second linearly polarized light, and guide the first linearly polarized light and the second linearly polarized light to the modulation unit respectively 230.

In this example, the PGU can project two imaging lights in different directions to suit different application scenarios.

FIG. 7 is a schematic structural diagram of another image generation device provided by an embodiment of the present application. The difference between the image generating device shown in FIG. 7 and the image generating device shown in FIG. 4 lies in the different structures of the light splitting unit and the modulating unit.

As shown in FIG. 7 , the light splitting unit 220 includes a first polarization beam splitter 221 and an optical guiding structure (optical rotator 223 and second polarization beam splitter 222 in FIG. 7 ). The first polarized beam splitter 221 is used to split the circularly polarized light or elliptically polarized light from the light source 110 into first linearly polarized light and second linearly polarized light, and guide the first linearly polarized light to the modulation unit 230 .

The optical guiding structure is located on the optical path between the first polarization beam splitter 221 and the modulation unit 230, and is used to guide the second linearly polarized light from the first polarization beam splitter 221 to the modulation unit 230; wherein, the polarization direction of the first linearly polarized light perpendicular to the polarization direction of the second linearly polarized light.

In the embodiment shown in FIG. 7, the optical guiding structure includes: an optical rotator 223 and a second polarizing beam splitter 222, and the optical rotator 223 is located on the optical path between the first polarizing beam splitter 221 and the second polarizing beam splitter 222, for The polarization direction of the second linearly polarized light from the first polarized beam splitter 221 is rotated by a set angle to obtain a third linearly polarized light, and the third linearly polarized light is guided to the second polarized beam splitter 222 . The second polarization beam splitter 222 is used to guide the third linearly polarized light from the optical rotator 223 to the modulation unit 230 . In the example shown in FIG. 7, the set angle is 90 degrees. In this way, when the second linearly polarized light is P light, the third linearly polarized light is S light. Therefore, the third linearly polarized light is reflected by the splitting surface of the second polarization beam splitter 222 to be guided to the modulation unit 230 .

Exemplarily, the optical rotator 223 includes, but is not limited to, a wave plate, a Faraday rotation mirror, and the like. For example, the rotator 223 is a 1/2 wave plate.

The modulation unit 230 may include two spatial light modulators, and the two spatial light modulators are respectively used to light modulate the two sub-beams to obtain two paths of imaging light. The two spatial light modulators are respectively a first spatial light modulator 231 and a second spatial light modulator 232 . The first spatial light modulator 231 is located on one side of the first polarization beam splitter 221 and is located in the propagation direction of the first linearly polarized light. The second spatial light modulator 232 is located on one side of the second polarization beam splitter 222 and is located in the propagation direction of the third linearly polarized light.

As shown in Figure 7, the beam splitting plane of the first polarizing beam splitter 221 is parallel to the beam splitting plane of the second polarizing beam splitter 222, so the propagation directions of the first linearly polarized light and the third linearly polarized light are the same, and the first spatial light modulator 231 It is located on the same side of the light splitting unit 220 as the second spatial light modulator 232 .

Since the two spatial light modulators are located on the same side of the light splitting unit 220, an integrated structure may be used to further simplify the structure of the image generating device. In this case, the modulation unit includes a spatial light modulator, and the spatial light modulator has two modulation areas, and the two modulation areas are respectively used for light modulation of the two sub-beams to obtain two imaging lights.

In this embodiment, the spatial

light modulators

231 and 232 are of the same type as the spatial

light modulators

231 and 232 in FIG. 4 . It should be noted that the type and structure adopted in FIG. 5 or FIG. 6 may also be replaced.

FIG. 8 is a schematic structural diagram of another image generation device provided by an embodiment of the present application. The difference between the image generating device shown in Fig. 8 and the image generating device shown in Fig. 4 lies in the structure of the light splitting unit and the modulating unit.

As shown in FIG. 8 , the light splitting unit 220 includes a first polarization beam splitter 221 and an optical guiding structure (optical rotator 223 and second polarization beam splitter 222 in FIG. 8 ). The first polarized beam splitter 221 is used to split the circularly polarized light or elliptically polarized light from the light source 110 into first linearly polarized light and second linearly polarized light, and guide the first linearly polarized light to the modulation unit 230 . The optical guiding structure is located on the optical path between the first polarization beam splitter 231 and the modulation unit 230 , and is used to guide the second linearly polarized light from the first polarization beam splitter 221 to the modulation unit 230 . Wherein, the polarization direction of the first linearly polarized light is perpendicular to the polarization direction of the second linearly polarized light.

The optical guiding structure includes an optical rotator 223 and a second polarizing beam splitter 222, and the second polarizing beam splitter 222 is located on the optical path between the first polarizing beam splitter 221 and the optical rotator 223, and is used to convert the second polarizing beam splitter 221 from the first polarizing beam splitter The second linearly polarized light is guided to the optical rotator 223; the optical rotator 223 is used to rotate the polarization direction of the second linearly polarized light from the second polarized beam splitter 222 to set an angle, obtain the third linearly polarized light, and guide the third linearly polarized light to the second polarized light The beam splitter 222 ; the second polarization beam splitter 222 is also used to guide the third linearly polarized light from the optical rotator 223 to the modulation unit 230 .

In this embodiment, the first linearly polarized light emitted by the first polarizing beam splitter 221 is S light, and the second linearly polarized light is P light.

Exemplarily, the optical rotator 223 can reversely propagate the incident light and change the polarization direction of the incident light, so that the polarization direction of the outgoing light and the polarization direction of the incident light form an included angle of 90°. Since the linearly polarized light guided by the second polarization beam splitter 222 to the optical rotator 223 is P light, when the polarization direction is rotated by 90°, the P light becomes S light and enters the second polarization beam splitter 222 again, and is subsequently captured by the second polarization beam splitter. The polarization beam splitter 222 is reflected to the modulation unit 230 .

Exemplarily, the beam splitting plane of the first polarizing beam splitter 221 is perpendicular to the beam splitting plane of the second polarizing beam splitter 222 . The propagating direction of the first linearly polarized light is 90 degrees to the propagating direction of the third linearly polarized light, and the propagating direction of the third linearly polarized light is perpendicular to the propagating direction of the second linearly polarized light.

In FIG. 8 , the first polarizing beam splitter 221 and the second polarizing beam splitter 222 are both polarizing beam splitting prisms and integrally structured to further simplify the structure of the device. A right-angle prism of the first polarization beam splitter 221 and a right-angle prism of the second polarization beam splitter 222 are integrated.

In the example shown in FIG. 8 , the first spatial light modulator 231 and the second spatial light modulator 232 are integrated. That is, the first spatial light modulator 231 and the second spatial light modulator 232 are two modulation regions of the same spatial light modulator, and the two modulation regions are respectively used for optical modulation of two sub-beams to obtain two paths of imaging light.

Alternatively, the first polarization beam splitter 221 and the second polarization beam splitter 222 may also adopt a split structure, and the modulation unit in FIG. 8 may also adopt the same structure of the modulation unit in FIG. 7 .

FIG. 9 is a schematic structural diagram of another image generation device provided by an embodiment of the present application. The difference between the image generating device shown in FIG. 9 and the image generating device shown in FIG. 8 lies in the structure of the light splitting unit and the modulating unit.

As shown in FIG. 9 , the light splitting unit 220 includes a first polarizing beam splitter 221 and an optical guiding structure (optical rotator 223 and second polarizing beam splitter 222 in FIG. 9 ). The first polarizing beam splitter 221 is used to split the circularly polarized light or elliptically polarized light from the light source 110 into first linearly polarized light and second linearly polarized light, and guide the first linearly polarized light to the modulation unit. The optical guiding structure is located on the optical path between the first polarization beam splitter 231 and the modulation unit, and is used to guide the second linearly polarized light from the first polarization beam splitter 221 to the modulation unit. Wherein, the polarization direction of the first linearly polarized light is perpendicular to the polarization direction of the second linearly polarized light.

The optical guiding structure includes an optical rotator 223 and a second polarizing beam splitter 222, and the second polarizing beam splitter 222 is located on the optical path between the first polarizing beam splitter 221 and the optical rotator 223, and is used to convert the second polarizing beam splitter 221 from the first polarizing beam splitter The second linearly polarized light is guided to the optical rotator 223; the optical rotator 223 is used to rotate the polarization direction of the second linearly polarized light from the second polarized beam splitter 222 to set an angle, obtain the third linearly polarized light, and guide the third linearly polarized light to the second polarized light Optical splitter 222; the second polarizing optical splitter 222 is also used to guide the third linearly polarized light from the optical rotator 223 to the modulation unit.

In this embodiment, the first linearly polarized light emitted by the first polarizing beam splitter 221 is S light, and the second linearly polarized light is P light. Exemplarily, the optical rotator 223 can reversely propagate the incident light and change the polarization direction of the incident light, so that the polarization direction of the outgoing light and the polarization direction of the incident light form an angle of 90°, and the third linearly polarized light is S light.

The beam-splitting plane of the first polarizing beam splitter 221 is parallel to the beam-splitting plane of the second polarizing beam splitter 222 , so that the propagation directions of the first linearly polarized light and the third linearly polarized light are opposite.

As shown in FIG. 9 , the modulation unit includes a first spatial light modulator 231 and a second spatial light modulator 232 . The first spatial light modulator 231 is a reflective spatial light modulator, and is located in the propagation direction of the first linearly polarized light, and is used for modulating the first linearly polarized light output by the first polarizing beam splitter 221 and changing the first linearly polarized light. The polarization direction and propagation direction of the linearly polarized light are used to output one imaging light B2. The second spatial light modulator 232 is a transmissive spatial light modulator, and is located in the propagation direction of the third linearly polarized light, and is used for modulating the third linearly polarized light, and transmitting the third linearly polarized light to output another path of imaging light B2.

In this example, different types of spatial light modulators are used to provide two paths of imaging light B2 with the same propagation direction.

Fig. 10 is a schematic structural diagram of another image generation device provided by an embodiment of the present application. The difference between the image generating device shown in FIG. 10 and the image generating device shown in FIG. 7 lies in the structure of the light splitting unit and the modulating unit.

As shown in FIG. 10 , the light splitting unit 220 includes a first polarization beam splitter 221 and an optical guiding structure (optical rotator 223 and second polarization beam splitter 222 in FIG. 10 ). The first polarized beam splitter 221 is used to split the circularly polarized light or elliptically polarized light from the light source 110 into first linearly polarized light and second linearly polarized light, and guide the first linearly polarized light to the modulation unit 230 . Wherein, the polarization direction of the first linearly polarized light is perpendicular to the polarization direction of the second linearly polarized light.

The optical guiding structure includes: an optical rotator 223 and a second polarization beam splitter 222 . The optical rotator 223 is located on the optical path between the first polarizing beam splitter 221 and the second polarizing beam splitter 222, and is used to rotate the polarization direction of the second linearly polarized light from the first polarizing beam splitter 221 to a set angle to obtain the third linearly polarized light light, and guide the third linearly polarized light to the second polarizing beam splitter 222. The second polarization beam splitter 222 is used to guide the third linearly polarized light from the optical rotator 223 to the modulation unit 230 .

As shown in FIG. 10 , the propagation direction of the first linearly polarized light is 90 degrees to the propagation direction of the third linearly polarized light, and the propagation direction of the third linearly polarized light is perpendicular to the propagation direction of the second linearly polarized light. For example, the propagating direction of the first linearly polarized light is downward parallel to the plane of the paper, the propagating direction of the second linearly polarized light is parallel to the plane of the paper to the right, and the propagating direction of the third linearly polarized light is perpendicular to the plane of the paper inward.

Exemplarily, there is an included angle between the splitting planes of the first polarized beam splitter 221 and the second polarized beam splitter 222, and the included angle can make the propagation direction of the first linearly polarized light, the second linearly polarized light and the third linearly polarized light satisfy the aforementioned relationship.

FIG. 11 is a schematic perspective view of the three-dimensional structure of the first polarizing beam splitter 221 and the second polarizing beam splitter 222 . 10 and 11, both the first polarizing beam splitter 221 and the second polarizing beam splitter 221 are polarizing beam splitting prisms, and the beam splitting surface 222a of the second polarizing beam splitter 221 rotates 90 degrees clockwise with the propagation direction of the light beam B0 as the center Afterwards, it is parallel to the beam splitting surface 221a of the first polarizing beam splitter 221 .

The modulation unit 230 includes two spatial light modulators, and the two spatial light modulators are respectively used to light modulate the two sub-beams to obtain two paths of imaging light. A spatial light modulator 231 is located on one side of the first polarizing beam splitter 221 and in the propagation direction of the first linearly polarized light, and is used for optically modulating the first linearly polarized light to obtain one imaging light B2. Another spatial light modulator 232 is located on one side of the second polarizing beam splitter 222 and in the propagation direction of the third linearly polarized light, and is used for optically modulating the third linearly polarized light to obtain another path of imaging light B2. The propagation directions of the two paths of imaging light B2 are vertical.

It should be noted that, in this embodiment, the type of the spatial light modulator is the same as that of the spatial light modulator in FIG. 4 . In other embodiments, the type and structure used in FIG. 5 or FIG. 6 can also be replaced.

In the embodiment of the present application, the light source 110 is used to provide white light. Fig. 12 is a schematic structural diagram of a light source provided by the present application. As shown in FIG. 12 , in some examples, the light source 110 includes a plurality of light emitting units 111 , a light combining unit 112 and an output unit 113 . Each light emitting unit 111 is used to emit light of different colors. For example, the light source 110 includes three light emitting units 111, the three light emitting units 111 are respectively a red light emitting unit R for emitting red light, a green light emitting unit G for emitting green light, and a blue light emitting unit for emitting blue light. Unit B. The light combination unit 112 is used to mix the lights of different colors emitted by the plurality of light emitting units 111 to obtain a bunch of white light. The output unit 113 is used to output white light from the light combination unit 1121 .

Exemplarily, each light emitting unit 111 includes at least one light emitting device 111a, and the light emitting device 111a is a semiconductor light emitting device, including but not limited to a light emitting diode (light emitting diode, LED) device or a laser diode (laser diode, LD). Optionally, each light emitting unit 111 further includes a collimating lens 111b for collimating the light emitted by the corresponding light emitting device 111a.

As shown in Figure 12, the green light emitting unit G and the red light emitting unit R are sequentially arranged along the light emitting direction of the blue light emitting unit B, and the light emitting direction of the green light emitting unit G and the light emitting direction of the red light emitting unit R are both in line with the blue light emitting The light output direction of unit B is vertical, that is, the propagation direction of green light and the propagation direction of red light are both perpendicular to the propagation direction of blue light. The light combination unit 112 includes a first dichroic mirror 112a and a second dichroic mirror 112b. The first dichroic mirror 112a is arranged at the intersection of the blue light emitted by the blue light emitting unit B and the green light emitted by the green light emitting unit G, and the first dichroic mirror 112a is connected to the direction of propagation of the blue light and the direction of propagation of the green light. The angle between them is 45°. The first dichroic mirror 112a is used to transmit blue light and reflect green light to guide the mixed light of blue light and green light to the second dichroic mirror 112b. The second dichroic mirror 112b is arranged at the intersection of the red light emitted by the red light emitting unit R and the mixed light of blue light and green light output by the first dichroic mirror 11a, and the second dichroic mirror 112b is connected with the first Dichroic mirror 112a is parallel. The second dichroic mirror 112 b is used to transmit blue light and green light and reflect red light to mix blue light, green light and red light to obtain white light, and guide the white light to the output unit 113 .

The output unit 113 may include one or more lenses, for example, a fly-eye lens, and the fly-eye lens is located on the optical path between the second dichroic mirror 112b and the spectroscopic unit. The fly-eye lens 113a is used to achieve uniform output of white light.

In some other examples, the light source 110 may also directly use a white light-emitting LED device. In this case, there is no need to use a color combining unit. It should be noted that the present application does not limit the structure of the light source, and any white light beam that can provide circularly polarized light or elliptically polarized light can be used.

It should be noted that, in Fig. 4 to Fig. 11 , the light splitting unit is used to divide a light beam provided by the light source into two sub-beams as an example, but when the light splitting unit needs to divide a light beam provided by the light source into more sub-beams, A beam splitter may be used to split the light beam first, and then a polarization beam splitter is used to split the light beam from the beam splitter to finally obtain multiple sub-beams, and each sub-beam is linearly polarized light.

Exemplarily, the beam splitter includes, but is not limited to, a semi-transparent and semi-reflective membrane and the like.

It should also be noted that, in the embodiments shown in FIG. 5 to FIG. 11 , the projection device is omitted, and the position of the projection device is located in the propagation direction of the imaging light B2. In addition, in the examples shown in FIGS. 5 to 11 , the lens 241 corresponding to the imaging light B2 formed by the reflective spatial light modulator has an imaging function; the lens 241 corresponding to the imaging light B2 formed by the transmissive spatial light modulator 241 does not need to have imaging light energy, but only needs to be able to pass through imaging light B2.

The embodiment of the present application also provides a display device, the display device includes a main processor and an image generating device, and the image generating device is any one of the aforementioned image generating devices. The main processor is used to send image data to the image generating device.

Optionally, the display device further includes a reflective device, the image generating device is used to project at least two paths of imaging light on the reflective device, and the reflective device is used to reflectively image the at least two paths of imaging light transmitted by the image generating device, to form at least two images.

Optionally, the display device further includes a power supply for supplying power to the main processor and the PGU.

In some examples, the display device is a projector and the reflective device is a light screen. In other examples, the display device is AR glasses.

The embodiment of the present application also provides a display device, the display device includes an image generating device, and the image generating device is any one of the aforementioned image generating devices. The image generating device is used for projecting at least two paths of imaging light onto the windshield to form at least two images. Exemplarily, the display device is a HUD.

The structure of the HUD will be described in detail below in conjunction with FIG. 13 .

Fig. 13 is a schematic structural diagram of a HUD provided by an embodiment of the present application. As shown in Figure 13, the HUD includes an image generating device 1, which is any of the aforementioned image generating devices, and the image generating device is used to project two paths of imaging light B2 on the windshield 2 to form two images S1 and S2.

Exemplarily, the windshield 2 is a windshield of a vehicle. Means of transportation include but are not limited to cars, planes, trains or ships.

As shown in Figure 11, the type of HUD is augmented reality (augmented reality, AR)-HUD. For the AR-HUD, two images S1 and S2 are imaged at different distances from the windshield 2 . For example, the distance between S1 and the windshield 2 is greater than the distance between S2 and the windshield 2 . In some examples, the image S1 is an augmented reality display image, which is used to display information such as indication information and navigation information of external objects. The indication information of external objects includes, but is not limited to, a safe vehicle distance, surrounding obstacles, and a reversing image. Navigation information includes, but is not limited to, directional arrows, distance, and travel time. The image S2 is a state display image for displaying state information of the vehicle. Taking a car as an example, the status information of the vehicle includes but is not limited to information such as driving speed, mileage, fuel level, water temperature and lamp status.

It should be noted that the imaging light projected by the image generating device can also be formed on the same plane, for example, two images are formed on the windshield 2 .

Optionally, in order to project the imaging light output by the image generating device to a proper position on the windshield, the HUD further includes a spatial light path structure for guiding two paths of imaging light to different positions of the windshield. The spatial light path structure includes one or more of the following optical devices: lenses, plane mirrors, curved mirrors, and the like.

An embodiment of the present application also provides a vehicle, the vehicle being any one of the aforementioned display devices. Means of transportation include but are not limited to cars, planes, trains or ships.

FIG. 14 is a schematic structural diagram of an image projection method provided by an embodiment of the present application. This method can be applied to any of the aforementioned image generating devices. As shown in Figure 14, the method includes:

S1: Get image data.

Exemplarily, the image data includes data of at least two images, and the data of each image can be used as an image source. The image content corresponding to different images may be the same or different. Exemplarily, the image data may be obtained from a control device, for example, from a driving computer (also known as a vehicle-machine system), a mobile terminal, and the like.

S2: According to the image data, perform light modulation on at least two sub-beams respectively to obtain at least two paths of imaging light.

Wherein, the at least two sub-beams are obtained by splitting a beam provided by the light source, for example, by splitting light of any one of the aforementioned splitting units.

In S2, the sub-beams are optically modulated by a spatial light modulator.

In some examples, each spatial light modulator is used to light-modulate a corresponding sub-beam, the number of spatial light modulators used is equal to the number of images corresponding to the acquired data, and the data of each image is used for Control a corresponding spatial light modulator. S2 includes: performing light modulation on corresponding sub-beams through at least two spatial light modulators according to the image data.

In other examples, one spatial light modulator is used to light modulate at least two sub-beams. The spatial light modulator has at least two modulation areas, and each modulation area is used to light-modulate a corresponding sub-beam, and the number of modulation areas used for light modulation is equal to the number of images corresponding to the acquired data, The data of each image is used to control a corresponding modulation area. S2 includes: performing light modulation on the corresponding sub-beams through at least two modulation regions of the spatial light modulator according to the image data.

S3: Projecting at least two paths of imaging light.

Exemplarily, at least two paths of imaging light may be transmitted through a projection lens. Through S3, the at least two paths of imaging light can be projected onto the imaging device, so as to use the imaging device to form an image.

FIG. 15 is a schematic circuit diagram of a display device provided by an embodiment of the present application. As shown in Figure 15, the circuit in the display device mainly includes a host processor (host CPU) 1101, an external memory interface 1102, an internal memory 1103, an audio module 1104, a video module 1105, a power supply module 1106, a wireless communication module 1107, 1 /O interface 1108, video interface 1109, display circuit 1110, modulator 1111, etc. Among them, the main processor 1101 and its surrounding components, such as an external memory interface 1102, an internal memory 1103, an audio module 1104, a video module 1105, a power module 1106, a wireless communication module 1107, an I/O interface 1108, a video interface 1109, and a display circuit 1110 can be connected by bus. The main processor 1101 may be called a front-end processor.

In addition, the circuit diagrams shown in the embodiments of the present application do not constitute specific limitations on the display device. In some other embodiments of the present application, the display device may include more or fewer components than shown in the illustration, or some components may be combined, or some components may be separated, or different component arrangements may be made. The illustrated components can be realized in hardware, software or a combination of software and hardware.

Wherein, the main processor 1101 includes one or more processing units, for example: the main processor 1101 may include an application processor (Application Processor, AP), a modem processor, a graphics processing unit (Graphics Processing Unit, GPU), an image Signal processor (Image Signal Processor, ISP), controller, video codec, digital signal processor (Digital Signal Processor, DSP), baseband processor, and/or neural network processor (Neural-Network Processing Unit, NPU )wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

A memory may also be provided in the main processor 1101 for storing instructions and data. In some embodiments, the memory in the main processor 1101 is a cache memory. The memory may hold instructions or data that the main processor 1101 has just used or recycled. If the main processor 1101 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the main processor 1101 is reduced, thereby improving the efficiency of the system.

In some embodiments, the display device may further include a plurality of input/output (Input/Output, I/O) interfaces 1108 connected to the main processor 1101 . The interface 1108 may include an integrated circuit (Inter-Integrated Circuit, I2C) interface, an integrated circuit built-in audio (Inter-Integrated Circuit Sound, I2S) interface, a pulse code modulation (Pulse Code Modulation, PCM) interface, a universal asynchronous transceiver (Universal Asynchronous Receiver/Transmitter, UART) interface, mobile industry processor interface (Mobile Industry Processor Interface, MIPI), general-purpose input and output (General-Purpose Input/Output, GPIO) interface, subscriber identity module (Subscriber Identity Module, SIM) interface, And/or Universal Serial Bus (Universal Serial Bus, USB) interface, etc. The above-mentioned I/O interface 1108 can be connected to devices such as a mouse, a touchpad, a keyboard, a camera, a speaker/speaker, and a microphone, and can also be connected to physical buttons on a display device (such as volume keys, brightness adjustment keys, power-on/off keys, etc.).

The external memory interface 1102 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the display device. The external memory card communicates with the main processor 1101 through the external memory interface 1102 to realize the data storage function.

The internal memory 1103 may be used to store computer-executable program code, which includes instructions. The internal memory 1103 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a call function, a time setting function, etc.) and the like. The storage data area can store data created during the use of the display device (such as phonebook, world time, etc.) and the like. In addition, the internal memory 1103 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (Universal Flash Storage, UFS), and the like. The main processor 1101 executes various functional applications and data processing of the display device by executing instructions stored in the internal memory 1103 and/or instructions stored in the memory provided in the main processor 1101 .

The display device may implement an audio function through an audio module 1104 and an application processor. Such as music playback, calls, etc.

The audio module 1104 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 1104 can also be used for encoding and decoding audio signals, such as playing or recording. In some embodiments, the audio module 1104 may be set in the processor 101 , or some functional modules of the audio module 1104 may be set in the processor 101 .

Video interface 1109 can receive the audio-video signal of external input, and it can specifically be High Definition Multimedia Interface (High Definition Multimedia Interface, HDMI), Digital Video Interface (Digital Visual Interface, DVI), Video Graphics Array (Video Graphics Array, VGA) , display port (Display port, DP), etc., the video interface 1109 can also output video externally. When the display device is used as a head-up display, the video interface 1109 can receive speed signals and power signals input from peripheral devices, and can also receive AR video signals input from the outside. When the display device is used as a projector, the video interface 1109 can receive a video signal input from an external computer or terminal device.

The video module 1105 can decode the video input by the video interface 1109, for example, perform H.264 decoding. The video module can also encode the video captured by the display device, for example, perform H.264 encoding on the video captured by the external camera. In addition, the main processor 1101 can also decode the video input from the video interface 1109 , and then output the decoded image signal to the display circuit 1110 .

The display circuit 1110 and the modulator 1111 are used to display corresponding images. In this embodiment, the video interface 1109 receives an externally input video source signal, and the video module 1105 outputs one or more image signals to the display circuit 1110 after decoding and/or digital processing, and the display circuit 1110 drives and modulates the signal according to the input image signal. The device 1111 images the incident polarized light, and then outputs at least two paths of imaging light. In addition, the main processor 1101 can also output one or more image signals to the display circuit 1110 .

In this embodiment, the display circuit 1110 and the modulator 1111 belong to the electronic components in the modulation unit 230, and the display circuit 1110 may be called a driving circuit.

The power module 1106 is used to provide power to the main processor 1101 and the light source 110 according to the input power (such as direct current). The light emitted by the light source 110 may be transmitted to the modulator 1111 for imaging, thereby forming an image light signal.

The wireless communication module 1107 can enable the display device to communicate wirelessly with the outside world, which can provide wireless local area networks (Wireless Local Area Networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), Bluetooth (Bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR) and other wireless communication solutions. The wireless communication module 1107 may be one or more devices integrating at least one communication processing module. The wireless communication module 1107 receives electromagnetic waves through the antenna, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the main processor 1101 . The wireless communication module 1107 can also receive the signal to be sent from the main processor 1101, frequency-modulate it, amplify it, and convert it into electromagnetic wave and radiate it through the antenna.

In addition, the video data decoded by the video module 1105 can be received through the wireless communication module 1107 in a wireless manner or read from an external memory besides being input through the video interface 1109, for example, the display device can be read from The terminal device or the vehicle entertainment system receives the video data, and the display device can also read the audio and video data stored in the external memory.

The above display device may be installed on a vehicle, please refer to FIG. 16 , which is a schematic diagram of a possible functional framework of a vehicle provided in an embodiment of the present application.

As shown in FIG. 16 , various subsystems may be included in the functional framework of the vehicle, such as a sensor system 12 in the figure, a control system 14, one or more peripheral devices 16 (one is shown as an example in the figure), a power supply 18. Computer system 20 and head-up display system 22. Optionally, the vehicle may also include other functional systems, such as an engine system for powering the vehicle, etc., which are not limited in this application.

Among them, the sensor system 12 may include several detection devices, which can sense the measured information and convert the sensed information into electrical signals or other required forms of information output according to certain rules. As shown in the figure, these detection devices may include a global positioning system (global positioning system, GPS), a vehicle speed sensor, an inertial measurement unit (inertial measurement unit, IMU), a radar unit, a laser range finder, a camera device, a wheel speed sensor, The steering sensor, gear sensor, or other components used for automatic detection, etc., are not limited in this application.

The control system 14 may include several elements such as the illustrated steering unit, braking unit, lighting system, automatic driving system, map navigation system, network time synchronization system and obstacle avoidance system. Optionally, the control system 14 may also include components such as an accelerator controller and an engine controller for controlling the driving speed of the vehicle, which are not limited in this application.

Peripherals 16 may include elements such as a communication system, a touch screen, a user interface, a microphone, and speakers as shown, among others. Among them, the communication system is used to realize the network communication between the vehicle and other devices except the vehicle. In practical applications, the communication system can use wireless communication technology or wired communication technology to realize network communication between vehicles and other devices. The wired communication technology may refer to communication between the vehicle and other devices through network cables or optical fibers.

Power source 18 represents a system that provides electrical power or energy to the vehicle, which may include, but is not limited to, a rechargeable lithium or lead-acid battery, or the like. In practical applications, one or more battery components in the power supply are used to provide electric energy or energy for starting the vehicle, and the type and material of the power supply are not limited in this application.

Several functions of the vehicle are controlled and realized by the computer system 20 . The computer system 20 may include one or more processors 2001 (one processor is used as an example in the figure) and a memory 2002 (also called a storage device). In practical applications, the memory 2002 is also inside the computer system 20, or outside the computer system 20, for example, as a buffer in a vehicle, which is not limited in this application. in,

The processor 2001 may include one or more general-purpose processors, such as a graphics processing unit (graphic processing unit, GPU). The processor 2001 can be used to run related programs stored in the memory 2002 or instructions corresponding to the programs, so as to realize corresponding functions of the vehicle.

Memory 2002 can comprise volatile memory (volatile memory), such as RAM; Memory also can comprise non-volatile memory (non-vlatile memory), such as ROM, flash memory (flash memory), HDD or solid state disk SSD; 2002 may also include combinations of the above types of memory. The memory 2002 can be used to store a set of program codes or instructions corresponding to the program codes, so that the processor 2001 calls the program codes or instructions stored in the memory 2002 to realize corresponding functions of the vehicle. This function includes but is not limited to some or all of the functions in the schematic diagram of the vehicle functional framework shown in FIG. 16 . In this application, a set of program codes for vehicle control can be stored in the memory 2002, and the processor 2001 calls the program codes to control the safe driving of the vehicle. How to realize the safe driving of the vehicle will be described in detail below in this application.

Optionally, in addition to storing program codes or instructions, the memory 2002 can also store information such as road maps, driving routes, and sensor data. The computer system 20 can combine other components in the vehicle functional framework diagram, such as sensors in the sensor system, GPS, etc., to realize related functions of the vehicle. For example, the computer system 20 can control the driving direction or driving speed of the vehicle based on the data input from the sensor system 12 , which is not limited in this application.

The heads-up display system 22 may include several elements, such as a windshield as shown, a controller, and a heads-up display. The controller 222 is used to generate images according to user instructions (for example, generate images containing vehicle speed, power/fuel level and other vehicle statuses and images of augmented reality AR content), and send the images to the head-up display for display; the head-up display may include images The combination of generating unit, reflector, and front windshield is used to cooperate with the head-up display to realize the optical path of the head-up display system, so that the target image is presented in front of the driver. It should be noted that the functions of some components in the head-up display system can also be realized by other subsystems of the vehicle, for example, the controller can also be a component in the control system.

Wherein, FIG. 16 of the present application shows that four subsystems are included, and the sensor system 12 , the control system 14 , the computer system 20 and the head-up display system 22 are only examples and not limiting. In practical applications, vehicles can combine several components in the vehicle according to different functions, so as to obtain subsystems with corresponding different functions. In practical application, the vehicle may include more or less systems or elements, which is not limited in this application.

The above means of transportation may be cars, trucks, motorcycles, buses, boats, airplanes, helicopters, lawn mowers, recreational vehicles, playground vehicles, construction equipment, trams, golf carts, trains, and trolleys. The application examples are not particularly limited.

Unless otherwise defined, the technical terms or scientific terms used herein shall have the usual meanings understood by those having ordinary skill in the art to which the present disclosure belongs. "First", "second", "third" and similar words used in the specification and claims of this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components . Likewise, words like "a" or "one" do not denote a limitation in quantity, but indicate that there is at least one. Words such as "comprises" or "comprising" and similar terms mean that the elements or items listed before "comprising" or "comprising" include the elements or items listed after "comprising" or "comprising" and their equivalents, and do not exclude other component or object. "A and/or B" means that the following three situations exist: A, B, and A and B.

The above is only an embodiment of the present application, and is not intended to limit the present application. Any modification, equivalent replacement, improvement, etc. made on the basis of the present application shall be included within the protection scope of the present application.

Claims

An image generating device, characterized in that it comprises:

a light source for providing a light beam;

A light splitting unit, configured to split the light beam into at least two sub-beams and input them into the modulation unit respectively;

The modulation unit is configured to perform optical modulation on the at least two sub-beams respectively according to the image data, and output at least two paths of imaging light;

The projection device is used for projecting the at least two paths of imaging light.
The image generating device according to claim 1, wherein the light splitting unit comprises:

The first polarizing beam splitter is used to divide the circularly polarized light or elliptically polarized light provided by the light source into first linearly polarized light and second linearly polarized light, and divide the first linearly polarized light into the second linearly polarized light respectively directed to the modulation unit, the polarization direction of the first linearly polarized light is perpendicular to the polarization direction of the second linearly polarized light.
The image generating device according to claim 1, wherein the light splitting unit comprises:

The first polarized beam splitter is used to divide the circularly polarized light or elliptically polarized light provided by the light source into first linearly polarized light and second linearly polarized light, and guide the first linearly polarized light to the modulation unit, so The polarization direction of the first linearly polarized light is perpendicular to the polarization direction of the second linearly polarized light;

An optical guiding structure, located on the optical path between the first polarization beam splitter and the modulation unit, is used to guide the second linearly polarized light to the modulation unit.
The image generating device according to claim 3, wherein the optical guiding structure comprises: a second polarization beam splitter, the second polarization beam splitter is used to guide the second linearly polarized light to the modulation unit.
The image generating device according to claim 3, wherein the optical guiding structure comprises: an optical rotator and a second polarization beam splitter,

The optical rotator is located on the optical path between the first polarizing beam splitter and the second polarizing beam splitter, and is used to rotate the polarization direction of the incident second linearly polarized light by a set angle to obtain a third linearly polarized light , and directing the third linearly polarized light to the second polarizing beam splitter;

The second polarization beam splitter is used to guide the third linearly polarized light to the modulation unit.
The image generating device according to claim 3, wherein the optical guiding structure comprises: an optical rotator and a second polarization beam splitter,

The second polarization beam splitter is located on the optical path between the first polarization beam splitter and the optical rotator, and is used to guide the second linearly polarized light to the optical rotator;

The optical rotator is used to rotate the polarization direction of the second linearly polarized light to set an angle to obtain a third linearly polarized light, and guide the third linearly polarized light to the second polarization beam splitter;

The second polarization beam splitter is also used to guide the third linearly polarized light to the modulation unit.
The image generating device according to any one of claims 4 to 6, characterized in that the light splitting plane of the second polarizing beam splitter is parallel to or perpendicular to the beam splitting plane of the first polarizing beam splitter.
The image generating device according to claim 5 or 6, wherein the optical rotator comprises at least one of the following devices: a Faraday rotation mirror and a wave plate.
The image generating device according to any one of claims 1 to 8, wherein the modulation unit comprises a spatial light modulator, the spatial light modulator has at least two modulation regions, and the at least two modulation regions The regions are respectively used for optical modulation of the at least two sub-beams to obtain the at least two paths of imaging light.
The image generating device according to any one of claims 1 to 8, wherein the modulating unit includes at least two spatial light modulators, and the at least two spatial light modulators are respectively used to control the at least two The sub-beams are optically modulated to obtain the at least two paths of imaging light.
The image generating device according to claim 9 or 10, wherein the spatial light modulator is a MEMS, a liquid crystal display, a digital micromirror device or a liquid crystal on silicon.
The image generating device according to claim 5, wherein the modulation unit comprises a first spatial light modulator and a second spatial light modulator,

The first spatial light modulator is located on one side of the first polarization beam splitter and is located in the propagation direction of the first linearly polarized light;

The second spatial light modulator is located on one side of the second polarization beam splitter and is located in the propagation direction of the third linearly polarized light;

Wherein, the first spatial light modulator and the second spatial light modulator are of the same type.
The image generating device according to claim 12, wherein the first linearly polarized light is P light, and the second linearly polarized light is S light;

Both the first spatial light modulator and the second spatial light modulator are liquid crystal on silicon modulators, and the first spatial light modulator outputs the corresponding imaging light through the first polarization beam splitter, so The second spatial light modulator outputs the corresponding imaging light through the second polarization beam splitter.
The image generating device according to claim 12 or 13, wherein the optical rotator is a 1/2 wave plate.
A display device, characterized by comprising a main processor and the image generating device according to any one of claims 1 to 14, the main processor is used to send image data to the modulation unit.
The display device according to claim 15, further comprising:

A reflective device, the reflective device is used for reflective imaging of the at least two paths of imaging light projected by the image generating device to form at least two images.
A display device, characterized in that it comprises the image generation device according to any one of claims 1 to 14, the image generation device is used to project the at least two paths of imaging light onto the windshield to form at least Two images.
A vehicle, characterized by comprising the display device according to any one of claims 15-17.
An image projection method, characterized in that, comprising:

get image data;

According to the image data, at least two sub-beams are optically modulated to obtain at least two imaging lights, and the at least two sub-beams are obtained by splitting a beam provided by a light source; and

Projecting the at least two paths of imaging light.
The image projection method according to claim 19, wherein the light modulation is performed on at least two sub-beams respectively according to the image data to obtain at least two paths of imaging light, comprising:

According to the image data, at least two spatial light modulators are used to perform light modulation on the corresponding sub-beams, and the number of the spatial light modulators is equal to the number of images corresponding to the image data.
The image projection method according to claim 19, wherein the light modulation is performed on at least two sub-beams respectively according to the image data to obtain at least two paths of imaging light, comprising:

According to the image data, light modulation is performed on the corresponding sub-beams through at least two modulation areas of the spatial light modulator, and the number of the modulation areas used for light modulation is equal to the number of images corresponding to the image data .