WO2024041034A1 - Display module, optical display system, terminal device, and imaging method - Google Patents

Display module, optical display system, terminal device, and imaging method Download PDF

Info

Publication number
WO2024041034A1
WO2024041034A1 PCT/CN2023/093125 CN2023093125W WO2024041034A1 WO 2024041034 A1 WO2024041034 A1 WO 2024041034A1 CN 2023093125 W CN2023093125 W CN 2023093125W WO 2024041034 A1 WO2024041034 A1 WO 2024041034A1
Authority
WO
WIPO (PCT)
Prior art keywords
light source
light
position information
component
control signal
Prior art date
Application number
PCT/CN2023/093125
Other languages
French (fr)
Chinese (zh)
Inventor
秦振韬
毛磊
董天浩
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2024041034A1 publication Critical patent/WO2024041034A1/en

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/55—Specular reflectivity
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays

Definitions

  • the present application relates to the field of display technology, and in particular, to a display module, an optical display system, a terminal device and an imaging method.
  • Three-dimensional (3D) display can give the observer a strong sense of three-dimensional realism, increase the display depth of field, and enhance the richness of the display content.
  • 3D technology is based on two sets of image information for the left eye and the right eye, and projects them onto the screen.
  • the observer uses polarized glasses to separate the image information, so that the left eye acquires a set of image information and the right eye Eyes obtain another set of image information.
  • naked-eye 3D display technology also known as parallax barrier or parallax barrier technology
  • naked-eye 3D display technology can achieve stereoscopic visual effects through light barrier technology without the use of external tools such as polarized glasses.
  • 3D images displayed based on light barrier technology will cause a loss of resolution.
  • the present application provides a display module, optical display system, terminal equipment and imaging method to reduce or eliminate the problem of resolution loss in displayed images.
  • the present application provides a display module.
  • the display module includes a light source component, an optical shaping component, a light modulating component and a reflecting component.
  • the optical shaping component is located between the light source component and the light modulating component.
  • the light source component is used to emit the first beam and the second beam in a time-sharing manner, and the first beam and the second beam have different exit positions.
  • the optical shaping component is used to adjust the direction of the first light beam to obtain the third light beam, and adjust the direction of the second light beam to obtain the fourth light beam.
  • the light modulation component is used to modulate the third light beam to obtain first image light carrying first image information, and to modulate the fourth light beam to obtain second image light carrying second image information.
  • the reflective component is used to reflect the first image light to the observer's left eye for imaging, and to reflect the second image light to the observer's right eye for imaging.
  • the optical shaping component is located between the light source component and the light modulation component, the light source component can cooperate with the optical shaping component to generate directional backlight, and the light modulation component loads the first image information or the second image information in a time-division manner.
  • the observer can see the first image information or the second image information modulated by all pixels of the light modulation component with a single eye, therefore, the loss of resolution of the displayed image can be reduced or avoided.
  • the first image light is imaged on the left eye
  • the second image light is imaged on the right eye.
  • the observer can observe different parallax images. If the first image information and the second image information are different, At the same time, a three-dimensional 3D image effect can be obtained.
  • the light source assembly includes a light source array, and the light source array includes a first light source and a second light source.
  • the light source component is configured to, according to the received first control signal, the first light source emit the first light beam during the first period, and the second light source emit the second light beam during the second period.
  • the light source array can realize the division of multiple viewing areas in the eye box, so that observers can watch at different positions of the eye box.
  • the first control signal includes position information of the first light source and position information of the second light source.
  • the light sources in the light source array are distributed in a plane.
  • the planarly distributed light source array can reduce the thickness of the display module and facilitate the processing of dense light source arrays.
  • the light sources in the light source array are distributed in a curved surface.
  • the light source array distributed through the curved surface can make the images seen by the observer at the edge and the center basically the same, thereby expanding the eye box range of the display module.
  • the light sources in the light source array are distributed in polygonal rows.
  • the light source array distributed in a polygon can make the image seen by the observer at the edge and center as consistent as possible while reducing the thickness of the display module as much as possible, thereby expanding the eye box range of the display module.
  • the light source assembly includes a surface light source and a light valve; the surface light source is used to emit a surface beam; the light valve is used to open the light valve in the first position in the third period according to the received second control signal, The first beam of the surface beam is emitted through the first position, and the light valve of the second position is opened during the fourth period, and the second beam of the surface beam is emitted through the second position.
  • the second control signal includes the first position information of the light valve and the second position information of the light valve.
  • a pixelated light source with high modulation accuracy can be achieved, making the switching between the first beam and the second beam smoother in the eye tracking state, and the image flicker observed by the observer moving within the eye box is less , more stable; and by controlling the opening width of the light valve, it can accurately match a larger viewing depth range.
  • the surface light source may be a planar surface light source, and/or the light valve may be a planar light valve.
  • Using a flat surface light source and/or a flat light valve helps reduce the thickness of the display module.
  • the optical shaping component includes a lens array. Further, the lenses in the lens array are distributed in a plane.
  • the thickness of the display module can be further reduced. Furthermore, the lens array helps to improve the uniformity of the image formed based on the first image light or the second image light.
  • the lens array includes an aspherical lens array.
  • the aspherical lens array can focus the light beams in different directions on the same fixed point. Therefore, the aspherical lens can reduce the edge of the field of view of the display module. aberration.
  • the aspherical lens array can not only reduce the aberration of the display module, but also in the case of a larger field of view (FOV), the light source component can also be designed as a planar light source array, which can reduce processing and assembly costs. the complexity.
  • the lens array includes a Fresnel lens array.
  • the edge of the image can be imaged through the Fresnel lens. The difference is small.
  • the pitch p of the lenses in the lens array (referring to the effective diameter or effective aperture size of a single lens in the lens array) satisfies the following formula 1:
  • ⁇ is the divergence angle of the first light beam and the divergence angle of the second light beam, whichever is larger
  • h is the lateral luminous width of the first light source or the second light source
  • t is the distance between the luminous surface of the light source component and the optical shaping component. The distance between faces close to the light modulating component.
  • the light source i.e. the first light source or the second light source
  • the light source array that is turned on once can illuminate the entire corresponding lens, thereby avoiding the existence of dark areas at the edge of the lens and affecting the display of the display module.
  • Image uniformity i.e. the first light source or the second light source
  • the pitch p of the lenses in the lens array satisfies the following formula 2:
  • W eye is the distance between the virtual eyes on the virtual eye box surface
  • d is the distance between the optical shaping component and the virtual eye box surface
  • the virtual eye box surface is the virtual image formed by the reflection of the actual eye box surface by the reflective component
  • t is the light source. The distance between the light-emitting surface of the component and the surface of the optical shaping component close to the light modulation component.
  • the optical shaping component may also include an aspherical lens.
  • the aspherical lens Since the curvature of the aspherical lens changes continuously from the center to the edge, the light beams in different directions can be focused on the same fixed point. Therefore, the aspherical lens can reduce the aberration at the edge of the field of view of the display module.
  • the reflective component includes at least one reflective element, and the reflective element may include but is not limited to a plane mirror, a spherical mirror, a free-form mirror, or a semi-transparent mirror.
  • the present application provides an optical display system, which includes a control module and the above-mentioned first aspect or any one of the display modules in the first aspect.
  • the control module is used to control the display module for image display.
  • the light source assembly includes a light source array, the light sources in the light source array are distributed in a plane, and the light source array includes a first light source and a second light source.
  • the control module is used to obtain the left eye position information and right eye position information of the observer; determine the position information of the first light source according to the left eye position information, and determine the position information of the second light source according to the right eye position information; according to the first light source
  • the position information of the second light source and the position information of the second light source generate a first control signal, and the first control signal is sent to the light source assembly.
  • the light source assembly is configured to, according to the received first control signal, the first light source emit the first light beam during the first period, and the second light source emit the second light beam during the second period.
  • the first control signal includes position information of the first light source and position information of the second light source.
  • the light source component includes a surface light source and a light valve
  • the control module is used to obtain the observer's left eye position information and right eye position information; and determine the first position information of the light valve according to the left eye position information, and determining the second position information of the light valve according to the right eye position information; generating a second control signal according to the first position information of the light valve and the second position information of the light valve and sending the second control signal to the light source assembly.
  • the surface light source is used to emit the surface beam; the light valve is used to open the light valve at the first position in the third period according to the received second control signal, and the first beam in the surface beam is emitted through the first position; and In the fourth period, the light valve at the second position is opened, and the second beam of the surface beam is emitted through the second position.
  • the surface light source is a planar surface light source and/or the light valve is a planar light valve.
  • the second control signal includes first position information of the light valve and second position information of the light valve.
  • the optical display system also includes an eye tracking module, and the eye tracking module is connected to the control module. catch. Further, optionally, the control module is configured to receive left eye position information and right eye position information from the eye tracking module.
  • the present application provides a terminal device, including the above-mentioned first aspect or any one of the optical display systems in the first aspect, and the optical display system is installed on the terminal device.
  • the reflective component included in the display module may be a windshield on the terminal device.
  • the present application provides an imaging method that can be applied to a display module.
  • the display module includes a light source component, an optical shaping component, a light modulation component and a reflection component.
  • the optical shaping component is located between the light source component and the light modulation component. between.
  • the method includes controlling a light source component to emit a first beam and a second beam in a time-sharing manner. The first beam and the second beam have different exit positions. The first beam is adjusted to a third beam by an optical shaping component, and the second beam is adjusted by an optical shaping component.
  • Be the fourth light beam and control the light modulation component to optically modulate the third light beam to obtain the first image light carrying the first image information, and optically modulate the fourth light beam to obtain the second image light carrying the second image information;
  • first The image light is reflected by the reflective component to the observer's left eye for imaging, and the second image light is reflected by the reflective component to the observer's right eye for imaging; a first control signal is sent to the light source component, and a third control signal is sent to the light modulation component.
  • control method can be executed by the control module.
  • the observer's left eye position information and right eye position information are obtained, a control signal is generated based on the left eye position information and the right eye position information, and the control signal is sent to the light source component.
  • the control signal is used to control the light source component to emit the first light beam and the second light beam in a time-divided manner.
  • left eye position information and right eye position information are received from the eye tracking module.
  • the control signal includes a first control signal
  • the light source component includes a light source array
  • the position information of the first light source is determined according to the left eye position information
  • the position information of the second light source is determined according to the right eye position information
  • a first control signal is generated according to the position information of the first light source and the position information of the second light source.
  • the first control signal is used to control the first light source in the light source array to emit the first light beam in the first period, and to control the second light source in the light source array to emit the second light beam in the second period.
  • the control signal includes a second control signal
  • the light source component includes a surface light source and a light valve
  • the first position information of the light valve is determined according to the left eye position information
  • the first position information of the light valve is determined according to the right eye position.
  • the information determines second position information of the light valve
  • a second control signal is generated based on the first position information of the light valve and the second position information of the light valve.
  • the second control signal is used to control the light valve at the first position to be opened during the third period, and the light valve at the second position to be opened during the fourth period.
  • the present application provides a control device, which is used to implement the method in the above-mentioned fourth aspect or any possible implementation of the fourth aspect, including corresponding functional modules, respectively used to implement the above method. step.
  • Functions can be implemented by hardware, or by hardware executing corresponding software.
  • Hardware or software includes one or more modules corresponding to the above functions.
  • the control device may include: an interface circuit and a processor.
  • the processor is used to implement the corresponding functions of the first aspect through logic circuits or execution code instructions.
  • the interface circuit is used to receive signals from other control devices other than the control device and transmit them to the processor or to transfer signals from the processor. Sent to other control devices besides the control device.
  • the interface circuit can be an independent receiver, an independent transmitter, or a transceiver with integrated transceiver functions.
  • the control device may also include a memory, which may be coupled to the processor and which stores necessary program instructions and data for the control device.
  • the processor cooperates with the interface circuit to control the light source component to emit the first beam and the second beam in a time-sharing manner.
  • the first beam and the second beam have different exit positions.
  • the first beam is adjusted to the third beam by the optical shaping component.
  • the second beam passes through The optical shaping component is adjusted to the fourth light beam; and the light modulation component is controlled to modulate the third light beam to obtain the first image light carrying the first image information, and modulate the fourth light beam to obtain the second image light carrying the second image information; first The image light is reflected by the reflective component to the observer's left eye for imaging, and the second image light is reflected by the reflective component to the observer's right eye for imaging.
  • the interface circuit is used to obtain the left eye position information and the right eye position information of the observer; the processor is used to generate a control signal according to the left eye position information and the right eye position information, and the control signal is used to
  • the light source component is controlled to emit a first light beam in a first period and a second light beam in a second period; the interface circuit is also used to send a control signal to the light source component.
  • the interface circuit is used to receive left eye position information and right eye position information from the eye tracking module.
  • control signal includes a first control signal
  • the light source assembly includes a light source array.
  • the processor is specifically configured to: determine the position information of the first light source based on the left eye position information, and determine the position information of the second light source based on the right eye position information; and generate the third light source based on the position information of the first light source and the position information of the second light source. a control signal.
  • control signal includes a second control signal
  • the light source assembly includes a surface light source and a light valve
  • the processor is specifically configured to determine the first position information of the light valve according to the left eye position information, and to determine the first position information of the light valve according to the right eye position information. Determine second position information of the light valve; and generate the second control signal based on the first position information of the light valve and the second position information of the light valve.
  • the present application provides a control device, which is used to implement the method in the above-mentioned fourth aspect or any possible implementation of the fourth aspect, including corresponding functional modules, respectively used to implement the above method. step.
  • Functions can be implemented by hardware, or by hardware executing corresponding software.
  • Hardware or software includes one or more modules corresponding to the above functions.
  • the processing module cooperates with the transceiver module to control the light source component to emit the first beam and the second beam in a time-sharing manner.
  • the first beam is adjusted to the third beam through the optical shaping component, and the second beam is adjusted to the fourth beam through the optical shaping component. ; and control the light modulation component to modulate the third light beam to obtain the first image light carrying the first image information, and modulate the fourth light beam to obtain the second image light carrying the second image information;
  • the first image light is reflected to the observation through the reflective component
  • the left eye of the observer is imaged, and the second image light is reflected to the observer's right eye through the reflective component.
  • the transceiver module is used to obtain the left eye position information and the right eye position information of the observer; the processing module is used to generate a control signal according to the left eye position information and the right eye position information, and the control signal is In order to control the light source component to emit the first light beam in the first time period and the second light beam in the second time period, the transceiver module is also used to send a control signal to the light source component.
  • the transceiver module is used to receive left eye position information and right eye position information from the eye tracking module.
  • control signal includes a first control signal
  • the light source assembly includes a light source array.
  • the processing module is specifically configured to: determine the position information of the first light source based on the left eye position information, and determine the position information of the second light source based on the right eye position information; and generate the third light source based on the position information of the first light source and the position information of the second light source.
  • a control signal is used to control the light source assembly to emit a first light beam from the first light source during a first period and to emit a second light beam from the second light source during a second period.
  • control signal includes a second control signal
  • the light source assembly includes a surface light source and a light valve
  • the processing module is specifically configured to determine the first position information of the light valve according to the left eye position information, and determine the first position information of the light valve according to the right eye position information. Determine second position information of the light valve; and generate a second control signal based on the first position information of the light valve and the second position information of the light valve.
  • the second control signal is used to control the light valve to open the light valve at the first position during the third period, emit the first beam of the surface beam emitted by the surface light source through the first position, and open the light valve at the second position during the fourth period. , the second of the surface beams emitted by the surface light source The light beam is emitted through the second position.
  • the present application provides a computer-readable storage medium.
  • Computer programs or instructions are stored in the computer-readable storage medium.
  • the control device is caused to execute the fourth aspect or the third aspect. Methods in any possible implementation of the four aspects.
  • the present application provides a computer program product.
  • the computer program product includes a computer program or instructions.
  • the control device causes the control device to execute the fourth aspect or any of the fourth aspects.
  • Figure 1a is a schematic diagram of a scene applied to HUD provided by this application.
  • Figure 1b is a schematic diagram of a scenario applied to NED equipment provided by this application.
  • Figure 1c is a schematic diagram of a scene applied to a vehicle-mounted display screen provided by this application.
  • FIG. 2 is a schematic structural diagram of a display module provided by this application.
  • Figure 3 is a schematic diagram of an optical path in a display module provided by this application.
  • Figure 4 is a schematic diagram of the relationship between a first light source and a second light source provided by this application;
  • Figure 5a is a schematic structural diagram of a one-dimensional light source array provided by this application.
  • Figure 5b is a schematic structural diagram of a two-dimensional light source array provided by this application.
  • Figure 5c is a schematic structural diagram of a staggered arrangement of a light source array provided by this application.
  • Figure 5d is a schematic structural diagram of yet another staggered arrangement of light source arrays provided by this application.
  • Figure 5e is a schematic structural diagram of yet another staggered arrangement of light source arrays provided by this application.
  • Figure 5f is a schematic structural diagram of another light source array provided by the present application in which the light sources are arranged staggered in the column direction;
  • Figure 5g is a schematic structural diagram of a light source array provided by the present application, in which part of the light source array is arranged in a staggered arrangement at equal intervals in the row direction and partially arranged in a staggered arrangement at non-equal intervals;
  • Figure 5h is a schematic structural diagram of a light source array provided by the present application in which the staggered arrangement is partially equally spaced in the column direction and the other is non-equally spaced staggered arrangement;
  • Figure 6a is a schematic diagram of a polygonal distribution of light sources in a light source array provided by this application;
  • Figure 6b is a three-dimensional diagram of a regular hexagonally distributed light source array provided by this application.
  • Figure 7a is a schematic structural diagram of a light source array provided by the present application in which the light sources are distributed on a curved surface;
  • Figure 7b is a three-dimensional diagram of a light source array with curved surface distribution provided by this application.
  • Figure 7c is a three-dimensional diagram of a light source array with curved surface distribution provided by this application.
  • Figure 8a is a schematic structural diagram of a surface light source and light valve provided by this application.
  • Figure 8b is a schematic structural diagram of another surface light source and light valve provided by this application.
  • Figure 9a is a schematic structural diagram of a Fresnel lens provided by this application.
  • Figure 9b is a schematic structural diagram of an aspherical lens array provided by this application.
  • Figure 9c is a schematic structural diagram of a spherical lens array provided by this application.
  • Figure 9d is a schematic structural diagram of a Fresnel lens array provided by this application.
  • Figure 10a is a schematic structural diagram of a display screen provided by this application.
  • Figure 10b is a schematic structural diagram of a display screen provided by this application.
  • Figure 11 is a schematic diagram of the optical path of a display screen provided by this application.
  • Figure 12 is a schematic structural diagram of another display module provided by this application.
  • FIG. 13 is a schematic structural diagram of another display module provided by this application.
  • Figure 14 is a schematic structural diagram of another display module provided by this application.
  • Figure 15 is a schematic structural diagram of an optical display system provided by this application.
  • Figure 16 is a principle of convergence adjustment conflict provided by this application.
  • Figure 17 is a schematic circuit diagram of an optical display system provided by this application.
  • Figure 18 is an exemplary functional block diagram of a vehicle provided by this application.
  • Figure 19 is a schematic flow chart of an imaging method provided by this application.
  • Figure 20a is a schematic optical path diagram of an observer's left eye and right eye at position 1 provided by this application;
  • Figure 20b is a schematic optical path diagram of an observer's left eye and right eye at position 2 provided by this application;
  • FIG. 21 is a schematic structural diagram of a control device provided by this application.
  • Figure 22 is a schematic structural diagram of a control device provided by this application.
  • the display module provided by this application can also be integrated into a head-up display device (HUD).
  • HUD head-up display device
  • Figure 1a takes the HUD installed in a vehicle as an example.
  • HUD can project the formed image (called HUD virtual image) into the driver's front field of view and fuse it with real road information, thereby enhancing the driver's perception of the actual driving environment.
  • the HUD can carry navigation information (such as direction arrows, distance, and/or driving time, etc.) and/or vehicle status information (such as driving speed, driving mileage, rotation speed, temperature, fuel level, and/or car light status).
  • HUD includes but is not limited to windshield-head up device (W-HUD), or AR-HUD, etc.
  • the display module provided by this application can also be integrated into a near eye display (NED) device.
  • the NED device may be, for example, an AR device or a virtual reality (VR) device.
  • the AR device may include but is not limited to AR glasses or an AR helmet.
  • the VR device may include but is not limited to VR glasses or a VR helmet. Please refer to Figure 1b, taking AR glasses as an example. Users can wear AR glasses to play games, watch videos, participate in virtual meetings, or video shopping, etc.
  • the display module provided by this application can also be integrated into a vehicle-mounted display screen.
  • the vehicle-mounted display screen can be installed on the back of the vehicle's seat or in the passenger seat. This application covers the installation of vehicle-mounted display screens. The position is not limited.
  • Figure 1c shows an example of being installed on the back of the seat.
  • the display module provided by this application can also be integrated into a device including a picture generation unit (picture generation unit, PGU) and a reflective component, or other possible smart virtual images.
  • a picture generation unit picture generation unit
  • a reflective component or other possible smart virtual images.
  • display scenarios such as light display, void display, etc., and are not limited to the scenes illustrated in the above examples.
  • this application provides a display module.
  • the display module can be used without losing the resolution of the displayed image.
  • the display module includes a light source component, an optical shaping component, a light modulating component and a reflecting component.
  • the optical shaping component is located between the light source component and the light modulating component.
  • the light source component is used to emit the first light beam and the second light beam in a time-sharing manner, and the first light beam and the second light beam emit different positions from the light source component. It can also be understood that the light source component emits different light beams from different positions at different time periods.
  • the optical shaping component is used to adjust the direction of the first light beam to obtain the third light beam, and adjust the direction of the second light beam to obtain the fourth light beam.
  • the light modulation component is used to modulate the third light beam to obtain first image light carrying first image information, and to modulate the fourth light beam to obtain second image light carrying second image information.
  • the reflective component is used to reflect the first image light to the observer's left eye for imaging, and to reflect the second image light to the observer's right eye for imaging.
  • the propagation light path of the first beam is: the light source component emits the first beam, the first beam is adjusted by the optical shaping component to obtain a third beam, and the third beam modulates the first image information into the third beam through the light modulation component.
  • the first image light is obtained, and the first image light is emitted to the observer's left eye for imaging through the reflective component.
  • the propagation light path of the second beam is: the light source component emits the second beam, the second beam is adjusted by the optical shaping component to obtain a fourth beam, and the fourth beam is modulated by the light modulation component to modulate the second image information into the fourth beam to obtain the second image.
  • the second image light is reflected by the reflective component to the observer's right eye for imaging.
  • the optical shaping component is located between the light source component and the light modulation component, the light source component can cooperate with the optical shaping component to generate directional backlight, and the light modulation component loads the first image information or the second image information in a time-division manner.
  • the observer can see the first image information or the second image information modulated by all the pixels of the light modulation component with one eye. It can also be understood that the observer can see the complete first image information or the second image information modulated by the light modulation component with one eye.
  • the second image information therefore, can reduce or avoid the loss of resolution of the displayed image.
  • the first image light is imaged on the left eye
  • the second image light is imaged on the right eye.
  • the observer can observe different parallax images. If the first image information and the second image information are different, a three-dimensional 3D image effect can be obtained. It can be understood that if the first image information and the second image information are the same, the display module can also display a two-dimensional image effect.
  • the light source component is configured to emit the first light beam and the second light beam in a time-divided manner according to the received control signal.
  • the following shows two possible structures of the light source assembly based on examples, and the process of the light source assembly emitting the first light beam and the second light beam in a time-division manner is introduced in detail respectively.
  • the light source component includes a light source array.
  • the light source array includes a first light source and a second light source. According to the received first control signal, the light source array emits the first light beam from the first light source during the first period and the second light beam from the second light source during the second period. That , the first control signal includes position information of the first light source and position information of the second light source.
  • the first period T 1 during which the first light source is turned on and the second period T 2 during which the second light source is turned on can be set during the initialization process of the display module; or, the first period T 1 and T 2 during which the first light source is turned on can be set.
  • the second period T2 during which the second light source is turned on may also be carried in the first control signal. It should be noted that there is a preset time period ⁇ t between turning on the first light source and the second light source. Please refer to Figure 4. Usually, the preset time period ⁇ t is equal to the modulation time length T 5 of the light modulation component.
  • the light source array can determine the first light source that needs to be turned on based on the position information of the first light source in the first control signal.
  • the first light source is turned on in the first period T1 , and the turned on first light source is used to emit the first light beam;
  • the second light source that needs to be turned on is determined according to the position information of the second light source.
  • the second light source is turned on in the second period T2 , and the turned on second light source is used to emit the second light beam.
  • the light sources in the light source array are distributed in a plane.
  • the light source array includes m ⁇ n light sources, m is an integer greater than 1, and n is a positive integer; or, m is a positive integer, and n is an integer greater than 1.
  • the light source array may be a one-dimensional array (or called a linear array), or it may be a two-dimensional array (or called an area array).
  • the light source array includes 6 ⁇ 1 light sources as an example. It can also be understood that these six light sources are arranged in strips along the row direction.
  • Case 2 The light sources in the light source array are arranged two-dimensionally.
  • the method can be further divided into the following five situations.
  • the light source array includes 6 ⁇ 6 light sources.
  • the lights are aligned in the row direction and also in the column direction.
  • the light sources in the light source array are staggered at equal intervals in the row direction and aligned in the column direction.
  • FIG. 5c it is a schematic structural diagram of a staggered arrangement of a light source array provided by the present application.
  • the light sources in the light source array are staggered at equal intervals in the row direction.
  • a staggered arrangement with a three-row period (or period called a staggered arrangement) is taken as an example.
  • the staggered size of any two adjacent light sources in the row direction is equal. is ⁇ 1 . It should be noted that the misalignment size ⁇ 1 in the row direction is smaller than the distance S 1 between the centers of two adjacent light sources.
  • the light sources in the light source array are staggered at equal intervals in the column direction, but are aligned in the row direction.
  • FIG. 5d it is a schematic structural diagram of another staggered arrangement of light source array provided by the present application.
  • the light sources in the light source array are staggered at equal intervals in the column direction.
  • a three-column periodic staggered arrangement is taken as an example.
  • the stagger size of any two adjacent light sources in the column direction is ⁇ 2 . It should be noted that the dislocation size ⁇ 2 in the column direction is smaller than the distance H 1 between the centers of two adjacent light sources.
  • dislocation size ⁇ 1 in the above-mentioned Fig. 5c may be the same as the dislocation size ⁇ 2 in the above-mentioned Fig. 5d, or may be different, and this application does not limit this.
  • Case 2.4 The light sources in the light source array are staggered at unequal intervals in the row direction and aligned in the column direction.
  • FIG. 5e it is a schematic structural diagram of yet another staggered arrangement in a light source array provided by this application.
  • the light sources in the light source array have at least two different dislocation sizes in the row direction.
  • a 2-row periodic dislocation arrangement is taken as an example, that is, there are two different dislocation sizes in the row direction.
  • the misalignment size of two adjacent light sources in the row direction is ⁇ 3 or ⁇ 4 . In this example, ⁇ 3 is smaller than ⁇ 4 .
  • the misalignment size ⁇ 3 of any two adjacent light sources in the row direction is less than the distance S 1 between the centers of the two adjacent light sources, and the misalignment size ⁇ 4 of any two adjacent light sources in the row direction is also smaller than the distance S 1 between the centers of the two adjacent light sources.
  • offset sizes in the offset arrangements at unequal intervals in the row direction may be different from each other, or may be partially the same and partially different, which is not limited in this application.
  • FIG. 5f it is a schematic structural diagram of another light source array provided by the present application in which the light sources are arranged staggered in the column direction.
  • the light sources in the light source array have at least two different dislocation sizes in the column direction.
  • a two-column periodic dislocation arrangement is taken as an example, that is, there are two different dislocation sizes in the column direction.
  • the misalignment size of two adjacent light sources in the column direction is ⁇ 5 or ⁇ 6 . In this example, ⁇ 5 is smaller than ⁇ 6 .
  • the misalignment size ⁇ 5 of any two adjacent light sources in the column direction is smaller than the distance H 1 between the centers of the two adjacent light sources, and the misalignment size ⁇ 6 of any two adjacent light sources in the column direction is smaller than the distance H 1 between the centers of the two adjacent light sources.
  • the distance between the centers is H 1 .
  • the stagger sizes may be different from each other, or may be partially the same and partially different, which is not limited in this application.
  • the staggered arrangement of the light sources in the row direction in the light source array can also be a combination of the above situations 2.2 and 2.5, that is, some are equally spaced staggered arrangements, and some are non-equally spaced staggered arrangements.
  • the misalignment sizes in the row direction are ⁇ 7 , ⁇ 8 and ⁇ 7 .
  • the staggered arrangement of the light sources in the column direction in the light source array can also be a combination of the above scenarios 2.3 and 2.5, that is, some are equally spaced staggered arrangements, and some are non-equally spaced staggered arrangements.
  • the misalignment sizes in the column direction are ⁇ 9 , ⁇ 0 and ⁇ 9 . It can be understood that, in order to reduce optical crosstalk as much as possible, the distance between two adjacent light sources can be set larger. For example, the distance between two adjacent light sources can be set to 400 microns or greater.
  • the light sources in the light source array given above are all rectangular as examples, and the shape of the light source can also be any other possible shape, such as a circle, an ellipse, a polygon, etc., which is not limited in this application.
  • the light sources in the light source array are distributed in polygonal rows.
  • Figure 6a is a schematic diagram of a polygonal distribution of light sources in a light source array provided by the present application.
  • the light sources in the light source array are distributed in a regular hexagon.
  • Figure 6b is a three-dimensional diagram of a regular hexagonally distributed light source array.
  • the thickness of the display module can be reduced as much as possible, so that the images seen by the observer at the edges and the center are as consistent as possible, thereby expanding the eye box range of the display module.
  • Scenario 3 The light sources in the light source array are distributed on a curved surface.
  • Figure 7a is a schematic structural diagram of a light source array provided by the present application in which the light sources are distributed on a curved surface.
  • Figure 7b or Figure 7c which is a three-dimensional diagram of a light source array distributed on a curved surface.
  • the light source array given above can achieve independent addressing.
  • Independent addressing means that the light sources in the light source array can be independently gated (or called on or turned on or powered on), and the gated light sources are used to emit the first beam or the second beam.
  • a driving current is input to a first light source in the light source array to strobe the first light source.
  • a driving current is input to the second light source in the light source array to strobe the second light source.
  • the addressing mode of the light source array is related to the physical connection relationship of the light sources in the light source array.
  • the light sources can be gated point by point, or the light sources can be gated on demand, where, for example, the gate on demand can be gated on a specific position at a certain time.
  • Light source etc.
  • the light sources in the same column in the light source array are connected in series and different columns are connected in parallel
  • the light source array can be gated column by column.
  • the light source in the column For another example, if the light sources in the same row of the light source array are connected in series and different rows are connected in parallel, the light sources in the light source array can be gated row by row.
  • the light sources in the light source array can be gated according to the diagonal lines, etc., which will not be listed one by one here.
  • the light source in the light source array may be a laser diode (LD), a light-emitting diode (LED), a vertical cavity surface emitting laser (VCSEL), an edge laser Emitting laser (edge emitting laser, EEL), all-solid-state semiconductor laser (diode pumped solid state laser, DPSS), or fiber laser, etc.
  • LD laser diode
  • LED light-emitting diode
  • VCSEL vertical cavity surface emitting laser
  • EEL edge laser Emitting laser
  • DPSS all-solid-state semiconductor laser
  • the light source component includes an area light source and a light valve.
  • the light source component may include a surface light source and a light valve.
  • the surface light source can be a planar surface light source
  • the light valve can be a planar light valve.
  • the light valve can cover the complete area light source. When the light valve at a certain position is opened, the area beam emitted by the area light source can be emitted from the position where the light valve is opened.
  • the surface light source is used to emit surface beams, and usually the surface light source is always on.
  • the light valve is used to open the light valve at the first position in the third period according to the received second control signal.
  • the first beam of the surface beam emitted by the surface light source is emitted through the first position.
  • the light valve is used to open the light valve at the second position in the fourth period according to the second control signal, and the second light beam in the surface beam emitted by the surface light source is emitted through the second position, please refer to (2) in Figure 8b.
  • the second control signal includes the first position information of the light valve and the second position information of the light valve.
  • the first position information of the light valve includes the first width and the first center coordinate of the light valve that needs to be opened, or includes the first starting position and the first end position of the light valve that needs to be opened.
  • the second position information of the light valve includes the second width and the second center coordinate of the light valve that needs to be opened, or includes the second starting position and the second end position of the light valve that needs to be opened.
  • the first width may be the same as the second width or may be different, which is not limited in this application.
  • the third period T 3 during which the light valve is opened at the first position and the fourth period T 4 during which the light valve is opened at the second position can be set during the initialization process of the display module; or, the light valve at the first position is opened.
  • the third period T 3 of opening and the fourth period T 4 of the light valve opening of the second position may also be carried in the first control signal.
  • the interval between opening the light valve in the first position and opening the light valve in the second position is a preset time period ⁇ t.
  • the preset time period ⁇ t can be found in the above-mentioned relevant introduction, and will not be described again here.
  • the light valve opens the light valve at the first position in the third period according to the received second control signal, and in the third period, the first light beam in the surface beam emitted by the surface light source is emitted through the first position; and In the fourth period, the light valve at the second position is opened. In the fourth period, the second beam of the surface beam emitted by the surface light source is emitted through the second position.
  • the first light beam is a partial light beam in the surface beam
  • the second light beam is also a partial light beam in the surface light beam. The first light beam and the second light beam emit from the light valve at different positions.
  • the first beam and the second beam can be adjusted more accurately, so that in the eye tracking state, the switching of the first beam and the second beam is smoother, and the image flickering observed by the observer moving within the eye box Fewer and more stable; and by controlling the opening width of the light valve, it can accurately match a larger viewing depth range.
  • the optical shaping component is used to adjust the direction of the first light beam to obtain the third light beam, and adjust the direction of the second light beam to obtain the fourth light beam.
  • the optical shaping component is used to change the propagation direction of the first light beam from the light source assembly so that the first light beam is focused to a certain position, and to change the propagation direction of the second light beam from the light source assembly so that the second light beam is focused. to another location.
  • optical shaping component The following exemplarily illustrates two possible structures of the optical shaping component.
  • the optical shaping component includes a lens.
  • the lens includes a spherical lens, an aspheric lens or a Fresnel lens (see Figure 9a).
  • Fresnel lenses can also be called threaded lenses.
  • One side of the surface of the Fresnel lens is smooth, and the other side is inscribed with concentric circles (or textures or Fresnel strips) from small to large. Therefore, the Fresnel lens can make the aberration at the edge of the image smaller. Since the curvature of the aspherical lens continuously changes from the center to the edge, the aspherical lens can focus the light beams in different directions on the same fixed point, thus reducing the aberration at the edge of the display module's field of view.
  • the material of the lens may be optical materials such as glass, resin, or crystal.
  • the material of the lens is resin, the quality of the display module can be reduced.
  • the material of the lens is glass, it helps to improve the imaging quality of the display module and suppress temperature drift. This application does not limit the material of the lens.
  • the optical shaping component includes a lens array.
  • the lens array includes a spherical lens array (see Figure 9b), an aspherical lens array (see Figure 9c) or a Fresnel lens array (see Figure 9d).
  • the pitch p of the lens array refers to the effective diameter or effective aperture size of a single lens in the lens array. Due to the aspherical lens array, the aberration at the edge of the field of view of the display module can be reduced, and in the case of a larger field of view (FOV), the light source component can also be designed as a planar light source array, thus Processing and assembly complexity can be reduced.
  • the lens array may be a planarly distributed lens array. Based on this, it helps to reduce the thickness of the display module.
  • the optical shaping component includes a lens array.
  • one lens in the lens array corresponds to at least two light sources in the light source array.
  • part of the light sources among the plurality of light sources corresponding to one lens serve as the first light source
  • other part of the light sources serve as the second light source.
  • one lens can correspond to two light sources, one of which serves as the first light source and the other as the second light source.
  • one lens can correspond to at least four light sources. It can also be understood that for each lens in the lens array, it has a light source corresponding to the position of an observer's left eye and a light source corresponding to the position of the right eye.
  • the number of first light sources (or second light sources) turned on in a certain period of time is related to the lateral width of the first light source (or second light source), the first light source array (or second light source array)
  • the density is related to the number of lenses included in the lens array, where the lateral direction of the first light source (or the second light source) refers to the direction parallel to the pitch p of the lenses.
  • the total lateral width of the first light source (or second light source) that needs to be turned on each time is certain, and the number of first light sources (or second light sources) turned on is the same as a single
  • the lateral width of the first light source (or second light source) is related to the density of the first light source array (or second light source array). The smaller the lateral width and the greater the density, the first light source (or second light source) that is turned on once The greater the number.
  • the light modulation component is used to modulate the third light beam to obtain a first image light carrying the first image information; and to modulate the fourth light beam to obtain a second light beam carrying the second image information.
  • Image light can load (or modulate) the first image information into the third light beam to obtain the first image light carrying the image information; load the second image information into the fourth light beam to obtain the third light beam carrying the image information.
  • the third beam and the fourth beam may be called optical carriers. It can be understood that in order to achieve a 3D display effect, the first image information and the second image information are different.
  • the light modulation component can switch the first image information and the second image information at high frequency, so that it can be This makes the images reaching the left and right eyes of the observer different, thereby achieving 3D display.
  • the light modulation component can be a liquid crystal on silicon (LCOS) display, a liquid crystal display (LCD), a digital light processing (DLP) display, a laser line scan ( laser beam scanning (LBS) display, organic light emitting diode (OLED), micro light emitting diode (micro light emitting diode, micro-LED), active matrix organic light emitting diode or active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (FLED), quantum dot light emitting diode (QLED), digital micro-mirror device , DMD) reflective display screen, etc.
  • LCOS liquid crystal on silicon
  • LCD liquid crystal display
  • DLP digital light processing
  • LBS laser line scan
  • OLED organic light emitting diode
  • micro light emitting diode micro light emitting diode
  • micro-LED active matrix organic light emitting diode or active matrix organic light emitting diode
  • the display screen may include a light source component, an optical shaping component and a light modulation component.
  • the light source component takes a surface light source and a light valve as an example.
  • the position of the light valve can emit part of the surface beam emitted by the surface light source (called the first beam or the second beam).
  • the emitted first beam or the second beam The divergence angle ⁇ .
  • the optical shaping component takes a spherical lens array as an example
  • the light modulation component takes an LCD as an example.
  • the display screen may include a light source component, an optical shaping component and a light modulation component.
  • the light source component is a planarly distributed light source array disposed on the substrate as an example
  • the optical shaping component is a planarly distributed aspherical lens array as an example
  • the light modulation component is an LCD as an example.
  • the planarly distributed aspherical lens array and the planarly distributed light source array can realize a dense light source array and a short-focus lens array with a small lateral width, thereby reducing the thickness of the display module.
  • display modules can be compressed to the millimeter level.
  • the aspherical lens array can make the aberration of the edge field of view smaller, thereby reducing the complexity of processing and assembly of the display module in the case of a large FOV.
  • the illuminated light source array can realize the division of multiple viewing areas in the eye box, allowing observers to perform 3D viewing at different positions of the eye box.
  • Figure 11 is a schematic diagram of an optical path of a display screen provided in this application.
  • the first light source in the light source array is turned on, and the turned on first light source is used to emit the first light beam (indicated by a solid line).
  • the first light beam is directed through the corresponding aspherical lens in the aspherical lens array to obtain the third
  • the third light beam is modulated by the LCD to obtain the first image light carrying the first image information, and the first image light is used for imaging in the left eye.
  • the second light source in the light source array is turned on.
  • the turned on second light source is used to emit a second light beam (indicated by a dotted line).
  • the second light beam is adjusted by the corresponding aspherical lens in the aspherical lens array to obtain a fourth light beam.
  • the fourth light beam is After being modulated by the LCD, the second image light carrying the second image information is obtained, and the second image light is used for imaging in the right eye.
  • the reflective component is used to reflect the first image light to the observer's left eye for imaging, and to reflect the second image light to the observer's right eye for imaging, so that the observer can observe a 3D image.
  • Figure 12 is an example in which the reflective component includes a free-form surface reflector.
  • the reflective assembly includes at least one reflective element.
  • the reflective element may include, for example, but is not limited to, a plane reflector, a spherical reflector, a free-curved mirror or a semi-transparent and semi-reflective mirror (semi-transparent and semi-reflective mirror).
  • a semi-transparent mirror can also be called a beam splitter, a beam splitter or a semi-reflective semi-reflective mirror. It is a semi-reflective film coated on optical glass, or a semi-transparent and semi-reflective film is coated on an optical surface of a lens. , an optical element that changes the original transmission and reflection ratio of the incident light beam. By coating the film layer, you can increase the light intensity by increasing the transmittance; you can also increase the reflection and reduce the light intensity.
  • the display module includes a display screen and a reflective component.
  • the display screen may include a light source component, an optical shaping component and a light modulation component.
  • the light source component is a planarly distributed light source array disposed on the substrate as an example
  • the optical shaping component is a planarly distributed aspherical lens array as an example
  • the light modulation component is an LCD as an example.
  • the reflective component takes the reflective component shown in Figure 12 as an example.
  • L is the length of the formed light spot (or light bar), and L needs to cover the left eye without affecting the right eye, or it needs to cover the right eye without affecting the left eye.
  • the pitch p of the aspherical lenses in the aspherical lens array satisfies the following formula 1.
  • ⁇ is the larger divergence angle of the first beam and the second beam
  • t is the distance between the light-emitting surface of the light source array and the surface of the aspherical lens array close to the LCD
  • h is the first The lateral luminous width of the light source or second light source.
  • the lateral width can be understood as the sum of the lateral widths of all the first light sources corresponding to an aspherical lens or the sum of the lateral widths of all the corresponding second light sources.
  • an aspherical lens corresponds to two first light sources and two second light sources.
  • h is the sum of the lateral widths of the two first light sources, or h is the sum of the lateral widths of the two second light sources.
  • t satisfies the following imaging formula 2, and may be 10 mm, for example.
  • the divergence angle of the first light beam and the divergence angle of the second light beam can be set.
  • the divergence angle of the first light source and the emission angle of the second light source can be set, or a light valve that opens the first position can be set. a first width and a second width that opens the light valve in a second position.
  • the divergence angle of the first light beam may be the same as the divergence angle of the second light beam, or may be different, which is not limited in this application.
  • the divergence angle of the first light source in the light source array is the divergence angle of the first light beam
  • the divergence angle of the second light source is the divergence angle of the second light beam.
  • f2 is the equivalent focal length of the aspherical lens array
  • d is the distance between the aspherical lens array and the virtual eyebox surface
  • d satisfies the following formula 3.
  • W is the inter-eye distance between the observer's left eye and right eye, usually about 65mm
  • d1 is the distance between the actual eye box surface and the reflective component
  • d3 is the distance between the virtual eye box surface and the reflective component distance.
  • d1 and d3 satisfy the following imaging formula 4.
  • f1 is the equivalent focal length of the reflective component.
  • the reflective component is a planar reflective element
  • the size of the actual eye box surface is the same as the size of the virtual eye box surface
  • the distance d1 between the actual eye box surface and the reflective component and the distance d1 between the virtual eye box surface and the reflective component The distance d3 is the same
  • the pitch p of the aspherical lenses in the aspherical lens array also satisfies the following formula 5.
  • W eye is the virtual eye distance on the virtual eye box surface
  • the virtual eye box surface is the virtual image formed by the reflection of the actual eye box surface by the reflective component.
  • W eye satisfies the following formula 6.
  • the aspherical lens when the aspherical lens is close to the light source, the light energy emitted by the light source covers a very small range.
  • an aspherical lens array composed of small-pitch aspherical lenses combined with a corresponding dense light source array, the uniformity of the image displayed by the display module can be improved.
  • the above-mentioned display module may include, but is not limited to, NED equipment, vehicle-mounted display screen or HUD, etc.
  • this application can also provide an optical display system.
  • Figure 15 is a schematic structural diagram of an optical display system provided by this application.
  • the optical display system may include the display module in any of the above embodiments, and the details will not be repeated here.
  • the optical display system may also include a control module, and the control module is connected to the display module.
  • the control module is used to control the display module to display images.
  • the optical display system may also include an eye tracking module, and the eye tracking module is connected to the control module.
  • the control module can receive left eye position information and right eye position information from the eye tracking module.
  • control module and eye tracking module are introduced separately below.
  • the control module can receive the observer's left eye position information and right eye position information from the eye tracking module, and determine that the light source component needs to be turned on based on the left eye position information.
  • the position information of the first light source, and the position information of the second light source that the light source component needs to be turned on is determined based on the right eye position information; the first control signal is generated based on the position information of the first light source and the position information of the second light source.
  • the control module can determine the first position information of the light valve based on the left eye position information, and determine the second position information of the light valve based on the right eye position information; and based on the third position information of the light valve.
  • the first position information and the second position information of the light valve generate a second control signal.
  • the control module may include a processor.
  • the processor may be a circuit with signal (or data) processing capabilities.
  • the processor may be a circuit with instruction reading and execution capabilities.
  • a central processing unit CPU
  • a microprocessor e.g., a central processing unit (CPU)
  • GPU graphics processing unit
  • DSP digital signal processor
  • the processor can implement certain functions through the logical relationship of the hardware circuit, and the logical relationship of the hardware circuit is fixed or reconfigurable.
  • the processor is an application-specific integrated circuit (application-specific integrated circuit, Hardware circuits implemented by ASIC) or programmable logic device (PLD), such as field programmable gate array (FPGA).
  • FPGA field programmable gate array
  • the processor loads the configuration file,
  • the process of realizing hardware circuit configuration can be understood as the process of loading instructions by the processor to realize the functions of some or all of the above units.
  • the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (neural network processing unit, NPU), tensor processing unit (TPU), deep learning Processing unit (deep learning processing unit, DPU), etc.
  • AP application processor
  • ISP image signal processor
  • eye tracking refers to tracking eye movement by measuring the position of the gaze point of the eye or the movement of the eyeball relative to the head.
  • the eye tracking module is a device that can track and measure eye position and eye movement information.
  • the eye tracking module tracks and outputs the position of the observer's eyes in real time and transmits it to the control module, so that the control module controls to turn on the first light source or the second light source corresponding to the position of the human eye, and switches the left eye corresponding to the first light source at high speed.
  • the eye tracking module continuously monitors the position of the human eye. When the human eye position moves, the eye tracking module obtains new position information and transmits the position information to the control module.
  • the eye tracking module can specifically determine the convergence depth of the binocular gaze image (i.e., binocular viewpoint).
  • the principle of convergence adjustment conflict is exemplarily shown.
  • the vergence accommodation conflict is due to the fact that when the human eye observes three-dimensional (3D) content, the correct binocular lens focus depth is always fixed on the screen, while the binocular vergence converges at the target distance defined by the parallax, which may be located In front of the screen, it may also be located behind the screen.
  • the mismatch between the focus depth and the vergence depth causes a convergence adjustment conflict.
  • the eye tracking module may include, but is not limited to, a camera, an infrared emitter or an infrared detector, etc. Further, optionally, the eye tracking module also includes a processor.
  • FIG. 17 is a schematic circuit diagram of an optical display system provided by this application.
  • the circuit in the optical display system mainly includes a processor 1701, an external memory interface 1702, an internal memory 1703, an audio module 1704, a video module 1705, a power module 1706, a wireless communication module 1707, input/output (I/O ) interface 1708, video interface 1709, display circuit 1710, modulator 1711, light source 1712, etc.
  • the processor 1701 and its peripheral components such as external memory interface 1702, internal memory 1703, audio module 1704, video module 1705, power module 1706, wireless communication module 1707, I/O interface 1708, video interface 1709, display circuit 1710 Can be connected via bus.
  • the circuit diagram schematically illustrated in this application does not constitute a specific limitation on the optical display system.
  • the optical display system may include more or fewer components than shown in the figures, or some components may be combined, or some components may be separated, or may be arranged differently.
  • the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 1701 includes one or more processing units.
  • the processing unit may be a circuit with signal (or data) processing capabilities.
  • signal (or data) processing capabilities For details, please refer to the above-mentioned relevant introductions, which will not be repeated here.
  • different processing units can be independent devices or integrated in one or more processors.
  • the processor 1701 may also be provided with a memory for storing instructions and data.
  • the memory in processor 1701 is cache memory. This memory can store instructions or data that have just been used or recycled by the processor 1701. according to. If the processor 1701 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 1701 is reduced, thereby improving the efficiency of the optical display system.
  • the processor 1701 can execute stored instructions to perform the above imaging method.
  • the optical display system may also include a plurality of input/output (I/O) interfaces 1708 connected to the processor 1701 .
  • the I/O interface 1708 may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and universal asynchronous reception and transmission.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • UART Universal asynchronous receiver/transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • the above-mentioned I/O interface 1708 can be connected to devices such as a mouse, touch pad, keyboard, camera, speaker/speaker, microphone, etc., or can be connected to physical buttons on the optical display system (such as volume keys, brightness adjustment keys, power on/off keys, etc.).
  • the external memory interface 1702 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the optical display system.
  • the external memory card communicates with the processor 1701 through the external memory interface 1702 to implement the data storage function.
  • Internal memory 1703 may be used to store computer executable program code, which includes instructions.
  • the internal memory 1703 may include a program storage area and a data storage area.
  • the stored program area can store the operating system, at least one application program required for the function, etc.
  • the storage data area can store data created during the use of the optical display system, etc.
  • the internal memory 1703 may include random access memory (RAM), flash memory, universal flash storage (UFS), read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically erasable programmable read-only memory (electrically EPROM, EEPROM), register, hard disk, mobile hard disk, CD-ROM or in this field any other well-known storage medium.
  • the processor 1701 executes various functional applications and data processing of the optical display system by executing instructions stored in the internal memory 1703 and/or instructions stored in a memory provided in the processor 1701 .
  • An exemplary storage medium is coupled to the processor such that the processor can read information from the storage medium and write information to the storage medium.
  • the storage medium may also be an integral part of the processor.
  • the processor and storage media may be located in an ASIC.
  • the ASIC can be located in an optical display system.
  • the processor and storage medium may also exist as discrete components in the optical display system.
  • the optical display system can implement audio functions through the audio module 1704 and application processor. For example, music playback, phone calls, etc.
  • the audio module 1704 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.
  • the audio module 1704 can also be used to encode and decode audio signals, such as playing or recording.
  • the audio module 1704 may be provided in the processor 1701, or some functional modules of the audio module 1704 may be provided in the processor 1701.
  • the video interface 1709 can receive external input audio and video signals, which can specifically be a high definition multimedia interface (HDMI), a digital visual interface (DVI), or a video graphics array (VGA). , display port (display port, DP), etc., the video interface 1709 can also output video to the outside.
  • HDMI high definition multimedia interface
  • DVI digital visual interface
  • VGA video graphics array
  • display port display port, DP
  • the video interface 1709 can also output video to the outside.
  • the video interface 1709 can receive speed signals and power signals input from peripheral devices, and can also receive externally input AR video signals.
  • the optical display system acts as a projection
  • the video interface 1709 can receive video signals input from an external computer or terminal device.
  • the video module 1705 can decode the video input by the video interface 1709, for example, perform H.264 decoding.
  • the video module can also encode the video collected by the optical display system, such as H.264 encoding of the video collected by an external camera.
  • the processor 1701 can also decode the video input from the video interface 1709 and then output the decoded image signal to the display circuit 1710 .
  • the power module 1706 is used to provide power to the processor 1701 and the light source 1712 according to the input power (such as direct current).
  • the power module 1706 may include a rechargeable battery, and the rechargeable battery may provide power to the processor 1701 and the light source 1712.
  • the light emitted by the light source 1712 can be transmitted to the modulator 1711 for imaging, thereby forming an image light signal.
  • the wireless communication module 1707 can enable the optical display system to communicate wirelessly with the outside world, and can provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT) , Global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • Wi-Fi wireless fidelity
  • Bluetooth bluetooth, BT
  • GNSS Global navigation satellite system
  • FM frequency modulation
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the wireless communication module 1707 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 1707 receives electromagnetic waves through the antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 1701 .
  • the wireless communication module 1707 can also receive the signal to be sent from the processor 1701, frequency modulate it
  • the video data decoded by the video module 1705 can also be received wirelessly through the wireless communication module 1707 or read from an external memory.
  • the optical display system can use the wireless LAN in the car. Receive video data from the terminal device or car entertainment system, the optical display system can also read the audio and video data stored in the external memory.
  • the display circuit 1710 and the modulator 1711 are used to display corresponding images.
  • the video interface 1709 receives an externally input video source signal.
  • the video module 1705 decodes and/or digitizes the signal and outputs one or more image signals to the display circuit 1710.
  • the display circuit 1710 drives the modulation according to the input image signal.
  • the detector 1711 images the incident polarized light, and then outputs at least two channels of image light.
  • the processor 1701 can also output one or more image signals to the display circuit 1710 .
  • the optical display system may include but is not limited to HUD, projector, display, vehicle display screen, AR device, VR device, or smart car lights, etc.
  • the AR device may include but is not limited to AR glasses or AR helmet, etc.
  • VR equipment may include but is not limited to VR glasses or VR helmets, etc.
  • the present application can also provide a terminal device. Based on the structure and functional principles of the optical display device described above, the present application can also provide a terminal device.
  • the terminal device may include the display module in any of the above embodiments.
  • the terminal device may be a vehicle (such as an unmanned vehicle, a smart vehicle, an electric vehicle, or a digital vehicle, etc.), a robot, a mapping device, a drone, or a smart home device (such as a television, a sweeping robot, or a smart desk lamp).
  • audio system intelligent lighting system, electrical control system, home background music, home theater system, intercom system, or video surveillance, etc.
  • intelligent manufacturing equipment such as industrial equipment
  • intelligent transportation equipment such as AGV, unmanned transport vehicle
  • smart terminals mobile phones, computers, tablets, PDAs, desktops, headsets, speakers, wearable devices, vehicle-mounted devices, virtual reality devices, augmented reality devices, etc.
  • terminal device 1800 may include propulsion system 1801, sensing system 1802, Control system 1803, computer system 1804, user interface 1805 and optical display system 1806.
  • the components of terminal device 1800 may be configured to operate in interconnection with each other and/or with other components coupled to various systems.
  • computer system 1804 may be configured to receive data from and control propulsion system 1801, sensing system 1802, control system 1803, and the like.
  • Computer system 1804 may also be configured to generate a display of the image on user interface 1805 and receive input from user interface 1805 .
  • Propulsion system 1801 may provide powered motion for terminal device 1800.
  • Propulsion system 1801 may include an engine/motor, energy source, transmission, and wheels/tyres. Additionally, propulsion system 1801 may additionally or alternatively include other components in addition to those shown in FIG. 18 . This application does not specifically limit this.
  • the sensing system 1802 may include several sensors for sensing information about the environment in which the terminal device 1800 is located, and the like.
  • the sensors of the sensing system 1802 may include, but are not limited to, global positioning system (GPS), inertial measurement unit (IMU), millimeter wave radar, lidar, cameras, and sensors for modifying the position and/or orientation of the brake.
  • Millimeter wave radar may utilize radio signals to sense targets in the surrounding environment of the terminal device 1800 .
  • millimeter wave radar may be used to sense the speed and/or heading of the target.
  • LiDAR can utilize laser light to sense targets in the environment where the terminal device 1800 is located.
  • a lidar may include one or more laser sources and one or more detectors, among other system components.
  • the camera may be used to capture multiple images of the surrounding environment of the terminal device 1800 .
  • the camera can be a still camera or a video camera.
  • GPS may be any sensor used to estimate the geographic location of terminal device 1800 .
  • the GPS may include a transceiver that estimates the position of the terminal device 1800 relative to the Earth based on satellite positioning data.
  • computer system 1804 may be used to estimate the road traveled by terminal device 1800 using GPS in conjunction with map data.
  • the IMU may be used to sense changes in position and orientation of the terminal device 1800 based on inertial acceleration and any combination thereof.
  • the combination of sensors in the IMU may include, for example, an accelerometer and a gyroscope. Additionally, other combinations of sensors in the IMU are possible.
  • the sensing system 1802 may also include sensors of internal systems of the terminal device 1800 being monitored (eg, in-vehicle air quality monitor, fuel gauge, oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding properties (position, shape, orientation, speed, etc.). This detection and identification is a critical function for the secure operation of terminal device 1800. Sensing system 1802 may also include other sensors. This application does not specifically limit this.
  • the control system 1803 controls the operation of the terminal device 1800 and its components.
  • the control system 1803 may include various elements, including steering units, throttles, braking units, sensor fusion algorithms, computer vision systems, route control systems, and obstacle avoidance systems.
  • the steering system is operable to adjust the forward direction of the terminal device 1800.
  • it may be a steering wheel system.
  • the throttle is used to control the operating speed of the engine and thus the speed of the terminal device 1800 .
  • Control system 1803 may additionally or alternatively include other components in addition to those shown in FIG. 18 . This application does not specifically limit this.
  • the braking unit is used to control the terminal equipment 1800 to decelerate. Braking units use friction to slow down the wheels.
  • the braking unit may convert the kinetic energy of the wheels into electrical current.
  • the braking unit may also take other forms to slow down the wheel speed to control the speed of the terminal device 1800 .
  • the computer vision system may be operable to process and analyze images captured by the camera in order to identify objects and/or features in the environment surrounding the terminal device 1800 . Objects and/or features may include traffic signals, road boundaries, and obstacles.
  • Computer vision systems can use target recognition algorithms, structure from motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, computer vision systems can be used to map an environment, track targets, estimate a target's speed, and so on. Route control systems are used to determine terminal equipment 1800 driving route.
  • the route control system may combine data from the sensing system 1802, GPS, and one or more predetermined maps to determine a driving route for the terminal device 1800.
  • An obstacle avoidance system is used to identify, evaluate, and avoid or otherwise negotiate potential obstacles in the environment of terminal device 1800 .
  • control system 1803 may additionally or alternatively include components in addition to those shown and described. Alternatively, some of the components shown above may be reduced.
  • the computer system 1804 may include at least one processor 18041. Further, the computer system 1804 may also include an interface circuit 18042. Processor 18041 executes instructions stored in a non-transitory computer-readable medium such as memory 18043. Computer system 1804 may also be multiple computing devices that control individual components or subsystems of terminal device 1800 in a distributed manner.
  • the processor 18041 may be a circuit with signal (or data) processing capabilities. For details, please refer to the above related introduction, which will not be described again here.
  • FIG. 18 functionally illustrates the processor, memory, and other elements of computer system 1804 in the same block
  • the processor and memory may not actually be stored in the same physical enclosure. multiple processors or memories within.
  • the memory may be a hard drive or other storage medium located in a housing different from computer system 1804.
  • some components such as the steering component and the deceleration component, may each have their own processor that only performs calculations related to component-specific functionality.
  • the processor can also be remote from the vehicle but can communicate wirelessly with the vehicle.
  • memory 18043 may contain instructions (eg, program logic) that may be read by processor 18041 to perform various functions of terminal device 1800, including the functions described above.
  • Memory 18043 may also contain additional instructions, including instructions to send data to, receive data from, interact with, and/or control one or more of propulsion system 1801 , sensing system 1802 , and control system 1803 .
  • the memory 18043 may also store data such as road maps, route information, data detected by sensors, vehicle position, direction, speed and other such vehicle data, as well as other information. This information may be used by terminal device 1800 and computer system 1804 when terminal device 1800 is in autonomous, semi-autonomous and/or manual modes.
  • User interface 1805 used to provide information to or receive information from the user of the terminal device 1800.
  • user interface 1805 may include one or more input/output devices within a collection of peripheral devices, which may include, for example, a wireless communication system, a touch screen, a microphone and/or a speaker, and the like.
  • Computer system 1804 may control the functionality of terminal device 1800 based on input received from various subsystems (eg, propulsion system 1801 , sensing system 1802 , and control system 1803 ) and from user interface 1805 .
  • computer system 1804 may utilize input from control system 1803 in order to control the steering unit to avoid obstacles detected by sensing system 1802 and obstacle avoidance system.
  • computer system 1804 is operable to provide control over many aspects of terminal device 1800 and its subsystems.
  • the optical display system 1806 can be referred to the introduction of any of the previous embodiments, and will not be described again here. It should be noted that the functions of some components in the optical display system can also be implemented by other subsystems of the vehicle.
  • the controller can also be a component in the control system.
  • one or more of the components described above may be installed separately from or associated with the terminal device 1800 .
  • the memory 18043 may exist partially or completely separately from the terminal device 1800.
  • the components described above may be communicatively coupled together in wired and/or wireless manners.
  • terminal device functional framework shown in Figure 18 is just an example.
  • the terminal device 1800 may include more, fewer, or different systems, and each system may include more, less, or different components.
  • systems and components shown can be combined or divided in any way, which is not specifically limited in this application.
  • this application provides an imaging method, please refer to the introduction of Figure 19.
  • This imaging method can be applied to the display module or optical display system or terminal device shown in any of the above embodiments. It can also be understood that the imaging method can be implemented based on the display module or optical display system or terminal device shown in any of the above embodiments.
  • the following takes the light source component as a light source array as an example. The method includes the following steps:
  • Step 1901 The eye tracking module detects the position of the observer's left eye and right eye.
  • the process and principle of the eye tracking module detecting the position of the observer's left eye and right eye can be found in the relevant introduction mentioned above and will not be described again here.
  • Step 1902 The eye tracking module sends left eye position information and right eye position information to the control module.
  • the control module receives left eye position information and right eye position information from the eye tracking module.
  • the eye tracking module is connected with the control module.
  • Step 1903 The control module determines the position information of the first light source based on the left eye position information and the first corresponding relationship, and determines the position information of the second light source based on the right eye position information and the second corresponding relationship.
  • the first correspondence relationship includes the relationship between the position of the left eye and the position information of the first light source
  • the second correspondence relationship includes the correspondence relationship between the position of the right eye and the position information of the second light source. It should be noted that the first correspondence relationship and the second correspondence relationship may be in the form of a table, or may be in other possible forms, which is not limited in this application.
  • Table 1 and Table 2 exemplarily show the first correspondence relationship and the second correspondence relationship.
  • the position information of the first light source and the position information of the second light source in Table 1 and Table 2 are both represented by the rows and columns of the first light source and the second light source in the light source array.
  • control module can also obtain the first period T 1 during which the first light source is turned on, the second period T 2 during which the second light source is turned on, the switching frequency v1 of the first light source, and the switching frequency v2 of the second light source. wait.
  • the first period T 1 during which the first light source is turned on and the switching frequency v1 of the first light source can be carried in the first control signal and sent to the light source array.
  • the second period T 2 during which the second light source is turned on and the switching frequency v2 of the second light source may be carried in the second control signal and sent to the light source array.
  • Step 1904 The control module generates a first control signal based on the position information of the first light source and the position information of the second light source.
  • the first control signal includes position information of the first light source and position information of the second light source.
  • Step 1905 The control module generates a third control signal based on the position information of the first light source and the position information of the second light source.
  • the third control signal is used to control the light modulation component to switch the frequency of the first image information and the second image information.
  • Step 1904 may be executed first and then step 1905, or step 1905 may be executed first and then step 1904, or step 1904 and step 1905 may be synchronized. Execution, that is, the first control signal and the third control signal are generated synchronously, which is not limited in this application.
  • Step 1906 The control module sends a first control signal to the light source component and a third control signal to the light modulation component.
  • the light source component receives the first control signal from the control module
  • the light modulation component receives the third control signal from the control module.
  • Step 1907 The light source component turns on the first light source in the light source array during the first period and turns on the second light source in the light source array during the second period according to the received first control signal.
  • the first light source that is turned on is used to emit a first light beam
  • the second light source that is turned on is used to emit a second light beam.
  • Step 1908 The light modulation component modulates the third light beam according to the third control signal to obtain the first image light carrying the first image information, and modulates the fourth light beam to obtain the second image light carrying the second image information.
  • the third control signal includes the switching frequency of the first image information and the second image information.
  • This switching frequency can be changed based on minimum requirements (i.e. the flicker frequency cannot be distinguished by the human eye) and user needs.
  • the switching frequency of the first image information and the second image information is equal to the sum of the switching frequency of the first light source and the switching frequency of the second light source.
  • the switching frequency of the first light source ⁇ 1 1/60 second
  • the switching frequency of the second light source ⁇ 2 1/60 second. It can be understood that after the optical display system starts to operate, the switching frequency of the first image information and the second image information is usually fixed.
  • the interval between the switching time of the light modulation component and the turning on time of the first light source is ⁇ T, where ⁇ T can also be preset during the initialization process of the display module. It should be understood that ⁇ T may be equal to 0 or not equal to 0, and this application does not limit this.
  • the display module can be controlled to display images. If the first image information and the second image information are the same, the display module can realize two-dimensional image display. If the first image information and the second image information are different, the display module can realize three-dimensional image display.
  • the eye tracking module continues to monitor the position of the human eye, and the eye tracking module continues to perform the above step 1901.
  • the eye tracking module detects the new positions of the left eye and the right eye, and repeats the above steps 1902 to 1908.
  • the first control signal in step 1902 does not change, and the first control signal continues to be sent to light the corresponding first light source or second light source.
  • Figure 20a is an optical path diagram of an observer's left eye and right eye at position 1 provided by this application.
  • the eye tracking module detects that the observer's left eye and right eye are at position 2, the optical path based on the display module can be seen in Figure 20b.
  • the control module determines the first position information of the light valve according to the left eye position information and the third corresponding relationship, and determines the first position information of the light valve according to the right eye position information. and the fourth pair The second position information of the light valve should be determined according to the relationship.
  • Table 3 and Table 4 exemplarily show the third correspondence relationship and the fourth correspondence relationship.
  • the first position information of the light valve includes the first width and the first center coordinate of the light valve as an example.
  • the second position information of the light valve includes the second width and the second center coordinate of the light valve. example.
  • first width 11, the first width 12... the first width 1n in the above Table 3 can be the same or different
  • second width 21, the second width 22... the second width 2n can be the same or different.
  • the first width and the second width may be the same or different, which is not limited in this application.
  • the above examples are based on the third correspondence relationship and the fourth correspondence relationship in different tables. It should be understood that the third corresponding relationship and the fourth corresponding relationship may also be in the same table, and this application does not limit this.
  • the above step 1904 may specifically include the control module generating a second control signal based on the first position information of the light valve and the second position information of the light valve.
  • control device includes corresponding hardware structures and/or software modules that perform each function.
  • modules and method steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software driving the hardware depends on the specific application scenarios and design constraints of the technical solution.
  • FIG. 21 and FIG. 22 are schematic structural diagrams of possible control devices provided by the present application. These control devices can be used to implement the functions of the control devices in the above method embodiments, and therefore can also achieve the beneficial effects of the above method embodiments.
  • control device 2100 includes a processing module 2101 and a transceiver module 2102.
  • the control device 2100 is used to implement the functions of the control device in the method embodiment shown in FIG. 19 .
  • the processing module 2101 coordinates with the transceiver module 2102 to control the light source component to emit the first beam and the second beam in a time-sharing manner, the first beam and The exit position of the second beam is different.
  • the first beam is adjusted to a third beam through the optical shaping component, and the second beam is adjusted to a fourth beam through the optical shaping component.
  • the light modulating component is controlled to modulate the third beam to carry the first image information.
  • the first image light is optically modulated on the fourth beam to obtain the second image light carrying the second image information; the first image light is reflected to the observer through the reflective component The left eye of the observer is imaged, and the second image light is reflected by the reflective component to the observer's right eye for imaging.
  • processing module 2101 in the embodiment of the present application can be implemented by a processor or processor-related circuit components
  • transceiver module 2102 can be implemented by a transceiver or transceiver-related circuit components.
  • the control device 2200 may include a processor 2201 and an interface circuit 2202.
  • the processor 2201 and the interface circuit 2202 are coupled to each other.
  • the interface circuit 2202 may be a transceiver or an input-output interface.
  • the control device 2200 may also include a memory 2203 for storing instructions executed by the processor 2201 or input data required for the processor 2201 to run the instructions or data generated after the processor 2201 executes the instructions.
  • control device 2200 When the control device 2200 is used to implement the method shown in Figure 19, the processor 2201 is used to perform the functions of the above-mentioned processing module 2101, and the interface circuit 2202 is used to perform the functions of the above-mentioned transceiver module 2102.
  • a computer program product includes one or more computer programs or instructions.
  • the computer may be a general purpose computer, a special purpose computer, a computer network, a control device, user equipment or other programmable device.
  • a computer program or instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., a computer program or instructions may be transferred from a website, computer, server, or data center Transmission by wired or wireless means to another website site, computer, server or data center.
  • Computer-readable storage media can be any available media that can be accessed by a computer, or data storage devices such as servers and data centers that integrate one or more available media. Available media can be magnetic media, such as floppy disks, hard disks, tapes; optical media, such as digital video discs (DVD); or semiconductor media, such as solid state drives (SSD) ).
  • a, b or c can mean: a, b, c, "a and b", “a and c", “b and c”, or “a and b and c” ”, where a, b, c can be single or multiple.
  • the character “/” generally indicates that the related objects are in an "or” relationship.
  • the character “/” indicates that the related objects are in a “division” relationship.
  • the word “exemplary” is used to mean an example, illustration, or illustration. Any embodiment or design described herein as “example” is not intended to be construed as preferred or advantageous over other embodiments or designs. Alternatively, it can be understood that the use of the word “example” is intended to present concepts in a specific manner and does not constitute a limitation on this application.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

A display module, an optical display system, a terminal device, and an imaging method, for use in solving the problem in the prior art of resolution loss of image display, and applied to a head-up display (HUD) device, a near-eye display (NED) device, or vehicle-mounted display and the like. The display module comprises: a light source assembly used for emitting a first light beam and a second light beam in different time periods, respectively, exit positions of the first light beam and the second light beam being different; an optical shaping assembly used for adjusting the direction of the first light beam to obtain a third light beam and adjusting the direction of the second light beam to obtain a fourth light beam; a light modulating assembly used for modulating the third light beam to obtain first image light carrying first image information, and modulating the fourth light beam to obtain second image light carrying second image information; and a reflecting assembly used for reflecting the first image light to a left eye of an observer for imaging and reflecting the second image light to a right eye of the observer for imaging, wherein the optical shaping assembly is located between the light source assembly and the light modulating assembly. In this way, the resolution loss of images can be avoided.

Description

一种显示模组、光学显示系统、终端设备及成像方法A display module, optical display system, terminal equipment and imaging method
本申请要求于2022年8月26日提交中国国家知识产权局、申请号202211033849.X、申请名称为“一种显示模组、光学显示系统、终端设备及成像方法”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application requests the priority of a Chinese patent application filed with the State Intellectual Property Office of China on August 26, 2022, with application number 202211033849.X and the application title "A display module, optical display system, terminal equipment and imaging method" , the entire contents of which are incorporated herein by reference.
技术领域Technical field
本申请涉及显示技术领域，尤其涉及一种显示模组、光学显示系统、终端设备及成像方法。The present application relates to the field of display technology, and in particular, to a display module, an optical display system, a terminal device and an imaging method.
背景技术Background technique
三维(three dimensional，3D)显示可以给观察者很强的立体逼真感，而且会增加显示景深以及提升显示内容的丰富性。通常3D技术的实现是基于左眼和右眼两组图像信息，并将其投影到荧幕之上，观测者使用偏振光眼镜来分离图像信息，使得左眼获取一组图像信息，右眼获取另外一组图像信息。Three-dimensional (3D) display can give the observer a strong sense of three-dimensional realism, increase the display depth of field, and enhance the richness of the display content. Usually the implementation of 3D technology is based on two sets of image information for the left eye and the right eye, and projects them onto the screen. The observer uses polarized glasses to separate the image information, so that the left eye acquires a set of image information and the right eye Eyes obtain another set of image information.
随着3D显示技术的发展，裸眼3D显示技术(或称为视差屏障或视差障栅技术)已成为研究的热点之一。目前裸眼3D显示技术可以在不借助偏振光眼镜等外部工具，通过光屏障技术实现立体视觉效果。然而，基于光屏障技术显示的3D图像会造成分辨率的损失。With the development of 3D display technology, naked-eye 3D display technology (also known as parallax barrier or parallax barrier technology) has become one of the hot spots of research. At present, naked-eye 3D display technology can achieve stereoscopic visual effects through light barrier technology without the use of external tools such as polarized glasses. However, 3D images displayed based on light barrier technology will cause a loss of resolution.
综上所示，如何在不损失分辨率的情况下实现图像显示，是当前亟需解决的技术问题。To sum up, how to realize image display without losing resolution is a technical problem that needs to be solved urgently.
发明内容Contents of the invention
本申请提供一种显示模组、光学显示系统、终端设备及成像方法，用于减小或消除显示的图像存在分辨率损失的问题。The present application provides a display module, optical display system, terminal equipment and imaging method to reduce or eliminate the problem of resolution loss in displayed images.
第一方面，本申请提供一种显示模组，该显示模组包括光源组件、光学整形组件、光调制组件和反射组件，光学整形组件位于光源组件与光调制组件之间。光源组件用于分时发射第一光束及第二光束，第一光束和第二光束的出射位置不同。光学整形组件用于调整第一光束的指向得到第三光束，以及调整第二光束的指向得到第四光束。光调制组件用于对第三光束进行调制得到携带第一图像信息的第一图像光、以及对第四光束进行调制得到携带第二图像信息的第二图像光。反射组件用于将第一图像光反射至观察者的左眼成像，以及将第二图像光反射至观察者的右眼成像。In a first aspect, the present application provides a display module. The display module includes a light source component, an optical shaping component, a light modulating component and a reflecting component. The optical shaping component is located between the light source component and the light modulating component. The light source component is used to emit the first beam and the second beam in a time-sharing manner, and the first beam and the second beam have different exit positions. The optical shaping component is used to adjust the direction of the first light beam to obtain the third light beam, and adjust the direction of the second light beam to obtain the fourth light beam. The light modulation component is used to modulate the third light beam to obtain first image light carrying first image information, and to modulate the fourth light beam to obtain second image light carrying second image information. The reflective component is used to reflect the first image light to the observer's left eye for imaging, and to reflect the second image light to the observer's right eye for imaging.
基于上述显示模组，由于光学整形组件位于光源组件与光调制组件之间，光源组件可以与光学整形组件配合生成方向性背光，光调制组件通过时分的方式加载第一图像信息或第二图像信息，观察者单眼即可看到光调制组件的所有像素调制的第一图像信息或第二图像信息，因此，可以减小或避免显示的图像的分辨率的损失。进一步，第一图像光在左眼成像，第二图像光在右眼成像，观察者可以观察到不同的视差图像，若第一图像信息和第二图像信息不 同，可获得立体的3D图像效果。Based on the above display module, since the optical shaping component is located between the light source component and the light modulation component, the light source component can cooperate with the optical shaping component to generate directional backlight, and the light modulation component loads the first image information or the second image information in a time-division manner. , the observer can see the first image information or the second image information modulated by all pixels of the light modulation component with a single eye, therefore, the loss of resolution of the displayed image can be reduced or avoided. Further, the first image light is imaged on the left eye, and the second image light is imaged on the right eye. The observer can observe different parallax images. If the first image information and the second image information are different, At the same time, a three-dimensional 3D image effect can be obtained.
在一种可能的实现方式中，光源组件包括光源阵列，光源阵列包括第一光源和第二光源。光源组件用于根据接收到的第一控制信号，在第一时段第一光源发射第一光束、及在第二时段第二光源发射第二光束。In a possible implementation, the light source assembly includes a light source array, and the light source array includes a first light source and a second light source. The light source component is configured to, according to the received first control signal, the first light source emit the first light beam during the first period, and the second light source emit the second light beam during the second period.
通过光源阵列可以实现在眼盒中多视区的划分，使观察者在眼盒的不同位置都能进行观看。The light source array can realize the division of multiple viewing areas in the eye box, so that observers can watch at different positions of the eye box.
进一步，可选的，第一控制信号包括第一光源的位置信息、及第二光源的位置信息。Further, optionally, the first control signal includes position information of the first light source and position information of the second light source.
在一种可能的实现方式中，光源阵列中的光源呈平面分布。In a possible implementation, the light sources in the light source array are distributed in a plane.
通过平面分布的光源阵列可以减小显示模组的厚度，而且便于密集的光源阵列的加工。The planarly distributed light source array can reduce the thickness of the display module and facilitate the processing of dense light source arrays.
在另一种可能的实现方式中，光源阵列中的光源呈曲面分布。In another possible implementation, the light sources in the light source array are distributed in a curved surface.
通过曲面分布的光源阵列可以使得观察者在边缘和中央看到的图像基本一致，从而可以扩大显示模组的眼盒范围。The light source array distributed through the curved surface can make the images seen by the observer at the edge and the center basically the same, thereby expanding the eye box range of the display module.
在又一种可能的实现方式中，光源阵列中的光源呈多边行分布。In yet another possible implementation manner, the light sources in the light source array are distributed in polygonal rows.
通过多边形分布的光源阵列可以在尽可能减小显示模组的厚度的情况下，使得观察者在边缘和中央看到的图像尽可能一致，从而可以扩大显示模组的眼盒范围。The light source array distributed in a polygon can make the image seen by the observer at the edge and center as consistent as possible while reducing the thickness of the display module as much as possible, thereby expanding the eye box range of the display module.
在一种可能的实现方式中，光源组件包括面光源和光阀；面光源用于发射面光束；光阀用于根据接收到的第二控制信号，在第三时段打开第一位置的光阀，面光束中的第一光束经第一位置射出，以及在第四时段打开第二位置的光阀，面光束中的第二光束经第二位置射出。In a possible implementation, the light source assembly includes a surface light source and a light valve; the surface light source is used to emit a surface beam; the light valve is used to open the light valve in the first position in the third period according to the received second control signal, The first beam of the surface beam is emitted through the first position, and the light valve of the second position is opened during the fourth period, and the second beam of the surface beam is emitted through the second position.
进一步，可选的，第二控制信号包括光阀的第一位置信息、及光阀的第二位置信息。Further, optionally, the second control signal includes the first position information of the light valve and the second position information of the light valve.
通过光阀配合面光源可实现调制精度较高的像素化光源，使得在眼跟踪状态下，第一光束和第二光束的切换更平滑，观察者在眼盒内移动观察到的图像闪烁更少、更加稳定；且通过控制光阀开启的宽度，能够精准匹配更大的观看深度范围。By combining the light valve with the surface light source, a pixelated light source with high modulation accuracy can be achieved, making the switching between the first beam and the second beam smoother in the eye tracking state, and the image flicker observed by the observer moving within the eye box is less , more stable; and by controlling the opening width of the light valve, it can accurately match a larger viewing depth range.
进一步，面光源可以为平面型面光源，和/或，光阀可以为平面型光阀。Furthermore, the surface light source may be a planar surface light source, and/or the light valve may be a planar light valve.
通过平面型面光源和/或平面型光阀有助于减小显示模组的厚度。Using a flat surface light source and/or a flat light valve helps reduce the thickness of the display module.
在一种可能的实现方式中，光学整形组件包括透镜阵列。进一步，透镜阵列中的透镜呈平面分布。In a possible implementation, the optical shaping component includes a lens array. Further, the lenses in the lens array are distributed in a plane.
通过平面分布的透镜阵列，可以进一步减小显示模组的厚度。而且，通过透镜阵列有助于提高基于第一图像光或第二图像光形成的图像的均匀度。Through the planarly distributed lens array, the thickness of the display module can be further reduced. Furthermore, the lens array helps to improve the uniformity of the image formed based on the first image light or the second image light.
在一种可能的实现方式中，透镜阵列包括非球面透镜阵列。In a possible implementation, the lens array includes an aspherical lens array.
由于非球面透镜从中心到边缘的曲率连续发生变化，通过非球面透镜阵列可以使得不同方向的光束都会聚焦在同一个定点上，因此，通过非球面透镜，可以减小显示模组的视场边缘的像差。通过非球面透镜阵列不仅可以减小显示模组的像差，而且可以在较大视场(field of view，FOV)的情况下，光源组件也可以设计为平面光源阵列，进而可以降低加工和组装复杂度。Since the curvature of the aspherical lens changes continuously from the center to the edge, the aspherical lens array can focus the light beams in different directions on the same fixed point. Therefore, the aspherical lens can reduce the edge of the field of view of the display module. aberration. The aspherical lens array can not only reduce the aberration of the display module, but also in the case of a larger field of view (FOV), the light source component can also be designed as a planar light source array, which can reduce processing and assembly costs. the complexity.
在另一种可能的实现方式中，透镜阵列包括菲涅尔透镜阵列。In another possible implementation, the lens array includes a Fresnel lens array.
由于菲涅尔透镜的表面的一面为光面，另一面刻录了由小到大的同心圆(或称为纹路或菲涅尔带)，因此，通过菲涅尔透镜可以使得图像的边缘的像差较小。Since one side of the surface of the Fresnel lens is smooth and the other side is inscribed with concentric circles from small to large (or called textures or Fresnel bands), the edge of the image can be imaged through the Fresnel lens. The difference is small.
在一种可能的实现方式中，透镜阵列中透镜的节距(是指透镜阵列中单个透镜的有效直径或有效口径的大小)p满足下述公式1：
In a possible implementation, the pitch p of the lenses in the lens array (referring to the effective diameter or effective aperture size of a single lens in the lens array) satisfies the following formula 1:
其中，α为第一光束的发散角和第二光束的发散角中较大的发散角，h为第一光源或第二光源的横向发光宽度，t为光源组件的发光面与光学整形组件中靠近光调制组件的面之间的距离。Among them, α is the divergence angle of the first light beam and the divergence angle of the second light beam, whichever is larger, h is the lateral luminous width of the first light source or the second light source, t is the distance between the luminous surface of the light source component and the optical shaping component. The distance between faces close to the light modulating component.
通过上述公式1，可以保证光源阵列中单次开启的光源(即第一光源或第二光源)即可照亮对应的整个透镜，从而可以避免透镜的边缘存在暗区，影响显示模组显示的图像的均匀性。Through the above formula 1, it can be ensured that the light source (i.e. the first light source or the second light source) in the light source array that is turned on once can illuminate the entire corresponding lens, thereby avoiding the existence of dark areas at the edge of the lens and affecting the display of the display module. Image uniformity.
进一步，可选的，透镜阵列中透镜的节距p满足下述公式2：
Further, optionally, the pitch p of the lenses in the lens array satisfies the following formula 2:
其中，Weye为虚拟眼盒面上的虚拟眼间距，d为光学整形组件与虚拟眼盒面之间的距离，虚拟眼盒面为实际眼盒面经反射组件反射形成的虚像，t为光源组件的发光面与光学整形组件靠近所述光调制组件的面之间的距离。Among them, W eye is the distance between the virtual eyes on the virtual eye box surface, d is the distance between the optical shaping component and the virtual eye box surface, the virtual eye box surface is the virtual image formed by the reflection of the actual eye box surface by the reflective component, and t is the light source. The distance between the light-emitting surface of the component and the surface of the optical shaping component close to the light modulation component.
通过上述公式2，可以保证经过相邻透镜的第一光束或第二光束在观察面(或称为实际眼盒面)不发生串扰。Through the above formula 2, it can be ensured that the first light beam or the second light beam passing through the adjacent lens will not cause crosstalk on the observation surface (or the actual eye box surface).
在一种可能的实现方式中，光学整形组件也可以包括非球面透镜。In a possible implementation, the optical shaping component may also include an aspherical lens.
由于非球面透镜从中心到边缘的曲率连续发生变化，可以使得不同方向的光束都会聚焦在同一个定点上，因此，通过非球面透镜可以减小显示模组的视场边缘的像差。Since the curvature of the aspherical lens changes continuously from the center to the edge, the light beams in different directions can be focused on the same fixed point. Therefore, the aspherical lens can reduce the aberration at the edge of the field of view of the display module.
在一种可能的实现方式中，反射组件包括至少一个反射元件，反射元件可以包括但不限于平面反射镜、球面反射镜、自由曲面镜、或半透半反镜。In a possible implementation, the reflective component includes at least one reflective element, and the reflective element may include but is not limited to a plane mirror, a spherical mirror, a free-form mirror, or a semi-transparent mirror.
第二方面，本申请提供一种光学显示系统，该光学显示系统包括控制模组以及上述第一方面或第一方面中的任意一种显示模组。控制模组用于控制显示模组进行图像显示。In a second aspect, the present application provides an optical display system, which includes a control module and the above-mentioned first aspect or any one of the display modules in the first aspect. The control module is used to control the display module for image display.
在一种可能的实现方式中，光源组件包括光源阵列，光源阵列中的光源呈平面分布，光源阵列包括第一光源和第二光源。控制模组用于获取观察者的左眼位置信息和右眼位置信息；根据左眼位置信息确定第一光源的位置信息，以及根据右眼位置信息确定第二光源的位置信息；根据第一光源的位置信息和第二光源的位置信息生成第一控制信号，向光源组件发送第一控制信号。进一步，光源组件用于根据接收到的第一控制信号，在第一时段第一光源发射第一光束、及在第二时段第二光源发射第二光束。In a possible implementation, the light source assembly includes a light source array, the light sources in the light source array are distributed in a plane, and the light source array includes a first light source and a second light source. The control module is used to obtain the left eye position information and right eye position information of the observer; determine the position information of the first light source according to the left eye position information, and determine the position information of the second light source according to the right eye position information; according to the first light source The position information of the second light source and the position information of the second light source generate a first control signal, and the first control signal is sent to the light source assembly. Further, the light source assembly is configured to, according to the received first control signal, the first light source emit the first light beam during the first period, and the second light source emit the second light beam during the second period.
示例性的，第一控制信号包括第一光源的位置信息及第二光源的位置信息。Exemplarily, the first control signal includes position information of the first light source and position information of the second light source.
在一种可能的实现方式中，光源组件包括面光源和光阀；控制模组用于获取观察者的左眼位置信息和右眼位置信息；根据左眼位置信息确定光阀的第一位置信息，以及根据右眼位置信息确定光阀的第二位置信息；根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号向光源组件发送第二控制信号。进一步，面光源用于发射面光束；光阀，用于根据接收到的第二控制信号，在第三时段打开第一位置的光阀，面光束中的第一光束经第一位置射出，以及在第四时段打开第二位置的光阀，面光束中的第二光束经第二位置射出。In a possible implementation, the light source component includes a surface light source and a light valve; the control module is used to obtain the observer's left eye position information and right eye position information; and determine the first position information of the light valve according to the left eye position information, and determining the second position information of the light valve according to the right eye position information; generating a second control signal according to the first position information of the light valve and the second position information of the light valve and sending the second control signal to the light source assembly. Further, the surface light source is used to emit the surface beam; the light valve is used to open the light valve at the first position in the third period according to the received second control signal, and the first beam in the surface beam is emitted through the first position; and In the fourth period, the light valve at the second position is opened, and the second beam of the surface beam is emitted through the second position.
其中，面光源为平面型面光源和/或光阀为平面型光阀。Wherein, the surface light source is a planar surface light source and/or the light valve is a planar light valve.
在一种可能的实现方式中，第二控制信号包括光阀的第一位置信息、及光阀的第二位置信息。In a possible implementation, the second control signal includes first position information of the light valve and second position information of the light valve.
在一种可能的实现方式中，光学显示系统还包括眼跟踪模组，眼跟踪模组与控制模组连 接。进一步，可选的，控制模组用于接收来自眼跟踪模组的左眼位置信息和右眼位置信息。In a possible implementation, the optical display system also includes an eye tracking module, and the eye tracking module is connected to the control module. catch. Further, optionally, the control module is configured to receive left eye position information and right eye position information from the eye tracking module.
第三方面，本申请提供一种终端设备，包括上述第一方面或第一方面中的任意一种光学显示系统，光学显示系统安装于终端设备上。In a third aspect, the present application provides a terminal device, including the above-mentioned first aspect or any one of the optical display systems in the first aspect, and the optical display system is installed on the terminal device.
在一种可能的实现方式中，显示模组包括的反射组件可以为终端设备上的风挡。In a possible implementation, the reflective component included in the display module may be a windshield on the terminal device.
第四方面，本申请提供一种成像方法，该方法可应用于显示模组，显示模组包括光源组件、光学整形组件、光调制组件和反射组件，光学整形组件位于光源组件与光调制组件之间。该方法包括控制光源组件分时发射第一光束及第二光束，第一光束和第二光束的出射位置不同，第一光束经光学整形组件调整为第三光束，第二光束经光学整形组件调整为第四光束；以及控制光调制组件对第三光束经光调制得到携带第一图像信息的第一图像光，对第四光束经光调制得到携带第二图像信息的第二图像光；第一图像光经反射组件反射至观察者的左眼成像，第二图像光经反射组件反射至观察者的右眼成像；向光源组件发送第一控制信号、以及向光调制组件发送第三控制信号。In a fourth aspect, the present application provides an imaging method that can be applied to a display module. The display module includes a light source component, an optical shaping component, a light modulation component and a reflection component. The optical shaping component is located between the light source component and the light modulation component. between. The method includes controlling a light source component to emit a first beam and a second beam in a time-sharing manner. The first beam and the second beam have different exit positions. The first beam is adjusted to a third beam by an optical shaping component, and the second beam is adjusted by an optical shaping component. Be the fourth light beam; and control the light modulation component to optically modulate the third light beam to obtain the first image light carrying the first image information, and optically modulate the fourth light beam to obtain the second image light carrying the second image information; first The image light is reflected by the reflective component to the observer's left eye for imaging, and the second image light is reflected by the reflective component to the observer's right eye for imaging; a first control signal is sent to the light source component, and a third control signal is sent to the light modulation component.
示例性的，上述控制方法可由控制模组执行。For example, the above control method can be executed by the control module.
在一种可能的实现方式中，获取观察者的左眼位置信息和右眼位置信息，根据左眼位置信息和右眼位置信息，生成控制信号，并向光源组件发送控制信号。其中，控制信号用于控制所述光源组件分时发射所述第一光束及所述第二光束。In a possible implementation, the observer's left eye position information and right eye position information are obtained, a control signal is generated based on the left eye position information and the right eye position information, and the control signal is sent to the light source component. The control signal is used to control the light source component to emit the first light beam and the second light beam in a time-divided manner.
在一种可能的实现方式中，接收来自眼跟踪模组的左眼位置信息和右眼位置信息。In a possible implementation, left eye position information and right eye position information are received from the eye tracking module.
在一种可能的实现方式中，控制信号包括第一控制信号，光源组件包括光源阵列；根据左眼位置信息确定第一光源的位置信息，以及根据右眼位置信息确定第二光源的位置信息；进一步，根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。进一步，第一控制信号用于控制所述光源阵列中的第一光源在第一时段发射第一光束、及控制光源阵列中的第二光源在第二时段发射第二光束。In a possible implementation, the control signal includes a first control signal, and the light source component includes a light source array; the position information of the first light source is determined according to the left eye position information, and the position information of the second light source is determined according to the right eye position information; Further, a first control signal is generated according to the position information of the first light source and the position information of the second light source. Further, the first control signal is used to control the first light source in the light source array to emit the first light beam in the first period, and to control the second light source in the light source array to emit the second light beam in the second period.
在一种可能的实现方式中，控制信号包括第二控制信号，光源组件包括面光源和光阀；根据所述左眼位置信息确定所述光阀的第一位置信息，以及根据所述右眼位置信息确定所述光阀的第二位置信息；根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号。进一步，第二控制信号用于控制在第三时段打开第一位置的光阀，在第四时段打开第二位置的光阀。In a possible implementation, the control signal includes a second control signal, the light source component includes a surface light source and a light valve; the first position information of the light valve is determined according to the left eye position information, and the first position information of the light valve is determined according to the right eye position. The information determines second position information of the light valve; and a second control signal is generated based on the first position information of the light valve and the second position information of the light valve. Further, the second control signal is used to control the light valve at the first position to be opened during the third period, and the light valve at the second position to be opened during the fourth period.
第五方面，本申请提供一种控制装置，该控制装置用于实现上述第四方面或第四方面的任意可能的实现方式中的方法，包括相应的功能模块，分别用于实现以上方法中的步骤。功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。硬件或软件包括一个或多个与上述功能相对应的模块。In a fifth aspect, the present application provides a control device, which is used to implement the method in the above-mentioned fourth aspect or any possible implementation of the fourth aspect, including corresponding functional modules, respectively used to implement the above method. step. Functions can be implemented by hardware, or by hardware executing corresponding software. Hardware or software includes one or more modules corresponding to the above functions.
在一种可能的实现方式中，该控制装置可以包括：接口电路和处理器。该处理器通过逻辑电路或执行代码指令用于实现上述第一方面的相应功能，该接口电路用于接收来自控制装置之外的其它控制装置的信号并传输至处理器或将来自处理器的信号发送给控制装置之外的其它控制装置。其中，接口电路可以为独立的接收器、独立的发射器、集成收发功能的收发器。可选地，该控制装置还可以包括存储器，该存储器可以与处理器耦合，其保存该控制装置必要的程序指令和数据。In a possible implementation, the control device may include: an interface circuit and a processor. The processor is used to implement the corresponding functions of the first aspect through logic circuits or execution code instructions. The interface circuit is used to receive signals from other control devices other than the control device and transmit them to the processor or to transfer signals from the processor. Sent to other control devices besides the control device. Among them, the interface circuit can be an independent receiver, an independent transmitter, or a transceiver with integrated transceiver functions. Optionally, the control device may also include a memory, which may be coupled to the processor and which stores necessary program instructions and data for the control device.
其中，处理器与接口电路协作，用于控制光源组件分时发射第一光束及第二光束，第一光束和第二光束的出射位置不同，第一光束经光学整形组件调整为第三光束，第二光束经光 学整形组件调整为第四光束；以及控制光调制组件对第三光束调制得到携带第一图像信息的第一图像光，对第四光束调制得到携带第二图像信息的第二图像光；第一图像光经反射组件反射至观察者的左眼成像，第二图像光经反射组件反射至观察者的右眼成像。Among them, the processor cooperates with the interface circuit to control the light source component to emit the first beam and the second beam in a time-sharing manner. The first beam and the second beam have different exit positions. The first beam is adjusted to the third beam by the optical shaping component. The second beam passes through The optical shaping component is adjusted to the fourth light beam; and the light modulation component is controlled to modulate the third light beam to obtain the first image light carrying the first image information, and modulate the fourth light beam to obtain the second image light carrying the second image information; first The image light is reflected by the reflective component to the observer's left eye for imaging, and the second image light is reflected by the reflective component to the observer's right eye for imaging.
在一种可能的实现方式中，接口电路用于获取所述观察者的左眼位置信息和右眼位置信息；处理器用于根据左眼位置信息和右眼位置信息生成控制信号，控制信号用于控制所述光源组件在第一时段发射第一光束、及在第二时段发射第二光束；接口电路还用于向光源组件发送控制信号。In a possible implementation, the interface circuit is used to obtain the left eye position information and the right eye position information of the observer; the processor is used to generate a control signal according to the left eye position information and the right eye position information, and the control signal is used to The light source component is controlled to emit a first light beam in a first period and a second light beam in a second period; the interface circuit is also used to send a control signal to the light source component.
进一步，可选的，接口电路用于接收来自眼跟踪模组的左眼位置信息和右眼位置信息。Further, optionally, the interface circuit is used to receive left eye position information and right eye position information from the eye tracking module.
在一种可能的实现方式中，控制信号包括第一控制信号，光源组件包括光源阵列。处理器具体用于：根据左眼位置信息确定第一光源的位置信息，以及根据右眼位置信息确定第二光源的位置信息；并根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。In a possible implementation, the control signal includes a first control signal, and the light source assembly includes a light source array. The processor is specifically configured to: determine the position information of the first light source based on the left eye position information, and determine the position information of the second light source based on the right eye position information; and generate the third light source based on the position information of the first light source and the position information of the second light source. a control signal.
在一种可能的实现方式中，控制信号包括第二控制信号，光源组件包括面光源和光阀；处理器具体用于根据左眼位置信息确定光阀的第一位置信息，以及根据右眼位置信息确定光阀的第二位置信息；并根据所述光阀的第一位置信息和所述光阀的第二位置信息生成所述第二控制信号。In a possible implementation, the control signal includes a second control signal, and the light source assembly includes a surface light source and a light valve; the processor is specifically configured to determine the first position information of the light valve according to the left eye position information, and to determine the first position information of the light valve according to the right eye position information. Determine second position information of the light valve; and generate the second control signal based on the first position information of the light valve and the second position information of the light valve.
第六方面，本申请提供一种控制装置，该控制装置用于实现上述第四方面或第四方面的任意可能的实现方式中的方法，包括相应的功能模块，分别用于实现以上方法中的步骤。功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。硬件或软件包括一个或多个与上述功能相对应的模块。In a sixth aspect, the present application provides a control device, which is used to implement the method in the above-mentioned fourth aspect or any possible implementation of the fourth aspect, including corresponding functional modules, respectively used to implement the above method. step. Functions can be implemented by hardware, or by hardware executing corresponding software. Hardware or software includes one or more modules corresponding to the above functions.
其中，处理模块与收发模块协作，用于控制光源组件分时发射第一光束及第二光束，第一光束经光学整形组件调整为第三光束，第二光束经光学整形组件调整为第四光束；以及控制光调制组件对第三光束调制得到携带第一图像信息的第一图像光，对第四光束调制得到携带第二图像信息的第二图像光；第一图像光经反射组件反射至观察者的左眼成像，第二图像光经反射组件反射至观察者的右眼成像。Among them, the processing module cooperates with the transceiver module to control the light source component to emit the first beam and the second beam in a time-sharing manner. The first beam is adjusted to the third beam through the optical shaping component, and the second beam is adjusted to the fourth beam through the optical shaping component. ; and control the light modulation component to modulate the third light beam to obtain the first image light carrying the first image information, and modulate the fourth light beam to obtain the second image light carrying the second image information; the first image light is reflected to the observation through the reflective component The left eye of the observer is imaged, and the second image light is reflected to the observer's right eye through the reflective component.
在一种可能的实现方式中，收发模块用于获取所述观察者的左眼位置信息和右眼位置信息；处理模块用于根据左眼位置信息和右眼位置信息生成控制信号，控制信号用于控制所述光源组件在第一时段发射第一光束、及在第二时段发射第二光束；收发模块还用于向光源组件发送控制信号。In a possible implementation, the transceiver module is used to obtain the left eye position information and the right eye position information of the observer; the processing module is used to generate a control signal according to the left eye position information and the right eye position information, and the control signal is In order to control the light source component to emit the first light beam in the first time period and the second light beam in the second time period, the transceiver module is also used to send a control signal to the light source component.
进一步，可选的，收发模块用于接收来自眼跟踪模组的左眼位置信息和右眼位置信息。Further, optionally, the transceiver module is used to receive left eye position information and right eye position information from the eye tracking module.
在一种可能的实现方式中，控制信号包括第一控制信号，光源组件包括光源阵列。处理模块具体用于：根据左眼位置信息确定第一光源的位置信息，以及根据右眼位置信息确定第二光源的位置信息；并根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。第一控制信号用于控制光源组件在第一时段第一光源发射第一光束、及在第二时段第二光源发射第二光束。In a possible implementation, the control signal includes a first control signal, and the light source assembly includes a light source array. The processing module is specifically configured to: determine the position information of the first light source based on the left eye position information, and determine the position information of the second light source based on the right eye position information; and generate the third light source based on the position information of the first light source and the position information of the second light source. a control signal. The first control signal is used to control the light source assembly to emit a first light beam from the first light source during a first period and to emit a second light beam from the second light source during a second period.
在一种可能的实现方式中，控制信号包括第二控制信号，光源组件包括面光源和光阀；处理模块具体用于根据左眼位置信息确定光阀的第一位置信息，以及根据右眼位置信息确定光阀的第二位置信息；并根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号。第二控制信号用于控制光阀在第三时段打开第一位置的光阀、面光源发射的面光束中的第一光束经第一位置射出，以及在第四时段打开第二位置的光阀、面光源发射的面光束中的第二 光束经第二位置射出。In a possible implementation, the control signal includes a second control signal, and the light source assembly includes a surface light source and a light valve; the processing module is specifically configured to determine the first position information of the light valve according to the left eye position information, and determine the first position information of the light valve according to the right eye position information. Determine second position information of the light valve; and generate a second control signal based on the first position information of the light valve and the second position information of the light valve. The second control signal is used to control the light valve to open the light valve at the first position during the third period, emit the first beam of the surface beam emitted by the surface light source through the first position, and open the light valve at the second position during the fourth period. , the second of the surface beams emitted by the surface light source The light beam is emitted through the second position.
第七方面，本申请提供一种计算机可读存储介质，计算机可读存储介质中存储有计算机程序或指令，当计算机程序或指令被控制装置执行时，使得该控制装置执行上述第四方面或第四方面的任意可能的实现方式中的方法。In a seventh aspect, the present application provides a computer-readable storage medium. Computer programs or instructions are stored in the computer-readable storage medium. When the computer programs or instructions are executed by the control device, the control device is caused to execute the fourth aspect or the third aspect. Methods in any possible implementation of the four aspects.
第八方面，本申请提供一种计算机程序产品，该计算机程序产品包括计算机程序或指令，当该计算机程序或指令被控制装置执行时，使得该控制装置执行上述第四方面或第四方面的任意可能的实现方式中的方法。In an eighth aspect, the present application provides a computer program product. The computer program product includes a computer program or instructions. When the computer program or instructions are executed by a control device, the control device causes the control device to execute the fourth aspect or any of the fourth aspects. Methods in possible implementations.
上述第二方面至第八方面中任一方面可以达到的技术效果可以参照上述第一方面中有益效果的描述，此处不再重复赘述。The technical effects that can be achieved by any one of the above-mentioned second to eighth aspects can be referred to the description of the beneficial effects in the above-mentioned first aspect, and will not be repeated here.
附图说明Description of drawings
图1a为本申请提供的一种应用于HUD的场景示意图；Figure 1a is a schematic diagram of a scene applied to HUD provided by this application;
图1b为本申请提供的一种应用于NED设备的场景示意图；Figure 1b is a schematic diagram of a scenario applied to NED equipment provided by this application;
图1c为本申请提供的一种应用于车载显示屏的场景示意图；Figure 1c is a schematic diagram of a scene applied to a vehicle-mounted display screen provided by this application;
图2为本申请提供的一种显示模组的结构示意图；Figure 2 is a schematic structural diagram of a display module provided by this application;
图3为本申请提供的一种显示模组中的光路示意图；Figure 3 is a schematic diagram of an optical path in a display module provided by this application;
图4为本申请提供的一种第一光源和第二光源的关系示意图；Figure 4 is a schematic diagram of the relationship between a first light source and a second light source provided by this application;
图5a为本申请提供的一种一维光源阵列的结构示意；Figure 5a is a schematic structural diagram of a one-dimensional light source array provided by this application;
图5b为本申请提供的一种二维光源阵列的结构示意图；Figure 5b is a schematic structural diagram of a two-dimensional light source array provided by this application;
图5c为本申请提供的一种光源阵列的错位排列的结构示意图；Figure 5c is a schematic structural diagram of a staggered arrangement of a light source array provided by this application;
图5d为本申请提供的又一种光源阵列的错位排列的结构示意图；Figure 5d is a schematic structural diagram of yet another staggered arrangement of light source arrays provided by this application;
图5e为本申请提供的又一种光源阵列中的错位排列的结构示意图；Figure 5e is a schematic structural diagram of yet another staggered arrangement of light source arrays provided by this application;
图5f为本申请提供的另一种光源阵列中的光源在列方向上错位排列的结构示意图；Figure 5f is a schematic structural diagram of another light source array provided by the present application in which the light sources are arranged staggered in the column direction;
图5g为本申请提供的一种光源阵列在行方向上部分等间隔的错位排列部分非等间隔错位排列的结构示意图；Figure 5g is a schematic structural diagram of a light source array provided by the present application, in which part of the light source array is arranged in a staggered arrangement at equal intervals in the row direction and partially arranged in a staggered arrangement at non-equal intervals;
图5h为本申请提供的一种光源阵列在列方向部分等间隔的错位排列部分非等间隔错位排列的结构示意图；Figure 5h is a schematic structural diagram of a light source array provided by the present application in which the staggered arrangement is partially equally spaced in the column direction and the other is non-equally spaced staggered arrangement;
图6a为本申请提供的一种光源阵列中的光源为多边形分布的示意图；Figure 6a is a schematic diagram of a polygonal distribution of light sources in a light source array provided by this application;
图6b为本申请提供的一种正六边形分布的光源阵列的三维图；Figure 6b is a three-dimensional diagram of a regular hexagonally distributed light source array provided by this application;
图7a为本申请提供的一种光源阵列中的光源为曲面分布的结构示意图；Figure 7a is a schematic structural diagram of a light source array provided by the present application in which the light sources are distributed on a curved surface;
图7b为本申请提供的一种曲面分布的光源阵列的三维图；Figure 7b is a three-dimensional diagram of a light source array with curved surface distribution provided by this application;
图7c为本申请提供的一种曲面分布的光源阵列的三维图；Figure 7c is a three-dimensional diagram of a light source array with curved surface distribution provided by this application;
图8a为本申请提供的一种面光源和光阀的结构示意图；Figure 8a is a schematic structural diagram of a surface light source and light valve provided by this application;
图8b为本申请提供的另一种面光源和光阀的结构示意图；Figure 8b is a schematic structural diagram of another surface light source and light valve provided by this application;
图9a为本申请提供的一种菲涅尔透镜的结构示意图；Figure 9a is a schematic structural diagram of a Fresnel lens provided by this application;
图9b为本申请提供的一种非球面透镜阵列的结构示意图；Figure 9b is a schematic structural diagram of an aspherical lens array provided by this application;
图9c为本申请提供的一种球面透镜阵列的结构示意图；Figure 9c is a schematic structural diagram of a spherical lens array provided by this application;
图9d为本申请提供的一种菲涅尔透镜阵列的结构示意图； Figure 9d is a schematic structural diagram of a Fresnel lens array provided by this application;
图10a为本申请提供的一种显示屏的结构示意图；Figure 10a is a schematic structural diagram of a display screen provided by this application;
图10b为本申请提供的一种显示屏的结构示意图；Figure 10b is a schematic structural diagram of a display screen provided by this application;
图11为本申请提供的一种显示屏的光路示意图；Figure 11 is a schematic diagram of the optical path of a display screen provided by this application;
图12为本申请提供的又一种显示模组的结构示意图；Figure 12 is a schematic structural diagram of another display module provided by this application;
图13为本申请提供的又一种显示模组的结构示意图；Figure 13 is a schematic structural diagram of another display module provided by this application;
图14为本申请提供的又一种显示模组的结构示意图；Figure 14 is a schematic structural diagram of another display module provided by this application;
图15为本申请提供的一种光学显示系统的结构示意图；Figure 15 is a schematic structural diagram of an optical display system provided by this application;
图16为本申请提供的一种辐辏调节冲突的原理；Figure 16 is a principle of convergence adjustment conflict provided by this application;
图17为本申请提供的一种光学显示系统的电路示意图；Figure 17 is a schematic circuit diagram of an optical display system provided by this application;
图18为本申请提供的一种车辆的示例性功能框图；Figure 18 is an exemplary functional block diagram of a vehicle provided by this application;
图19为本申请提供的一种成像方法流程示意图；Figure 19 is a schematic flow chart of an imaging method provided by this application;
图20a为本申请提供的一种观察者的左眼和右眼在位置1的光路图示意图；Figure 20a is a schematic optical path diagram of an observer's left eye and right eye at position 1 provided by this application;
图20b为本申请提供的一种观察者的左眼和右眼在位置2的光路图示意图；Figure 20b is a schematic optical path diagram of an observer's left eye and right eye at position 2 provided by this application;
图21为本申请提供的一种控制装置的结构示意图；Figure 21 is a schematic structural diagram of a control device provided by this application;
图22为本申请提供的一种控制装置的结构示意图。Figure 22 is a schematic structural diagram of a control device provided by this application.
具体实施方式Detailed ways
下面将结合附图，对本申请实施例进行详细描述。The embodiments of the present application will be described in detail below with reference to the accompanying drawings.
下面对本申请可能的应用场景进行介绍。The possible application scenarios of this application are introduced below.
在一种可能的应用场景中，本申请提供的显示模组也可以集成于抬头显示设备(head-up device，HUD)，请参阅图1a，以HUD安装于车辆为例介绍。HUD可将形成的图像(称为HUD虚像)投射在驾驶员的前方视野范围，并与真实路面信息融合起来，从而可增强驾驶员对于实际驾驶环境的感知。例如，HUD可以将携带导航信息(如方向箭头、距离、和/或行驶时间等)和/或车辆的状态信息(如行驶速度、行驶里程、转速、温度、油量、和/或车灯状态等信息)的HUD虚像叠加在车辆外的真实环境(如安全车距、周围障碍物、和/或倒车影像等)上，使得驾驶员可获得增强现实的视觉效果。基于此，车辆可以实现增强现实(augmented reality，AR)导航、自适应巡航、车道偏离预警等功能。或者，可以结合高级驾驶辅助系统(advanced driving assistant system，ADAS)的功能，实现车辆的辅助驾驶或智能驾驶等。通常，为了不干扰路况，基于车辆的状态信息形成的HUD虚像的虚像距约在2～3米。为了使得基于导航信息形成的HUD虚像与真实路面能够更好的融合，基于导航信息形成的HUD虚像的虚像距约为7～15米。其中，HUD包括但不限于挡风玻璃(windshield-head up device，W-HUD)、或AR-HUD等。In a possible application scenario, the display module provided by this application can also be integrated into a head-up display device (HUD). Please refer to Figure 1a, which takes the HUD installed in a vehicle as an example. HUD can project the formed image (called HUD virtual image) into the driver's front field of view and fuse it with real road information, thereby enhancing the driver's perception of the actual driving environment. For example, the HUD can carry navigation information (such as direction arrows, distance, and/or driving time, etc.) and/or vehicle status information (such as driving speed, driving mileage, rotation speed, temperature, fuel level, and/or car light status). and other information) is superimposed on the real environment outside the vehicle (such as safe distance, surrounding obstacles, and/or reversing images, etc.), so that the driver can obtain augmented reality visual effects. Based on this, vehicles can implement augmented reality (AR) navigation, adaptive cruise, lane departure warning and other functions. Alternatively, it can be combined with the functions of the advanced driving assist system (ADAS) to achieve assisted driving or intelligent driving of the vehicle. Usually, in order not to interfere with road conditions, the virtual image distance of the HUD virtual image formed based on the vehicle's status information is about 2 to 3 meters. In order to better integrate the HUD virtual image formed based on navigation information with the real road surface, the virtual image distance of the HUD virtual image formed based on navigation information is approximately 7 to 15 meters. Among them, HUD includes but is not limited to windshield-head up device (W-HUD), or AR-HUD, etc.
在又一种可能的应用场景中，本申请提供的显示模组也可以集成于近眼显示(near eye display，NED)设备。NED设备例如可以是AR设备或虚拟(virtual reality，VR)设备，AR设备可以包括但不限于AR眼镜或AR头盔，VR设备可以包括但不限于VR眼镜或VR头盔。请参阅图1b，以AR眼镜为例示例，用户可佩戴AR眼镜进行游戏、观看视频、参加虚拟会议、或视频购物等。In another possible application scenario, the display module provided by this application can also be integrated into a near eye display (NED) device. The NED device may be, for example, an AR device or a virtual reality (VR) device. The AR device may include but is not limited to AR glasses or an AR helmet. The VR device may include but is not limited to VR glasses or a VR helmet. Please refer to Figure 1b, taking AR glasses as an example. Users can wear AR glasses to play games, watch videos, participate in virtual meetings, or video shopping, etc.
在又一种可能的应用场景中，本申请提供的显示模组也可以集成于车载显示屏。请参阅图1c，车载显示屏可以安装在车辆的座椅后背或副驾驶位置等，本申请对车载显示屏安装的 位置不作限定，图1c是以安装于座椅后背示例的。In another possible application scenario, the display module provided by this application can also be integrated into a vehicle-mounted display screen. Please refer to Figure 1c. The vehicle-mounted display screen can be installed on the back of the vehicle's seat or in the passenger seat. This application covers the installation of vehicle-mounted display screens. The position is not limited. Figure 1c shows an example of being installed on the back of the seat.
应理解，上述给出的可能的应用场景仅是举例，本申请提供的显示模组还可以集成于包括图像生成单元(picture generation unit，PGU)和反射组件的设备中，或者其它可能的智能虚像光显、虚空显示等其它可能显示场景，而不限于上述示例出的场景。It should be understood that the possible application scenarios given above are only examples. The display module provided by this application can also be integrated into a device including a picture generation unit (picture generation unit, PGU) and a reflective component, or other possible smart virtual images. There are other possible display scenarios such as light display, void display, etc., and are not limited to the scenes illustrated in the above examples.
如背景技术介绍，目前基于光屏障技术的图像显示会造成分辨率的损失。鉴于此，本申请提供一种显示模组。该显示模组可以不损失显示的图像的分辨率。As introduced in the background art, current image display based on light barrier technology will cause a loss of resolution. In view of this, this application provides a display module. The display module can be used without losing the resolution of the displayed image.
基于上述内容，下面结合附图对本申请提出的显示模组进行具体阐述。Based on the above content, the display module proposed in this application will be described in detail below with reference to the accompanying drawings.
如图2所示，为本申请提供的一种显示模组的结构示意图。该显示模组包括光源组件、光学整形组件、光调制组件和反射组件，光学整形组件位于光源组件与光调制组件之间。其中，光源组件用于分时发射第一光束和第二光束，第一光束和第二光束从光源组件的出射位置不同。也可以理解为，光源组件在不同的时段从不同位置发射出不同的光束。光学整形组件用于调整第一光束的指向得到第三光束，以及调整第二光束的指向得到第四光束。光调制组件用于对第三光束进行调制得到携带第一图像信息的第一图像光，以及对第四光束进行调制得到携带第二图像信息的第二图像光。反射组件用于将第一图像光反射至观察者的左眼成像，以及将第二图像光反射至观察者的右眼成像。As shown in Figure 2, it is a schematic structural diagram of a display module provided by this application. The display module includes a light source component, an optical shaping component, a light modulating component and a reflecting component. The optical shaping component is located between the light source component and the light modulating component. Wherein, the light source component is used to emit the first light beam and the second light beam in a time-sharing manner, and the first light beam and the second light beam emit different positions from the light source component. It can also be understood that the light source component emits different light beams from different positions at different time periods. The optical shaping component is used to adjust the direction of the first light beam to obtain the third light beam, and adjust the direction of the second light beam to obtain the fourth light beam. The light modulation component is used to modulate the third light beam to obtain first image light carrying first image information, and to modulate the fourth light beam to obtain second image light carrying second image information. The reflective component is used to reflect the first image light to the observer's left eye for imaging, and to reflect the second image light to the observer's right eye for imaging.
结合图3，第一光束的传播光路为：光源组件发射第一光束，第一光束经光学整形组件调整指向得到第三光束，第三光束经光调制组件将第一图像信息调制于第三光束得到第一图像光，第一图像光经反射组件发射至观察者的左眼成像。第二光束的传播光路为：光源组件发射第二光束，第二光束经光学整形组件调整指向得到第四光束，第四光束经光调制组件将第二图像信息调制于第四光束得到第二图像光，第二图像光经反射组件反射至观察者的右眼成像。With reference to Figure 3, the propagation light path of the first beam is: the light source component emits the first beam, the first beam is adjusted by the optical shaping component to obtain a third beam, and the third beam modulates the first image information into the third beam through the light modulation component. The first image light is obtained, and the first image light is emitted to the observer's left eye for imaging through the reflective component. The propagation light path of the second beam is: the light source component emits the second beam, the second beam is adjusted by the optical shaping component to obtain a fourth beam, and the fourth beam is modulated by the light modulation component to modulate the second image information into the fourth beam to obtain the second image. The second image light is reflected by the reflective component to the observer's right eye for imaging.
基于上述显示模组，由于光学整形组件位于光源组件与光调制组件之间，光源组件可以与光学整形组件配合生成方向性背光，光调制组件通过时分的方式加载第一图像信息或第二图像信息，观察者单眼即可看到光调制组件的所有像素调制的第一图像信息或第二图像信息，也可以理解为，观察者单眼即可看到光调制组件调制的完整的第一图像信息或第二图像信息，因此，可以减小或避免显示的图像的分辨率的损失。进一步，第一图像光在左眼成像，第二图像光在右眼成像，观察者可以观察到不同的视差图像，若第一图像信息和第二图像信息不同，可获得立体的3D图像效果。可以理解的是，若第一图像信息与第二图像信息相同，显示模组也可以显示二维图像效果。Based on the above display module, since the optical shaping component is located between the light source component and the light modulation component, the light source component can cooperate with the optical shaping component to generate directional backlight, and the light modulation component loads the first image information or the second image information in a time-division manner. , the observer can see the first image information or the second image information modulated by all the pixels of the light modulation component with one eye. It can also be understood that the observer can see the complete first image information or the second image information modulated by the light modulation component with one eye. The second image information, therefore, can reduce or avoid the loss of resolution of the displayed image. Furthermore, the first image light is imaged on the left eye, and the second image light is imaged on the right eye. The observer can observe different parallax images. If the first image information and the second image information are different, a three-dimensional 3D image effect can be obtained. It can be understood that if the first image information and the second image information are the same, the display module can also display a two-dimensional image effect.
下面对图2所示的各个功能组件和结构分别进行介绍说明，以给出示例性的具体实现方案。Each functional component and structure shown in Figure 2 will be introduced and explained separately below to provide an exemplary specific implementation solution.
一、光源组件1. Light source components
在一种可能的实现方式中，光源组件用于根据接收到的控制信号，分时发射第一光束和第二光束。In a possible implementation, the light source component is configured to emit the first light beam and the second light beam in a time-divided manner according to the received control signal.
如下基于示例性的示出了两种可能的光源组件的结构，分别详细介绍光源组件分时发射第一光束和第二光束的过程。The following shows two possible structures of the light source assembly based on examples, and the process of the light source assembly emitting the first light beam and the second light beam in a time-division manner is introduced in detail respectively.
结构一，光源组件包括光源阵列。Structure 1: the light source component includes a light source array.
在一种可能的实现方式中，光源阵列包括第一光源和第二光源。光源阵列根据接收到的第一控制信号，在第一时段第一光源发射第一光束，在第二时段第二光源发射第二光束。其 中，第一控制信号包括第一光源的位置信息及第二光源的位置信息。可以理解的是，第一光源开启的第一时段T1、第二光源开启的第二时段T2可以在显示模组初始化过程中可以设置；或者，第一光源开启的第一时段T1、第二光源开启的第二时段T2也可以携带于第一控制信号中。需要说明的是，开启第一光源和第二光源间隔预设时长Δt，请参阅图4，通常预设时长Δt等于光调制组件的调制时长T5。In a possible implementation, the light source array includes a first light source and a second light source. According to the received first control signal, the light source array emits the first light beam from the first light source during the first period and the second light beam from the second light source during the second period. That , the first control signal includes position information of the first light source and position information of the second light source. It can be understood that the first period T 1 during which the first light source is turned on and the second period T 2 during which the second light source is turned on can be set during the initialization process of the display module; or, the first period T 1 and T 2 during which the first light source is turned on can be set. The second period T2 during which the second light source is turned on may also be carried in the first control signal. It should be noted that there is a preset time period Δt between turning on the first light source and the second light source. Please refer to Figure 4. Usually, the preset time period Δt is equal to the modulation time length T 5 of the light modulation component.
具体的，光源阵列可根据第一控制信号中的第一光源的位置信息确定需要开启的第一光源，第一光源在第一时段T1开启，开启的第一光源用于发射第一光束；根据第二光源的位置信息确定需要开启的第二光源，第二光源在第二时段T2开启，开启的第二光源用于发射第二光束。Specifically, the light source array can determine the first light source that needs to be turned on based on the position information of the first light source in the first control signal. The first light source is turned on in the first period T1 , and the turned on first light source is used to emit the first light beam; The second light source that needs to be turned on is determined according to the position information of the second light source. The second light source is turned on in the second period T2 , and the turned on second light source is used to emit the second light beam.
下面基于光源阵列的分布方式，如下示例性的示出了三种可能的情形。Based on the distribution of the light source array, three possible situations are exemplarily shown below.
情形一，光源阵列中的光源呈平面分布。In case one, the light sources in the light source array are distributed in a plane.
在一种可能的实现方式中，光源阵列包括m×n个光源，m为大于1的整数，n为正整数；或者，m为正整数，n为大于1的整数。具体的，光源阵列可以是一维阵列(或称为线列型)，或者也可以是二维阵列(或称为面阵型)。In a possible implementation, the light source array includes m×n light sources, m is an integer greater than 1, and n is a positive integer; or, m is a positive integer, and n is an integer greater than 1. Specifically, the light source array may be a one-dimensional array (or called a linear array), or it may be a two-dimensional array (or called an area array).
如下基于光源阵列中光源的排列方式分两种情形介绍。The following is an introduction in two situations based on the arrangement of light sources in the light source array.
情形1，光源阵列中的光源为一维排列。Case 1, the light sources in the light source array are arranged in one dimension.
如图5a所示，为本申请提供的一种一维光源阵列的结构示意。该示例中以光源阵列包括6×1个光源为例示例。也可以理解为，这6个光源沿行方向呈条状排列。As shown in Figure 5a, it is a schematic structural diagram of a one-dimensional light source array provided by this application. In this example, the light source array includes 6×1 light sources as an example. It can also be understood that these six light sources are arranged in strips along the row direction.
情形2，光源阵列中的光源为二维排列。Case 2: The light sources in the light source array are arranged two-dimensionally.
基于光源阵列中的光源在行方向和/或列方向的对齐方式可进一步分如下五种情形介绍。Based on the alignment of the light sources in the light source array in the row direction and/or column direction, the method can be further divided into the following five situations.
情形2.1，光源阵列中的光源在行方向和列方向上均是对齐排列的。Case 2.1, the light sources in the light source array are aligned in both row and column directions.
如图5b所示，为本申请提供的一种二维光源阵列的结构示意图。该示例中以光源阵列包括6×6个光源为例。该示例中光源在行方向上是对齐的，在列方向上也是对齐的。As shown in Figure 5b, it is a schematic structural diagram of a two-dimensional light source array provided by this application. In this example, the light source array includes 6×6 light sources. In this example the lights are aligned in the row direction and also in the column direction.
情形2.2，光源阵列中的光源在行方向等间隔的错位排列，在列方向是对齐排列的。In case 2.2, the light sources in the light source array are staggered at equal intervals in the row direction and aligned in the column direction.
如图5c所示，为本申请提供的一种光源阵列的错位排列的结构示意图。该光源阵列中的光源在行方向上等间隔的错位排列，该示例中以3行为周期的错位排列(或称为错位排列的周期)为例，任意相邻两个光源在行方向的错位大小均为Δ1。需要说明的是，在行方向的错位大小Δ1小于相邻两个光源的中心之间的距离S1。As shown in Figure 5c, it is a schematic structural diagram of a staggered arrangement of a light source array provided by the present application. The light sources in the light source array are staggered at equal intervals in the row direction. In this example, a staggered arrangement with a three-row period (or period called a staggered arrangement) is taken as an example. The staggered size of any two adjacent light sources in the row direction is equal. is Δ 1 . It should be noted that the misalignment size Δ 1 in the row direction is smaller than the distance S 1 between the centers of two adjacent light sources.
情形2.3，光源阵列中的光源在列方向等间隔的错位排列，在行方向是对齐排列的。In case 2.3, the light sources in the light source array are staggered at equal intervals in the column direction, but are aligned in the row direction.
如图5d所示，为本申请提供的又一种光源阵列的错位排列的结构示意图。其中，该光源阵列中的光源在列方向上是等间隔的错位排列的，该示例中以3列为周期的错位排列为例，任意相邻两个光源在列方向的错位大小为Δ2。需要说明的是，在列方向的错位大小Δ2小于相邻两个光源的中心之间的距离H1。As shown in Figure 5d, it is a schematic structural diagram of another staggered arrangement of light source array provided by the present application. The light sources in the light source array are staggered at equal intervals in the column direction. In this example, a three-column periodic staggered arrangement is taken as an example. The stagger size of any two adjacent light sources in the column direction is Δ 2 . It should be noted that the dislocation size Δ 2 in the column direction is smaller than the distance H 1 between the centers of two adjacent light sources.
应理解，上述图5c中的错位大小Δ1可以与上述图5d中的错位大小Δ2相同，也可以不相同，本申请对此不作限定。It should be understood that the dislocation size Δ 1 in the above-mentioned Fig. 5c may be the same as the dislocation size Δ 2 in the above-mentioned Fig. 5d, or may be different, and this application does not limit this.
情形2.4，光源阵列中的光源在行方向不等间隔的错位排列，在列方向是对齐排列的。Case 2.4: The light sources in the light source array are staggered at unequal intervals in the row direction and aligned in the column direction.
如图5e所示，为本申请提供的又一种光源阵列中的错位排列的结构示意图。该光源阵列中的光源在行方向上的错位大小中存在至少两种不同的错位大小，该示例中以2行为周期的错位排列为例，即在行方向包括两种不同的错位大小。相邻两个光源在行方向的错位大小为 Δ3或Δ4，该示例中以Δ3小于Δ4为例。任意相邻两个光源在行方向的错位大小Δ3小于相邻两个光源的中心之间的距离S1、且任意相邻两个光源在行方向的错位大小Δ4也小于相邻两个光源的中心之间的距离S1。As shown in Figure 5e, it is a schematic structural diagram of yet another staggered arrangement in a light source array provided by this application. The light sources in the light source array have at least two different dislocation sizes in the row direction. In this example, a 2-row periodic dislocation arrangement is taken as an example, that is, there are two different dislocation sizes in the row direction. The misalignment size of two adjacent light sources in the row direction is Δ3 or Δ4 . In this example, Δ3 is smaller than Δ4 . The misalignment size Δ3 of any two adjacent light sources in the row direction is less than the distance S 1 between the centers of the two adjacent light sources, and the misalignment size Δ4 of any two adjacent light sources in the row direction is also smaller than the distance S 1 between the centers of the two adjacent light sources. The distance S 1 between the centers of the light sources.
需要说明的是，在行方向不等间隔的错位排列中的错位大小可以互不相同，或者也可以部分相同部分不同，本申请对此不作限定。It should be noted that the offset sizes in the offset arrangements at unequal intervals in the row direction may be different from each other, or may be partially the same and partially different, which is not limited in this application.
情形2.5，光源阵列中的光源在列方向不等间隔的错位排列，在行方向是对齐排列的。Case 2.5, the light sources in the light source array are staggered at unequal intervals in the column direction, but are aligned in the row direction.
如图5f所示，为本申请提供的另一种光源阵列中的光源在列方向上错位排列的结构示意图。该光源阵列中的光源在列方向上的错位大小中存在至少两种不同的错位大小，该示例中以2列为周期的错位排列为例，即在列方向包括两种不同的错位大小。相邻两个光源在列方向的错位大小为Δ5或Δ6，该示例中以Δ5小于Δ6为例。任意相邻两个光源在列方向的错位大小Δ5小于相邻两个光源的中心之间的距离H1、且任意相邻两个光源在列方向的错位大小Δ6小于相邻两个光源的中心之间的距离H1。As shown in Figure 5f, it is a schematic structural diagram of another light source array provided by the present application in which the light sources are arranged staggered in the column direction. The light sources in the light source array have at least two different dislocation sizes in the column direction. In this example, a two-column periodic dislocation arrangement is taken as an example, that is, there are two different dislocation sizes in the column direction. The misalignment size of two adjacent light sources in the column direction is Δ5 or Δ6 . In this example, Δ5 is smaller than Δ6 . The misalignment size Δ 5 of any two adjacent light sources in the column direction is smaller than the distance H 1 between the centers of the two adjacent light sources, and the misalignment size Δ 6 of any two adjacent light sources in the column direction is smaller than the distance H 1 between the centers of the two adjacent light sources. The distance between the centers is H 1 .
需要说明的是，在列方向不等间隔的错位排列中错位大小可以互不相同，也可以部分相同部分不相同，本申请对此不作限定。It should be noted that in the staggered arrangement at unequal intervals in the column direction, the stagger sizes may be different from each other, or may be partially the same and partially different, which is not limited in this application.
可以理解的是，光源阵列中光源在行方向上错位排列方式也可以是上述情形2.2和情形2.5的组合，即部分是等间隔的错位排列，部分是非等间隔错位排列。可参见图5g，在行方向的错位大小为Δ7、Δ8和Δ7。类似的，光源阵列中光源在列方向上错位排列方式也可以是上述情形2.3和情形2.5的组合，即部分是等间隔的错位排列，部分是非等间隔错位排列。可参见图5h，在列方向的错位大小为Δ9、Δ0和Δ9。可以理解的是，为了尽可能的减小光学串扰，相邻两个光源之间的间隔可以设置的大些，例如，相邻两个光源之间的间隔可设置为400微米或更大。It can be understood that the staggered arrangement of the light sources in the row direction in the light source array can also be a combination of the above situations 2.2 and 2.5, that is, some are equally spaced staggered arrangements, and some are non-equally spaced staggered arrangements. Referring to Figure 5g, the misalignment sizes in the row direction are Δ7 , Δ8 and Δ7 . Similarly, the staggered arrangement of the light sources in the column direction in the light source array can also be a combination of the above scenarios 2.3 and 2.5, that is, some are equally spaced staggered arrangements, and some are non-equally spaced staggered arrangements. Referring to Figure 5h, the misalignment sizes in the column direction are Δ 9 , Δ 0 and Δ 9 . It can be understood that, in order to reduce optical crosstalk as much as possible, the distance between two adjacent light sources can be set larger. For example, the distance between two adjacent light sources can be set to 400 microns or greater.
应理解，上述给出的光源阵列中的光源均是以矩形为例的，光源的形状也可以是其它可能的任意形状，例如圆形、椭圆形或多边形等，本申请对此不作限定。It should be understood that the light sources in the light source array given above are all rectangular as examples, and the shape of the light source can also be any other possible shape, such as a circle, an ellipse, a polygon, etc., which is not limited in this application.
情形二，光源阵列中的光源呈多边行分布。In case two, the light sources in the light source array are distributed in polygonal rows.
请参阅图6a，为本申请提供的一种光源阵列中的光源为多边形分布的示意图。该示例中以光源阵列中的光源为正六边形分布为例。图6b为正六边形分布的光源阵列的三维图。Please refer to Figure 6a, which is a schematic diagram of a polygonal distribution of light sources in a light source array provided by the present application. In this example, the light sources in the light source array are distributed in a regular hexagon. Figure 6b is a three-dimensional diagram of a regular hexagonally distributed light source array.
通过光源阵列为多边行分布，可以在尽可能的减小显示模组的厚度的情况下，使得观察者在边缘和中央看到的图像尽可能一致，从而可以扩大显示模组的眼盒范围。By distributing the light source array into multilateral rows, the thickness of the display module can be reduced as much as possible, so that the images seen by the observer at the edges and the center are as consistent as possible, thereby expanding the eye box range of the display module.
情形三，光源阵列中的光源呈曲面分布。Scenario 3: The light sources in the light source array are distributed on a curved surface.
请参阅图7a，为本申请提供的一种光源阵列中的光源为曲面分布的结构示意图。请参阅图7b或图7c，为曲面分布的光源阵列的三维图。通过曲面分布的光源，可以使得观察者在边缘和中央看到的图像尽基本一致，从而可以扩大显示模组的眼盒范围。Please refer to Figure 7a, which is a schematic structural diagram of a light source array provided by the present application in which the light sources are distributed on a curved surface. Please refer to Figure 7b or Figure 7c, which is a three-dimensional diagram of a light source array distributed on a curved surface. Through the light source distributed on the curved surface, the image seen by the observer at the edge and the center can be basically consistent, thereby expanding the eye box range of the display module.
需要说明的是，上述给出的光源阵列可以实现独立寻址。独立寻址是指可独立选通(或称为点亮或开启或通电)光源阵列中的光源，选通的光源用于发射第一光束或第二光束。例如，向光源阵列中的第一光源输入驱动电流，以选通第一光源。向光源阵列中的第二光源输入驱动电流，以选通第二光源。可以理解的是，光源阵列的寻址方式与光源阵列中光源的物理连接关系相关。例如，若光源阵列中各个光源的物理连接方式为并联，则可以逐点选通光源，或者也可以按需选通光源，其中，按需选通例如可以是在某一时刻选通特定位置的光源等。再比如，光源阵列中的同一列内的光源串联，不同列之间并联，则可以逐列选通光源阵 列中的光源。再比如，光源阵列同一行内的光源串联，不同行之间并联，则可以逐行选通光源阵列中的光源。再比如，若光源阵列中各斜对角线上的光源串联，不同斜对角线上光源并联，则可以按斜对角线选通光源阵列中的光源等，此处不再逐一列举。It should be noted that the light source array given above can achieve independent addressing. Independent addressing means that the light sources in the light source array can be independently gated (or called on or turned on or powered on), and the gated light sources are used to emit the first beam or the second beam. For example, a driving current is input to a first light source in the light source array to strobe the first light source. A driving current is input to the second light source in the light source array to strobe the second light source. It can be understood that the addressing mode of the light source array is related to the physical connection relationship of the light sources in the light source array. For example, if the physical connection mode of each light source in the light source array is parallel, the light sources can be gated point by point, or the light sources can be gated on demand, where, for example, the gate on demand can be gated on a specific position at a certain time. Light source, etc. For another example, if the light sources in the same column in the light source array are connected in series and different columns are connected in parallel, the light source array can be gated column by column. The light source in the column. For another example, if the light sources in the same row of the light source array are connected in series and different rows are connected in parallel, the light sources in the light source array can be gated row by row. For another example, if the light sources on diagonal lines in the light source array are connected in series and the light sources on different diagonal lines are connected in parallel, the light sources in the light source array can be gated according to the diagonal lines, etc., which will not be listed one by one here.
示例性地，光源阵列中的光源例如可以是激光二极管(laser diode，LD)、发光二级管(light-emitting diode，LED)、垂直腔面发射激光器(vertical cavity surface emitting laser，VCSEL)、边缘发射激光器(edge emitting laser，EEL)、全固态半导体激光器(diode pumped solid state laser，DPSS)、或光纤激光器等。可以理解的是，上述给出的光源仅是示例，本申请对此不作限定。For example, the light source in the light source array may be a laser diode (LD), a light-emitting diode (LED), a vertical cavity surface emitting laser (VCSEL), an edge laser Emitting laser (edge emitting laser, EEL), all-solid-state semiconductor laser (diode pumped solid state laser, DPSS), or fiber laser, etc. It can be understood that the light sources given above are only examples, and this application does not limit them.
结构二，光源组件包括面光源和光阀。Structure 2, the light source component includes an area light source and a light valve.
在一种可能的实现方式中，光源组件可以包括面光源和光阀。进一步，面光源可以为平面型面光源，光阀可以为平面型光阀。请参阅图8a，光阀可以覆盖完整的面光源，当某一位置的光阀打开，面光源发射的面光束可以从打开光阀的位置射出。In a possible implementation, the light source component may include a surface light source and a light valve. Furthermore, the surface light source can be a planar surface light source, and the light valve can be a planar light valve. Please refer to Figure 8a. The light valve can cover the complete area light source. When the light valve at a certain position is opened, the area beam emitted by the area light source can be emitted from the position where the light valve is opened.
其中，面光源用于发射面光束，通常面光源为常亮状态。光阀用于根据接收到的第二控制信号在第三时段打开第一位置的光阀，面光源发射的面光束中的第一光束经第一位置射出，请参阅图8b中的(1)。进一步，光阀用于根据第二控制信号在第四时段打开第二位置的光阀，面光源发射的面光束中的第二光束经第二位置射出，请参阅图8b中的(2)。Among them, the surface light source is used to emit surface beams, and usually the surface light source is always on. The light valve is used to open the light valve at the first position in the third period according to the received second control signal. The first beam of the surface beam emitted by the surface light source is emitted through the first position. Please refer to (1) in Figure 8b . Further, the light valve is used to open the light valve at the second position in the fourth period according to the second control signal, and the second light beam in the surface beam emitted by the surface light source is emitted through the second position, please refer to (2) in Figure 8b.
也可以理解为，第二控制信号包括光阀的第一位置信息、及光阀的第二位置信息。其中，光阀的第一位置信息包括需要打开的光阀的第一宽度和第一中心坐标，或者，包括需要打开的光阀的第一起始位置和第一终止位置。光阀的第二位置信息包括需要打开的光阀的第二宽度和第二中心坐标，或者，包括需要打开的光阀的第二起始位置和第二终止位置。其中，第一宽度可以与第二宽度相同也可以不同，本申请对此不作限定。可以理解的是，第一位置的光阀打开的第三时段T3和第二位置的光阀打开的第四时段T4可以在显示模组初始化过程中设置；或者，第一位置的光阀打开的第三时段T3和第二位置的光阀打开的第四时段T4也可以携带于第一控制信号中。需要说明的是，打开第一位置的光阀和打开第二位置的光阀间隔预设时长Δt，预设时长Δt可参见前述相关介绍，此处不再赘述。It can also be understood that the second control signal includes the first position information of the light valve and the second position information of the light valve. The first position information of the light valve includes the first width and the first center coordinate of the light valve that needs to be opened, or includes the first starting position and the first end position of the light valve that needs to be opened. The second position information of the light valve includes the second width and the second center coordinate of the light valve that needs to be opened, or includes the second starting position and the second end position of the light valve that needs to be opened. The first width may be the same as the second width or may be different, which is not limited in this application. It can be understood that the third period T 3 during which the light valve is opened at the first position and the fourth period T 4 during which the light valve is opened at the second position can be set during the initialization process of the display module; or, the light valve at the first position is opened. The third period T 3 of opening and the fourth period T 4 of the light valve opening of the second position may also be carried in the first control signal. It should be noted that the interval between opening the light valve in the first position and opening the light valve in the second position is a preset time period Δt. The preset time period Δt can be found in the above-mentioned relevant introduction, and will not be described again here.
具体的，光阀根据接收到的第二控制信号，在第三时段打开第一位置的光阀，在第三时段内，面光源发射的面光束中的第一光束经第一位置射出；以及在第四时段打开第二位置的光阀，在第四时段内，面光源发射的面光束中的第二光束经第二位置射出。可以理解的是，第一光束为面光束中的部分光束，第二光束也为面光束中的部分光束，第一光束和第二光束从光阀出射的位置不同。Specifically, the light valve opens the light valve at the first position in the third period according to the received second control signal, and in the third period, the first light beam in the surface beam emitted by the surface light source is emitted through the first position; and In the fourth period, the light valve at the second position is opened. In the fourth period, the second beam of the surface beam emitted by the surface light source is emitted through the second position. It can be understood that the first light beam is a partial light beam in the surface beam, and the second light beam is also a partial light beam in the surface light beam. The first light beam and the second light beam emit from the light valve at different positions.
通过光阀配合面光源可更精确的调整第一光束和第二光束，使得在眼跟踪状态下，第一光束和第二光束的切换更平滑，观察者在眼盒内移动观察到的图像闪烁更少、更加稳定；且通过控制光阀开启的宽度，能够精准匹配更大的观看深度范围。Through the light valve and the surface light source, the first beam and the second beam can be adjusted more accurately, so that in the eye tracking state, the switching of the first beam and the second beam is smoother, and the image flickering observed by the observer moving within the eye box Fewer and more stable; and by controlling the opening width of the light valve, it can accurately match a larger viewing depth range.
二、光学整形组件2. Optical shaping components
在一种可能的实现方式中，光学整形组件用于调整第一光束的指向得到第三光束，以及调整第二光束的指向得到第四光束。具体的，光学整形组件用于改变来自光源组件的第一光束的传播方向，以使得第一光束聚焦至某一位置，以及改变来自光源组件的第二光束的传播方向，以使得第二光束聚焦至另一位置。In a possible implementation, the optical shaping component is used to adjust the direction of the first light beam to obtain the third light beam, and adjust the direction of the second light beam to obtain the fourth light beam. Specifically, the optical shaping component is used to change the propagation direction of the first light beam from the light source assembly so that the first light beam is focused to a certain position, and to change the propagation direction of the second light beam from the light source assembly so that the second light beam is focused. to another location.
如下示例性的示出了两种可能的光学整形组件的结构。 The following exemplarily illustrates two possible structures of the optical shaping component.
结构A，光学整形组件包括透镜。Structure A, the optical shaping component includes a lens.
在一种可能的实现方式中，透镜包括球面透镜、或非球面透镜或菲涅尔透镜(请参阅图9a)。菲涅尔透镜(fresnel lens)也可以称为螺纹透镜，菲涅尔透镜的表面的一面为光面，另一面刻录了由小到大的同心圆(或称为纹路或菲涅尔带)，因此，通过菲涅尔透镜可以使得图像的边缘的像差较小。由于非球面透镜从中心到边缘的曲率连续发生变化，因此，通过非球面透镜可以使得不同方向的光束都会聚焦在同一个定点上，因此，可以减小显示模组的视场边缘的像差。In a possible implementation, the lens includes a spherical lens, an aspheric lens or a Fresnel lens (see Figure 9a). Fresnel lenses can also be called threaded lenses. One side of the surface of the Fresnel lens is smooth, and the other side is inscribed with concentric circles (or textures or Fresnel strips) from small to large. Therefore, the Fresnel lens can make the aberration at the edge of the image smaller. Since the curvature of the aspherical lens continuously changes from the center to the edge, the aspherical lens can focus the light beams in different directions on the same fixed point, thus reducing the aberration at the edge of the display module's field of view.
示例性的，透镜的材料可以是玻璃、树脂、或晶体等光学材料。当透镜的材料为树脂时，可以减轻显示模组的质量。当透镜的材料为玻璃时，有助于提高显示模组的成像质量以及抑制温漂。本申请对透镜的材料不作限定。For example, the material of the lens may be optical materials such as glass, resin, or crystal. When the material of the lens is resin, the quality of the display module can be reduced. When the material of the lens is glass, it helps to improve the imaging quality of the display module and suppress temperature drift. This application does not limit the material of the lens.
结构B，光学整形组件包括透镜阵列。Structure B, the optical shaping component includes a lens array.
在一种可能的实现方式中，透镜阵列包括球面透镜阵列(请参阅图9b)、非球面透镜阵列(请参阅图9c)或菲涅尔透镜阵列(请参阅图9d)。关于透镜阵列中透镜的材料可参见前述相关介绍，此处不再赘述。其中，透镜阵列的节距p是指透镜阵列中单个透镜的有效直径或有效口径的大小。由于非球面透镜阵列，既可以减小显示模组的视场边缘的像差，而且可以在较大视场(field of view，FOV)的情况下，光源组件也可以设计为平面光源阵列，进而可以降低加工和组装复杂度。In a possible implementation, the lens array includes a spherical lens array (see Figure 9b), an aspherical lens array (see Figure 9c) or a Fresnel lens array (see Figure 9d). Regarding the materials of the lenses in the lens array, please refer to the relevant introduction mentioned above and will not be repeated here. Among them, the pitch p of the lens array refers to the effective diameter or effective aperture size of a single lens in the lens array. Due to the aspherical lens array, the aberration at the edge of the field of view of the display module can be reduced, and in the case of a larger field of view (FOV), the light source component can also be designed as a planar light source array, thus Processing and assembly complexity can be reduced.
进一步，可选的，透镜阵列可以为平面分布的透镜阵列。基于此，有助于减小显示模组的厚度。Further, optionally, the lens array may be a planarly distributed lens array. Based on this, it helps to reduce the thickness of the display module.
若光源组件包括光源阵列，光学整形组件包括透镜阵列。在一种可能的实现方式中，透镜阵列中的一个透镜对应光源阵列中的至少两个光源。换言之，一个透镜对应的多个光源中的部分光源作为第一光源，另外部分光源作为第二光源。例如，一个观察者在观看，一个透镜下可对应两个光源，其中一个作为第一光源，另一个作为第二光源。为了满足多个观察者可以同时观看，一个透镜可对应至少四个光源。也可以理解为，对于透镜阵列中的每个透镜，其都有一个与一个观察者的左眼位置对应的光源以及和右眼位置对应的光源。If the light source component includes a light source array, the optical shaping component includes a lens array. In a possible implementation, one lens in the lens array corresponds to at least two light sources in the light source array. In other words, part of the light sources among the plurality of light sources corresponding to one lens serve as the first light source, and other part of the light sources serve as the second light source. For example, when an observer is watching, one lens can correspond to two light sources, one of which serves as the first light source and the other as the second light source. In order to allow multiple observers to watch at the same time, one lens can correspond to at least four light sources. It can also be understood that for each lens in the lens array, it has a light source corresponding to the position of an observer's left eye and a light source corresponding to the position of the right eye.
可以理解的是，对于光源阵列，某一时段开启的第一光源(或第二光源)的数量与第一光源(或第二光源)的横向宽度、第一光源阵列(或第二光源阵列)的密度、透镜阵列包括的透镜的数量有关，其中，第一光源(或第二光源)的横向是指平行于透镜的节距p的方向。每一次需要开启的第一光源(或第二光源)的横向总宽度(或称为横向发光宽度相当于透镜的物高)是一定的，开启的第一光源(或第二光源)数量与单个第一光源(或第二光源)的横向宽度和第一光源阵列(或第二光源阵列)的密度有关，横向宽度越小且密度越大，单次开启的第一光源(或第二光源)的数量越多。It can be understood that for the light source array, the number of first light sources (or second light sources) turned on in a certain period of time is related to the lateral width of the first light source (or second light source), the first light source array (or second light source array) The density is related to the number of lenses included in the lens array, where the lateral direction of the first light source (or the second light source) refers to the direction parallel to the pitch p of the lenses. The total lateral width of the first light source (or second light source) that needs to be turned on each time (or the lateral luminous width is equivalent to the object height of the lens) is certain, and the number of first light sources (or second light sources) turned on is the same as a single The lateral width of the first light source (or second light source) is related to the density of the first light source array (or second light source array). The smaller the lateral width and the greater the density, the first light source (or second light source) that is turned on once The greater the number.
三、光调制组件3. Light modulation components
在一种可能的实现方式中，光调制组件用于对第三光束进行调制，得到携带第一图像信息的第一图像光；以及对第四光束进行调制，得到携带第二图像信息的第二图像光。具体的，光调制组件可将第一图像信息加载(或称为调制)于第三光束，得到携带图像信息的第一图像光；将第二图像信息加载于第四光束得到携带图像信息的第二图像光束。其中，第三光束和第四光束可以称为光载波。可以理解的是，为了实现3D显示效果，第一图像信息和第二图像信息不同。此外，光调制组件可以高频切换第一图像信息和第二图像信息，从而可以是 使得到达观察者的左右眼的图像不同，进而实现3D显示。In a possible implementation, the light modulation component is used to modulate the third light beam to obtain a first image light carrying the first image information; and to modulate the fourth light beam to obtain a second light beam carrying the second image information. Image light. Specifically, the light modulation component can load (or modulate) the first image information into the third light beam to obtain the first image light carrying the image information; load the second image information into the fourth light beam to obtain the third light beam carrying the image information. Two image beams. The third beam and the fourth beam may be called optical carriers. It can be understood that in order to achieve a 3D display effect, the first image information and the second image information are different. In addition, the light modulation component can switch the first image information and the second image information at high frequency, so that it can be This makes the images reaching the left and right eyes of the observer different, thereby achieving 3D display.
示例性的，光调制组件例如可以是硅基液晶(liquid crystal on silicon，LCOS)显示屏、液晶显示器(liquid crystal display，LCD)、数字光处理(digital light procession，DLP)显示器、激光线扫描(laser beam scanning，LBS)显示器、有机发光二极管(organic light emitting diode，OLED)、微型发光二极管(micro light emitting diode，micro-LED)、有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode，AMOLED)、柔性发光二极管(flex light-emitting diode，FLED)、量子点发光二极管(quantum dot light emitting diodes，QLED)、基于字微镜器件(digital micro-mirror device，DMD)的反射式显示屏等。需要说明的是，上述给出的光调制组件仅是示例，本申请对此不作限定，其它可以对光学整形组件输出的第三光束和第四光束进行调制的组件也在本申请的保护范围。For example, the light modulation component can be a liquid crystal on silicon (LCOS) display, a liquid crystal display (LCD), a digital light processing (DLP) display, a laser line scan ( laser beam scanning (LBS) display, organic light emitting diode (OLED), micro light emitting diode (micro light emitting diode, micro-LED), active matrix organic light emitting diode or active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (FLED), quantum dot light emitting diode (QLED), digital micro-mirror device , DMD) reflective display screen, etc. It should be noted that the above-mentioned light modulation component is only an example, and this application is not limited thereto. Other components that can modulate the third light beam and the fourth light beam output by the optical shaping component are also within the protection scope of this application.
基于上述内容，如下示例性的示出了两种可能的显示屏的结构。Based on the above content, two possible display screen structures are exemplarily shown below.
如图10a所示，为本申请提供的一种显示屏的结构示意图。该显示屏可包括光源组件、光学整形组件和光调制组件。该示例中光源组件以面光源和光阀为例，打开光阀的位置可以出射面光源发射的面光束的部分光束(称为第一光束或第二光束)，出射的第一光束或第二光束的发散角α。其中，光学整形组件以球面透镜阵列为例，光调制组件以LCD为例。关于光源组件、光学整形组件和光调制组件的详细介绍可参见前述内容，此处不再赘述。As shown in Figure 10a, it is a schematic structural diagram of a display screen provided by this application. The display screen may include a light source component, an optical shaping component and a light modulation component. In this example, the light source component takes a surface light source and a light valve as an example. The position of the light valve can emit part of the surface beam emitted by the surface light source (called the first beam or the second beam). The emitted first beam or the second beam The divergence angle α. Among them, the optical shaping component takes a spherical lens array as an example, and the light modulation component takes an LCD as an example. For a detailed introduction to the light source component, optical shaping component and light modulation component, please refer to the foregoing content and will not be described again here.
请参阅图10b，为本申请提供的另一种显示屏的结构示意图。该显示屏可包括光源组件、光学整形组件和光调制组件。该示例中的光源组件以设置于基板上的平面分布的光源阵列为例，光学整形组件以平面分布的非球面透镜阵列为例，光调制组件以LCD为例。关于光源组件、光学整形组件和光调制组件的详细介绍可参见前述内容，此处不再赘述。Please refer to Figure 10b, which is a schematic structural diagram of another display screen provided by this application. The display screen may include a light source component, an optical shaping component and a light modulation component. In this example, the light source component is a planarly distributed light source array disposed on the substrate as an example, the optical shaping component is a planarly distributed aspherical lens array as an example, and the light modulation component is an LCD as an example. For a detailed introduction to the light source component, optical shaping component and light modulation component, please refer to the foregoing content and will not be described again here.
基于图10b的显示屏，平面分布的非球面透镜阵列和平面分布的光源阵列，可以实现小的横向宽度的密集的光源阵列和短焦透镜阵列，从而可以减小显示模组的厚度。例如，显示模组可以压缩至毫米级。通过非球面透镜阵列可以使得边缘视场的像差较小，从而可以在较大FOV情况下降低显示模组的加工和组装的复杂度。而且，光源化的光源阵列可以实现在眼盒中多视区的划分，使观察者在眼盒的不同位置都能进行3D观看。Based on the display screen in Figure 10b, the planarly distributed aspherical lens array and the planarly distributed light source array can realize a dense light source array and a short-focus lens array with a small lateral width, thereby reducing the thickness of the display module. For example, display modules can be compressed to the millimeter level. The aspherical lens array can make the aberration of the edge field of view smaller, thereby reducing the complexity of processing and assembly of the display module in the case of a large FOV. Moreover, the illuminated light source array can realize the division of multiple viewing areas in the eye box, allowing observers to perform 3D viewing at different positions of the eye box.
请参阅图11，为本申请提供的一种显示屏的光路示意图。该示例中，光源阵列中的第一光源开启，开启的第一光源用于发射第一光束(用实线表示)，第一光束经非球面透镜阵列中对应的非球面透镜调整指向得到第三光束，第三光束经LCD调制后得到携带第一图像信息的第一图像光，第一图像光用于在左眼成像。光源阵列中的第二光源开启，开启的第二光源用于发射第二光束(用虚线表示)，第二光束经非球面透镜阵列中对应的非球面透镜调整指向得到第四光束，第四光束经LCD调制后得到携带第二图像信息的第二图像光，第二图像光用于在右眼成像。Please refer to Figure 11, which is a schematic diagram of an optical path of a display screen provided in this application. In this example, the first light source in the light source array is turned on, and the turned on first light source is used to emit the first light beam (indicated by a solid line). The first light beam is directed through the corresponding aspherical lens in the aspherical lens array to obtain the third The third light beam is modulated by the LCD to obtain the first image light carrying the first image information, and the first image light is used for imaging in the left eye. The second light source in the light source array is turned on. The turned on second light source is used to emit a second light beam (indicated by a dotted line). The second light beam is adjusted by the corresponding aspherical lens in the aspherical lens array to obtain a fourth light beam. The fourth light beam is After being modulated by the LCD, the second image light carrying the second image information is obtained, and the second image light is used for imaging in the right eye.
四、反射组件4. Reflective components
请参阅图12，反射组件用于将第一图像光反射至观察者的左眼成像，以及将第二图像光反射至观察者的右眼成像，从而可以使得观察者观察到3D图像。图12是以反射组件包括一个自由曲面反射镜为例示例的。Referring to FIG. 12 , the reflective component is used to reflect the first image light to the observer's left eye for imaging, and to reflect the second image light to the observer's right eye for imaging, so that the observer can observe a 3D image. Figure 12 is an example in which the reflective component includes a free-form surface reflector.
示例性的，反射组件包括至少一个反射元件，反射元件例如可以包括但不限于平面反射镜、球面反射镜、自由曲面镜或半透半反镜(semi-transparent and semi-reflective mirro)等。 其中，半透半反镜又可称为分光镜、分光片或半反半透镜，是一种在光学玻璃上镀制半反射膜，或者在透镜的一个光学面上镀制半透半反膜，以改变入射光束原来的透射和反射的比例的光学元件。通过镀制膜层可以增透加大光强；也可以增反减少光强。Exemplarily, the reflective assembly includes at least one reflective element. The reflective element may include, for example, but is not limited to, a plane reflector, a spherical reflector, a free-curved mirror or a semi-transparent and semi-reflective mirror (semi-transparent and semi-reflective mirror). Among them, a semi-transparent mirror can also be called a beam splitter, a beam splitter or a semi-reflective semi-reflective mirror. It is a semi-reflective film coated on optical glass, or a semi-transparent and semi-reflective film is coated on an optical surface of a lens. , an optical element that changes the original transmission and reflection ratio of the incident light beam. By coating the film layer, you can increase the light intensity by increasing the transmittance; you can also increase the reflection and reduce the light intensity.
基于上述内容，下面给出上述显示模组的一种具体实现方式。以便于进一步理解上述显示模组的结构及图像显示的实现过程。需要说明的是，上述给出各个组件中，如果没有特殊说明以及逻辑冲突，根据其内在的逻辑关系可以组合形成其它可能的显示模组。Based on the above content, a specific implementation method of the above display module is given below. In order to further understand the structure of the above display module and the implementation process of image display. It should be noted that among the components given above, if there are no special instructions or logical conflicts, they can be combined to form other possible display modules according to their internal logical relationships.
如图13所示，为本申请提供的又一种显示模组的结构示意图。该显示模组包括显示屏和反射组件。其中，显示屏可包括光源组件、光学整形组件和光调制组件。该示例中的光源组件以设置于基板上的平面分布的光源阵列为例，光学整形组件以平面分布的非球面透镜阵列为例，光调制组件以LCD为例。关于光源组件、光学整形组件和光调制组件的详细介绍可参见前述内容，此处不再赘述。反射组件以上述图12所示的反射组件为例，具体可参见前述相关介绍，此处不再赘述。可以理解的是，L为形成的光斑(或光条)的长度，L需要满足可以覆盖左眼且不影响右眼，或者需要覆盖右眼且不影响左眼。As shown in Figure 13, it is a schematic structural diagram of another display module provided by the present application. The display module includes a display screen and a reflective component. The display screen may include a light source component, an optical shaping component and a light modulation component. In this example, the light source component is a planarly distributed light source array disposed on the substrate as an example, the optical shaping component is a planarly distributed aspherical lens array as an example, and the light modulation component is an LCD as an example. For a detailed introduction to the light source component, optical shaping component and light modulation component, please refer to the foregoing content and will not be described again here. The reflective component takes the reflective component shown in Figure 12 as an example. For details, please refer to the relevant introduction mentioned above and will not be described again here. It can be understood that L is the length of the formed light spot (or light bar), and L needs to cover the left eye without affecting the right eye, or it needs to cover the right eye without affecting the left eye.
结合上述图13，为了保证光源阵列中单个光源也可以照亮对应的非球面透镜，非球面透镜阵列中的非球面透镜的节距p满足下述公式1。
In conjunction with the above-mentioned Figure 13, in order to ensure that a single light source in the light source array can also illuminate the corresponding aspherical lens, the pitch p of the aspherical lenses in the aspherical lens array satisfies the following formula 1.
其中，α为第一光束的发散角和第二光束的发散角中较大的发散角，t为光源阵列的发光面与非球面透镜阵列中靠近LCD的面之间的距离，h为第一光源或第二光源的横向发光宽度。横向宽度可以理解为一个非球面透镜对应的全部的第一光源的横向宽度之和或者对应的全部的第二光源的横向宽度之和。结合上述图13，一个非球面透镜对应两个第一光源和两个第二光源，h即为两个第一光源的横向宽度之和，或者h为两个第二光源的横向宽度之和。其中，t满足下述成像公式2，例如可以为10mm。可以理解的是，第一光束的发散角与第二光束的发散角是可以设置的，例如，可以设置第一光源的发散角和第二光源的发射角，或者设置打开第一位置的光阀的第一宽度和打开第二位置的光阀的第二宽度。此外，第一光束的发散角可以与第二光束的发散角相同，或者也可以不同，本申请对此不作限定。需要说明的是，光源阵列中第一光源的发散角即为第一光束的发散角，第二光源的发散角即为第二光束的发散角。
Among them, α is the larger divergence angle of the first beam and the second beam, t is the distance between the light-emitting surface of the light source array and the surface of the aspherical lens array close to the LCD, h is the first The lateral luminous width of the light source or second light source. The lateral width can be understood as the sum of the lateral widths of all the first light sources corresponding to an aspherical lens or the sum of the lateral widths of all the corresponding second light sources. Referring to Figure 13 above, an aspherical lens corresponds to two first light sources and two second light sources. h is the sum of the lateral widths of the two first light sources, or h is the sum of the lateral widths of the two second light sources. Wherein, t satisfies the following imaging formula 2, and may be 10 mm, for example. It can be understood that the divergence angle of the first light beam and the divergence angle of the second light beam can be set. For example, the divergence angle of the first light source and the emission angle of the second light source can be set, or a light valve that opens the first position can be set. a first width and a second width that opens the light valve in a second position. In addition, the divergence angle of the first light beam may be the same as the divergence angle of the second light beam, or may be different, which is not limited in this application. It should be noted that the divergence angle of the first light source in the light source array is the divergence angle of the first light beam, and the divergence angle of the second light source is the divergence angle of the second light beam.
其中，f2为非球面透镜阵列的等效焦距，d为非球面透镜阵列与虚拟眼盒面之间的距离，d满足下述公式3。
d＝|d3-d1|   公式3Among them, f2 is the equivalent focal length of the aspherical lens array, d is the distance between the aspherical lens array and the virtual eyebox surface, and d satisfies the following formula 3.
d＝|d3-d1| Formula 3
结合图14，W为观察者的左眼和右眼之间的眼间距，通常约为65mm，d1为实际眼盒面与反射组件之间的距离，d3为虚拟眼盒面与反射组件之间的距离。d1和d3满足下述成像公式4。
Combined with Figure 14, W is the inter-eye distance between the observer's left eye and right eye, usually about 65mm, d1 is the distance between the actual eye box surface and the reflective component, d3 is the distance between the virtual eye box surface and the reflective component distance. d1 and d3 satisfy the following imaging formula 4.
其中，f1为反射组件的等效焦距。 Among them, f1 is the equivalent focal length of the reflective component.
需要说明的是，若反射组件为平面反射元件，实际眼盒面的大小与虚拟眼盒面的大小相同，实际眼盒面与反射组件之间的距离d1和虚拟眼盒面与反射组件之间的距离d3的大小相同，且实际眼盒面与虚拟眼盒面位于平面反射元件的两侧。以平面反射元件为中心，则d1＝-d3。It should be noted that if the reflective component is a planar reflective element, the size of the actual eye box surface is the same as the size of the virtual eye box surface, the distance d1 between the actual eye box surface and the reflective component and the distance d1 between the virtual eye box surface and the reflective component The distance d3 is the same, and the actual eyebox surface and the virtual eyebox surface are located on both sides of the plane reflective element. Taking the plane reflective element as the center, then d1=-d3.
进一步，为了保证经过相邻非球面透镜的第一光束或第二光束在实际眼盒面不发生串扰，非球面透镜阵列中的非球面透镜的节距p还满足下述公式5。
Furthermore, in order to ensure that the first light beam or the second light beam passing through adjacent aspherical lenses does not cause crosstalk on the actual eyebox surface, the pitch p of the aspherical lenses in the aspherical lens array also satisfies the following formula 5.
其中，Weye为虚拟眼盒面上的虚拟眼间距，虚拟眼盒面为实际眼盒面经反射组件反射形成的虚像。Weye满足下述公式6。
Among them, W eye is the virtual eye distance on the virtual eye box surface, and the virtual eye box surface is the virtual image formed by the reflection of the actual eye box surface by the reflective component. W eye satisfies the following formula 6.
由于光源阵列中的光源的发散角都有一定的局限，当非球面透镜离光源较近时，光源发出的光能覆盖的范围很小。通过使用小节距的非球面透镜组成的非球面透镜阵列，并结合相对应的密集的光源阵列可以提高显示模组显示的图像的均匀性。Since the divergence angles of the light sources in the light source array have certain limitations, when the aspherical lens is close to the light source, the light energy emitted by the light source covers a very small range. By using an aspherical lens array composed of small-pitch aspherical lenses, combined with a corresponding dense light source array, the uniformity of the image displayed by the display module can be improved.
示例性的，上述显示模组例如可以包括但不限于NED设备、车载显示屏或HUD等。For example, the above-mentioned display module may include, but is not limited to, NED equipment, vehicle-mounted display screen or HUD, etc.
基于上述描述的显示模组的结构和功能原理，本申请还可以提供一种光学显示系统。请参阅图15，为本申请提供的一种光学显示系统的结构示意图。该光学显示系统可以包括上述任一实施例中的显示模组，此处不再重复赘述。进一步，该光学显示系统还可包括控制模组，控制模组与显示模组连接。控制模组用于控制所述显示模组进行图像显示。Based on the structure and functional principles of the display module described above, this application can also provide an optical display system. Please refer to Figure 15, which is a schematic structural diagram of an optical display system provided by this application. The optical display system may include the display module in any of the above embodiments, and the details will not be repeated here. Furthermore, the optical display system may also include a control module, and the control module is connected to the display module. The control module is used to control the display module to display images.
进一步，可选的，光学显示系统还可包括眼跟踪模组，眼跟踪模组与控制模组连接。在一种可能的实现方式中，控制模组可接收来自眼跟踪模组的左眼位置信息和右眼位置信息。Further, optionally, the optical display system may also include an eye tracking module, and the eye tracking module is connected to the control module. In a possible implementation, the control module can receive left eye position information and right eye position information from the eye tracking module.
下面对控制模组和眼跟踪模组分别进行介绍。The control module and eye tracking module are introduced separately below.
五、控制模组5. Control module
在一种可能的实现方式中，若光源组件为光源阵列，控制模组可以接收来自眼跟踪模组的观察者的左眼位置信息和右眼位置信息，根据左眼位置信息确定光源组件需要开启的第一光源的位置信息，以及根据右眼位置信息确定光源组件需要开启的第二光源的位置信息；根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。或者，若光源组件为面光源和光阀，控制模组可以根据左眼位置信息确定光阀的第一位置信息，以及根据右眼位置信息确定光阀的第二位置信息；并根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号。In a possible implementation, if the light source component is a light source array, the control module can receive the observer's left eye position information and right eye position information from the eye tracking module, and determine that the light source component needs to be turned on based on the left eye position information. The position information of the first light source, and the position information of the second light source that the light source component needs to be turned on is determined based on the right eye position information; the first control signal is generated based on the position information of the first light source and the position information of the second light source. Alternatively, if the light source component is a surface light source and a light valve, the control module can determine the first position information of the light valve based on the left eye position information, and determine the second position information of the light valve based on the right eye position information; and based on the third position information of the light valve. The first position information and the second position information of the light valve generate a second control signal.
示例性的，控制模组可以包括处理器，处理器可以是一种具有信号(或数据)的处理能力的电路，在一种实现中，处理器可以是具有指令读取与运行能力的电路，例如中央处理单元(central processing unit，CPU)、微处理器、图形处理器(graphics processing unit，GPU)(可以理解为一种微处理器)、或数字信号处理器(digital singnal processor，DSP)等；在另一种实现中，处理器可以通过硬件电路的逻辑关系实现一定功能，该硬件电路的逻辑关系是固定的或可以重构的，例如处理器为专用集成电路(application-specific integrated circuit，ASIC)或可编程逻辑器件(programmable logic device，PLD)实现的硬件电路，例如现场可编程门阵列(field programmable gate array，FPGA)。在可重构的硬件电路中，处理器加载配置文档， 实现硬件电路配置的过程，可以理解为处理器加载指令，以实现以上部分或全部单元的功能的过程。此外，处理器还可以是针对人工智能设计的硬件电路，其可以理解为一种ASIC，例如神经网络处理单元(neural network processing pnit，NPU)张量处理单元(tensor processing unit，TPU)、深度学习处理单元(deep learning processing unit，DPU)等。例如还可以是应用处理器(application processor，AP)、图像信号处理器(image signal processor，ISP)、或者其它可编程逻辑器件、晶体管逻辑器件，硬件部件或者其任意组合等。For example, the control module may include a processor. The processor may be a circuit with signal (or data) processing capabilities. In one implementation, the processor may be a circuit with instruction reading and execution capabilities. For example, a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP), etc. ; In another implementation, the processor can implement certain functions through the logical relationship of the hardware circuit, and the logical relationship of the hardware circuit is fixed or reconfigurable. For example, the processor is an application-specific integrated circuit (application-specific integrated circuit, Hardware circuits implemented by ASIC) or programmable logic device (PLD), such as field programmable gate array (FPGA). In reconfigurable hardware circuits, the processor loads the configuration file, The process of realizing hardware circuit configuration can be understood as the process of loading instructions by the processor to realize the functions of some or all of the above units. In addition, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (neural network processing unit, NPU), tensor processing unit (TPU), deep learning Processing unit (deep learning processing unit, DPU), etc. For example, it can also be an application processor (AP), an image signal processor (ISP), or other programmable logic devices, transistor logic devices, hardware components or any combination thereof.
六、眼跟踪模组6. Eye tracking module
在一种可能的实现方式中，眼跟踪是指通过测量眼睛的注视点的位置或者眼球相对头部的运动而实现对眼球运动的跟踪。眼跟踪模组是一种能够跟踪测量眼球位置及眼球运动信息的一种设备。In one possible implementation, eye tracking refers to tracking eye movement by measuring the position of the gaze point of the eye or the movement of the eyeball relative to the head. The eye tracking module is a device that can track and measure eye position and eye movement information.
眼跟踪模组实时跟踪并输出观察者人眼的位置，并传输给控制模组，以使得控制模组控制开启对应人眼位置的第一光源或第二光源，并高速切换左眼对应第一光源的开关和右眼对应的第二光源的开关。眼跟踪模块持续监测人眼位置，当人眼位置移动时，眼跟踪模块获取新的位置信息，将位置信息传输给控制模组。The eye tracking module tracks and outputs the position of the observer's eyes in real time and transmits it to the control module, so that the control module controls to turn on the first light source or the second light source corresponding to the position of the human eye, and switches the left eye corresponding to the first light source at high speed. The switch of the light source and the switch of the second light source corresponding to the right eye. The eye tracking module continuously monitors the position of the human eye. When the human eye position moves, the eye tracking module obtains new position information and transmits the position information to the control module.
具体的，当显示的图像发生移动时，用户的双目视线需实时跟踪虚像的移动，眼跟踪模组具体可确定双目注视图像的辐辏深度(即双目视点)。如图16所示，示例性地示出了辐辏调节冲突的原理。辐辏调节冲突是由于人眼在观察三维(three dimensional，3D)内容时，双目的正确的晶状体聚焦深度始终固定在屏幕上，而双目辐辏则会聚在由视差定义的目标距离上，可能位于屏幕前方,也可能位于屏幕后方，由于聚焦深度与辐辏深度的不匹配造成辐辏调节冲突。Specifically, when the displayed image moves, the user's binocular vision needs to track the movement of the virtual image in real time. The eye tracking module can specifically determine the convergence depth of the binocular gaze image (i.e., binocular viewpoint). As shown in Figure 16, the principle of convergence adjustment conflict is exemplarily shown. The vergence accommodation conflict is due to the fact that when the human eye observes three-dimensional (3D) content, the correct binocular lens focus depth is always fixed on the screen, while the binocular vergence converges at the target distance defined by the parallax, which may be located In front of the screen, it may also be located behind the screen. The mismatch between the focus depth and the vergence depth causes a convergence adjustment conflict.
示例性的，眼跟踪模组例如可以包括但不限于摄像头、红外线发射器或红外线探测器等。进一步，可选的，眼跟踪模组还包括处理器。For example, the eye tracking module may include, but is not limited to, a camera, an infrared emitter or an infrared detector, etc. Further, optionally, the eye tracking module also includes a processor.
基于上述内容，图17是本申请提供的一种光学显示系统的电路示意图。该光学显示系统中的电路主要包括处理器1701，外部存储器接口1702，内部存储器1703，音频模块1704，视频模块1705，电源模块1706，无线通信模块1707，输入/输出(input/output，I/O)接口1708、视频接口1709、显示电路1710、调制器1711和光源1712等。其中，处理器1701与其周边的元件，例如外部存储器接口1702，内部存储器1703，音频模块1704，视频模块1705，电源模块1706，无线通信模块1707，I/O接口1708、视频接口1709、显示电路1710可以通过总线连接。Based on the above content, FIG. 17 is a schematic circuit diagram of an optical display system provided by this application. The circuit in the optical display system mainly includes a processor 1701, an external memory interface 1702, an internal memory 1703, an audio module 1704, a video module 1705, a power module 1706, a wireless communication module 1707, input/output (I/O ) interface 1708, video interface 1709, display circuit 1710, modulator 1711, light source 1712, etc. Among them, the processor 1701 and its peripheral components, such as external memory interface 1702, internal memory 1703, audio module 1704, video module 1705, power module 1706, wireless communication module 1707, I/O interface 1708, video interface 1709, display circuit 1710 Can be connected via bus.
需要说明的是，本申请示意的电路图并不构成对光学显示系统的具体限定。在本申请另一些实施例中，光学显示系统可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。It should be noted that the circuit diagram schematically illustrated in this application does not constitute a specific limitation on the optical display system. In other embodiments of the present application, the optical display system may include more or fewer components than shown in the figures, or some components may be combined, or some components may be separated, or may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.
其中，处理器1701包括一个或多个处理单元，处理单元可以是一种具有信号(或数据)的处理能力的电路，具体可参见前述相关介绍，此处不再重复赘述。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。The processor 1701 includes one or more processing units. The processing unit may be a circuit with signal (or data) processing capabilities. For details, please refer to the above-mentioned relevant introductions, which will not be repeated here. Among them, different processing units can be independent devices or integrated in one or more processors.
处理器1701中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器1701中的存储器为高速缓冲存储器。该存储器可以保存处理器1701刚用过或循环使用的指令或数 据。如果处理器1701需要再次使用该指令或数据，可从存储器中直接调用。避免了重复存取，减少了处理器1701的等待时间，因而提高了光学显示系统的效率。其中，处理器1701可以执行存储的指令，执行上述成像方法。The processor 1701 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 1701 is cache memory. This memory can store instructions or data that have just been used or recycled by the processor 1701. according to. If the processor 1701 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 1701 is reduced, thereby improving the efficiency of the optical display system. The processor 1701 can execute stored instructions to perform the above imaging method.
在一些实施例中，光学显示系统还可以包括多个连接到处理器1701的输入输出(input/output，I/O)接口1708。I/O接口1708可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。上述I/O接口1708可以连接鼠标、触摸板、键盘、摄像头、扬声器/喇叭、麦克风等设备，也可以连接光学显示系统上的物理按键(例如音量键、亮度调节键、开关机键等)。In some embodiments, the optical display system may also include a plurality of input/output (I/O) interfaces 1708 connected to the processor 1701 . The I/O interface 1708 may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and universal asynchronous reception and transmission. Universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) ) interface, and/or universal serial bus (USB) interface, etc. The above-mentioned I/O interface 1708 can be connected to devices such as a mouse, touch pad, keyboard, camera, speaker/speaker, microphone, etc., or can be connected to physical buttons on the optical display system (such as volume keys, brightness adjustment keys, power on/off keys, etc.).
外部存储器接口1702可以用于连接外部存储卡，例如Micro SD卡，实现扩展光学显示系统的存储能力。外部存储卡通过外部存储器接口1702与处理器1701通信，实现数据存储功能。The external memory interface 1702 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the optical display system. The external memory card communicates with the processor 1701 through the external memory interface 1702 to implement the data storage function.
内部存储器1703可以用于存储计算机可执行程序代码，可执行程序代码包括指令。内部存储器1703可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序等。存储数据区可存储光学显示系统使用过程中所创建的数据等。此外，内部存储器1703可以包括随机存取存储器(random access memory，RAM)、闪存、通用闪存存储器(universal flash storage，UFS)、只读存储器(read-only memory，ROM)、可编程只读存储器(programmable ROM，PROM)、可擦除可编程只读存储器(erasable PROM，EPROM)、电可擦除可编程只读存储器(electrically EPROM，EEPROM)、寄存器、硬盘、移动硬盘、CD-ROM或者本领域熟知的任何其它形式的存储介质中。处理器1701通过运行存储在内部存储器1703的指令，和/或存储在设置于处理器1701中的存储器的指令，执行光学显示系统的各种功能应用以及数据处理。一种示例性的存储介质耦合至处理器，从而使处理器能够从该存储介质读取信息，且可向该存储介质写入信息。另一种示例中，存储介质也可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。另外，该ASIC可以位于光学显示系统中。当然，处理器和存储介质也可以作为分立组件存在于光学显示系统中。Internal memory 1703 may be used to store computer executable program code, which includes instructions. The internal memory 1703 may include a program storage area and a data storage area. Among them, the stored program area can store the operating system, at least one application program required for the function, etc. The storage data area can store data created during the use of the optical display system, etc. In addition, the internal memory 1703 may include random access memory (RAM), flash memory, universal flash storage (UFS), read-only memory (ROM), programmable read-only memory ( programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically erasable programmable read-only memory (electrically EPROM, EEPROM), register, hard disk, mobile hard disk, CD-ROM or in this field any other well-known storage medium. The processor 1701 executes various functional applications and data processing of the optical display system by executing instructions stored in the internal memory 1703 and/or instructions stored in a memory provided in the processor 1701 . An exemplary storage medium is coupled to the processor such that the processor can read information from the storage medium and write information to the storage medium. In another example, the storage medium may also be an integral part of the processor. The processor and storage media may be located in an ASIC. Additionally, the ASIC can be located in an optical display system. Of course, the processor and storage medium may also exist as discrete components in the optical display system.
光学显示系统可以通过音频模块1704以及应用处理器等实现音频功能。例如音乐播放，通话等。The optical display system can implement audio functions through the audio module 1704 and application processor. For example, music playback, phone calls, etc.
音频模块1704用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块1704还可以用于对音频信号编码和解码，例如进行放音或录音。在一些实施例中，音频模块1704可以设置于处理器1701中，或将音频模块1704的部分功能模块设置于处理器1701中。The audio module 1704 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 1704 can also be used to encode and decode audio signals, such as playing or recording. In some embodiments, the audio module 1704 may be provided in the processor 1701, or some functional modules of the audio module 1704 may be provided in the processor 1701.
视频接口1709可以接收外部输入的音视频信号，其具体可以为高清晰多媒体接口(high definition multimedia interface，HDMI)，数字视频接口(digital visual interface，DVI)，视频图形阵列(video graphics array，VGA)，显示端口(display port，DP)等，视频接口1709还可以向外输出视频。当光学显示系统作为抬头显示使用时，视频接口1709可以接收周边设备输入的速度信号、电量信号，还可以接收外部输入的AR视频信号。当光学显示系统作为投 影仪使用时，视频接口1709可以接收外部电脑或终端设备输入的视频信号。The video interface 1709 can receive external input audio and video signals, which can specifically be a high definition multimedia interface (HDMI), a digital visual interface (DVI), or a video graphics array (VGA). , display port (display port, DP), etc., the video interface 1709 can also output video to the outside. When the optical display system is used as a head-up display, the video interface 1709 can receive speed signals and power signals input from peripheral devices, and can also receive externally input AR video signals. When the optical display system acts as a projection When the projector is used, the video interface 1709 can receive video signals input from an external computer or terminal device.
视频模块1705可以对视频接口1709输入的视频进行解码，例如进行H.264解码。视频模块还可以对光学显示系统采集到的视频进行编码，例如对外接的摄像头采集到的视频进行H.264编码。此外，处理器1701也可以对视频接口1709输入的视频进行解码，然后将解码后的图像信号输出到显示电路1710。The video module 1705 can decode the video input by the video interface 1709, for example, perform H.264 decoding. The video module can also encode the video collected by the optical display system, such as H.264 encoding of the video collected by an external camera. In addition, the processor 1701 can also decode the video input from the video interface 1709 and then output the decoded image signal to the display circuit 1710 .
电源模块1706用于根据输入的电力(例如直流电)为处理器1701和光源1712提供电源，电源模块1706中可以包括可充电电池，可充电电池可以为处理器1701和光源1712提供电源。光源1712发出的光可以传输到调制器1711进行成像，从而形成图像光信号。The power module 1706 is used to provide power to the processor 1701 and the light source 1712 according to the input power (such as direct current). The power module 1706 may include a rechargeable battery, and the rechargeable battery may provide power to the processor 1701 and the light source 1712. The light emitted by the light source 1712 can be transmitted to the modulator 1711 for imaging, thereby forming an image light signal.
无线通信模块1707可以使得光学显示系统与外界进行无线通信，其可以提供无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near Field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。无线通信模块1707可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块1707经由天线接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器1701。无线通信模块1707还可以从处理器1701接收待发送的信号，对其进行调频，放大，经天线转为电磁波辐射出去。The wireless communication module 1707 can enable the optical display system to communicate wirelessly with the outside world, and can provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT) , Global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 1707 may be one or more devices integrating at least one communication processing module. The wireless communication module 1707 receives electromagnetic waves through the antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 1701 . The wireless communication module 1707 can also receive the signal to be sent from the processor 1701, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna for radiation.
另外，视频模块1705进行解码的视频数据除了通过视频接口1709输入之外，还可以通过无线通信模块1707以无线的方式接收或从外部存储器中读取，例如光学显示系统可以通过车内的无线局域网从终端设备或车载娱乐系统接收视频数据，光学显示系统还可以读取外部存储器中存储的音视频数据。In addition, in addition to being input through the video interface 1709, the video data decoded by the video module 1705 can also be received wirelessly through the wireless communication module 1707 or read from an external memory. For example, the optical display system can use the wireless LAN in the car. Receive video data from the terminal device or car entertainment system, the optical display system can also read the audio and video data stored in the external memory.
显示电路1710和调制器1711用于显示对应的图像。在本实施例中，视频接口1709接收外部输入的视频源信号，视频模块1705进行解码和/或数字化处理后输出一路或多路图像信号至显示电路1710，显示电路1710根据输入的图像信号驱动调制器1711将入射的偏振光进行成像，进而输出至少两路图像光。此外，处理器1701也可以向显示电路1710输出一路或多路图像信号。The display circuit 1710 and the modulator 1711 are used to display corresponding images. In this embodiment, the video interface 1709 receives an externally input video source signal. The video module 1705 decodes and/or digitizes the signal and outputs one or more image signals to the display circuit 1710. The display circuit 1710 drives the modulation according to the input image signal. The detector 1711 images the incident polarized light, and then outputs at least two channels of image light. In addition, the processor 1701 can also output one or more image signals to the display circuit 1710 .
示例性地，光学显示系统可以包括但不限于HUD、投影机、显示器、车载显示屏、AR设备、VR设备、或智能车灯等，其中，AR设备可以包括但不限于AR眼镜或AR头盔等，VR设备可以包括但不限于VR眼镜或VR头盔等。For example, the optical display system may include but is not limited to HUD, projector, display, vehicle display screen, AR device, VR device, or smart car lights, etc., wherein the AR device may include but is not limited to AR glasses or AR helmet, etc. , VR equipment may include but is not limited to VR glasses or VR helmets, etc.
基于上述描述的光学显示系统的结构和功能原理，本申请还可以提供一种终端设备。基于上述描述的光学显示装置的结构和功能原理，本申请还可以提供一种终端设备。该终端设备可包括上述任一实施例中的显示模组。示例性地，该终端设备例如可以是车辆(例如无人车、智能车、电动车、或数字汽车等)、机器人、测绘设备、无人机、智能家居设备(例如电视、扫地机器人、智能台灯、音响系统、智能照明系统、电器控制系统、家庭背景音乐、家庭影院系统、对讲系统、或视频监控等)、智能制造设备(例如工业设备)、智能运输设备(例如AGV、无人运输车、或货车等)、或智能终端(手机、计算机、平板电脑、掌上电脑、台式机、耳机、音响、穿戴设备、车载设备、虚拟现实设备、增强现实设备等)等。Based on the structure and functional principles of the optical display system described above, the present application can also provide a terminal device. Based on the structure and functional principles of the optical display device described above, the present application can also provide a terminal device. The terminal device may include the display module in any of the above embodiments. For example, the terminal device may be a vehicle (such as an unmanned vehicle, a smart vehicle, an electric vehicle, or a digital vehicle, etc.), a robot, a mapping device, a drone, or a smart home device (such as a television, a sweeping robot, or a smart desk lamp). , audio system, intelligent lighting system, electrical control system, home background music, home theater system, intercom system, or video surveillance, etc.), intelligent manufacturing equipment (such as industrial equipment), intelligent transportation equipment (such as AGV, unmanned transport vehicle) , or trucks, etc.), or smart terminals (mobile phones, computers, tablets, PDAs, desktops, headsets, speakers, wearable devices, vehicle-mounted devices, virtual reality devices, augmented reality devices, etc.), etc.
以终端设备为车辆为例，请参阅图18，为本申请提供的一种车辆的示例性功能框图。耦合到终端设备1800或包括在终端设备1800中的组件可以包括推进系统1801、传感系统1802、 控制系统1803、计算机系统1804、用户接口1805以及光学显示系统1806。终端设备1800的组件可以被配置为以与彼此互连和/或与耦合到各系统的其它组件互连的方式工作。例如，计算机系统1804可以被配置为从推进系统1801、传感系统1802和控制系统1803等接收数据并对它们进行控制。计算机系统1804还可以被配置为在用户接口1805上生成图像的显示并从用户接口1805接收输入。Taking the terminal device as a vehicle as an example, please refer to Figure 18, which is an exemplary functional block diagram of a vehicle provided by this application. Components coupled to or included in terminal device 1800 may include propulsion system 1801, sensing system 1802, Control system 1803, computer system 1804, user interface 1805 and optical display system 1806. The components of terminal device 1800 may be configured to operate in interconnection with each other and/or with other components coupled to various systems. For example, computer system 1804 may be configured to receive data from and control propulsion system 1801, sensing system 1802, control system 1803, and the like. Computer system 1804 may also be configured to generate a display of the image on user interface 1805 and receive input from user interface 1805 .
推进系统1801可以为终端设备1800提供动力运动。推进系统1801可以包括引擎/发动机、能量源、传动装置(transmission)和车轮/轮胎。另外，推进系统1801可以额外地或可替换地包括除了图18所示出的组件以外的其他组件。本申请对此不做具体限定。Propulsion system 1801 may provide powered motion for terminal device 1800. Propulsion system 1801 may include an engine/motor, energy source, transmission, and wheels/tyres. Additionally, propulsion system 1801 may additionally or alternatively include other components in addition to those shown in FIG. 18 . This application does not specifically limit this.
传感系统1802可以包括用于感测关于终端设备1800所位于的环境的信息等的若干个传感器。示例性的，传感系统1802的传感器可以包括但不限于全球定位系统(global positioning system，GPS)、惯性测量单元(inertial measurement unit，IMU)、毫米波雷达、激光雷达、相机以及用于修改传感器的位置和/或朝向的制动器。毫米波雷达可利用无线电信号来感测终端设备1800的周边环境内的目标。在一些实施例中，除了感测目标以外，毫米波雷达还可用于感测目标的速度和/或前进方向。激光雷达可利用激光来感测终端设备1800所位于的环境中的目标。在一些实施例中，激光雷达可包括一个或多个激光源以及一个或多个探测器，以及其他系统组件。相机可用于捕捉终端设备1800的周边环境的多个图像。相机可以是静态相机或视频相机。在一些实施例中，GPS可以为用于估计终端设备1800的地理位置的任何传感器。为此，GPS可以包括收发器，基于卫星定位数据估计终端设备1800相对于地球的位置。在一些可能的示例中，计算机系统1804可以用于结合地图数据使用GPS来估计终端设备1800行驶的道路。IMU可以用于基于惯性加速度及其任意组合来感测终端设备1800的位置和朝向变化。在一些示例中，IMU中传感器的组合可包括例如加速度计和陀螺仪。另外，IMU中传感器的其它组合也是可能的。The sensing system 1802 may include several sensors for sensing information about the environment in which the terminal device 1800 is located, and the like. For example, the sensors of the sensing system 1802 may include, but are not limited to, global positioning system (GPS), inertial measurement unit (IMU), millimeter wave radar, lidar, cameras, and sensors for modifying the position and/or orientation of the brake. Millimeter wave radar may utilize radio signals to sense targets in the surrounding environment of the terminal device 1800 . In some embodiments, in addition to sensing targets, millimeter wave radar may be used to sense the speed and/or heading of the target. LiDAR can utilize laser light to sense targets in the environment where the terminal device 1800 is located. In some embodiments, a lidar may include one or more laser sources and one or more detectors, among other system components. The camera may be used to capture multiple images of the surrounding environment of the terminal device 1800 . The camera can be a still camera or a video camera. In some embodiments, GPS may be any sensor used to estimate the geographic location of terminal device 1800 . To this end, the GPS may include a transceiver that estimates the position of the terminal device 1800 relative to the Earth based on satellite positioning data. In some possible examples, computer system 1804 may be used to estimate the road traveled by terminal device 1800 using GPS in conjunction with map data. The IMU may be used to sense changes in position and orientation of the terminal device 1800 based on inertial acceleration and any combination thereof. In some examples, the combination of sensors in the IMU may include, for example, an accelerometer and a gyroscope. Additionally, other combinations of sensors in the IMU are possible.
可以理解的是，传感系统1802还可包括被监视终端设备1800的内部系统的传感器(例如，车内空气质量监测器、燃油量表、机油温度表等)。来自这些传感器中的一个或多个的传感器数据可用于检测对象及其相应特性(位置、形状、方向、速度等)。这种检测和识别是终端设备1800的安全操作的关键功能。传感系统1802还可以包括其它传感器。本申请对此不做具体限定。It can be understood that the sensing system 1802 may also include sensors of internal systems of the terminal device 1800 being monitored (eg, in-vehicle air quality monitor, fuel gauge, oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding properties (position, shape, orientation, speed, etc.). This detection and identification is a critical function for the secure operation of terminal device 1800. Sensing system 1802 may also include other sensors. This application does not specifically limit this.
控制系统1803为控制终端设备1800及其组件的操作。控制系统1803可包括各种元件，其中包括转向单元、油门、制动单元、传感器融合算法、计算机视觉系统、路线控制系统以及障碍物避免系统。转向系统可操作来调整终端设备1800的前进方向。例如在一个实施例中可以为方向盘系统。油门用于控制引擎的操作速度并进而控制终端设备1800的速度。控制系统1803可以额外地或可替换地包括除了图18所示出的组件以外的其他组件。本申请对此不做具体限定。制动单元用于控制终端设备1800减速。制动单元可使用摩擦力来减慢车轮。在其他实施例中，制动单元可将车轮的动能转换为电流。制动单元也可采取其他形式来减慢车轮转速从而控制终端设备1800的速度。计算机视觉系统可以操作来处理和分析由相机捕捉的图像以便识别终端设备1800周边环境中的目标和/或特征。目标和/或特征可包括交通信号、道路边界和障碍物。计算机视觉系统可使用目标识别算法、运动中恢复结构(structure from motion，SFM)算法、视频跟踪和其他计算机视觉技术。在一些实施例中，计算机视觉系统可以用于为环境绘制地图、跟踪目标、估计目标的速度等等。路线控制系统用于确定终端设备 1800的行驶路线。在一些实施例中，路线控制系统可结合来自传感系统1802、GPS和一个或多个预定地图的数据以为终端设备1800确定行驶路线。障碍物避免系统用于识别、评估和避免或者以其他方式越过终端设备1800的环境中的潜在障碍物。当然，在一个实例中，控制系统1803可以增加或替换地包括除了所示出和描述的那些以外的组件。或者也可以减少一部分上述示出的组件。The control system 1803 controls the operation of the terminal device 1800 and its components. The control system 1803 may include various elements, including steering units, throttles, braking units, sensor fusion algorithms, computer vision systems, route control systems, and obstacle avoidance systems. The steering system is operable to adjust the forward direction of the terminal device 1800. For example, in one embodiment it may be a steering wheel system. The throttle is used to control the operating speed of the engine and thus the speed of the terminal device 1800 . Control system 1803 may additionally or alternatively include other components in addition to those shown in FIG. 18 . This application does not specifically limit this. The braking unit is used to control the terminal equipment 1800 to decelerate. Braking units use friction to slow down the wheels. In other embodiments, the braking unit may convert the kinetic energy of the wheels into electrical current. The braking unit may also take other forms to slow down the wheel speed to control the speed of the terminal device 1800 . The computer vision system may be operable to process and analyze images captured by the camera in order to identify objects and/or features in the environment surrounding the terminal device 1800 . Objects and/or features may include traffic signals, road boundaries, and obstacles. Computer vision systems can use target recognition algorithms, structure from motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, computer vision systems can be used to map an environment, track targets, estimate a target's speed, and so on. Route control systems are used to determine terminal equipment 1800 driving route. In some embodiments, the route control system may combine data from the sensing system 1802, GPS, and one or more predetermined maps to determine a driving route for the terminal device 1800. An obstacle avoidance system is used to identify, evaluate, and avoid or otherwise negotiate potential obstacles in the environment of terminal device 1800 . Of course, in one example, control system 1803 may additionally or alternatively include components in addition to those shown and described. Alternatively, some of the components shown above may be reduced.
终端设备1800的部分或所有功能受计算机系统1804控制。计算机系统1804可包括至少一个处理器18041，进一步，该计算机系统1804还可包括接口电路18042。处理器18041执行存储在例如存储器18043这样的非暂态计算机可读介质中的指令。计算机系统1804还可以是采用分布式方式控制终端设备1800的个体组件或子系统的多个计算设备。Some or all functions of the terminal device 1800 are controlled by the computer system 1804. The computer system 1804 may include at least one processor 18041. Further, the computer system 1804 may also include an interface circuit 18042. Processor 18041 executes instructions stored in a non-transitory computer-readable medium such as memory 18043. Computer system 1804 may also be multiple computing devices that control individual components or subsystems of terminal device 1800 in a distributed manner.
处理器18041可以是一种具有信号(或数据)的处理能力的电路，具体可参见前述相关介绍，此处不再赘述。The processor 18041 may be a circuit with signal (or data) processing capabilities. For details, please refer to the above related introduction, which will not be described again here.
尽管图18功能性地图示了处理器、存储器、和在相同块中的计算机系统1804的其它元件，但是本领域的普通技术人员应该理解该处理器和存储器实际上可以不存储在相同的物理外壳内的多个处理器或存储器。例如，存储器可以是硬盘驱动器或位于不同于计算机系统1804的外壳内的其它存储介质。不同于使用单一的处理器来执行此处所描述的步骤，诸如转向组件和减速组件的一些组件每个都可以具有其自己的处理器，处理器只执行与特定于组件的功能相关的计算。再比如，处理器也可以远离该车辆但可以与该车辆进行无线通信。Although FIG. 18 functionally illustrates the processor, memory, and other elements of computer system 1804 in the same block, one of ordinary skill in the art will understand that the processor and memory may not actually be stored in the same physical enclosure. multiple processors or memories within. For example, the memory may be a hard drive or other storage medium located in a housing different from computer system 1804. Rather than using a single processor to perform the steps described herein, some components, such as the steering component and the deceleration component, may each have their own processor that only performs calculations related to component-specific functionality. As another example, the processor can also be remote from the vehicle but can communicate wirelessly with the vehicle.
在一些实施例中，存储器18043可包含指令(例如，程序逻辑)，指令可被处理器18041读取来执行终端设备1800的各种功能，包括以上描述的功能。存储器18043也可包含额外的指令，包括向推进系统1801、传感系统1802和控制系统1803中的一个或多个发送数据、从其接收数据、与其交互和/或对其进行控制的指令。除了指令以外，存储器18043还可存储数据，例如道路地图，路线信息，传感器检测到的数据，车辆的位置、方向、速度以及其它这样的车辆数据，以及其他信息。这种信息可在终端设备1800在自主、半自主和/或手动模式中被终端设备1800和计算机系统1804使用。In some embodiments, memory 18043 may contain instructions (eg, program logic) that may be read by processor 18041 to perform various functions of terminal device 1800, including the functions described above. Memory 18043 may also contain additional instructions, including instructions to send data to, receive data from, interact with, and/or control one or more of propulsion system 1801 , sensing system 1802 , and control system 1803 . In addition to instructions, the memory 18043 may also store data such as road maps, route information, data detected by sensors, vehicle position, direction, speed and other such vehicle data, as well as other information. This information may be used by terminal device 1800 and computer system 1804 when terminal device 1800 is in autonomous, semi-autonomous and/or manual modes.
存储器可参见上述图19中的内部存储器1903的介绍，此处不再赘述。For memory, please refer to the introduction of the internal memory 1903 in Figure 19 above, and will not be described again here.
用户接口1805，用于向终端设备1800的用户提供信息或从其接收信息。可选地，用户接口1805可包括在外围设备的集合内的一个或多个输入/输出设备，外围设备可以包括例如无线通信系统、触摸屏、麦克风和/或扬声器等。User interface 1805, used to provide information to or receive information from the user of the terminal device 1800. Optionally, user interface 1805 may include one or more input/output devices within a collection of peripheral devices, which may include, for example, a wireless communication system, a touch screen, a microphone and/or a speaker, and the like.
计算机系统1804可基于从各种子系统(例如，推进系统1801、传感系统1802和控制系统1803)以及从用户接口1805接收的输入来控制终端设备1800的功能。例如，计算机系统1804可利用来自控制系统1803的输入以便控制转向单元来避免由传感系统1802和障碍物避免系统检测到的障碍物。在一些实施例中，计算机系统1804可操作来对终端设备1800及其子系统的许多方面提供控制。Computer system 1804 may control the functionality of terminal device 1800 based on input received from various subsystems (eg, propulsion system 1801 , sensing system 1802 , and control system 1803 ) and from user interface 1805 . For example, computer system 1804 may utilize input from control system 1803 in order to control the steering unit to avoid obstacles detected by sensing system 1802 and obstacle avoidance system. In some embodiments, computer system 1804 is operable to provide control over many aspects of terminal device 1800 and its subsystems.
光学显示系统1806可参见前述任一实施例的介绍，此处不再赘述。需要说明的是，光学显示系统中的部分元件的功能也可以由车辆的其它子系统来实现，例如，控制器也可以为控制系统中的元件。The optical display system 1806 can be referred to the introduction of any of the previous embodiments, and will not be described again here. It should be noted that the functions of some components in the optical display system can also be implemented by other subsystems of the vehicle. For example, the controller can also be a component in the control system.
可选地，上述这些组件中的一个或多个可与终端设备1800分开安装或关联。例如，存储器18043可以部分或完全地与终端设备1800分开存在。上述组件可以按有线和/或无线方式来通信地耦合在一起。 Alternatively, one or more of the components described above may be installed separately from or associated with the terminal device 1800 . For example, the memory 18043 may exist partially or completely separately from the terminal device 1800. The components described above may be communicatively coupled together in wired and/or wireless manners.
需要说明的是，图18给出的终端设备功能框架只是一个示例，在其它示例中，终端设备1800可以包括更多、更少或不同的系统，并且每个系统可以包括更多、更少或不同的组件。此外，示出的系统和组件可以按任意种的方式进行组合或划分，本申请对此不做具体限定。It should be noted that the terminal device functional framework shown in Figure 18 is just an example. In other examples, the terminal device 1800 may include more, fewer, or different systems, and each system may include more, less, or different components. In addition, the systems and components shown can be combined or divided in any way, which is not specifically limited in this application.
基于上述内容和相同的构思，本申请提供一种成像方法，请参阅图19的介绍。该成像方法可应用于上述任一实施例所示的显示模组或光学显示系统或终端设备。也可以理解为，可以基于上述任一实施例所示的显示模组或光学显示系统或终端设备来实现成像方法。为了便于方案的说明，如下以光源组件为光源阵列为例介绍。该方法包括以下步骤：Based on the above content and the same concept, this application provides an imaging method, please refer to the introduction of Figure 19. This imaging method can be applied to the display module or optical display system or terminal device shown in any of the above embodiments. It can also be understood that the imaging method can be implemented based on the display module or optical display system or terminal device shown in any of the above embodiments. In order to facilitate the explanation of the solution, the following takes the light source component as a light source array as an example. The method includes the following steps:
步骤1901，眼跟踪模组检测观察者的左眼位置和右眼位置。Step 1901: The eye tracking module detects the position of the observer's left eye and right eye.
其中，眼跟踪模组检测观察者的左眼位置和右眼位置的过程和原理可参见前述相关介绍，此处不再赘述。Among them, the process and principle of the eye tracking module detecting the position of the observer's left eye and right eye can be found in the relevant introduction mentioned above and will not be described again here.
步骤1902，眼跟踪模组向控制模组发送左眼位置信息和右眼位置信息。相应的，控制模组接收来自眼跟踪模组的左眼位置信息和右眼位置信息。Step 1902: The eye tracking module sends left eye position information and right eye position information to the control module. Correspondingly, the control module receives left eye position information and right eye position information from the eye tracking module.
其中，眼跟踪模组与控制模组连接。Among them, the eye tracking module is connected with the control module.
步骤1903，控制模组根据左眼位置信息及第一对应关系确定第一光源的位置信息，以及根据右眼位置信息及第二对应关系确定第二光源的位置信息。Step 1903: The control module determines the position information of the first light source based on the left eye position information and the first corresponding relationship, and determines the position information of the second light source based on the right eye position information and the second corresponding relationship.
其中，第一对应关系包括左眼位置与第一光源的位置信息的关系，第二对应关系包括右眼位置与第二光源的位置信息的对应关系。需要说明的是，第一对应关系和第二对应关系可以是表的形式，或者也可以是其它可能的形式，本申请对此不做限定。The first correspondence relationship includes the relationship between the position of the left eye and the position information of the first light source, and the second correspondence relationship includes the correspondence relationship between the position of the right eye and the position information of the second light source. It should be noted that the first correspondence relationship and the second correspondence relationship may be in the form of a table, or may be in other possible forms, which is not limited in this application.
表1和表2示例性的示出了第一对应关系和第二对应关系。表1和表2中的第一光源的位置信息和第二光源的位置信息均以第一光源和第二光源在光源阵列中的行和列表示。Table 1 and Table 2 exemplarily show the first correspondence relationship and the second correspondence relationship. The position information of the first light source and the position information of the second light source in Table 1 and Table 2 are both represented by the rows and columns of the first light source and the second light source in the light source array.
表1第一对应关系
Table 1 First correspondence relationship
表2第二对应关系
Table 2 Second Correspondence
可以理解的是，控制模组还可以获取到第一光源开启的第一时段T1、第二光源开启的第二时段T2、第一光源的切换频率v1、以及第二光源的切换频率v2等。其中，第一光源开启的第一时段T1和第一光源的切换频率v1可以携带于第一控制信号，并发送给光源阵列。第二光源开启的第二时段T2和第二光源的切换频率v2可以携带于第二控制信号，并发送给光源阵列。应理解，第一对应关系和第二对应关系也可以是在同一张表中，本申请对此不作限 定。It can be understood that the control module can also obtain the first period T 1 during which the first light source is turned on, the second period T 2 during which the second light source is turned on, the switching frequency v1 of the first light source, and the switching frequency v2 of the second light source. wait. The first period T 1 during which the first light source is turned on and the switching frequency v1 of the first light source can be carried in the first control signal and sent to the light source array. The second period T 2 during which the second light source is turned on and the switching frequency v2 of the second light source may be carried in the second control signal and sent to the light source array. It should be understood that the first corresponding relationship and the second corresponding relationship may also be in the same table, and this application is not limited to this. Certainly.
步骤1904，控制模组根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。Step 1904: The control module generates a first control signal based on the position information of the first light source and the position information of the second light source.
在一种可能的实现方式中，第一控制信号包括第一光源的位置信息及第二光源的位置信息。In a possible implementation, the first control signal includes position information of the first light source and position information of the second light source.
步骤1905，控制模组根据第一光源的位置信息和第二光源的位置信息生成第三控制信号。Step 1905: The control module generates a third control signal based on the position information of the first light source and the position information of the second light source.
其中，第三控制信号用于控制光调制组件切换第一图像信息和第二图像信息的频率。Wherein, the third control signal is used to control the light modulation component to switch the frequency of the first image information and the second image information.
需要说明的是，上述步骤1904与步骤1905之间没有先后顺序，可以先执行步骤1904后执行步骤1905，或者也可以是先执行步骤1905后执行步骤1904，或者也可以是步骤1904和步骤1905同步执行，即第一控制信号和第三控制信号同步生成，本申请对此不作限定。It should be noted that there is no sequence between the above steps 1904 and 1905. Step 1904 may be executed first and then step 1905, or step 1905 may be executed first and then step 1904, or step 1904 and step 1905 may be synchronized. Execution, that is, the first control signal and the third control signal are generated synchronously, which is not limited in this application.
步骤1906，控制模组向光源组件发送第一控制信号，并向光调制组件发送第三控制信号。相应的，光源组件接收来自控制模块的第一控制信号，光调制组件接收来自控制模组的第三控制信号。Step 1906: The control module sends a first control signal to the light source component and a third control signal to the light modulation component. Correspondingly, the light source component receives the first control signal from the control module, and the light modulation component receives the third control signal from the control module.
步骤1907，光源组件根据接收到的第一控制信号，在第一时段开启光源阵列中的第一光源，在第二时段开启光源阵列中的第二光源。Step 1907: The light source component turns on the first light source in the light source array during the first period and turns on the second light source in the light source array during the second period according to the received first control signal.
其中，开启的第一光源用于发射第一光束，开启的第二光源用于发射第二光束。关于第一光束和第二光束的详细介绍可参见前述相关描述，此处不再赘述。Wherein, the first light source that is turned on is used to emit a first light beam, and the second light source that is turned on is used to emit a second light beam. For detailed introduction of the first beam and the second beam, please refer to the foregoing relevant descriptions and will not be described again here.
步骤1908，光调制组件根据第三控制信号，对第三光束进行调制得到携带第一图像信息的第一图像光，以及对第四光束进行调制得到携带第二图像信息的第二图像光。Step 1908: The light modulation component modulates the third light beam according to the third control signal to obtain the first image light carrying the first image information, and modulates the fourth light beam to obtain the second image light carrying the second image information.
其中，第三控制信号包括第一图像信息和第二图像信息的切换频率。该切换频率可以根据最低要求(即人眼不可分辨出闪烁频率)和用户需求改变。进一步，可选的，第一图像信息和第二图像信息的切换频率等于第一光源的切换频率和第二光源的切换频率之和。结合上述图4，ν3＝ν1+ν2，ν3表示光调制组件的切换频率，ν1表示第一光源的切换频率，ν2表示第二光源的切换频率。通常ν1＝ν2，ν3＝2ν1＝2ν2。例如，第一光源的切换频率ν1＝1/60秒，第二光源的切换频率ν2＝1/60秒。可以理解的是，光学显示系统开始运作后，第一图像信息和第二图像信息的切换频率通常是固定的。Wherein, the third control signal includes the switching frequency of the first image information and the second image information. This switching frequency can be changed based on minimum requirements (i.e. the flicker frequency cannot be distinguished by the human eye) and user needs. Further, optionally, the switching frequency of the first image information and the second image information is equal to the sum of the switching frequency of the first light source and the switching frequency of the second light source. Combined with the above-mentioned Figure 4, ν3=ν1+ν2, ν3 represents the switching frequency of the light modulation component, ν1 represents the switching frequency of the first light source, and ν2 represents the switching frequency of the second light source. Usually ν1=ν2, ν3=2ν1=2ν2. For example, the switching frequency of the first light source ν1=1/60 second, and the switching frequency of the second light source ν2=1/60 second. It can be understood that after the optical display system starts to operate, the switching frequency of the first image information and the second image information is usually fixed.
进一步，结合上述图4，光调制组件切换时间与第一光源开启时间的间隔为ΔT，其中，ΔT也可以是在显示模组初始化过程中预先设置的。应理解，ΔT可以等于0，也可以不等于0，本申请对此不作限定。Furthermore, with reference to the above-mentioned Figure 4, the interval between the switching time of the light modulation component and the turning on time of the first light source is ΔT, where ΔT can also be preset during the initialization process of the display module. It should be understood that ΔT may be equal to 0 or not equal to 0, and this application does not limit this.
通过上述步骤1901至步骤1908，可以控制显示模组进行图像显示。若第一图像信息与第二图像信息相同，显示模组可以实现二维图像显示。若第一图像信息与第二图像信息不同，显示模组可以实现三维图像显示。Through the above steps 1901 to 1908, the display module can be controlled to display images. If the first image information and the second image information are the same, the display module can realize two-dimensional image display. If the first image information and the second image information are different, the display module can realize three-dimensional image display.
需要说明的是，眼跟踪模组持续监测人眼位置，眼跟踪模组持续执行上述步骤1901。当人眼位置移动时，眼跟踪模组检测到左眼和右眼的新的位置，重复执行上述步骤1902～步骤1908。当人眼位置不变动时，步骤1902中的第一控制信号不变，持续发送第一控制信号以点亮相应的第一光源或第二光源。It should be noted that the eye tracking module continues to monitor the position of the human eye, and the eye tracking module continues to perform the above step 1901. When the human eye position moves, the eye tracking module detects the new positions of the left eye and the right eye, and repeats the above steps 1902 to 1908. When the position of the human eye does not change, the first control signal in step 1902 does not change, and the first control signal continues to be sent to light the corresponding first light source or second light source.
请参阅图20a，为本申请提供的一种观察者的左眼和右眼在位置1的光路图。当眼跟踪模组检测到观察者的左眼和右眼在位置2时，基于显示模组的光路可参见图20b。Please refer to Figure 20a, which is an optical path diagram of an observer's left eye and right eye at position 1 provided by this application. When the eye tracking module detects that the observer's left eye and right eye are at position 2, the optical path based on the display module can be seen in Figure 20b.
需要说明的是，若光源组件为面光源和光阀，上述步骤1903的具体过程为：控制模组根据左眼位置信息及第三对应关系确定光阀的第一位置信息，以及根据右眼位置信息及第四对 应关系确定光阀的第二位置信息。It should be noted that if the light source component is a surface light source and a light valve, the specific process of the above step 1903 is: the control module determines the first position information of the light valve according to the left eye position information and the third corresponding relationship, and determines the first position information of the light valve according to the right eye position information. and the fourth pair The second position information of the light valve should be determined according to the relationship.
表3和表4示例性的示出了第三对应关系和第四对应关系。表3和表4中以光阀的第一位置信息包括光阀的第一宽度和第一中心坐标为例，以光阀的第二位置信息包括光阀的第二宽度和第二中心坐标为例。Table 3 and Table 4 exemplarily show the third correspondence relationship and the fourth correspondence relationship. In Table 3 and Table 4, the first position information of the light valve includes the first width and the first center coordinate of the light valve as an example. The second position information of the light valve includes the second width and the second center coordinate of the light valve. example.
表3第一对应关系
Table 3 First Correspondence
表4第二对应关系
Table 4 Second Correspondence
需要说明的是，上述表3中的第一宽度11、第一宽度12…第一宽度1n可以相同也可以不同，第二宽度21、第二宽度22…第二宽度2n可以相同也可以不同，第一宽度与第二宽度可以相同也可以不同，本申请对此不作限定。此外，上述是以第三对应关系和第四对应关系在不同的表中示例的。应理解，第三对应关系和第四对应关系也可以是在同一张表中，本申请对此不作限定。It should be noted that the first width 11, the first width 12... the first width 1n in the above Table 3 can be the same or different, and the second width 21, the second width 22... the second width 2n can be the same or different. The first width and the second width may be the same or different, which is not limited in this application. In addition, the above examples are based on the third correspondence relationship and the fourth correspondence relationship in different tables. It should be understood that the third corresponding relationship and the fourth corresponding relationship may also be in the same table, and this application does not limit this.
基于此，上述步骤1904具体可以为，控制模组根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号。Based on this, the above step 1904 may specifically include the control module generating a second control signal based on the first position information of the light valve and the second position information of the light valve.
可以理解的是，为了实现上述实施例中功能，控制装置包括了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到，结合本申请中所公开的实施例描述的各示例的模块及方法步骤，本申请能够以硬件或硬件和计算机软件相结合的形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用场景和设计约束条件。It can be understood that, in order to implement the functions in the above embodiments, the control device includes corresponding hardware structures and/or software modules that perform each function. Those skilled in the art should easily realize that the modules and method steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software driving the hardware depends on the specific application scenarios and design constraints of the technical solution.
基于上述内容和相同构思，图21和图22为本申请的提供的可能的控制装置的结构示意图。这些控制装置可以用于实现上述方法实施例中控制装置的功能，因此也能实现上述方法实施例所具备的有益效果。Based on the above content and the same concept, FIG. 21 and FIG. 22 are schematic structural diagrams of possible control devices provided by the present application. These control devices can be used to implement the functions of the control devices in the above method embodiments, and therefore can also achieve the beneficial effects of the above method embodiments.
如图21所示，该控制装置2100包括处理模块2101和收发模块2102。控制装置2100用于实现上述图19中所示的方法实施例中控制装置的功能。As shown in Figure 21, the control device 2100 includes a processing module 2101 and a transceiver module 2102. The control device 2100 is used to implement the functions of the control device in the method embodiment shown in FIG. 19 .
当控制装置2100用于实现图19所示的方法实施例的控制装置的功能时：处理模块2101与收发模块2102协调用于控制光源组件分时发射第一光束及第二光束，第一光束和第二光束的出射位置不同，第一光束经光学整形组件调整为第三光束，第二光束经光学整形组件调整为第四光束；并控制光调制组件对第三光束调制得到携带第一图像信息的第一图像光，对第四光束经光调制得到携带第二图像信息的第二图像光；第一图像光经反射组件反射至观察者 的左眼成像，第二图像光经反射组件反射至观察者的右眼成像。When the control device 2100 is used to implement the functions of the control device in the method embodiment shown in Figure 19: the processing module 2101 coordinates with the transceiver module 2102 to control the light source component to emit the first beam and the second beam in a time-sharing manner, the first beam and The exit position of the second beam is different. The first beam is adjusted to a third beam through the optical shaping component, and the second beam is adjusted to a fourth beam through the optical shaping component. The light modulating component is controlled to modulate the third beam to carry the first image information. The first image light is optically modulated on the fourth beam to obtain the second image light carrying the second image information; the first image light is reflected to the observer through the reflective component The left eye of the observer is imaged, and the second image light is reflected by the reflective component to the observer's right eye for imaging.
有关上述处理模块2101和收发模块2102更详细的描述可以参考图19所示的方法实施例中相关描述直接得到，此处不再一一赘述。A more detailed description of the above processing module 2101 and transceiver module 2102 can be obtained directly by referring to the relevant description in the method embodiment shown in Figure 19, and will not be described again here.
应理解，本申请实施例中的处理模块2101可以由处理器或处理器相关电路组件实现，收发模块2102可以由收发器或收发器相关电路组件实现。It should be understood that the processing module 2101 in the embodiment of the present application can be implemented by a processor or processor-related circuit components, and the transceiver module 2102 can be implemented by a transceiver or transceiver-related circuit components.
基于上述内容和相同构思，如图22所示，本申请还提供一种控制装置2200。该控制装置2200可包括处理器2201和接口电路2202。处理器2201和接口电路2202之间相互耦合。可以理解的是，接口电路2202可以为收发器或输入输出接口。可选地，控制装置2200还可包括存储器2203，用于存储处理器2201执行的指令或存储处理器2201运行指令所需要的输入数据或存储处理器2201运行指令后产生的数据。Based on the above content and the same concept, as shown in Figure 22, this application also provides a control device 2200. The control device 2200 may include a processor 2201 and an interface circuit 2202. The processor 2201 and the interface circuit 2202 are coupled to each other. It can be understood that the interface circuit 2202 may be a transceiver or an input-output interface. Optionally, the control device 2200 may also include a memory 2203 for storing instructions executed by the processor 2201 or input data required for the processor 2201 to run the instructions or data generated after the processor 2201 executes the instructions.
当控制装置2200用于实现图19所示的方法时，处理器2201用于执行上述处理模块2101的功能，接口电路2202用于执行上述收发模块2102的功能。When the control device 2200 is used to implement the method shown in Figure 19, the processor 2201 is used to perform the functions of the above-mentioned processing module 2101, and the interface circuit 2202 is used to perform the functions of the above-mentioned transceiver module 2102.
在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。计算机程序产品包括一个或多个计算机程序或指令。在计算机上加载和执行计算机程序或指令时，全部或部分地执行本申请实施例的流程或功能。计算机可以是通用计算机、专用计算机、计算机网络、控制装置、用户设备或者其它可编程装置。计算机程序或指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，计算机程序或指令可以从一个网站站点、计算机、服务器或数据中心通过有线或无线方式向另一个网站站点、计算机、服务器或数据中心进行传输。计算机可读存储介质可以是计算机能够存取的任何可用介质或者是集成一个或多个可用介质的服务器、数据中心等数据存储设备。可用介质可以是磁性介质，例如，软盘、硬盘、磁带；也可以是光介质，例如，数字视频光盘(digital video disc，DVD)；还可以是半导体介质，例如，固态硬盘(solid state drive，SSD)。In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer programs or instructions. When a computer program or instruction is loaded and executed on a computer, the processes or functions of the embodiments of the present application are executed in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, a control device, user equipment or other programmable device. A computer program or instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., a computer program or instructions may be transferred from a website, computer, server, or data center Transmission by wired or wireless means to another website site, computer, server or data center. Computer-readable storage media can be any available media that can be accessed by a computer, or data storage devices such as servers and data centers that integrate one or more available media. Available media can be magnetic media, such as floppy disks, hard disks, tapes; optical media, such as digital video discs (DVD); or semiconductor media, such as solid state drives (SSD) ).
在本申请的各个实施例中，如果没有特殊说明以及逻辑冲突，不同的实施例之间的术语和/或描述具有一致性、且可以相互引用，不同的实施例中的技术特征根据其内在的逻辑关系可以组合形成新的实施例。In the various embodiments of this application, if there is no special explanation or logical conflict, the terms and/or descriptions between different embodiments are consistent and can be referenced to each other. The technical features in different embodiments are based on their inherent Logical relationships can be combined to form new embodiments.
本申请中，“均匀”不是指绝对的均匀，可以允许有一定工程上的误差。“垂直”不是指绝对的垂直，可以允许有一定工程上的误差。“至少一个”是指一个或者多个，“多个”是指两个或两个以上。“和/或”，描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B的情况，其中A，B可以是单数或者复数。“以下至少一项(个)”或其类似表达，是指这些项中的任意组合，包括单项(个)或复数项(个)的任意组合。例如，a，b或c中的至少一项(个)，可以表示：a，b，c，“a和b”，“a和c”，“b和c”，或“a和b和c”，其中a，b，c可以是单个，也可以是多个。在本申请的文字描述中，字符“/”，一般表示前后关联对象是一种“或”的关系。在本申请的公式中，字符“/”，表示前后关联对象是一种“相除”的关系。另外，在本申请中，“示例性的”一词用于表示作例子、例证或说明。本申请中被描述为“示例”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。或者可理解为，使用示例的一词旨在以具体方式呈现概念，并不对本申请构成限定。In this application, "uniform" does not mean absolute uniformity, and certain engineering errors may be allowed. "Vertical" does not mean absolute verticality, and certain engineering errors are allowed. "At least one" means one or more, and "plurality" means two or more. "And/or" describes the association of associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone, where A, B can be singular or plural. “At least one of the following” or similar expressions thereof refers to any combination of these items, including any combination of a single item (items) or a plurality of items (items). For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c" ”, where a, b, c can be single or multiple. In the text description of this application, the character "/" generally indicates that the related objects are in an "or" relationship. In the formula of this application, the character "/" indicates that the related objects are in a "division" relationship. In addition, in this application, the word "exemplary" is used to mean an example, illustration, or illustration. Any embodiment or design described herein as "example" is not intended to be construed as preferred or advantageous over other embodiments or designs. Alternatively, it can be understood that the use of the word "example" is intended to present concepts in a specific manner and does not constitute a limitation on this application.
可以理解的是，在本申请中涉及的各种数字编号仅为描述方便进行的区分，并不用来限 制本申请的实施例的范围。上述各过程的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定。术语“第一”、“第二”等类似表述，是用于分区别类似的对象，而不必用于描述特定的顺序或先后次序。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元。方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It can be understood that the various numerical numbers involved in this application are only for convenience of description and are not used to limit limit the scope of the embodiments of this application. The size of the serial numbers of the above processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic. The terms "first", "second" and other similar expressions are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. Furthermore, the terms "including" and "having" and any variations thereof are intended to cover a non-exclusive inclusion, for example, the inclusion of a series of steps or units. Methods, systems, products or devices are not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such processes, methods, products or devices.
以上，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以权利要求的保护范围为准。 The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the present application, and all of them should be covered. within the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (25)

  1. 一种显示模组，其特征在于，包括光源组件、光学整形组件、光调制组件和反射组件，所述光学整形组件位于所述光源组件与所述光调制组件之间；A display module, characterized in that it includes a light source component, an optical shaping component, a light modulating component and a reflecting component, and the optical shaping component is located between the light source component and the light modulating component;
    所述光源组件，用于分时发射第一光束和第二光束，所述第一光束和所述第二光束的出射位置不同；The light source assembly is used to emit a first light beam and a second light beam in a time-sharing manner, and the first light beam and the second light beam have different exit positions;
    所述光学整形组件，用于调整所述第一光束的指向得到第三光束，以及调整所述第二光束的指向得到第四光束；The optical shaping component is used to adjust the pointing of the first beam to obtain a third beam, and to adjust the pointing of the second beam to obtain a fourth beam;
    所述光调制组件，用于对所述第三光束进行调制得到携带第一图像信息的第一图像光、以及对所述第四光束进行调制得到携带第二图像信息的第二图像光；The light modulation component is used to modulate the third light beam to obtain first image light carrying first image information, and to modulate the fourth light beam to obtain second image light carrying second image information;
    所述反射组件，用于将所述第一图像光反射至观察者的左眼，以及将所述第二图像光反射至所述观察者的右眼。The reflective component is used to reflect the first image light to the observer's left eye, and reflect the second image light to the observer's right eye.
  2. 如权利要求1所述的模组，其特征在于，所述光学整形组件包括透镜阵列，所述透镜阵列中的透镜呈平面分布。The module of claim 1, wherein the optical shaping component includes a lens array, and the lenses in the lens array are distributed in a plane.
  3. 如权利要求2所述的模组，其特征在于，所述透镜阵列包括非球面透镜阵列或菲涅尔透镜阵列。The module of claim 2, wherein the lens array includes an aspherical lens array or a Fresnel lens array.
  4. 如权利要求2或3所述的模组，其特征在于，所述透镜阵列中的透镜的节距p满足下述公式：
    The module according to claim 2 or 3, characterized in that the pitch p of the lenses in the lens array satisfies the following formula:
    其中，所述α为所述第一光束的发散角和所述第二光束的发散角中较大的发散角，所述t为所述光源组件的发光面与所述光学整形组件中靠近所述光调制组件的面之间的距离，所述h为所述第一光源或所述第二光源的横向发光宽度。Wherein, the α is the larger divergence angle between the divergence angle of the first beam and the divergence angle of the second beam, and t is the distance between the light-emitting surface of the light source component and the optical shaping component. The distance between the surfaces of the light modulation component, and h is the lateral luminous width of the first light source or the second light source.
  5. 如权利要求2～4任一项所述的模组，其特征在于，所述透镜阵列中的透镜的节距p满足下述公式：
    The module according to any one of claims 2 to 4, characterized in that the pitch p of the lenses in the lens array satisfies the following formula:
    其中，Weye为虚拟眼盒面上的虚拟眼间距，所述d为所述光学整形组件与虚拟眼盒面之间的距离，所述虚拟眼盒面为实际眼盒面经所述反射组件反射形成的虚像，所述t为所述光源组件的发光面与所述光学整形组件靠近所述光调制组件的面之间的距离。Wherein, W eye is the virtual eye box distance on the virtual eye box surface, the d is the distance between the optical shaping component and the virtual eye box surface, and the virtual eye box surface is the actual eye box surface through the reflection component The virtual image formed by reflection, where t is the distance between the light-emitting surface of the light source component and the surface of the optical shaping component close to the light modulation component.
  6. 如权利要求1所述的模组，其特征在于，所述光学整形组件包括非球面透镜。The module of claim 1, wherein the optical shaping component includes an aspherical lens.
  7. 如权利要求1～6任一项所述的模组，其特征在于，所述光源组件包括光源阵列，所述光源阵列中的光源呈平面分布，所述光源阵列包括第一光源和第二光源；The module according to any one of claims 1 to 6, wherein the light source component includes a light source array, the light sources in the light source array are distributed in a plane, and the light source array includes a first light source and a second light source. ;
    所述光源组件，用于根据接收到的第一控制信号，在第一时段所述第一光源发射所述第一光束、及在第二时段所述第二光源发射所述第二光束。The light source assembly is configured to, according to the received first control signal, the first light source emit the first light beam in a first period, and the second light source emit the second light beam in a second period.
  8. 如权利要求7所述的模组，其特征在于，所述第一控制信号包括所述第一光源的位置信息、及所述第二光源的位置信息。The module of claim 7, wherein the first control signal includes position information of the first light source and position information of the second light source.
  9. 如权利要求1～6任一项所述的模组，其特征在于，所述光源组件包括面光源和光阀；The module according to any one of claims 1 to 6, wherein the light source assembly includes a surface light source and a light valve;
    所述面光源，用于发射面光束；The surface light source is used to emit surface beams;
    所述光阀，用于根据接收到的第二控制信号，在第三时段打开第一位置的光阀，所述 面光束中的第一光束经所述第一位置射出，以及在第四时段打开第二位置的光阀，所述面光束中的第二光束经所述第二位置射出。The light valve is used to open the light valve at the first position in the third period according to the received second control signal, the The first beam of the surface beam is emitted through the first position, and the light valve of the second position is opened during a fourth period, and the second beam of the surface beam is emitted through the second position.
  10. 如权利要求9所述的模组，其特征在于，所述第二控制信号包括所述光阀的第一位置信息、及所述光阀的第二位置信息。The module of claim 9, wherein the second control signal includes first position information of the light valve and second position information of the light valve.
  11. 如权利要求9或10所述的模组，其特征在于，所述面光源为平面型面光源和/或光阀为平面型光阀。The module according to claim 9 or 10, wherein the surface light source is a planar surface light source and/or the light valve is a planar light valve.
  12. 如权利要求1～11任一项所述的模组，其特征在于，所述反射组件包括至少一个反射元件，所述反射元件包括以下任一项：The module according to any one of claims 1 to 11, wherein the reflective component includes at least one reflective element, and the reflective element includes any of the following:
    平面反射镜、球面反射镜、自由曲面镜、或半透半反镜。Plane reflector, spherical reflector, free-form mirror, or semi-transparent mirror.
  13. 一种光学显示系统，其特征在于，包括控制模组、及如权利要求1～6和12中任一项所述的显示模组；An optical display system, characterized by comprising a control module and a display module as claimed in any one of claims 1 to 6 and 12;
    所述控制模组，用于控制所述显示模组进行图像显示。The control module is used to control the display module to display images.
  14. 如权利要求13所述的系统，其特征在于，所述光源组件包括光源阵列，所述光源阵列中的光源呈平面分布，所述光源阵列包括第一光源和第二光源；The system of claim 13, wherein the light source assembly includes a light source array, the light sources in the light source array are distributed in a plane, and the light source array includes a first light source and a second light source;
    所述控制模组，用于：The control module is used for:
    获取所述观察者的左眼位置信息和右眼位置信息；Obtain the left eye position information and right eye position information of the observer;
    根据所述左眼位置信息确定所述第一光源的位置信息，以及根据所述右眼位置信息确定所述第二光源的位置信息；Determine the position information of the first light source based on the left eye position information, and determine the position information of the second light source based on the right eye position information;
    根据所述第一光源的位置信息和所述第二光源的位置信息生成第一控制信号；Generate a first control signal according to the position information of the first light source and the position information of the second light source;
    向所述光源组件发送所述第一控制信号；sending the first control signal to the light source assembly;
    所述光源组件，用于根据接收到的所述第一控制信号，在第一时段所述第一光源发射所述第一光束、及在第二时段所述第二光源发射所述第二光束。The light source component is configured to, according to the received first control signal, the first light source emit the first light beam in a first period, and the second light source emit the second light beam in a second period. .
  15. 如权利要求14所述的系统，其特征在于，所述第一控制信号包括所述第一光源的位置信息、及所述第二光源的位置信息。The system of claim 14, wherein the first control signal includes position information of the first light source and position information of the second light source.
  16. 如权利要求13所述的系统，其特征在于，所述光源组件包括面光源和光阀；The system of claim 13, wherein the light source assembly includes a surface light source and a light valve;
    所述控制模组，用于：The control module is used for:
    获取所述观察者的左眼位置信息和右眼位置信息；Obtain the left eye position information and right eye position information of the observer;
    根据所述左眼位置信息确定所述光阀的第一位置信息，以及根据所述右眼位置信息确定所述光阀的第二位置信息；Determine first position information of the light valve based on the left eye position information, and determine second position information of the light valve based on the right eye position information;
    根据所述光阀的第一位置信息和所述光阀的第二位置信息生成第二控制信号；Generate a second control signal based on the first position information of the light valve and the second position information of the light valve;
    向所述光源组件发送所述第二控制信号；sending the second control signal to the light source assembly;
    所述面光源，用于发射面光束；The surface light source is used to emit surface beams;
    所述光阀，用于根据接收到的所述第二控制信号，在第三时段打开第一位置的光阀，所述面光束中的第一光束经所述第一位置射出，以及在第四时段打开第二位置的光阀，所述面光束中的第二光束经所述第二位置射出。The light valve is used to open the light valve at the first position in a third period according to the received second control signal, the first light beam in the surface beam is emitted through the first position, and in the third period The light valve at the second position is opened for four periods, and the second beam of the surface beam is emitted through the second position.
  17. 如权利要求16所述的系统，其特征在于，所述第二控制信号包括所述光阀的第一位置信息、及所述光阀的第二位置信息。The system of claim 16, wherein the second control signal includes first position information of the light valve and second position information of the light valve.
  18. 如权利要求16或17所述的系统，其特征在于，所述面光源为平面型面光源和/或光阀为平面型光阀。 The system according to claim 16 or 17, wherein the surface light source is a planar surface light source and/or the light valve is a planar light valve.
  19. 如权利要求14～18任一项所述的系统，其特征在于，所述光学显示系统还包括所述眼跟踪模组，所述眼跟踪模组与所述控制模组连接；The system according to any one of claims 14 to 18, wherein the optical display system further includes the eye tracking module, and the eye tracking module is connected to the control module;
    所述控制模组，用于：The control module is used for:
    接收来自眼跟踪模组的所述左眼位置信息和所述右眼位置信息。Receive the left eye position information and the right eye position information from the eye tracking module.
  20. 一种终端设备，其特征在于，包括如权利要求13～19任一项所述的光学显示系统，所述光学显示系统安装于所述终端设备上。A terminal device, characterized in that it includes the optical display system according to any one of claims 13 to 19, and the optical display system is installed on the terminal device.
  21. 一种成像方法，其特征在于，应用于显示模组，所述显示模组包括光源组件、光学整形组件、光调制组件和反射组件，所述光学整形组件位于所述光源组件与所述光调制组件之间，所述方法包括：An imaging method, characterized in that it is applied to a display module. The display module includes a light source component, an optical shaping component, a light modulation component and a reflection component. The optical shaping component is located between the light source component and the light modulation component. Between components, the methods include:
    控制所述光源组件分时发射第一光束和第二光束，所述第一光束和所述第二光束的出射位置不同，所述第一光束经所述光学整形组件调整为第三光束，所述第二光束经所述光学整形组件调整为第四光束；The light source component is controlled to emit a first beam and a second beam in a time-divided manner. The first beam and the second beam have different exit positions. The first beam is adjusted into a third beam by the optical shaping component, so The second beam is adjusted into a fourth beam by the optical shaping component;
    控制所述光调制组件对所述第三光束调制得到携带第一图像信息的第一图像光、以及对所述第四光束调制得到携带第二图像信息的第二图像光；所述第一图像光经所述反射组件反射至观察者的左眼成像，所述第二图像光经所述反射组件反射至所述观察者的右眼成像。Control the light modulation component to modulate the third light beam to obtain a first image light carrying first image information, and modulate the fourth light beam to obtain a second image light carrying second image information; the first image The light is reflected by the reflective component to the observer's left eye for imaging, and the second image light is reflected by the reflective component to the observer's right eye for imaging.
  22. 如权利要求21所述的方法，其特征在于，所述控制所述光源组件分时发射第一光束和第二光束，包括：The method of claim 21, wherein controlling the light source component to emit the first light beam and the second light beam in a time-divided manner includes:
    获取所述观察者的左眼位置信息和右眼位置信息；Obtain the left eye position information and right eye position information of the observer;
    根据所述左眼位置信息和所述右眼位置信息，生成控制信号，所述控制信号用于控制所述光源组件分时发射所述第一光束及所述第二光束；Generate a control signal based on the left eye position information and the right eye position information, the control signal being used to control the light source component to emit the first beam and the second beam in a time-sharing manner;
    向所述光源组件发送所述控制信号。Send the control signal to the light source assembly.
  23. 如权利要求22所述的方法，其特征在于，所述获取观察者的左眼位置信息和右眼位置信息，包括：The method of claim 22, wherein obtaining the observer's left eye position information and right eye position information includes:
    接收来自眼跟踪模组的所述左眼位置信息和所述右眼位置信息。Receive the left eye position information and the right eye position information from the eye tracking module.
  24. 如权利要求22或23所述的方法，其特征在于，所述控制信号包括第一控制信号，所述光源组件包括光源阵列，所述光源阵列中的光源呈平面分布，所述光源阵列包括第一光源和第二光源；The method of claim 22 or 23, wherein the control signal includes a first control signal, the light source assembly includes a light source array, the light sources in the light source array are distributed in a plane, and the light source array includes a first a light source and a second light source;
    所述根据所述左眼位置信息和所述右眼位置信息生成控制信号，包括：Generating a control signal based on the left eye position information and the right eye position information includes:
    根据所述左眼位置信息确定所述第一光源的位置信息，以及根据所述右眼位置信息确定所述第二光源的位置信息；Determine the position information of the first light source based on the left eye position information, and determine the position information of the second light source based on the right eye position information;
    根据所述第一光源的位置信息和所述第二光源的位置信息生成所述第一控制信号，所述第一控制信号用于控制所述光源组件在第一时段所述第一光源发射所述第一光束、及在第二时段所述第二光源发射所述第二光束。The first control signal is generated according to the position information of the first light source and the position information of the second light source. The first control signal is used to control the light source assembly to emit the light emitted by the first light source in a first period. The first light beam, and the second light source emit the second light beam during a second period.
  25. 如权利要求22或23所述的方法，其特征在于，所述控制信号包括第二控制信号，所述光源组件包括面光源和光阀；The method of claim 22 or 23, wherein the control signal includes a second control signal, and the light source assembly includes a surface light source and a light valve;
    所述根据所述左眼位置信息和所述右眼位置信息生成控制信号，包括：Generating a control signal based on the left eye position information and the right eye position information includes:
    根据所述左眼位置信息确定所述光阀的第一位置信息，以及根据所述右眼位置信息确定所述光阀的第二位置信息； Determine first position information of the light valve based on the left eye position information, and determine second position information of the light valve based on the right eye position information;
    根据所述光阀的第一位置信息和所述光阀的第二位置信息生成所述第二控制信号，所述第二控制信号用于控制所述光阀在第三时段打开第一位置的光阀、所述面光源发射的面光束中的第一光束经所述第一位置射出，以及在第四时段打开第二位置的光阀、所述面光源发射的面光束中的第二光束经所述第二位置射出。 The second control signal is generated according to the first position information of the light valve and the second position information of the light valve. The second control signal is used to control the light valve to open the first position in a third period. The light valve, the first beam of the surface beam emitted by the surface light source is emitted through the first position, and the light valve of the second position is opened in the fourth period, and the second beam of the surface beam emitted by the surface light source Ejected through the second location.
PCT/CN2023/093125 2022-08-26 2023-05-10 Display module, optical display system, terminal device, and imaging method WO2024041034A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211033849.XA CN117664924A (en) 2022-08-26 2022-08-26 Display module, optical display system, terminal equipment and imaging method
CN202211033849.X 2022-08-26

Publications (1)

Publication Number Publication Date
WO2024041034A1 true WO2024041034A1 (en) 2024-02-29

Family

ID=90012355

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/093125 WO2024041034A1 (en) 2022-08-26 2023-05-10 Display module, optical display system, terminal device, and imaging method

Country Status (2)

Country Link
CN (1) CN117664924A (en)
WO (1) WO2024041034A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050018288A1 (en) * 2001-12-14 2005-01-27 Peter-Andre Redert Stereoscopic display apparatus and system
CN104950459A (en) * 2015-05-27 2015-09-30 广东顺德中山大学卡内基梅隆大学国际联合研究院 View angle enhancement type directional backlight automatic stereoscopic display device
CN110187506A (en) * 2019-05-28 2019-08-30 京东方科技集团股份有限公司 Optical presentation system and augmented reality equipment
US20210392305A1 (en) * 2020-06-16 2021-12-16 Lightspace Technologies, SIA Display Systems, Projection Units and Methods for Presenting Three-Dimensional Images
CN216351537U (en) * 2021-07-12 2022-04-19 极瞳科技(北京)有限公司 Holographic near-to-eye three-dimensional display system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050018288A1 (en) * 2001-12-14 2005-01-27 Peter-Andre Redert Stereoscopic display apparatus and system
CN104950459A (en) * 2015-05-27 2015-09-30 广东顺德中山大学卡内基梅隆大学国际联合研究院 View angle enhancement type directional backlight automatic stereoscopic display device
CN110187506A (en) * 2019-05-28 2019-08-30 京东方科技集团股份有限公司 Optical presentation system and augmented reality equipment
US20210392305A1 (en) * 2020-06-16 2021-12-16 Lightspace Technologies, SIA Display Systems, Projection Units and Methods for Presenting Three-Dimensional Images
CN216351537U (en) * 2021-07-12 2022-04-19 极瞳科技(北京)有限公司 Holographic near-to-eye three-dimensional display system

Also Published As

Publication number Publication date
CN117664924A (en) 2024-03-08

Similar Documents

Publication Publication Date Title
US11838689B2 (en) Rotating LIDAR with co-aligned imager
US11270114B2 (en) AR device and method for controlling the same
US20220365345A1 (en) Head-up display and picture display system
JP2023175794A (en) Head-up display
US20200257124A1 (en) Electronic device
WO2021015171A1 (en) Head-up display
WO2024021852A1 (en) Stereoscopic display apparatus, stereoscopic display system, and vehicle
US11388390B2 (en) Wearable electronic device on head
WO2024041034A1 (en) Display module, optical display system, terminal device, and imaging method
WO2024021574A1 (en) 3d projection system, projection system, and vehicle
WO2024065332A1 (en) Display module, optical display system, terminal device and image display method
EP3961291B1 (en) Vehicular head-up display and light source unit used therefor
WO2023193210A1 (en) Optical emission module, optical display device, terminal device, and image display method
US20240036311A1 (en) Head-up display
US20240069335A1 (en) Head-up display
US11442279B2 (en) Wearable glasses-type device and method for providing virtual images of the glasses-type device
US20230152586A1 (en) Image generation device and head-up display
WO2024032057A1 (en) Three-dimensional display apparatus, three-dimensional display device and three-dimensional display method
WO2023130759A1 (en) Display device and vehicle
WO2024098828A1 (en) Projection system, projection method, and transportation means
US11977243B1 (en) Collaborative navigation system with campfire display
WO2023190338A1 (en) Image irradiation device
WO2023216670A1 (en) Three-dimensional display apparatus and vehicle
WO2023019442A1 (en) Detection system, terminal device and detection control method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23856128

Country of ref document: EP

Kind code of ref document: A1