WO2022017272A1 - 光源装置、成像装置及显示装置 - Google Patents

光源装置、成像装置及显示装置 Download PDF

Info

Publication number
WO2022017272A1
WO2022017272A1 PCT/CN2021/106722 CN2021106722W WO2022017272A1 WO 2022017272 A1 WO2022017272 A1 WO 2022017272A1 CN 2021106722 W CN2021106722 W CN 2021106722W WO 2022017272 A1 WO2022017272 A1 WO 2022017272A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
light source
subframe
spot
module
Prior art date
Application number
PCT/CN2021/106722
Other languages
English (en)
French (fr)
Inventor
胡飞
陈晨
陈彦哲
李屹
Original Assignee
深圳光峰科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳光峰科技股份有限公司 filed Critical 深圳光峰科技股份有限公司
Publication of WO2022017272A1 publication Critical patent/WO2022017272A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/20Lamp housings
    • G03B21/2006Lamp housings characterised by the light source
    • G03B21/2013Plural light sources
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10Beam splitting or combining systems
    • G02B27/1006Beam splitting or combining systems for splitting or combining different wavelengths
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/20Lamp housings
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/20Lamp housings
    • G03B21/2006Lamp housings characterised by the light source
    • G03B21/2033LED or laser light sources
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/20Lamp housings
    • G03B21/2046Positional adjustment of light sources
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/20Lamp housings
    • G03B21/206Control of light source other than position or intensity

Definitions

  • the present application relates to the technical field of optical information processing, and in particular, to a light source device, an imaging device and a display device.
  • Imaging technology In technologies such as 3D imaging of objects, projection display, etc., it is usually necessary to use an imaging system including a light source, spatial light modulator, projection lens, etc. to form image light according to the source image to reproduce the source image, which is referred to as imaging technology herein.
  • imaging technical solutions include spatial light modulator-based imaging solutions, beam scanning-based imaging solutions, and the like.
  • Imaging solutions based on spatial light modulators generally include solutions based on DMD (Digital Micromirror device, digital micromirror device), solutions based on LCD (Liquid Crystal Display, liquid crystal display), and solutions based on LCOS (Liquid Crystal on Silicon, silicon base liquid crystal).
  • DMD Digital Micromirror device, digital micromirror device
  • LCD Liquid Crystal Display, liquid crystal display
  • LCOS Liquid Crystal on Silicon, silicon base liquid crystal
  • DMD-based solution Digital Light Processing (DLP, Digital Light Processing) display technology images are generated by DMD.
  • DMD is a spatial light modulator, which is a matrix composed of micro-mirrors (precise, miniature mirrors) arranged on a semiconductor chip, wherein each micro-mirror controls a pixel in the projection screen, and the number of micro-mirrors Matches the resolution of the projected screen.
  • the light source is projected on the DMD, and the micro-lens can be quickly flipped under the drive of the digital signal, there are on (on) and off (off) states, the lens only receives the light in the on state, and different grayscales are obtained by controlling the switch state. , and then obtain a color image.
  • LCD-based solution LCD liquid crystal display places a liquid crystal cell in two parallel glass substrates, a TFT (thin film transistor) is arranged on the glass of the lower substrate, and a color filter is arranged on the glass of the upper substrate, and the signal and voltage on the TFT are changed. Control the rotation direction of the liquid crystal molecules, so as to achieve the control of the polarized light output state of each pixel point to obtain gray scale and realize color imaging.
  • the principle is to use the birefringence of liquid crystal molecules, through a certain arrangement of liquid crystal molecules (commonly nematic), under the action of different current and electric fields, the liquid crystal molecules will regularly rotate 90 degrees, and the incident polarized light will be affected. The difference in transmittance is generated, and the conversion between on and off states is realized to achieve the purpose of imaging.
  • LCOS belongs to a new type of reflective Micro LCD (micro LCD) projection technology. Its structure is to use a semiconductor process to make a drive panel (also known as CMOS-LCD) on a silicon wafer, and then plated on the transistor. Aluminum is used as a mirror to form a CMOS substrate, and then the CMOS substrate is bonded to an upper glass substrate containing a transparent electrode, and then liquid crystal is injected.
  • the basic principle is similar to that of LCD, both of which are based on the birefringence principle of liquid crystal molecules. When the voltage of the aluminum electrode on the silicon substrate changes, the voltage of the liquid crystal changes, the liquid crystal molecules are deflected, and the on and off states of the incident polarized light are modulated to generate an image.
  • Imaging solutions based on spatial light modulators all use the spatial light modulator to modulate the light intensity of image light, thereby realizing the display of different gray levels and colors.
  • the energy utilization efficiency of the spatial light modulator is very low. For example, the off light of the DMD cannot be used.
  • the LCD or LCOS modulates the polarization state distribution of the transmitted light through the deflection of the liquid crystal molecules, and the excess light is absorbed by the polarizer.
  • These spatial light modulators all have large energy loss, so they also need to be equipped with a strong heat dissipation system.
  • the light source device, imaging device or display device based on the spatial light modulator has a large overall volume and low energy efficiency.
  • the spatial light modulator device due to the limitation of heat dissipation of the spatial light modulator device itself, it cannot carry a high energy density, so it is difficult to obtain a very high brightness display. Due to the limitation of the spatial light modulator itself, such as the leakage of the off light of the DMD, the conversion of the polarization state of the light beam by the liquid crystal molecules, and the polarizer have a certain conversion efficiency, it is difficult to obtain high dynamic contrast for the obtained image.
  • the imaging scheme based on beam scanning generally uses a laser as the light source, modulates the light source through a light modulator, and realizes display imaging through a two-dimensional scanner, an optical color combination system and a projection objective lens.
  • the source image signal is loaded on the light modulator to control the intensity of the light beam; at the same time, the line and field signals are synchronized to the light deflector, so that the light beam is projected onto the screen or other targets with a modulated intensity according to a certain rule to form a color image.
  • Existing beam scanning imaging schemes mainly use laser as the main light source, and use a light modulator to modulate the light intensity of the beam.
  • Common light modulators include electro-optic modulation and acousto-optic modulation.
  • the three-color laser passes through the modulator loaded with the video signal and becomes a laser beam with different light intensities with the video signal, and then passes through the color combination system of the optical film to synthesize a beam. Then enter the X-Y scanning system.
  • the scanning system is generally realized by a combination of a rotating mirror and a small-angle galvanometer, or a double rotating mirror system and a double galvanometer.
  • the beam scanning imaging scheme uses a light modulator, and the power consumption and volume of the system are relatively large; due to the small number of laser light sources used, the control bandwidth of the modulator and scanning equipment is required to be large, the resolution of the image is low, and the obtained field of view The angle is small, and there is a strong speckle effect.
  • Embodiments of the present application provide a light source device, the light source device includes a light source array module, a control module and a light spot shift device, wherein:
  • the light source array module includes a plurality of light sources arranged in an array, wherein the light beam emitted by each light source in the plurality of light sources forms a light spot corresponding to one pixel of a frame of target image, and the target image includes a plurality of pixels and consists of a plurality of light sources. consists of subframes, wherein the pixels included in each subframe in the multiple subframes are part of the multiple pixels, and the pixels included in the multiple subframes together form multiple pixels;
  • the light spot shifting device is used to move the positions of the light spots of the plurality of light sources under the control of the control module;
  • the control module is configured to control the light spot shifting device according to the time sequence so that the positions of the light spots of the plurality of light sources correspond to each subframe in turn, wherein the control module is configured to: control the light spot shifting device according to the pixel position of each subframe, to Make the positions of the light spots of the multiple light sources correspond one-to-one with the positions of the pixels included in the subframe at the moment corresponding to the subframe, wherein other subframes are interposed between at least two adjacent pixels of each subframe at least one pixel of the frame.
  • Embodiments of the present application further provide an imaging device, including the above-mentioned light source device.
  • Embodiments of the present application also provide a display device including the above-mentioned light source device.
  • Embodiments of the present application also provide an imaging method, comprising:
  • each subframe move the position of the light spot emitted by the light source array module according to the time sequence through the light spot shifting device, so that the position of the light spot corresponds to each subframe in turn;
  • the light source array module includes a plurality of light sources, and the light beam emitted by each light source in the plurality of light sources forms a light spot corresponding to one pixel of the target image, and the plurality of light spots formed by the plurality of light sources at the moment corresponding to the sub-frame The positions correspond one-to-one with the positions of multiple pixels included in the subframe.
  • a light spot corresponding to each subframe is sequentially formed according to the time sequence, wherein when switching from one subframe to the next subframe, the light spot is shifted by
  • the device moves the position of the light spot to correspond to the pixel position of the corresponding sub-frame, so that in the time of displaying one frame of image, the light spot corresponding to each light source is moved to correspond to a plurality of image pixels. Since the overall resolution is achieved by a light source array including a plurality of light sources, each light source can be modulated separately to contribute to the overall resolution.
  • the embodiment of the present application reduces the The modulation bandwidth of the light source device.
  • the embodiment of the present application can effectively reduce the control bandwidth of the light spot shifting device.
  • the embodiments of the present application can effectively improve the uniformity of the image.
  • the embodiment of the present application uses a light source array as the light source, and when the light source is a laser, the moving light spot scheme can also effectively reduce the speckle of the formed image.
  • the two-dimensional grayscale distribution of each sub-frame is achieved by adjusting the brightness of each light source in the corresponding time period, avoiding the use of the current low-efficiency spatial light modulator. Therefore, , the efficiency of the light source device, the imaging device, the display device or the imaging method can be greatly improved. In addition, since the brightness of a single pixel can be fully on/off by adjusting the brightness of the light source, these embodiments can achieve high contrast ratio and high dynamic range.
  • each light source of the light source array module is independently addressable, that is, independently controllable, therefore, variable light encoding can be implemented, thereby improving imaging accuracy.
  • the gray scale of a single pixel can be realized by modulating the light intensity of the corresponding single light source, and the adjustment method is simple and easy. Adjustment can achieve full on/off, so these embodiments can achieve high contrast and high dynamic range. The lattice or structured light generated by this solution can be quickly transformed to generate customized patterns at extremely high speed.
  • FIG. 1 is a schematic structural diagram of a light source device according to an embodiment of the present application.
  • FIG. 2 is a schematic diagram of how to decompose a frame of target image into multiple subframes according to an embodiment of the present application
  • FIG. 3 is a schematic diagram of an array light source of a light source array module according to an embodiment of the present application and a close-packed pixel array formed by using the array light source;
  • FIG. 4 is a schematic structural diagram of a light source device according to another embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of a light source device according to another embodiment of the present application.
  • FIG. 6 is a schematic flowchart of an imaging method according to an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a 3D imaging scheme based on a light source array according to an embodiment
  • FIG. 8 is a schematic diagram of a MEMS-based VCSEL light source array system according to an embodiment
  • FIG. 9 is a schematic structural block diagram of an imaging device according to an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of an imaging device according to another embodiment of the present application.
  • FIG. 11 is a schematic diagram of a pulse signal and a displacement curve in the embodiment shown in FIG. 10;
  • FIG. 12 is a schematic structural diagram of an imaging device according to another embodiment of the present application.
  • FIG. 13 is a schematic structural diagram of a display device according to an embodiment of the present application.
  • FIG. 14 is a schematic structural diagram of a display device according to another embodiment of the present application.
  • FIG. 15 is a schematic structural diagram of a display device according to another embodiment of the present application.
  • FIG. 16 is a schematic diagram of a Micro LED combined light source according to an embodiment of the present application.
  • FIG. 17 is a schematic diagram of frame breaking for an example image corresponding to the frame breaking method shown in FIG. 2 .
  • imaging technique refers to the process, method or technique of using a light source and optical/electrical devices to form image light corresponding to the source image to reproduce the source image .
  • image includes images and/or video in any form or format.
  • FIG. 1 shows a schematic structural diagram of a light source device 100 according to an embodiment of the present application.
  • the light source device 100 includes a light source array module 110 , a control module 120 and a light spot shifting device 130 .
  • the light source array module 110 includes a plurality of light sources 111 arranged in an array.
  • the light beam emitted by each light source 111 forms a light spot 112 corresponding to one pixel of one frame of target image (see FIG. 3 ). That is, one pixel in the target image corresponds to one spot of the light source beam.
  • the number of light sources is large enough, for example, the number of light sources is equal to or greater than the number of pixels of the target image, there is no need to decompose the target image into multiple sub-frames, and the target image can be displayed completely at one time by forming light spots equal to the number of pixels of the target image.
  • the target image needs to be decomposed into multiple subframes, and the multiple subframes need to be displayed in sequence in a very short period of time.
  • the number of pixels included in the subframes displayed each time is equal to or smaller than the number of light sources, that is, the resolution of the subframes is equal to or smaller than the light source resolution of the light source array module 110 .
  • Each of the multiple subframes forming a frame of the target image includes a part of the pixels included in the target image, and the set of pixels included in all the subframes is equal to all the pixels included in the target image. Since the time for displaying multiple subframes is short enough, the human eye cannot perceive the switching between different subframes due to the phenomenon of persistence of vision, and the human eye will automatically splicing multiple subframes into a complete image in one frame.
  • the number of pixels included in the target image is greater than the number of light sources included in the light source array module 110 .
  • the target image in this embodiment of the present application includes a plurality of pixels and is composed of a plurality of subframes, wherein the pixels included in each subframe in the plurality of subframes are part of the plurality of pixels included in the target image, and the pixels included in the plurality of subframes The pixels together make up the pixels contained in the target image.
  • these subframes are sparsely sampled, at least one pixel of other subframes is inserted between at least two adjacent pixels of each subframe, and the number of pixels included in each subframe is equal to or less than The number of light sources included in the light source array module and the pixel positions of each subframe are different. In one example, one or more pixels of one or more other subframes are interposed between every two adjacent pixels included in each subframe.
  • the light spot shifting device 130 is used to move the position of the light spot 112 emitted by the light source 111 of the light source array module 110 under the control of the control module 120 .
  • the control module 120 is configured to control the light spot shifting device 130 according to the time sequence, so that the position of the overall light spot emitted by the light source array module 110 sequentially corresponds to each subframe.
  • control module 120 may be configured to: control the light spot shifting device 130 according to the pixel position of each subframe, so that at the moment corresponding to the subframe The positions of the plurality of light spots 112 of the light source array module 110 correspond one-to-one with the positions of the plurality of pixels included in the subframe.
  • the time T for displaying the target image of the frame is divided into four equal subframe periods T1-T4, wherein the subframe S1 is displayed at time t1, and the subframe is displayed at time t2.
  • subframe S3 is displayed at time t3
  • subframe S4 is displayed at time t4.
  • the subframes S1-S4 are sparsely sampled, the number of pixels included in each subframe is equal to the number of light sources 111 included in the light source array module 110, and each subframe S1-S4 has different pixel positions .
  • the control module 120 controls the light spot shifting device 130 to shift the position of the light spot 112 emitted by the light source array module 110 to the position corresponding to the pixel of the subframe S1, that is, the light spot 112
  • the pixel positions of the formed image light coincide with the positions of the pixels included in the subframe S1.
  • the position of each light spot 112 corresponds to its corresponding position in the subframe S1 pixel location.
  • the light spot shifting device 130 controls the control module 120 to control the light spot shifting device 130 to shift the light spot 112 emitted by the light source array module 110 to the position corresponding to the pixel of the subframe S2.
  • the spot shifting device 130 moves the spot 112 by a distance corresponding to the pixel pitch of the two subframes. For example, assuming that each pixel of the subframe S2 is shifted to the right by one pixel relative to each pixel of the subframe S1, the control module 120 controls the light spot shifting device 130 to shift the entire light spot 112 emitted by the light source array module 110 to the right with The distance corresponding to one pixel of the image light.
  • the light spot shifting device 130 continues to move the light spot 112 to correspond to the positions of the subframes S3 and S4, respectively. Therefore, within the time T, the light source device 100 sequentially emits light spots corresponding to the subframes S1-S4 in sequence. Due to the persistence of vision of the human eye, these four subframes constitute a complete target image to the human eye. reappearance.
  • each pixel in S2 is the same distance from the corresponding pixel in S1 is a pixel, so that when moving the spot, you can move all the spots as a whole. It can be understood that the distance between the corresponding pixels of two adjacent subframes can also be different.
  • the distance to be moved can be determined for each light spot, and the light spot can be controlled.
  • the shifting device 130 respectively shifts each light spot or each part of the light spot with the same moving distance.
  • the interval between every two adjacent light sources 111 of the light source array module 110 is equal, so the interval between adjacent light spots emitted by them is also equal. It can be understood that the intervals between adjacent light sources may be different, and the distances between adjacent light spots may also be different.
  • FIG. 2 shows a schematic diagram of how to decompose a frame of target image into multiple subframes according to an embodiment of the present application.
  • how to decompose the target image into multiple subframes may be determined according to factors such as the number of pixels of the target image, the number of light sources included in the light source array module, and the interval between the light sources.
  • factors such as the number of pixels of the target image, the number of light sources included in the light source array module, and the interval between the light sources.
  • the light source array module 110 is a 3 ⁇ 3 light source array, and the number of pixels included in the target image is 6 ⁇ 6, so the target image S can be decomposed into 2 ⁇ 2 subframes S1 - S4 .
  • the density of the array formed by the plurality of light sources 111 of the light source array module 110 is smaller than the density of the pixel distribution of the target image, and the array formed by the plurality of light sources 111 is sparse relative to the pixel distribution of the target image
  • the dot matrix that is, after the multiple light spots emitted by the light source 111 are imaged, correspond not to multiple adjacent pixels of the image, but to non-adjacent pixels separated by one or more other pixels.
  • each square represents a pixel
  • the number in the square represents the subframe number to which the pixel belongs.
  • the number "1" represents the subframe S1
  • the number "2" represents the subframe S2
  • the number "3" represents subframe S3
  • the number “4” represents subframe S4.
  • the target image S is decomposed into four subframes S1-S4 displayed in time sequence, wherein each subframe is separated from the next subframe by a distance of one pixel.
  • the control module 120 controls the light spot shifting device 130 to shift the entire light spot 112 emitted by the light source array module 110 to the right by a distance corresponding to one pixel of the image light to form a subframe S2;
  • the control module 120 controls the light spot shifting device 130 to translate the light spot 112 emitted by the light source array module 110 downward as a whole by a distance corresponding to one pixel of the image light and continue to translate to the right corresponding to one pixel of the image light.
  • the control module 120 controls the light spot shifting device 130 to shift the entire light spot 112 emitted by the light source array module 110 to the right by a distance corresponding to one pixel of the image light to form a sub-frame S3.
  • Frame S4 In the example of Fig. 2, the four subframes are displayed in the order of S1 ⁇ S2 ⁇ S3 ⁇ S4. It can be understood that the four subframes can also be displayed in other order, and finally the complete reproduction of the target image is obtained. .
  • the pixels of subframes S1-S4 are arranged together as close-packed pixels.
  • the sparse array light source can be effectively projected into a high-resolution implementation, and the M*N array of sparse light source arrays can be scanned into aM*bN closely-spaced equally spaced light spots, as shown in FIG. 3 .
  • the control module 120 when the control module 120 controls the light spot shifting device 130 to shift the light spot 112 emitted by the light source array module 110 to correspond to the position of each subframe, the control module 120 also controls the light source according to the grayscale distribution of each subframe
  • the brightness of each light source 111 of the array module 110 is such that each light spot of the light source 111 forms a grayscale display of the corresponding pixel of the subframe at the moment corresponding to the subframe.
  • the control module 120 may adjust the brightness of the light source 111 by adjusting or modulating the driving current or driving voltage of the light source 111 .
  • each pixel of the image light is in one-to-one correspondence with each light spot 112 emitted by the light source array module 110 , and each light spot 112 is only emitted by one light source. Therefore, each pixel of the image light is only associated with the corresponding light source.
  • One light source is related, not related to other light sources.
  • each light source 111 can be independently controlled or driven, the gray scale of each pixel of the formed image light is only related to the corresponding unique light source, and the control module 120 can independently control the light source array module 110 The brightness of each light source 111 controls the pixel gray scale of the formed image.
  • the target image in the source image signal is decomposed into a plurality of subframes that are sparsely sampled (that is, at least one pixel of other subframes is interposed between at least two adjacent pixels of each subframe) ), the pixels of each subframe are in one-to-one correspondence with the light sources of the light source array module, and the light spots corresponding to each subframe are formed in sequence according to the time sequence.
  • the positions of the light spots are moved to correspond to the pixel positions of the corresponding subframes.
  • the light spot corresponding to each light source is moved to correspond to a plurality of image pixel points.
  • each light source can be modulated separately to contribute to the overall resolution. Therefore, compared with the contribution of a single light source to the overall resolution, the embodiment of the present application reduces the The modulation bandwidth of the light source device.
  • the embodiment of the present application can effectively reduce the control bandwidth of the light spot shifting device.
  • the embodiments of the present application can effectively improve the uniformity of the image.
  • the embodiment of the present application uses a light source array as the light source, and when the light source is a laser, the moving light spot scheme can also effectively reduce the speckle of the formed image.
  • the two-dimensional grayscale distribution of each subframe is achieved by adjusting the brightness of each light source in the corresponding time period, avoiding the use of spatial light modulators that are currently inefficient. , therefore, the efficiency of the light source device can be greatly improved.
  • these embodiments can achieve high contrast ratio and high dynamic range.
  • each light source of the light source array module is independently addressable, that is, independently controllable, therefore, variable light encoding can be implemented, thereby improving imaging accuracy.
  • the gray scale of a single pixel can be realized by modulating the light intensity of the corresponding single light source, and the adjustment method is simple and easy. Adjustment can achieve full on/off, so these embodiments can achieve high contrast and high dynamic range. The lattice or structured light generated by this solution can be quickly transformed to generate customized patterns at extremely high speed.
  • FIG. 4 shows a schematic structural diagram of a light source device 100 according to another embodiment of the present application.
  • the control module 120 may include the following three parts: a processor 121 , a light source driver 122 and a spot shift control unit 123 , wherein:
  • the processor 121 is configured to perform image processing on the received source image signal to obtain a target image including a plurality of subframes.
  • the image processing performed by the processor 121 may include performing one or more of format conversion, decoding, filtering, amplification, etc. on the received source image signal, and may also include acquiring the target image from the source image signal and obtaining the target image from the source image signal.
  • the number of pixels and the configuration parameters of the light source device 100 decompose the target image into a plurality of subframes that match the light source device 100 .
  • the configuration parameters of the light source device 100 may include the number and interval of the light sources of the light source array module 110 , and the like.
  • the processor 121 sends the decomposed subframe signal and the timing corresponding to each subframe to the light source driver 122 and the spot shift control unit 123 .
  • the light source driver 122 is configured to generate a signal for driving the light source array module 110 to emit light according to signals of a plurality of subframes.
  • the light source driver 122 generates a corresponding driving signal for the light source 111 corresponding to the pixel according to the gray level of each pixel in each subframe, and the driving signal makes the brightness of the light emitted by the light source 111 equal to that of the pixel. Grayscale matches.
  • the light source driver 122 can drive the light source 111 to generate a light spot with corresponding brightness for the subframe at the moment of each subframe.
  • some light sources may not emit light, that is, the light source driver 122 does not generate driving signals for them.
  • the light spot shift control unit 123 is configured to generate a signal for controlling the light spot shift device 130 to move the light spot 112 according to the signals of the plurality of subframes.
  • the light spot shift control unit 123 controls the light spot shift device 130 to move the light spots formed by the light source array module 110 to correspond one-to-one with each pixel position of the subframe at the moment of each subframe.
  • the spot shift device 130 moves the positions of the light spots formed by the light source array module 110 according to the instructions from the control module 120 or the light spot shift control unit 123 , so that at the moment of each subframe, the light spots formed by the light source array module 110 are moved.
  • the position of is in a one-to-one correspondence with the position of each pixel in the subframe.
  • the "time of each subframe” above and below in this application refers to the time when each subframe is reproduced according to the time sequence, that is, the time when the light spot corresponding to the subframe is formed, and at this time, the corresponding light spot is moved to the position corresponding to the subframe, and the brightness of each light spot is consistent with the grayscale of each pixel in the subframe.
  • the light spot shifting device 130 can change the position of the light spot 112 by moving the position of the light source 111 of the light source array module 110 .
  • the light spot shifting device 130 is a two-dimensional micro-actuator that can move in a first direction and a second direction that are perpendicular to each other.
  • the light spot shifting device 130 is a combination of two one-dimensional micro-actuators, the first one-dimensional micro-actuator can move in the first direction, and the second one-dimensional micro-actuator can move in the second direction.
  • the light source 111 of the light source array module 110 can be attached to the above-mentioned micro-actuator, and the micro-actuator moves under the instruction of the control module 120 or the spot shift control unit 123, thereby driving the light source 111 to move, thereby changing the position of the light source 111.
  • the light source 111 of the light source array module 110 can be fixed on a two-dimensional micro-actuator or two one-dimensional micro-actuators as a whole, and the movement of the micro-actuators can drive the movement of the light source array module 110 as a whole.
  • the light source array module 110 can be divided into a plurality of parts, each part includes one or more light sources 111, and each part is respectively fixed to one two-dimensional micro-actuator or two one-dimensional micro-actuators.
  • the two-dimensional micro-actuator can be a two-dimensional deflection stage, and the one-dimensional micro-actuator can be a high-frequency piezoelectric ceramic actuator, a piezoelectric moving platform, a piezoelectric stepping motor, or a one-dimensional deflection stage.
  • the micro-actuator can be linear motion, deflection or other motion forms.
  • the speed of movement of the two-dimensional microactuator in the two directions can be the same or different, eg, the movement in the first direction is faster than the movement in the second direction.
  • the speed of movement of the two one-dimensional micro-actuators may be the same or different, eg, a one-dimensional micro-actuator moving in a first direction is faster than a one-dimensional micro-actuator moving in a second direction.
  • the light spot shifting device 130 can change the position of the light spot 112 by deflecting the propagation direction of the light beam emitted by the light source array module 110 .
  • the beam deflection device is a MEMS scanning mirror or a phase deflection device.
  • the control module 120 may further include a synchronization unit 124 .
  • the synchronization unit 124 is configured to control the light source driver 122 to synchronize with the light spot shifting device 130 according to the plurality of subframes, so that the light spot shifting device 130 moves the light spots 112 of the plurality of light sources 111 to be in phase with each of the plurality of subframes.
  • the light source driver 122 drives the light source array module 110 to emit light corresponding to the grayscale distribution of the subframe.
  • the synchronization unit 124 is connected to the processor 121 , the light source driver 122 and the spot shift control unit 123 .
  • the control module 120 may send each subframe and the corresponding timing to the synchronization unit 124 .
  • the synchronization unit 124 can ensure that the light spot shift control unit 123 drives the light spot shift device 130 and the light source driver 122 drives the light source 111 to emit light synchronously according to the timing of each subframe, so that the light spot shift device 130 drives the light spot shift
  • each light source 111 emits light under the driving of the light source driver 122, and the brightness of the emitted light spot 112 is consistent with the grayscale of each pixel in the subframe.
  • the synchronization unit 124 can ensure that the light source 111 neither emits light in advance nor delays light emission, but emits light with corresponding brightness when the light spot is shifted to the target position.
  • the light source 111 is a laser light source
  • the light source driver 122 sends a pulse driving signal to drive the light source 111 to emit light.
  • the synchronization unit 124 is configured to control the timing of the pulses driving the laser light source 111 and the movement of the spot shifting device 130 , so that the laser light source 111 emits equally spaced light spots with the movement of the spot shifting device 130 .
  • control module 120 is divided into four functional modules: a processor 121 , a light source driver 122 , a spot shift control unit 123 and a synchronization unit 124 . It can be understood that this division is based on logical division of functions, the control module 120 can also be divided into other different logical function modules, and the number of divided functional modules can be more or less.
  • the light source 111 may be various light source devices capable of emitting light.
  • each light source 111 may be a vertical cavity surface emitting laser, an edge emitting laser, an LED, or a Micro LED, or the like.
  • each light source 111 of the light source array module 110 may emit a monochromatic light spot or a white light spot.
  • FIG. 5 shows a schematic structural diagram of a light source device 100 according to yet another embodiment of the present application.
  • the difference between this embodiment and the embodiment shown in FIG. 1 is that the light source array module 110 may include a first light source array module 110A, a second light source array module 110B and a third light source array module 110C, wherein,
  • the first light source array module 110A includes a plurality of first light sources 111A that emit light having a first color
  • the second light source array module 110B includes a plurality of second light sources 111B that emit light having a second color
  • the third light source array module 110C A plurality of third light sources 111C emitting light having a third color are included.
  • the first color, the second color and the third color may be blue, green and red, respectively.
  • the light source device 100 may further include a light combining module 140 , the three light source array modules have the same number of light sources, and each first light source 111A corresponds to a second light source 111B and Three light spots with three colors respectively emitted by a third light source 111C can be combined into one white light spot by the light combining module 140 as imaging light. In this way, the three monochromatic light spot arrays emitted by the three light source array modules are finally combined by the light combining module 140 into a mixed color light spot array, such as a white light spot array.
  • the light source device 100 may not have the light combining module 140, and each first light source 111A, a corresponding second light source 111B and a third light source 111C may be arranged in the same position as three sub-pixels next to each other, Makes the light spots emitted by the three light sources appear to be emitted from the same position and correspond to the same pixel of the imaging light.
  • the light combining module 140 may not be used.
  • the light spot shifting device 130 may accordingly include a first light spot shifting device 130A for moving the light spot of the first light source array module 110A, a light spot shifting device 130A for moving the second light source array module 110B The second light spot shifting device 130B of the light spot and the third light spot shifting device 130C for moving the light spot of the third light source array module 110C.
  • the control module 120 may be configured to sequentially or simultaneously control the first light spot shifting device 130A, the second light spot shifting device 130B and the third light spot shifting device 130C according to the pixel positions of each subframe, so that the The positions of the light spots of the plurality of first light sources 111A, the second light sources 111B, and the third light sources 111C correspond one-to-one with the positions of the pixels included in the subframe at a corresponding time.
  • Each subframe of the target image may be decomposed into a first subframe component having a first color component, a second subframe component having a second color component, and a third subframe component having a third color component, the control module 120 further Can be configured as:
  • the brightness of each of the plurality of first light sources 111A is independently controlled according to the grayscale distribution of the first subframe component, so that each light spot of the plurality of first light sources 111A forms a first light source at a time corresponding to the subframe.
  • Grayscale display of subframe components that is, at the moment corresponding to the subframe, the brightness of each light spot of the first light source 111A corresponds to the grayscale value of the first color component of each pixel of the subframe in one-to-one correspondence.
  • each of the plurality of second light sources 111B is independently controlled according to the gradation distribution of the second subframe component, so that each light spot of the plurality of second light sources 111B forms a second light source at a time corresponding to the subframe.
  • Grayscale display of subframe components that is, at the moment corresponding to the subframe, the brightness of each light spot of the second light source 111B corresponds to the grayscale value of the second color component of each pixel of the subframe one-to-one.
  • the brightness of each of the plurality of third light sources 111C is independently controlled according to the grayscale distribution of the third subframe component, so that each light spot of the plurality of third light sources 111C forms a third light source at a time corresponding to the subframe.
  • Grayscale display of subframe components That is, at the time corresponding to the subframe, the brightness of each light spot of the third light source 111C corresponds to the grayscale value of the third color component of each pixel of the subframe in one-to-one correspondence.
  • the method is the same as that of adjusting the brightness of the light source to be consistent with the gray-scale value of the sub-frame pixels, which is not repeated here. Repeat.
  • control module 120 in the embodiment of FIG. 5 may further include a processor 121, a light source driver 122, and a light spot shift control unit 123 as shown in FIG. 4, and may also include a synchronization unit 124, which is omitted here. Repeat.
  • the above-mentioned light source device can reduce the modulation bandwidth of the light source device, effectively reduce the control bandwidth of the spot shift device, and effectively improve the image uniformity, and when the light source is a laser, the moving spot scheme can also effectively reduce all Speckle of the resulting image.
  • the gray-scale display of the pixel can be realized by adjusting the brightness of the light source corresponding to the pixel, so that at the corresponding time of each subframe, the brightness of each light source can be adjusted by adjusting the brightness of the light source. Brightness to achieve a two-dimensional grayscale distribution of each subframe.
  • an imaging method is also provided.
  • the imaging method can be implemented by a light source device, the light source device can decompose a target image into a plurality of sparsely sampled subframes, and includes a plurality of light sources, a plurality of Each light spot emitted by each light source corresponds to each pixel of a subframe one-to-one, and the light source device generates a corresponding light spot array for each subframe sequentially by moving the light spot within a frame time, thereby obtaining the image light of the target image.
  • the light source device may be, for example, any embodiment of the light source device 100 described above.
  • FIG. 6 shows a schematic flowchart of an imaging method according to an embodiment of the present application. As shown in Figure 6, the example imaging method includes the steps of:
  • S610 Decompose a frame of target image to obtain multiple subframes.
  • At least one pixel of other subframes is interposed between at least two adjacent pixels of each subframe.
  • the control module of the light source device decomposes the target image frame.
  • the control module may decompose the target image according to the number of pixels of the target image, the configuration parameters of the light source device, and the like.
  • a target image containing a plurality of pixels is decomposed into a plurality of sparsely sampled subframes, and at least one pixel of other subframes is interposed between at least two adjacent pixels of each subframe.
  • the light source device generates corresponding light spots in step S620 according to the information of the multiple subframes.
  • S620 According to the pixel position of each subframe, move the position of the light spot emitted by the light source array module according to the time sequence through the light spot shifting device, so that the position of the light spot corresponds to each subframe in sequence.
  • step S620 the light source device sequentially generates corresponding light spots for each subframe according to the pixel positions of the decomposed subframes.
  • Generating a corresponding light spot for a subframe may refer to moving the position of the light spot at the moment of the subframe to make the position of each light spot correspond one-to-one with the position of each pixel of the subframe.
  • the light source array module includes a plurality of light sources, and the light beam emitted by each light source in the plurality of light sources forms a light spot corresponding to one pixel of the target image, and the plurality of light spots formed by the plurality of light sources at the moment corresponding to the sub-frame
  • the positions correspond one-to-one with the positions of multiple pixels included in the subframe.
  • Each subframe is generated by sparse sampling of the target image, and correspondingly, the light sources included in the light source array module are also sparse lattices with respect to the pixel distribution of the target image.
  • step S620 may be implemented by the light source device through the following processing:
  • S621 Generate, for each subframe, a shift control signal for controlling the light spot shifting device to move the light spot to reach a position corresponding to the subframe according to the pixel position of each subframe;
  • S622 Move the position of the light spot by the light spot shifting device according to the shift control signal of each subframe.
  • Step S621 may be implemented, for example, by the control module of the light source device or the light spot displacement control unit of the control module in the foregoing light source device embodiments.
  • the target position to which the light spot is to be moved can be determined according to the position of each pixel in each subframe, and the moving distance, moving direction and moving route of the light spot can be further determined according to the target position and the current position of the light spot, and then according to the determined This information generates corresponding shift control signals for each subframe. Further, the moving distance, moving direction or moving route, moving speed, etc.
  • the of the light source of the light source device or the light source array module can also be determined according to the distance and moving direction of the light spot to be moved, or the angle and direction of the light beam emitted by the light source that need to be deflected, etc. can be determined. , and include this information in the shift control signal.
  • step S622 the light spot shifting device of the light source device moves the light spot according to the shift control signal, so that the position of each light spot corresponds to the position of each pixel of the corresponding subframe one-to-one.
  • the light spot shifting device can move the positions of the light spots by moving the positions of the multiple light sources, and can also move the positions of the light spots formed by the light beams by deflecting the directions of the light beams emitted by the multiple light sources.
  • generating the corresponding light spot for the subframe may further include: at the moment of the subframe, when the light spot is shifted to a position corresponding to the subframe, adjusting the brightness of each light spot to be the same as the subframe
  • the grayscale of each pixel is the same. That is, the example imaging method may further include the step of: controlling the brightness of each light source of the plurality of light sources according to the grayscale distribution of each subframe, so that each spot of the plurality of light sources forms the subframe at a time corresponding to the subframe Grayscale display of the corresponding pixels of the frame. This step can be achieved by the following processing:
  • a plurality of light sources emit light under the driving of corresponding driving signals to form light spots corresponding to the subframe.
  • each of the plurality of light sources is a pulse-driven laser light source configured to emit light when the spot shifting device displaces the spot to the target position.
  • the timing of the pulses for driving the laser light source and the movement of the spot shifting device can be controlled, so that the laser light source emits light spots at equal intervals with the movement of the spot shifting device.
  • the spot displacement in order to obtain precise consistency between the spot position and the spot brightness, can be synchronized with the lighting of the light source.
  • the above-described example imaging method may further include the step of: controlling the light source driver to synchronize with the light spot shifting device according to the plurality of subframes, so that the light spot shifting device moves the light spots of the plurality of light sources to correspond to each of the plurality of subframes
  • the light source driver drives the light source array module to emit light corresponding to the grayscale distribution of the subframe.
  • the position movement of the light spot is kept in line with the brightness change, so that the light spot of precise brightness can be provided at the precise pixel position.
  • step S630 After forming the light spot corresponding to each subframe, the example imaging method proceeds to step S630.
  • S630 Image the light spots corresponding to the multiple subframes emitted by the light source array module to obtain image light.
  • the light spot may be imaged by an imaging module to obtain image light.
  • the imaging module may be a module in the light source device or a module located outside the light source device.
  • the light emitted by each light source may be monochromatic light or white light.
  • the light sources emit monochromatic light of different colors.
  • the light source array module of the light source device includes a first light source array module, a second light source array module and a third light source array module, and the first light source array module includes a plurality of first light sources that emit light having a first color
  • the second light source array module includes a plurality of second light sources emitting light with a second color
  • the third light source array module includes a plurality of third light sources emitting light with a third color.
  • the light spot shifting device includes a first light spot shifting device for moving the light spot of the first light source array module, a second light spot shifting device for moving the light spot of the second light source array module, and a second light spot shifting device for moving the third light source array module.
  • a third spot shift device for the spot is
  • step S620 may include: sequentially or simultaneously controlling the first light spot shifting device, the second light spot shifting device and the third light spot shifting device according to the pixel positions of each subframe, so that the The positions of the light spots of the plurality of first light sources, the second light sources and the third light sources at the corresponding moment correspond one-to-one with the positions of the pixels included in the subframe.
  • each subframe of the target image can be decomposed into a first subframe component with a first color component, a second subframe component with a second color component, and a third subframe with a third color component component, which controls the brightness of each light source in the multiple light sources according to the grayscale distribution of each subframe, including:
  • the brightness of each of the plurality of first light sources is controlled according to the grayscale distribution of the first subframe component, so that each light spot of the plurality of first light sources forms the first subframe component at the moment corresponding to the subframe.
  • Grayscale display that is, at the moment corresponding to the subframe, the brightness of each light spot corresponds to the grayscale value of the first color component of each pixel of the subframe in one-to-one correspondence.
  • the brightness of each of the plurality of second light sources is controlled according to the grayscale distribution of the second sub-frame component, so that each light spot of the plurality of second light sources forms the second sub-frame component at the moment corresponding to the sub-frame.
  • Grayscale display that is, at the moment corresponding to the subframe, the brightness of each light spot corresponds to the grayscale value of the second color component of each pixel in the subframe one-to-one.
  • the brightness of each of the plurality of third light sources is controlled according to the grayscale distribution of the third subframe component, so that each light spot of the plurality of third light sources forms the third subframe component at the moment corresponding to the subframe.
  • Grayscale display That is, at the moment corresponding to the subframe, the brightness of each light spot corresponds to the grayscale value of the third color component of each pixel in the subframe in one-to-one correspondence.
  • the method is the same as that of adjusting the brightness of the light source to be consistent with the gray-scale value of the sub-frame pixels, which is not repeated here. Repeat.
  • the example imaging method further includes the step of: combining the light spots of the plurality of first light sources, the second light sources and the third light sources. .
  • a light combining module can be used to combine the three light spots emitted by the group of light sources into one light spot.
  • the three monochromatic light spot arrays emitted by the three light source array modules are finally synthesized by the light combining module into a mixed color light spot array, such as a white light spot array.
  • the combined light spot is imaged to obtain image light.
  • the target image in the source image signal can be decomposed into a plurality of subframes that are sparsely sampled (that is, at least one of other subframes is interposed between at least two adjacent pixels of each subframe) Pixels), the pixels of each subframe correspond to the light sources of the light source array module one-to-one, and the light spots corresponding to each subframe are formed in sequence according to the time sequence.
  • the device moves the position of the light spot to correspond with the pixel position of the corresponding subframe.
  • the light spot corresponding to each light source is moved to correspond to a plurality of image pixel points.
  • each light source can be modulated separately to contribute to the overall resolution. Therefore, compared with the contribution of a single light source to the overall resolution, the embodiment of the present application reduces the The modulation bandwidth of the light source device.
  • the embodiment of the present application can effectively reduce the control bandwidth of the light spot shifting device.
  • the embodiments of the present application can effectively improve the uniformity of the image.
  • the embodiment of the present application uses a light source array as the light source, and when the light source is a laser, the moving light spot scheme can also effectively reduce the speckle of the formed image.
  • the two-dimensional grayscale distribution of each subframe is achieved by adjusting the brightness of each light source in the corresponding time period, avoiding the use of spatial light that is currently inefficient modulator, therefore, the efficiency of the imaging method can be greatly improved.
  • these embodiments can achieve high contrast ratio and high dynamic range.
  • each light source of the light source array module is independently addressable, that is, independently controllable, therefore, variable light encoding can be implemented, thereby improving imaging accuracy.
  • the gray scale of a single pixel can be realized by modulating the light intensity of the corresponding single light source, and the adjustment method is simple and easy to implement.
  • these embodiments can achieve high contrast ratio and high dynamic range. The lattice or structured light generated by this solution can be quickly transformed to generate customized patterns at extremely high speed.
  • Embodiments of the above-described example light source apparatus and example imaging method may be applied in many applications, eg, for projection image display, or for 3D imaging of objects.
  • the image light obtained in step S630 can be projected onto the screen, so that the target image is reproduced on the screen.
  • the above-mentioned embodiments of the light source device can be integrated into a display device, and the display device may further include a method for imaging the light spot emitted by the light source device to obtain image light, and project the image light onto the screen imaging module.
  • the image light obtained in S630 can be used as structured light, and the example imaging method may include the following steps:
  • the image light is irradiated on the object to be measured; the image light modulated by the object to be measured is collected; the acquired modulated image light is processed to obtain three-dimensional information of the object to be measured.
  • the above-mentioned embodiments of the light source device may be integrated into an imaging device for 3D imaging of the object to be measured, and the imaging device may further include:
  • the imaging module is used for forming image light based on the light spot output by the light source device and irradiating it on the object to be measured.
  • the acquisition module is used to acquire the image light modulated by the object to be measured.
  • the image processing module is used for processing the modulated image light collected by the acquisition module to obtain the three-dimensional information of the object to be measured.
  • 3D imaging technology can also obtain information about the depth dimension of the target, so 3D stereo scanning or modeling can be achieved.
  • Common 3D imaging solutions can include Diffractive Optical Elements (DOE, Diffractive Optical Elements), 3D structured light scanning solutions, and Vertical Cavity Surface Emitting Lasers (VCSELs) based on Micro Electro Mechanical Systems (MEMS, Micro Electronic Mechanical System).
  • VCSELs Vertical Cavity Surface Emitting Lasers
  • MEMS Micro Electro Mechanical Systems
  • Emitting Laser Emitting Laser
  • DLP Digital Light Processing
  • the control of the projected structured light is mainly achieved through a plurality of closely arranged light source arrays, DOEs and some spatial processing.
  • the light sources do not realize independent addressing control, and the number of images that can be controlled is limited, and it is impossible to control the image.
  • the accuracy and resolution that can be achieved are limited; when using a digital micro mirror device (DMD, Digital Micro Mirror Device) to implement a DLP-based 3D structured light scheme, the efficiency of the DMD spatial light modulator is low, and the required The heat dissipation module is large, so the whole system is complex, bulky and low in efficiency.
  • DMD Digital Micro Mirror Device
  • regular and irregular light source arrays are mostly used, or multiple light source arrays are used to project light spots with different degrees of sparseness and different arrangements, and the light beams are received and collimated by lens units (such as microlens arrays or lens groups, etc.). , and then project it into space, and then copy and amplify the beam emitted by the light source array with different multiples through one or more DOEs, as shown in Figure 7.
  • the 3D imaging scheme based on the light source array can realize structured light for different application scenarios. ; Multiple light source arrays can also be processed by one or more combinations of translation, rotation, mirroring or scaling, aiming to obtain laser speckle images with uniform overall particle distribution but high degree of local irrelevance, in order to obtain higher accuracy.
  • the MEMS-based VCSEL light source array system reflects the array beam emitted by the regular or irregular VCSEL through the vibration of the MEMS micromirror, and projects it onto the object in the form of a lattice. Dense spot distribution improves accuracy, as shown in Figure 8; the control of the projected structured light is mainly achieved through multiple closely-arranged light source arrays, DOEs and some spatial processing, and the light sources do not implement independent addressing control , the number of images that can be controlled is limited, the image cannot be dynamically modulated, and the accuracy and resolution that can be achieved are limited.
  • DLP-based 3D structured light solutions when designers need to perform fast and high-precision scanning with millimeter to micron resolution, they often choose DLP-based structured light systems and use DMD to achieve high-speed real-time 3D scanning, but DMD spatial light modulators The efficiency is lower, and the required cooling module is larger, so the whole system is complicated, the volume is larger, and the efficiency is low.
  • FIG. 9 shows a schematic structural block diagram of an imaging device according to an embodiment of the present application.
  • the imaging device 900 includes a light source device 100 , an imaging module 920 , an acquisition module 930 and an image processing module 940 .
  • the light source device 100 and the imaging module 920 form a test pattern generating module 910 for generating structured light.
  • the light source device 100 may be the various light source device embodiments described above.
  • the control module of the light source device is divided into a decoder 911 and a light source array drive module 912 , and the beam scanning/deflection actuator 913 is equivalent to the light spot shifting device 130 in the foregoing light source device embodiments.
  • the light source array module 110 in the test pattern generation module 910 uses electrodes with independent control of each light source, and realizes fast single-point control of each laser light source through a driver. Since the array light sources of the light source array module 110 need to be independently addressed and controlled, the array is in the form of a sparse lattice, and is arranged in an M*N lattice, as shown in FIG. 4 . Through the optical imaging lens of the imaging module 920, M*N sparse pixel points can be realized on the screen.
  • a frame of image with densely packed pixels In order to display a frame of image with densely packed pixels, it is necessary to split a frame of image into a*b sub-frames displayed by time-division multiplexing, that is, the light spot corresponding to each independently addressed light source is expanded by time-division multiplexing.
  • the densely packed a*b light spots correspond to the a*b densely packed pixels in one frame of image, which just fill the gaps between several adjacent independently addressable and controllable light sources.
  • the switching between sub-frames can be realized by the micro-actuator, and finally aM*bN pixels are realized on the screen.
  • the integration effect of the human eye splices multiple subframes into a complete image.
  • the above description divides a frame of image into a*b non-overlapping subframes, and a*b subframes are repeated only once in a frame, and the principle of repeating a*b subframes multiple times is similar. The speed can be accelerated, and I will not repeat them here.
  • the sparse lattice light source is located at position 1 at time t1, at position 2 at time t2, and so on.
  • the light sources are located at positions 1, 2, 3, and 4 in sequence within one frame, and each light source forms non-overlapping 2*2 close-packed pixels, forming 2M*2N pixels as a whole.
  • the video signal source After the video signal source is converted by the decoder 911, it is transmitted to the light source array driving module 912. By controlling the brightness of the light source at each spot position, different gray scales are realized, and the regulation of a sub-frame image is completed.
  • the image acquisition module 930 acquires the image and transmits it to the image processing module 940 for analysis.
  • the beam scanning/deflection actuator 913 moves the light spot corresponding to the array light source to its corresponding position, and the light source array driving module 912 drives the array light source according to the grayscale corresponding to this subframe, so that on the image Displays the grayscale distribution of the corresponding subframe.
  • the image acquisition module 930 acquires the image and transmits it to the image processing module 940 for analysis.
  • the image processing module 940 analyzes and compares all the displayed images to achieve high-precision 3D imaging.
  • FIG. 10 shows a schematic structural diagram of an imaging device 1000 according to another embodiment of the present application, wherein an independently addressable and regulated VCSEL is used as an array light source of the light source array module, and a micro-actuator 1010 is used as a light spot shift device to vibrate
  • the light source array module 110 is used to realize the displacement of the light spot.
  • the decoder 1021 , VCSEL driver 1022 , micro-actuator driver 1023 and synchronization device 1024 are respectively equivalent to the processor 121 , light source driver 122 , spot shift controller 123 and synchronization unit 124 constituting the control module 120 as before.
  • the VCSEL light source of the light source array module 110 is mounted on the micro-actuator 1010 .
  • the micro-actuator 1010 may be a two-dimensional micro-actuator, or may be two one-dimensional micro-actuators, and the two one-dimensional micro-actuators respectively control two mutually perpendicular directions, so that the VCSEL vibrates in two directions.
  • One of the two-dimensional vibration directions can be at a fast frequency and the other at a slow frequency. Among them, the slow frequency direction vibrates in a step-by-step manner.
  • the microactuator 1010 may be a linear moving actuator or a rotary actuator.
  • the laser light source VCSEL is driven with pulses so that it emits light when the microactuator 1010 moves to the desired spot position.
  • a single VCSEL light source has a diameter of 15 microns, and the spacing between each light source in the x and y directions is 150 microns.
  • the entire VCSEL light source array is about 30mm long and wide. About 15mm. Then when the vibration frequency in the x-direction is 600Hz and the vibration frequency in the y-direction is 60Hz, a resolution of 2k and a refresh rate of 60Hz can be achieved.
  • the one-dimensional micro-actuator in the x-direction can be a high-frequency piezoelectric ceramic actuator
  • the one-dimensional micro-actuator in the y-direction can be, but not limited to, a piezoelectric mobile platform, Piezo stepper motor or 1D deflection stage.
  • the 2D microactuator can use a high frequency 2D deflection stage to achieve deflection in both directions simultaneously.
  • the pulse sequence of the laser light source can be controlled to match the displacement curve of the micro-actuator 1010, so that the VCSEL projects equally spaced light spots.
  • the moving curve is a sine wave
  • the output at equal intervals can be achieved, as shown in Figure 11.
  • the micro-actuator 1010 moves the light spot corresponding to the array light source to its corresponding position
  • the VCSEL driver 1022 drives the array light source according to the grayscale corresponding to the subframe, so that the grayscale corresponding to the subframe is displayed on the image. degree distribution.
  • the obtained densely packed pixel points are optically amplified by the imaging module 920, and finally projected onto the object to be measured.
  • the acquisition module 930 collects the light modulated by the object, and transmits the signal to the image processing module 940, and the image processing module 940 obtains the three-dimensional information of the object to be measured after calculating the signal.
  • the vibration bandwidth of the two-dimensional micro-actuator is reduced by sparse lattice light sources, the system is simple, the volume is small, and the resolution is high.
  • the image modulation can be realized without an additional spatial light modulator. Accurate 3D imaging.
  • FIG. 12 shows a schematic structural diagram of an imaging device 1200 according to another embodiment of the present application, wherein Micro LED is used as a sparse array light source of the light source array module, and a MEMS scanning mirror or a phase deflection device is used to realize beam scanning/spot shift.
  • the decoder 1221 , the LED driver 1222 , the scanning device driver 1223 and the synchronization device 1224 are respectively equivalent to the processor 121 , the light source driver 122 , the spot shift controller 123 and the synchronization unit 124 constituting the control module 120 as before.
  • the signal is transmitted to the LED driver 1222 and the scanning device driver 1223 , and the synchronization device 1224 ensures that the two are synchronized.
  • the function of the phase deflector/MEMS mirror 1230 as a light spot shifting device is to realize beam deflection.
  • the phase deflector uses the diffraction principle of light to realize the deflection of the main light level by modulating the phase of the light.
  • Typical devices such as acousto-optic deflectors and liquid crystals.
  • MEMS uses piezoelectric ceramics as the driving source, which can realize two-dimensional fast flipping, and realize beam deflection using the principle of light reflection.
  • the diameter of a single Micro LED light source of the LED light source array 1210 is 15 microns, and the distance between each light source in the x and y directions is 150 microns. There are 200 light sources in the x direction and 100 light sources in the y direction. The entire Micro LED The light source array is about 30mm long and 15mm wide. Then, when the scanning frequency in the x-direction is 600 Hz and the scanning frequency in the y-direction is 60 Hz, a resolution of 2k and a refresh rate of 60 Hz can be achieved.
  • the phase deflector/MEMS mirror 1230 is driven by the scanning device driver 1223 to move the light spot of the LED light source array 1210 to the position corresponding to the subframe.
  • the LED light source array 1210 is driven so that the grayscale distribution of the corresponding sub-frame is displayed on the image.
  • the obtained densely packed pixel points are optically amplified by the imaging module 920, and finally projected onto the object to be measured.
  • the acquisition module 930 collects the modulated light of the object, and transmits the signal to the image processing module 940, and the image processing module 940 obtains the three-dimensional information of the object after calculating the signal.
  • This embodiment uses a sparse lattice light source, the system is simple, the volume is small, and the resolution is high, and the image modulation can be realized without an additional spatial light modulator, thereby realizing high-precision 3D imaging.
  • FIG. 13 shows a schematic structural diagram of a display device according to an embodiment of the present application.
  • the exemplary display device 1300 is composed of a light source array module 1310 , a decoder 1321 , a beam scanning/deflection actuator 1330 , a light source array driver 1322 , a light combining module 1340 , and an imaging module 1350 .
  • the decoder 1321 and the light source array driver 1322 constitute the control module 120 in the aforementioned embodiments of the light source device, and the beam scanning/deflection actuator 1330 is equivalent to the light spot shift in the aforementioned embodiments of the light source device
  • the position device 130 , the light source array module 1310 , the decoder 1321 , the beam scanning/deflection actuator 1330 , and the light source array driver 1322 constitute a light source device module equivalent to the aforementioned light source device embodiments.
  • the array light sources of the light source array module 1310 use electrodes with independent control of each light source, and the light source array driver 1322 realizes fast single-point control of each laser light source. Since the array light sources need to be independently addressed and regulated, the array light sources of the light source array module 1310 are in the form of sparse lattices and are arranged in an M*N lattice, as shown in FIG. 4 . Through the optical imaging lens of the imaging module 1350, M*N sparse pixel points can be realized on the screen.
  • a frame of image In order to display a frame of images with densely packed pixels, a frame of image needs to be split into a*b sub-frames displayed by time division multiplexing, that is, the light spot corresponding to each independently addressed light source is expanded by time division multiplexing into The closely-packed a*b light spots correspond to the a*b closely-packed pixels in one frame of image, which just fill the gaps between several adjacent independently addressable and controllable light sources.
  • the switching between display subframes can be realized by the beam scanning/deflection actuator 1330, and finally aM*bN pixels are realized on the screen.
  • the integration effect of the human eye splices multiple subframes into a complete image.
  • the above description divides a frame of image into a*b non-overlapping subframes, and a*b subframes are repeated only once in a frame, and the principle of repeating a*b subframes multiple times is similar. The speed can be accelerated, and I will not repeat them here.
  • the a*b light spots corresponding to the same independently controllable light source may not be closely arranged, but overlap or have gaps in the middle, and the specific solution can be determined according to the actual imaging requirements.
  • the sparse lattice light source is located at position 1 at time t1, at position 2 at time t2, and so on.
  • the light sources are located at positions 1, 2, 3, and 4 in sequence within one frame, and each light source forms non-overlapping 2*2 close-packed pixels, forming 2M*2N pixels as a whole.
  • FIG. 17 shows a schematic diagram of frame breaking for an example image corresponding to the frame breaking method shown in FIG. 2 .
  • the video signal source After the video signal source is converted by the decoder 1321, it is transmitted to the light source array driver 1322, and the control of a sub-frame image is completed by controlling the brightness of the light source at each spot position to achieve different gray scales.
  • the beam scanning/deflection actuator 1330 moves the light spot corresponding to the array light source to the position corresponding to the subframe, and the light source array driver 1322 drives the array light source according to the grayscale corresponding to the subframe, so that the image The grayscale distribution of the corresponding subframe is displayed on the top.
  • the light source array module 1310 includes three light sources that respectively emit light of three different colors (eg, light of three colors G, R, and B). By using the light combining module 1340 to combine light of three colors, such as G, R, and B, through the imaging module 1350, a color image is realized on the screen.
  • FIG. 14 shows a schematic structural diagram of a display device 1400 according to another embodiment of the present application, wherein an independently addressable and regulated VCSEL is used as an array light source of the light source array module, and a micro-actuator is used as a light spot shifting device to vibrate light source.
  • the decoder 1421, the VCSEL driver 1422, the micro-actuator driver 1423 and the synchronization device 1424 are respectively equivalent to the processor 121, the light source driver 122, the spot shift controller 123 and the synchronization unit 124 that constitute the control module 120 as described above. .
  • the light source array module includes a first light source array module 1410A emitting B (blue) light, a second light source array module 1410B emitting R (red) light, and a third light source emitting G (green) light Array modules 1410C, which are located at different locations.
  • the three light source array modules have an equal number of light sources. Three light spots with three colors respectively emitted by each light source of the first light source array module 1410A, a light source corresponding to a position in the second light source array module 1410B and a light source corresponding to a position in the third light source array module 1410C can be combined.
  • the light module 1440 is combined into a white light spot. In this way, the three monochromatic light spot arrays emitted by the three light source array modules are finally combined by the light combining module 1440 into a mixed color light spot array, such as a white light spot array.
  • the micro-actuator as the light spot shifting device may also include a first micro-actuator 1430A for moving the light spot of the first light source array module 1410A, and a first micro-actuator 1430A for moving the second light source.
  • the video source After the video source is decoded by the decoder 1421, it is transmitted to the VCSEL driver 1422 and the micro-actuator driver 1423, and the synchronization device 1424 ensures that the two are synchronized.
  • the direction of the VCSEL makes the VCSEL vibrate in two directions.
  • the overall scheme is shown in Figure 14. Vibration in these two dimensions can be one fast frequency and one slow frequency. The slow frequency direction vibrates in a step-by-step manner.
  • Micro-actuators can be linear moving actuators or deflection actuators.
  • the laser light source can be pulsed to emit light when the microactuator is moved to the desired spot position.
  • a single VCSEL light source has a diameter of 15 microns, and the spacing between each light source in the x and y directions is 150 microns.
  • the entire VCSEL light source array is about 30mm long and wide. About 15mm. Then when the vibration frequency in the x-direction is 600Hz and the vibration frequency in the y-direction is 60Hz, a resolution of 2k and a refresh rate of 60Hz can be achieved.
  • the micro-actuator in the x-direction can be a high-frequency piezoelectric ceramic actuator, and the micro-actuator in the y-direction can be a piezoelectric moving platform, a piezoelectric stepping motor, or a one-dimensional deflection stage.
  • a high frequency 2D deflection stage can be chosen to achieve deflection in both directions simultaneously.
  • the pulse timing of the laser light source can be controlled to match the displacement curve of the micro-actuator to project equally spaced light spots. For example, when the moving curve is a sine wave, by modulating the pulse sequence, the output at equal intervals can be achieved, as shown in Figure 11.
  • the micro-actuator moves the light spot corresponding to the array light source to the position corresponding to the subframe, and the VCSEL driver 1422 drives the array light source of each light source array module according to the grayscale corresponding to the subframe. Its response time is in the ns level, which can make the grayscale distribution of the corresponding subframe displayed on the image.
  • the VCSEL driver 1422 respectively drives the light source array modules that emit light of corresponding colors according to the grayscales corresponding to different color components of the subframe.
  • the light spots of different colors emitted by the three light source array modules correspond to the grayscales of different color components of the subframe.
  • the sparse array light spots of multiple subframes are time-division multiplexed to obtain close-packed pixels within one frame time.
  • RGB three-color light sources need to achieve pixel-level alignment and require time-shift up-synchronization.
  • This embodiment reduces the vibration bandwidth of the two-dimensional micro-actuator by sparse lattice light source, realizes grayscale by directly driving the light source, does not require an additional spatial light modulator, the system is simple, the volume is small, and the efficiency is high. High resolution while enabling high dynamic contrast. Due to the large number of light sources used, the speckle effect of the laser can be effectively reduced.
  • FIG. 15 shows a schematic structural diagram of a display device according to another embodiment of the present application, wherein three-color Micro LEDs are used as the sparse array light source of the light source array module, and MEMS scanning mirrors or phase deflection devices are used as the spot shifting device to achieve beam scanning/spot shifting.
  • the decoder 1521 , the LED driver 1522 , the scanning device driver 1523 and the synchronization device 1524 are respectively equivalent to the processor 121 , the light source driver 122 , the spot shift controller 123 and the synchronization unit 124 constituting the control module 120 as before.
  • the overall scheme is shown in Figure 15.
  • the function of the phase deflector/MEMS mirror 1530 as a light spot shift device is to realize beam deflection, thereby realizing light spot shift.
  • the phase deflector uses the diffraction principle of light to realize the deflection of the main light level by modulating the phase of the light.
  • Typical devices such as acousto-optic deflectors and liquid crystals.
  • MEMS uses piezoelectric ceramics as the driving source, which can realize two-dimensional fast flipping, and realize beam deflection using the principle of light reflection.
  • each light source of the LED light source array 1510 is a combined light source composed of three Micro LED light sources emitting R, G, and B lights, placed together.
  • 16 shows a schematic diagram of a Micro LED combined light source according to an embodiment of the present application. Three Micro LED light sources respectively emitting R, G, and B light are placed close to each other and arranged in a triangle. The diameter of the combined light source is about 40 microns.
  • the entire Micro LED light source array is about 80mm long and 40mm wide. Then, when the scanning frequency in the x-direction is 600 Hz and the scanning frequency in the y-direction is 60 Hz, a resolution of 2k and a refresh rate of 60 Hz can be achieved.
  • the acousto-optic deflector is used as the beam deflecting device, since the response time of the acousto-optic deflector is in the ns level, the densely packed pixel point arrangement can be realized without the need for pulse driving of the light source.
  • the response time of the LED driver 1522 is in the ns level.
  • the grayscale distribution of the corresponding subframe is displayed on the image.
  • the obtained densely packed pixel points are optically enlarged by the imaging module 1540, and finally projected onto the screen to obtain a color image.
  • control bandwidth of the light source and the vibration frequency of the micro-actuator are reduced by sparse dot-matrix light sources, and grayscale is realized by directly driving the light source, and no additional spatial light modulator is required. Since the three light sources of the GRB are combined into one combined light source, a light combining device is not required, and there is no need to consider the synchronization accuracy of the three-color light sources.
  • the system is simple, small in size, high in efficiency, high in resolution, and capable of achieving high dynamic contrast.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Liquid Crystal Display Device Control (AREA)

Abstract

本申请公开了一种光源装置、显示装置和成像装置,该光源装置包括光源阵列模块、控制模块和光斑移位装置,其中:光源阵列模块包括以阵列的形式排列的多个光源,每个光源发出与一帧目标图像的一个像素相对应的光斑,目标图像包括多个子帧;光斑移位装置用于在控制模块的控制下移动光斑的位置;控制模块被配置为按照时序控制光斑移位装置以使得光斑的位置依次对应于每个子帧,控制模块被配置为:根据每个子帧的像素位置控制光斑移位装置,以使得在与该子帧相对应的时刻光斑的位置与该子帧所包含的像素的位置一一对应,其中,每个子帧的至少两个相邻像素之间间插有其他子帧的至少一个像素。通过上述方式,本申请能够提高分辨率与效率。

Description

光源装置、成像装置及显示装置 技术领域
本申请涉及光信息处理技术领域,具体涉及一种光源装置、成像装置及显示装置。
背景技术
在诸如物体3D成像、投影显示等技术中,通常需要根据源图像利用包括光源、空间光调制器、投影镜头等的成像系统来形成图像光以再现源图像,在此将其称为成像技术。常见的成像技术方案包括基于空间光调制器的成像方案、基于光束扫描的成像方案等。
现有的基于空间光调制器的成像方案一般包括基于DMD(Digital Micromirror device,数字微镜器件)的方案、基于LCD(Liquid Crystal Display,液晶显示器)的方案、基于LCOS(Liquid Crystal on Silicon,硅基液晶)的方案。
基于DMD的方案:数字光处理(DLP,Digital Light Processing)显示技术图像由DMD产生。DMD是一种空间光调制器,是在半导体芯片上布置一个由微镜片(精密、微型的反射镜)所组成的矩阵,其中,每一个微镜片控制投影画面中的一个像素,微镜片的数量与投影画面的分辨率相符。光源投射到DMD上,微镜片在数字信号的驱动下能够快速翻转,存在on(开)和off(关)的状态,镜头仅接收on状态的光,通过对开关状态的控制得到不同的灰度,进而获得彩色图像。
基于LCD的方案:LCD液晶显示器在两片平行的玻璃基板当中放置液晶盒,下基板玻璃上设置TFT(薄膜晶体管),上基板玻璃上设置彩色滤光片,通过TFT上的信号与电压改变来控制液晶分子的转动方向,从而达到控制每个像素点的偏振光出射状态而获得灰阶,实现彩色成像。其原理是利用液晶分子的双折射,通过一定的液晶分子排布(常见的为向列型),在不同电流电场的作用下,液晶分子会规则地作90度旋转,对入射的偏振光会产生透光度的区别,实现on和off状态的转换,达到成像目的。
基于LCOS的方案:LCOS属于新型的反射式Micro LCD(微LCD)投影技术,其结构是在硅片上,利用半导体制程制作驱动面板(又称为CMOS-LCD),然后在电晶体上镀上铝当作反射镜,形成CMOS基板,然后将CMOS基板与含有透明电极的上玻璃基板贴合,再注入液晶。其基本原理和LCD类似,均是采用液晶分子的双折射原理。当硅基板上铝电极电压变化时,液晶电压发生变化,液晶分子偏转,实现对入射偏振光on和off状态的调制,产生图像。
现有的基于空间光调制器(例如DMD、LCD或者LCOS)的成像方案均通过空间光调制器来调制图像光的光强,从而实现不同的灰阶和色彩的显示。空间光调制器的能量利用效率是很低的,例如DMD的off光无法利用,LCD或者LCOS通过液晶分子的偏转调制透过光的偏振态分布,多余的光被偏振器件吸收。这些空间光调制器均存在较大的能量损失,因此也需要配套较强的散热系统,基于空间光调制器的光源装置、成像装置或显示装置整体体积大,能效低。另外,由于空间光调制器器件本身散热的限制,无法承载高的能量密度,因此难以获得很高亮度的显示。由于受到空间光调制器本身的限制,例如DMD的off光的泄露、液晶分子对光束偏振态转换以及偏振片均存在一定的转换效率,导致所得到的图像也难以获得高的动 态对比度。
基于光束扫描的成像方案一般主要以激光为光源,通过光调制器调制光源,通过二维扫描器、光学合色系统和投影物镜,实现显示成像。源图像信号加载到光调制器上,控制光束的强度;同时将行、场的信号同步到光偏转器上,使光束按一定规律以调制后的强度投射到屏幕或其他目标上形成彩色图像。
现有的光束扫描成像方案主要以激光作为主要光源,用光调制器来调制光束光强。常见的光调制器有电光调制和声光调制。三色激光经过加载了视频信号的调制器之后变成带有视频信号的不同光强的激光束,再经过光学薄膜的合色系统,合成一束光束。接着进入X-Y扫描系统。该扫描系统一般采用转镜与小角度的振镜组合,或者双转镜系统、双振镜来实现。
光束扫描成像方案使用光调制器,系统的功耗和体积较大;由于采用的激光光源数量少,对调制器和扫描设备的控制带宽要求大,图像的分辨率较低,所获得的视场角小,且存在较强的散斑效应。
发明内容
本申请的实施例提供一种光源装置,该光源装置包括光源阵列模块、控制模块和光斑移位装置,其中:
光源阵列模块包括以阵列的形式排列的多个光源,其中,多个光源中的每个光源发出的光束形成与一帧目标图像的一个像素相对应的光斑,目标图像包括多个像素且由多个子帧组成,其中,多个子帧中每个子帧所包含的像素是多个像素中的一部分,并且多个子帧所包含的像素共同组成多个像素;
光斑移位装置用于在控制模块的控制下移动多个光源的光斑的位置;
控制模块被配置为按照时序控制光斑移位装置以使得多个光源的光斑的位置依次对应于每个子帧,其中,控制模块被配置为:根据每个子帧的像素位置控制光斑移位装置,以使得在与该子帧相对应的时刻多个光源的光斑的位置与该子帧所包含的像素的位置一一对应,其中,每个子帧的至少两个相邻像素之间间插有其他子帧的至少一个像素。
本申请的实施例还提供一种成像装置,包括如上所述的光源装置。
本申请的实施例还提供一种显示装置,包括如上所述的光源装置。
本申请的实施例还提供一种成像方法,包括:
对一帧目标图像进行分解,得到多个子帧,其中,每个子帧的至少两个相邻像素之间间插有其他子帧的至少一个像素;
根据每个子帧的像素位置,按照时序通过光斑移位装置移动光源阵列模块发出的光斑的位置,使得光斑的位置依次对应于每个子帧;
对光源阵列模块发出的对应于多个子帧的光斑进行成像以得到图像光,
其中,光源阵列模块包括多个光源,多个光源中的每个光源发出的光束形成与目标图像的一个像素相对应的光斑,在与子帧相对应的时刻多个光源形成的多个光斑的位置与该子帧所包含的多个像素的位置一一对应。
通过如上的光源装置、成像装置、显示装置和成像方法的各实施例,本申请的有益效果是:
通过将源图像信号中的目标图像分解成稀疏采样的多个子帧,按照时序依次形成与每个子帧相对应的光斑,其中,在从一个子帧切换到下一子帧时,通过光斑移位装置移动光斑的位置以使其与相应的子帧的像素位置相对应,使得在显示一帧图像的时间中,每个光源对应的光斑经移动而对应多个图像像素点。由于将整体分辨 率通过包括多个光源的光源阵列来实现,每个光源可分别调制来对整体分辨率作贡献,因此,相比于单个光源对整体分辨率作贡献,本申请实施例降低了光源装置的调制带宽。另外,由于单个光源对应的光斑只需覆盖整体图像中的某个区域,本申请实施例可以有效降低光斑移位装置的控制带宽。此外,由于整体图像中的某个区域是通过单个光源移动而成,因此本申请实施例可以有效提高图像均匀性。此外,本申请实施例使用光源阵列作为光源,在该光源是激光时,该移动光斑方案也可有效减弱所形成的图像的散斑。
另外,在本申请的一些实施例中,每个子帧的二维灰度分布通过调节对应其时间段内的每个光源的亮度来实现,避免使用了目前效率较低的空间光调制器,因此,光源装置、成像装置、显示装置或成像方法的效率可以大幅提升。另外,由于单个像素的亮度通过光源的亮度调节可以实现全开/全关,因此这些实施例可以实现高对比度和高动态范围。
另外,在一些实施例中,光源阵列模块的每个光源是独立可寻址的,即是独立可控的,因此,可以实现可变的光编码,从而提高成像的精度。另外,在每个光源独立可控的情况下,单个像素的灰阶可通过对相对应的单个光源的光强调制来实现,调节方法简单易行,另外,由于单个像素的亮度通过光源的亮度调节可以实现全开/全关,因此这些实施例可以实现高对比度和高动态范围。利用此方案产生的点阵或者结构光可以快速实现变换,以极高的速度生成定制图案。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。其中:
图1是根据本申请一实施例的光源装置的示意结构图;
图2是根据本申请一实施例的如何将一帧目标图像分解成多个子帧的示意图;
图3是根据本申请一实施例的光源阵列模块的阵列光源及利用该阵列光源形成的密排像素阵列的示意图;
图4是根据本申请另一实施例的光源装置的示意结构图;
图5是根据本申请又一实施例的光源装置的示意结构图;
图6是根据本申请一实施例的成像方法的流程示意图;
图7是根据一实施例的基于光源阵列的3D成像方案的示意图;
图8是根据一实施例的基于MEMS的VCSEL光源阵列系统的示意图;
图9是根据本申请一实施例的成像装置的示意结构框图;
图10是根据本申请另一实施例的成像装置的示意结构图;
图11是图10所示的实施例中脉冲信号与位移曲线的示意图;
图12是根据本申请另一实施例的成像装置的示意结构图;
图13是根据本申请一实施例的显示装置的示意结构图;
图14是根据本申请另一实施例的显示装置的示意结构图;
图15是根据本申请又一实施例的显示装置的示意结构图;
图16是根据本申请一实施例的Micro LED组合光源的示意图;
图17是与图2所示的拆帧方法相对应的针对一幅示例图像的拆帧示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、 完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性的劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请中上文及下文中的“成像技术”、“成像方法”或“成像”等术语是指使用光源和光/电器件形成对应于源图像的图像光以再现源图像的过程、方法或技术。
本申请中上文及下文中的“图像”、“源图像”、“图像信号”等术语包括任何形式或格式的图像和/或视频。
本申请中上文及下文中的“子帧的时刻”、“与子帧相对应的时刻”等术语是指要显示该子帧的时刻,要形成与该子帧的像素相对应的光斑的时刻。
图1示出了根据本申请一实施例的光源装置100的示意结构图。如图1所示,在该实施例中,光源装置100包括光源阵列模块110、控制模块120和光斑移位装置130。光源阵列模块110包括以阵列的形式排列的多个光源111。其中,每个光源111发出的光束形成与一帧目标图像的一个像素相对应的光斑112(参见图3)。即,目标图像中的一个像素对应光源光束的一个光斑。如果光源的数量足够多,例如光源数量等于或大于目标图像的像素数,则无需将目标图像分解成多个子帧,可以通过形成与目标图像的像素数相等的光斑一次将目标图像显示完整。但是,在光源的数量小于目标图像包含的像素数的情况下,则需要将目标图像分解为多个子帧,在极短的时间内依次分时显示多个子帧。每次显示的子帧所包含的像素数等于或小于光源的数量,即子帧的分辨率等于或小于光源阵列模块110的光源分辨率。组成一帧目标图像的这多个子帧中每个子帧包括目标图像所包含的像素的一部分,所有子帧所包含的像素集合等于目标图像所包含的所有像素。由于显示多个子帧的时间足够短,人眼由于视觉暂留现象而感受不到不同子帧之间的切换,一帧内人眼会自动将多个子帧拼接成一个完整的图像。
在本申请实施例中,目标图像所包含的像素数大于光源阵列模块110所包含的光源数量。本申请实施例的目标图像包括多个像素且由多个子帧组成,其中,多个子帧中每个子帧所包含的像素是目标图像包含的多个像素中的一部分,并且多个子帧所包含的像素共同组成目标图像包含的像素。在本申请实施例中,这些子帧是稀疏采样的,每个子帧的至少两个相邻像素之间间插有其他子帧的至少一个像素,每个子帧所包含的像素数量均等于或小于光源阵列模块所包含的光源的数量,并且各子帧的像素位置是不相同的。在一个示例中,每个子帧所包含的每两个相邻像素之间均间插有一个或多个其他子帧的一个或多个像素。
光斑移位装置130用于在控制模块120的控制下移动光源阵列模块110的光源111所发出的光斑112的位置。控制模块120被配置为按照时序控制光斑移位装置130,以使得光源阵列模块110发出的整体光斑的位置依次对应于每个子帧。为实现光斑的位置依次对应于每个子帧,在一个示例中,控制模块120可被配置为:根据每个子帧的像素位置控制光斑移位装置130,以使得在与该子帧相对应的时刻光源阵列模块110的多个光斑112的位置与该子帧所包含的多个像素的位置一一对应。
例如,假设目标图像包括4个子帧S1-S4,将显示该帧目标图像的时间T划分成四个相等的子帧周期T1-T4,其中,在t1时刻显示子帧S1,在t2时刻显示子帧S2,在t3时刻显示子帧S3,在t4时刻显示子帧S4。如上所述,子帧S1-S4是稀疏采样的,每个子帧所包含的像素数量均等于光源阵列模块110所包含的光源111的数量,并且各个子帧S1-S4具有各不相同的像素位置。在本申请的一个实施例中,在t1时刻,控制模块120控制光斑移位装置130将光源阵列模块110发出的光斑112的位置移位为对应于子帧S1的像素的位置,即使得光斑112形成的图像光的像素位 置与子帧S1所包含的像素的位置是一致的。在本实施例中,在光斑移位装置130将光源阵列模块110发出的光斑112移位到对应于子帧S1的位置时,每个光斑112的位置均对应于子帧S1中与其相对应的像素的位置。在t2时刻,光斑移位装置130将控制模块120控制光斑移位装置130将光源阵列模块110发出的光斑112移位为对应于子帧S2的像素的位置。从显示一个子帧到显示下一子帧,光斑移位装置130将光斑112移动与两个子帧的像素间距相对应的距离。例如,假设子帧S2的每个像素相对于子帧S1的每个像素向右平移了一个像素,则控制模块120控制光斑移位装置130将光源阵列模块110发出的光斑112整体向右平移与图像光的一个像素相对应的距离。在t3和t4时刻,光斑移位装置130继续移动光斑112,使其分别与子帧S3和S4的位置相对应。由此,在时间T内,光源装置100按照时序依次发出分别对应于子帧S1-S4的光斑,由于人眼的视觉暂留现象,这四个子帧在人眼看来构成一帧完整的目标图像的再现。
在本文上面及下面所述的示例中,相邻两个子帧的相应像素之间的距离是相同的,例如,在如上所述的示例中,S2中每个像素与S1中相应像素的距离均是一个像素,这样在移动光斑时可以将所有光斑作为一个整体来移动。可以理解的是,相邻两个子帧的相应像素之间的距离也可以是不同的,在从一个子帧过渡到下一子帧时,可以为每个光斑确定要移动的距离,并控制光斑移位装置130分别对每个光斑或移动距离相同的每部分光斑进行移位。
在本文上面及下面所述的示例中,光源阵列模块110的每两个相邻光源111之间的间隔是相等的,因此它们所发出的相邻光斑之间的间隔也是相等。可以理解的是,相邻光源之间的间隔可以不同,相邻光斑之间的距离也可以不同。
图2示出了根据本申请一实施例的如何将一帧目标图像分解成多个子帧的示意图。在本申请实施例中,可以根据目标图像的像素数、光源阵列模块所包含的光源数、光源之间的间隔等因素来确定如何将目标图像分解成多个子帧。在一个示例中,假设光源阵列模块110的多个光源组成M×N阵列(M和N均大于1),发出的光斑同样是M×N阵列(如图3所示),目标图像S包含X×Y个像素(X大于M,Y大于N),那么,可以将目标图像S分解成a×b个子帧,其中,a=X/M,b=Y/N。在图2的示例中,光源阵列模块110为3×3光源阵列,目标图像包含的像素数为6×6,则可以将目标图像S分解成2×2个子帧S1-S4。
在本申请实施例中,光源阵列模块110的多个光源111排列成的阵列的密度小于目标图像的像素分布的密度,多个光源111排列成的阵列相对于目标图像的像素分布来说是稀疏点阵,即,光源111发出的多个光斑被成像后对应的不是图像的多个相邻像素,而是之间间隔有一个或多个其他像素的非相邻像素。在图2的示例中,假设每两个相邻光源111之间的间隔使得两个相邻光源111发出的光斑被成像后形成的像素之间间隔1个像素,则目标图像S分解成的四个子帧S1-S4在目标图像S中的位置如图2所示。在图2中,每个方格代表一个像素,方格中的数字表示该像素所属于的子帧编号,例如数字“1”代表子帧S1,数字“2”代表子帧S2,数字“3”代表子帧S3,数字“4”代表子帧S4。在图2的示例中,将目标图像S分解成按时间顺序显示的四个子帧S1-S4,其中,每个子帧与下一子帧间隔一个像素的距离。在t1时刻显示子帧S1后,在t2时刻,控制模块120控制光斑移位装置130将光源阵列模块110发出的光斑112整体向右平移与图像光的一个像素相对应的距离,以形成子帧S2;在t3时刻,控制模块120控制光斑移位装置130将光源阵列模块110发出的光斑112整体向下平移与图像光的一个像素相对应的距离并继续向右平移与图像光的一个像素相对应的距离,以形成子帧S3;在t4时刻,控制模块120控制光斑移 位装置130将光源阵列模块110发出的光斑112整体向右平移与图像光的一个像素相对应的距离,以形成子帧S4。在图2的示例中,以S1→S2→S3→S4的顺序来显示四个子帧,可以理解的是,也可以以其他顺序来显示四个子帧,最后得到的都是完整的目标图像的再现。在图2的示例中,子帧S1-S4的像素一起排列为密排像素。通过本申请实施例,可以有效地将稀疏阵列光源投影成高分辨率的实施方案,可以将M*N排列的稀疏光源阵列扫描成aM*bN个密排等间距光斑,如图3中所示。
在本申请实施例中,控制模块120在控制光斑移位装置130将光源阵列模块110发出的光斑112移位为与每个子帧的位置相对应时,还根据每个子帧的灰度分布控制光源阵列模块110的每个光源111的亮度,以使得在与该子帧相对应的时刻光源111的每个光斑形成该子帧的对应像素的灰度显示。例如,控制模块120可以通过调节或调制光源111的驱动电流或驱动电压来调节光源111的亮度。在本申请实施例中,图像光的每个像素与光源阵列模块110发出的每个光斑112一一对应,每个光斑112仅由一个光源发出,因此,图像光的每个像素仅与相应的一个光源相关,与其他光源无关。在一个示例中,每个光源111能够独立地被控制或被驱动,所形成的图像光的每个像素的灰阶只与对应的唯一光源有关,控制模块120可以独立地控制光源阵列模块110的每个光源111的亮度,从而控制所形成的图像的像素灰阶。
通过根据本申请实施例的光源装置,将源图像信号中的目标图像分解成稀疏采样的多个子帧(即每个子帧的至少两个相邻像素之间间插有其他子帧的至少一个像素),每个子帧的像素与光源阵列模块的光源一一对应,按照时序依次形成与每个子帧相对应的光斑,其中,在从一个子帧切换到下一子帧时,通过光斑移位装置移动光斑的位置以使其与相应的子帧的像素位置相对应。在显示一帧图像的时间中,每个光源对应的光斑经移动对应多个图像像素点。由于将整体分辨率通过包括多个光源的光源阵列来实现,每个光源可分别调制来对整体分辨率作贡献,因此,相比于单个光源对整体分辨率作贡献,本申请实施例降低了光源装置的调制带宽。另外,由于单个光源对应的光斑只需覆盖整体图像中的某个区域,本申请实施例可以有效降低光斑移位装置的控制带宽。此外,由于整体图像中的某个区域是通过单个光源移动而成,因此本申请实施例可以有效提高图像均匀性。此外,本申请实施例使用光源阵列作为光源,在该光源是激光时,该移动光斑方案也可有效减弱所形成的图像的散斑。
如上所述,在本申请的一些实施例中,每个子帧的二维灰度分布通过调节对应其时间段内的每个光源的亮度来实现,避免使用了目前效率较低的空间光调制器,因此,光源装置的效率可以大幅提升。另外,由于单个像素的亮度通过光源的亮度调节可以实现全开/全关,因此这些实施例可以实现高对比度和高动态范围。
另外,在一些实施例中,光源阵列模块的每个光源是独立可寻址的,即是独立可控的,因此,可以实现可变的光编码,从而提高成像的精度。另外,在每个光源独立可控的情况下,单个像素的灰阶可通过对相对应的单个光源的光强调制来实现,调节方法简单易行,另外,由于单个像素的亮度通过光源的亮度调节可以实现全开/全关,因此这些实施例可以实现高对比度和高动态范围。利用此方案产生的点阵或者结构光可以快速实现变换,以极高的速度生成定制图案。
图4示出了根据本申请另一实施例的光源装置100的示意结构图。在图4的实施例中,与图1的实施例不同的是,控制模块120可以包括如下三个部分:处理器121、光源驱动器122以及光斑移位控制单元123,其中:
处理器121被配置为对接收到的源图像信号进行图像处理,得到包括多个子帧的目标图像。处理器121进行的图像处理可以包括对接收到的源图像信号进行格式 转换、解码、滤波、放大等中的一种或多种,还可以包括从源图像信号中获取目标图像并根据目标图像的像素数和光源装置100的配置参数将目标图像分解成与光源装置100相匹配的多个子帧。光源装置100的配置参数可以包括光源阵列模块110的光源数量及间隔等。处理器121将分解后的子帧信号及各子帧对应的时序发送给光源驱动器122和光斑移位控制单元123。
光源驱动器122被配置为根据多个子帧的信号生成用于驱动光源阵列模块110发光的信号。在一个示例中,光源驱动器122根据每个子帧的每个像素的灰阶,为该像素相对应的光源111生成相应的驱动信号,该驱动信号使得该光源111发出的光的亮度与该像素的灰阶相一致。这样,光源驱动器122可以驱动光源111在每一子帧的时刻为该子帧生成具有相对应的亮度的光斑。在一些示例中,在子帧所需的光斑数小于光源个数的情况下,某些光源可以不发光,即,光源驱动器122不为其产生驱动信号。
光斑移位控制单元123被配置为根据多个子帧的信号生成用于控制光斑移位装置130对光斑112进行移动的信号。例如,光斑移位控制单元123在每个子帧的时刻控制光斑移位装置130将光源阵列模块110形成的各光斑移动为与该子帧的各像素位置一一相对应。
光斑移位装置130根据来自控制模块120或光斑移位控制单元123的指示来移动光源阵列模块110形成的各光斑的位置,以使得在每个子帧的时刻,移动光源阵列模块110形成的各光斑的位置与该子帧的各像素的位置一一对应。本申请上文及下文中“每个子帧的时刻”是指每个子帧按照时序被再现的时刻,即与该子帧相对应的光斑被形成的时刻,在该时刻,相对应的光斑被移动到与该子帧相对应的位置,并且各光斑的亮度与该子帧的各像素的灰阶相一致。
在一个示例中,光斑移位装置130可以通过移动光源阵列模块110的光源111的位置来改变光斑112的位置。例如,光斑移位装置130为能够沿相互垂直的第一方向和第二方向运动的二维微执行器。或者,光斑移位装置130为两个一维微执行器的组合,第一一维微执行器能够沿第一方向运动,第二一维微执行器能够沿第二方向运动。光源阵列模块110的光源111可以附着在上述微执行器上,微执行器在控制模块120或光斑移位控制单元123的指示下运动,从而带动光源111运动,从而改变光源111的位置。光源阵列模块110的光源111可以作为一个整体固定到一个二维微执行器或两个一维微执行器上,微执行器的移动可以带动光源阵列模块110整体的移动。或者,可以将光源阵列模块110分成多个部分,每个部分包括一个或多个光源111,每个部分分别固定到一个二维微执行器或两个一维微执行器上。二维微执行器可以是二维偏转台,一维微执行器可以是高频压电陶瓷执行器、压电移动平台、压电步进马达或者一维偏转台。微执行器可以是直线式运动的,也可以是偏转式的或者其他运动形式。二维微执行器在两个方向上的运动速度可以相同或不同,例如,在第一方向上的运动快于在第二方向上的运动。或者,两个一维微执行器的运动速度可以相同或不同,例如,在第一方向上的运动的一维微执行器快于在第二方向上的运动的一维微执行器。
在另一示例中,光斑移位装置130可以通过偏转光源阵列模块110发出的光束的传播方向来改变光斑112的位置。例如,光束偏转装置为MEMS扫描反射镜或者相位偏转器件。
在本申请的一个实施例中,为保障光斑位置的移动与光斑亮度的调节的一致性,控制模块120还可以包括同步单元124。同步单元124被配置为根据多个子帧控制光源驱动器122与光斑移位装置130同步,以使得在光斑移位装置130将多个光源 111的光斑112移动到与多个子帧中的每个子帧相对应的位置的同时,光源驱动器122驱动光源阵列模块110发出与该子帧的灰度分布相对应的光。同步单元124与处理器121、光源驱动器122以及光斑移位控制单元123均连接。控制模块120可以将各子帧及相应的时序发送给同步单元124。在一个示例中,同步单元124可以根据各子帧的时序来保证光斑移位控制单元123驱动光斑移位装置130与光源驱动器122驱动光源111发光同步,以使得光斑移位装置130驱动光斑移位到与每个子帧相对应的位置的同时各光源111在光源驱动器122的驱动下发光,且发出的光斑112的亮度与该子帧的各像素灰阶相一致。同步单元124可以保证光源111既不提前发光也不延迟发光,而是在光斑移位到目标位置的同时发出对应亮度的光。
在一个示例中,光源111为激光光源,光源驱动器122发出脉冲驱动信号来驱动光源111发光。在一个示例中,同步单元124被配置为控制驱动激光光源111的脉冲的时序以及光斑移位装置130的运动,以使得激光光源111随着光斑移位装置130的运动发出等间距的光斑。
在图4的实施例中,控制模块120被分为四个功能模块:处理器121、光源驱动器122、光斑移位控制单元123以及同步单元124。可以理解的是,这种划分是根据功能的逻辑划分,控制模块120也可以被划分为其他不同的逻辑功能模块,被划分成的功能模块数量可以更多或更少。
光源111可以是各种能够发光的光源装置。例如,每个光源111可以为垂直腔面发射激光器、边缘发射激光器、LED或者Micro LED等。
在上面的实施例中,光源阵列模块110的每个光源111发出的可以是单色光光斑,也可以是白光光斑。
图5示出了根据本申请又一实施例的光源装置100的示意结构图。如图5所示,该实施例与图1所示的实施例的区别在于,光源阵列模块110可以包括第一光源阵列模块110A、第二光源阵列模块110B和第三光源阵列模块110C,其中,第一光源阵列模块110A包括发出具有第一颜色的光的多个第一光源111A,第二光源阵列模块110B包括发出具有第二颜色的光的多个第二光源111B,第三光源阵列模块110C包括发出具有第三颜色的光的多个第三光源111C。例如,第一颜色、第二颜色和第三颜色可以分别是蓝色、绿色和红色。在一个示例中(如图4所示),光源装置100还可以包括合光模块140,三个光源阵列模块具有数量相等的光源,每个第一光源111A与位置相应的一个第二光源111B和一个第三光源111C发出的分别具有三种颜色的三个光斑可以通过合光模块140被合成为一个白光光斑,作为成像光。这样,由三个光源阵列模块发出的三个单色光斑阵列最终被合光模块140合成为一个混合色光斑阵列,例如白光光斑阵列。在另一示例中,光源装置100可以不具有合光模块140,每个第一光源111A与相应的一个第二光源111B和一个第三光源111C可以作为三个子像素紧挨着布置在同一位置,使得三个光源发出的光斑看起来是从同一位置发出的,且对应于成像光的同一个像素。在这种情况下,可以不使用合光模块140。
在图5所示的该实施例中,光斑移位装置130可以相应地包括用于移动第一光源阵列模块110A的光斑的第一光斑移位装置130A、用于移动第二光源阵列模块110B的光斑的第二光斑移位装置130B以及用于移动第三光源阵列模块110C的光斑的第三光斑移位装置130C。控制模块120可被配置为:根据每个子帧的像素位置依次或同时控制第一光斑移位装置130A、第二光斑移位装置130B和第三光斑移位装置130C,以使得在与该子帧相对应的时刻多个第一光源111A、第二光源111B和第三光源111C的光斑的位置与该子帧所包含的像素的位置一一对应。
目标图像的每个子帧可被分解为具有第一颜色分量的第一子帧分量、具有第二颜色分量的第二子帧分量和具有第三颜色分量的第三子帧分量,控制模块120还可被配置为:
根据第一子帧分量的灰度分布独立地控制多个第一光源111A中每个光源的亮度,以使得在与该子帧相对应的时刻多个第一光源111A的每个光斑形成第一子帧分量的灰度显示;即,在与该子帧相对应的时刻,第一光源111A的各光斑的亮度与该子帧各像素的第一颜色分量的灰阶值一一对应。
根据第二子帧分量的灰度分布独立地控制多个第二光源111B中每个光源的亮度,以使得在与该子帧相对应的时刻多个第二光源111B的每个光斑形成第二子帧分量的灰度显示;即,在与该子帧相对应的时刻,第二光源111B的各光斑的亮度与该子帧各像素的第二颜色分量的灰阶值一一对应。
根据第三子帧分量的灰度分布独立地控制多个第三光源111C中每个光源的亮度,以使得在与该子帧相对应的时刻多个第三光源111C的每个光斑形成第三子帧分量的灰度显示。即,在与该子帧相对应的时刻,第三光源111C的各光斑的亮度与该子帧各像素的第三颜色分量的灰阶值一一对应。
关于如何调节对应颜色的光源的亮度以与子帧像素的颜色分量的灰阶值相对应,方法与前面所述的调节光源亮度以与子帧像素的灰阶值相一致相同,在此不再赘述。
可以理解的是,图5实施例中的控制模块120也可以进一步包括如图4所示的处理器121、光源驱动器122以及光斑移位控制单元123,还可以包括同步单元124,在此不再赘述。
根据本申请各实施例的上述光源装置可以降低光源装置的调制带宽,有效降低光斑移位装置的控制带宽,有效提高图像均匀性,并且在光源是激光时,该移动光斑方案也可有效减弱所形成的图像的散斑。另外,在一些实施例中,对于图像中的单个像素,可以通过调节与该像素相对应的光源的亮度来实现该像素的灰阶显示,从而在每个子帧的相应时间可以通过调节各光源的亮度来实现每个子帧的二维灰度分布。
根据本申请实施例的另一方面,还提供一种成像方法,该成像方法可通过光源装置来实现,该光源装置能够将目标图像分解成稀疏采样的多个子帧,并包括多个光源,多个光源发出的各光斑与一子帧的各像素一一对应,该光源装置通过移动光斑在一帧时间内依次为每个子帧生成相对应的光斑阵列,从而得到目标图像的图像光。所述光源装置例如可以是如上所述的光源装置100的任一实施例。图6示出了根据本申请一实施例的成像方法的流程示意图。如图6所示,该示例成像方法包括步骤:
S610:对一帧目标图像进行分解,得到多个子帧。
每个子帧的至少两个相邻像素之间间插有其他子帧的至少一个像素。
例如,收到目标图像之后,光源装置的控制模块(例如图1、图4、图5中的控制模块120)对目标图像帧进行分解。例如,控制模块可以根据目标图像的像素数、光源装置的配置参数等来对目标图像进行分解。例如,如果光源装置的光源阵列模块的所包含的多个光源为M×N阵列,目标图像包含X×Y个像素,则可以将该目标图像分解成a×b个子帧,其中,X=M*a,Y=N*b,使得子帧的像素数等于光源阵列模块的光源数,子帧的每个像素与一个光源相对应。
具体的分解方法及细节可以参考如前面在光源装置的各实施例中的那些,在此不再赘述。
包含多个像素的目标图像被分解成多个稀疏采样的子帧,每个子帧的至少两个相邻像素之间间插有其他子帧的至少一个像素。光源装置根据这多个子帧的信息在步骤S620中生成相应的光斑。
S620:根据每个子帧的像素位置,按照时序通过光斑移位装置移动光源阵列模块发出的光斑的位置,使得光斑的位置依次对应于每个子帧。
在步骤S620中,光源装置根据所分解成的多个子帧的像素位置为每个子帧依次生成对应的光斑。为子帧生成对应的光斑可以指在该子帧的时刻,通过移动光斑的位置来使各光斑的位置与该子帧的各像素的位置一一对应。
其中,光源阵列模块包括多个光源,多个光源中的每个光源发出的光束形成与目标图像的一个像素相对应的光斑,在与子帧相对应的时刻多个光源形成的多个光斑的位置与该子帧所包含的多个像素的位置一一对应。各子帧是通过对目标图像稀疏采样生成的,相应地,光源阵列模块所包括的光源相对于目标图像的像素分布来说也是稀疏点阵。
在一个示例中,步骤S620可以由光源装置通过如下处理来实现:
S621:根据每个子帧的像素位置,为每个子帧生成用于控制光斑移位装置对光斑进行移动以到达与该子帧相对应的位置的移位控制信号;
S622:由光斑移位装置根据每个子帧的移位控制信号移动光斑的位置。
步骤S621可以例如由前面的光源装置实施例中的光源装置的控制模块或控制模块的光斑移位控制单元来实施。例如,可以根据每个子帧的各像素的位置确定光斑要移动到的目标位置,还可以进一步根据目标位置以及光斑的当前位置确定光斑的移动距离、移动方向和移动路线等,然后根据所确定的这些信息为每个子帧生成相应的移位控制信号。进一步地,还可以根据光斑需要移动的距离和移动方向确定光源装置的光源或光源阵列模块的移动距离、移动方向或移动路线、移动速度等,或者确定光源发出的光束需要偏转的角度和方向等,并将这些信息包括在移位控制信号中。
在步骤S622,光源装置的光斑移位装置根据移位控制信号移动光斑,以使得各光斑的位置与相应子帧的各像素的位置一一对应。光斑移位装置可以通过移动多个光源的位置来移动光斑的位置,也可以通过对多个光源发出的光束的方向进行偏转来移动光束形成的光斑的位置。
有关如何根据每个子帧的像素位置通过光斑移位依次为每个子帧生成对应的光斑,可以参考前述光源装置各实施例中的描述。
在一个示例中,为子帧生成对应的光斑还可以包括:在该子帧的时刻,在光斑被移位到与该子帧相对应的位置时,将各光斑的亮度调节为与该子帧各像素的灰阶相一致。即,示例成像方法还可以包括步骤:根据每个子帧的灰度分布控制多个光源中每个光源的亮度,以使得在与该子帧相对应的时刻多个光源的每个光斑形成该子帧的对应像素的灰度显示。该步骤可以通过如下处理来实现:
根据每个子帧的灰度分布确定在该子帧的时刻光源阵列模块中的每个光源的亮度;
根据所确定的每个光源的亮度,为每个光源生成用以驱动该光源发出所确定的亮度的光的驱动信号;
在每个子帧的时刻,由多个光源在相应驱动信号的驱动下发光,以形成与该子帧相对应的光斑。
上述的光源可以为任意发光装置,例如可以为垂直腔面发射激光器、边缘发射激光器、LED或者Micro LED等。在一个示例中,多个光源中的每个光源为脉冲驱 动的激光光源,激光光源被配置为在光斑移位装置将光斑移位到目标位置时发光。例如,可以控制驱动激光光源的脉冲的时序以及光斑移位装置的运动,以使得激光光源随着光斑移位装置的运动发出等间距的光斑。
在一个实施例中,为了获得光斑位置与光斑亮度之间的精确一致性,可以对光斑移位与光源发光进行同步。例如,上述示例成像方法还可以包括步骤:根据多个子帧控制光源驱动器与光斑移位装置同步,以使得光斑移位装置将多个光源的光斑移动到与多个子帧中的每个子帧相对应的位置时,光源驱动器驱动光源阵列模块发出与该子帧的灰度分布相对应的光。通过同步步骤,光斑的位置移动与亮度变化保持一致,从而可以在精确的像素位置提供精确亮度的光斑。
形成对应于每个子帧的光斑之后,示例成像方法进入步骤S630。
S630:对光源阵列模块发出的对应于多个子帧的光斑进行成像以得到图像光。
在步骤S630中,可以通过成像模块对光斑进行成像以得到图像光。成像模块可以是光源装置中的模块,也可以是位于光源装置之外的模块。
在上面的实施例中,每个光源发出的光可以是单色光,也可以是白光。在下面的实施例中,光源发出不同颜色的单色光。在该实施例中,光源装置的光源阵列模块包括第一光源阵列模块、第二光源阵列模块和第三光源阵列模块,第一光源阵列模块包括发出具有第一颜色的光的多个第一光源,第二光源阵列模块包括发出具有第二颜色的光的多个第二光源,第三光源阵列模块包括发出具有第三颜色的光的多个第三光源。
光斑移位装置包括用于移动第一光源阵列模块的光斑的第一光斑移位装置、用于移动第二光源阵列模块的光斑的第二光斑移位装置以及用于移动第三光源阵列模块的光斑的第三光斑移位装置。
在这种情况下,步骤S620可以包括:根据每个子帧的像素位置依次或同时控制第一光斑移位装置、第二光斑移位装置和第三光斑移位装置,以使得在与该子帧相对应的时刻多个第一光源、第二光源和第三光源的光斑的位置与该子帧所包含的像素的位置一一对应。
在该实施例中,目标图像的每个子帧可被分解为具有第一颜色分量的第一子帧分量、具有第二颜色分量的第二子帧分量和具有第三颜色分量的第三子帧分量,根据每个子帧的灰度分布控制多个光源中每个光源的亮度包括:
根据第一子帧分量的灰度分布控制多个第一光源中每个光源的亮度,以使得在与该子帧相对应的时刻多个第一光源的每个光斑形成第一子帧分量的灰度显示;即,在与该子帧相对应的时刻,各光斑的亮度与该子帧各像素的第一颜色分量的灰阶值一一对应。
根据第二子帧分量的灰度分布控制多个第二光源中每个光源的亮度,以使得在与该子帧相对应的时刻多个第二光源的每个光斑形成第二子帧分量的灰度显示;即,在与该子帧相对应的时刻,各光斑的亮度与该子帧各像素的第二颜色分量的灰阶值一一对应。
根据第三子帧分量的灰度分布控制多个第三光源中每个光源的亮度,以使得在与该子帧相对应的时刻多个第三光源的每个光斑形成第三子帧分量的灰度显示。即,在与该子帧相对应的时刻,各光斑的亮度与该子帧各像素的第三颜色分量的灰阶值一一对应。
关于如何调节对应颜色的光源的亮度以与子帧像素的颜色分量的灰阶值相对应,方法与前面所述的调节光源亮度以与子帧像素的灰阶值相一致相同,在此不再赘述。
在如上所述的光源阵列模块发出多种单色光的情况下,在成像步骤S630之前,示例成像方法还包括步骤:将多个第一光源、第二光源和第三光源的光斑进行合光。在该步骤中,对于由位置相对应的一第一光源、一第二光源和一第三光源组成的光源组,可以使用合光模块将这组光源发出的三个光斑合成为一个光斑。这样,由三个光源阵列模块发出的三个单色光斑阵列最终被合光模块合成为一个混合色光斑阵列,例如白光光斑阵列。之后在步骤S630中,对合光后的光斑进行成像以得到图像光。
有关以上步骤或处理的具体细节,可以参考前面所述的光源装置的各实施例,在此不再赘述。反过来,在成像方法各实施例中的描述也可作为前述光源装置各实施例的参考。
通过根据本申请实施例的成像方法,可以将源图像信号中的目标图像分解成稀疏采样的多个子帧(即每个子帧的至少两个相邻像素之间间插有其他子帧的至少一个像素),每个子帧的像素与光源阵列模块的光源一一对应,按照时序依次形成与每个子帧相对应的光斑,其中,在从一个子帧切换到下一子帧时,通过光斑移位装置移动光斑的位置以使其与相应的子帧的像素位置相对应。在显示一帧图像的时间中,每个光源对应的光斑经移动对应多个图像像素点。由于将整体分辨率通过包括多个光源的光源阵列来实现,每个光源可分别调制来对整体分辨率作贡献,因此,相比于单个光源对整体分辨率作贡献,本申请实施例降低了光源装置的调制带宽。另外,由于单个光源对应的光斑只需覆盖整体图像中的某个区域,本申请实施例可以有效降低光斑移位装置的控制带宽。此外,由于整体图像中的某个区域是通过单个光源移动而成,因此本申请实施例可以有效提高图像均匀性。此外,本申请实施例使用光源阵列作为光源,在该光源是激光时,该移动光斑方案也可有效减弱所形成的图像的散斑。
如上所述,在本申请的一些成像方法实施例中,每个子帧的二维灰度分布通过调节对应其时间段内的每个光源的亮度来实现,避免使用了目前效率较低的空间光调制器,因此,成像方法的效率可以大幅提升。另外,由于单个像素的亮度通过光源的亮度调节可以实现全开/全关,因此这些实施例可以实现高对比度和高动态范围。
另外,在一些成像方法实施例中,光源阵列模块的每个光源是独立可寻址的,即是独立可控的,因此,可以实现可变的光编码,从而提高成像的精度。另外,在每个光源独立可控的情况下,单个像素的灰阶可通过对相对应的单个光源的光强调制来实现,调节方法简单易行。另外,由于单个像素的亮度通过光源的亮度调节可以实现全开/全关,因此这些实施例可以实现高对比度和高动态范围。利用此方案产生的点阵或者结构光可以快速实现变换,以极高的速度生成定制图案。
上述示例光源装置和示例成像方法的各实施例可以应用于许多场合,例如,用于投影图像显示,或用于物体的3D成像。
在投影图像显示应用中,可以将在步骤S630中得到的图像光投射到屏幕上,使得目标图像再现在屏幕上。在这样的应用场合下,上述光源装置各实施例可被集成在显示装置中,该显示装置可以还包括用于对光源装置发出的光斑进行成像以得到图像光、并将图像光投射到屏幕上的成像模块。
在物体3D成像应用中,在S630中得到的图像光可以作为结构光,该示例成像方法接下来可以包括步骤:
将图像光照射到待测物体上;对被待测物体调制的图像光进行采集;对采集的调制后图像光进行处理,得到待测物体的三维信息。
在这样的应用场合下,上述光源装置各实施例可被集成在用于对待测物体进行3D成像的成像装置中,该成像装置可以还包括:
成像模块,用于基于光源装置输出的光斑形成图像光并照射到待测物体上。
采集模块,用于对被待测物体调制的图像光进行采集。
图像处理模块,用于对采集模块采集的调制后图像光进行处理,得到待测物体的三维信息。
在下文中,将对成像装置和显示装置的示例实施例分别进行详细描述。
3D成像技术除了可以对目标物体实现2D的成像,还可以获得目标在深度维度的信息,因此可以实现3D立体扫描或建模。常见的3D成像方案可以包括基于衍射光学元件(DOE,Diffractive Optical Elements)、3D结构光的扫描方案、基于微机电系统(MEMS,Micro Electronic Mechanical System)的垂直腔面发射激光器(VCSEL,Vertical Cavity Surface Emitting Laser)光源阵列系统以及基于数字光处理(DLP,Digital Light Processing)的3D结构光等。
然而对所投射的结构光的调控主要通过多个紧密排列的光源阵列、DOE以及一些空间上的处理来实现,光源并没有实现独立寻址控制,所能调控的图像个数有限,无法对图像进行动态调制,所能达到的精度和分辨率有限;使用数字微镜器件(DMD,Digital Micro Mirror Device)实现基于DLP的3D结构光方案时,DMD空间光调制器的效率较低,所需要的散热模块较大,因此整个系统复杂,体积较大,效率低。
目前使用比较多的是规则和不规则的光源阵列,或者应用多片光源阵列投射出不同稀疏程度和不同排布的光斑,通过透镜单元(如微透镜阵列或透镜组等)接收并准直光束,然后向空间投射,再通过一个或者多个DOE以不同的倍数将光源阵列发出的光束复制和放大,如图7所示的基于光源阵列的3D成像方案,以实现针对不同应用场景的结构光;也可以通过平移、旋转、镜像或缩放等一种或多种组合对多个光源阵列做处理,旨在获得颗粒整体分布均匀、但局部不相关程度高的激光散斑图像,以获得更高的精度。
基于MEMS的VCSEL光源阵列系统通过MEMS微镜振动将规则或者不规则的VCSEL发射的阵列光束反射,以点阵的形式投射到物体上,旨在通过MEMS的快速扫描,复制VCSEL点阵,实现更密集的光斑分布,提高精度,如图8所示;对所投射的结构光的调控主要通过多个紧密排列的光源阵列、DOE以及一些空间上的处理来实现,光源并没有实现独立寻址控制,所能调控的图像个数有限,无法对图像进行动态调制,所能达到的精度和分辨率有限。
对于基于DLP的3D结构光方案,当设计人员需要进行毫米到微米分辨率的快速高精度扫描时,经常选择基于DLP的结构光系统,利用DMD实现高速实时的3D扫描,但DMD空间光调制器的效率较低,所需要的散热模块较大,因此整个系统复杂,体积较大,效率低。
图9示出了根据本申请一实施例的成像装置的示意结构框图。如图9所示,成像装置900包括光源装置100、成像模块920、采集模块930和图像处理模块940。其中,光源装置100与成像模块920组成用于产生结构光的测试图产生模块910。光源装置100可以是如前面所述的各光源装置实施例。在图9的实施例中,光源装置的控制模块被划分为解码器911和光源阵列驱动模块912,光束扫描/偏转执行器913相当于前述光源装置实施例中的光斑移位装置130。
测试图产生模块910中的光源阵列模块110使用具有对每个光源进行独立控制的电极,通过驱动器实现对每个激光光源的快速单点控制。由于光源阵列模块110 的阵列光源需要独立寻址调控,阵列采用稀疏点阵的形式,排列成M*N的点阵,如图4所示。通过成像模块920的光学成像镜头,可以在屏幕上实现M*N个稀疏像素点。为显示一帧像素密排的图像,需要将一帧图像拆分成a*b个通过时分复用的方式显示的子帧,即将每个独立寻址控制的光源对应的光斑通过时分复用扩展成密排的a*b个光斑,对应一帧图像中a*b个密排的像素,恰好填充满相邻几个可独立寻址调控的光源之间的空隙。在一帧的时间内,可以显示子帧之间的切换通过微执行器实现,最后在屏幕上实现aM*bN个像素点。由于子帧之间切换的时间远大于人眼视觉暂留现象所能响应的最小时间,人眼的积分效果将多个子帧拼接成一个完整图像。上面的描述将一帧图像分成a*b个互不重叠的子帧,一帧中只重复一次a*b个子帧,重复多次a*b个子帧的原理类似,只需将微执行器调控速率加快即可,这里不再赘述。
详细的拆帧示意图如图3所示,对应着a=2,b=2的情况。t1时刻稀疏点阵光源位于位置1处,t2时刻位于位置2处,以此类推。在一帧的时间内光源依次位于位置1,2,3,4,每个光源组成不重叠的2*2的密排像素,整体形成2M*2N个像素。
视频信号源经过解码器911转换之后被传给光源阵列驱动模块912,通过控制光源在每个光斑位置的亮暗实现不同的灰阶,完成对一个子帧图像的调控。此时,图像采集模块930对图像进行采集,并传给图像处理模块940进行分析。到另外一个子帧时,光束扫描/偏转执行器913将阵列光源对应的光斑移动到其对应的位置上,同时光源阵列驱动模块912按照本子帧对应的灰度对阵列光源进行驱动,使得图像上显示对应子帧的灰度分布。图像采集模块930对图像进行采集,并再传给图像处理模块940进行分析。最后图像处理模块940对所有的显示图像进行分析对比,实现高精度的3D成像。
图10示出了根据本申请另一实施例的成像装置1000的示意结构图,其中采用可独立寻址调控的VCSEL作为光源阵列模块的阵列光源,采用微执行器1010作为光斑移位装置来振动光源阵列模块110以实现光斑移位。其中,解码器1021、VCSEL驱动器1022、微执行器驱动器1023以及同步装置1024分别相当于如前的组成控制模块120的处理器121、光源驱动器122、光斑移位控制器123和同步单元124。
视频源通过解码器1021解码处理之后,被传输给VCSEL驱动器1022以及微执行器驱动器1023,并由同步装置1024保证二者同步。将光源阵列模块110的VCSEL光源安装在微执行器1010上。微执行器1010可以是一个二维微执行器,或者可以是两个一维微执行器,两个一维微执行器分别控制两个相互垂直的方向,使得VCSEL有两个方向的振动。这二维振动方向可以一个是快频率,一个慢频率。其中,慢频率方向采用步进的方式振动。微执行器1010可以是直线式移动执行器,也可以是旋转式执行器。用脉冲驱动激光光源VCSEL,使其在微执行器1010移动到所需光斑位置时发光。例如,VCSEL单个光源直径为15微米,每个光源在x和y方向的间距均为150微米,在x方向有200个光源,在y方向有100个光源,整个VCSEL光源阵列长约30mm,宽约15mm。则当x方向的振动频率为600Hz,y方向的振动频率为60Hz时,可以实现2k的分辨率和60Hz的刷新率。其中,在两个一维微执行器的情况下,x方向的一维微执行器可以为高频压电陶瓷执行器,y方向的一维微执行器可以为但不限于压电移动平台、压电步进马达或者一维偏转台。在一个二维微执行器的情况下,二维微执行器可以使用高频率二维偏转台同时实现两个方向的偏转。可以控制激光光源的脉冲时序来配合微执行器1010的位移曲线,使得VCSEL投射出等间距的光斑。例如,当移动曲线为正弦波时,通过调制脉冲时序,可以实现等间距地输出,如图11所示。到一个子帧时,微执行器1010将阵 列光源对应的光斑移动到其对应的位置上,同时VCSEL驱动器1022按照本子帧对应的灰度对阵列光源进行驱动,使得图像上显示对应子帧的灰度分布。所获得的密排像素点经过成像模块920进行光学放大,最终投射到待测物体上。采集模块930采集经过物体调制后的光,将信号传输给图像处理模块940,图像处理模块940对信号进行计算之后获得待测物体的三维信息。
本实施方案通过稀疏点阵光源降低了两个维度的微执行器的振动带宽,系统简单,体积小,分辨率高,不需要额外的空间光调制器就可以实现对图像的调制,实现了高精度的3D成像。
图12示出了根据本申请另一实施例的成像装置1200的示意结构图,其中,采用Micro LED作为光源阵列模块的稀疏阵列光源,利用MEMS扫描反射镜或者相位偏转器件来实现光束扫描/光斑移位。其中,解码器1221、LED驱动器1222、扫描装置驱动器1223以及同步装置1224分别相当于如前的组成控制模块120的处理器121、光源驱动器122、光斑移位控制器123和同步单元124。
如图12所示,视频源通过解码器1221之后,信号被传输给LED驱动器1222以及扫描装置驱动器1223,并通过同步装置1224保证二者同步。作为光斑移位装置的相位偏转器/MEMS反射镜1230的功能为实现光束偏转。相位偏转器利用光的衍射原理,通过调制光的相位实现主光级的偏转,典型的器件如声光偏转器和液晶。MEMS采用压电陶瓷作为驱动源,可以实现二维的快速翻转,利用光的反射原理实现光束偏转。
例如,LED光源阵列1210的Micro LED单个光源直径为15微米,每个光源在x和y方向的间距均为150微米,在x方向有200个光源,在y方向有100个光源,整个Micro LED光源阵列长约30mm,宽约15mm。则当x方向的扫描频率为600Hz,y方向的扫描频率为60Hz时,可以实现2k的分辨率和60Hz的刷新率。当利用声光偏转器作为光束偏转装置时,由于声光偏转器的响应时间在ns级别,不需要对光源进行脉冲驱动也可实现密排的像素点排布。到一个子帧时,相位偏转器/MEMS反射镜1230在扫描装置驱动器1223的驱动下将LED光源阵列1210的光斑移动到该子帧对应的位置上,同时LED驱动器1222按照本子帧对应的灰度对LED光源阵列1210进行驱动,使得图像上显示对应子帧的灰度分布。所获得的密排像素点经过成像模块920进行光学放大,最终投射到待测物体上。采集模块930采集经过物体调制后的光,将信号传输给图像处理模块940,图像处理模块940对信号进行计算之后获得物体的三维信息。
本实施方案利用稀疏点阵光源,系统简单,体积小,分辨率高,不需要额外的空间光调制器就可以实现对图像的调制,实现了高精度的3D成像。
图13示出了根据本申请一实施例的显示装置的示意结构图。如图13所示,该示例显示装置1300由光源阵列模块1310、解码器1321、光束扫描/偏转执行器1330、光源阵列驱动器1322、合光模块1340、成像模块1350组成。其中,解码器1321与光源阵列驱动器1322组成如前所述的光源装置各实施例中的控制模块120,光束扫描/偏转执行器1330相当于如前所述的光源装置各实施例中的光斑移位装置130,光源阵列模块1310、解码器1321、光束扫描/偏转执行器1330、光源阵列驱动器1322组成相当于如前所述的光源装置各实施例的光源装置模块。
如图13所示,光源阵列模块1310的阵列光源使用具有对每个光源的独立控制的电极,通过光源阵列驱动器1322实现对每个激光光源的快速单点控制。由于阵列光源需要独立寻址调控,光源阵列模块1310的阵列光源采用稀疏点阵的形式,排列成M*N的点阵,如图4所示。通过成像模块1350的光学成像镜头,可以在屏幕上 实现M*N个稀疏像素点。为显示一帧像素密排的图像,需要将一帧图像拆分成a*b个通过时分复用方式显示的子帧,即将每个独立寻址控制的光源对应的光斑通过时分复用扩展成密排的a*b个光斑,对应一帧图像中a*b个密排的像素,恰好填充满相邻几个可独立寻址调控光源之间的空隙。在一帧的时间内,可以显示子帧之间的切换通过光束扫描/偏转执行器1330实现,最后在屏幕上实现aM*bN个像素点。由于子帧之间切换的时间远大于人眼视觉暂留现象所能响应的最小时间,人眼的积分效果将多个子帧拼接成一个完整图像。上面的描述将一帧图像分成a*b个互不重叠的子帧,一帧中只重复一次a*b个子帧,重复多次a*b个子帧的原理类似,只需将微执行器调控速率加快即可,这里不再赘述。需要指出的是,同一个可独立控制的光源对应的a*b个光斑也可以不是密排,而是中间有交叠或者有间隙,具体方案可根据实际成像需求而定。
详细的拆帧示意图如图3所示,对应着a=2,b=2的情况。t1时刻稀疏点阵光源位于位置1处,t2时刻位于位置2处,以此类推。在一帧的时间内光源依次位于位置1,2,3,4,每个光源组成不重叠的2*2的密排像素,整体形成2M*2N个像素。图17示出了与图2所示的拆帧方法相对应的针对一幅示例图像的拆帧示意图。
视频信号源经过解码器1321转换之后,被传给光源阵列驱动器1322,通过控制光源在每个光斑位置的亮暗实现不同的灰阶,完成对一个子帧图像的调控。到另外一个子帧时,光束扫描/偏转执行器1330将阵列光源对应的光斑移动到该子帧对应的位置上,同时光源阵列驱动器1322按照本子帧对应的灰度对阵列光源进行驱动,使得图像上显示对应子帧的灰度分布。在本实施例中,光源阵列模块1310包括分别发出三种不同颜色光(例如G、R、B三种颜色的光)的三种光源。通过使用合光模块1340对诸如G、R、B的三种颜色的光进行合光,经过成像模块1350,在屏幕上实现彩色图像。
图14示出了根据本申请另一实施例的显示装置1400的示意结构图,其中,采用可独立寻址调控的VCSEL作为光源阵列模块的阵列光源,采用微执行器作为光斑移位装置来振动光源。其中,解码器1421、VCSEL驱动器1422、微执行器驱动器1423以及同步装置1424分别相当于如前所述的组成控制模块120的处理器121、光源驱动器122、光斑移位控制器123和同步单元124。
在图14的实施例中,光源阵列模块包括发出B(蓝)光的第一光源阵列模块1410A、发出R(红)光的第二光源阵列模块1410B和发出G(绿)光的第三光源阵列模块1410C,它们分别位于不同的位置。三个光源阵列模块具有数量相等的光源。第一光源阵列模块1410A的每个光源与第二光源阵列模块1410B中位置相应的一个光源和第三光源阵列模块1410C中位置相应的一个光源发出的分别具有三种颜色的三个光斑可以通过合光模块1440被合成为一个白光光斑。这样,由三个光源阵列模块发出的三个单色光斑阵列最终被合光模块1440合成为一个混合色光斑阵列,例如白光光斑阵列。
在图14所示的该实施例中,作为光斑移位装置的微执行器也可以相应地包括用于移动第一光源阵列模块1410A的光斑的第一微执行器1430A、用于移动第二光源阵列模块1410B的光斑的第二微执行器1430B以及用于移动第三光源阵列模块1410C的光斑的第三微执行器1430C。
视频源经过解码器1421解码之后,被传输给VCSEL驱动器1422以及微执行器驱动器1423,并通过同步装置1424来保证二者同步。将每个光源阵列模块1410A、光源阵列模块1410B或光源阵列模块1410C的VCSEL安装在一个二维微执行器或者两个一维微执行器上,两个一维微执行器分别控制两个相互垂直的方向,使得 VCSEL有两个方向的振动,整体方案如图14所示。这两个维度的振动可以一个是快频率,一个是慢频率。慢频率方向采用步进的方式振动。微执行器可以是直线式移动执行器,也可以是偏转执行器。可以用脉冲驱动激光光源,使其在微执行器移动到所需光斑位置时发光。例如,VCSEL单个光源直径为15微米,每个光源在x和y方向的间距均为150微米,在x方向有200个光源,在y方向有100个光源,整个VCSEL光源阵列长约30mm,宽约15mm。则当x方向的振动频率为600Hz,y方向的振动频率为60Hz时,可以实现2k的分辨率和60Hz的刷新率。其中,x方向的微执行器可以为高频压电陶瓷执行器,y方向的微执行器可以为压电移动平台、压电步进马达或者一维偏转台。在二维微执行器的情况下,可以选择用一个高频率二维偏转台同时实现两个方向的偏转。可以控制激光光源的脉冲时序以配合微执行器的位移曲线,从而投射出等间距的光斑。例如,当移动曲线为正弦波时,通过调制脉冲时序,可以实现等间距地输出,如图11所示。每到下一个子帧时,微执行器将阵列光源对应的光斑移动到该子帧对应的位置上,同时VCSEL驱动器1422按照本子帧对应的灰度对每个光源阵列模块的阵列光源进行驱动,其响应时间在ns级,可以使得图像上显示对应子帧的灰度分布。在一个示例中,VCSEL驱动器1422按照本子帧的不同颜色分量对应的灰度分别对发出对应颜色光的光源阵列模块进行驱动。三个光源阵列模块所发出的不同颜色的光斑对应本子帧的不同颜色分量的灰度。对于每个颜色分量,多个子帧的稀疏阵列光斑在一帧时间内通过时分复用获得密排像素点。
所获得的密排像素点经过合光模块1440进行RGB三色合光,再通过成像模块1450进行光学放大,最终投射到屏幕上,实现彩色成像。RGB三色光源需要实现像素级对准,并且要求时间移动上同步。
本实施方案通过稀疏点阵光源,降低了两个维度的微执行器的振动带宽,通过对光源的直接驱动实现灰度,不需要额外的空间光调制器,系统简单,体积小,效率高,分辨率高,同时能够实现高动态对比度。由于采用的光源数量多,能够有效降低激光的散斑效应。
图15示出了根据本申请又一实施例的显示装置的示意结构图,其中,采用三色Micro LED作为光源阵列模块的稀疏阵列光源,利用MEMS扫描反射镜或者相位偏转器件作为光斑移位装置来实现光束扫描/光斑移位。其中,解码器1521、LED驱动器1522、扫描装置驱动器1523以及同步装置1524分别相当于如前的组成控制模块120的处理器121、光源驱动器122、光斑移位控制器123和同步单元124。
视频源经过解码器1521解码之后,被传输给LED驱动器1522以及扫描装置驱动器1523,并通过同步装置1524保证二者同步。整体方案如图15所示。作为光斑移位装置的相位偏转器/MEMS反射镜1530的功能为实现光束偏转,从而实现光斑移位。相位偏转器利用光的衍射原理,通过调制光的相位实现主光级的偏转,典型的器件如声光偏转器和液晶。MEMS采用压电陶瓷作为驱动源,可以实现二维的快速翻转,利用光的反射原理实现光束偏转。
一颗Micro LED单个光源的直径约为15微米。在本实施例中,LED光源阵列1510的每个光源是由分别发出R、G、B光的三颗Micro LED光源放置一起组成的组合光源。图16示出了根据本申请一实施例的Micro LED组合光源的示意图,分别发出R、G、B光的三个Micro LED光源放置为靠在一起,呈三角形排列。该组合光源的直径约40微米。
假设每个组合光源在x和y方向的间距均为400微米,在x方向有200个光源,在y方向有100个光源,整个Micro LED光源阵列长约80mm,宽约40mm。则当x 方向的扫描频率为600Hz,y方向的扫描频率为60Hz时,可以实现2k的分辨率和60Hz的刷新率。当利用声光偏转器作为光束偏转装置时,由于声光偏转器的响应时间在ns级别,不需要对光源进行脉冲驱动也可实现密排的像素点排布。LED驱动器1522的响应时间在ns级别。通过按照子帧对应的灰度对阵列光源进行驱动,使得图像上显示对应子帧的灰度分布。所获得的密排像素点经过成像模块1540进行光学放大,最终投射到屏幕上,得到彩色的图像。
本实施方案通过稀疏点阵光源,降低了光源的控制带宽和微执行器的振动频率,通过对光源的直接驱动实现灰度,不需要额外的空间光调制器。由于将GRB三个光源组合成一个组合光源,不需要合光装置,也不需要考虑三色光源的同步精度。系统简单,体积小,效率高,分辨率高,同时能够实现高动态对比度。
以上仅为本申请的实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。

Claims (24)

  1. 一种光源装置,其特征在于,包括光源阵列模块、控制模块和光斑移位装置,其中:
    所述光源阵列模块包括以阵列的形式排列的多个光源,其中,所述多个光源中的每个光源发出的光束形成与一帧目标图像的一个像素相对应的光斑,所述目标图像包括多个像素且由多个子帧组成,其中,所述多个子帧中每个子帧所包含的像素是所述多个像素中的一部分,并且所述多个子帧所包含的像素共同组成所述多个像素;
    所述光斑移位装置用于在所述控制模块的控制下移动所述多个光源的光斑的位置;
    所述控制模块被配置为按照时序控制所述光斑移位装置以使得所述多个光源的光斑的位置依次对应于每个子帧,其中,所述控制模块被配置为:根据所述每个子帧的像素位置控制所述光斑移位装置,以使得在与该子帧相对应的时刻所述多个光源的光斑的位置与该子帧所包含的像素的位置一一对应,其中,每个子帧的至少两个相邻像素之间间插有其他子帧的至少一个像素。
  2. 根据权利要求1所述的光源装置,其特征在于,所述多个光源排列成的阵列的密度小于所述目标图像的像素分布的密度。
  3. 根据权利要求1或2所述的光源装置,其特征在于,所述控制模块还被配置为根据每个子帧的灰度分布控制所述多个光源中每个光源的亮度,以使得在与该子帧相对应的时刻所述多个光源的每个光斑形成该子帧的对应像素的灰度显示。
  4. 根据权利要求3所述的光源装置,其特征在于,所述多个光源中的每个光源被独立地控制,所述控制模块被配置为根据每个子帧的灰度分布独立地控制所述多个光源中每个光源的亮度。
  5. 根据权利要求1所述的光源装置,其特征在于,所述光源阵列模块的所述多个光源为M×N阵列,所述目标图像包含X×Y个像素,所述目标图像包含的子帧数量为a×b,其中,X=M*a,Y=N*b。
  6. 根据权利要求1所述的光源装置,其特征在于,所述多个子帧包括第一子帧,其中,第一子帧的每两个相邻像素之间均间插有一个或多个其他子帧的一个或多个像素。
  7. 根据权利要求1所述的光源装置,其特征在于,所述控制模块包括:处理器、光源驱动器以及光斑移位控制单元,其中:
    所述处理器被配置为对接收到的源图像信号进行图像处理,得到包括所述多个子帧的所述目标图像;
    所述光源驱动器被配置为根据所述多个子帧生成用于驱动所述光源阵列模块发光的信号;以及
    所述光斑移位控制单元被配置为根据所述多个子帧生成用于控制所述光斑移位装置对所述光斑进行移动的信号。
  8. 根据权利要求7所述的光源装置,其特征在于,所述控制模块还包括同步单元,所述同步单元被配置为根据所述多个子帧控制所述光源驱动器与所述光斑移位装置同步,以使得所述光斑移位装置将所述多个光源的光斑移动到与所述多个子帧中的每个子帧相对应的位置时,所述光源驱动器驱动所述光源阵列模块发出与该子帧的灰度分布相对应的光。
  9. 根据权利要求8所述的光源装置,其特征在于,所述多个光源中的每个光源为脉冲驱动的激光光源,所述激光光源被配置为在所述光斑移位装置将光斑移位到目标位置时发光,其中,所述同步单元被配置为控制驱动所述激光光源的脉冲的时序以及所述光斑移位装置的运动,以使得所述激光光源随着光斑移位装置的运动发出等间距的光斑。
  10. 根据权利要求9所述的光源装置,其特征在于,所述光束偏转装置为MEMS扫描反射镜或者相位偏转器件。
  11. 根据权利要求1所述的光源装置,其特征在于,所述光斑移位装置为光源移位装置,所述光源移位装置用于移动所述多个光源的位置。
  12. 根据权利要求11所述的光源装置,其特征在于,所述光源移位装置为沿相互垂直的第一方向和第二方向运动的二维微执行器,或沿第一方向运动的第一一维微执行器和沿第二方向运动的第二一维微执行器。
  13. 根据权利要求12所述的光源装置,其特征在于,所述二维微执行器在第一方向上的运动快于在第二方向上的运动,或者所述第一一维微执行器的运动快于第二一维微执行器的运动。
  14. 根据权利要求12所述的光源装置,其特征在于,
    所述二维微执行器为二维偏转台;所述第一一维微执行器为高频压电陶瓷执行器,第二一维微执行器为压电移动平台、压电步进马达或者一维偏转台。
  15. 根据权利要求1所述的光源装置,其特征在于,所述光斑移位装置为光束偏转装置,所述光束偏转装置用于对所述多个光源发出的光束的方向进行偏转,以移动所述光束形成的光斑的位置。
  16. 根据权利要求1所述的光源装置,其特征在于,所述多个光源中的每个光源为脉冲驱动的激光光源,所述激光光源被配置为在所述光斑移位装置将光斑移位到目标位置时发光。
  17. 根据权利要求1所述的光源装置,其特征在于,所述多个光源中的每个光源为垂直腔面发射激光器、边缘发射激光器、LED或者Micro LED。
  18. 根据权利要求1所述的光源装置,其特征在于,
    所述光源阵列模块包括第一光源阵列模块、第二光源阵列模块和第三光源阵列模块,第一光源阵列模块包括发出具有第一颜色的光的多个第一光源,第二光源阵列模块包括发出具有第二颜色的光的多个第二光源,第三光源阵列模块包括发出具有第三颜色的光的多个第三光源;
    所述光斑移位装置包括用于移动第一光源阵列模块的光斑的第一光斑移位装置、用于移动第二光源阵列模块的光斑的第二光斑移位装置以及用于移动第三光源阵列模块的光斑的第三光斑移位装置;
    所述控制模块被配置为:根据所述每个子帧的像素位置依次或同时控制所述第一光斑移位装置、第二光斑移位装置和第三光斑移位装置,以使得在与该子帧相对应的时刻所述多个第一光源、第二光源和第三光源的光斑的位置与该子帧所包含的像素的位置一一对应。
  19. 根据权利要求18所述的光源装置,其特征在于,所述目标图像的每个子帧被分解为具有第一颜色分量的第一子帧分量、具有第二颜色分量的第二子帧分量和具有第三颜色分量的第三子帧分量,所述控制模块还被配置为:
    根据第一子帧分量的灰度分布独立地控制所述多个第一光源中每个光源的亮度,以使得在与该子帧相对应的时刻所述多个第一光源的每个光斑形成所述第一子帧分量的灰度显示;
    根据第二子帧分量的灰度分布独立地控制所述多个第二光源中每个光源的亮度,以使得在与该子帧相对应的时刻所述多个第二光源的每个光斑形成所述第二子帧分量的灰度显示;
    根据第三子帧分量的灰度分布独立地控制所述多个第三光源中每个光源的亮度,以使得在与该子帧相对应的时刻所述多个第三光源的每个光斑形成所述第三子帧分量的 灰度显示。
  20. 根据权利要求19所述的光源装置,其特征在于,所述光源装置还包括:
    合光模块,用于将所述多个第一光源、所述多个第二光源和所述多个第三光源的光斑进行合光。
  21. 一种成像装置,其特征在于,包括权利要求1-20中任一项所述的光源装置。
  22. 根据权利要求21所述的成像装置,其特征在于,所述成像装置还包括成像模块、采集模块和图像处理模块,其中:
    所述成像模块用于基于所述光源装置输出的光斑形成图像光并照射到待测物体上;
    所述采集模块用于对被所述待测物体调制的图像光进行采集;
    所述图像处理模块用于对所述采集模块采集的调制后图像光进行处理,得到所述待测物体的三维信息。
  23. 一种显示装置,其特征在于,包括权利要求1-20中任一项所述的光源装置。
  24. 根据权利要求23所述的显示装置,其特征在于,还包括成像模块,用于对所述光源装置发出的光斑进行成像以得到图像光,并将所述图像光投射到屏幕上。
PCT/CN2021/106722 2020-07-21 2021-07-16 光源装置、成像装置及显示装置 WO2022017272A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010705924.7 2020-07-21
CN202010705924.7A CN113960865A (zh) 2020-07-21 2020-07-21 光源装置、成像装置及显示装置

Publications (1)

Publication Number Publication Date
WO2022017272A1 true WO2022017272A1 (zh) 2022-01-27

Family

ID=79459833

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/106722 WO2022017272A1 (zh) 2020-07-21 2021-07-16 光源装置、成像装置及显示装置

Country Status (2)

Country Link
CN (1) CN113960865A (zh)
WO (1) WO2022017272A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115789577A (zh) * 2023-01-09 2023-03-14 深圳新视智科技术有限公司 一种高均匀高亮散射光源及其制备方法

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114740625B (zh) * 2022-04-28 2023-08-01 珠海莫界科技有限公司 一种光机、光机的控制方法及ar近眼显示装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1645469A (zh) * 2004-01-20 2005-07-27 惠普开发有限公司 具有顺序制彩色和摆动装置的显示系统
WO2007102752A2 (ru) * 2006-03-02 2007-09-13 Deryagin Grigory Ivanovich Способ формирования изображения на светодиодном экране
CN102759795A (zh) * 2011-04-29 2012-10-31 上海数字电视国家工程研究中心有限公司 光束并行扫描成像的图像显示系统及方法
CN103839743A (zh) * 2012-11-27 2014-06-04 Fei公司 采样样本和显示获得的信息的方法
CN106094409A (zh) * 2016-08-19 2016-11-09 广景视睿科技(深圳)有限公司 一种投影装置
CN110209000A (zh) * 2019-05-30 2019-09-06 上海天马微电子有限公司 一种显示面板、显示方法及显示装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1645469A (zh) * 2004-01-20 2005-07-27 惠普开发有限公司 具有顺序制彩色和摆动装置的显示系统
WO2007102752A2 (ru) * 2006-03-02 2007-09-13 Deryagin Grigory Ivanovich Способ формирования изображения на светодиодном экране
CN102759795A (zh) * 2011-04-29 2012-10-31 上海数字电视国家工程研究中心有限公司 光束并行扫描成像的图像显示系统及方法
CN103839743A (zh) * 2012-11-27 2014-06-04 Fei公司 采样样本和显示获得的信息的方法
CN106094409A (zh) * 2016-08-19 2016-11-09 广景视睿科技(深圳)有限公司 一种投影装置
CN110209000A (zh) * 2019-05-30 2019-09-06 上海天马微电子有限公司 一种显示面板、显示方法及显示装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115789577A (zh) * 2023-01-09 2023-03-14 深圳新视智科技术有限公司 一种高均匀高亮散射光源及其制备方法

Also Published As

Publication number Publication date
CN113960865A (zh) 2022-01-21

Similar Documents

Publication Publication Date Title
JP7226700B2 (ja) 複数レーザ光源
WO2022017272A1 (zh) 光源装置、成像装置及显示装置
WO2022017273A1 (zh) 成像方法
US6972737B2 (en) Image display apparatus
JP5011919B2 (ja) 照明装置及びプロジェクタ
US10070106B2 (en) Optical system designs for generation of light fields using spatial light modulators
US9703182B2 (en) Projection apparatus
KR20130143599A (ko) 화상 표시 장치
CN108459455A (zh) 一种投影显示系统
KR20010031147A (ko) 디스플레이용 동영상 제조 시스템
JP2009048116A (ja) 空間像表示装置
CN212181159U (zh) 一种光束偏移装置、扫描装置及显示装置
WO2009045513A1 (en) Projection apparatus and image projection changeover method
JP2002162599A (ja) 立体画像表示装置
JP2008015064A (ja) 照明装置及びプロジェクタ
JP2002372701A (ja) 画像表示装置
WO2021197356A1 (zh) 一种光束偏移装置、扫描方法、扫描装置及显示装置
US20080144139A1 (en) Scanning display apparatus and method for controlling output time of light sources
WO2022017268A1 (zh) 显示装置
US20040145708A1 (en) Infrared projector
JP4077139B2 (ja) 画像表示装置
US11425348B2 (en) Optical display device and method of operating an optical display device
JP4430647B2 (ja) 画像表示装置
KR100905556B1 (ko) 1판넬 디스플레이 시스템의 광원 출력 제어 장치
US20070052619A1 (en) Color display apparatus using two panels

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21845236

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21845236

Country of ref document: EP

Kind code of ref document: A1