WO2022017273A1

WO2022017273A1 - Imaging method

Info

Publication number: WO2022017273A1
Application number: PCT/CN2021/106737
Authority: WO
Inventors: 胡飞; 陈晨; 陈彦哲; 李屹
Original assignee: 深圳光峰科技股份有限公司
Priority date: 2020-07-21
Filing date: 2021-07-16
Publication date: 2022-01-27
Also published as: CN113965736A

Abstract

Disclosed is an imaging method, comprising: splitting one frame target image to obtain a plurality of subframes, at least one pixel of other subframes being inserted between at least two adjacent pixels of each subframe; according to the positions of pixels of each subframe, moving, by a light spot shifting device according to the time sequence, the position of light spots emitted by a light source array module, so that the position of each light spot sequentially corresponds to that of each subframe; and imaging the light spots emitted by the light source array module and corresponding to a plurality of subframes to obtain an image light, wherein the light source array module comprises a plurality of light sources; a beam emitted by each of the plurality of light sources forms a light spot corresponding to one pixel of a target image; at the moment corresponding to the subframe, the positions of the plurality of light spots formed by the plurality of light sources have one-to-one correspondence to the positions of a plurality of pixels comprised by the subframe. By means of the approach, the present application can increase the resolution and the efficiency.

Description

imaging method

technical field

The present application relates to the technical field of optical information processing, and in particular, to an imaging method.

Background technique

In technologies such as 3D imaging of objects, projection display, etc., it is usually necessary to use an imaging system including a light source, spatial light modulator, projection lens, etc. to form image light according to the source image to reproduce the source image, which is referred to as imaging technology herein. Common imaging technical solutions include spatial light modulator-based imaging solutions, beam scanning-based imaging solutions, and the like.

Existing imaging solutions based on spatial light modulators generally include solutions based on DMD (Digital Micro mirror device, digital micro mirror device), solutions based on LCD (Liquid Crystal Display, liquid crystal display), and solutions based on LCOS (Liquid Crystal on Silicon, liquid crystal on silicon).

DMD-based solution: Digital Light Processing (DLP, Digital Light Processing) display technology images are generated by DMD. DMD is a spatial light modulator, which is a matrix composed of micro-mirrors (precise, miniature mirrors) arranged on a semiconductor chip, wherein each micro-mirror controls a pixel in the projection screen, and the number of micro-mirrors Matches the resolution of the projected screen. The light source is projected on the DMD, and the micro-lens can be quickly flipped under the drive of the digital signal, there are on (on) and off (off) states, the lens only receives the light in the on state, and different grayscales are obtained by controlling the switch state. , and then obtain a color image.

LCD-based solution: LCD liquid crystal display places a liquid crystal cell in two parallel glass substrates, a TFT (thin film transistor) is arranged on the glass of the lower substrate, and a color filter is arranged on the glass of the upper substrate, and the signal and voltage on the TFT are changed. Control the rotation direction of the liquid crystal molecules, so as to achieve the control of the polarized light output state of each pixel point to obtain gray scale and realize color imaging. The principle is to use the birefringence of liquid crystal molecules, through a certain arrangement of liquid crystal molecules (commonly nematic), under the action of different current and electric fields, the liquid crystal molecules will regularly rotate 90 degrees, and the incident polarized light will be affected. The difference in transmittance is generated, and the conversion between on and off states is realized to achieve the purpose of imaging.

LCOS-based solution: LCOS belongs to a new type of reflective Micro LCD (micro LCD) projection technology. Its structure is to use a semiconductor process to make a drive panel (also known as CMOS-LCD) on a silicon wafer, and then plated on the transistor. Aluminum is used as a mirror to form a CMOS substrate, and then the CMOS substrate is bonded to an upper glass substrate containing a transparent electrode, and then liquid crystal is injected. The basic principle is similar to that of LCD, both of which are based on the birefringence principle of liquid crystal molecules. When the voltage of the aluminum electrode on the silicon substrate changes, the voltage of the liquid crystal changes, the liquid crystal molecules are deflected, and the on and off states of the incident polarized light are modulated to generate an image.

Existing imaging solutions based on spatial light modulators such as DMD, LCD or LCOS all use the spatial light modulator to modulate the light intensity of image light, thereby realizing the display of different gray scales and colors. The energy utilization efficiency of the spatial light modulator is very low. For example, the off light of the DMD cannot be used. The LCD or LCOS modulates the polarization state distribution of the transmitted light through the deflection of the liquid crystal molecules, and the excess light is absorbed by the polarizer. These spatial light modulators have large energy loss, so they also need to be equipped with a strong heat dissipation system. The light source device, imaging device or display device based on the spatial light modulator has a large overall volume and low energy efficiency. In addition, due to the limitation of heat dissipation of the spatial light modulator device itself, it cannot carry a high energy density, so it is difficult to obtain a very high brightness display. Due to the limitation of the spatial light modulator itself, such as the leakage of the off light of the DMD, the conversion of the polarization state of the light beam by the liquid crystal molecules, and the polarizer have a certain conversion efficiency, it is difficult to obtain high dynamic contrast for the obtained image.

The imaging scheme based on beam scanning generally uses a laser as the light source, modulates the light source through a light modulator, and realizes display imaging through a two-dimensional scanner, an optical color combination system and a projection objective lens. The source image signal is loaded on the light modulator to control the intensity of the light beam; at the same time, the line and field signals are synchronized to the light deflector, so that the light beam is projected onto the screen or other targets with a modulated intensity according to a certain rule to form a color image.

Existing beam scanning imaging schemes mainly use laser as the main light source, and use a light modulator to modulate the light intensity of the beam. Common light modulators include electro-optic modulation and acousto-optic modulation. The three-color laser passes through the modulator loaded with the video signal and becomes a laser beam with different light intensities with the video signal, and then passes through the color combination system of the optical film to synthesize a beam. Then enter the X-Y scanning system. The scanning system is generally realized by a combination of a rotating mirror and a small-angle galvanometer, or a double rotating mirror system and a double galvanometer.

The beam scanning imaging scheme uses a light modulator, and the power consumption and volume of the system are relatively large; due to the small number of laser light sources used, the control bandwidth of the modulator and scanning equipment is required to be large, the resolution of the image is low, and the obtained field of view The angle is small, and there is a strong speckle effect.

SUMMARY OF THE INVENTION

Embodiments of the present application provide an imaging method, the method comprising:

Decomposing a frame of target image to obtain a plurality of subframes, wherein at least one pixel of other subframes is inserted between at least two adjacent pixels of each subframe;

According to the pixel position of each subframe, move the position of the light spot emitted by the light source array module according to the time sequence through the light spot shifting device, so that the position of the light spot corresponds to each subframe in turn;

imaging the light spots corresponding to the plurality of subframes emitted by the light source array module to obtain image light,

Wherein, the light source array module includes a plurality of light sources, and the light beam emitted by each light source in the plurality of light sources forms a light spot corresponding to one pixel of the target image. The positions of the plurality of light spots formed by the plurality of light sources correspond one-to-one with the positions of the plurality of pixels included in the subframe.

Through the various embodiments of the imaging method as described above, the beneficial effects of the present application are:

By decomposing the target image in the source image signal into a plurality of sparsely sampled subframes, a light spot corresponding to each subframe is sequentially formed according to the time sequence, wherein when switching from one subframe to the next subframe, the light spot is shifted by The device moves the position of the light spot to correspond to the pixel position of the corresponding sub-frame, so that in the time of displaying one frame of image, the light spot corresponding to each light source is moved to correspond to a plurality of image pixels. Since the overall resolution is achieved by a light source array including a plurality of light sources, each light source can be modulated separately to contribute to the overall resolution. Therefore, compared with the contribution of a single light source to the overall resolution, the embodiment of the present application reduces the The modulation bandwidth of the light source device. In addition, since the light spot corresponding to a single light source only needs to cover a certain area in the overall image, the embodiment of the present application can effectively reduce the control bandwidth of the light spot shifting device. In addition, since a certain area in the overall image is moved by a single light source, the embodiments of the present application can effectively improve the uniformity of the image. In addition, the embodiments of the present application use a light source array as the light source, and when the light source is a laser, the moving light spot scheme can also effectively reduce the speckle of the formed image.

In addition, in some embodiments of the present application, the two-dimensional grayscale distribution of each sub-frame is achieved by adjusting the brightness of each light source in the corresponding time period, avoiding the use of the current low-efficiency spatial light modulator. Therefore, , the efficiency of the imaging method can be greatly improved. In addition, since the brightness of a single pixel can be fully on/off by adjusting the brightness of the light source, these embodiments can achieve high contrast ratio and high dynamic range.

In addition, in some embodiments, each light source of the light source array module is independently addressable, that is, independently controllable, therefore, variable light encoding can be implemented, thereby improving imaging accuracy. In addition, under the condition that each light source is independently controllable, the gray scale of a single pixel can be realized by modulating the light intensity of the corresponding single light source, and the adjustment method is simple and easy. Adjustment can achieve full on/off, so these embodiments can achieve high contrast and high dynamic range. The lattice or structured light generated by this solution can be quickly transformed to generate customized patterns at extremely high speed.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort. in:

FIG. 1 is a schematic structural diagram of a light source device according to an embodiment of the present application;

2 is a schematic diagram of how to decompose a frame of target image into multiple subframes according to an embodiment of the present application;

3 is a schematic diagram of an array light source of a light source array module according to an embodiment of the present application and a close-packed pixel array formed by using the array light source;

4 is a schematic structural diagram of a light source device according to another embodiment of the present application;

5 is a schematic structural diagram of a light source device according to another embodiment of the present application;

6 is a schematic flowchart of an imaging method according to an embodiment of the present application;

7 is a schematic diagram of a 3D imaging scheme based on a light source array according to an embodiment;

8 is a schematic diagram of a MEMS-based VCSEL light source array system according to an embodiment;

FIG. 9 is a schematic structural block diagram of an imaging device according to an embodiment of the present application;

10 is a schematic structural diagram of an imaging device according to another embodiment of the present application;

11 is a schematic diagram of a pulse signal and a displacement curve in the embodiment shown in FIG. 10;

12 is a schematic structural diagram of an imaging device according to another embodiment of the present application;

13 is a schematic structural diagram of a display device according to an embodiment of the present application;

14 is a schematic structural diagram of a display device according to another embodiment of the present application;

FIG. 15 is a schematic structural diagram of a display device according to another embodiment of the present application;

16 is a schematic diagram of a Micro LED combined light source according to an embodiment of the present application;

FIG. 17 is a schematic diagram of frame breaking for an example image corresponding to the frame breaking method shown in FIG. 2 .

detailed description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

The terms "imaging technique", "imaging method" or "imaging" above and below in this application refer to the process, method or technique of using a light source and optical/electrical devices to form image light corresponding to the source image to reproduce the source image .

The terms "image", "source image", "image signal" and the like in this application, above and below, include images and/or video in any form or format.

Terms such as "the moment of the subframe" and "the moment corresponding to the subframe" in the above and below of this application refer to the moment when the subframe is to be displayed, and the light spots corresponding to the pixels of the subframe are to be formed. time.

FIG. 1 shows a schematic structural diagram of a light source device 100 according to an embodiment of the present application. As shown in FIG. 1 , in this embodiment, the light source device 100 includes a light source array module 110 , a control module 120 and a light spot shifting device 130 . The light source array module 110 includes a plurality of light sources 111 arranged in an array. The light beam emitted by each light source 111 forms a light spot 112 corresponding to one pixel of one frame of target image (see FIG. 3 ). That is, one pixel in the target image corresponds to one spot of the light source beam. If the number of light sources is large enough, for example, the number of light sources is equal to or greater than the number of pixels of the target image, there is no need to decompose the target image into multiple sub-frames, and the target image can be displayed completely at one time by forming light spots equal to the number of pixels of the target image. However, when the number of light sources is less than the number of pixels included in the target image, the target image needs to be decomposed into multiple subframes, and the multiple subframes need to be displayed in sequence in a very short period of time. The number of pixels included in the subframes displayed each time is equal to or smaller than the number of light sources, that is, the resolution of the subframes is equal to or smaller than the light source resolution of the light source array module 110 . Each of the multiple subframes forming a frame of the target image includes a part of the pixels included in the target image, and the set of pixels included in all the subframes is equal to all the pixels included in the target image. Since the time for displaying multiple subframes is short enough, the human eye cannot perceive the switching between different subframes due to the phenomenon of persistence of vision, and the human eye will automatically splicing multiple subframes into a complete image in one frame.

In this embodiment of the present application, the number of pixels included in the target image is greater than the number of light sources included in the light source array module 110 . The target image in this embodiment of the present application includes a plurality of pixels and is composed of a plurality of subframes, wherein the pixels included in each subframe in the plurality of subframes are part of the plurality of pixels included in the target image, and the pixels included in the plurality of subframes The pixels together make up the pixels contained in the target image. In this embodiment of the present application, these subframes are sparsely sampled, at least one pixel of other subframes is inserted between at least two adjacent pixels of each subframe, and the number of pixels included in each subframe is equal to or less than The number of light sources included in the light source array module and the pixel positions of each subframe are different. In one example, one or more pixels of one or more other subframes are interposed between every two adjacent pixels included in each subframe.

The light spot shifting device 130 is used to move the position of the light spot 112 emitted by the light source 111 of the light source array module 110 under the control of the control module 120 . The control module 120 is configured to control the light spot shifting device 130 according to the time sequence, so that the position of the overall light spot emitted by the light source array module 110 sequentially corresponds to each subframe. In order to realize that the position of the light spot corresponds to each subframe in turn, in an example, the control module 120 may be configured to: control the light spot shifting device 130 according to the pixel position of each subframe, so that at the moment corresponding to the subframe The positions of the plurality of light spots 112 of the light source array module 110 correspond one-to-one with the positions of the plurality of pixels included in the subframe.

For example, assuming that the target image includes 4 subframes S1-S4, the time T for displaying the target image of the frame is divided into four equal subframe periods T1-T4, wherein the subframe S1 is displayed at time t1, and the subframe is displayed at time t2. In frame S2, subframe S3 is displayed at time t3, and subframe S4 is displayed at time t4. As mentioned above, the subframes S1-S4 are sparsely sampled, the number of pixels included in each subframe is equal to the number of light sources 111 included in the light source array module 110, and each subframe S1-S4 has different pixel positions . In one embodiment of the present application, at time t1, the control module 120 controls the light spot shifting device 130 to shift the position of the light spot 112 emitted by the light source array module 110 to the position corresponding to the pixel of the subframe S1, that is, the light spot 112 The pixel positions of the formed image light coincide with the positions of the pixels included in the subframe S1. In this embodiment, when the light spot shifting device 130 shifts the light spot 112 emitted by the light source array module 110 to a position corresponding to the subframe S1, the position of each light spot 112 corresponds to its corresponding position in the subframe S1 pixel location. At time t2, the light spot shifting device 130 controls the control module 120 to control the light spot shifting device 130 to shift the light spot 112 emitted by the light source array module 110 to the position corresponding to the pixel of the subframe S2. From displaying one subframe to displaying the next subframe, the spot shifting device 130 moves the spot 112 by a distance corresponding to the pixel pitch of the two subframes. For example, assuming that each pixel of the subframe S2 is shifted to the right by one pixel relative to each pixel of the subframe S1, the control module 120 controls the light spot shifting device 130 to shift the entire light spot 112 emitted by the light source array module 110 to the right with The distance corresponding to one pixel of the image light. At times t3 and t4, the light spot shifting device 130 continues to move the light spot 112 to correspond to the positions of the subframes S3 and S4, respectively. Therefore, within the time T, the light source device 100 sequentially emits light spots corresponding to the subframes S1-S4 in sequence. Due to the persistence of vision of the human eye, these four subframes constitute a complete target image to the human eye. reappearance.

In the examples described above and below, the distances between corresponding pixels in two adjacent subframes are the same, for example, in the examples described above, each pixel in S2 is the same distance from the corresponding pixel in S1 is a pixel, so that when moving the spot, you can move all the spots as a whole. It can be understood that the distance between the corresponding pixels of two adjacent subframes can also be different. When transitioning from one subframe to the next subframe, the distance to be moved can be determined for each light spot, and the light spot can be controlled. The shifting device 130 respectively shifts each light spot or each part of the light spot with the same moving distance.

In the examples described above and below, the interval between every two adjacent light sources 111 of the light source array module 110 is equal, so the interval between adjacent light spots emitted by them is also equal. It can be understood that the intervals between adjacent light sources may be different, and the distances between adjacent light spots may also be different.

FIG. 2 shows a schematic diagram of how to decompose a frame of target image into multiple subframes according to an embodiment of the present application. In this embodiment of the present application, how to decompose the target image into multiple subframes may be determined according to factors such as the number of pixels of the target image, the number of light sources included in the light source array module, and the interval between the light sources. In an example, it is assumed that multiple light sources of the light source array module 110 form an M×N array (both M and N are greater than 1), the emitted light spots are also M×N arrays (as shown in FIG. 3 ), and the target image S contains X ×Y pixels (X is greater than M, Y is greater than N), then the target image S can be decomposed into a×b subframes, where a=X/M, b=Y/N. In the example of FIG. 2 , the light source array module 110 is a 3×3 light source array, and the number of pixels included in the target image is 6×6, so the target image S can be decomposed into 2×2 subframes S1 - S4 .

In this embodiment of the present application, the density of the array formed by the plurality of light sources 111 of the light source array module 110 is smaller than the density of the pixel distribution of the target image, and the array formed by the plurality of light sources 111 is sparse relative to the pixel distribution of the target image The dot matrix, that is, after the multiple light spots emitted by the light source 111 are imaged, correspond not to multiple adjacent pixels of the image, but to non-adjacent pixels separated by one or more other pixels. In the example of FIG. 2 , assuming that the interval between every two adjacent light sources 111 is such that the pixels formed after the light spots emitted by the two adjacent light sources 111 are imaged are separated by 1 pixel, the target image S is decomposed into four The positions of the subframes S1-S4 in the target image S are shown in FIG. 2 . In Figure 2, each square represents a pixel, and the number in the square represents the subframe number to which the pixel belongs. For example, the number "1" represents the subframe S1, the number "2" represents the subframe S2, and the number "3" ” represents subframe S3, and the number “4” represents subframe S4. In the example of Figure 2, the target image S is decomposed into four subframes S1-S4 displayed in time sequence, wherein each subframe is separated from the next by a distance of one pixel. After the subframe S1 is displayed at time t1, at time t2, the control module 120 controls the light spot shifting device 130 to shift the entire light spot 112 emitted by the light source array module 110 to the right by a distance corresponding to one pixel of the image light to form a subframe S2; At time t3, the control module 120 controls the light spot shifting device 130 to translate the light spot 112 emitted by the light source array module 110 downward as a whole by a distance corresponding to one pixel of the image light and continue to translate to the right corresponding to one pixel of the image light. corresponding distance to form sub-frame S3; at time t4, the control module 120 controls the light spot shifting device 130 to shift the entire light spot 112 emitted by the light source array module 110 to the right by a distance corresponding to one pixel of the image light to form a sub-frame S3. Frame S4. In the example of Fig. 2, the four subframes are displayed in the order of S1→S2→S3→S4. It can be understood that the four subframes can also be displayed in other order, and finally the complete reproduction of the target image is obtained. . In the example of FIG. 2, the pixels of subframes S1-S4 are arranged together as close-packed pixels. Through the embodiments of the present application, the sparse array light source can be effectively projected into a high-resolution implementation, and the M*N array of sparse light source arrays can be scanned into aM*bN closely-spaced equally spaced light spots, as shown in FIG. 3 .

In this embodiment of the present application, when the control module 120 controls the light spot shifting device 130 to shift the light spot 112 emitted by the light source array module 110 to correspond to the position of each subframe, the control module 120 also controls the light source according to the grayscale distribution of each subframe The brightness of each light source 111 of the array module 110 is such that each light spot of the light source 111 forms a grayscale display of the corresponding pixel of the subframe at the moment corresponding to the subframe. For example, the control module 120 may adjust the brightness of the light source 111 by adjusting or modulating the driving current or driving voltage of the light source 111 . In this embodiment of the present application, each pixel of the image light is in one-to-one correspondence with each light spot 112 emitted by the light source array module 110 , and each light spot 112 is only emitted by one light source. Therefore, each pixel of the image light is only associated with the corresponding light source. One light source is related, not related to other light sources. In an example, each light source 111 can be independently controlled or driven, the gray scale of each pixel of the formed image light is only related to the corresponding unique light source, and the control module 120 can independently control the light source array module 110 The brightness of each light source 111 controls the pixel gray scale of the formed image.

With the light source device according to the embodiment of the present application, the target image in the source image signal is decomposed into a plurality of subframes that are sparsely sampled (that is, at least one pixel of other subframes is interposed between at least two adjacent pixels of each subframe) ), the pixels of each subframe are in one-to-one correspondence with the light sources of the light source array module, and the light spots corresponding to each subframe are formed in sequence according to the time sequence. The positions of the light spots are moved to correspond to the pixel positions of the corresponding subframes. During the time of displaying one frame of image, the light spot corresponding to each light source is moved to correspond to a plurality of image pixel points. Since the overall resolution is achieved by a light source array including a plurality of light sources, each light source can be modulated separately to contribute to the overall resolution. Therefore, compared with the contribution of a single light source to the overall resolution, the embodiment of the present application reduces the The modulation bandwidth of the light source device. In addition, since the light spot corresponding to a single light source only needs to cover a certain area in the overall image, the embodiment of the present application can effectively reduce the control bandwidth of the light spot shifting device. In addition, since a certain area in the overall image is moved by a single light source, the embodiments of the present application can effectively improve the uniformity of the image. In addition, the embodiment of the present application uses a light source array as the light source, and when the light source is a laser, the moving light spot scheme can also effectively reduce the speckle of the formed image.

As described above, in some embodiments of the present application, the two-dimensional grayscale distribution of each subframe is achieved by adjusting the brightness of each light source in the corresponding time period, avoiding the use of spatial light modulators that are currently inefficient. , therefore, the efficiency of the light source device can be greatly improved. In addition, since the brightness of a single pixel can be fully on/off by adjusting the brightness of the light source, these embodiments can achieve high contrast ratio and high dynamic range.

In addition, in some embodiments, each light source of the light source array module is independently addressable, that is, independently controllable, therefore, variable light encoding can be realized, thereby improving the imaging accuracy. In addition, under the condition that each light source is independently controllable, the gray scale of a single pixel can be realized by modulating the light intensity of the corresponding single light source, and the adjustment method is simple and easy. Adjustment can achieve full on/off, so these embodiments can achieve high contrast and high dynamic range. The lattice or structured light generated by this solution can be quickly transformed to generate customized patterns at extremely high speed.

FIG. 4 shows a schematic structural diagram of a light source device 100 according to another embodiment of the present application. In the embodiment of FIG. 4 , different from the embodiment of FIG. 1 , the control module 120 may include the following three parts: a processor 121 , a light source driver 122 and a spot shift control unit 123 , wherein:

The processor 121 is configured to perform image processing on the received source image signal to obtain a target image including a plurality of subframes. The image processing performed by the processor 121 may include performing one or more of format conversion, decoding, filtering, amplification, etc. on the received source image signal, and may also include acquiring the target image from the source image signal and obtaining the target image from the source image signal. The number of pixels and the configuration parameters of the light source device 100 decompose the target image into a plurality of subframes that match the light source device 100 . The configuration parameters of the light source device 100 may include the number and interval of the light sources of the light source array module 110 , and the like. The processor 121 sends the decomposed subframe signal and the timing corresponding to each subframe to the light source driver 122 and the spot shift control unit 123 .

The light source driver 122 is configured to generate a signal for driving the light source array module 110 to emit light according to signals of a plurality of subframes. In one example, the light source driver 122 generates a corresponding driving signal for the light source 111 corresponding to the pixel according to the gray level of each pixel in each subframe, and the driving signal makes the brightness of the light emitted by the light source 111 equal to that of the pixel. Grayscale matches. In this way, the light source driver 122 can drive the light source 111 to generate a light spot with corresponding brightness for the subframe at the moment of each subframe. In some examples, when the number of light spots required for a subframe is less than the number of light sources, some light sources may not emit light, that is, the light source driver 122 does not generate driving signals for them.

The light spot shift control unit 123 is configured to generate a signal for controlling the light spot shift device 130 to move the light spot 112 according to the signals of the plurality of subframes. For example, the light spot shift control unit 123 controls the light spot shift device 130 to move the light spots formed by the light source array module 110 to correspond one-to-one with each pixel position of the subframe at the moment of each subframe.

The spot shift device 130 moves the positions of the light spots formed by the light source array module 110 according to the instructions from the control module 120 or the light spot shift control unit 123 , so that at the moment of each subframe, the light spots formed by the light source array module 110 are moved. The position of is in a one-to-one correspondence with the position of each pixel in the subframe. The "time of each subframe" above and below in this application refers to the time when each subframe is reproduced according to the time sequence, that is, the time when the light spot corresponding to the subframe is formed, and at this time, the corresponding light spot is moved to the position corresponding to the subframe, and the brightness of each light spot is consistent with the grayscale of each pixel in the subframe.

In one example, the light spot shifting device 130 can change the position of the light spot 112 by moving the position of the light source 111 of the light source array module 110 . For example, the light spot shifting device 130 is a two-dimensional micro-actuator that can move in a first direction and a second direction that are perpendicular to each other. Alternatively, the light spot shifting device 130 is a combination of two one-dimensional micro-actuators, the first one-dimensional micro-actuator can move in the first direction, and the second one-dimensional micro-actuator can move in the second direction. The light source 111 of the light source array module 110 can be attached to the above-mentioned micro-actuator, and the micro-actuator moves under the instruction of the control module 120 or the spot shift control unit 123, thereby driving the light source 111 to move, thereby changing the position of the light source 111. The light source 111 of the light source array module 110 can be fixed to one two-dimensional micro-actuator or two one-dimensional micro-actuators as a whole, and the movement of the micro-actuators can drive the entire movement of the light source array module 110 . Alternatively, the light source array module 110 can be divided into a plurality of parts, each part includes one or more light sources 111, and each part is respectively fixed to one two-dimensional micro-actuator or two one-dimensional micro-actuators. The two-dimensional micro-actuator can be a two-dimensional deflection stage, and the one-dimensional micro-actuator can be a high-frequency piezoelectric ceramic actuator, a piezoelectric moving platform, a piezoelectric stepping motor, or a one-dimensional deflection stage. The micro-actuator can be linear motion, deflection or other motion forms. The speed of movement of the two-dimensional microactuator in the two directions can be the same or different, eg, the movement in the first direction is faster than the movement in the second direction. Alternatively, the speed of movement of the two one-dimensional micro-actuators may be the same or different, eg, a one-dimensional micro-actuator moving in a first direction is faster than a one-dimensional micro-actuator moving in a second direction.

In another example, the light spot shifting device 130 can change the position of the light spot 112 by deflecting the propagation direction of the light beam emitted by the light source array module 110 . For example, the beam deflection device is a MEMS scanning mirror or a phase deflection device.

In an embodiment of the present application, in order to ensure the consistency between the movement of the spot position and the adjustment of the brightness of the spot, the control module 120 may further include a synchronization unit 124 . The synchronization unit 124 is configured to control the light source driver 122 to synchronize with the light spot shifting device 130 according to the plurality of subframes, so that the light spot shifting device 130 moves the light spots 112 of the plurality of light sources 111 to be in phase with each of the plurality of subframes. At the same time as the corresponding position, the light source driver 122 drives the light source array module 110 to emit light corresponding to the grayscale distribution of the subframe. The synchronization unit 124 is connected to the processor 121 , the light source driver 122 and the spot shift control unit 123 . The control module 120 may send each subframe and the corresponding timing to the synchronization unit 124 . In one example, the synchronization unit 124 can ensure that the light spot shift control unit 123 drives the light spot shift device 130 and the light source driver 122 drives the light source 111 to emit light synchronously according to the timing of each subframe, so that the light spot shift device 130 drives the light spot shift When reaching the position corresponding to each subframe, each light source 111 emits light under the driving of the light source driver 122, and the brightness of the emitted light spot 112 is consistent with the grayscale of each pixel in the subframe. The synchronization unit 124 can ensure that the light source 111 neither emits light in advance nor delays light emission, but emits light with corresponding brightness when the light spot is shifted to the target position.

In one example, the light source 111 is a laser light source, and the light source driver 122 sends a pulse driving signal to drive the light source 111 to emit light. In one example, the synchronization unit 124 is configured to control the timing of the pulses driving the laser light source 111 and the movement of the spot shifting device 130 , so that the laser light source 111 emits equally spaced light spots with the movement of the spot shifting device 130 .

In the embodiment of FIG. 4 , the control module 120 is divided into four functional modules: a processor 121 , a light source driver 122 , a spot shift control unit 123 and a synchronization unit 124 . It can be understood that this division is based on logical division of functions, the control module 120 can also be divided into other different logical function modules, and the number of divided functional modules can be more or less.

The light source 111 may be various light source devices capable of emitting light. For example, each light source 111 may be a vertical cavity surface emitting laser, an edge emitting laser, an LED, or a Micro LED, or the like.

In the above embodiment, each light source 111 of the light source array module 110 may emit a monochromatic light spot or a white light spot.

FIG. 5 shows a schematic structural diagram of a light source device 100 according to yet another embodiment of the present application. As shown in FIG. 5 , the difference between this embodiment and the embodiment shown in FIG. 1 is that the light source array module 110 may include a first light source array module 110A, a second light source array module 110B and a third light source array module 110C, wherein, The first light source array module 110A includes a plurality of first light sources 111A that emit light having a first color, the second light source array module 110B includes a plurality of second light sources 111B that emit light having a second color, and the third light source array module 110C A plurality of third light sources 111C emitting light having a third color are included. For example, the first color, the second color and the third color may be blue, green and red, respectively. In an example (as shown in FIG. 4 ), the light source device 100 may further include a light combining module 140 , the three light source array modules have the same number of light sources, and each first light source 111A corresponds to a second light source 111B and Three light spots with three colors respectively emitted by a third light source 111C can be combined into one white light spot by the light combining module 140 as imaging light. In this way, the three monochromatic light spot arrays emitted by the three light source array modules are finally combined by the light combining module 140 into a mixed color light spot array, such as a white light spot array. In another example, the light source device 100 may not have the light combining module 140, and each first light source 111A, a corresponding second light source 111B and a third light source 111C may be arranged in the same position as three sub-pixels next to each other, Makes the light spots emitted by the three light sources appear to be emitted from the same position and correspond to the same pixel of the imaging light. In this case, the light combining module 140 may not be used.

In the embodiment shown in FIG. 5 , the light spot shifting device 130 may accordingly include a first light spot shifting device 130A for moving the light spot of the first light source array module 110A, a light spot shifting device 130A for moving the second light source array module 110B The second light spot shifting device 130B of the light spot and the third light spot shifting device 130C for moving the light spot of the third light source array module 110C. The control module 120 may be configured to sequentially or simultaneously control the first light spot shifting device 130A, the second light spot shifting device 130B and the third light spot shifting device 130C according to the pixel positions of each subframe, so that the The positions of the light spots of the plurality of first light sources 111A, the second light sources 111B, and the third light sources 111C correspond one-to-one with the positions of the pixels included in the subframe at a corresponding time.

Each subframe of the target image may be decomposed into a first subframe component having a first color component, a second subframe component having a second color component, and a third subframe component having a third color component, the control module 120 further Can be configured as:

The brightness of each of the plurality of first light sources 111A is independently controlled according to the grayscale distribution of the first subframe component, so that each light spot of the plurality of first light sources 111A forms a first light source at a time corresponding to the subframe. Grayscale display of subframe components; that is, at the moment corresponding to the subframe, the brightness of each light spot of the first light source 111A corresponds to the grayscale value of the first color component of each pixel of the subframe in one-to-one correspondence.

The luminance of each of the plurality of second light sources 111B is independently controlled according to the gradation distribution of the second subframe component, so that each light spot of the plurality of second light sources 111B forms a second light source at a time corresponding to the subframe. Grayscale display of subframe components; that is, at the moment corresponding to the subframe, the brightness of each light spot of the second light source 111B corresponds to the grayscale value of the second color component of each pixel of the subframe one-to-one.

The brightness of each of the plurality of third light sources 111C is independently controlled according to the grayscale distribution of the third subframe component, so that each light spot of the plurality of third light sources 111C forms a third light source at a time corresponding to the subframe. Grayscale display of subframe components. That is, at the time corresponding to the subframe, the brightness of each light spot of the third light source 111C corresponds to the grayscale value of the third color component of each pixel of the subframe in one-to-one correspondence.

Regarding how to adjust the brightness of the light source of the corresponding color to correspond to the gray-scale value of the color component of the sub-frame pixels, the method is the same as that of adjusting the brightness of the light source to be consistent with the gray-scale value of the sub-frame pixels, which is not repeated here. Repeat.

It can be understood that the control module 120 in the embodiment of FIG. 5 may further include a processor 121, a light source driver 122, and a light spot shift control unit 123 as shown in FIG. 4, and may also include a synchronization unit 124, which is omitted here. Repeat.

The above-mentioned light source device according to the embodiments of the present application can reduce the modulation bandwidth of the light source device, effectively reduce the control bandwidth of the spot shift device, and effectively improve the image uniformity, and when the light source is a laser, the moving spot scheme can also effectively reduce all Speckle of the resulting image. In addition, in some embodiments, for a single pixel in the image, the gray-scale display of the pixel can be realized by adjusting the brightness of the light source corresponding to the pixel, so that at the corresponding time of each subframe, the brightness of each light source can be adjusted by adjusting the brightness of the light source. Brightness to achieve a two-dimensional grayscale distribution of each subframe.

According to another aspect of the embodiments of the present application, an imaging method is also provided. The imaging method can be implemented by a light source device, the light source device can decompose a target image into a plurality of sparsely sampled subframes, and includes a plurality of light sources, a plurality of Each light spot emitted by each light source corresponds to each pixel of a subframe one-to-one, and the light source device generates a corresponding light spot array for each subframe sequentially by moving the light spot within a frame time, thereby obtaining the image light of the target image. The light source device may be, for example, any embodiment of the light source device 100 described above. FIG. 6 shows a schematic flowchart of an imaging method according to an embodiment of the present application. As shown in Figure 6, the example imaging method includes the steps of:

S610: Decompose a frame of target image to obtain multiple subframes.

At least one pixel of other subframes is interposed between at least two adjacent pixels of each subframe.

For example, after receiving the target image, the control module of the light source device (eg, the control module 120 in FIG. 1 , FIG. 4 , and FIG. 5 ) decomposes the target image frame. For example, the control module may decompose the target image according to the number of pixels of the target image, the configuration parameters of the light source device, and the like. For example, if the plurality of light sources included in the light source array module of the light source device is an M×N array, and the target image includes X×Y pixels, the target image can be decomposed into a×b subframes, where X=M *a, Y=N*b, so that the number of pixels in the subframe is equal to the number of light sources in the light source array module, and each pixel in the subframe corresponds to one light source.

For specific decomposition methods and details, reference may be made to those in the foregoing embodiments of the light source device, and details are not described herein again.

A target image containing a plurality of pixels is decomposed into a plurality of sparsely sampled subframes, and at least one pixel of other subframes is interposed between at least two adjacent pixels of each subframe. The light source device generates corresponding light spots in step S620 according to the information of the multiple subframes.

S620: According to the pixel position of each subframe, move the position of the light spot emitted by the light source array module according to the time sequence through the light spot shifting device, so that the position of the light spot corresponds to each subframe in sequence.

In step S620, the light source device sequentially generates corresponding light spots for each subframe according to the pixel positions of the decomposed subframes. Generating a corresponding light spot for a subframe may refer to moving the position of the light spot at the moment of the subframe to make the position of each light spot correspond one-to-one with the position of each pixel of the subframe.

The light source array module includes a plurality of light sources, and the light beam emitted by each light source in the plurality of light sources forms a light spot corresponding to one pixel of the target image, and the plurality of light spots formed by the plurality of light sources at the moment corresponding to the sub-frame The positions correspond one-to-one with the positions of multiple pixels included in the subframe. Each subframe is generated by sparse sampling of the target image, and correspondingly, the light sources included in the light source array module are also sparse lattices with respect to the pixel distribution of the target image.

In an example, step S620 may be implemented by the light source device through the following processing:

S621: Generate, for each subframe, a shift control signal for controlling the light spot shifting device to move the light spot to reach a position corresponding to the subframe according to the pixel position of each subframe;

S622: Move the position of the light spot by the light spot shifting device according to the shift control signal of each subframe.

Step S621 can be implemented, for example, by the control module of the light source device or the light spot displacement control unit of the control module in the foregoing light source device embodiments. For example, the target position to which the light spot is to be moved can be determined according to the position of each pixel in each subframe, and the moving distance, moving direction and moving route of the light spot can be further determined according to the target position and the current position of the light spot, and then according to the determined This information generates corresponding shift control signals for each subframe. Further, the moving distance, moving direction or moving route, moving speed, etc. of the light source of the light source device or the light source array module can also be determined according to the distance and moving direction of the light spot to be moved, or the angle and direction of the light beam emitted by the light source that need to be deflected, etc. , and include this information in the shift control signal.

In step S622, the light spot shifting device of the light source device moves the light spot according to the shift control signal, so that the position of each light spot corresponds to the position of each pixel of the corresponding subframe one-to-one. The light spot shifting device can move the positions of the light spots by moving the positions of the multiple light sources, and can also move the positions of the light spots formed by the light beams by deflecting the directions of the light beams emitted by the multiple light sources.

For details on how to sequentially generate corresponding light spots for each subframe through light spot shifting according to the pixel positions of each subframe, reference may be made to the descriptions in the foregoing embodiments of the light source apparatus.

In an example, generating the corresponding light spot for the subframe may further include: at the moment of the subframe, when the light spot is shifted to a position corresponding to the subframe, adjusting the brightness of each light spot to be the same as the subframe The grayscale of each pixel is the same. That is, the example imaging method may further include the step of: controlling the brightness of each light source of the plurality of light sources according to the grayscale distribution of each subframe, so that each spot of the plurality of light sources forms the subframe at a time corresponding to the subframe Grayscale display of the corresponding pixels of the frame. This step can be achieved by the following processing:

Determine the brightness of each light source in the light source array module at the moment of the subframe according to the grayscale distribution of each subframe;

generating, for each light source, a driving signal for driving the light source to emit light of the determined brightness according to the determined brightness of each light source;

At the moment of each subframe, a plurality of light sources emit light under the driving of corresponding driving signals to form light spots corresponding to the subframe.

The above-mentioned light source can be any light-emitting device, such as a vertical cavity surface emitting laser, an edge emitting laser, an LED or a Micro LED, and the like. In one example, each of the plurality of light sources is a pulse-driven laser light source configured to emit light when the spot shifting device displaces the spot to the target position. For example, the timing of the pulses for driving the laser light source and the movement of the spot shifting device can be controlled, so that the laser light source emits light spots at equal intervals with the movement of the spot shifting device.

In one embodiment, in order to obtain precise consistency between the spot position and the spot brightness, the spot displacement can be synchronized with the lighting of the light source. For example, the above-described example imaging method may further include the step of: controlling the light source driver to synchronize with the light spot shifting device according to the plurality of subframes, so that the light spot shifting device moves the light spots of the plurality of light sources to correspond to each of the plurality of subframes The light source driver drives the light source array module to emit light corresponding to the grayscale distribution of the subframe. Through the synchronization step, the position movement of the light spot is kept in line with the brightness change, so that the light spot of precise brightness can be provided at the precise pixel position.

After forming the light spot corresponding to each subframe, the example imaging method proceeds to step S630.

S630: Image the light spots corresponding to the multiple subframes emitted by the light source array module to obtain image light.

In step S630, the light spot may be imaged by an imaging module to obtain image light. The imaging module may be a module in the light source device or a module located outside the light source device.

In the above embodiments, the light emitted by each light source may be monochromatic light or white light. In the following embodiments, the light sources emit monochromatic light of different colors. In this embodiment, the light source array module of the light source device includes a first light source array module, a second light source array module and a third light source array module, and the first light source array module includes a plurality of first light sources that emit light having a first color The second light source array module includes a plurality of second light sources emitting light with a second color, and the third light source array module includes a plurality of third light sources emitting light with a third color.

The light spot shifting device includes a first light spot shifting device for moving the light spot of the first light source array module, a second light spot shifting device for moving the light spot of the second light source array module, and a second light spot shifting device for moving the third light source array module. A third spot shift device for the spot.

In this case, step S620 may include: sequentially or simultaneously controlling the first light spot shifting device, the second light spot shifting device and the third light spot shifting device according to the pixel positions of each subframe, so that the The positions of the light spots of the plurality of first light sources, the second light sources and the third light sources at the corresponding moment correspond one-to-one with the positions of the pixels included in the subframe.

In this embodiment, each subframe of the target image can be decomposed into a first subframe component with a first color component, a second subframe component with a second color component, and a third subframe with a third color component component, which controls the brightness of each light source in the multiple light sources according to the grayscale distribution of each subframe, including:

The brightness of each of the plurality of first light sources is controlled according to the grayscale distribution of the first subframe component, so that each light spot of the plurality of first light sources forms the first subframe component at the moment corresponding to the subframe. Grayscale display; that is, at the moment corresponding to the subframe, the brightness of each light spot corresponds to the grayscale value of the first color component of each pixel of the subframe in one-to-one correspondence.

The brightness of each of the plurality of second light sources is controlled according to the grayscale distribution of the second sub-frame component, so that each light spot of the plurality of second light sources forms the second sub-frame component at the moment corresponding to the sub-frame. Grayscale display; that is, at the moment corresponding to the subframe, the brightness of each light spot corresponds to the grayscale value of the second color component of each pixel in the subframe one-to-one.

The brightness of each of the plurality of third light sources is controlled according to the grayscale distribution of the third subframe component, so that each light spot of the plurality of third light sources forms the third subframe component at the moment corresponding to the subframe. Grayscale display. That is, at the moment corresponding to the subframe, the brightness of each light spot corresponds to the grayscale value of the third color component of each pixel in the subframe in one-to-one correspondence.

In the case that the above-mentioned light source array module emits a plurality of monochromatic lights, before the imaging step S630, the example imaging method further includes the step of: combining the light spots of the plurality of first light sources, the second light sources and the third light sources. . In this step, for a light source group consisting of a first light source, a second light source and a third light source corresponding to positions, a light combining module can be used to combine the three light spots emitted by the group of light sources into one light spot. In this way, the three monochromatic light spot arrays emitted by the three light source array modules are finally synthesized by the light combining module into a mixed color light spot array, such as a white light spot array. Then in step S630, the combined light spot is imaged to obtain image light.

For the specific details of the above steps or processing, reference may be made to the foregoing embodiments of the light source device, and details are not described herein again. Conversely, the descriptions in the embodiments of the imaging method can also be used as a reference for the foregoing embodiments of the light source device.

With the imaging method according to the embodiment of the present application, the target image in the source image signal can be decomposed into a plurality of subframes that are sparsely sampled (that is, at least one of other subframes is interposed between at least two adjacent pixels of each subframe) Pixels), the pixels of each subframe correspond to the light sources of the light source array module one-to-one, and the light spots corresponding to each subframe are formed in sequence according to the time sequence. The device moves the position of the light spot to correspond with the pixel position of the corresponding subframe. During the time of displaying one frame of image, the light spot corresponding to each light source is moved to correspond to a plurality of image pixel points. Since the overall resolution is achieved by a light source array including a plurality of light sources, each light source can be modulated separately to contribute to the overall resolution. Therefore, compared with the contribution of a single light source to the overall resolution, the embodiment of the present application reduces the The modulation bandwidth of the light source device. In addition, since the light spot corresponding to a single light source only needs to cover a certain area in the overall image, the embodiment of the present application can effectively reduce the control bandwidth of the light spot shifting device. In addition, since a certain area in the overall image is moved by a single light source, the embodiments of the present application can effectively improve the uniformity of the image. In addition, the embodiment of the present application uses a light source array as the light source, and when the light source is a laser, the moving light spot scheme can also effectively reduce the speckle of the formed image.

As described above, in some imaging method embodiments of the present application, the two-dimensional grayscale distribution of each subframe is achieved by adjusting the brightness of each light source in the corresponding time period, avoiding the use of spatial light that is currently inefficient modulator, therefore, the efficiency of the imaging method can be greatly improved. In addition, since the brightness of a single pixel can be fully on/off by adjusting the brightness of the light source, these embodiments can achieve high contrast ratio and high dynamic range.

In addition, in some imaging method embodiments, each light source of the light source array module is independently addressable, that is, independently controllable, therefore, variable light encoding can be implemented, thereby improving imaging accuracy. In addition, under the condition that each light source is independently controllable, the gray scale of a single pixel can be realized by modulating the light intensity of the corresponding single light source, and the adjustment method is simple and easy to implement. In addition, since the brightness of a single pixel can be fully on/off by adjusting the brightness of the light source, these embodiments can achieve high contrast ratio and high dynamic range. The lattice or structured light generated by this solution can be quickly transformed to generate customized patterns at extremely high speed.

Embodiments of the above-described example light source apparatus and example imaging method may be applied in many applications, eg, for projection image display, or for 3D imaging of objects.

In the projection image display application, the image light obtained in step S630 can be projected onto the screen, so that the target image is reproduced on the screen. In such an application, the above-mentioned embodiments of the light source device can be integrated into a display device, and the display device may further include a method for imaging the light spot emitted by the light source device to obtain image light, and project the image light onto the screen imaging module.

In the application of 3D imaging of objects, the image light obtained in S630 can be used as structured light, and the example imaging method may include the following steps:

The image light is irradiated on the object to be measured; the image light modulated by the object to be measured is collected; the acquired modulated image light is processed to obtain three-dimensional information of the object to be measured.

In such an application, the above-mentioned embodiments of the light source device may be integrated into an imaging device for 3D imaging of the object to be measured, and the imaging device may further include:

The imaging module is used for forming image light based on the light spot output by the light source device and irradiating it on the object to be measured.

The acquisition module is used to acquire the image light modulated by the object to be measured.

The image processing module is used for processing the modulated image light collected by the acquisition module to obtain the three-dimensional information of the object to be measured.

Hereinafter, example embodiments of an imaging device and a display device will be described in detail, respectively.

In addition to 2D imaging of the target object, 3D imaging technology can also obtain information about the depth dimension of the target, so 3D stereo scanning or modeling can be achieved. Common 3D imaging solutions can include Diffractive Optical Elements (DOE, Diffractive Optical Elements), 3D structured light scanning solutions, and Vertical Cavity Surface Emitting Lasers (VCSELs) based on Micro Electro Mechanical Systems (MEMS, Micro Electronic Mechanical System). Emitting Laser) light source array system and 3D structured light based on Digital Light Processing (DLP, Digital Light Processing).

However, the control of the projected structured light is mainly achieved through a plurality of closely arranged light source arrays, DOEs and some spatial processing. The light sources do not realize independent addressing control, and the number of images that can be controlled is limited, and it is impossible to control the image. For dynamic modulation, the accuracy and resolution that can be achieved are limited; when using a digital micro mirror device (DMD, Digital Micro Mirror Device) to implement a DLP-based 3D structured light scheme, the efficiency of the DMD spatial light modulator is low, and the required The heat dissipation module is large, so the whole system is complex, bulky and low in efficiency.

At present, regular and irregular light source arrays are mostly used, or multiple light source arrays are used to project light spots with different degrees of sparseness and different arrangements, and the light beams are received and collimated by lens units (such as microlens arrays or lens groups, etc.). , and then project it into space, and then copy and amplify the beam emitted by the light source array with different multiples through one or more DOEs, as shown in Figure 7. The 3D imaging scheme based on the light source array can realize structured light for different application scenarios. ; Multiple light source arrays can also be processed by one or more combinations of translation, rotation, mirroring or scaling, aiming to obtain laser speckle images with uniform overall particle distribution but high degree of local irrelevance, in order to obtain higher accuracy.

The MEMS-based VCSEL light source array system reflects the array beam emitted by the regular or irregular VCSEL through the vibration of the MEMS micromirror, and projects it onto the object in the form of a lattice. Dense spot distribution improves accuracy, as shown in Figure 8; the control of the projected structured light is mainly achieved through multiple closely-arranged light source arrays, DOEs and some spatial processing, and the light sources do not implement independent addressing control , the number of images that can be controlled is limited, the image cannot be dynamically modulated, and the accuracy and resolution that can be achieved are limited.

For DLP-based 3D structured light solutions, when designers need to perform fast and high-precision scanning with millimeter to micron resolution, they often choose DLP-based structured light systems and use DMD to achieve high-speed real-time 3D scanning, but DMD spatial light modulators The efficiency is lower, and the required cooling module is larger, so the whole system is complicated, the volume is larger, and the efficiency is low.

FIG. 9 shows a schematic structural block diagram of an imaging device according to an embodiment of the present application. As shown in FIG. 9 , the imaging device 900 includes a light source device 100 , an imaging module 920 , an acquisition module 930 and an image processing module 940 . The light source device 100 and the imaging module 920 form a test pattern generating module 910 for generating structured light. The light source device 100 may be the various light source device embodiments described above. In the embodiment of FIG. 9 , the control module of the light source device is divided into a decoder 911 and a light source array drive module 912 , and the beam scanning/deflection actuator 913 is equivalent to the light spot shifting device 130 in the foregoing light source device embodiments.

The light source array module 110 in the test pattern generation module 910 uses electrodes with independent control of each light source, and realizes fast single-point control of each laser light source through a driver. Since the array light sources of the light source array module 110 need to be independently addressed and controlled, the array is in the form of a sparse lattice, and is arranged in an M*N lattice, as shown in FIG. 4 . Through the optical imaging lens of the imaging module 920, M*N sparse pixel points can be realized on the screen. In order to display a frame of image with densely packed pixels, it is necessary to split a frame of image into a*b sub-frames displayed by time-division multiplexing, that is, the light spot corresponding to each independently addressed light source is expanded by time-division multiplexing. The densely packed a*b light spots correspond to the a*b densely packed pixels in one frame of image, which just fill the gaps between several adjacent independently addressable and controllable light sources. In one frame, the switching between sub-frames can be realized by the micro-actuator, and finally aM*bN pixels are realized on the screen. Since the switching time between subframes is much longer than the minimum time that the human eye can respond to the phenomenon of persistence of vision, the integration effect of the human eye splices multiple subframes into a complete image. The above description divides a frame of image into a*b non-overlapping subframes, and a*b subframes are repeated only once in a frame, and the principle of repeating a*b subframes multiple times is similar. The speed can be accelerated, and I will not repeat them here.

A detailed schematic diagram of frame splitting is shown in FIG. 3 , corresponding to the case of a=2, b=2. The sparse lattice light source is located at position 1 at time t1, at position 2 at time t2, and so on. The light sources are located at

positions

1, 2, 3, and 4 in sequence within one frame, and each light source forms non-overlapping 2*2 close-packed pixels, forming 2M*2N pixels as a whole.

After the video signal source is converted by the decoder 911, it is transmitted to the light source array driving module 912. By controlling the brightness of the light source at each spot position, different gray scales are realized, and the regulation of a sub-frame image is completed. At this time, the image acquisition module 930 acquires the image and transmits it to the image processing module 940 for analysis. When another subframe is reached, the beam scanning/deflection actuator 913 moves the light spot corresponding to the array light source to its corresponding position, and the light source array driving module 912 drives the array light source according to the grayscale corresponding to this subframe, so that on the image Displays the grayscale distribution of the corresponding subframe. The image acquisition module 930 acquires the image and transmits it to the image processing module 940 for analysis. Finally, the image processing module 940 analyzes and compares all the displayed images to achieve high-precision 3D imaging.

10 shows a schematic structural diagram of an imaging device 1000 according to another embodiment of the present application, wherein an independently addressable and regulated VCSEL is used as an array light source of the light source array module, and a micro-actuator 1010 is used as a light spot shift device to vibrate The light source array module 110 is used to realize the displacement of the light spot. The decoder 1021 , VCSEL driver 1022 , micro-actuator driver 1023 and synchronization device 1024 are respectively equivalent to the processor 121 , light source driver 122 , spot shift controller 123 and synchronization unit 124 constituting the control module 120 as before.

After the video source is decoded by the decoder 1021, it is transmitted to the VCSEL driver 1022 and the micro-actuator driver 1023, and the synchronization device 1024 ensures that the two are synchronized. The VCSEL light source of the light source array module 110 is mounted on the micro-actuator 1010 . The micro-actuator 1010 may be a two-dimensional micro-actuator, or may be two one-dimensional micro-actuators, and the two one-dimensional micro-actuators respectively control two mutually perpendicular directions, so that the VCSEL vibrates in two directions. One of the two-dimensional vibration directions can be at a fast frequency and the other at a slow frequency. Among them, the slow frequency direction vibrates in a step-by-step manner. The microactuator 1010 may be a linear moving actuator or a rotary actuator. The laser light source VCSEL is driven with pulses so that it emits light when the microactuator 1010 moves to the desired spot position. For example, a single VCSEL light source has a diameter of 15 microns, and the spacing between each light source in the x and y directions is 150 microns. There are 200 light sources in the x direction and 100 light sources in the y direction. The entire VCSEL light source array is about 30mm long and wide. About 15mm. Then when the vibration frequency in the x-direction is 600Hz and the vibration frequency in the y-direction is 60Hz, a resolution of 2k and a refresh rate of 60Hz can be achieved. Wherein, in the case of two one-dimensional micro-actuators, the one-dimensional micro-actuator in the x-direction can be a high-frequency piezoelectric ceramic actuator, and the one-dimensional micro-actuator in the y-direction can be, but not limited to, a piezoelectric mobile platform, Piezo stepper motor or 1D deflection stage. In the case of a 2D microactuator, the 2D microactuator can use a high frequency 2D deflection stage to achieve deflection in both directions simultaneously. The pulse sequence of the laser light source can be controlled to match the displacement curve of the micro-actuator 1010, so that the VCSEL projects light spots with equal intervals. For example, when the moving curve is a sine wave, by modulating the pulse sequence, the output at equal intervals can be achieved, as shown in Figure 11. When a subframe is reached, the micro-actuator 1010 moves the light spot corresponding to the array light source to its corresponding position, and the VCSEL driver 1022 drives the array light source according to the grayscale corresponding to the subframe, so that the grayscale corresponding to the subframe is displayed on the image. degree distribution. The obtained densely packed pixel points are optically amplified by the imaging module 920, and finally projected onto the object to be measured. The acquisition module 930 collects the light modulated by the object, and transmits the signal to the image processing module 940, and the image processing module 940 obtains three-dimensional information of the object to be measured after calculating the signal.

In this embodiment, the vibration bandwidth of the two-dimensional micro-actuator is reduced by sparse lattice light sources, the system is simple, the volume is small, and the resolution is high. The image modulation can be realized without an additional spatial light modulator. Accurate 3D imaging.

12 shows a schematic structural diagram of an imaging device 1200 according to another embodiment of the present application, wherein Micro LED is used as a sparse array light source of the light source array module, and a MEMS scanning mirror or a phase deflection device is used to realize beam scanning/spot shift. The decoder 1221 , the LED driver 1222 , the scanning device driver 1223 and the synchronization device 1224 are respectively equivalent to the processor 121 , the light source driver 122 , the spot shift controller 123 and the synchronization unit 124 constituting the control module 120 as before.

As shown in FIG. 12 , after the video source passes through the decoder 1221 , the signal is transmitted to the LED driver 1222 and the scanning device driver 1223 , and the synchronization device 1224 ensures that the two are synchronized. The function of the phase deflector/MEMS mirror 1230 as a light spot shifting device is to realize beam deflection. The phase deflector uses the diffraction principle of light to realize the deflection of the main light level by modulating the phase of the light. Typical devices such as acousto-optic deflectors and liquid crystals. MEMS uses piezoelectric ceramics as the driving source, which can realize two-dimensional fast flipping, and realize beam deflection using the principle of light reflection.

For example, the diameter of a single Micro LED light source of the LED light source array 1210 is 15 microns, and the distance between each light source in the x and y directions is 150 microns. There are 200 light sources in the x direction and 100 light sources in the y direction. The entire Micro LED The light source array is about 30mm long and 15mm wide. Then, when the scanning frequency in the x-direction is 600 Hz and the scanning frequency in the y-direction is 60 Hz, a resolution of 2k and a refresh rate of 60 Hz can be achieved. When the acousto-optic deflector is used as the beam deflecting device, since the response time of the acousto-optic deflector is in the ns level, the densely packed pixel point arrangement can be realized without the need for pulse driving of the light source. When a subframe is reached, the phase deflector/MEMS mirror 1230 is driven by the scanning device driver 1223 to move the light spot of the LED light source array 1210 to the position corresponding to the subframe. The LED light source array 1210 is driven so that the grayscale distribution of the corresponding sub-frame is displayed on the image. The obtained densely packed pixel points are optically amplified by the imaging module 920, and finally projected onto the object to be measured. The acquisition module 930 collects the modulated light of the object, and transmits the signal to the image processing module 940, and the image processing module 940 obtains the three-dimensional information of the object after calculating the signal.

This embodiment uses a sparse lattice light source, the system is simple, the volume is small, and the resolution is high, and the image modulation can be realized without an additional spatial light modulator, thereby realizing high-precision 3D imaging.

FIG. 13 shows a schematic structural diagram of a display device according to an embodiment of the present application. As shown in FIG. 13 , the exemplary display device 1300 is composed of a light source array module 1310 , a decoder 1321 , a beam scanning/deflection actuator 1330 , a light source array driver 1322 , a light combining module 1340 , and an imaging module 1350 . The decoder 1321 and the light source array driver 1322 constitute the control module 120 in the aforementioned embodiments of the light source device, and the beam scanning/deflection actuator 1330 is equivalent to the light spot shift in the aforementioned embodiments of the light source device The position device 130 , the light source array module 1310 , the decoder 1321 , the beam scanning/deflection actuator 1330 , and the light source array driver 1322 constitute a light source device module equivalent to the aforementioned light source device embodiments.

As shown in FIG. 13 , the array light sources of the light source array module 1310 use electrodes with independent control of each light source, and the light source array driver 1322 realizes fast single-point control of each laser light source. Since the array light sources need to be independently addressed and regulated, the array light sources of the light source array module 1310 are in the form of sparse lattices and are arranged in an M*N lattice, as shown in FIG. 4 . Through the optical imaging lens of the imaging module 1350, M*N sparse pixel points can be realized on the screen. In order to display a frame of images with densely packed pixels, a frame of image needs to be split into a*b sub-frames displayed by time division multiplexing, that is, the light spot corresponding to each independently addressed light source is expanded by time division multiplexing into The closely-packed a*b light spots correspond to the a*b closely-packed pixels in one frame of image, which just fill the gaps between several adjacent independently addressable and controllable light sources. In one frame, the switching between display subframes can be realized by the beam scanning/deflection actuator 1330, and finally aM*bN pixels are realized on the screen. Since the switching time between subframes is much longer than the minimum time that the human eye can respond to the phenomenon of persistence of vision, the integration effect of the human eye splices multiple subframes into a complete image. The above description divides a frame of image into a*b non-overlapping subframes, and a*b subframes are repeated only once in a frame, and the principle of repeating a*b subframes multiple times is similar. The speed can be accelerated, and I will not repeat them here. It should be pointed out that the a*b light spots corresponding to the same independently controllable light source may not be closely arranged, but overlap or have gaps in the middle, and the specific solution can be determined according to the actual imaging requirements.

positions

1, 2, 3, and 4 in sequence within one frame, and each light source forms non-overlapping 2*2 close-packed pixels, forming 2M*2N pixels as a whole. FIG. 17 shows a schematic diagram of frame breaking for an example image corresponding to the frame breaking method shown in FIG. 2 .

After the video signal source is converted by the decoder 1321, it is transmitted to the light source array driver 1322, and the control of a sub-frame image is completed by controlling the brightness of the light source at each spot position to achieve different gray scales. When another subframe is reached, the beam scanning/deflection actuator 1330 moves the light spot corresponding to the array light source to the position corresponding to the subframe, and the light source array driver 1322 drives the array light source according to the grayscale corresponding to the subframe, so that the image The grayscale distribution of the corresponding subframe is displayed on the top. In this embodiment, the light source array module 1310 includes three light sources that respectively emit light of three different colors (eg, light of three colors G, R, and B). By using the light combining module 1340 to combine light of three colors, such as G, R, and B, through the imaging module 1350, a color image is realized on the screen.

14 shows a schematic structural diagram of a display device 1400 according to another embodiment of the present application, wherein an independently addressable and regulated VCSEL is used as an array light source of the light source array module, and a micro-actuator is used as a light spot shifting device to vibrate light source. The decoder 1421, the VCSEL driver 1422, the micro-actuator driver 1423 and the synchronization device 1424 are respectively equivalent to the processor 121, the light source driver 122, the spot shift controller 123 and the synchronization unit 124 that constitute the control module 120 as described above. .

In the embodiment of FIG. 14 , the light source array module includes a first light source array module 1410A emitting B (blue) light, a second light source array module 1410B emitting R (red) light, and a third light source emitting G (green) light Array modules 1410C, which are located at different locations. The three light source array modules have an equal number of light sources. Three light spots with three colors respectively emitted by each light source of the first light source array module 1410A, a light source corresponding to a position in the second light source array module 1410B and a light source corresponding to a position in the third light source array module 1410C can be combined. The light module 1440 is combined into a white light spot. In this way, the three monochromatic light spot arrays emitted by the three light source array modules are finally combined by the light combining module 1440 into a mixed color light spot array, such as a white light spot array.

In the embodiment shown in FIG. 14 , the micro-actuator as the light spot shifting device may also include a first micro-actuator 1430A for moving the light spot of the first light source array module 1410A, and a first micro-actuator 1430A for moving the second light source. The second micro-actuator 1430B for the light spot of the array module 1410B and the third micro-actuator 1430C for moving the light spot of the third light source array module 1410C.

After the video source is decoded by the decoder 1421, it is transmitted to the VCSEL driver 1422 and the micro-actuator driver 1423, and the synchronization device 1424 ensures that the two are synchronized. Install the VCSEL of each light source array module 1410A, light source array module 1410B or light source array module 1410C on a two-dimensional micro-actuator or two one-dimensional micro-actuators, and the two one-dimensional micro-actuators respectively control two mutually perpendicular The direction of the VCSEL makes the VCSEL vibrate in two directions. The overall scheme is shown in Figure 14. Vibration in these two dimensions can be one fast frequency and one slow frequency. The slow frequency direction vibrates in a step-by-step manner. Micro-actuators can be linear moving actuators or deflection actuators. The laser light source can be pulsed to emit light when the microactuator is moved to the desired spot position. For example, a single VCSEL light source has a diameter of 15 microns, and the spacing between each light source in the x and y directions is 150 microns. There are 200 light sources in the x direction and 100 light sources in the y direction. The entire VCSEL light source array is about 30mm long and wide. About 15mm. Then when the vibration frequency in the x-direction is 600Hz and the vibration frequency in the y-direction is 60Hz, a resolution of 2k and a refresh rate of 60Hz can be achieved. The micro-actuator in the x-direction can be a high-frequency piezoelectric ceramic actuator, and the micro-actuator in the y-direction can be a piezoelectric moving platform, a piezoelectric stepping motor, or a one-dimensional deflection stage. In the case of 2D microactuators, a high frequency 2D deflection stage can be chosen to achieve deflection in both directions simultaneously. The pulse timing of the laser light source can be controlled to match the displacement curve of the micro-actuator to project equally spaced light spots. For example, when the moving curve is a sine wave, by modulating the pulse sequence, the output at equal intervals can be achieved, as shown in Figure 11. At each next subframe, the micro-actuator moves the light spot corresponding to the array light source to the position corresponding to the subframe, and the VCSEL driver 1422 drives the array light source of each light source array module according to the grayscale corresponding to this subframe, Its response time is in the ns level, which can display the grayscale distribution of the corresponding subframe on the image. In one example, the VCSEL driver 1422 respectively drives the light source array modules that emit light of corresponding colors according to the grayscales corresponding to different color components of the subframe. The light spots of different colors emitted by the three light source array modules correspond to the grayscales of different color components of the subframe. For each color component, the sparse array light spots of multiple subframes are time-division multiplexed to obtain close-packed pixels within one frame time.

The obtained close-packed pixels are combined by the light combining module 1440 for RGB three-color light, and then optically amplified by the imaging module 1450, and finally projected on the screen to realize color imaging. RGB three-color light sources need to achieve pixel-level alignment and require time-shift up-synchronization.

This embodiment reduces the vibration bandwidth of the two-dimensional micro-actuator by sparse lattice light source, realizes grayscale by directly driving the light source, does not require an additional spatial light modulator, the system is simple, the volume is small, and the efficiency is high. High resolution while enabling high dynamic contrast. Due to the large number of light sources used, the speckle effect of the laser can be effectively reduced.

15 shows a schematic structural diagram of a display device according to another embodiment of the present application, wherein three-color Micro LEDs are used as the sparse array light source of the light source array module, and MEMS scanning mirrors or phase deflection devices are used as the spot shifting device to achieve beam scanning/spot shifting. Wherein, the decoder 1521, the LED driver 1522, the scanning device driver 1523 and the synchronization device 1524 are respectively equivalent to the processor 121, the light source driver 122, the spot shift controller 123 and the synchronization unit 124 that constitute the control module 120 as before.

After the video source is decoded by the decoder 1521, it is transmitted to the LED driver 1522 and the scanning device driver 1523, and the synchronization device 1524 ensures that the two are synchronized. The overall scheme is shown in Figure 15. The function of the phase deflector/MEMS mirror 1530 as a light spot shift device is to realize beam deflection, thereby realizing light spot shift. The phase deflector uses the diffraction principle of light to realize the deflection of the main light level by modulating the phase of the light. Typical devices such as acousto-optic deflectors and liquid crystals. MEMS uses piezoelectric ceramics as the driving source, which can realize two-dimensional fast flipping, and realize beam deflection using the principle of light reflection.

The diameter of a single Micro LED light source is about 15 microns. In this embodiment, each light source of the LED light source array 1510 is a combined light source composed of three Micro LED light sources emitting R, G, and B lights, placed together. 16 shows a schematic diagram of a Micro LED combined light source according to an embodiment of the present application. Three Micro LED light sources respectively emitting R, G, and B light are placed close to each other and arranged in a triangle. The diameter of the combined light source is about 40 microns.

Assuming that the spacing of each combined light source in the x and y directions is 400 microns, there are 200 light sources in the x direction and 100 light sources in the y direction, the entire Micro LED light source array is about 80mm long and 40mm wide. Then, when the scanning frequency in the x-direction is 600 Hz and the scanning frequency in the y-direction is 60 Hz, a resolution of 2k and a refresh rate of 60 Hz can be achieved. When the acousto-optic deflector is used as the beam deflecting device, since the response time of the acousto-optic deflector is in the ns level, the densely packed pixel point arrangement can be realized without the need for pulse driving of the light source. The response time of the LED driver 1522 is in the ns level. By driving the array light source according to the grayscale corresponding to the subframe, the grayscale distribution of the corresponding subframe is displayed on the image. The obtained densely packed pixel points are optically enlarged by the imaging module 1540, and finally projected onto the screen to obtain a color image.

In this embodiment, the control bandwidth of the light source and the vibration frequency of the micro-actuator are reduced by sparse dot-matrix light sources, and grayscale is realized by directly driving the light source, and no additional spatial light modulator is required. Since the three light sources of the GRB are combined into one combined light source, a light combining device is not required, and there is no need to consider the synchronization accuracy of the three-color light sources. The system is simple, small in size, high in efficiency, high in resolution, and capable of achieving high dynamic contrast.

The above are only the embodiments of the present application, and are not intended to limit the scope of the patent of the present application. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present application, or directly or indirectly applied in other related technical fields, All are similarly included in the scope of patent protection of the present application.

Claims

An imaging method, comprising:

Decomposing a frame of target image to obtain a plurality of subframes, wherein at least one pixel of other subframes is inserted between at least two adjacent pixels of each subframe;

According to the pixel position of each subframe, move the position of the light spot emitted by the light source array module according to the time sequence through the light spot shifting device, so that the position of the light spot corresponds to each subframe in turn;

imaging the light spots corresponding to the plurality of subframes emitted by the light source array module to obtain image light,

Wherein, the light source array module includes a plurality of light sources, and the light beam emitted by each light source in the plurality of light sources forms a light spot corresponding to one pixel of the target image. The positions of the plurality of light spots formed by the plurality of light sources correspond one-to-one with the positions of the plurality of pixels included in the subframe.
The imaging method according to claim 1, wherein the density of the array in which the plurality of light sources are arranged is smaller than the density of the pixel distribution of the target image.
The imaging method according to claim 1 or 2, wherein the method further comprises:

The brightness of each of the plurality of light sources is controlled according to the grayscale distribution of each subframe, so that each light spot of the plurality of light sources forms the grayscale of the corresponding pixel of the subframe at the moment corresponding to the subframe degree display.
The imaging method according to claim 3, wherein controlling the brightness of each light source in the plurality of light sources according to the grayscale distribution of each subframe comprises:

Determine the brightness of each light source in the light source array module at the moment of the subframe according to the grayscale distribution of each subframe;

generating, for each light source, a driving signal for driving the light source to emit light of the determined brightness according to the determined brightness of each light source;

At the moment of each subframe, the plurality of light sources emit light under the driving of corresponding driving signals to form a light spot corresponding to the subframe.
The imaging method of claim 4, further comprising:

The light source driver is controlled to be synchronized with the light spot shifting device according to the plurality of subframes, so that the light spot shifting device moves the light spots of the plurality of light sources to a corresponding subframe of each of the plurality of subframes. When the light source driver is in the position, the light source driver drives the light source array module to emit light corresponding to the grayscale distribution of the subframe.
The imaging method according to claim 1, wherein the plurality of light sources of the light source array module is an M×N array, the target image includes X×Y pixels, and the target image includes subframes The quantity is a×b, where X=M*a, Y=N*b.
The imaging method according to claim 1, wherein the plurality of subframes comprise a first subframe, wherein one or more other subframes are interposed between every two adjacent pixels of the first subframe One or more pixels of the frame.
The imaging method according to claim 1, wherein, according to the pixel position of each sub-frame, moving the position of the light spot emitted by the light source array module according to the time sequence by the light spot shifting device comprises:

generating, for each subframe, a shift control signal for controlling the light spot shifting device to move the light spot to a position corresponding to the subframe according to the pixel position of each subframe;

The position of the light spot is shifted by the light spot shifting device according to the shift control signal of each subframe.
The imaging method according to claim 1, wherein the light spot shifting device moves the positions of the light spots by moving the positions of the plurality of light sources.
The imaging method according to claim 1, wherein the light spot shifting device moves the position of the light spot formed by the light beams by deflecting the directions of the light beams emitted by the plurality of light sources.
The imaging method according to claim 1, wherein each light source in the plurality of light sources is a pulse-driven laser light source, and the laser light source is configured to shift the light spot to a position in the light spot shifting device. Lights up at the target location.
The imaging method according to claim 1, wherein each light source in the plurality of light sources is a pulse-driven laser light source, and the laser light source is configured to shift the light spot to a position in the light spot shifting device. When the target position is illuminated, the imaging method further includes:

The timing of the pulses for driving the laser light source and the movement of the light spot shifting device are controlled, so that the laser light source emits equidistant light spots along with the movement of the light spot shifting device.
The imaging method according to claim 1, wherein the method further comprises:

irradiating the image light onto the object to be measured;

The image light modulated by the object to be measured is collected by the collection module;

The modulated image light collected by the collection module is processed by the image processing module to obtain the three-dimensional information of the object to be measured.
The imaging method according to claim 1, wherein,

The light source array module includes a first light source array module, a second light source array module and a third light source array module, the first light source array module includes a plurality of first light sources that emit light with a first color, and the second light source array module includes a plurality of second light sources emitting light with a second color, and the third light source array module includes a plurality of third light sources emitting light with a third color;

The light spot shift device includes a first light spot shift device for moving the light spot of the first light source array module, a second light spot shift device for moving the light spot of the second light source array module, and a third light source array for moving the light source array. a third light spot shift device for the light spot of the module;

The moving the position of the light spot emitted by the light source array module through the light spot shifting device according to the time sequence according to the pixel position of each subframe includes: sequentially or simultaneously controlling the displacement of the first light spot according to the pixel position of each subframe. device, the second light spot shifting device and the third light spot shifting device, so that the plurality of first light sources, the plurality of second light sources and the plurality of light sources at the time corresponding to the subframe The positions of the light spots of the second light source and the third light source correspond one-to-one with the positions of the pixels included in the subframe.
15. The imaging method of claim 14, wherein each subframe of the target image is decomposed into a first subframe component having a first color component, a second subframe component having a second color component, and a second subframe component having a second color component For the third subframe component of the third color component, the independently controlling the brightness of each light source in the plurality of light sources according to the grayscale distribution of each subframe includes:

The brightness of each of the plurality of first light sources is independently controlled according to the grayscale distribution of the first sub-frame component, so that each light spot of the plurality of first light sources forms at a moment corresponding to the sub-frame grayscale display of the first subframe component;

The brightness of each of the plurality of second light sources is independently controlled according to the grayscale distribution of the second sub-frame component, so that each light spot of the plurality of second light sources forms at a moment corresponding to the sub-frame grayscale display of the second subframe component;

The brightness of each of the plurality of third light sources is independently controlled according to the grayscale distribution of the third subframe component, so that each light spot of the plurality of third light sources forms at a time corresponding to the subframe Grayscale display of the third subframe component.
The imaging method of claim 15, wherein the method further comprises:

combining the light spots of the plurality of first light sources, the plurality of second light sources and the plurality of third light sources;

The imaging of the light spots corresponding to the plurality of subframes emitted by the light source array module to obtain the image light includes: imaging the light spots after combining light to obtain the image light.
The imaging method according to claim 1, wherein the method further comprises:

The image light is projected onto the screen.