TW202009551A - Optical system based on structured lighting technology and application method thereof including a storage module, a signal conversion module, a control module and a digital dimming module - Google Patents

Abstract

This invention discloses an optical system based on a structured lighting technology, including a storage module, a signal conversion module, a control module and a digital dimming module. The signal conversion module is used for decompressing and unpackaging a plurality of packets from a user device after receiving the packets to obtain a plurality of to-be-projected images; and the control module is used for storing the to-be-projected images obtained by the signal conversion module into the storage module. The control module continuously and sequentially transmits the to-be-projected images stored by the storage module to the digital dimming module, and for each of the to-be-projected images, the digital dimming module generates dimmed light related to the to-be-projected images according to the to-be-projected images and projects the dimmed light to a to-be-tested object after receiving the to-be-projected images.

Description

Optical system based on structured light illumination technology and its application method

The invention relates to an optical system, in particular to an optical system based on structured light illumination technology and its application method.

In recent years, structured illumination microscopy (SIM) technology has used structural illumination patterns to illuminate samples, and has successfully broken through the diffraction limit to improve the resolution of two-dimensional or three-dimensional fluorescent images to approximately twice the degree of resolution. .

Structured lighting microscopy is an illumination method that changes the spatial structure of the illumination light. Usually the structured light that is illuminated is a carrier stripe. This illumination method can be used to measure angle, length, vibration, etc., and is widely used in three-dimensional imaging. This special lighting method creates moire fringes to make some high-resolution information that cannot be distinguished under conventional lighting methods visible.

Referring to FIG. 1, the existing structured illumination microscopy technique is that a user device 91 first converts a moiré image to the RGB888 color format, and packs it into multiple packets and compresses the packets, and then passes the high image quality The multimedia interface (High Definition Multimedia Interface, HDMI) transmits the compressed packets to a digital light modulation module 92 (Digital Spatial Light Modulator), which decompresses and decompresses the packets The packet is converted into the moiré image, and then a dimming light is generated according to the moiré image. The dimming light passes through an optical element group 93 to project the moiré image onto an object to be measured 94, followed by a detection The detector 95 detects the object under test 94 to obtain an image of the object under test related to the moiré image, and then the user device 91 repeats the above actions with another moiré image until the detector 95 obtains After a plurality of images of the object to be tested related to different moiré images, the detector 95 obtains high-frequency information according to the images of the object to be measured to improve the resolution of the images of the object to be tested.

However, in the existing structured illumination microscopy technology, the frame rate (Frame Per Second, FPS) of the image projected by the digital light modulation module is too low, which affects the time resolution of repeated detection. During the detection process, when the time resolution is too low and the object to be measured is displaced at the same time, the detection result may be distorted.

Therefore, the object of the present invention is to provide an optical system based on structured light illumination technology that improves the frame rate of images projected by the digital light modulation module.

Therefore, the optical system of the present invention based on structured light illumination technology is suitable for an object to be measured, and is electrically connected to a user device that stores a plurality of images to be projected. The optical system includes a storage module and an electronic device. A signal conversion module connected to the user device, a control module electrically connected to the storage module and the signal conversion module, and a digital light modulation module electrically connected to the control module.

The signal conversion module is used to obtain the wait after decompressing and unpacking the plurality of compressed packets received from the user device and generated by the user device according to the waiting projection image Project the image.

The control module is used to store the waiting projection image obtained by the signal conversion module to the storage module.

Wherein, the control module continuously transmits the waiting projection images stored in the storage module to the digital light modulation module in sequence, and for each of the waiting projection images, when the digital light modulation module When receiving the image to be projected, the digital light modulation module generates a dimming light according to the received image to be projected, and projects the dimming light to the object to be measured.

Another object of the present invention is to provide an optical system application method based on structured light illumination technology that improves the frame rate of images projected by the digital light modulation module.

Therefore, the optical system application method based on structured light illumination technology of the present invention is suitable for an object to be measured, and is electrically connected to a user device that stores multiple images to be projected. The optical system includes a storage module, A signal conversion module electrically connected to the user device, a control module electrically connected to the storage module and the signal conversion module, and a digital light modulation module electrically connected to the control module, the method includes One step (A), one step (B), one step (C), and one step (D).

In this step (A), the signal conversion module decompresses and decompresses these packets after receiving a plurality of compressed packets generated by the user device according to the waiting projection image After unpacking the packet, the waiting projection image is obtained.

In the step (B), the control module stores the waiting projection image obtained by the signal conversion module to the storage module.

In the step (C), the control module continuously transmits the waiting projection images stored by the storage module to the digital light modulation module in sequence.

In this step (D), for each of the images waiting to be projected, when the digital light modulation module receives the image to be projected, the digital light modulation module according to the received image to be projected A modulated light related to the image to be projected is generated, and the modulated light is projected onto the object to be measured.

The effect of the present invention is that: the storage module first stores the waiting projection image, and the control module continuously transmits the waiting projection image stored in the storage module to the digital light modulation module in sequence, It saves the time of packaging the waiting projection image into packets and compressing, and decompressing and unpacking the packets, so as to increase the frame rate of the digital light modulation module to project the waiting projection image.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same number.

Referring to FIG. 2, an embodiment of an optical system based on structured light illumination technology of the present invention is suitable for a test object 2 and is electrically connected to a user device 3 that stores N images to be projected. The optical The system 1 includes a storage module 11, a signal conversion module 12, a control module 13, a digital light modulation module 14, an optical element group 15, and a detector 16. In this embodiment, the object to be measured 2 is placed on a precision mobile platform, the user device 3 is, for example, a personal computer, and the image to be projected is, for example, any image with structural stripes, but not limited to this.

In this embodiment, the storage module 11 is, for example, a flash memory (flash memory), but it is not limited thereto.

The signal conversion module 12 is electrically connected to the user device 3 by a Universal Serial Bus (USB) standard, and is used to receive projections from the user device 3 and the user device 3 according to the waiting projection After a plurality of compressed packets generated by the image, the compressed packets are decompressed and decapsulated to obtain the waiting projection image. In this embodiment, the signal conversion module 12 is, for example, a signal transducer. The signal conversion module 12 is also used to convert the image waiting to be projected into a color format such as RGB888.

The control module 13 is electrically connected to the storage module 11 and the signal conversion module 12 for storing the waiting projection image obtained by the signal conversion module 12 to the storage module 11. In this embodiment, the control module 13 is, for example, a Field Programmable Gate Array (FPGA) control chip, but it is not limited thereto.

The digital light modulation module 14 includes a light source 141, a light modulation array group 142, and a light controller 143 electrically connected to the light source 141, the light modulation array group 142 and the control module 13. In this embodiment, the light modulation array group 142 is, for example, a transmissive liquid crystal array chip. In other embodiments, the light modulation array group 142 may also be, for example, a reflective liquid crystal array chip or a reflective surface Mirror array, but not limited to this.

In this embodiment, the optical element group 15 includes, for example, a lens 151, a beam splitter 152, and a micro-objective lens 153, but not limited thereto.

The detector 16 is used to detect the object 2 to be measured. In this embodiment, the detector 16 is, for example, a camera, used to photograph the object 2 to be tested, but not limited thereto.

2, FIG. 3 and FIG. 4 illustrate how the optical system of the present invention based on structured light illumination technology implements an embodiment of the optical system application method of the present invention based on structured light illumination technology, which includes a stored procedure, and An application after the stored procedure.

The stored program is implemented by the user device 3 and the optical system 1. The steps included in the stored program are described in detail below.

In step S301, initially, the user device 3 stores the first image to be projected, that is, i=1.

In step S302, the user device 3 packages the stored i-th image to be projected into a plurality of packets.

In step S303, the user device 3 compresses the packets into a Low-Voltage Differential Signaling (LVDS) format, and transmits the compressed packets to the signal conversion module 12.

In step S304, the signal conversion module 12 decompresses and decapsulates the packets to obtain the i-th image to be projected.

In step S305, the signal conversion module 12 converts the ith image to be projected into the RGB888 color format.

In step S306, the control module 13 stores the i-th image to be projected into the storage module 11.

In step S307, the user device 3 determines whether the i-th image to be projected is the N-th image to be projected, that is, whether i=N. After determining i=N, the flow ends; otherwise, the flow proceeds to step S308.

In step S308, the user device 3 sets i to i+1 for the (i+1)th image to be projected. Thereafter, steps S302 to S307 are repeated until i=N.

The application program is implemented by the optical system 1, and the steps included in the application program will be described in detail below.

In step S401, initially, the control module 13 stores the first image to be projected stored in the storage module 11, that is, j=1.

In step S402, the control module 13 converts the jth image to be projected stored by the storage module 11 into a low-voltage differential signal format.

In step S403, the control module 13 transmits the converted j-th image to be projected to the light controller 143, and simultaneously transmits a control voltage signal to the detector 16. In this embodiment, the control voltage signal is 3.3 volts or 5 volts, for example. It is worth noting that in other embodiments, the control module 13 may also first transmit the converted jth image to be projected to the digital light modulation module 14, or first transmit the control voltage signal to the The detector 16 is not limited to this.

In step S404, after receiving the jth image to be projected, the light controller 143 adjusts the light modulation array group 142 according to the jth image to be projected. It is worth noting that in this embodiment, the light controller 143 uses the polarization characteristics of light to adjust the polarizer (not shown) of the light modulation array group 142 to block part of the light source from penetrating In other embodiments, if the light modulation array group 142 is a reflective liquid crystal array chip, it is a polarizer for adjusting the light modulation array group 142, blocking part of the light source from reflecting, the light modulation array group If 142 is a reflective mirror array, the light controller 143 adjusts the reflection angle of the mirror in the reflective mirror array.

In step S405, the light controller 143 controls the light source 141 to illuminate the adjusted light modulation array group 142 to generate a modulated light related to the jth image to be projected, and passes the modulated light through the The optical element group 15 projects onto the object to be measured 2.

In step S406, the detector 16 detects the object 2 after receiving the control signal. It is worth noting that in this embodiment, after receiving the control signal, the detector 16 will wait for a predetermined time before detecting the object under test 2 to ensure that the modulated light is projected to the object The object under test 2 is detected after the object under test 2, but not limited to this.

In step S407, the control module 13 determines whether the jth image to be projected is the Nth image to be projected, that is, whether j=N. After determining that j=N, the process ends; otherwise, the process proceeds to step S408.

In step S408, the control module 13 sets j to j+1 for the (j+1)th image to be projected. Thereafter, steps S402 to S407 are repeated until j=N.

It should be particularly noted that the sequence of steps in the above process is only for illustration, and is for those skilled in the art to understand the present invention, rather than limiting the scope of the present invention.

In summary, the optical system based on structured lighting technology and its application method of the present invention first store the waiting projection image with the storage module 11 and continuously store the storage module 11 with the control module 13 The waiting projection images are sequentially sent to the digital light modulation module 14 to save time for packaging the waiting projection images into packets and compressing, and decompressing and unpacking the packets, so as to improve the digital optical modulation module 14 Project the frame rate of the waiting projection image, and sequentially transmit the waiting projection image with the hardware clock of the control module 13 to improve time accuracy. In addition, when the control module 13 transmits each image to be projected, the control signal is also sent to the detector 16 so that the detector 16 detects the object to be tested after receiving the control signal Object 2 can also achieve the effect of synchronization of hardware operations, so it can indeed achieve the purpose of the invention.

However, the above are only examples of the present invention, and the scope of implementation of the present invention cannot be limited by this, any simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the content of the patent specification are still classified as Within the scope of the invention patent.

1‧‧‧Optical system 151‧‧‧Lens 11‧‧‧Storage module 152‧‧‧Split mirror 12‧‧‧Signal conversion module 153‧‧‧Microscopic objective lens 13‧‧‧Control module 16‧‧‧ Detector 14‧‧‧Digital light modulation module 2‧‧‧DUT 141‧‧‧Light source 3‧‧‧User device 142‧‧‧Light modulation array group S301~S308‧‧‧Stored program 143 ‧‧‧Light controller S401~S408‧‧‧‧Application 15‧‧‧Optical component group

Other features and functions of the present invention will be clearly presented in the embodiments with reference to the drawings, where: 　 FIG. 1 is a schematic diagram illustrating the existing optical system based on structured light illumination technology; 　 FIG. 2 is a schematic diagram illustrating the present invention An embodiment of an optical system based on structured light illumination technology; 　 FIG. 3 is a flowchart illustrating a stored procedure of an embodiment of an optical system application method based on structured light illumination technology of the present invention; and FIG. 4 is a flowchart Illustrate an application program of this embodiment of the optical system application method based on structured light illumination technology of the present invention.

1‧‧‧Optical system

11‧‧‧Storage module

12‧‧‧Signal conversion module

13‧‧‧Control module

14‧‧‧Digital Modulation Module

141‧‧‧Light source

142‧‧‧Light modulation array group

143‧‧‧ light controller

15‧‧‧Optical component group

151‧‧‧Lens

152‧‧‧Spectroscope

153‧‧‧Micro Objective

16‧‧‧detector

2‧‧‧ test object

3‧‧‧User device

Claims (8)

An optical system based on structured light illumination technology is suitable for an object to be measured, and is electrically connected to a user device that stores multiple images to be projected. The optical system includes: a storage module; a signal conversion module Group, electrically connected to the user device for decompressing and unpacking the plurality of compressed packets received from the user device and generated by the user device according to the waiting projection image And then obtain the waiting projection image; a control module, which is electrically connected to the storage module and the signal conversion module, for storing the waiting projection image obtained by the signal conversion module to the storage module, and a digital The light modulation module is electrically connected to the control module; wherein, the control module continuously transmits the waiting projection image stored in the storage module to the digital light modulation module in sequence, and the waiting projection image Of each, when the digital light modulation module receives the image to be projected, the digital light modulation module generates a modulated light related to the image to be projected according to the received image to be projected, And project the modulated light onto the object to be measured. The optical system based on structured light illumination technology according to claim 1, further comprising a detector electrically connected to the control module, wherein the control module also transmits a control signal when transmitting each image to be projected To the detector, the detector detects the object to be tested after receiving the control signal. The optical system based on structured light illumination technology as described in claim 1, wherein the signal conversion module is electrically connected to the user device with a universal serial bus standard, and the signal conversion module is further used to project the waiting image Convert to RGB888 color format. The optical system based on structured light illumination technology according to claim 1, wherein the digital light modulation module includes a light source, a light modulation array group, and an electrical connection to the light source, the light modulation array group and The light controller of the control module, the control module sequentially transmits the waiting projection image to the light controller of the digital light modulation module, and the light controller of the digital light modulation module receives After waiting for one of the projected images, the light modulation array group is adjusted according to the received image to be projected, and the light source is controlled to illuminate the adjusted light modulation array group to generate the modulated light, and the The modulated light is projected onto the object to be measured. An application method of an optical system based on structured light illumination technology is suitable for an object to be measured, and is electrically connected to a user device that stores a plurality of images to be projected. The optical system includes a storage module and an electrical connection The signal conversion module of the user device, a control module electrically connected to the storage module and the signal conversion module, and a digital light modulation module electrically connected to the control module, the method includes the following steps: (A) After receiving a plurality of compressed packets from the user device and generated by the user device according to the waiting projection image, the signal conversion module decompresses and decompresses the packets Waiting for projected image; (B) the control module stores the waiting projection image obtained by the signal conversion module to the storage module; (C) the control module continuously stores the waiting for the storage module The projected image is sequentially transmitted to the digital light modulation module; and (D) for each of the waiting images for projection, when the digital light modulation module receives the image to be projected, the digital light modulation module The group generates a modulated light related to the image to be projected according to the received image to be projected, and projects the modulated light to the object to be measured. The optical system application method based on structured light illumination technology as described in claim 5, the optical system further includes a detector electrically connected to the control module, wherein in step (C), the control module transmits each When an image is to be projected, a control signal is also sent to the detector. After step (C), the following steps are included: (E) The detector detects the object under test after receiving the control signal. The method for applying an optical system based on structured light illumination technology according to claim 5, wherein step (A) includes the following sub-steps: (A-1) the signal conversion module receives the packets from the user device; (A-2) The signal conversion module decompresses and decapsulates the packets to obtain the waiting projection image; and (A-3) The signal conversion module converts the waiting projection image into RGB888 color format. The optical system application method based on structured light illumination technology as described in claim 5, the digital light modulation module includes a light source, a light modulation array group, and an electrical connection to the light source, the light modulation array group and The light controller of the control module, wherein step (D) includes the following sub-steps: (D-1) After the light controller receives one of the images waiting to be projected, according to the received image to be projected Adjusting the light modulation array group; and (D-2) the light controller controls the light source to illuminate the adjusted light modulation array group to generate the modulation light and project the modulation light to the object to be measured .

Images