CN117055318A - Imaging method of holographic image, system and main control equipment thereof - Google Patents
Imaging method of holographic image, system and main control equipment thereof Download PDFInfo
- Publication number
- CN117055318A CN117055318A CN202310877088.4A CN202310877088A CN117055318A CN 117055318 A CN117055318 A CN 117055318A CN 202310877088 A CN202310877088 A CN 202310877088A CN 117055318 A CN117055318 A CN 117055318A
- Authority
- CN
- China
- Prior art keywords
- light beam
- camera
- holographic image
- lens
- sample
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 80
- 238000005259 measurement Methods 0.000 claims abstract description 60
- 230000003287 optical effect Effects 0.000 claims description 33
- 238000000034 method Methods 0.000 claims description 25
- 238000013507 mapping Methods 0.000 claims description 7
- 238000009647 digital holographic microscopy Methods 0.000 description 13
- 238000005070 sampling Methods 0.000 description 10
- 230000006835 compression Effects 0.000 description 9
- 238000007906 compression Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 239000011159 matrix material Substances 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 239000004005 microsphere Substances 0.000 description 4
- 230000033001 locomotion Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000002123 temporal effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000009087 cell motility Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/10—Processes or apparatus for producing holograms using modulated reference beam
- G03H1/12—Spatial modulation, e.g. ghost imaging
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
- G03H2001/005—Adaptation of holography to specific applications in microscopy, e.g. digital holographic microscope [DHM]
Abstract
The invention discloses an imaging method of a holographic image, which is applied to an imaging system of the holographic image, and comprises the steps of dividing a light beam emitted by a laser emitter to a sample to be imaged into a first light beam and a second light beam through a beam splitter; receiving the first light beam by using a spatial light modulator, and reflecting the first light beam to a camera according to a preset angle; controlling the camera to receive the first light beam and the second light beam, and generating a measurement image according to the first light beam and the second light beam; inversion and reconstruction are performed on the measurement image to obtain a holographic image of the sample to be imaged. The imaging method disclosed by the invention can solve the problem of slower imaging speed of the traditional DHM. In addition, the invention also discloses an imaging system and a main control device of the holographic image.
Description
Technical Field
The invention relates to the technical field of holographic microscopes, in particular to an imaging method of a holographic image, a system and main control equipment thereof.
Background
Digital holographic microscopy (digital holographic microscopy, DHM) is a powerful microscopic imaging technique that can measure tiny structures such as microspheres and living cells. DHM technology is capable of recording the entire wavefront of a three-dimensional scene in a non-invasive and label-free manner. By using a detector such as a CCD or CMOS, an interference pattern between the object light and the reference light is digitally recorded and stored. Using two-dimensional (2D) holograms, the amplitude and quantitative phase distribution of an object can be reconstructed using appropriate algorithm values.
In the current digital holographic microscopy, two-dimensional imaging speed is an important indicator of DHM. However, the two-dimensional imaging speed of DHM is still limited by the camera acquisition speed. DHM cannot capture transient motion of microscopic objects at a speed faster than the maximum acquisition speed of the camera, and the signal-to-noise ratio of the image drops faster as the image acquisition speed increases.
Disclosure of Invention
The invention mainly aims to provide an imaging method of a holographic image, a system thereof and a main control device, and aims to solve the problem that the imaging speed of the traditional DHM is low.
In order to achieve the above object, the present invention provides an imaging method of a holographic image, which is applied to an imaging system of the holographic image, the imaging method of the holographic image comprising:
dividing a light beam emitted by a laser emitter to a sample to be imaged into a first light beam and a second light beam by a beam splitter;
receiving the first light beam by using a spatial light modulator, and reflecting the first light beam to a camera according to a preset angle;
controlling the camera to receive the first light beam and the second light beam, and generating a measurement image according to the first light beam and the second light beam;
inverting and reconstructing the measurement image to obtain a holographic image of the sample to be imaged.
Preferably, the generating a measurement image from the first light beam and the second light beam includes:
generating a plurality of scene frames according to the second light beam;
generating a coded mask from the first beam;
and modulating and mapping the scene frame according to the coding mask to obtain a measurement frame of the measurement image.
Preferably, the modulating and mapping the scene frame according to the encoding mask to obtain a measurement frame of the measurement image includes:
calculating the measurement frame according to a preset formula, wherein the preset formula is as follows:y represents the measurement frame; n represents noise->C b C (: b) represents the b-th encoding mask, +.>X b X (: b) represents the scene frame corresponding to the encoding mask,the product by element; b represents a B frame.
Preferably, the inverting and reconstructing the measurement image to obtain a holographic image of the sample to be imaged includes:
calculating a measured value of each measuring frame in the measuring image;
calculating a corresponding inversion estimation solution according to the measured value;
reconstructing the inversion estimation solution according to a reconstruction algorithm to obtain a reconstructed estimation solution;
and generating the holographic image according to the reconstruction estimation solution.
Preferably, the receiving the first light beam by using a spatial light modulator and reflecting the first light beam to a camera at a preset angle includes:
the spatial light modulator is controlled to rotate 45 ° about its panel normal, with the reflected light parallel to the light table, and the incident light is kept 24 ° from the panel normal of the spatial light modulator.
Preferably, after said controlling said spatial light modulator to rotate 45 ° around its panel normal such that the reflected light is parallel to the light table and the incident light is kept 24 ° from the panel normal of said spatial light modulator, the imaging method of said holographic image further comprises:
the camera is controlled to tilt 45 ° to align the pixel array of the camera with the micromirror unit array of the spatial light modulator.
Preferably, the beam emitted from the laser emitter to the sample to be imaged is split into a first beam and a second beam by a beam splitter, including:
the laser beam emitted by the laser emitter is sequentially incident to the beam splitter through the beam expander, the first lens, the objective lens, the Fresnel biprism and the second lens;
and uniformly moving a sample stage on which the sample to be imaged is placed.
The invention further provides an imaging system of the holographic image, which comprises a laser emitter, a spatial light modulator, a camera, a beam splitter and a control device, wherein the beam splitter is arranged between the spatial light modulator and the camera;
the laser beam is incident to the beam splitter after passing through a sample to be imaged, and is split into a first beam and a second beam by the beam splitter, wherein the first beam is incident to the spatial light modulator and is reflected to the camera by the spatial light modulator according to a preset angle;
the control device is used for:
controlling the laser emitter to emit a laser beam to the sample to be imaged;
controlling the camera to receive the first light beam and the second light beam, and generating a measurement image according to the first light beam and the second light beam;
inverting and reconstructing the measurement image to obtain a holographic image of the sample to be imaged.
Preferably, the imaging system of the holographic image further comprises a first optical device arranged between the laser transmitter and the beam splitter, the first optical device comprises a beam expander, a first lens, an objective lens, a fresnel biprism and a second lens, and the laser beam emitted by the laser transmitter is incident to the beam splitter through the beam expander, the first lens, the objective lens, the fresnel biprism and the second lens in sequence.
Preferably, the imaging system of the holographic image further comprises a sample stage for placing a sample to be imaged, the sample stage being located between the first lens and the objective lens; the control device is also used for: and controlling the sample table to uniformly move.
Preferably, the control device is further configured to:
controlling a panel of the spatial light modulator to rotate 45 degrees around a panel normal, so that an included angle between the first light beam and the panel normal is 24 degrees when the first light beam is incident to the spatial light modulator; the camera is mounted at 45 ° tilt to align the pixel array of the camera with the micromirror cell array of the spatial light modulator.
Preferably, the imaging system of the holographic image further comprises a second optical device arranged between the beam splitter and the camera, the second optical device comprises a third lens and a fourth lens, and the second light beam and the first light beam reflected by the spatial light modulator sequentially pass through the third lens and the fourth lens to be incident to the camera.
The invention further provides a master control device, which comprises:
a memory for storing program instructions; and
and a processor for executing the program instructions to implement the method of imaging a holographic image as described above.
The technical scheme of the invention has the beneficial effects that: the snapshot time compression imaging (Snapshot compressive imaging, SCI) technology is applied to digital microscopic holographic imaging to obtain a snapshot time compression digital holographic microscopic (Snapshot temporal compressive digital holographic microscopy, STC-DHM) imaging system, high-speed frames of measurement images are modulated at a speed higher than the time sampling rate of a camera, a plurality of frames are reconstructed from each measurement image, a high-quality holographic image is inverted by modulating a proper compression ratio, the limitation of the acquisition speed of the camera can be overcome by snapshot compression imaging, a high-speed and high-quality scene is captured, the limitation of the imaging speed of a traditional digital holographic microscope is broken, and therefore the change process of three-dimensional phase information of a dynamic scene can be observed in a very short time, and the imaging speed is fast and clear.
Drawings
Fig. 1 is a flowchart of a method for imaging a holographic image according to an embodiment of the present invention.
Fig. 2 is a first sub-flowchart of a method for imaging a holographic image according to an embodiment of the present invention.
Fig. 3 is a second sub-flowchart of a method for imaging a holographic image according to an embodiment of the present invention.
Fig. 4 is a schematic diagram of an imaging system for a holographic image according to an embodiment of the present invention.
Fig. 5 is a schematic view of the sample to be imaged shown in fig. 1.
Fig. 6 is a measurement image of the sample to be imaged shown in fig. 1.
Fig. 7 is a holographic image of the sample to be imaged shown in fig. 1.
Fig. 8 is a schematic diagram of an internal structure of a master control device according to an embodiment of the present invention.
Fig. 9 is a schematic diagram of an internal structure of an imaging system for a holographic image according to an embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
The following description of the embodiments of the present invention will be made more clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that all directional indicators (such as up, down, left, right, front, and rear are used in the embodiments of the present invention) are merely for explaining the relative positional relationship, movement conditions, and the like between the components in a certain specific posture (as shown in the drawings), and if the specific posture is changed, the directional indicators are changed accordingly.
It will also be understood that when an element is referred to as being "mounted" or "disposed" on another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present.
Furthermore, the description of "first," "second," etc. in this disclosure is for descriptive purposes only and is not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In addition, the technical solutions of the embodiments may be combined with each other, but it is necessary to base that the technical solutions can be realized by those skilled in the art, and when the technical solutions are contradictory or cannot be realized, the combination of the technical solutions should be considered to be absent and not within the scope of protection claimed in the present invention.
Referring to fig. 4 and fig. 9 in combination, fig. 4 is a schematic diagram of an imaging system for a holographic image according to an embodiment of the present invention, and fig. 9 is a schematic diagram of an internal structure of the imaging system for a holographic image according to an embodiment of the present invention. The imaging system 1 for holographic images comprises a laser emitter 20, a spatial light modulator 40, a camera 30, a beam splitter 60 and a control device 90, the control device 90 being in communication with the laser emitter 20, the spatial light modulator 40, the camera 30, respectively. The beam splitter 60 is disposed between the spatial light modulator 40 and the camera 30, and the sample to be imaged is located on the optical path between the laser emitter 20 and the beam splitter 60.
The control device 90 is used for controlling the laser emitter 20 to emit a laser beam to the sample to be imaged, and the laser beam irradiates the sample to be imaged. Wherein the laser light emitted by the laser emitter 20 has a wavelength of 632nm.
In this embodiment, the laser beam is incident to the beam splitter 60 after passing through the sample to be imaged, and is split into a first beam and a second beam by the beam splitter 60. The first light beam is incident on the spatial light modulator 40 and reflected by the spatial light modulator 40 to the camera 30 at a preset angle. It will be appreciated that after passing through the sample to be imaged, the laser beam is incident on a beam splitter 60 located between the spatial light modulator 40 and the camera 30, and is split by the beam splitter 60 into a first beam and a second beam propagating in opposite directions. Wherein the spatial light modulator 40, the camera 30 and the beam splitter 60 are positioned on the same line. Beam Splitter 60 is a Beam Splitter (BS), and spatial light modulator 40 is a digital micromirror device (Digital Micromirror Devices, DMD), model number may be vilux, V-9601.
The control device 90 is configured to control the camera 30 to receive the first light beam and the second light beam and generate a measurement image according to the first light beam and the second light beam. In the present embodiment, the second light beam formed by the beam splitter 60 is directly incident on the camera 30. The control device 90 controls the spatial light modulator 40 and the camera 30 to synchronize so that the first light beam and the second light beam have synchronicity. The camera 30 generates a measurement image from the first light beam and the second light beam, and transmits the measurement image to the control device 90. Wherein the first light beam introduces a time-varying spatial modulation, i.e. a random binary pattern or mask, via reflection by the spatial light modulator 40.
The control device 90 is used for inverting and reconstructing the measurement image to obtain a holographic image of the sample to be imaged.
In some embodiments, the imaging system 1 for holographic images further comprises a first optical device 70 arranged between the laser emitter 20 and the beam splitter 60. The first optical device 70 includes a beam expander 71, a first lens 72, an objective lens 73, a fresnel double prism 74, and a second lens 75, and the laser beam emitted from the laser emitter 20 is incident on the beam splitter 60 via the beam expander 71, the first lens 72, the objective lens 73, the fresnel double prism 74, and the second lens 75 in this order.
In the present embodiment, the laser emitter 20, the beam expander 71, the first lens 72, the objective lens 73, the fresnel double prism 74, the second lens 75, and the beam splitter 60 are positioned on the same straight line. It will be appreciated that the optical path formed by the first optical device 70 is rectilinear. The laser beam emitted from the laser emitter 20 is incident on the beam splitter 60 via the optical path of the first optical device 70. Wherein the first lens 72 and the second lens 75 constitute a 4f system.
In some possible embodiments, the first optical device 70 further comprises a mirror 76 and a fifth lens 77. In the present embodiment, the laser emitter 20, the beam expander 71, the first lens 72, and the mirror 76 are positioned on the same straight line, and the mirror 76, the objective lens 73, the fresnel double prism 74, the second lens 75, the fifth lens 77, and the beam splitter 60 are positioned on the same straight line. It will be appreciated that the optical path formed by the first optical device 70 is L-shaped.
In some embodiments, the imaging system 1 of the holographic image further comprises a sample stage 50 for placing the sample to be imaged, the sample stage 50 being located between the first lens 72 and the objective lens 73. The control device 90 is also used to control the uniform movement of the sample stage 50.
It will be appreciated that the sample stage 50 is positioned in the optical path of the first optical device 70 and that the laser beam emitted by the laser emitter 20 impinges on the sample stage 50 as it passes through the optical path of the first optical device 70. In this embodiment, the laser transmitter 20 is located on one side of the sample stage 50, and the spatial light modulator 40, the camera 30, and the beam splitter 60 are located on the other side of the sample stage 50. The control device 90 controls the sample stage 50 to rotate at a constant speed.
In some possible embodiments, when the first optical device 70 includes a mirror 76, the sample stage 50 is disposed between the mirror 76 and the objective 73.
In some embodiments, the control device 90 is further configured to control the panel of the spatial light modulator 40 to rotate 45 ° about the panel normal such that the first light beam is incident on the spatial light modulator 40 at an angle of 24 ° with respect to the panel normal. The camera 30 is mounted at an angle of 45 deg. to align the pixel array of the camera 30 with the micromirror cell array of the spatial light modulator 40.
In this embodiment, the first light beam reflected from the spatial light modulator 40 is parallel to the optical bench to reduce distortion of the modulated scene. Camera 30 may be mounted on a fine tuning platform to achieve a 1-to-1 pixel match between spatial light modulator 40 and camera 30, thereby maximizing the resolution of the holographic image obtained by the imaging system. The optical stage is an optical stage, and the imaging system 1 for the hologram is disposed on the optical stage (not shown), and the fine adjustment stage may be disposed on the optical stage.
In some embodiments, the sampling frequency of spatial light modulator 40 is greater than the sampling frequency of camera 30.
In this embodiment, the sampling frequency of the spatial light modulator 40 may be 10 times the sampling frequency of the camera 30, for example, the sampling frequency of the camera 30 is 50Hz, and the sampling frequency of the spatial light modulator 40 is 500Hz, so that the compression ratio between the spatial light modulator 40 and the camera 30 is 10, i.e., the number of compressed scene frames in each camera frame. Where the frame rate of spatial light modulator 40 may be 22000fps, the temporal resolution of the reconstructed scene may be determined. In some possible embodiments, the ratio between the sampling frequency of the spatial light modulator 40 and the sampling frequency of the camera 30 may be set according to the actual imaging situation, which is not limited herein.
In some embodiments, the imaging system 1 of the holographic image further comprises a second optical device 80 arranged between the beam splitter 60 and the camera 30, the second optical device 80 comprising a third lens 81 and a fourth lens 82. The second light beam and the first light beam reflected by the spatial light modulator 40 are sequentially incident to the camera 30 through the third lens 81 and the fourth lens 82.
In the present embodiment, the third lens 81 and the fourth lens 82 constitute a 4f system. Wherein the beam splitter 60, the third lens 81, the fourth lens 82, and the camera 30 are positioned on the same line. The second light beam split by the beam splitter 60 is sequentially incident to the camera 30 through the third lens 81 and the fourth lens 82, and the first light beam modulated via the spatial light modulator 40 is then sequentially incident to the camera 30 through the third lens 81 and the fourth lens 82.
Referring to fig. 1 in combination, a flowchart of a method for imaging a holographic image according to an embodiment of the present invention is shown. The imaging method of the hologram image is applied to the imaging system 1 of the hologram image described in the above embodiment for holographically imaging minute structures such as microspheres, living cells, etc. to observe cell movement and microsphere flow in a living biological specimen. The imaging method of the holographic image specifically comprises the following steps.
In step S102, a beam emitted from a laser emitter to a sample to be imaged is split into a first beam and a second beam by a beam splitter.
The laser emitter 20 is controlled to emit a laser beam which is directed to the sample to be imaged. In this embodiment, the laser beam is incident to the beam splitter 60 after passing through the sample to be imaged, and is split into a first beam and a second beam by the beam splitter 60.
In this embodiment, splitting a beam emitted from a laser emitter to a sample to be imaged into a first beam and a second beam by a beam splitter specifically includes: laser beams emitted by a laser emitter are sequentially incident to a beam splitter through a beam expander, a first lens, an objective lens, a Fresnel biprism and a second lens; the sample stage on which the sample to be imaged is placed is moved uniformly.
Taking the light path of the first optical device 70 as an example, the laser beam emitted by the laser emitter 20 passes through the beam expander 71, the first lens 72 and the reflecting mirror 76 in sequence, and irradiates the sample to be imaged under the reflection of the reflecting mirror 76; the laser beam passes through the object lens 73, the Fresnel biprism 74, the second lens 75 and the fifth lens 77 after passing through the sample to be imaged, and then enters the beam splitter 60; the beam splitter 60 splits the laser beam into a first beam and a second beam. In the present embodiment, the laser beam emitted from the laser emitter 20 is spread by the action of the beam expander 71; after passing through the first lens 72, the light is reflected to the sample stage 50 by the reflecting mirror 76 and irradiates the sample to be imaged; the laser beam reflected from the sample to be imaged is incident to the fresnel double prism 74 through the objective lens 73, thereby generating interference fringes.
In this embodiment, if the sample to be imaged is an immovable biological specimen such as dead cells, the sample stage 50 is controlled to move uniformly. Specifically, the sample stage 50 is controlled to rotate at a constant speed so that the sample to be imaged can form a dynamic process on the sample stage 50.
In some embodiments, if the sample to be imaged is a movable microstructure of living cells, microspheres, or the like, there is no need to control the rotation of the sample stage 50, since the movable microstructure can self-form a dynamic scene.
Step S104, the first light beam is received by the spatial light modulator and reflected to the camera according to a preset angle.
In this embodiment, the first light beam is refracted to the spatial light modulator 40 through the beam splitter 60, reflected by the spatial light modulator 40, and then sequentially passes through the third lens 81 and the fourth lens 82 to be incident on the camera 30. The 4f system formed by the first lens 72 and the second lens 75 transfers the dynamic micro scene formed by the sample to be imaged to the spatial light modulator 40 through the beam splitter 60.
In this embodiment, receiving the first light beam by using the spatial light modulator, and reflecting the first light beam to the camera according to a preset angle specifically includes: the spatial light modulator is controlled to rotate 45 ° about its panel normal, with the reflected light parallel to the light table, and the incident light is kept 24 ° from the panel normal of the spatial light modulator.
Specifically, when the first light beam is incident on the spatial light modulator 40, the angle between the first light beam and the normal line of the panel is 24 °; the first light beam reflected off the spatial light modulator 40 is parallel to the optical bench.
In some embodiments, the method of imaging a holographic image after controlling the spatial light modulator to rotate 45 ° about its panel normal such that the reflected light is parallel to the light table such that the incident light is maintained 24 ° from the panel normal of the spatial light modulator further comprises: the camera is controlled to tilt 45 deg. to align the pixel array of the camera with the micromirror unit array of the spatial light modulator.
Step S106, controlling the camera to receive the first light beam and the second light beam, and generating a measurement image according to the first light beam and the second light beam.
The control camera 30 receives the first light beam and the second light beam. In this embodiment, the second light beam is refracted by the beam splitter 60, then sequentially passes through the third lens 81 and the fourth lens 82, and is incident on the camera 30. It will be appreciated that after passing through the sample to be imaged, the laser beam is incident on a beam splitter 60 located between the spatial light modulator 40 and the camera 30, and is split into a first beam and a second beam by the beam splitting action of the beam splitter 60. Wherein the spatial light modulator 40, the camera 30 and the beam splitter 60 are positioned on the same line.
In this embodiment, the spatial light modulator 40 and the camera 30 are synchronized so that the first light beam and the second light beam have synchronicity. The first light beam introduces a time-varying spatial modulation, i.e. a random binary pattern or mask, via reflection by the spatial light modulator 40. The camera 30 generates a measurement image from the first light beam and the second light beam.
For example, fig. 5 shows a sample to be imaged, and fig. 6 shows a measurement frame of 10 dynamic holographic sequences formed by the camera 30 from the first beam and the second beam, i.e. 10 measurement images of the sample to be imaged.
A specific procedure of how the measurement image is generated from the first light beam and the second light beam will be described in detail below.
Step S108, inverting and reconstructing the measured image to obtain a holographic image of the sample to be imaged.
Inversion and reconstruction are carried out on the measured image to obtain a holographic image of the sample to be imaged.
For example, fig. 7 shows the three-dimensional phase of a holographic image of a sample to be imaged reconstructed from the inversion of one measurement frame in fig. 6.
The specific process of inverting and reconstructing the measurement image to obtain a holographic image of the sample to be imaged is described in detail below.
In the above embodiment, the snapshot time compression imaging (Snapshot compressive imaging, SCI) technology is applied to digital microscopic holographic imaging to obtain a snapshot time compression digital microscopic (Snapshot temporal compressive digital holographic microscopy, STC-DHM) imaging system, high-speed frames of measurement images are modulated at a speed higher than the time sampling rate of a camera, a plurality of frames are reconstructed from each measurement image, a high-quality holographic image is inverted by modulating a proper compression ratio, the limitation of the acquisition speed of the camera can be overcome by snapshot compression imaging, a high-speed and high-quality scene is captured, the imaging speed limitation of a traditional digital holographic microscope is broken, and therefore, the change process of three-dimensional phase information of a dynamic scene can be observed in a super-short time, and the imaging speed is fast and clear.
Referring to fig. 2 in combination, a first sub-flowchart of a method for imaging a holographic image according to an embodiment of the present invention is shown. In step S106, generating a measurement image from the first light beam and the second light beam specifically includes the following steps.
Step S202, generating a plurality of scene frames according to the second light beam.
A number of scene frames are generated from the second light beam. Specifically, a scene frame may be represented as:wherein X is a B frame scene frame.
Step S204, generating a coding mask according to the first light beam.
A number of encoding masks are generated from the first beam. Specifically, the encoding mask may be expressed as:wherein C is a B frame encoding mask.
Step S206, modulating and mapping the scene frame according to the coding mask to obtain a measurement frame of the measurement image.
And modulating and mapping the corresponding scene frames according to the coding mask, thereby obtaining a plurality of measurement frames.
In this embodiment, modulating and mapping the corresponding scene frames according to the encoding mask, so as to obtain a plurality of measurement frames includes: and calculating a measurement frame according to a preset formula. Specifically, the preset formula is:where Y represents a measurement frame, which can be expressed as: />N represents noise->C b =c (: b) represents the b-th encoding mask; x is X b ＝X(：，：B) represents a scene frame corresponding to the encoding mask; the product by element; b represents a B frame.
In the above embodiment, the camera generates the corresponding scene frame according to the second light beam with the original information of the sample to be imaged, generates the corresponding encoding mask according to the first light beam with the modulation information of the sample to be imaged, modulates and maps the dynamic scene frame of the B frame according to the B frame encoding mask, thereby obtaining the measurement frame of the measurement image, and samples the high-definition data in a compressed manner to provide powerful support for the reconstruction of the subsequent holographic image.
Please refer to fig. 3 in combination, which is a second sub-flowchart of a method for imaging a holographic image according to an embodiment of the present invention. Step S108 specifically includes the following steps.
Step S302, a measurement value of each measurement frame in the measurement image is calculated.
And calculating a measured value corresponding to each measuring frame. On a mathematical model, the measurement values of a measurement frame can be expressed as: y=hx+n. Wherein, h denotes a coding matrix, wherein,vec () represents the spreading of the columns in the matrix to vector the matrix; the superscript T denotes the transpose of the matrix.
Step S304, calculating a corresponding inversion estimation solution according to the measured value.
And calculating a corresponding inversion estimation solution according to the measured value. In this embodiment, in the case where the measurement value and the coding matrix are determined, the inversion estimation solution of the measurement value may be expressed as:
wherein,representing an inversion estimation solution; r (x) represents regularization or a priori; lambda represents the regularized tuning parameter.
Step S306, reconstructing the inversion estimation solution according to the reconstruction algorithm to obtain a reconstructed estimation solution.
And reconstructing the inversion estimation solution according to a reconstruction algorithm to obtain a reconstruction estimation solution. In this embodiment, the reconstruction inversion process may be represented by a second formula. Specifically, the second formula is:
wherein the reconstruction algorithm is GAP-TV algorithm.
Step S308, generating a holographic image according to the reconstruction estimation solution.
And generating a corresponding holographic image according to the reconstruction estimation solution. In this embodiment, the reconstruction estimation solution is converted into a third equation and a fourth equation. Specifically, the third formula is:
x (k+1) ＝v (k) +H T (HH T ) -1 (y-Hv (k) ) The method comprises the steps of carrying out a first treatment on the surface of the The fourth formula is: v (k+1) ＝D TV (x (k+1) )。
Wherein k represents the number of iterations; d (D) TV Is a TV denoising algorithm.
Solving the third and fourth formulas may result in a holographic image.
In the above embodiment, the measurement frames are inverted and reconstructed according to the measured values of the calculated measurement frames, so that the GAP-TV reconstruction algorithm can provide good imaging effect, and the subsequent introduction of deep learning can further improve the reconstruction quality, reduce noise and obtain a clear holographic image.
Please refer to fig. 8 in combination, which is a schematic diagram illustrating an internal structure of a master control device according to an embodiment of the present invention. The master device 10 includes a memory 11 and a processor 12. The memory 11 is for storing program instructions and the processor 12 is for executing the program instructions for implementing the above-described imaging method of the holographic image.
The processor 12 may be, in some embodiments, a central processing unit (Central Processing Unit, CPU), controller, microcontroller, microprocessor or other data processing chip for executing program instructions stored in the memory 11.
The memory 11 includes at least one type of readable storage medium including flash memory, a hard disk, a multimedia card, a card memory (e.g., SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, etc. The memory 11 may in some embodiments be an internal storage unit of a computer device, such as a hard disk of a computer device. The memory 11 may in other embodiments also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the computer device. Further, the memory 11 may also include both an internal storage unit and an external storage device of the computer device. The memory 11 may be used not only for storing application software installed in a computer device and various types of data, such as codes for implementing an imaging method of a hologram image, etc., but also for temporarily storing data that has been output or is to be output.
The above description of the preferred embodiments of the present invention should not be taken as limiting the scope of the invention, but rather should be understood to cover all modifications, variations and adaptations of the present invention using its general principles and the following detailed description and the accompanying drawings, or the direct/indirect application of the present invention to other relevant arts and technologies.
Claims (13)
1. A method of imaging a holographic image, applied to an imaging system of a holographic image, the method of imaging a holographic image comprising:
dividing a light beam emitted by a laser emitter to a sample to be imaged into a first light beam and a second light beam by a beam splitter;
receiving the first light beam by using a spatial light modulator, and reflecting the first light beam to a camera according to a preset angle;
controlling the camera to receive the first light beam and the second light beam, and generating a measurement image according to the first light beam and the second light beam;
inverting and reconstructing the measurement image to obtain a holographic image of the sample to be imaged.
2. The method of imaging a holographic image of claim 1, in which the generating a measurement image from the first beam and the second beam comprises:
generating a plurality of scene frames according to the second light beam;
generating a coded mask from the first beam;
and modulating and mapping the scene frame according to the coding mask to obtain a measurement frame of the measurement image.
3. The method of imaging a holographic image of claim 2, in which the modulating and mapping the scene frames according to the encoding mask to obtain measurement frames of the measurement image comprises:
calculating the measurement frame according to a preset formula, wherein the preset formula is as follows: y represents the measurement frame; n represents noise->Cb=c (: b) represents the b-th encoding mask, +.>X b =x (: b) represents the scene frame corresponding to the coding mask, ++>The product by element; b represents a B frame.
4. The method of imaging a holographic image of claim 2, in which the inverting and reconstructing the measurement image to obtain a holographic image of the sample to be imaged comprises:
calculating a measured value of each measuring frame in the measuring image;
calculating a corresponding inversion estimation solution according to the measured value;
reconstructing the inversion estimation solution according to a reconstruction algorithm to obtain a reconstructed estimation solution;
and generating the holographic image according to the reconstruction estimation solution.
5. The method of imaging a holographic image of claim 1, in which said receiving said first light beam with a spatial light modulator and reflecting said first light beam at a preset angle to a camera, comprises:
the spatial light modulator is controlled to rotate 45 ° about its panel normal, with the reflected light parallel to the light table, and the incident light is kept 24 ° from the panel normal of the spatial light modulator.
6. The method of imaging a holographic image of claim 5, in which said method of imaging a holographic image further comprises, after said controlling said spatial light modulator to rotate 45 ° about its panel normal such that reflected light is parallel to the light table such that incident light is maintained 24 ° from the panel normal of said spatial light modulator:
the camera is controlled to tilt 45 ° to align the pixel array of the camera with the micromirror unit array of the spatial light modulator.
7. The method of imaging a holographic image of claim 1, in which the beam of light emitted by the laser emitter to the sample to be imaged is split into a first beam and a second beam by a beam splitter, comprising:
the laser beam emitted by the laser emitter is sequentially incident to the beam splitter through the beam expander, the first lens, the objective lens, the Fresnel biprism and the second lens;
and uniformly moving a sample stage on which the sample to be imaged is placed.
8. The imaging system of the holographic image is characterized by comprising a laser emitter, a spatial light modulator, a camera, a beam splitter and a control device, wherein the beam splitter is arranged between the spatial light modulator and the camera;
the laser beam is incident to the beam splitter after passing through a sample to be imaged, and is split into a first beam and a second beam by the beam splitter, wherein the first beam is incident to the spatial light modulator and is reflected to the camera by the spatial light modulator according to a preset angle;
the control device is used for:
controlling the laser emitter to emit a laser beam to the sample to be imaged;
controlling the camera to receive the first light beam and the second light beam, and generating a measurement image according to the first light beam and the second light beam;
inverting and reconstructing the measurement image to obtain a holographic image of the sample to be imaged.
9. The holographic imaging system of claim 8, in which the holographic imaging system further comprises a first optical device disposed between the laser transmitter and the beam splitter, the first optical device comprising a beam expander, a first lens, an objective lens, a fresnel biprism, and a second lens, the laser beam emitted by the laser transmitter being incident on the beam splitter via the beam expander, the first lens, the objective lens, the fresnel biprism, and the second lens in sequence.
10. The imaging system of a holographic image of claim 9, in which the imaging system of a holographic image further comprises a sample stage for positioning a sample to be imaged, the sample stage being located between the first lens and the objective lens; the control device is also used for: and controlling the sample table to uniformly move.
11. The holographic imaging system of claim 8, in which the control means is further for:
controlling a panel of the spatial light modulator to rotate 45 degrees around a panel normal, so that an included angle between the first light beam and the panel normal is 24 degrees when the first light beam is incident to the spatial light modulator; the camera is mounted at 45 ° tilt to align the pixel array of the camera with the micromirror cell array of the spatial light modulator.
12. The holographic imaging system of claim 8, in which the holographic imaging system further comprises a second optical device disposed between the beam splitter and the camera, the second optical device comprising a third lens and a fourth lens, the second light beam and the first light beam reflected by the spatial light modulator being incident to the camera through the third lens and the fourth lens in sequence.
13. A master device, the master device comprising:
a memory for storing program instructions; and
a processor for executing the program instructions to implement the method of imaging a holographic image as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310877088.4A CN117055318A (en) | 2023-07-17 | 2023-07-17 | Imaging method of holographic image, system and main control equipment thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310877088.4A CN117055318A (en) | 2023-07-17 | 2023-07-17 | Imaging method of holographic image, system and main control equipment thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117055318A true CN117055318A (en) | 2023-11-14 |
Family
ID=88665288
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310877088.4A Pending CN117055318A (en) | 2023-07-17 | 2023-07-17 | Imaging method of holographic image, system and main control equipment thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117055318A (en) |
-
2023
- 2023-07-17 CN CN202310877088.4A patent/CN117055318A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Poon et al. | Three-dimensional microscopy by optical scanning holography | |
| EP0988580B1 (en) | Direct-to-digital holography, holographic interferometry, and holovision | |
| JP5130311B2 (en) | System and method for recovering wavefront phase information | |
| CN106097269B (en) | Based on the method for calculating the micro- vision system of high-resolution of ghost imaging and obtaining image | |
| CN107367919B (en) | A kind of digital holographic imaging systems and method | |
| JPWO2019044336A1 (en) | Holographic imaging device and data processing method used for the device | |
| CN113114882B (en) | Fourier single-pixel imaging method with high sampling efficiency | |
| JP2019144520A (en) | Hologram recording device and image playback device | |
| CN212933246U (en) | Phase accelerated reading device for iteration based on single spectrum dynamic sampling | |
| Indebetouw et al. | Space–time digital holography: a three-dimensional microscopic imaging scheme with an arbitrary degree of spatial coherence | |
| CN116183568A (en) | High-fidelity reconstruction method and device for three-dimensional structured light illumination super-resolution microscopic imaging | |
| Wang et al. | Simple and robust digital holography for high-resolution imaging | |
| CN107065488A (en) | The laser hologram direct printer and method of a kind of use frequency domain filtering | |
| CN212391678U (en) | Device for generating vector non-uniform Hermite-associated light beam | |
| JP5552707B2 (en) | Reproducing apparatus, interference measuring apparatus, control program, and recording medium | |
| CN117055318A (en) | Imaging method of holographic image, system and main control equipment thereof | |
| CN110874047A (en) | Method and device for holographing image under endoscope | |
| CN112212807B (en) | Iterative phase acceleration reading method and reading device based on single spectrum intensity image dynamic sampling | |
| Ferraro et al. | Digital holography: recent advancements and prospective improvements for applications in microscopy | |
| CN109804229A (en) | Electromagnetic wave phase amplitude generating means, electromagnetic wave phase amplitude generation method and electromagnetic wave phase amplitude generate program | |
| CN117389124B (en) | High-speed four-dimensional compression holographic microscopic imaging device and method | |
| JP5891567B2 (en) | Digital holography device and three-dimensional image reproduction method using digital holography | |
| CN111596465A (en) | Device for measuring super-resolution ghost imaging quality by using drift light beam | |
| Blatt et al. | Application of acousto-optic cells and video processing to achieve signal-to-noise improvements in variable resolution moire profilometry | |
| JP2003294412A (en) | Holography apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |