CN111476897A - Non-visual field dynamic imaging method and device based on synchronous scanning stripe camera - Google Patents
Non-visual field dynamic imaging method and device based on synchronous scanning stripe camera Download PDFInfo
- Publication number
- CN111476897A CN111476897A CN202010212152.3A CN202010212152A CN111476897A CN 111476897 A CN111476897 A CN 111476897A CN 202010212152 A CN202010212152 A CN 202010212152A CN 111476897 A CN111476897 A CN 111476897A
- Authority
- CN
- China
- Prior art keywords
- imaged
- synchronous scanning
- imaging
- fringe
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/003—Reconstruction from projections, e.g. tomography
- G06T11/006—Inverse problem, transformation from projection-space into object-space, e.g. transform methods, back-projection, algebraic methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
Abstract
The invention discloses a non-visual field dynamic imaging method and a non-visual field dynamic imaging device based on a synchronous scanning stripe camera, wherein the method comprises the following steps: scanning a plurality of positions of an object to be imaged by moving a light source through a rotating mirror; acquiring a plurality of fringe images at different positions of the object to be imaged by utilizing a plurality of synchronous scanning fringe cameras at different positions; reconstructing the object to be imaged according to a plurality of fringe images at different positions acquired by one synchronous scanning fringe camera and a back projection algorithm to realize static three-dimensional imaging of the object to be imaged; and imaging the object to be imaged according to a plurality of fringe images at different positions acquired by a plurality of synchronous scanning fringe cameras and a time decoupling mode to obtain three-dimensional dynamic information of the object to be imaged. The method can realize high-efficiency high-quality non-visual field imaging.
Description
Technical Field
The invention relates to the technical field of camera imaging, in particular to a non-visual field dynamic imaging method and device based on a synchronous scanning stripe camera.
Background
In recent years, computational photography has become an international leading-edge research in the fields of cross vision, graphics, photography, signal processing and the like, and how to make full use of computational methods to continuously promote new imaging devices has attracted extensive attention. The non-vision field imaging technology is mainly used for detecting hidden objects at corners of urban streets and in houses, can bypass the corners or obstacles to image the hidden target objects, realizes positioning of targets in areas outside sight lines, and has very important significance in improving the imaging performance by fully utilizing the means of calculating camera.
The Non-line-of-vision imaging (Non-line-of-vision imaging) technique is the most different from the conventional optical imaging technique in that it is imaging a hidden object in an area invisible to the human eye. Conventional optical imaging techniques image objects that can be seen through a detector, while non-field-of-view imaging techniques image objects that are specifically intended for hidden objects. The key technology of the technology is that laser is irradiated on a middle interface to perform diffuse reflection, and the light is transmitted to a hidden object after being subjected to one or more times of diffuse reflection, so that the information of the hidden object is indirectly acquired, and finally the hidden object is imaged. Over the last 10 years, non-field imaging techniques have also developed rapidly as laser imaging techniques, detector techniques, and computational imaging techniques have matured. Ahmed Kirmani et al, MIT in 2010, implemented a novel algorithm for understanding temporal image analysis of a scene using a Time of Flight (TOF) camera and multipath analysis; 2011 OveSteinvall et al in Sweden researches the reflection characteristic of window glass, actively illuminates by laser, uses PMD Tec as a receiving detector, and compares the influence of different reflection angles of a window on reflection images and transmission images, and the result shows that the higher the incident angle is, the stronger and clearer the reflection images are; andreas Velten et al, MIT of 2012, utilized time-of-flight measurement techniques and computational reconstruction algorithms to process image information confounded by diffuse reflections; MIT scholars in 2018 adopt the SPAD detector to realize non-vision three-dimensional reconstruction; in 2019, the Vivek adopts a scheme of reverse pinhole imaging, so that the purpose of realizing non-visual field target imaging by adopting a common camera is realized.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art.
Therefore, an object of the present invention is to provide a non-visual field dynamic imaging method based on a synchronous scanning stripe camera, which can realize high-efficiency and high-quality non-visual field imaging.
Another objective of the present invention is to provide a non-visual field dynamic imaging device based on a synchronous scanning stripe camera.
In order to achieve the above object, an embodiment of an aspect of the present invention provides a non-visual field dynamic imaging method based on a synchronous scanning stripe camera, including:
scanning a plurality of positions of an object to be imaged by moving a light source through a rotating mirror;
acquiring a plurality of fringe images at different positions of the object to be imaged by utilizing a plurality of synchronous scanning fringe cameras at different positions;
reconstructing the object to be imaged according to a plurality of fringe images at different positions acquired by one synchronous scanning fringe camera and a back projection algorithm to realize static three-dimensional imaging of the object to be imaged;
and imaging the object to be imaged according to a plurality of fringe images at different positions acquired by a plurality of synchronous scanning fringe cameras and a time decoupling mode to obtain three-dimensional dynamic information of the object to be imaged.
The non-visual field dynamic imaging method based on the synchronous scanning stripe camera provided by the embodiment of the invention utilizes the advantages of the synchronous scanning stripe camera in the aspect of collecting weak light and combines the function of the stripe camera for detecting flight time, a single camera can be used for obtaining static three-dimensional imaging of a non-visual field target, and two cameras are used for obtaining non-visual field three-dimensional dynamic imaging through a time decoupling method. The scheme is easy to operate, and a high-efficiency high-quality non-visual field imaging technology can be realized.
In addition, the non-visual field dynamic imaging method based on the synchronous scanning stripe camera according to the above embodiment of the invention may further have the following additional technical features:
further, in an embodiment of the present invention, the synchronous scanning fringe camera scans the object to be imaged through a high-frequency scanning mode to obtain an integration result after multiple scans.
Further, in one embodiment of the present invention, the rotating mirror is arranged so that the laser emitted by the laser source scans different positions of the object to be imaged.
Further, in an embodiment of the present invention, the synchronous scanning stripe camera converts the changed time information into spatial information in a scanning manner, reversely deduces the flight time through the stripe image, and performs three-dimensional reconstruction on the object to be imaged by using the back projection algorithm.
Further, in an embodiment of the present invention, before the three-dimensional reconstruction of the object to be imaged by using the back projection algorithm, the method further includes: and processing the fringe image through a filtering algorithm.
Further, in an embodiment of the present invention, the multiple synchronous scanning fringe cameras are located at different viewing angles of the object to be imaged, and because there is an interval between the synchronous acquisition times of the synchronous scanning fringe cameras, a time-domain decoupling manner is adopted to obtain a three-dimensional image at another time, and a video mode is used to obtain three-dimensional dynamic information of the object to be imaged in a non-viewing area.
In order to achieve the above object, another embodiment of the present invention provides a non-visual field dynamic imaging apparatus based on a synchronous scanning stripe camera, including: the system comprises a laser source, a spectroscope, a rotating mirror, a plurality of synchronous scanning stripe cameras, a first imaging module and a second imaging module;
the laser source is used for emitting laser;
the spectroscope is used for reflecting the laser and changing the irradiation direction of the laser;
the rotating mirror is used for adjusting the reflection direction of the laser so that the laser scans different positions of the object to be imaged;
the synchronous scanning fringe cameras are arranged at different view angle positions of the object to be imaged and are used for scanning and imaging the object to be imaged to obtain a plurality of fringe images at different positions of the object to be imaged;
the first imaging module is used for reconstructing a plurality of fringe images at different positions acquired by one synchronous scanning fringe camera and a back projection algorithm on the object to be imaged, so as to realize static three-dimensional imaging of the object to be imaged;
the second imaging module is used for imaging the object to be imaged according to a plurality of fringe images at different positions acquired by a plurality of synchronous scanning fringe cameras and a time decoupling mode to obtain three-dimensional dynamic information of the object to be imaged.
The synchronous scanning stripe camera-based non-visual field dynamic imaging device provided by the embodiment of the invention utilizes the advantages of the synchronous scanning stripe camera in the aspect of collecting weak light and combines the function of the stripe camera for detecting flight time, a single camera can be used for obtaining static three-dimensional imaging of a non-visual field target, and two cameras are used for obtaining non-visual field three-dimensional dynamic imaging through a time decoupling method. The scheme is easy to operate, and a high-efficiency high-quality non-visual field imaging technology can be realized.
In addition, the non-visual field dynamic imaging device based on the synchronous scanning stripe camera according to the above embodiment of the invention may further have the following additional technical features:
further, in an embodiment of the present invention, the synchronous scanning fringe camera scans the object to be imaged through a high-frequency scanning mode to obtain an integration result after multiple scans.
Further, in an embodiment of the present invention, the synchronous scanning stripe camera converts the changed time information into spatial information in a scanning manner, reversely deduces the flight time through the stripe image, and performs three-dimensional reconstruction on the object to be imaged by using the back projection algorithm.
Further, in an embodiment of the present invention, the multiple synchronous scanning fringe cameras are located at different viewing angles of the object to be imaged, and because there is an interval between the synchronous acquisition times of the synchronous scanning fringe cameras, a time-domain decoupling manner is adopted to obtain a three-dimensional image at another time, and a video mode is used to obtain three-dimensional dynamic information of the object to be imaged in a non-viewing area.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow chart of a method for non-visual field dynamic imaging based on a synchronous scanning stripe camera according to an embodiment of the invention;
FIG. 2 is a schematic diagram of the operation of a synchronous scanning streak camera according to one embodiment of the present invention;
FIG. 3 is a schematic diagram of non-field of view still imaging according to one embodiment of the present invention;
FIG. 4 is a schematic diagram of non-field-of-view still imaging according to another embodiment of the invention;
fig. 5 is a schematic structural diagram of a non-visual field dynamic imaging apparatus based on a synchronous scanning stripe camera according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The non-visual field dynamic imaging method and device based on the synchronous scanning stripe camera according to the embodiment of the invention are described below with reference to the attached drawings.
A non-visual field dynamic imaging method based on a synchronous scanning fringe camera proposed according to an embodiment of the present invention will be described first with reference to the accompanying drawings.
Fig. 1 is a flowchart of a non-visual field dynamic imaging method based on a synchronous scanning stripe camera according to an embodiment of the present invention.
As shown in fig. 1, the non-visual field dynamic imaging method based on the synchronous scanning stripe camera comprises the following steps:
and step S1, scanning a plurality of positions of the object to be imaged by moving the light source through the rotating mirror.
The laser source emits laser, the laser can be reflected through the spectroscope, the rotating mirror is used for irradiating an object to be imaged, and the shooting position of the laser is designed through the rotating mirror, so that the laser scans different positions of the object to be imaged.
And step S2, acquiring a plurality of fringe images at different positions of the object to be imaged by using a plurality of synchronous scanning fringe cameras at different positions.
The synchronous scanning stripe camera can work in a high-frequency scanning mode of 80M-300MHz, and has great advantages in weak signal imaging because the nature of non-visual field imaging is to image scattered light of a target, and the intensity of the scattered light is weak. The synchronous scanning stripe camera converts the changed time information into space information in a scanning mode, reversely deduces flight time through a stripe image, and performs three-dimensional reconstruction on an object to be imaged by utilizing a back projection algorithm. Algorithms such as filtering need to be added before calculation.
It can be understood that, the synchronous scanning stripe camera scans the object to be imaged in a high-frequency scanning mode to obtain an integration result after multiple scans. Due to the limitation of the stripe image and the cathode slit, the rotating mirror is designed at the light source, so that the imaging target is scanned, and the two-dimensional imaging of the object can be realized.
The synchronous scanning stripe cameras are arranged at different visual angles of the object to be imaged, and acquire stripe images of the whole object to be imaged in the process of moving the laser source by the rotating mirror. Because the stripe camera can only realize space one-dimensional imaging, the stripe image of the whole target can be obtained after the imaging target is scanned by moving the light source through the rotating mirror.
Because the stripe camera can only realize space one-dimensional imaging, the stripe image of the whole target can be obtained after the imaging target is scanned by moving the light source through the rotating mirror, and the non-visual field imaging target can be recovered by adopting a back projection algorithm on the image.
And step S3, reconstructing the object to be imaged according to a plurality of fringe images at different positions acquired by one synchronous scanning fringe camera and a back projection algorithm, and realizing the static three-dimensional imaging of the object to be imaged.
It can be understood that a plurality of stripe images of the whole object to be imaged, which are acquired by one synchronous scanning stripe camera, can be used for recovering a non-visual field imaging target by adopting a back projection algorithm on the images, and reconstructing a 3D structure of the object to be imaged.
And step S4, imaging the object to be imaged according to a plurality of fringe images at different positions acquired by the synchronous scanning fringe cameras and a time decoupling mode to obtain three-dimensional dynamic information of the object to be imaged.
One camera can only see static images, and states at different moments can be seen through time domain decoupling of the two cameras so as to achieve the purpose of dynamic imaging.
The two cameras image at different visual angles, and because the two cameras synchronously acquire images at intervals in time, a three-dimensional image at another moment is obtained in a time domain decoupling mode, and three-dimensional dynamic information of a non-visual field target can be obtained in a video mode.
In one embodiment of the present invention, two synchronous scanning streak cameras are used, and one of the cameras is used to collect streak images of the whole object to be imaged first, wherein the 3D structure of the object to be imaged can be reconstructed from the streak images of one synchronous scanning streak camera. And finally, according to the fringe images acquired by the two synchronous scanning fringe cameras and by utilizing a time decoupling mode, the states of the object to be imaged at different moments can be obtained, so that the dynamic three-dimensional information of the object to be imaged is obtained.
Therefore, the stripe camera has ultrahigh time resolution, and the synchronous scanning stripe camera can realize low-light detection on extremely weak optical signals in a multi-scanning accumulation mode by taking high-frequency sinusoidal signals as scanning signals. The non-visual field imaging is to image scattered light of a non-visual field target, most of the scattered light is formed by reflected light of the imaged target after multiple reflection and scattering, so the light intensity is extremely weak, in view of the advantage of a synchronous scanning stripe camera in the aspect of low-light imaging, the stripe camera is used as a detector for the non-visual field imaging, as one camera can only realize static images, two cameras are used for time-sharing collection in order to obtain dynamic images, and finally, the non-visual field dynamic imaging is obtained in a time decoupling mode.
As shown in fig. 2, the working principle of the synchronous scanning stripe camera is demonstrated, the stripe image converter converts the ultrafast optical signal into an electronic signal through the photocathode, converts the electronic signal into a one-dimensional space signal through the slit, and finally converts the electronic image changing along with time into an optical signal changing along with space through the acceleration, focusing and scanning processes of the system by the fluorescent screen; the high-low voltage power supply module mainly provides a static electric field for the image converter tube to finish the acceleration, focusing and other processes of photoelectrons; the scanning control module provides high-voltage slope voltage for the scanning deflection system to complete ultrafast scanning and deflection of electronic signals and realize conversion from time information to space information; the image intensifier has the function of intensifying weak image signals from the fluorescent screen of the fringe image converter to a recordable level; the internal intensifier omits a photocathode of the internal intensifier, and directly realizes photoelectron multiplication through a microchannel plate; the image acquisition system couples the optical image output by the image intensifier to the photosensitive surface of the charge coupled device, and realizes the recording of image signals through the generation, storage and transmission processes of signal charges.
As shown in fig. 3, a non-visual field imaging principle when a synchronous scanning stripe camera is used is shown, Wall is within the visual fields of a femtosecond laser and the stripe camera, a laser pulse emitted by the femtosecond laser is applied to Wall, reflected by the Wall and applied to an imaged object, the laser is reflected to the Wall and finally enters the stripe camera, and since the distance between the laser and the Wall and the distance between the stripe camera and the Wall are known, the image acquired at each position includes flight time and 3D contour information. Because the stripe camera is one-dimensional space imaging, in order to reconstruct a 3D structure well, laser is used for shooting a plurality of different positions on wall through a rotating mirror, the stripe camera acquires a plurality of images, and finally the 3D structure is reconstructed according to a back projection algorithm.
As shown in FIG. 4, the non-visual field imaging principle of two synchronous scanning stripe cameras is demonstrated, with the center of wall as the origin and the radius r1Are positioned at equal angles on the circumference of the circle, and are respectively SC1 and SC 3. The 2 streak cameras are operatively acquired at a time interval defined as the decoupled short exposure, denoted by Δ T. Because of the consistent distance between SC1 and SC3 and wall, SC1 can obtain t0Three-dimensional image of time, SC3 obtains t1And the time image adopts a time decoupling method to obtain three-dimensional dynamic information in such a way.
According to the non-visual field dynamic imaging method based on the synchronous scanning stripe camera, provided by the embodiment of the invention, by utilizing the advantages of the synchronous scanning stripe camera in the aspect of collecting weak light and combining the function of detecting flight time of the stripe camera, static three-dimensional imaging of a non-visual field target can be obtained by adopting a single camera, and non-visual field three-dimensional dynamic imaging is obtained by adopting two cameras through a time decoupling method. The scheme is easy to operate, and a high-efficiency high-quality non-visual field imaging technology can be realized.
Next, a non-visual field dynamic imaging apparatus based on a synchronous scanning fringe camera according to an embodiment of the present invention will be described with reference to the drawings.
Fig. 5 is a schematic structural diagram of a non-visual field dynamic imaging apparatus based on a synchronous scanning stripe camera according to an embodiment of the present invention.
As shown in fig. 5, the non-visual field dynamic imaging device based on the synchronous scanning stripe camera comprises: the system comprises a laser source, a spectroscope, a rotating mirror, a plurality of synchronous scanning stripe cameras, a first imaging module and a second imaging module;
the laser source is used for emitting laser;
the spectroscope is used for reflecting the laser and changing the irradiation direction of the laser;
the rotating mirror is used for adjusting the reflection direction of the laser so that the laser scans different positions of an object to be imaged;
the synchronous scanning fringe cameras are arranged at different visual angle positions of an object to be imaged and are used for scanning and imaging the object to be imaged to obtain a plurality of fringe images at different positions of the object to be imaged;
the first imaging module is used for reconstructing a plurality of fringe images at different positions acquired by one synchronous scanning fringe camera and a to-be-imaged object by using a back projection algorithm, so as to realize static three-dimensional imaging of the to-be-imaged object;
the second imaging module is used for imaging the object to be imaged according to a plurality of synchronous scanning fringe images at different positions acquired by the plurality of synchronous scanning fringe cameras and a time decoupling mode to obtain three-dimensional dynamic information of the object to be imaged.
Further, in an embodiment of the present invention, the synchronous scanning streak camera scans the object to be imaged in a high frequency scanning mode to obtain an integration result after multiple scans.
Further, in an embodiment of the present invention, the synchronous scanning stripe camera converts the changed time information into spatial information in a scanning manner, reversely deduces the flight time through the stripe image, and performs three-dimensional reconstruction on the object to be imaged by using a back projection algorithm.
Further, in an embodiment of the present invention, the multiple synchronous scanning stripe cameras are located at different viewing angles of the object to be imaged, and because there is an interval between the synchronous acquisition times of the synchronous scanning stripe cameras, a time-domain decoupling manner is adopted to obtain a three-dimensional image at another time, and a video mode is used to obtain three-dimensional dynamic information of the object to be imaged in a non-viewing area.
It should be noted that the foregoing explanation of the embodiment of the non-visual field dynamic imaging method based on the synchronous scanning stripe camera is also applicable to the apparatus of this embodiment, and is not repeated here.
According to the non-visual field dynamic imaging device based on the synchronous scanning stripe camera, provided by the embodiment of the invention, by utilizing the advantages of the synchronous scanning stripe camera in the aspect of collecting weak light and combining the function of detecting flight time of the stripe camera, static three-dimensional imaging of a non-visual field target can be obtained by adopting a single camera, and non-visual field three-dimensional dynamic imaging is obtained by adopting two cameras through a time decoupling method. The scheme is easy to operate, and a high-efficiency high-quality non-visual field imaging technology can be realized.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (10)
1. A non-visual field dynamic imaging method based on a synchronous scanning stripe camera is characterized by comprising the following steps:
scanning a plurality of positions of an object to be imaged by moving a light source through a rotating mirror;
acquiring a plurality of fringe images at different positions of the object to be imaged by utilizing a plurality of synchronous scanning fringe cameras at different positions;
reconstructing the object to be imaged according to a plurality of fringe images at different positions acquired by one synchronous scanning fringe camera and a back projection algorithm to realize static three-dimensional imaging of the object to be imaged;
and imaging the object to be imaged according to a plurality of fringe images at different positions acquired by a plurality of synchronous scanning fringe cameras and a time decoupling mode to obtain three-dimensional dynamic information of the object to be imaged.
2. The non-visual-field dynamic imaging method based on the synchronous scanning stripe camera of claim 1, wherein the synchronous scanning stripe camera scans the object to be imaged through a high frequency scanning mode to obtain an integration result after multiple scanning.
3. The non-visual field dynamic imaging method based on the synchronous scanning stripe camera of claim 1, characterized in that the rotating mirror is arranged so that the laser emitted by the laser source scans different positions of the object to be imaged.
4. The method according to claim 1, wherein the synchronous scanning stripe camera converts the time information into the space information by scanning, the flight time is deduced by the stripe image, and the object to be imaged is three-dimensionally reconstructed by the back projection algorithm.
5. The method according to claim 4, further comprising, before three-dimensionally reconstructing the object to be imaged by using the back projection algorithm: and processing the fringe image through a filtering algorithm.
6. The non-visual-field dynamic imaging method based on the synchronous scanning stripe camera of claim 1, wherein the plurality of synchronous scanning stripe cameras are located at different viewing angles of the object to be imaged, and because there is an interval between the synchronous acquisition times of the synchronous scanning stripe cameras, a time-domain decoupling mode is adopted to obtain a three-dimensional image at another time, and a video mode is adopted to obtain three-dimensional dynamic information of the object to be imaged in a non-visual field.
7. A non-field-of-view dynamic imaging apparatus based on a synchronous scanning fringe camera, comprising: the system comprises a laser source, a spectroscope, a rotating mirror, a plurality of synchronous scanning stripe cameras, a first imaging module and a second imaging module;
the laser source is used for emitting laser;
the spectroscope is used for reflecting the laser and changing the irradiation direction of the laser;
the rotating mirror is used for adjusting the reflection direction of the laser so that the laser scans different positions of the object to be imaged;
the synchronous scanning fringe cameras are arranged at different view angle positions of the object to be imaged and are used for scanning and imaging the object to be imaged to obtain a plurality of fringe images at different positions of the object to be imaged;
the first imaging module is used for reconstructing a plurality of fringe images at different positions acquired by one synchronous scanning fringe camera and a back projection algorithm on the object to be imaged, so as to realize static three-dimensional imaging of the object to be imaged;
the second imaging module is used for imaging the object to be imaged according to a plurality of fringe images at different positions acquired by a plurality of synchronous scanning fringe cameras and a time decoupling mode to obtain three-dimensional dynamic information of the object to be imaged.
8. The non-visual-field dynamic imaging device based on the synchronous scanning stripe camera of claim 7, wherein the synchronous scanning stripe camera scans the object to be imaged through a high frequency scanning mode to obtain an integration result after multiple scanning.
9. The non-visual-field dynamic imaging device based on the synchronous scanning stripe camera of claim 7, wherein the synchronous scanning stripe camera converts the changed time information into the space information by means of scanning, the flight time is reversely deduced through the stripe image, and the object to be imaged is three-dimensionally reconstructed by the back projection algorithm.
10. The device according to claim 7, wherein the plurality of synchronous scanning stripe cameras are located at different viewing angles of the object to be imaged, and because there is an interval between the synchronous acquisition times of the synchronous scanning stripe cameras, a time-domain decoupling manner is adopted to obtain a three-dimensional image at another time, and a video mode is adopted to obtain three-dimensional dynamic information of the object to be imaged in a non-viewing area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010212152.3A CN111476897B (en) | 2020-03-24 | 2020-03-24 | Non-visual field dynamic imaging method and device based on synchronous scanning stripe camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010212152.3A CN111476897B (en) | 2020-03-24 | 2020-03-24 | Non-visual field dynamic imaging method and device based on synchronous scanning stripe camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111476897A true CN111476897A (en) | 2020-07-31 |
| CN111476897B CN111476897B (en) | 2023-04-18 |
Family
ID=71748364
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010212152.3A Active CN111476897B (en) | 2020-03-24 | 2020-03-24 | Non-visual field dynamic imaging method and device based on synchronous scanning stripe camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111476897B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112946990A (en) * | 2021-05-13 | 2021-06-11 | 清华大学 | Non-vision field dynamic imaging system based on confocal mode |
| CN113052833A (en) * | 2021-04-20 | 2021-06-29 | 东南大学 | Non-vision field imaging method based on infrared thermal radiation |
| CN113109787A (en) * | 2021-04-15 | 2021-07-13 | 东南大学 | Non-vision field imaging device and method based on thermal imaging camera |
| CN113630560A (en) * | 2021-08-12 | 2021-11-09 | 哈尔滨工业大学 | Active illumination non-vision field secondary penumbra imaging method |
| CN114460805A (en) * | 2020-10-21 | 2022-05-10 | 中国科学院国家空间科学中心 | Shielding scattering imaging system based on high-pass filtering |
| CN115695977A (en) * | 2022-10-28 | 2023-02-03 | 重庆邮电大学 | Compressed ultrafast imaging system and method without limitation of exposure time |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102763138A (en) * | 2009-11-18 | 2012-10-31 | 皇家飞利浦电子股份有限公司 | Motion correction in radiation therapy |
| US20160360081A1 (en) * | 2015-06-05 | 2016-12-08 | Canon Kabushiki Kaisha | Control apparatus, image pickup apparatus, control method, and non-transitory computer-readable storage medium |
| CN106791335A (en) * | 2017-01-25 | 2017-05-31 | 浙江大学 | A kind of compact big visual field optical field acquisition system and its analysis optimization method |
| CN107131848A (en) * | 2016-02-26 | 2017-09-05 | 福禄理昂·伟洛米泽 | The optical triangle method device of quick and fine and close SHAPE DETECTION can be realized |
| CN108629829A (en) * | 2018-03-23 | 2018-10-09 | 中德（珠海）人工智能研究院有限公司 | The three-dimensional modeling method and system that one bulb curtain camera is combined with depth camera |
| US20190012804A1 (en) * | 2017-07-10 | 2019-01-10 | Nokia Technologies Oy | Methods and apparatuses for panoramic image processing |
-
2020
- 2020-03-24 CN CN202010212152.3A patent/CN111476897B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102763138A (en) * | 2009-11-18 | 2012-10-31 | 皇家飞利浦电子股份有限公司 | Motion correction in radiation therapy |
| US20160360081A1 (en) * | 2015-06-05 | 2016-12-08 | Canon Kabushiki Kaisha | Control apparatus, image pickup apparatus, control method, and non-transitory computer-readable storage medium |
| CN107131848A (en) * | 2016-02-26 | 2017-09-05 | 福禄理昂·伟洛米泽 | The optical triangle method device of quick and fine and close SHAPE DETECTION can be realized |
| CN106791335A (en) * | 2017-01-25 | 2017-05-31 | 浙江大学 | A kind of compact big visual field optical field acquisition system and its analysis optimization method |
| US20190012804A1 (en) * | 2017-07-10 | 2019-01-10 | Nokia Technologies Oy | Methods and apparatuses for panoramic image processing |
| CN108629829A (en) * | 2018-03-23 | 2018-10-09 | 中德（珠海）人工智能研究院有限公司 | The three-dimensional modeling method and system that one bulb curtain camera is combined with depth camera |
Non-Patent Citations (1)
| Title |
|---|
| 翟建华: "基于光子计数原理的非视域激光三维成像的精度研究", 《信息科技辑》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114460805A (en) * | 2020-10-21 | 2022-05-10 | 中国科学院国家空间科学中心 | Shielding scattering imaging system based on high-pass filtering |
| CN113109787A (en) * | 2021-04-15 | 2021-07-13 | 东南大学 | Non-vision field imaging device and method based on thermal imaging camera |
| CN113109787B (en) * | 2021-04-15 | 2024-01-16 | 东南大学 | Non-visual field imaging device and method based on thermal imaging camera |
| CN113052833A (en) * | 2021-04-20 | 2021-06-29 | 东南大学 | Non-vision field imaging method based on infrared thermal radiation |
| CN112946990A (en) * | 2021-05-13 | 2021-06-11 | 清华大学 | Non-vision field dynamic imaging system based on confocal mode |
| CN113630560A (en) * | 2021-08-12 | 2021-11-09 | 哈尔滨工业大学 | Active illumination non-vision field secondary penumbra imaging method |
| CN113630560B (en) * | 2021-08-12 | 2023-01-17 | 哈尔滨工业大学 | Active illumination non-vision field secondary penumbra imaging method |
| CN115695977A (en) * | 2022-10-28 | 2023-02-03 | 重庆邮电大学 | Compressed ultrafast imaging system and method without limitation of exposure time |
| CN115695977B (en) * | 2022-10-28 | 2024-04-19 | 重庆邮电大学 | Compression ultrafast imaging system and method with unlimited exposure time |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111476897B (en) | 2023-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111476897B (en) | Non-visual field dynamic imaging method and device based on synchronous scanning stripe camera | |
| Musarra et al. | Non-line-of-sight three-dimensional imaging with a single-pixel camera | |
| US7667824B1 (en) | Range gated shearography systems and related methods | |
| US5081530A (en) | Three dimensional camera and range finder | |
| CN110579775A (en) | Ultra-long-range single-photon three-dimensional laser radar scanning imaging system | |
| CN102510282B (en) | Time-resolved single-photon counting two-dimensional imaging system and method | |
| CN100337122C (en) | Pulse modulation type three-dimensional image-forming method and system containing no scanning device | |
| CN110325879A (en) | System and method for compress three-dimensional depth sense | |
| CN105705962A (en) | Sensor system with active illimination | |
| CN109814128B (en) | High-resolution rapid imaging system and method combining time flight and associated imaging | |
| US20120330162A1 (en) | Modulated aperture imaging for automatic moving target detection | |
| CN110187356B (en) | Remote super-resolution single photon imaging reconstruction method | |
| Monnin et al. | A 3D outdoor scene scanner based on a night-vision range-gated active imaging system | |
| CN111487648A (en) | Non-visual field imaging method and system based on flight time | |
| JP2022176974A (en) | Imaging apparatus | |
| CN107861252A (en) | A kind of imaging device and method | |
| CN112946990B (en) | Non-vision field dynamic imaging system based on confocal mode | |
| CN2773729Y (en) | Impulsed and modulated three-dimensional imaging system without scanner | |
| CN112040116B (en) | Non-vision field dynamic imaging method and device based on aperture-division gating camera | |
| Kawakita et al. | Axi-vision camera: a three-dimensional camera | |
| CA2237894C (en) | Confocal-reflection streak lidar apparatus with strip-shaped photocathode, for application at a wide range of scales | |
| AU2020408599A1 (en) | Light field reconstruction method and system using depth sampling | |
| CN114813643A (en) | Scattering medium penetrating correlation imaging method and system based on preset scattering medium | |
| CN111445507B (en) | Data processing method for non-visual field imaging | |
| CN113099209A (en) | Non-visual field imaging device and method based on photomultiplier tube array |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |