CN116088173A - Scattering imaging system, optical axis non-invasive searching method and device thereof, and storage medium - Google Patents

Scattering imaging system, optical axis non-invasive searching method and device thereof, and storage medium Download PDF

Info

Publication number
CN116088173A
CN116088173A CN202310368543.8A CN202310368543A CN116088173A CN 116088173 A CN116088173 A CN 116088173A CN 202310368543 A CN202310368543 A CN 202310368543A CN 116088173 A CN116088173 A CN 116088173A
Authority
CN
China
Prior art keywords
center
sub
sampling
coordinate
optical axis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310368543.8A
Other languages
Chinese (zh)
Other versions
CN116088173B (en
Inventor
王歆
施钧辉
陈锋
陈睿黾
李驰野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Lab
Original Assignee
Zhejiang Lab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Lab filed Critical Zhejiang Lab
Priority to CN202310368543.8A priority Critical patent/CN116088173B/en
Publication of CN116088173A publication Critical patent/CN116088173A/en
Application granted granted Critical
Publication of CN116088173B publication Critical patent/CN116088173B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0012Optical design, e.g. procedures, algorithms, optimisation routines
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

The invention relates to the field of optical imaging and image processing, in particular to a scattering imaging system, and a non-invasive searching method, a device and a storage medium for an optical axis of the scattering imaging system, wherein the method comprises the following steps: establishing a coordinate system; respectively acquiring a first light intensity image and a second light intensity image by using an area array detector; selecting a series of sub-sampling graphs of the first light intensity graph, finding out the sub-sampling graph with the largest correlation in the second light intensity graph for each sub-sampling graph, and defining a scaling vector between center coordinates of the sub-sampling graphs; drawing a scaling vector, performing vector extension, and determining the center of the area with the maximum coincidence of the vector extension as a scaling center; the optical axis is calculated using the zoom center and the stop position. Compared with the prior art, the invention determines the system optical axis by using the similarity information between the sub-sampling graphs of the sampling graphs with different wavelengths based on the distribution rule of the light intensity signals of the scattering medium with different wavelengths, and has the advantages of no need of damaging the system, wide application range and the like.

Description

Scattering imaging system, optical axis non-invasive searching method and device thereof, and storage medium
Technical Field
The present invention relates to the field of optical imaging and image processing, and in particular, to a scattering imaging system, and a method, an apparatus, and a storage medium for non-invasively searching an optical axis thereof.
Background
The scattering characteristics of scattering media such as fog, haze, clouds or biological tissues, which are common in the nature, can cause the emergent field to be disordered when light is transmitted, so that the traditional imaging is blurred or even fails. Some novel imaging technologies can effectively solve the problems, and have great application advantages in the fields of biological imaging, underwater detection, low-visibility environment imaging and the like. More common methods include time/coherence gating methods that utilize the time of flight or coherence of ballistic light, iterative wavefront shaping methods that utilize phase cycling optimization, matrix measurement methods that utilize advanced calibration systems and matrix operations, deconvolution methods that utilize point spread functions, and speckle autocorrelation methods that utilize memory effects and phase recovery algorithms, among others. The gating method is only suitable for a relatively thin scattering medium to ensure existence of ballistic light, and the iterative wave-front shaping method, the matrix measuring method and the deconvolution method need to invasively place a reference object on one side of a target, so that application scenes are greatly limited. The speckle autocorrelation method firstly uses autocorrelation calculation and Wei Naxin k theorem to extract a spectrogram of a target from a sampling image, and then reconstructs the target image by means of a phase recovery algorithm. The method does not need an advanced measurement system, has lower requirement on system stability, gradually becomes a research hot spot in recent years, and obviously improves resolution, imaging speed and view angle. Although the method can reconstruct the pattern of the target noninvasively, an optical axis cannot be defined, and acquisition of more important information such as the target position is limited. Although searching for the optical axis by using ballistic light can be used as an auxiliary means, the ballistic light decays exponentially with the penetration depth, and is only suitable for very thin scattering media, and cannot be applied to strong scattering scenes. Therefore, it is needed to propose a non-invasive optical axis searching method to clarify the propagation of the optical path in the scattering system, so as to further obtain more effective information, such as screening out the sampling area with less distortion or performing position and size calculation on the target. The solution of these problems will greatly improve the functionality and universality of the above method, making the novel imaging technique easier to apply in actual strongly scattering natural scenes.
Disclosure of Invention
The invention aims to provide a scattering imaging system, a non-invasive searching method, a non-invasive searching device and a storage medium for an optical axis of the scattering imaging system, wherein the non-invasive optical axis is determined, and the propagation of an optical path in the scattering system is clear so as to acquire more effective information.
The aim of the invention can be achieved by the following technical scheme:
a scatter imaging system for generating and detecting optical signals, comprising: the device comprises an incoherent light source, a convex lens, an object to be observed, a scattering medium, a diaphragm, a filter, an area array detector and a processing device connected with the area array detector, wherein the convex lens, the object to be observed, the scattering medium, the diaphragm, the filter, the area array detector and the processing device are sequentially arranged behind the incoherent light source, the object to be observed is located in a memory effect range of the scattering medium, the filter is tightly attached to the front end of an light inlet of the area array detector and is used for filtering interference light to the maximum extent, the plane of the diaphragm is parallel to the photosurface of the area array detector, the center of the photosurface of the area array detector is located on a middling line of the diaphragm, and the processing device is used for calculating the position of an optical axis and is configured to execute the following steps:
step 1) establishing a coordinate origin with the center of the diaphragm and the center of the diaphragm pointing to the photosensitive surface as the coordinate originzSpatial three-dimensional coordinate system of axes, and such that the spatial coordinate systemxShaft and method for producing the sameyThe axes are respectively parallel to the rows and the columns of the area array detector;
step 2) when a first narrow-band filter and a second narrow-band filter are respectively placed between a diaphragm and a detector, respectively acquiring and storing a corresponding first light intensity image and a corresponding second light intensity image by using an area array detector, wherein the narrow-band filters are closely placed at the front end of an light inlet of the area array detector;
step 3) selecting a series of first sub-sampling patterns of preconfigured array dimensions for the first light intensity pattern, wherein each first sub-sampling pattern has a center coordinatezThe axis coordinate is the central coordinate of the detectorzAn axis coordinate value;
step 4) for each first sub-sampling image, finding out a second sub-sampling image with the largest correlation with the second sub-sampling image in the second light intensity image, and determining a scaling vector between center coordinates of the second sub-sampling image and the second sub-sampling image;
step 5) drawing a series of scaling vectors determined in the step 4) and making vector extension lines, wherein the center of the area with the most overlapped vector extension lines is used as a scaling center;
and 6) calculating an optical axis linear formula based on the three-dimensional coordinates corresponding to the zoom center and the three-dimensional coordinates corresponding to the diaphragm.
Preferably, the diaphragm is placed close to the scattering medium, and the diaphragm is ensured to be covered by a light spot generated by an object to be observed after the scattering medium, so that the aperture can be used for contrast adjustment of a sampling graph and optical axis position calculation.
A method of non-invasive finding of an optical axis of a scatter imaging system, based on a scatter imaging system as described above, the method comprising the steps of:
step 1) establishing a coordinate origin with the center of the diaphragm and the center of the diaphragm pointing to the photosensitive surface as the coordinate originzSpatial three-dimensional coordinate system of axes, and such that the spatial coordinate systemxShaft and method for producing the sameyThe axes are respectively parallel to the rows and the columns of the area array detector;
step 2) when a first narrow-band filter and a second narrow-band filter are respectively placed between a diaphragm and a detector, respectively acquiring and storing a corresponding first light intensity image and a corresponding second light intensity image by using an area array detector, wherein the narrow-band filters are closely placed at the front end of an light inlet of the area array detector;
step 3) selecting a series of first sub-sampling patterns of preconfigured array dimensions for the first light intensity pattern, wherein each first sub-sampling pattern has a center coordinatezThe axis coordinate is the central coordinate of the detectorzAn axis coordinate value;
step 4) for each first sub-sampling image, finding out a second sub-sampling image with the largest correlation with the second sub-sampling image in the second light intensity image, and determining a scaling vector between center coordinates of the second sub-sampling image and the second sub-sampling image;
step 5) drawing a series of scaling vectors determined in the step 4) and making vector extension lines, wherein the center of the area with the most overlapped vector extension lines is used as a scaling center;
and 6) calculating an optical axis linear formula based on the three-dimensional coordinates corresponding to the zoom center and the three-dimensional coordinates corresponding to the diaphragm.
Preferably, the bandwidth of the narrow band filter is less than 0.025 times the center wavelength of the narrow band filter.
Preferably, the central wavelength of the second narrow-band filter is selected within a range of 1.01 ×λ 1 <λ 2 <1.03*λ 1 Wherein, the method comprises the steps of, wherein,λ 1λ 2 the center wavelengths of the first narrow-band filter and the second narrow-band filter are respectively.
Preferably, the step 4) specifically includes:
performing traversal operation in a second light intensity graph by using a preconfigured array size, determining a series of second sub-sampling graphs, performing two-dimensional correlation operation on the series of second sub-sampling graphs and the current first sub-sampling graph respectively, determining a second sub-sampling graph with the largest correlation with the current first sub-sampling graph, defining a corresponding center coordinate, and establishing a scaling vector taking the center coordinate of the current first sub-sampling graph as a starting point and taking the center coordinate of the second sub-sampling graph with the largest correlation as an end point.
Preferably, the step 6) specifically includes:
for any point on the optical axis line, its coordinate is #xyz) All satisfy:
Figure SMS_1
wherein, the method comprises the following steps ofx centery centerz D ) The three-dimensional coordinates corresponding to the zoom center are calculatedx Ay Az A ) Is the center coordinate of the diaphragm.
Preferably, the center coordinate of the diaphragm is the origin of coordinates, namely @x Ay Az A ) = (0, 0), the optical axis straight line formula reduces to:
Figure SMS_2
an optical axis non-invasive finding apparatus of a scatter imaging system, implemented based on a scatter imaging system as described above, comprising:
the coordinate system establishment module is used for establishing a coordinate system by taking the center of the diaphragm as a coordinate origin and taking the center of the diaphragm pointing to the photosurface as a coordinate originzSpatial three-dimensional coordinate system of axes, and such that the spatial coordinate systemxShaft and method for producing the sameyThe axes are respectively parallel to the rows and the columns of the area array detector;
the acquisition and storage module is used for respectively acquiring and storing a corresponding first light intensity image and a corresponding second light intensity image by using the area array detector when the first narrow-band filter and the second narrow-band filter are respectively placed between the diaphragm and the detector, wherein the narrow-band filter is tightly attached to the front end of the light inlet of the area array detector;
the optical axis calculating module is used for executing the following steps: selecting a series of first sub-sampling patterns of a preconfigured array size of the first light intensity pattern, wherein a center coordinate of each first sub-sampling patternzThe axis coordinate is the central coordinate of the detectorzAn axis coordinate value; for each first sub-sampling image, finding out a second sub-sampling image with the greatest correlation with the second sub-sampling image in the second light intensity image, and determining a scaling vector between center coordinates of the second sub-sampling image and the second sub-sampling image; drawing a series of determined scaling vectors, performing vector extension, and taking the center of the area with the most coincident vector extension as a scaling center; and calculating an optical axis straight line formula based on the three-dimensional coordinates corresponding to the zoom center and the three-dimensional coordinates corresponding to the diaphragm.
Preferably, the bandwidth of the narrow band filter is less than 0.025 times the center wavelength of the narrow band filter.
Preferably, the central wavelength of the second narrow-band filter is selected within a range of 1.01 ×λ 1 <λ 2 <1.03*λ 1 Wherein, the method comprises the steps of, wherein,λ 1λ 2 the center wavelengths of the first narrow-band filter and the second narrow-band filter are respectively.
Preferably, for each first sub-sampling map, a second sub-sampling map with the greatest correlation is found in the second light intensity map, and the scaling vector between the central coordinates of the two sub-sampling maps is defined specifically as follows:
performing traversal operation in a second light intensity graph by using a preconfigured array size, determining a series of second sub-sampling graphs, performing two-dimensional correlation operation on the series of second sub-sampling graphs and the current first sub-sampling graph respectively, determining a second sub-sampling graph with the largest correlation with the current first sub-sampling graph, defining a corresponding center coordinate, and establishing a scaling vector taking the center coordinate of the current first sub-sampling graph as a starting point and taking the center coordinate of the second sub-sampling graph with the largest correlation as an end point.
Preferably, the calculating the optical axis straight line formula based on the three-dimensional coordinates corresponding to the zoom center and the three-dimensional coordinates corresponding to the diaphragm specifically includes:
for any point on the optical axis line, its coordinate is #xyz) All satisfy:
Figure SMS_3
wherein, the method comprises the following steps ofx centery centerz D ) The three-dimensional coordinates corresponding to the zoom center are calculatedx Ay Az A ) Is the center coordinate of the diaphragm.
Preferably, the center coordinate of the diaphragm is the origin of coordinates, namely @x Ay Az A ) = (0, 0), the optical axis straight line formula reduces to:
Figure SMS_4
an optical axis non-invasive seeking device of a scatter imaging system, comprising a memory, a processor, and a program stored in the memory, the processor implementing the method as described above when executing the program.
A storage medium having stored thereon a program which when executed performs a method as described above.
Compared with the prior art, the invention has the following beneficial effects:
(1) According to the invention, based on the distribution rule of the light intensity signals of the scattering medium under different wavelengths, the sampling graphs are subjected to traversal calculation by utilizing the similarity information among the sub-sampling graphs of the sampling graphs with different wavelengths, and the effective signal center of the system on the photosensitive surface of the detector is found, so that the optical axis of the system is further found, the optical axis of the system can be accurately positioned in a non-invasive manner, and the system is not required to be destroyed.
(2) The invention can be applied to imaging experiments related to scattering, has simple system structure and convenient operation, and has great application prospect in the aspects of underwater target positioning, fog-penetrating imaging and the like.
Drawings
Fig. 1 is a block diagram of a scattering imaging system provided in embodiment 1 of the present invention, and is labeled as follows:
1-an incoherent light source; 2-convex lenses; 3-an object to be observed; 4-scattering medium; 5-diaphragm; 6-a filter; 7-area array detector; 8-a processing device;
FIG. 2 is a flow chart of a method for non-invasively finding an optical axis according to embodiment 2 of the present invention;
FIG. 3 is a graph of the light intensity of the detection surface corresponding to the filter in example 2 with a center wavelength of 525nm and a bandwidth of 10 nm;
FIG. 4 is a graph of the light intensity of the detection surface corresponding to the filter in example 2 with a center wavelength of 536nm and a bandwidth of 10 nm;
FIG. 5 is a series of scaling vector diagrams obtained in example 2;
fig. 6 is a diagram of a non-invasive optical axis searching apparatus according to embodiment 3 of the present invention, which is labeled as follows:
the system comprises an A-coordinate system building module, a B-acquisition and storage module and a C-optical axis calculation module.
Detailed Description
The invention will now be described in detail with reference to the drawings and specific examples. The present embodiment is implemented on the premise of the technical scheme of the present invention, and a detailed implementation manner and a specific operation process are given, but the protection scope of the present invention is not limited to the following examples.
The terminology used in the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. As used in this application, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.
Example 1
The present embodiment provides a scatter imaging system for generating and detecting optical signals, as shown in fig. 1, comprising: the incoherent light source 1, a convex lens 2, an object 3 to be observed, a scattering medium 4, a diaphragm 5, a filter 6, an area array detector 7 and a processing device 8 connected with the area array detector 7 are sequentially arranged behind the incoherent light source 1.
The object 3 to be observed is located in the memory effect range of the scattering medium 4, the filter 6 is tightly attached to the front end of the light inlet of the area array detector 7 to furthest filter interference light, the diaphragm plane is parallel to the light sensing surface of the area array detector, the center of the light sensing surface of the area array detector is located on the middle vertical line of the diaphragm, the processing device 8 is used for calculating the position of the optical axis, and the processing device is configured to execute the following steps:
step 1) establishing a space coordinate system.
Sequentially fixing an incoherent light source, a convex lens, an object to be observed, a scattering medium, a diaphragm and an area array detector, placing the diaphragm tightly against the scattering medium, enabling the plane of the diaphragm to be parallel to the photosensitive surface of the area array detector, enabling the center of the photosensitive surface of the detector to be positioned on the center vertical line of the diaphragm, establishing a coordinate origin with the center of the diaphragm as the center of coordinates, and taking the center of the diaphragm pointing to the center of the photosensitive surface as the center of the photosensitive surfacezSpatial three-dimensional coordinate system of axes, and such that the spatial coordinate systemxShaft and method for producing the sameyThe axes are parallel to the rows and columns of the area array detector, respectively. At this time, the center coordinate of the diaphragmx Ay Az A ) Is (0, 0), and the center coordinates of the detector at this time are recorded as (0,z D ) The light path is regulated to make the sampling graph have obvious contrast.
Step 2) when the center wavelength is set to beλ 1 With a bandwidth of deltaλ 1 Narrow band filter F of (2) 1 When the light intensity image is placed between the diaphragm and the detector, the area array detector is used for collecting the corresponding light intensity imageI 1 And stored.
In this embodiment, the narrow band filter F 1 Is closely attached to the front end of the light inlet of the area array detector.
Step 3) when the narrow band filter F 1 Replaced by a central wavelength ofλ 2 With a bandwidth of deltaλ 2 Narrow band filter F of (2) 2 When the area array detector is used for collecting the corresponding light intensity graphI 2 And stored.
Likewise, a narrow band filter F 2 Is closely attached to the front end of the light inlet of the area array detector.
Step 4) selecting a light intensity mapI 1 Is of a series of array sizesl×lThe center coordinate is%x k1y k1z D ) Subsampled map of (a)I 1_ part k Whereink=1,2,3…。
Step 5) for each sub-sample mapI 1_ part k In the sampling diagramI 2 Find out the sub-sampling graph with maximum correlationI 2_ part k And define the scaling vector between their center coordinates
Figure SMS_5
Whereink=1,2,3…。
Step 6) for the series of scaling vectors determined in step 5)
Figure SMS_6
Drawing and making a vector extension line, taking the center of the area with the most overlapped vector extension line as a zoom center, and marking the coordinate as #x centery centerz D )。
Step 7) based on the three-dimensional coordinates corresponding to the zoom centerx centery centerz D ) And the three-dimensional coordinates corresponding to the diaphragmx Ay Az A ) Calculating an optical axis straight line formula, and for any point on a straight line, calculating the coordinates of any point on the straight linexyz) All satisfy:
Figure SMS_7
/>
the processing device set forth in the above embodiment may be implemented in particular by a computer chip or an entity, or by a product having a certain function. One typical implementation is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
In this embodiment, the diaphragm 5 is placed close to the scattering medium 4, and it is required to ensure that the diaphragm 5 can be covered by a light spot generated by the object 3 to be observed after the scattering medium 4, so as to be used for contrast adjustment of a sampling chart and optical axis position calculation by a subsequent processing device.
Specifically, the incoherent light source 1 of the present embodiment adopts an LED light source with a center wavelength of 530nm and a bandwidth of 35nm, the size of the object 3 to be observed is 600 μm, the material of the scattering medium 4 is 600 mesh frosted glass, and the diameter of the diaphragm 5 is 1mm.
Example 2
The embodiment provides a non-invasive optical axis searching method of a scattering imaging system, which is implemented based on the scattering imaging system as described in embodiment 1, and a specific method flow is shown in fig. 2, and includes the following steps.
Step 1) establishing a space coordinate system.
The LED light source with the central wavelength of 530nm and the bandwidth of 35nm, the convex lens, the object to be observed with the size of 600 mu m, the scattering medium made of 600 mesh frosted glass, the diaphragm with the diameter of 1mm, the filter plate and the area array detector are sequentially fixed, and the distance from the object to be observed to the scattering mediumAdjusted to 4.5cm, the distance from the scattering medium to the area array detectorz D The diaphragm is adjusted to 7cm and is placed closely to the scattering medium, the diaphragm plane is parallel to the photosensitive surface of the area array detector, the center of the photosensitive surface of the detector is positioned on the center vertical line of the diaphragm, the center of the diaphragm is taken as the origin of coordinates, and the center of the diaphragm pointing to the photosensitive surface is taken as the center of the photosensitive surfacezSpatial three-dimensional coordinate system of axes, and such that the spatial coordinate systemxShaft and method for producing the sameyThe axes are parallel to the rows and columns of the area array detector, respectively. At this time, the center coordinate of the diaphragmx Ay Az A ) Is (0, 0), and the center coordinates of the detector at this time are recorded as (0,z D ) The light path is regulated to make the sampling graph have obvious contrast.
Step 2) when the center wavelength is set to beλ 1 With a bandwidth of deltaλ 1 Narrow band filter F of (2) 1 When the light intensity image is placed between the diaphragm and the detector, the area array detector is used for collecting the corresponding light intensity imageI 1 And stored.
In this embodiment, the narrow band filter F 1 Is closely attached to the front end of the light inlet of the area array detector.
In a preferred embodiment, the bandwidth of the narrow-band filter is less than 0.025 times the center wavelength of the filter, i.e., Δλ 1 <0.025λ 1 The specific extraction of this embodimentλ 1 =525nm,Δλ 1 Light intensity pattern collected =10nmI 1 As shown in fig. 3.
Step 3) when the narrow band filter F 1 Replaced by a central wavelength ofλ 2 With a bandwidth of deltaλ 2 Narrow band filter F of (2) 2 When the area array detector is used for collecting the corresponding light intensity graphI 2 And stored.
Likewise, a narrow band filter F 2 Is closely attached to the front end of the light inlet of the area array detector.
The embodiment provides a preferable scheme for determining the narrow-band filter F 2 The selection range of the center wavelength of (2) is 1.01λ 1 <λ 2 <1.03*λ 1 Specifically, takeλ 2 =536nm,Δλ 2 Light intensity pattern collected =10nmI 2 As shown in fig. 4.
Step 4) selecting a light intensity mapI 1 Is of a series of array sizesl×lThe center coordinate is%x k1y k1z D ) Subsampled map of (a)I 1_ part k Whereink=1,2,3…。
Step 5) for each sub-sample mapI 1_ part k In the light intensity patternI 2 Find out the sub-sampling graph with maximum correlationI 2_ part k And specifies the scaling vector between the center coordinates of the two
Figure SMS_8
Whereink=1,2,3…。
In particular, in array sizel×lIn the light intensity patternI 2 Is traversed and a series of operations are selectedI 2 And respectively comparing the series of sub-sampling patterns withI 1_ part k Performing two-dimensional correlation operation to find out the sub-sampling graph with maximum correlationI 2_ part k And clarify thisI 2_ part k Corresponding center coordinates [ (]x k2y k2z D ) And build up to%x k1y k1z D ) As a starting point, take%x k2y k2z D ) Scaling vector for endpoint
Figure SMS_9
,/>
Figure SMS_10
Satisfy->
Figure SMS_11
Step 6) for the series of scaling vectors determined in step 5)
Figure SMS_12
Drawing (as shown in figure 5) and making vector extension lines, taking the center of the area with the most overlapped vector extension lines as a zoom center, and marking the coordinate as #x centery centerz D )。
Step 7) based on the three-dimensional coordinates corresponding to the zoom centerx centery centerz D ) And the three-dimensional coordinates corresponding to the diaphragmx Ay Az A ) Calculating an optical axis straight line formula, and for any point on a straight line, calculating the coordinates of any point on the straight linexyz) All satisfy:
Figure SMS_13
due to%x Ay Az A ) = (0, 0), the optical axis straight line formula may be further simplified to:
Figure SMS_14
according to the embodiment, based on the light intensity signal distribution rule of scattering media under different wavelengths, the sampling graphs are subjected to traversal calculation by utilizing the similarity information among sub-sampling graphs of the sampling graphs with different wavelengths, and the effective signal center of the system on the photosensitive surface of the detector is found, so that the optical axis of the system is further found, the system can be applied to imaging experiments related to scattering, the system is simple in structure and convenient to operate, and the system has a great application prospect in the aspects of underwater target positioning, fog penetration imaging and the like.
Example 3
The present embodiment provides an optical axis non-invasive searching apparatus of a scatter imaging system, which is implemented based on the scatter imaging system as described in embodiment 1, and corresponds to an optical axis non-invasive searching method as described in embodiment 2, and a structure diagram of the apparatus is shown in fig. 6, and includes:
a coordinate system establishing module A for establishing coordinate origin with the center of the diaphragm and the center of the diaphragm pointing to the photosensitive surface as the coordinate originzSpatial three-dimensional coordinate system of axes, and such that the spatial coordinate systemxShaft and method for producing the sameyThe axes are parallel to the rows and columns of the area array detector, respectively.
The acquisition and storage module B is used for respectively filtering the narrow-band filter plates F 1 And narrow-band filter F 2 When the light intensity image is placed between the diaphragm and the detector, the area array detector is used for respectively collecting the corresponding light intensity imageI 1I 2 And stored.
An optical axis calculation module C for performing the method as described in step 4) -step 7) of embodiment 2.
The invention also provides a non-invasive optical axis searching device of a scattering imaging system, which comprises a memory, a processor and a program stored in the memory, wherein the processor realizes the method when executing the program.
At the hardware level, the optical axis non-invasive searching device comprises a processor, an internal bus, a network interface, a memory and a nonvolatile storage, and can also comprise hardware required by other services. The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs to implement the method described above with respect to fig. 2. Of course, other implementations, such as logic devices or combinations of hardware and software, are not excluded from the present invention, that is, the execution subject of the following processing flows is not limited to each logic unit, but may be hardware or logic devices.
The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer readable medium storing computer readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, application specific integrated circuits (Application Specific Integrated Circuit, ASIC), programmable logic controllers, and embedded microcontrollers, examples of which include, but are not limited to, the following microcontrollers: ARC 625D, atmel AT91SAM, microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic of the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller in a pure computer readable program code, it is well possible to implement the same functionality by logically programming the method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers, etc. Such a controller may thus be regarded as a kind of hardware component, and means for performing various functions included therein may also be regarded as structures within the hardware component. Or even means for achieving the various functions may be regarded as either software modules implementing the methods or structures within hardware components.
The present invention also provides a computer readable storage medium storing a computer program operable to perform a method of non-invasively finding an optical axis of a scatter imaging system as provided in fig. 2 above.
That is, the above-described functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing describes in detail preferred embodiments of the present invention. It should be understood that numerous modifications and variations can be made in accordance with the concepts of the invention by one of ordinary skill in the art without undue burden. Therefore, all technical solutions which can be obtained by logic analysis, reasoning or limited experiments based on the prior art by a person skilled in the art according to the inventive concept shall be within the scope of protection defined by the claims.

Claims (16)

1. A scatter imaging system for generating and detecting optical signals, comprising: the device comprises an incoherent light source, a convex lens, an object to be observed, a scattering medium, a diaphragm, a filter, an area array detector and a processing device connected with the area array detector, wherein the convex lens, the object to be observed, the scattering medium, the diaphragm, the filter, the area array detector and the processing device are sequentially arranged behind the incoherent light source, the object to be observed is located in a memory effect range of the scattering medium, the filter is tightly attached to the front end of an light inlet of the area array detector and is used for filtering interference light to the maximum extent, the plane of the diaphragm is parallel to the photosurface of the area array detector, the center of the photosurface of the area array detector is located on a middling line of the diaphragm, and the processing device is used for calculating the position of an optical axis and is configured to execute the following steps:
step 1) establishing a coordinate origin with the center of the diaphragm and the center of the diaphragm pointing to the photosensitive surface as the coordinate originzSpatial three-dimensional coordinate system of axes, and such that the spatial coordinate systemxShaft and method for producing the sameyThe axes are respectively parallel to the rows and the columns of the area array detector;
step 2) when a first narrow-band filter and a second narrow-band filter are respectively placed between a diaphragm and a detector, respectively acquiring and storing a corresponding first light intensity image and a corresponding second light intensity image by using an area array detector, wherein the narrow-band filters are closely placed at the front end of an light inlet of the area array detector;
step 3) selecting a series of first sub-sampling patterns of preconfigured array dimensions for the first light intensity pattern, wherein each first sub-sampling pattern has a center coordinatezThe axis coordinate is the central coordinate of the detectorzAn axis coordinate value;
step 4) for each first sub-sampling image, finding out a second sub-sampling image with the largest correlation with the second sub-sampling image in the second light intensity image, and determining a scaling vector between center coordinates of the second sub-sampling image and the second sub-sampling image;
step 5) drawing a series of scaling vectors determined in the step 4) and making vector extension lines, wherein the center of the area with the most overlapped vector extension lines is used as a scaling center;
and 6) calculating an optical axis linear formula based on the three-dimensional coordinates corresponding to the zoom center and the three-dimensional coordinates corresponding to the diaphragm.
2. A scattering imaging system for generating and detecting optical signals according to claim 1, characterized in that the diaphragm is placed against the scattering medium and ensures that the diaphragm can be covered by a light spot generated by the object to be observed behind the scattering medium for contrast adjustment of the sample map and optical axis position calculation.
3. A method for non-invasive finding of an optical axis of a scatter imaging system, characterized in that it is implemented on the basis of a scatter imaging system according to claim 1 or 2, said method comprising the steps of:
step 1) establishing a coordinate origin with the center of the diaphragm and the center of the diaphragm pointing to the photosensitive surface as the coordinate originzSpatial three-dimensional coordinate system of axes, and such that the spatial coordinate systemxShaft and method for producing the sameyThe axes are respectively parallel to the rows and the columns of the area array detector;
step 2) when a first narrow-band filter and a second narrow-band filter are respectively placed between a diaphragm and a detector, respectively acquiring and storing a corresponding first light intensity image and a corresponding second light intensity image by using an area array detector, wherein the narrow-band filters are closely placed at the front end of an light inlet of the area array detector;
step 3) selecting a series of first sub-sampling patterns of preconfigured array dimensions for the first light intensity pattern, wherein each first sub-sampling pattern has a center coordinatezThe axis coordinate is the central coordinate of the detectorzAn axis coordinate value;
step 4) for each first sub-sampling image, finding out a second sub-sampling image with the largest correlation with the second sub-sampling image in the second light intensity image, and determining a scaling vector between center coordinates of the second sub-sampling image and the second sub-sampling image;
step 5) drawing a series of scaling vectors determined in the step 4) and making vector extension lines, wherein the center of the area with the most overlapped vector extension lines is used as a scaling center;
and 6) calculating an optical axis linear formula based on the three-dimensional coordinates corresponding to the zoom center and the three-dimensional coordinates corresponding to the diaphragm.
4. A method of non-invasive optical axis searching for a scattering imaging system according to claim 3, wherein the bandwidth of the narrowband filter is less than 0.025 times the center wavelength of the narrowband filter.
5. A method for non-invasively finding an optical axis of a scattering imaging system according to claim 3, wherein the second narrow-band filter has a center wavelength selected from a range of 1.01 ×λ 1 <λ 2 <1.03*λ 1 Wherein, the method comprises the steps of, wherein,λ 1λ 2 the center wavelengths of the first narrow-band filter and the second narrow-band filter are respectively.
6. A method for non-invasively finding an optical axis of a scatter imaging system according to claim 3, wherein said step 4) is specifically:
performing traversal operation in a second light intensity graph by using a preconfigured array size, determining a series of second sub-sampling graphs, performing two-dimensional correlation operation on the series of second sub-sampling graphs and the current first sub-sampling graph respectively, determining a second sub-sampling graph with the largest correlation with the current first sub-sampling graph, defining a corresponding center coordinate, and establishing a scaling vector taking the center coordinate of the current first sub-sampling graph as a starting point and taking the center coordinate of the second sub-sampling graph with the largest correlation as an end point.
7. A method for non-invasively finding an optical axis of a scatter imaging system according to claim 3, wherein said step 6) is specifically:
for any point on the optical axis line, its coordinate is #xyz) All satisfy:
Figure QLYQS_1
wherein, the method comprises the following steps ofx centery centerz D ) The three-dimensional coordinates corresponding to the zoom center are calculatedx Ay Az A ) Is the center coordinate of the diaphragm.
8. The method for non-invasively searching for an optical axis of a scattering imaging system according to claim 7, wherein the center coordinates of the diaphragm are the origin of coordinatesx Ay Az A ) = (0, 0), the optical axis straight line formula reduces to:
Figure QLYQS_2
9. an optical axis non-invasive finding device of a scatter imaging system, realized based on a scatter imaging system as claimed in claim 1 or 2, comprising:
the coordinate system establishment module is used for establishing a coordinate system by taking the center of the diaphragm as a coordinate origin and taking the center of the diaphragm pointing to the photosurface as a coordinate originzSpatial three-dimensional coordinate system of axes, and such that the spatial coordinate systemxShaft and method for producing the sameyThe axes are respectively parallel to the rows and the columns of the area array detector;
the acquisition and storage module is used for respectively acquiring and storing a corresponding first light intensity image and a corresponding second light intensity image by using the area array detector when the first narrow-band filter and the second narrow-band filter are respectively placed between the diaphragm and the detector, wherein the narrow-band filter is tightly attached to the front end of the light inlet of the area array detector;
the optical axis calculating module is used for executing the following steps: selecting a series of first sub-sampling patterns of a preconfigured array size of the first light intensity pattern, wherein a center coordinate of each first sub-sampling patternzThe axis coordinate is the central coordinate of the detectorzAn axis coordinate value; for each first sub-sampling image, finding out a second sub-sampling image with the greatest correlation with the second sub-sampling image in the second light intensity image, and determining a scaling vector between center coordinates of the second sub-sampling image and the second sub-sampling image; drawing a series of determined scaling vectors, performing vector extension, and taking the center of the area with the most coincident vector extension as a scaling center; and calculating an optical axis straight line formula based on the three-dimensional coordinates corresponding to the zoom center and the three-dimensional coordinates corresponding to the diaphragm.
10. The optical axis non-invasive searching apparatus of claim 9, wherein the bandwidth of the narrowband filter is less than 0.025 times the center wavelength of the narrowband filter.
11. The apparatus of claim 9, wherein the second narrow band filter has a center wavelength selected from a range of 1.01 xλ 1 <λ 2 <1.03*λ 1 Wherein, the method comprises the steps of, wherein,λ 1λ 2 the center wavelengths of the first narrow-band filter and the second narrow-band filter are respectively.
12. The apparatus according to claim 9, wherein for each first sub-sampling map, the second sub-sampling map with the greatest correlation is found in the second light intensity map, and the scaling vector between the center coordinates of the two sub-sampling maps is specified as follows:
performing traversal operation in a second light intensity graph by using a preconfigured array size, determining a series of second sub-sampling graphs, performing two-dimensional correlation operation on the series of second sub-sampling graphs and the current first sub-sampling graph respectively, determining a second sub-sampling graph with the largest correlation with the current first sub-sampling graph, defining a corresponding center coordinate, and establishing a scaling vector taking the center coordinate of the current first sub-sampling graph as a starting point and taking the center coordinate of the second sub-sampling graph with the largest correlation as an end point.
13. The apparatus for non-invasively finding an optical axis of a scattering imaging system according to claim 9, wherein the calculating an optical axis straight line formula based on the three-dimensional coordinates corresponding to the zoom center and the three-dimensional coordinates corresponding to the diaphragm is specifically:
for any point on the optical axis line, its coordinate is #xyz) All satisfy:
Figure QLYQS_3
wherein, the method comprises the following steps ofx centery centerz D ) The three-dimensional coordinates corresponding to the zoom center are calculatedx Ay Az A ) Is the center coordinate of the diaphragm.
14. The method for non-invasively finding an optical axis of a scattering imaging system according to claim 13, characterized in that the center coordinates of the diaphragm are the origin of coordinatesx Ay Az A ) = (0, 0), the optical axis straight line formula reduces to:
Figure QLYQS_4
15. an optical axis non-invasive finding device of a scatter imaging system, comprising a memory, a processor, and a program stored in said memory, characterized in that said processor implements the method according to any of claims 3-8 when executing said program.
16. A storage medium having a program stored thereon, wherein the program, when executed, implements the method of any of claims 3-8.
CN202310368543.8A 2023-04-10 2023-04-10 Scattering imaging system, optical axis non-invasive searching method and device thereof, and storage medium Active CN116088173B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310368543.8A CN116088173B (en) 2023-04-10 2023-04-10 Scattering imaging system, optical axis non-invasive searching method and device thereof, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310368543.8A CN116088173B (en) 2023-04-10 2023-04-10 Scattering imaging system, optical axis non-invasive searching method and device thereof, and storage medium

Publications (2)

Publication Number Publication Date
CN116088173A true CN116088173A (en) 2023-05-09
CN116088173B CN116088173B (en) 2023-06-16

Family

ID=86210512

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310368543.8A Active CN116088173B (en) 2023-04-10 2023-04-10 Scattering imaging system, optical axis non-invasive searching method and device thereof, and storage medium

Country Status (1)

Country Link
CN (1) CN116088173B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116242252A (en) * 2023-05-11 2023-06-09 之江实验室 Scattering imaging method with positioning and size measuring functions

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105005053B (en) * 2015-07-13 2017-11-21 西安电子科技大学 Random scatter relevance imaging system and imaging method based on LED illumination

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116242252A (en) * 2023-05-11 2023-06-09 之江实验室 Scattering imaging method with positioning and size measuring functions
CN116242252B (en) * 2023-05-11 2023-08-15 之江实验室 Scattering imaging method with positioning and size measuring functions

Also Published As

Publication number Publication date
CN116088173B (en) 2023-06-16

Similar Documents

Publication Publication Date Title
US8773550B2 (en) Range measurement using multiple coded apertures
CA2711727C (en) Method and camera for the real-time acquisition of visual information from three-dimensional scenes
Srinivasan An image-interpolation technique for the computation of optic flow and egomotion
KR101858491B1 (en) 3-d image analyzer for determining viewing direction
Zhou et al. Computational cameras: convergence of optics and processing
US8305485B2 (en) Digital camera with coded aperture rangefinder
US8432479B2 (en) Range measurement using a zoom camera
US9105103B2 (en) Systems and methods of tracking object movements in three-dimensional space
CN116088173B (en) Scattering imaging system, optical axis non-invasive searching method and device thereof, and storage medium
US8330852B2 (en) Range measurement using symmetric coded apertures
US20110267485A1 (en) Range measurement using a coded aperture
Kaga et al. Thermal non-line-of-sight imaging from specular and diffuse reflections
CN111160136B (en) Standardized 3D information acquisition and measurement method and system
CN110213491B (en) Focusing method, device and storage medium
WO2018031962A1 (en) Image capture with digital light path length modulation
Thurow Perspective on the development and application of light-field cameras in flow diagnostics
CA2998676A1 (en) An apparatus and a method for calibrating an optical acquisition system
Wei et al. Depth measurement using single camera with fixed camera parameters
Raffel et al. Techniques for 3D-PIV
CN105488780A (en) Monocular vision ranging tracking device used for industrial production line, and tracking method thereof
US9176263B2 (en) Optical micro-sensor
Hasler Motion capture
CN113607736A (en) Miniature intelligent sperm in-vitro detector and image processing method thereof
Ruiz-Rodriguez et al. Reconstruction of 3D deformable objects using a single Kinect sensor
CN111383262A (en) Occlusion detection method, system, electronic terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant