WO2019075680A1 - Procédé et appareil d'étalonnage de position d'imagerie ptychographique de fourier assistée par vision - Google Patents

Procédé et appareil d'étalonnage de position d'imagerie ptychographique de fourier assistée par vision Download PDF

Info

Publication number
WO2019075680A1
WO2019075680A1 PCT/CN2017/106786 CN2017106786W WO2019075680A1 WO 2019075680 A1 WO2019075680 A1 WO 2019075680A1 CN 2017106786 W CN2017106786 W CN 2017106786W WO 2019075680 A1 WO2019075680 A1 WO 2019075680A1
Authority
WO
WIPO (PCT)
Prior art keywords
center
spatial
image
coordinates
dimensional coordinates
Prior art date
Application number
PCT/CN2017/106786
Other languages
English (en)
Chinese (zh)
Inventor
刘晓利
李成
汤其剑
彭翔
Original Assignee
深圳大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳大学 filed Critical 深圳大学
Priority to PCT/CN2017/106786 priority Critical patent/WO2019075680A1/fr
Publication of WO2019075680A1 publication Critical patent/WO2019075680A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Definitions

  • the invention belongs to the field of microscopic imaging technology, and in particular relates to a visual aided Fourier laminate imaging position calibration method and device.
  • Microscopes have made it possible for humans to observe smaller objects since the day of their invention.
  • the direct change is that the field of view that the observer can observe becomes smaller.
  • the commonly used method is to realize a large-scale scanning by using a precision electric platform and combined with an image processing method, but this method requires very precise scanning and the operation process is very complicated. How to get large field of view and high resolution images at the same time has been plaguing many researchers engaged in microscopy.
  • the breakthrough in this regard should belong to the Fourier stacked imaging technology first proposed and successfully achieved large field of view and super-resolution imaging.
  • a typical Fourier stacked imaging system is implemented on the basis of a conventional microscope device, replacing the microscope's own illumination source with a programmable LED array, and controlling the sample by controlling the brightness and darkness of each LED on the LED array. Lighting in different directions.
  • the image obtained by the LED illumination sample at each position is the imaging result limited by the numerical aperture of the objective lens, and the image has the high frequency information loss of the sample, which we call a low resolution image.
  • Fourier stacked imaging technology is to obtain a plurality of low-resolution images containing different angle information of samples by sequentially lighting each LED on the illumination array, and then adopting synthetic aperture and phase recovery method in the Fourier domain of the image. To recover high resolution information from the sample.
  • the resolution of the reconstructed high-resolution image depends on the sum of the objective numerical aperture and the numerical aperture of the illumination, so from this perspective, Fourier stacked imaging technology can break the limitation of the numerical aperture of the traditional microscope objective, and finally realize the big vision. Field and high resolution imaging.
  • the implementation of Fourier stacked imaging technology is to find the spatial frequency corresponding to each different position LED in the high-resolution spectrum to be recovered, and take the corresponding position in the high-resolution spectrum with the numerical aperture of the objective lens as the radius.
  • the spectral aperture is replaced by a low-resolution image acquired at the corresponding LED position to achieve phase recovery.
  • the quality of the final restored high-resolution image is greatly affected by the positioning error of the spatial LED array, which is represented by the spatial frequency corresponding to each LED in the conventional Fourier stack.
  • the spatial frequencies at other locations are calculated based on this. Therefore, once there is a positional deviation between the center LED and the center of the micro-system, the position of the LED space of the entire illumination area is deviated, so that the center position of each sub-aperture spectrum in the high-resolution spectrum to be recovered is not Accurate, its phase recovery is also difficult to get an accurate result. Therefore, in order to obtain better recovery quality results, it is necessary to solve the problem of spatial position deviation of the LED array in the Fourier stack.
  • the invention provides a visual aided Fourier laminate imaging position calibration method and device, which aims to solve the problem that the LED array and the microscopic system center in the traditional Fourier stacked imaging optical path are difficult to precisely adjust and align, and the high resolution is to be restored.
  • the problem of degraded image quality is a problem that the LED array and the microscopic system center in the traditional Fourier stacked imaging optical path are difficult to precisely adjust and align, and the high resolution is to be restored.
  • the invention provides a visually assisted Fourier stacked imaging position calibration method, which is applied to a Fourier stacked imaging position calibration system, the calibration system comprising: a leaf stack imaging device and a vision assisted binocular camera, the Fourier stacked imaging device comprising a microscopic image acquisition camera, a microscope, a stage, a resolution plate with circular landmarks, and an LED array, a resolution plate is disposed on the stage, the microscopic image acquisition camera is located directly above the stage, the LED array is located directly below the stage, and is in a plane opposite to the stage Parallelly, the visual aid binocular camera comprises: a vision assisted left camera and a visual aid right camera, the visual assist left camera, the visual aid right camera being located directly in front of the Fourier stacked imaging device, the method comprising :
  • Step S1 using the microscopic image acquisition camera to acquire an image of the resolution plate with the circular marker points, and extracting the center of the circular marker point in the image of the resolution plate by using a circular marker point extraction algorithm.
  • Step S2 acquiring an image by using the microscopic image acquisition camera to obtain image pixel coordinates of a microscopic field center point of the image, and using a coordinate measuring device to measure the resolution plate on which the circular marker point is attached.
  • the actual physical size coordinates of each set of elements of the first level, and the actual physical state of the center of the microscopic field of view and the center of the circular mark point is calculated by establishing a relationship between the image coordinate system and the actual physical size coordinate system. Size coordinate
  • Step S3 using the vision-assisted binocular camera to capture an image when the LED array is not placed under the resolution panel, thereby obtaining each LED in the LED array in the visual aid binocular Image coordinates in the camera, the first spatial three-dimensional coordinates of each LED of the LED array are calculated from the image coordinates of each LED and the calibration parameters of the visual aid binocular camera pre-calibrated;
  • Step S4 using the vision assisting camera to acquire an image of the resolution plate with the circular marker point in the focus position and an image of the LED array placed under the resolution panel, and combined with the pre-calibrated
  • the calibration parameter of the vision assisted binocular camera calculates a spatial three-dimensional coordinate of the center of the circular marker point in the focus position and a second spatial three-dimensional coordinate of the unoccluded LED array in the focus position;
  • Step S5 calculating a spatial three-dimensional coordinate of the center of the microscopic field of view according to the spatial three-dimensional coordinates of the center of the circular marker point and the relationship between the center of the microscopic field of view and the actual physical size coordinate of the center of the circular marker point;
  • the position coordinates of each LED in the high-resolution spectrum to be recovered are calculated by combining the spatial three-dimensional coordinates of the microscopic field center and the calibration result of the LED array in the illumination area.
  • the present invention also provides a visually assisted Fourier stacked imaging position calibration device for use in a Fourier stacked imaging position calibration system, the calibration system comprising: a superimposed stacked imaging device and a visual aided binocular camera, the Fourier stacked imaging device comprising a microscopic image acquisition camera, a microscope, a stage, a resolution plate with circular landmarks, and an LED array
  • the resolution plate is placed on the stage
  • the microscopic image acquisition camera is located directly above the stage
  • the LED array is located directly below the stage and is opposite to the stage Parallel to the plane
  • the visual aid binocular camera comprises: a vision assisted left camera and a visual aid right camera, the vision assisted left camera, the visual aid right camera being located directly in front of the Fourier stack imaging device
  • the device include:
  • An image pixel coordinate extraction module configured to acquire an image of the resolution plate with a circular marker point by using the microscopic image acquisition camera, and extract an image circle of the resolution plate according to a circular marker point extraction algorithm Image pixel coordinates of the center of the mark point;
  • An actual physical size coordinate calculation module configured to acquire an image by using the microscopic image acquisition camera to obtain image pixel coordinates of a microscopic field center point of the image, and measure the circular marker point by using a three coordinate device Calculating the microscopic field center point and the circular mark by establishing a relationship between the image coordinate system and the actual physical size coordinate system on the actual physical size coordinates of each set of elements in each stage of the resolution board.
  • a first calculation module configured to acquire, by the visual aid binocular camera, an image when the LED array is not placed under the resolution panel, thereby obtaining each LED in the LED array Image coordinates in the visual aid binocular camera, the first spatial three-dimensional coordinates of each LED of the LED array are calculated from the image coordinates of each LED and the calibration parameters of the visual aid binocular camera pre-calibrated;
  • a second calculation module configured to acquire, by the vision assisting camera, an image of the resolution plate with the circular mark point attached to the focus position and an image of the LED array placed under the resolution plate at this time, And calculating, in combination with the calibration parameters of the visually assisted binocular camera, which are pre-calibrated, the spatial three-dimensional coordinates of the center of the circular marker point in the focus position and the second spatial three-dimensional coordinates of the unoccluded LED array in the focus position;
  • a calibration module configured to calculate a spatial three-dimensional space of the center of the microscopic field of view according to a spatial three-dimensional coordinate of a center of the circular marker point and an actual physical size coordinate of a center of the microscopic field of view and a center of a circular marker point coordinate;
  • the position coordinates of each LED in the high-resolution spectrum to be recovered are calculated by combining the spatial three-dimensional coordinates of the microscopic field center and the calibration result of the LED array in the illumination area.
  • the present invention has the beneficial effects that the present invention provides a visually assisted Fourier stacked imaging position calibration method and apparatus, the method comprising: passing the traditional Fourier laminate imaging calculation before recovering The visual aided binocular system is built to collect the image of the LED array not placed under the resolution plate, and the first spatial three-dimensional coordinates of the LED array are calculated by combining the camera calibration parameters; and then the circular mark is attached on the resolution plate.
  • the point method finds the spatial three-dimensional coordinates of the center of the microscopic field of view; then combines the three-dimensional coordinates of the first space and finds the spatial three-dimensional coordinates of the LED array when the system is in the focus position by rotating translation transformation, and uses the spatial three-dimensional coordinates of the center of the microscopic field of view.
  • FIG. 1 is a schematic diagram showing the hardware structure of a Fourier stacked imaging position calibration system according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a vision assisted Fourier stacked imaging position calibration method according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a calculation model of an image coordinate system and an actual physical size coordinate system according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram showing the comparison between the spatial position of the LED array and the visually assisted calibration of the spatial position of the LED array in the conventional Fourier stacked imaging according to an embodiment of the present invention
  • FIG. 5(a) is a schematic diagram showing the result of reconstructing a resolution plate by a conventional Fourier stacked imaging method according to an embodiment of the present invention
  • FIG. 5(b) is a schematic diagram showing the result of reconstructing the resolution plate after visually assisted position calibration according to an embodiment of the present invention
  • FIG. 6(a) is a schematic diagram showing the results of reconstructing human blood cells by conventional Fourier laminate imaging according to an embodiment of the present invention
  • FIG. 6(b) is a schematic diagram showing the result of reconstructing human blood cells after visual aided position calibration according to an embodiment of the present invention
  • FIG. 7 is a schematic block diagram of a vision assisted Fourier stacked imaging position calibration apparatus according to an embodiment of the present invention.
  • the present invention provides a visually assisted Fourier stacked imaging position calibration method, which is applied to a Fourier stacked imaging position calibration system, as shown in FIG.
  • the calibration system comprises: a Fourier stacked imaging device 1 and a visual aid binocular camera 2, the Fourier stacked imaging device 1 comprising a microscopic image acquisition camera 11, a microscope 12 (the microscopic image acquisition camera described in the figure) 11 below, a lens 121 and an objective lens 122), a stage (not shown), a resolution plate 13 to which a circular mark is attached, and an LED array 14 are sequentially disposed, and the resolution plate 13 is placed in the On the stage, the microscopic image acquisition camera 11 is located directly above the stage, and the LED array 14 is located directly below the stage and parallel to the plane of the stage, the vision
  • the auxiliary binocular camera 2 includes a visual assist left camera and a visual assist right camera, the visual assist left camera and the visual assist right camera being located directly in front of the Fourier stacked imaging device.
  • the microscope 12 is of the type Olympus BX43, and is equipped with an Olympus plan apochromatic objective lens, the objective lens magnification is 4 times, the numerical aperture is 0.1; and the microscope 12 is equipped with an SCMOS camera.
  • the model is PCO.edge5.5, the resolution is 2560*2048, and the pixel size is 6.5um*6.5um.
  • the visual aid binocular camera 2 uses a Basler camera, model piA2400-17gc, and the resolution is 2448*2050.
  • the pixel size is 3.45um*3.45um; the visual aid binocular camera uses a Computar lens, model number M1214-MP2.
  • the resolution board 13 adopts a USAF1951 resolution board.
  • the Fourier stacked imaging position calibration method includes:
  • Step S1 using the microscopic image acquisition camera to acquire an image of the resolution plate with the circular marker points, and extracting the center of the circular marker point in the image of the resolution plate by using a circular marker point extraction algorithm.
  • Step S2 acquiring an image by using the microscopic image acquisition camera to obtain image pixel coordinates of a microscopic field center point of the image, and using a coordinate measuring device to measure the resolution plate on which the circular marker point is attached.
  • the actual physical size coordinates of each set of elements of the first level, and the actual physical state of the center of the microscopic field of view and the center of the circular mark point is calculated by establishing a relationship between the image coordinate system and the actual physical size coordinate system. Size coordinate
  • the microscopic field center point refers to the field of view center of the image acquired by the microscopic image acquisition camera.
  • FIG. 3 is a schematic diagram of a calculation model of an image coordinate system and an actual physical size coordinate system. Specifically, the relationship between the established image coordinate system and the actual physical size coordinate system is:
  • x 0 x center +(u 0 -u center ) ⁇ dx
  • y 0 y center +(v 0 -v center ) ⁇ dy
  • x circle x center +(u circle -u center ) ⁇ dx
  • y circle y center +(v circle -v center ) ⁇ dy
  • (x 0 , y 0 ) represents the actual physical size coordinate of the center of the microscopic field of view
  • (x circle , y circle ) represents the actual physical size coordinate of the center of the circular marker point
  • (u center , v center ) indicates the selected
  • (x center , y center ) represents the physical size coordinate of the selected image coordinate system
  • the physical size coordinate is obtained by a coordinate coordinate device
  • (u 0 , v 0 ) represents the microscopic field of view.
  • the image pixel coordinates of the center point (u circle , v circle ) represent the image pixel coordinates of the center of the circular marker point, and d x and d y are the unit physical dimensions in the x and y directions of the actual physical size coordinate system, respectively.
  • Step S3 using the vision-assisted binocular camera to capture an image when the LED array is not placed under the resolution panel, thereby obtaining each LED in the LED array in the visual aid binocular Image coordinates in the camera, image coordinates from each LED and pre-calibrated view
  • a calibration parameter of the auxiliary binocular camera calculates a first spatial three-dimensional coordinate of each LED of the LED array;
  • the LED array is not placed under the resolution plate, so the LED array is not blocked by the stage, and the visual auxiliary binocular camera can collect the complete LED array when it is lit. image.
  • the pre-calibration process of the vision-assisted binocular camera is: placing a target under the vision-assisted binocular camera, and acquiring the target image in several postures by using the vision-assisted binocular camera, and according to The captured target image calculates internal parameters and external parameters of the visual aid binocular camera, and the visual assisted binocular camera is calibrated to obtain a visually assisted left camera, and the visual assisted right camera has an effective focal length of f l and f r , and the rotation matrix between the vision assisted left camera and the visual aid right camera And translation matrix
  • the parameters r 1 , r 2 , r 3 , r 4 , r 5 , r 6 , r 7 , r 8 , r 9 , t x , t y , t z can all be calibrated from the visual aid binocular camera In the camera calibration process, the MATLAB Camera Calibration Toolbox (MATLAB) is used.
  • MATLAB MATLAB Camera Calibration Toolbox
  • the formula for calculating the three-dimensional coordinates of the first space is:
  • the calibration parameters of the vision assisted binocular camera include: the effective focal length f l of the visual assisted left camera, and the effective focal length f of the visual assisted right camera r , further comprising a rotation matrix between the visual aided left camera and the visually assisted right camera Translation matrix
  • Step S4 using the vision assisting camera to acquire an image of the resolution plate with the circular marker point in the focus position and an image of the LED array placed under the resolution panel, and combined with the pre-calibrated
  • the calibration parameter of the vision assisted binocular camera calculates a spatial three-dimensional coordinate of the center of the circular marker point in the focus position and a second spatial three-dimensional coordinate of the unoccluded LED array in the focus position;
  • an image of the center of the circular marker point on the resolution panel in the vision assisted binocular camera is obtained by acquiring an image of the resolution plate with the circular marker point in the focus position. Coordinate; calculating the spatial three-dimensional coordinates of the center of the circular marker point in the focus position by the image coordinates of the center of the circular marker point and the calibration parameters of the visually-assisted binocular camera pre-calibrated. At the same time, by collecting an image of the LED array placed under the resolution plate at this time, image coordinates of the LED array in the LED array that are not blocked by the stage are obtained, and the LED array is unoccluded by the LED array. The image coordinates and the calibration parameters of the visually assisted binocular camera, which are pre-calibrated, calculate a second spatial three-dimensional coordinate of the unblocked LED array at the focus position.
  • the vision assisting camera can only observe a part of the LED array, and a part of the image can only obtain a spatial three-dimensional coordinate of a part of the LED array;
  • all spatial three-dimensional coordinates of the LED array can be obtained; then, in order to obtain all the LED arrays placed under the resolution plate
  • the spatial three-dimensional coordinates need to convert the spatial three-dimensional coordinates of the LED array not placed under the resolution plate to the position posture of step S4, and the corresponding relationship is to find the coordinate relationship of the corresponding LEDs in S3 and S4, and rotate and translate. Find the transformation relationship.
  • the spatial three-dimensional coordinates of the LED array in the focus position are obtained by combining the first spatial three-dimensional coordinates and the second spatial three-dimensional coordinates, including:
  • Step S5 calculating a spatial three-dimensional coordinate of the center of the microscopic field of view according to the spatial three-dimensional coordinates of the center of the circular marker point and the relationship between the center of the microscopic field of view and the actual physical size coordinate of the center of the circular marker point;
  • the position coordinates of each LED in the high-resolution spectrum to be recovered are calculated by combining the spatial three-dimensional coordinates of the microscopic field center and the calibration result of the LED array in the illumination area.
  • each LED of the illumination region to the focus position fitting plane Ax 0 +By 0 +Cz 0 + is calculated.
  • a height z of D 0 and an abscissa x and an ordinate y projected to the fitting plane, completing a spatial position (x, y, z) calibration of the LED array with respect to a focus position of the resolution panel;
  • the invention provides a visual aided Fourier stacked imaging position calibration method for performing Fourier stacked imaging position calibration, because the calibration result is obtained by visual aid calculation, thus reducing the experimental optical path adjustment pair The exact difficulty; at the same time, the accurate position of each LED in the high-resolution spectrum to be recovered can be calculated by the calibration result, and the influence of the position deviation on the recovery result is avoided.
  • the invention also provides a visual aided Fourier stacked imaging position calibration device, the Fuli The leaf laminate imaging position calibration device is applied to a Fourier stacked imaging position calibration system, the calibration system comprising: a Fourier laminate imaging device 1 and a vision assisted binocular camera 2, the Fourier stacked imaging device 1 includes a microscopic image acquisition camera 11, a microscope 12 (the lens 121 and the objective lens 122 are sequentially shown below the microscopic image acquisition camera 11 in the figure), a stage (not shown), and a circular mark Point resolution plate 13 and LED array 14, said resolution plate 13 being placed on said stage, said microscopic image acquisition camera 11 being located directly above said stage, said LED array 14 being located Directly below the stage and parallel to the plane of the stage, the visual aid binocular camera 2 comprises: a visual assist left camera and a visual aid right camera, the visual assist left camera and the visual assist right camera are located Directly in front of the Fourier laminate imaging device, as shown in FIG. 7, the device includes:
  • An image pixel coordinate extraction module 1 is configured to acquire an image of the resolution plate with the circular marker points by using the microscopic image acquisition camera, and extract the image of the resolution plate by using a circular marker point extraction algorithm. Image pixel coordinates of the center of the circle mark point;
  • the circular marker point extraction algorithm is specifically: detecting a circular marker point edge image coordinate (x, y) by using a canny operator in image processing and fitting an elliptic equation.
  • x 2 +2Bxy+Cy 2 +2Dx+2Ey+F 0, wherein the parameters B, C, D, E, and F are obtained by fitting, and an image of the center of the circular marker point in the image of the resolution plate is calculated
  • the formula for pixel coordinates (x, y) is:
  • the actual physical size coordinate calculation module 2 is configured to acquire an image by using the microscopic image acquisition camera to obtain image pixel coordinates of a microscopic field center point of the image, and measure the rounded mark by using a three coordinate device. Calculating the microscopic field center point and the circle by establishing a relationship between the image coordinate system and the actual physical size coordinate system on the actual physical size coordinate of each group of elements in the resolution board of the point. The actual physical size coordinates of the center of the marker point;
  • the relationship between the established image coordinate system and the actual physical size coordinate system is:
  • x 0 x center +(u 0 -u center ) ⁇ dx
  • y 0 y center +(v 0 -v center ) ⁇ dy
  • x circle x center +(u circle -u center ) ⁇ dx
  • y circle y center +(v circle -v center ) ⁇ dy
  • (x 0 , y 0 ) represents the actual physical size coordinate of the center of the microscopic field of view
  • (x circle , y circle ) represents the actual physical size coordinate of the center of the circular marker point
  • (u center , v center ) indicates the selected
  • the center image coordinate of the image coordinate system (x center , y center ) represents the physical size coordinate of the selected image coordinate system
  • (u 0 , v 0 ) represents the image pixel coordinates of the microscopic field center point
  • (u circle , v circle ) represents the image pixel coordinates of the center of the circular marker point
  • d x and d y are the unit physical dimensions in the x and y directions of the actual physical size coordinate system, respectively.
  • a first calculation module 3 configured to acquire, by using the visual aid binocular camera, an image when the LED array is not placed under the resolution panel, thereby obtaining each LED in the LED array Calculating the image coordinates in the visual aid binocular camera, calculating the first spatial three-dimensional coordinates of each LED of the LED array from the image coordinates of each LED and the calibration parameters of the visually assisted binocular camera pre-calibrated;
  • the formula for calculating the three-dimensional coordinates of the first space is:
  • the calibration parameters of the visual aid binocular camera include: the effective focal length f l of the visual aid left camera, the effective focal length f r of the visual aid right camera, and Rotation matrix between the vision assisted left camera and the vision assisted right camera Translation matrix
  • a second calculation module 4 configured to acquire, by using the vision assisting camera, an image of the resolution plate with the circular marker point in the focus position and a diagram of the LED array placed under the resolution panel at this time Calculating, according to the calibration parameters of the visually-assisted binocular camera, which is pre-calibrated, the spatial three-dimensional coordinates of the center of the circular marker point in the focus position and the second spatial three-dimensional coordinates of the unoccluded LED array in the focus position;
  • the formula for calculating the spatial three-dimensional coordinates of the LED array at the focus position is:
  • (x, y, z) represents a first spatial three-dimensional coordinate
  • (X, Y, Z) represents a second spatial three-dimensional coordinate
  • the rotation matrix R 2 and the translation matrix T 2 may utilize the first calculation module and the In the two position states of the second calculation module, the first spatial three-dimensional coordinates corresponding to the illumination LED array and the second spatial three-dimensional coordinates are calculated and fitted.
  • a calibration module 5 configured to calculate a space of the center of the microscopic field of view according to a spatial three-dimensional coordinate of a center of the circular marker point and an actual physical size coordinate of a center of the microscopic field of view and a center of a circular marker point 3D coordinates; and using the spatial three-dimensional coordinates of the center of the microscopic field of view combined with the spatial three-dimensional coordinates of the LED array at the focus position to calculate the height z of each of the LEDs in the illumination region to the focus position and the LED projection to the projection Combining the horizontal and vertical coordinates x, y of the plane, completes the spatial position (x, y, z) calibration of the LED array with respect to the resolution plate; and simultaneously combines the spatial three-dimensional coordinates of the microscopic field center with the illumination area
  • the calibration result of the LED array calculates the position coordinates of each LED in the high resolution spectrum to be recovered.

Abstract

La présente invention est applicable au domaine technique de l'imagerie microscopique, et concerne un procédé et un appareil d'étalonnage de position d'imagerie ptychographique de Fourier assistée par vision. Avant un calcul de restauration d'imagerie ptychographique de Fourier classique, une image lorsqu'une matrice de DEL qui n'est pas placée sous une plaque de résolution est éclairée est collectée au moyen d'un système binoculaire assisté par vision, et des premières coordonnées spatiales tridimensionnelles de l'image sont calculées en combinaison avec des paramètres d'étalonnage de caméra ; ensuite, au moyen d'un procédé consistant à fixer un point de repère rond à la plaque de résolution, des coordonnées spatiales tridimensionnelles du centre d'un champ de vision de microscopie sont trouvées ; puis, en combinaison avec les premières coordonnées spatiales tridimensionnelles, des coordonnées spatiales tridimensionnelles de la matrice de DEL lorsque le système est à une position de mise au point sont trouvées par rotation, translation et transformation, et en utilisant les coordonnées spatiales tridimensionnelles du centre du champ de vision de microscopie en combinaison avec les coordonnées spatiales tridimensionnelles de la matrice de DEL à la position de mise au point, la hauteur depuis chaque DEL dans une zone d'éclairage jusqu'à un plan d'ajustement de la position de mise au point ainsi qu'une coordonnée transversale et une coordonnée longitudinale de la projection de la DEL sur le plan d'ajustement sont calculées, de manière à réaliser l'étalonnage de position spatiale. La présente invention peut éviter l'influence d'un écart de position sur un résultat de restauration.
PCT/CN2017/106786 2017-10-19 2017-10-19 Procédé et appareil d'étalonnage de position d'imagerie ptychographique de fourier assistée par vision WO2019075680A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/106786 WO2019075680A1 (fr) 2017-10-19 2017-10-19 Procédé et appareil d'étalonnage de position d'imagerie ptychographique de fourier assistée par vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/106786 WO2019075680A1 (fr) 2017-10-19 2017-10-19 Procédé et appareil d'étalonnage de position d'imagerie ptychographique de fourier assistée par vision

Publications (1)

Publication Number Publication Date
WO2019075680A1 true WO2019075680A1 (fr) 2019-04-25

Family

ID=66173158

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/106786 WO2019075680A1 (fr) 2017-10-19 2017-10-19 Procédé et appareil d'étalonnage de position d'imagerie ptychographique de fourier assistée par vision

Country Status (1)

Country Link
WO (1) WO2019075680A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110175960A (zh) * 2019-05-21 2019-08-27 Oppo广东移动通信有限公司 图像校正方法、装置、电子设备以及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150317508A1 (en) * 2014-04-30 2015-11-05 University Of Connecticut Methods and Systems for Fourier Ptychographic Imaging
CN106127767A (zh) * 2016-06-24 2016-11-16 南京理工大学 一种针对傅立叶叠层显微成像技术的位置校正方法
US20170178317A1 (en) * 2015-12-21 2017-06-22 Canon Kabushiki Kaisha Physical registration of images acquired by fourier ptychography
CN107065159A (zh) * 2017-03-24 2017-08-18 南京理工大学 一种基于大照明数值孔径的大视场高分辨率显微成像装置及迭代重构方法
CN107102430A (zh) * 2017-06-01 2017-08-29 暨南大学 用于傅里叶叠层显微成像的弧形光源扫描照明装置及方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150317508A1 (en) * 2014-04-30 2015-11-05 University Of Connecticut Methods and Systems for Fourier Ptychographic Imaging
US20170178317A1 (en) * 2015-12-21 2017-06-22 Canon Kabushiki Kaisha Physical registration of images acquired by fourier ptychography
CN106127767A (zh) * 2016-06-24 2016-11-16 南京理工大学 一种针对傅立叶叠层显微成像技术的位置校正方法
CN107065159A (zh) * 2017-03-24 2017-08-18 南京理工大学 一种基于大照明数值孔径的大视场高分辨率显微成像装置及迭代重构方法
CN107102430A (zh) * 2017-06-01 2017-08-29 暨南大学 用于傅里叶叠层显微成像的弧形光源扫描照明装置及方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110175960A (zh) * 2019-05-21 2019-08-27 Oppo广东移动通信有限公司 图像校正方法、装置、电子设备以及存储介质
CN110175960B (zh) * 2019-05-21 2021-04-13 Oppo广东移动通信有限公司 图像校正方法、装置、电子设备以及存储介质

Similar Documents

Publication Publication Date Title
Genovese et al. Stereo-digital image correlation (DIC) measurements with a single camera using a biprism
Tiwari et al. Assessment of high speed imaging systems for 2D and 3D deformation measurements: methodology development and validation
WO2018228013A1 (fr) Dispositif et procédé d'étalonnage de paramètre de lumière structurée à base de miroir plan à revêtement frontal
JP4943946B2 (ja) 偏芯量測定装置
US10154187B2 (en) Apparatus and method for adjusting and / or calibrating a multi-camera module as well as the use of such an apparatus
US8934721B2 (en) Microscopic vision measurement method based on adaptive positioning of camera coordinate frame
CN107065159A (zh) 一种基于大照明数值孔径的大视场高分辨率显微成像装置及迭代重构方法
JP2016520894A (ja) 複数収集スライド画像における参照
CN107966801A (zh) 一种基于环形照明的高速傅立叶叠层成像装置及重构方法
CN109325981B (zh) 基于聚焦像点的微透镜阵列型光场相机几何参数标定方法
CN102567989A (zh) 基于双目立体视觉的空间定位方法
CN107113370A (zh) 图像捕获装置及图像捕获方法
JP7462890B2 (ja) プレノプティック・カメラ・システムを較正するための方法及びシステム
CN109581643A (zh) 傅里叶叠层显微成像装置及方法
DE102017100262A1 (de) Verfahren zur Erzeugung eines dreidimensionalen Modells einer Probe in einem digitalen Mikroskop und digitales Mikroskop
Li et al. A flexible and easy-to-implement single-camera microscopic 3D digital image correlation technique
WO2019075680A1 (fr) Procédé et appareil d'étalonnage de position d'imagerie ptychographique de fourier assistée par vision
CN107545593A (zh) 视觉辅助的傅里叶叠层成像位置标定方法及装置
JP2015156011A (ja) 画像取得装置およびその制御方法
CN111123497A (zh) 一种基于led阵列照明的显微镜光学装置及其校准方法
Hwang et al. Camera calibration and 3D surface reconstruction for multi-camera semi-circular DIC system
Veldhuis et al. Multiview robotic microscope reveals the in-plane kinematics of amphibian neurulation
CN110727095A (zh) 一种多目立体成像显微镜及成像方法
WO2014198248A2 (fr) Procédé d'imagerie plénoptique
TWI286197B (en) 2/3-dimensional synchronous image capturing system and method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17929304

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17929304

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10.12.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17929304

Country of ref document: EP

Kind code of ref document: A1