WO2021261158A1 - 情報処理装置、その作動方法及び作動プログラム - Google Patents

情報処理装置、その作動方法及び作動プログラム Download PDF

Info

Publication number
WO2021261158A1
WO2021261158A1 PCT/JP2021/019891 JP2021019891W WO2021261158A1 WO 2021261158 A1 WO2021261158 A1 WO 2021261158A1 JP 2021019891 W JP2021019891 W JP 2021019891W WO 2021261158 A1 WO2021261158 A1 WO 2021261158A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
focus position
reconstruction
original image
initial position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/019891
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
拓明 山本
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Priority to JP2022532438A priority Critical patent/JP7397196B2/ja
Priority to EP21828784.5A priority patent/EP4175283A4/en
Publication of WO2021261158A1 publication Critical patent/WO2021261158A1/ja
Priority to US18/069,279 priority patent/US12489975B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/675—Focus control based on electronic image sensor signals comprising setting of focusing regions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28—Systems for automatic generation of focusing signals
    • G02B7/36—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/761—Proximity, similarity or dissimilarity measures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
    • G06V10/993—Evaluation of the quality of the acquired pattern
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/693—Acquisition

Definitions

  • the technology of the present disclosure relates to an information processing device, an operation method thereof, and an operation program.
  • So-called lens-free digital holography which eliminates optical system components, is known in order to reduce the size of a device that captures images of small objects to be observed such as cells.
  • digital holography an object to be observed is imaged using a light source that emits coherent light such as laser light, and the image including the interference fringe image obtained by the imaging is reconstructed at an arbitrary reconstructed position. Images can be generated.
  • the reconstruction position which is the position corresponding to the distance from the image pickup sensor to the light source direction, is used as a parameter.
  • the image including the interference fringe image before the reconstruction is referred to as an original image.
  • the reconstructed position is a position corresponding to the focal length described in Patent Document 1.
  • Patent Document 2 discloses that cells are selected by processing an original image in real time while taking a moving image of an object to be observed flowing in a microchannel with an image pickup sensor.
  • the information processing apparatus of the present disclosure is an information processing apparatus that reconstructs an original image including an interference fringe image of an object to be observed, and includes at least one processor, wherein the processor is the original image.
  • Reconstruction process to generate a reconstructed image while changing the reconstructed position from the initial position based on the original image acquired by the original image acquisition process, and reconstructed by the reconstructed process.
  • Focusing position detection processing that calculates the sharpness of the reconstructed image each time an image is generated and detects the focusing position where the calculated sharpness is maximized, and focusing detected by the focusing position detection processing
  • Focusing position recording processing for recording the position, initial position determination processing for determining the initial position in the next reconstruction processing based on the focusing position recorded by the focusing position recording processing, original image acquisition processing, and reconstruction processing.
  • Focusing position detection processing, focusing position recording processing, and repetitive processing of executing initial position determination processing every one imaging cycle are executed.
  • the processor determines the in-focus position obtained in the immediately preceding imaging cycle as the initial position among one or more in-focus positions recorded in the past by the in-focus position recording process.
  • the processor determines the initial position based on the statistics of one or more in-focus positions recorded in the past by the in-focus position recording process.
  • the statistic is preferably the mode, median, or average.
  • the processor changes the reconstruction position from the initial position in the direction of increasing sharpness in the reconstruction process.
  • the processor stops the iterative processing when the difference processing for calculating the difference amount between the two original images or the two reconstructed images having different imaging cycles and the difference amount calculated by the difference processing are equal to or less than a certain value. It is preferable to carry out the processing further.
  • the processor further executes the notification information output processing for outputting the notification information when the difference amount calculated by the difference processing is equal to or less than a certain value.
  • the processor executes the optimum reconstructed image output process of outputting the reconstructed image at the focused position detected by the in-focus position detection process as the optimum reconstructed image in the iterative process.
  • the method of operating the information processing device of the present disclosure is a method of operating an information processing device that reconstructs an original image including an interference fringe image of an object to be observed, and is an original image acquisition process for acquiring an original image and an original image acquisition. Based on the original image acquired by the process, the reconstructed image is generated while changing the reconstructed position from the initial position, and the reconstructed image is sharp every time the reconstructed image is generated by the reconstructed process. Focusing position detection processing that calculates the degree and detects the focusing position that maximizes the calculated sharpness, and focusing position recording processing that records the focusing position detected by the focusing position detection processing.
  • Initial position determination processing that determines the initial position in the next reconstruction processing based on the focusing position recorded by the focusing position recording processing, original image acquisition processing, reconstruction processing, focusing position detection processing, and focusing position recording processing. , And a repetitive process of executing the initial position determination process every one imaging cycle.
  • the operation program of the present disclosure is an operation program that causes a computer to execute a process of reconstructing an original image including an interference fringe image of an object to be observed, and is an operation program that acquires an original image and obtains an original image. Based on the acquired original image, the reconstruction process that generates the reconstructed image while changing the reconstructed position from the initial position, and the sharpness of the reconstructed image each time the reconstructed image is generated by the reconstructed process.
  • Focusing position detection processing that detects the focusing position that is calculated and maximizes the calculated sharpness
  • focusing position recording processing that records the focusing position detected by the focusing position detection processing
  • focusing position Initial position determination processing that determines the initial position in the next reconstruction processing based on the focusing position recorded by the recording processing, original image acquisition processing, reconstruction processing, focusing position detection processing, focusing position recording processing, and The computer is made to execute a repetitive process of executing the initial position determination process every one image pickup cycle.
  • an information processing device capable of speeding up the search for the in-focus position, an operation method thereof, and an operation program.
  • FIG. 1 shows the configuration of the digital holography system 2 according to the first embodiment.
  • the digital holography system 2 includes an information processing device 10 and an image pickup device 11.
  • An image pickup device 11 is connected to the information processing device 10.
  • the information processing device 10 is, for example, a desktop type personal computer.
  • a display 5, a keyboard 6, a mouse 7, and the like are connected to the information processing apparatus 10.
  • the keyboard 6 and the mouse 7 constitute an input device 8 for the user to input information.
  • the input device 8 also includes a touch panel and the like.
  • FIG. 2 shows an example of the configuration of the image pickup apparatus 11.
  • the image pickup apparatus 11 has a light source 20 and an image pickup sensor 22.
  • the light source 20 is, for example, a laser diode.
  • the light source 20 may be configured by combining a light emitting diode and a pinhole.
  • a micro flow path 13 is arranged between the light source 20 and the image pickup sensor 22.
  • the micro flow path 13 is formed in, for example, a flow path unit formed of a silicone resin, and is a flow path through which a liquid can flow.
  • the flow path unit has translucency, and it is possible to irradiate the inside of the micro flow path 13 with light from the outside of the flow path unit.
  • the microchannel 13 is provided with an opening 13A for introducing the solution 14 containing cells 12 and the like, and an opening 13B for discharging the solution 14 introduced into the microchannel 13.
  • the solution 14 is introduced into the opening 13A of the microchannel 13 from a tank (not shown), flows in the microchannel 13 at a constant speed, and is discharged from the opening 13B.
  • the light source 20, the image pickup sensor 22, and the microchannel 13 are arranged, for example, in an incubator (not shown).
  • the image pickup apparatus 11 takes an image of cells 12 contained in the solution 14, for example, as an image pickup target.
  • the cell 12 is an example of an "observation target object" according to the technique of the present disclosure.
  • the light source 20 irradiates the irradiation light 23 toward the microchannel 13.
  • the irradiation light 23 is coherent light.
  • the irradiation light 23 is incident on the microchannel 13, passes through the microchannel 13, and then is incident on the image pickup surface 22A of the image pickup sensor 22.
  • the Z direction indicated by the arrow is the irradiation direction of the irradiation light 23.
  • the micro flow path 13 is arranged so that the flow direction of the solution 14 is substantially orthogonal to the Z direction.
  • the shape of the microchannel 13 and the number of openings 13A and 13B can be changed as appropriate. Further, the number of microchannels 13 arranged between the light source 20 and the image pickup sensor 22 is not limited to one, and may be two or more. In the present embodiment, it is assumed that one microchannel 13 is arranged between the light source 20 and the image pickup sensor 22.
  • the image sensor 22 is composed of, for example, a monochrome CMOS (Complementary Metal Oxide Semiconductor) type image sensor.
  • the image pickup operation of the image pickup sensor 22 is controlled by the information processing device 10.
  • the image pickup sensor 22 is arranged so that the image pickup surface 22A is orthogonal to the Z direction.
  • the irradiation light 23 is incident on the solution 14 in the microchannel 13, and the irradiation light 23 is diffracted by the cells 12, so that an interference fringe image reflecting the shape of the cells 12 is generated.
  • the interference fringe image is also referred to as a hologram image.
  • FIG. 3 shows an example of the configuration of the image pickup sensor 22.
  • the image pickup sensor 22 has a plurality of pixels 22B arranged on the image pickup surface 22A.
  • the pixel 22B is a photoelectric conversion element that outputs a pixel signal according to the amount of incident light by photoelectrically converting the incident light.
  • Pixels 22B are arranged at equal pitches along the X and Y directions.
  • the array of pixels 22B is a so-called square array.
  • the X direction is a direction orthogonal to the Z direction.
  • the Y direction is a direction orthogonal to the X direction and the Z direction.
  • the pixels 22B are arranged in the X direction at the first arrangement pitch ⁇ x and are arranged in the Y direction at the second arrangement pitch ⁇ y.
  • the image pickup sensor 22 captures the light incident on the image pickup surface 22A and outputs image data composed of pixel signals output from each of the pixels 22B. In the following, it is simply said to output an image.
  • FIG. 4 shows how the cell 12 generates the interference fringe image 33.
  • a part of the irradiation light 23 incident on the microchannel 13 is diffracted by the cells 12. That is, the irradiation light 23 is divided into a diffracted light 30 diffracted by the cell 12 and a transmitted light 31 that is not diffracted by the cell 12 and passes through the microchannel 13.
  • the transmitted light 31 is a plane wave.
  • the diffracted light 30 and the transmitted light 31 pass through the microchannel 13 and are incident on the image pickup surface 22A of the image pickup sensor 22.
  • the diffracted light 30 and the transmitted light 31 interfere with each other to generate an interference fringe image 33.
  • the interference fringe image 33 is composed of a bright portion 36 and a dark portion 38.
  • the interference fringe image 33 shows the bright portion 36 and the dark portion 38 as circles, respectively, but the shape of the interference fringe image 33 changes depending on the shape and internal structure of the cell 12.
  • the image pickup sensor 22 captures an optical image including the interference fringe image 33 formed on the image pickup surface 22A, and outputs an original image OP (see FIG. 7) including the interference fringe image 33.
  • FIGS. 5 and 6 show the wavefronts of the diffracted light 30 and the transmitted light 31.
  • FIG. 5 shows the wavefront when the diffracted light 30 and the transmitted light 31 strengthen each other.
  • FIG. 6 shows the wavefront when the diffracted light 30 and the transmitted light 31 weaken each other.
  • the solid line indicates the wavefront with the maximum amplitude of the diffracted light 30 and the transmitted light 31.
  • the broken line indicates the wavefront with the minimum amplitude of the diffracted light 30 and the transmitted light 31.
  • the white spot 35 shown on the image pickup surface 22A is a portion where the wavefronts of the diffracted light 30 and the transmitted light 31 are aligned and strengthened.
  • the portion of the white spot 35 corresponds to the bright portion 36 (see FIG. 4) of the interference fringe image 33.
  • the black spot 37 shown on the image pickup surface 22A is a portion where the wavefronts of the diffracted light 30 and the transmitted light 31 are deviated by half a wavelength and weaken each other.
  • the portion of the black dot 37 corresponds to the dark portion 38 (see FIG. 4) of the interference fringe image 33.
  • FIG. 7 shows an example of the original image OP output from the image pickup sensor 22.
  • the original image OP shown in FIG. 7 includes one interference fringe image 33 generated by diffracting the irradiation light 23 by one cell 12 (see FIG. 4) included in the image pickup region of the image pickup sensor 22. ..
  • FIG. 8 shows an example of the hardware configuration of the information processing apparatus 10.
  • the information processing device 10 includes a CPU (Central Processing Unit) 40, a storage device 41, and a communication unit 42, which are interconnected via a bus line 43. Further, the display 5 and the input device 8 described above are connected to the bus line 43.
  • a CPU Central Processing Unit
  • the CPU 40 is an arithmetic unit that realizes various functions by reading the operation program 41A stored in the storage device 41 and various data (not shown) and executing processing.
  • the CPU 40 is an example of a processor according to the technique of the present disclosure.
  • the storage device 41 includes, for example, a RAM (RandomAccessMemory), a ROM (ReadOnlyMemory), a storage device, or the like.
  • the RAM is, for example, a volatile memory used as a work area or the like.
  • the ROM is, for example, a non-volatile memory such as an operation program 41A and a flash memory that holds various data.
  • the storage device is, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive).
  • the storage stores an OS (Operating System), an application program, image data, various data, and the like.
  • the communication unit 42 is a network interface that controls transmission of various information via a network such as LAN (Local Area Network) or WAN (Wide Area Network).
  • the information processing device 10 is connected to the image pickup device 11 via the communication unit 42.
  • the display 5 displays various screens.
  • the information processing device 10 receives input of an operation instruction from the input device 8 through various screens.
  • FIG. 9 shows an example of the functional configuration of the information processing apparatus 10.
  • the function of the information processing apparatus 10 is realized by the CPU 40 executing a process based on the operation program 41A.
  • the CPU 40 includes an image pickup control unit 50, an image processing unit 51, a repeat control unit 52, and a display control unit 53.
  • the image pickup control unit 50 controls the operation of the image pickup device 11. Specifically, the image pickup control unit 50 controls the operation of generating the irradiation light 23 by the light source 20 and the image pickup operation of the image pickup sensor 22. Hereinafter, the operation of generating the irradiation light 23 by the light source 20 and the image pickup operation of the image pickup sensor 22 are collectively referred to as an image pickup operation of the image pickup apparatus 11.
  • the image pickup control unit 50 causes the image pickup device 11 to perform an image pickup operation based on the operation signal input from the input device 8.
  • the image pickup control unit 50 drives the image pickup device 11 so as to periodically perform image pickup in each image pickup cycle. That is, the image pickup device 11 performs moving image imaging. As shown in FIG. 10, the image pickup apparatus 11 performs an image pickup operation every one image pickup cycle and outputs an original image OP.
  • the image processing unit 51 performs reconstruction processing, focusing position detection processing, and the like based on the original image OP (see FIG. 7) output from the image pickup apparatus 11, and optimally focuses on the cell 12 which is the observation target object. Output the reconstructed image.
  • the repeat control unit 52 causes the image processing unit 51 to repeatedly execute the reconstruction process, the in-focus position detection process, and the like in synchronization with the image pickup cycle of the image pickup device 11.
  • the image processing unit 51 outputs an optimum reconstructed image for each imaging cycle.
  • the display control unit 53 displays the optimum reconstructed image output from the image processing unit 51 every one imaging cycle on the display 5. As a result, the optimum reconstructed image is displayed on the display 5 in real time.
  • the image pickup control unit 50 causes the image pickup device 11 to start the image pickup operation in response to the input of the image pickup start signal from the input device 8, and the image pickup device 50 in response to the input of the image pickup stop signal from the input device 8.
  • the imaging operation of 11 is stopped.
  • the repetition control unit 52 causes the image processing unit 51 to start the operation when the image pickup device 11 starts the image pickup operation, and stops the operation of the image processing unit 51 when the image pickup operation is stopped.
  • the image processing unit 51 includes an original image acquisition unit 60, a reconstruction image generation unit 61, an in-focus position detection unit 62, an in-focus position recording unit 63, an initial position determination unit 64, and an optimum reconstruction image output unit 65.
  • the original image acquisition unit 60 acquires the original image OP (see FIG. 10) output as a result of the imaging device 11 imaging the microchannel 13 every one imaging cycle.
  • the original image acquisition unit 60 stores the acquired original image OP in the storage device 41.
  • the reconstructed image generation unit 61 reconstructs the original image OP while changing the reconstructed position, and generates a reconstructed image RP at each reconstructed position. Specifically, as shown in FIG. 11, the reconstructed image generation unit 61 generates a reconstructed image RP each time the reconstructed position P is changed while changing the reconstructed position P by a constant value.
  • the reconstruction position P is a position (so-called depth position) represented by a distance d from the image pickup surface 22A of the image pickup sensor 22 toward the light source 20.
  • the reconstruction image generation unit 61 performs reconstruction processing based on, for example, the Fresnel conversion equations represented by the following equations (1) to (3).
  • I (x, y) represents the original image OP.
  • x represents the coordinates of the pixel 22B (see FIG. 3) of the image pickup sensor 22 with respect to the X direction.
  • y represents the coordinates of the pixel 22B with respect to the Y direction.
  • ⁇ x is the above-mentioned first arrangement pitch
  • ⁇ y is the above-mentioned second arrangement pitch (see FIG. 3).
  • ⁇ is the wavelength of the irradiation light 23.
  • ⁇ (m, n) is a complex amplitude image in which the original image OP is Fresnel-transformed.
  • m 1,2,3, ... Nx-1
  • n 1,2,3, ... Ny-1.
  • Nx represents the number of arrangements of the pixels 22B in the X direction on the imaging surface 22A.
  • Ny represents the number of arrangements of the pixels 22B in the Y direction on the imaging surface 22A.
  • a 0 (m, n) is an intensity distribution image representing the intensity component of the complex amplitude image ⁇ (m, n).
  • ⁇ 0 (m, n) is a phase distribution image representing the phase component of the complex amplitude image ⁇ (m, n).
  • the reconstructed image generation unit 61 obtains a complex amplitude image ⁇ (m, n) by applying the original image OP to the equation (1), and obtains the obtained complex amplitude image ⁇ (m, n) in the equation (2). Alternatively, by applying to the equation (3), the intensity distribution image A 0 (m, n) or the phase distribution image ⁇ 0 (m, n) is obtained. The reconstructed image generation unit 61 obtains one of the intensity distribution image A 0 (m, n) and the phase distribution image ⁇ 0 (m, n), outputs it as a reconstructed image RP, and stores it. Store in device 41.
  • the reconstructed image generation unit 61 outputs the phase distribution image ⁇ 0 (m, n) as the reconstructed image RP.
  • the phase distribution image ⁇ 0 (m, n) is an image showing the refractive index distribution of the object to be observed. Since the cell 12 which is the observation target object in the present embodiment is translucent, most of the irradiation light 23 is not absorbed by the cell 12, but is transmitted or diffracted. The statue hardly appears. Therefore, in the present embodiment, it is preferable to use the phase distribution image ⁇ 0 (m, n) as the reconstructed image RP.
  • the wavelength ⁇ of the irradiation light 23 is included in, for example, the image pickup condition 11A supplied from the image pickup apparatus 11.
  • the reconstructed image generation unit 61 performs the calculation of the equation (1) using the value of the wavelength ⁇ included in the imaging condition 11A. Further, the reconstructed image generation unit 61 obtained and obtained the complex amplitude image ⁇ (m, n) by performing the calculation of the equation (1) while changing the distance d corresponding to the reconstructed position P by a constant value.
  • the complex amplitude image ⁇ (m, n) is applied to Eq. (2) or Eq. (3).
  • the reconstruction image generation unit 61 starts changing the reconstruction position P from the initial position Pi supplied from the initial position determination unit 64, which will be described later.
  • the reconstructed image generation unit 61 reconstructs the reconstructed position P in the direction indicated by the arrow D (hereinafter referred to as the change direction D) from the initial position Pi while changing the reconstructed position P by a constant value ⁇ P.
  • the generation of the configuration image RP is repeated.
  • P1 and P2 shown in FIG. 12 correspond to the lower limit and the upper limit of the range in which the cell 12 which is an observation target object can exist in the Z direction, respectively.
  • the reconstruction image generation unit 61 changes the reconstruction position P within the range from the lower limit position P1 to the upper limit position P2.
  • the change of the reconstruction position P corresponds to the change of the distance d in the equation (1).
  • the reconstructed image generation unit 61 determines the changing direction D of the reconstructed position P from the initial position Pi based on the sharpness of the reconstructed image RP calculated by the in-focus position detection unit 62 described later. For example, the reconstruction image generation unit 61 sets the direction in which the sharpness increases from the initial position Pi as the change direction D. For example, as shown in FIG. 13, the reconstructed image generation unit 61 acquires the sharpness at the position (Pi + ⁇ P) shifted from the initial position Pi in the direction of the upper limit position P2 by a constant value ⁇ P from the in-focus position detection unit 62. ..
  • the reconstruction image generation unit 61 sets the direction from the initial position Pi to the upper limit position P2 as the change direction D.
  • the reconstructed image generation unit 61 sets the direction from the initial position Pi to the lower limit position P1 as the changing direction D. do.
  • the reconstruction image generation unit 61 is not limited to the method using the Fresnel conversion formula, and may perform the reconstruction processing by a Fourier iterative phase retrieval method or the like.
  • the focusing position detection unit 62 obtains the sharpness of each reconstructed image RP output from the reconstructed image generation unit 61 and stored in the storage device 41, and the reconfiguration in which the sharpness is maximized is obtained.
  • the position P (hereinafter referred to as the in-focus position Pm) is searched.
  • the in-focus position detection unit 62 detects the in-focus position Pm and inputs it to the in-focus position recording unit 63 every one imaging cycle.
  • the in-focus position detection unit 62 calculates, for example, the contrast value of the reconstructed image RP as sharpness.
  • the in-focus position detection unit 62 may use a value obtained by evaluating the spread of the image of the cell 12 in the reconstructed image RP by a cross-sectional profile or the like as the sharpness. Further, the in-focus position detection unit 62 may obtain sharpness by performing frequency analysis by Fourier analysis or the like.
  • the in-focus position recording unit 63 performs an in-focus position recording process for sequentially recording the in-focus position Pm input from the in-focus position detection unit 62 in the storage device 41 every one imaging cycle.
  • the initial position determination unit 64 is based on the past one or more in-focus position Pm recorded in the storage device 41.
  • the reconstruction image generation unit 61 determines the initial position Pi to be used for the reconstruction process in the next imaging cycle.
  • the initial position determination unit 64 determines the initial position Pi based on, for example, a statistic (for example, mode, median, or average value) of a plurality of in-focus positions Pm.
  • the initial position determination unit 64 inputs the determined initial position Pi to the reconstruction image generation unit 61.
  • the optimum reconstructed image output unit 65 acquires the reconstructed image RP corresponding to the in-focus position Pm from the storage device 41 each time the in-focus position Pm is recorded by the in-focus position recording unit 63 in each imaging cycle. .. Further, the optimum reconstructed image output unit 65 performs an optimum reconstructed image output process of outputting the acquired reconstructed image RP as an optimum reconstructed image to the display control unit 53.
  • FIG. 14 shows an example of the flow of iterative processing by the iterative control unit 52.
  • the original image acquisition unit 60 acquires the original image OP corresponding to the first image pickup cycle (step S10).
  • the original image OP acquired by the original image acquisition unit 60 is stored in the storage device 41.
  • the reconstruction image generation unit 61 reads the original image OP from the storage device 41, sets the reconstruction position P to the initial position Pi, and then performs the above-mentioned reconstruction processing to generate the reconstruction image RP. (Step S20).
  • the reconstructed image RP generated by the reconstructed image generation unit 61 is stored in the storage device 41.
  • the in-focus position detection unit 62 reads the reconstructed image RP from the storage device 41, calculates the sharpness of the reconstructed image RP, and detects the in-focus position Pm based on the calculated sharpness (step). S30). Since the in-focus position Pm is the reconstructed position P in which the sharpness is maximized, it is necessary to calculate the sharpness of at least three reconstructed image RPs in order to detect the in-focus position Pm. For this, step S30 needs to be repeated at least three times.
  • the repeat control unit 52 determines whether or not the in-focus position Pm has been detected by the in-focus position detection unit 62 (step S40). If the repeat control unit 52 determines that the focus position Pm has not been detected (step S40: NO), the process returns to step S20. Each process of step S20 and step S30 is repeatedly executed until the determination is affirmed in step S40.
  • step S40 When the in-focus position Pm is detected by the in-focus position detection unit 62 (step S40: YES), the repeat control unit 52 shifts the process to step S50.
  • step S50 the focusing position recording unit 63 records the focusing position Pm detected by the focusing position detecting unit 62 in the storage device 41.
  • the initial position determining unit 64 determines the initial position Pi to be used in the reconstruction process (step S20) in the next imaging cycle based on one or more focusing positions Pm recorded in the storage device 41 in the past (step S20). Step S60). The initial position Pi determined by the initial position determining unit 64 is supplied to the reconstructed image generation unit 61.
  • the optimum reconstructed image output unit 65 acquires the reconstructed image RP corresponding to the in-focus position Pm recorded in the storage device 41 in the current imaging cycle from the storage device 41, and optimally reconstructs the acquired reconstructed image RP. It is output to the display control unit 53 as an image (step S70).
  • the display control unit 53 causes the display 5 to display the optimum reconstruction image input from the optimum reconstruction image output unit 65 (step S80).
  • step S90 determines whether or not the image pickup stop signal has been input from the input device 8 (step S90).
  • step S90: NO the repeat control unit 52 increments the parameter N (see FIG. 10) representing the image pickup cycle number (step S100), and performs processing.
  • step S10 the original image acquisition unit 60 acquires the original image OP corresponding to the second imaging cycle.
  • Each process from step S10 to step S100 is repeatedly executed every one imaging cycle until the determination is affirmed in step S90.
  • step S90 the repeat control unit 52 ends a series of repeat processes.
  • step S20 the reconstruction process (step S20), the in-focus position detection process (step S30), and the initial position determination process (step S60) will be described in detail.
  • FIG. 15 shows an example of the flow of the reconstruction process by the reconstruction image generation unit 61.
  • the reconstructed image generation unit 61 reads the original image OP acquired by the original image acquisition process by the original image acquisition unit 60 and stored in the storage device 41 (step S21).
  • the reconstruction image generation unit 61 acquires the initial position Pi determined by the initial position determination unit 64 (step S22).
  • the reconstruction image generation unit 61 sets the acquired initial position Pi as the reconstruction position P (step S23). Since it is necessary for the initial position determination unit 64 to complete at least one reconstruction process in order to determine the initial position Pi, in the first reconstruction process, the initial position is determined from the initial position determination unit 64. I can't get Pi. Therefore, in the first reconstruction process, the reconstruction image generation unit 61 sets, for example, the initial position Pi to the central position located at the center between the lower limit position P1 and the upper limit position P2 (FIG. 12). reference). Further, the reconstruction image generation unit 61 may set the initial position Pi to the lower limit position P1 or the upper limit position P2 in the first reconstruction process.
  • the reconstructed image generation unit 61 performs a calculation based on the original image OP using the equations (1) and (3), and as shown in FIG. 11, the reconstructed image at the reconstructed position P.
  • Generate RP (step S24).
  • the reconstructed image generation unit 61 performs an operation using the value of the wavelength ⁇ included in the image pickup condition 11A supplied from the image pickup apparatus 11.
  • the reconstructed image RP is a phase distribution image ⁇ 0 (m, n).
  • the reconstructed image generation unit 61 outputs the generated reconstructed image RP and stores it in the storage device 41 (step S25).
  • the reconstructed image RP stored in the storage device 41 is used in the focusing position detection process by the focusing position detection unit 62.
  • the reconstruction image generation unit 61 changes the reconstruction position P in the change direction D by a constant value ⁇ P (see FIG. 12) (step S26).
  • the reconstruction image generation unit 61 changes the reconstruction position P, for example, with the direction from the initial position Pi to the upper limit position P2 as the change direction D.
  • the reconstruction image generation unit 61 obtained the sharpness of the reconstruction image RP obtained in the first reconstruction process and the sharpness in the second reconstruction process.
  • the reconstruction position P is changed by comparing with the sharpness of the reconstructed image RP and setting the direction in which the sharpness becomes high as the change direction D (see FIG. 13). This completes one reconstruction process.
  • FIG. 16 shows an example of the flow of the in-focus position detection process by the in-focus position detection unit 62.
  • the in-focus position detection unit 62 acquires one reconstructed image RP output from the reconstructed image generation unit 61 and stored in the storage device 41 (step S31).
  • the in-focus position detection unit 62 calculates the sharpness of the acquired reconstructed image RP (step S32).
  • step S33 determines whether or not the calculated sharpness has reached the maximum.
  • step S33 determines that the sharpness has not reached the maximum.
  • step S33 the in-focus position detection unit 62 detects the reconstructed position P in which the sharpness is maximized as the in-focus position Pm.
  • the detected focusing position Pm is output to the focusing position recording unit 63 (step S34). This completes one in-focus position detection process.
  • FIG. 17 shows an example of the search process for the in-focus position Pm.
  • the in-focus position detection unit 62 performs peak determination of sharpness by, for example, a so-called mountain climbing method. Each time the in-focus position detection unit 62 calculates the sharpness, the calculated sharpness is plotted in association with the reconstructed position P. The sharpness increases as the reconstruction position P approaches the in-focus position Pm, and decreases after the in-focus position Pm. When the in-focus position detection unit 62 detects that the sharpness has changed from an increase to a decrease, the in-focus position detection unit 62 detects the previous reconstructed position P as the in-focus position Pm.
  • the in-focus position Pm corresponds to the depth position of the cell 12 which is the object to be observed.
  • FIG. 18 shows an example of the flow of the initial position determination process by the initial position determination unit 64.
  • the initial position determining unit 64 acquires one or more in-focus position Pm recorded in the storage device 41 in the past by the in-focus position recording unit 63 (step S61).
  • the initial position determining unit 64 acquires, for example, one or more focusing positions Pm recorded in the storage device 41 between the start of the imaging operation by the imaging device 11 and the current imaging cycle.
  • the initial position determination unit 64 calculates the acquired statistic of one or more in-focus positions Pm (step S62). As shown in FIG. 19, the initial position determining unit 64 calculates the mode of the in-focus position Pm by creating a histogram based on the acquired one or more in-focus positions Pm.
  • the initial position determining unit 64 is not limited to the mode value, and may calculate a median value, an average value, or the like.
  • the initial position determination unit 64 determines the calculated statistic as the initial position Pi (step S63), and outputs the determined initial position Pi to the reconstructed image generation unit 61 (step S64). This completes one initial position determination process.
  • the initial position determination unit 64 determines the in-focus position Pm obtained in the immediately preceding imaging cycle by the in-focus position detection unit 62 as the initial position Pi without calculating the statistic of the in-focus position Pm. good.
  • the initial position Pi of the reconstruction position P to start the reconstruction process is determined based on the past focusing position Pm, so that the search for the focusing position Pm can be performed at high speed. Can be transformed into.
  • the position of the cells 12 flowing in the microchannel 13 in the depth direction is not constant and varies, but the initial position Pi is determined based on the past focusing position Pm, so that the reconstruction process and focusing can be performed.
  • the number of position detection processes is reduced. This speeds up the search for the in-focus position Pm. By speeding up the search for the in-focus position Pm, it is possible to display the optimum reconstructed image in which the cell 12 as the observation target object is clearly reflected on the display 5 in real time.
  • FIG. 20 shows the functional configuration of the information processing apparatus 10A according to the second embodiment.
  • the information processing apparatus 10A according to the second embodiment includes a stop determination unit 66 and a broadcast information output unit 54 in addition to the functional configuration of the information processing apparatus 10 according to the first embodiment.
  • the stop determination unit 66 is included in the image processing unit 51.
  • the repeat control unit 52 performs a stop process for stopping the repeat process of the image processing unit 51 when the stop instruction 66A input from the stop determination unit 66 is input. Further, the repeat control unit 52 restarts the repeat process of the image processing unit 51 when the input of the stop instruction 66A is canceled.
  • the stop determination unit 66 calculates the difference amount between the two original image OPs having different imaging cycles, and repeatedly outputs the stop instruction 66A to the control unit 52 when the calculated difference amount is equal to or less than a certain value.
  • the fact that the difference amount between the two original image OPs is not more than a certain value corresponds to the fact that the cell 12 as the observation target object is not reflected in the original image OP. That is, the stop determination unit 66 also functions as an object detector. Further, when the flow of the solution 14 in the microchannel 13 is stopped, the change in the original image OP obtained in each imaging cycle is reduced, and the difference amount becomes a certain value or less. In this way, the stop determination unit 66 also functions as a flow detector for detecting the flow of the solution 14 in the micro flow path 13.
  • the notification information output unit 54 performs notification information output processing for outputting the notification information 54A to the display control unit 53 when the difference amount calculated by the stop determination unit 66 is equal to or less than a certain value.
  • the display control unit 53 causes the display 5 to display the notification information 54A input from the notification information output unit 54.
  • the notification information 54A is, for example, information for notifying the user that the cell 12 has not been detected.
  • the notification information 54A may be information for notifying the user that the flow of the solution 14 has stopped.
  • the notification information output unit 54 may notify the user by voice of the presence or absence of detection of the cell 12 by outputting the notification information 54A to a speaker (not shown).
  • FIG. 21 shows the flow of the iterative process by the iterative control unit 52 according to the second embodiment.
  • the iterative process of the present embodiment is different from the iterative process of the first embodiment shown in FIG. 14 only in that step S110 and step S120 are added between steps S10 and S20.
  • the above-mentioned determination process is performed by the stop determination unit 66 (step S110).
  • the stop determination unit 66 outputs a stop instruction 66A when the above-mentioned stop condition is satisfied.
  • step S120 determines whether or not the stop instruction 66A has been received from the stop determination unit 66 (step S120).
  • the process shifts to step S20.
  • the processing after step S20 is the same as that of the first embodiment.
  • step S120 determines that the stop instruction 66A has been received (step S120: YES)
  • step S90 shifts to step S90.
  • the processing after step S90 is the same as that of the first embodiment.
  • the processes such as the reconstruction process and the in-focus position detection process included in steps S20 to S30 are skipped. To. That is, processes such as the reconstruction process and the in-focus position detection process are executed only when the cells 12 are detected.
  • FIG. 22 shows an example of the stop determination process by the stop determination unit 66.
  • the stop determination unit 66 acquires two original image OPs obtained in the last two imaging cycles from the storage device 41 (step S111).
  • the stop determination unit 66 performs a difference process for calculating the difference amount by subtracting the other from one of the two acquired original image OPs (step S112).
  • the stop determination unit 66 determines whether or not the calculated difference amount is equal to or less than a certain value (step S113). If the difference amount is not equal to or less than a certain value (step S113: NO), the stop determination unit 66 ends the process. When the difference amount is equal to or less than a certain value (step S113: YES), the stop determination unit 66 outputs the stop instruction 66A (step S114), and ends the process.
  • the reconstruction process, the in-focus position detection process, and the like are executed only when the cells 12 are detected, so that the arithmetic load of the CPU 40 and the storage device 41 can be used.
  • the amount of data to be stored can be reduced.
  • the notification information 54A is notified, so that the user can easily grasp that the cell 12 is not detected.
  • the stop determination unit 66 calculates the difference amount between the two original image OPs having different imaging cycles, but the stopping determination unit 66 is not limited to this, and the stop determination unit 66 has two different imaging cycles.
  • the difference amount of the reconstructed image RP may be calculated. Further, the stop determination unit 66 may calculate the difference amount between the two optimally reconstructed images having different imaging cycles.
  • the stop determination unit 66 outputs a stop instruction 66A when it is determined that the difference amount is equal to or less than a certain value, but the imaging cycle in which the difference amount is equal to or less than a certain value is constant. When it is repeated a number of times, the stop instruction 66A may be output.
  • the notification information output unit 54 outputs that the cell 12 has not been detected as the notification information 54A, but conversely, the notification information output unit 54 notifies that the cell 12 has been detected. It may be output as information 54A.
  • the stop determination unit 66 detects the presence or absence of the cell 12 by calculating the difference amount between the two images, but the image using a method such as image analysis or machine learning.
  • the presence or absence of the cell 12 may be detected by the recognition process.
  • the notification information output unit 54 may output an image of the cells 12, the number of cells 12, the speed of the cells 12 flowing through the microchannel 13, and the like as the notification information 54A.
  • the notification information output unit 54 may determine the type of the observation target object from the shape of the observation target object detected by image analysis or image recognition, and output the type of the observation target object as the notification information 54A.
  • the image pickup apparatus 11 is imaging one microchannel 13, but a plurality of microchannels 13 may be imaged at the same time. In this case, it is preferable to perform the reconstruction process, the in-focus position detection process, and the like only on the microchannel 13 in which the cells 12 are detected.
  • the phase distribution image ⁇ 0 (m, n) obtained by the equation (3) is used as the reconstructed image RP, but the present invention is not limited to this, and the intensity distribution image A 0 (m, n) obtained by the equation (2) is not limited to this.
  • n) may be used as the reconstructed image RP.
  • the object to be observed has a thickness such as a cell population (so-called colony)
  • an image appears in the intensity distribution , so it is preferable to use the intensity distribution image A0 (m, n) as the reconstructed image RP.
  • the input device 8 may allow the user to select which of the phase distribution image ⁇ 0 (m, n) and the intensity distribution image A 0 (m, n) is used as the reconstructed image RP. As a result, the user can select the optimum reconstructed image RP according to the object to be observed.
  • the digital holography system 2 relates to a technique called lens-free imaging, in which the image pickup apparatus 11 is not provided with an optical lens.
  • the technique of the present disclosure is not limited to lens-free imaging, and can be applied to digital holography in general (for example, when reference light is used).
  • the hardware configuration of the computer constituting the information processing devices 10 and 10A can be modified in various ways.
  • the information processing apparatus 10 can be configured by a plurality of computers separated as hardware for the purpose of improving processing capacity and reliability.
  • the hardware configuration of the computer of the information processing devices 10 and 10A can be appropriately changed according to the required performance such as processing capacity, safety, and reliability. Further, not only the hardware but also the application program such as the operation program 41A can be duplicated for the purpose of ensuring safety and reliability, or can be distributed and stored in a plurality of storage devices. ..
  • processors for example, hardware of a processing unit (Processing Unit) that executes various processes such as an image pickup control unit 50, an image processing unit 51, a repetition control unit 52, a display control unit 53, and a notification information output unit 54.
  • various processors shown below can be used.
  • the CPU 40 which is a general-purpose processor that executes software (operation program 41A) and functions as various processing units, after manufacturing an FPGA (Field Programmable Gate Array) or the like.
  • Dedicated processor with a circuit configuration designed exclusively for executing specific processing such as programmable logic device (PLD), ASIC (Application Specific Integrated Circuit), which is a processor whose circuit configuration can be changed. Includes electrical circuits and the like.
  • One processing unit may be composed of one of these various processors, or may be a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs and / or a CPU). It may be configured in combination with FPGA). Further, a plurality of processing units may be configured by one processor.
  • one processor is configured by a combination of one or more CPUs and software, as represented by a computer such as a client and a server.
  • the processor functions as a plurality of processing units.
  • SoC System On Chip
  • the various processing units are configured by using one or more of the above-mentioned various processors as a hardware-like structure.
  • an electric circuit in which circuit elements such as semiconductor elements are combined can be used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Automatic Focus Adjustment (AREA)
  • Microscoopes, Condenser (AREA)
PCT/JP2021/019891 2020-06-25 2021-05-26 情報処理装置、その作動方法及び作動プログラム Ceased WO2021261158A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2022532438A JP7397196B2 (ja) 2020-06-25 2021-05-26 情報処理装置、その作動方法及び作動プログラム
EP21828784.5A EP4175283A4 (en) 2020-06-25 2021-05-26 INFORMATION PROCESSING DEVICE, ASSOCIATED OPERATING METHOD AND OPERATING PROGRAM
US18/069,279 US12489975B2 (en) 2020-06-25 2022-12-21 Information processing device, and operation method and operation program thereof

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-109803 2020-06-25
JP2020109803 2020-06-25

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/069,279 Continuation US12489975B2 (en) 2020-06-25 2022-12-21 Information processing device, and operation method and operation program thereof

Publications (1)

Publication Number Publication Date
WO2021261158A1 true WO2021261158A1 (ja) 2021-12-30

Family

ID=79282454

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/019891 Ceased WO2021261158A1 (ja) 2020-06-25 2021-05-26 情報処理装置、その作動方法及び作動プログラム

Country Status (4)

Country Link
US (1) US12489975B2 (https=)
EP (1) EP4175283A4 (https=)
JP (1) JP7397196B2 (https=)
WO (1) WO2021261158A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230028492A1 (en) * 2021-07-20 2023-01-26 Cytena Gmbh Method for detecting a particle in a container filled with liquid
JPWO2023188305A1 (https=) * 2022-03-31 2023-10-05

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016163560A1 (ja) * 2015-04-09 2016-10-13 国立大学法人神戸大学 ディジタルホログラフィック顕微鏡
JP2017075958A (ja) 2011-12-07 2017-04-20 アイメックＩｍｅｃ 流体中の物体の分析および選別
JP2017146696A (ja) * 2016-02-16 2017-08-24 ソニー株式会社 画像処理装置、画像処理方法及び画像処理システム
JP2017168602A (ja) 2016-03-15 2017-09-21 富士電機株式会社 半導体装置および半導体装置の製造方法
WO2018158810A1 (ja) * 2017-02-28 2018-09-07 株式会社島津製作所 細胞観察装置
WO2019180810A1 (ja) * 2018-03-20 2019-09-26 株式会社島津製作所 細胞観察装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4811632B2 (ja) 2004-08-17 2011-11-09 横河電機株式会社 ３次元共焦点顕微鏡システム
JP2008249804A (ja) 2007-03-29 2008-10-16 Fujifilm Corp 共焦点蛍光顕微鏡
CN101349540B (zh) * 2007-07-18 2011-06-29 财团法人工业技术研究院 影像调整方法及影像撷取装置
EP2667150B1 (en) * 2011-01-21 2018-03-14 University of Hyogo Three-dimensional shape measurement method and three-dimensional shape measurement device
AU2014280898A1 (en) * 2014-12-23 2016-07-07 Canon Kabushiki Kaisha Reconstruction algorithm for Fourier Ptychographic imaging

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017075958A (ja) 2011-12-07 2017-04-20 アイメックＩｍｅｃ 流体中の物体の分析および選別
WO2016163560A1 (ja) * 2015-04-09 2016-10-13 国立大学法人神戸大学 ディジタルホログラフィック顕微鏡
JP2017146696A (ja) * 2016-02-16 2017-08-24 ソニー株式会社 画像処理装置、画像処理方法及び画像処理システム
JP2017168602A (ja) 2016-03-15 2017-09-21 富士電機株式会社 半導体装置および半導体装置の製造方法
WO2018158810A1 (ja) * 2017-02-28 2018-09-07 株式会社島津製作所 細胞観察装置
WO2019180810A1 (ja) * 2018-03-20 2019-09-26 株式会社島津製作所 細胞観察装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4175283A4

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230028492A1 (en) * 2021-07-20 2023-01-26 Cytena Gmbh Method for detecting a particle in a container filled with liquid
US12332266B2 (en) * 2021-07-20 2025-06-17 Cytena Gmbh Method for detecting a particle in a container filled with liquid
JPWO2023188305A1 (https=) * 2022-03-31 2023-10-05
JP7736170B2 (ja) 2022-03-31 2025-09-09 日本電気株式会社 情報処理装置、情報処理方法、及び、記録媒体

Also Published As

Publication number Publication date
US12489975B2 (en) 2025-12-02
JP7397196B2 (ja) 2023-12-12
US20230121799A1 (en) 2023-04-20
EP4175283A1 (en) 2023-05-03
EP4175283A4 (en) 2023-11-22
JPWO2021261158A1 (https=) 2021-12-30

Similar Documents

Publication Publication Date Title
Pei et al. Dynamic non-line-of-sight imaging system based on the optimization of point spread functions
RU2633922C2 (ru) Устройство и способ для профилирования глубины поверхности целевого объекта
JP5134694B2 (ja) 画像処理装置及び画像処理方法
JP2022509959A (ja) 学習型のオートフォーカス
JP7397196B2 (ja) 情報処理装置、その作動方法及び作動プログラム
US11378521B2 (en) Optical condition determination system and optical condition determination method
TWI452335B (zh) 應用共聚焦顯微鏡結構的被測物圖像獲取方法及系統
CN109901303B (zh) 基于自适应并行坐标算法的多模光纤出射光斑聚焦方法与系统
Ge et al. Millisecond autofocusing microscopy using neuromorphic event sensing
US20230120464A1 (en) Imaging system and imaging device
WO2009077779A2 (en) Method and apparatus for providing image data
KR101505745B1 (ko) 이중 검출 반사 공초점 현미경 및 이를 사용하는 시편의 높이의 정보를 검출하는 방법
JP7364796B2 (ja) 情報処理装置、その作動方法及び作動プログラム
JP6362415B2 (ja) オートフォーカス装置および顕微鏡システム
WO2017034517A1 (en) Digital spectroscopic and holographic microscope and method thereof
JP2023090091A (ja) 波面計測装置及び波面計測方法
JP4398183B2 (ja) 共焦点顕微鏡
JP2013088570A (ja) 顕微鏡装置
CN119002212B (zh) 一种基于区域分割和二分法的数字全息聚焦方法和系统
JP7566302B2 (ja) フローサイトメータ、観測対象物判別方法、及びプログラム
CN119845894B (zh) 实时太赫兹波单像素成像方法、装置、系统和计算机设备
Ouyang et al. High-Speed 3D Imaging
CN120985070A (zh) 激光头出光信号焦距检测方法和相关设备
CN114485457A (zh) 基于二值正交光栅的深度信息检测系统及方法
CN120820093A (zh) 电池极板的毛刺轮廓检测装置及方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21828784

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022532438

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021828784

Country of ref document: EP

Effective date: 20230125