US11880965B2 - Smartphone for obtaining Fourier ptychography image and method for obtaining Fourier ptychography image using smartphone - Google Patents
Smartphone for obtaining Fourier ptychography image and method for obtaining Fourier ptychography image using smartphone Download PDFInfo
- Publication number
- US11880965B2 US11880965B2 US17/671,513 US202217671513A US11880965B2 US 11880965 B2 US11880965 B2 US 11880965B2 US 202217671513 A US202217671513 A US 202217671513A US 11880965 B2 US11880965 B2 US 11880965B2
- Authority
- US
- United States
- Prior art keywords
- point light
- light source
- image
- pattern
- smartphone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000005286 illumination Methods 0.000 claims abstract description 79
- 230000003287 optical effect Effects 0.000 claims description 22
- 238000000926 separation method Methods 0.000 claims description 11
- 238000013441 quality evaluation Methods 0.000 claims description 7
- 239000000523 sample Substances 0.000 description 31
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 239000012472 biological sample Substances 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 238000010827 pathological analysis Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000012780 transparent material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/0008—Microscopes having a simple construction, e.g. portable microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G06T5/001—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10141—Special mode during image acquisition
- G06T2207/10152—Varying illumination
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30168—Image quality inspection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
Definitions
- the present disclosure relates to a smartphone and a method for obtaining image using a smartphone, more particularly to a smartphone for obtaining Fourier ptychography image and a method for obtaining Fourier ptychography image using a smartphone.
- Fourier ptychography image restoration technology is a technology for improving resolution by composing an optical system with an objective lens of a low magnification and low numerical aperture that can capture large-area images, obtaining multiple images by changing the incident angle of the illumination of the sample, and applying a restoration algorithm to the obtained multiple images.
- the demand is increasing for a simple and highly portable image acquisition device that can be used for experiments and pathological diagnosis in a limited environment.
- the Fourier ptychography image restoration technology can simultaneously improve the observation area and resolution, it requires a separate illumination device to obtain multiple images, and a separate camera and processor for image processing are required for Fourier ptychography image restoration.
- the present disclosure proposes a method capable of restoring a Fourier ptychography image at low cost without using a separate illumination device.
- the present disclosure proposes a method for obtaining Fourier ptychography image using a smartphone capable of improving the quality of the Fourier ptychography image.
- a method for obtaining a Fourier ptychography image using a smartphone in which a Fourier ptychography image of a sample is obtained by controlling the smartphone through an application installed on the smartphone, the method comprising the steps of: (a) sequentially providing illumination of different angles to the sample by sequentially displaying, according to a first pattern composed of point light sources at different positions, the point light sources of the first pattern on a display of the smartphone; (b) obtaining an image for each illumination angle of the sample using a camera of the smartphone whenever illumination of different angles is provided by the point light sources of the first pattern; and (c) restoring a first Fourier ptychography image using a plurality of images for each illumination angle obtained using the camera of the smartphone.
- the point light sources of the first pattern include a first point light source displayed vertically aligned with the sample, and a plurality of point light sources are distributed in the first pattern around the first point light source.
- the sizes of the plurality of point light sources distributed around the first point light source are set in proportion to a separation distance from the first point light source.
- the first point light source has a circular shape, and shapes of a plurality of point light sources distributed around the first point light source are set based on a separation direction between the first point light source and the corresponding point light source.
- the point light source spaced apart from the first point light source in the horizontal direction has an elliptical shape having a major axis in the horizontal direction
- the point light source spaced apart from the first point light source in the vertical direction has an elliptical shape having a major axis in the vertical direction.
- the method may further include the steps of: (d) repeating the steps (a) to (c) for a second pattern to an Nth pattern having a point light source position distribution different from the first pattern; (e) evaluating quality of the first to Nth Fourier ptychography images restored for each pattern; and ( 0 selecting a Fourier ptychography image of the best quality among the first to Nth Fourier ptychography images.
- a smartphone for obtaining a Fourier ptychography image of a sample in combination with an optical system device, the smartphone comprising: a display control module configured to sequentially provide illumination of different angles to the sample by sequentially displaying, according to a first pattern of point light sources at different positions, the point light sources of the first pattern on a display; an image acquisition module for obtaining an image for each illumination angle of the sample by using a camera whenever illumination of different angles is provided by the point light sources of the first pattern; and a Fourier ptychography image restoration module for restoring a first Fourier ptychography image using a plurality of images for each illumination angle obtained using the camera.
- FIG. 1 shows a structure of a microscope system for obtaining a Fourier ptychography image according to an embodiment of the present disclosure.
- FIG. 2 shows an optical path of a microscope system according to an embodiment of the present disclosure.
- FIGS. 3 A and 3 B are a conceptual diagram illustrating a conventional image acquisition structure for Fourier ptychography image restoration.
- FIG. 4 is a block diagram illustrating a module configuration of an application installed in a smartphone for obtaining a Fourier ptychography image according to an embodiment of the present disclosure.
- FIG. 5 shows an example of a point light source pattern displayed on a display according to a first embodiment of the present disclosure.
- FIG. 6 shows an example of a point light source pattern displayed on a display according to a second embodiment of the present disclosure.
- FIG. 7 shows an example of a point light source pattern displayed on a display according to a third embodiment of the present disclosure.
- FIG. 8 is a flowchart illustrating an overall flow of a method for obtaining a Fourier image using a smartphone according to an embodiment of the present disclosure.
- FIG. 1 shows a structure of a microscope system for obtaining a Fourier ptychography image according to an embodiment of the present disclosure
- FIG. 2 shows an optical path of a microscope system according to an embodiment of the present disclosure.
- a microscope system for obtaining a Fourier ptychography image includes an optical system device 100 and a smartphone 200 .
- the optical system device 100 has an optical structure for providing an image of the sample to the smartphone 200 .
- the smartphone 200 is coupled to the optical system device 100 , provides illumination to the optical system device 100 , and obtains images of a sample from the optical system device 100 .
- the smartphone 200 restores a Fourier ptychography image by using the obtained images of the sample.
- the optical system device 100 includes a light path portion 110 , a plurality of lenses 120 , 130 , 140 and 150 , a plurality of mirrors 160 and 170 , and a sample holder 180 .
- the sample holder 180 On the sample holder 180 , a sample is placed.
- the sample holder 180 is made of a transparent material, and illumination for the sample is provided from the smartphone 200 .
- the conventional illumination for obtaining a Fourier ptychography image was provided using a separate illumination system including a plurality of LEDs and a control device for controlling the luminescence of the plurality of LEDs. Since the illumination is provided through an illumination system including a control device and a plurality of LEDs, the conventional Fourier ptychography image acquisition requires high cost.
- a display of the smartphone 200 is used as a light source for providing illumination and does not require a separate illumination system. Due to this structure, the existing high cost problem can be solved.
- the smartphone 200 displays an image on a display by causing OLED to emit light, and the present disclosure is to utilize the OLED constituting the display of the smartphone as illumination for obtaining a Fourier ptychography image.
- illumination must be provided from a plurality of angles. Control of the display screen of the smartphone display for providing such illumination will be described with reference to a separate drawing.
- a first end of the optical system device 100 is coupled to the smartphone 200 , particularly to the camera of the smartphone 200 .
- the light path portion 110 of the optical system device 100 provides an optical path such that an image of the sample to which illumination is provided is captured by the camera of the smartphone 200 .
- the light path portion 110 has a ‘ ⁇ ’-shaped structure that is bent twice, but this is an example, and it will be apparent to those skilled in the art that the structure of the light path portion 110 may have a different structure.
- mirrors 160 and 170 are installed to reflect light by illumination so that the light can be transmitted along the light path portion.
- the light path portion 110 has a structure in which it is bent twice, there is shown a case in which two mirrors 160 and 170 are used, however, the number of mirrors used may be variously changed according to the structure of the light path portion 110 .
- a plurality of lenses 120 , 130 , 140 and 150 are coupled to the light path portion 110 , and the lenses function to adjust a focal length between a sample and a camera of the smartphone 200 and focus diffused light.
- an application for controlling the smartphone 200 is installed to obtain a Fourier ptychography image.
- a detailed structure of the application installed on the smartphone and an operation of the smartphone 200 by the application will be described with reference to a separate drawing.
- FIGS. 3 A and 3 B are a conceptual diagram illustrating a conventional image acquisition structure for Fourier ptychography image restoration.
- illumination was provided using an illumination system including a plurality of LEDs.
- FIG. 3 A shows a case in which a central LED among a plurality of LEDs emits light and the other LEDs are in an off state.
- FIG. 3 B shows a case in which an LED adjacent to a left of a central LED among a plurality of LEDs emits light and the other LEDs are in an off state.
- the illumination system for Fourier ptychography image restoration requires a plurality of LEDs arranged in different positions, and requires a control device for controlling light emission and off of such LEDs.
- a display of a smartphone 200 performs the role of the illumination system shown in FIG. 3 , and the image acquisition and ptychography image restoration are also performed in the smartphone 200 .
- FIG. 4 is a block diagram illustrating a module configuration of an application installed in a smartphone for obtaining a Fourier ptychography image according to an embodiment of the present disclosure.
- an application installed in a smartphone for obtaining a Fourier ptychography image includes a display control module 400 , an image acquisition module 410 , a Fourier ptychography image restoration module 420 , an image quality evaluation module 430 and an image selection module 440 .
- the display control module 400 controls the display of the smartphone such that only a selected region of the display of the smartphone emits light and LEDs of the remaining regions of the display are turned off to form a point light source.
- the display control module 400 provides illumination at different angles to the sample while changing a position of the point light source based on a preset pattern. Since the illumination angles required to obtain a Fourier ptychography image are preset, and the height between the smartphone display and the sample is preset, it is possible to provide illumination at a required angle by adjusting the position where the point light source is formed on the display.
- a pattern in which the positions of the point light sources are set is stored in advance, and the point light sources are sequentially displayed on the display at different positions according to the pattern.
- FIG. 5 shows an example of a point light source pattern displayed on a display according to a first embodiment of the present disclosure.
- a first point light source 500 formed in a center of the point light sources in FIG. 5 is a point light source formed at a position vertically aligned with a sample placed on a sample holder, and is a point light source providing vertical illumination.
- a plurality of point light sources are arranged at regular intervals on the top, bottom, left, and right sides around the first point light source 500 formed in the center.
- the display control module 400 in FIG. 4 forms point light sources according to the pattern shown in FIG. 5 at preset time intervals.
- the display control module 400 controls the display such that the first point light source 500 formed in the center is primarily formed, and then maintains the first point light source 500 formed in the center for a certain amount of time, and then controls the display such that a second point light source 502 adjacent to the left side of the point light source 500 formed in the center is secondarily formed. After the second point light source 502 is maintained for a certain amount of time, a third point light source 504 adjacent to the right side of the first point light source 500 is controlled to be formed.
- the display control module 400 activates all the point light sources included in the pattern at a preset time interval according to a pre-determined order. A total of 25 point light sources are shown in FIG. 5 , and an operation of controlling the display to activate a specific point light source is performed 25 times.
- the image acquisition module 410 controls the camera of the smartphone 200 to obtain, whenever a point light source is formed according to the pattern, an image influenced by the point light source.
- the image acquisition module 410 controls the camera of the smartphone to obtain a first image, when the first point light source 500 shown in FIG. 5 is formed on the display and provide illumination, and controls the camera of the smartphone to obtain a second image, when after the first point light source 500 is deactivated, the second point light source 502 is formed on the display and provide illumination.
- This image acquisition is performed whenever a specific point light source is activated according to a pattern, and in the case of a pattern consisting of a total of 25 point light sources as shown in FIG. 5 , the image acquisition module 410 obtains 25 images. Since the positions of the 25 point light sources are different, the image acquisition module 410 obtains 25 images by receiving illumination from 25 different angles.
- the image acquisition module 410 controls the camera to obtain a plurality of images for each illumination angle, and the images for each illumination angle obtained in the camera through the image acquisition module 410 are provided to the Fourier ptychography image restoration module 420 .
- the Fourier ptychography image restoration module 420 restores a Fourier ptychography image by using the plurality of images for each illumination angle obtained through a camera of a smartphone.
- a bandwidth of an image acquisition system is determined according to a numerical aperture of an objective lens, and a resolution of an obtained image is determined in proportion to the bandwidth.
- a central axis of the bandwidth changes according to an irradiation angle of the point light source.
- Fourier ptychography image restoration is to restore high-resolution object information of a wider synthesis bandwidth by applying an image quality enhancement algorithm called iterative phase retrieval using the information.
- the improvement of the synthesis bandwidth is determined according to the maximum irradiation angle, and the degree of restoration varies according to the scanning pattern.
- a Fourier ptychography image may be restored using a plurality of patterns.
- the Fourier ptychography image restoration module 420 restores a first Fourier ptychography image by obtaining images for each illumination angle according to the pattern shown in FIG. 5 .
- a second Fourier ptychography image is restored by obtaining images for each illumination angle according to a pattern different from the pattern shown in FIG. 5 (a pattern having different positions of point light sources).
- the Fourier ptychography image restoration module 420 may restore a plurality of Fourier ptychography images for a plurality of patterns.
- the pattern may have different shapes and colors of the point light sources as well as the positions of the point light sources.
- Various shapes of the point light source as well as the circular shape and elliptical shape described above may be applied to the point light source, and the point light source of each pattern may be set to a different color.
- the image quality evaluation module 430 evaluates an image quality of each Fourier ptychography image when a plurality of Fourier ptychography images are restored using a plurality of patterns.
- the image quality evaluation module 430 may be performed using a previously known image quality evaluation algorithm, and since image quality evaluation is a general technique, a detailed description thereof will be omitted.
- the image quality evaluation module 430 may evaluate the quality of each Fourier ptychography image in a manner such as a rating or a score.
- the image selection module 440 selects a Fourier ptychography image having the best image quality, and outputs the selected image as a final image.
- FIG. 6 shows an example of a point light source pattern displayed on a display according to a second embodiment of the present disclosure.
- the size of each of the plurality of point light sources was the same. However, in the point light source pattern according to the second embodiment shown in FIG. 6 , the size of each point light source is not the same.
- a fourth point light source 600 located in the center is a point light source formed at a position vertically aligned with a sample.
- the fourth point light source 600 has the smallest size compared to other point light sources, and the other point light sources have a relatively larger size than the fourth point light source 600 .
- the size of each of the plurality of point light sources may be determined based on a distance from the fourth point light source 600 located in the center. Point light sources far from the fourth point light source 600 have a relatively large size, and point light sources close to the fourth point light source 600 have a relatively small size.
- the size of each point light source is determined in consideration of the distance from the sample, and the size of the point light sources is set such that the fourth point light source 600 closest to the sample has the smallest size, and the size of the point light sources gradually increases as the distance from the fourth point light source 600 increases.
- Such adjustment of the size of the point light source is an advantage of the present disclosure, which is difficult to be applied in a method using an existing physical illumination system, and by adjusting the size of the point light sources, uniform intensity of illumination can be provided despite the difference in distance, so that better Fourier ptychography image restoration becomes possible.
- FIG. 7 shows an example of a point light source pattern displayed on a display according to a third embodiment of the present disclosure.
- a fifth point light source 700 located in the center is a point light source formed at a position vertically aligned with a sample, and the fifth point light source 700 has a circular size and has the smallest size compared to other point light sources.
- the sizes of the point light sources are set differently, but also the shapes are set differently. At least some of the point light sources other than the fifth point light source 700 have an elliptical shape.
- the shape and size of the point light sources are determined based on the separation direction and the separation distance from the fifth point light source 700 .
- point light sources relatively far from the fourth point light source 600 have a relatively large size
- point light sources located relatively close to the fourth point light source 600 have a relatively small size
- the shapes of the point light sources are determined based on the separation direction from the fifth point light source 700 .
- a sixth point light source 710 spaced apart from the fifth point light source 700 in a first direction (horizontal direction) has an elliptical shape having a major axis in the first direction.
- a seventh point light source 720 spaced apart from the fifth point light source 700 in the first direction and located at a relatively greater distance from the fifth point light source 700 than the sixth point light source 710 has an elliptical shape having a major axis in the first direction, and has a longer major axis compared to the sixth point light source 710 .
- a eighth point light source 730 spaced apart from the fifth point light source 700 in a second direction (vertical direction) orthogonal to the first direction (horizontal direction) has an elliptical shape having a major axis in the second direction.
- the reason for setting the shape of the point light sources in consideration of the separation direction from the fifth point light source 700 is that when the shape of the point light source is set in an elliptical shape in consideration of the separation direction, it is suitable to provide illumination of uniform intensity for each point light source.
- point light sources are formed using a display of a smartphone, the size and shape can be freely adjusted, and through this degree of freedom, more uniform intensity of illumination can be provided for each angle, so that a better Fourier ptychography image can be restored compared to the case of using a physical illumination system.
- FIG. 8 is a flowchart illustrating an overall flow of a method for obtaining a Fourier image using a smartphone according to an embodiment of the present disclosure.
- a smartphone 200 on which an application is installed is coupled with an optical system device 100 (step 800 ).
- the smartphone 200 is positioned under the optical system device 100 and a camera of the smartphone 200 is coupled to a light path portion of the optical system device 100 .
- a display of the smartphone 200 and a sample holder are positioned to face each other, so that the smartphone 200 is coupled to the optical system device 100 so as to provide illumination to the sample through the display of the smartphone 200 .
- the application installed on the smartphone sequentially provides illumination by the point light sources based on the first preset pattern (step 802 ).
- illumination at different angles is provided while sequentially activating point light sources at different positions included in the pattern according to preset time intervals.
- other point light sources may have different sizes and shapes compared to the first point light source aligned vertically with the sample, and it is preferable to set the size and shape of each point light source such that illumination of uniform intensity can be provided even when illumination is provided by point light sources at different positions.
- the smartphone Whenever illumination is sequentially provided by point light sources in step 802 , the smartphone is controlled to obtain an image for each illumination angle through the camera of the smartphone (step 804 ).
- a first Fourier ptychography image is restored using the obtained images for each illumination angle (step 806 ).
- the image quality of the restored first Fourier ptychography image is evaluated (step 808 ).
- the steps 802 to 808 above are repeatedly performed for N patterns prepared in advance, N Fourier ptychography images are restored by restoring a Fourier ptychography image for each pattern, and the image quality is evaluated for each Fourier ptychography image.
- a Fourier ptychography image with the best image quality is selected (step 810 ).
- a method according to the present disclosure can be implemented as a computer program stored in a medium for execution on a computer.
- the computer-readable medium can be an arbitrary medium available for access by a computer, where examples can include all types of computer storage media.
- Examples of a computer storage medium can include volatile and non-volatile, detachable and non-detachable media implemented based on an arbitrary method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data, and can include ROM (read-only memory), RAM (random access memory), CD-ROM's, DVD-ROM's, magnetic tapes, floppy disks, optical data storage devices, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Analytical Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Optics & Photonics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Software Systems (AREA)
- Microscoopes, Condenser (AREA)
- Studio Devices (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (8)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020210021683A KR102638985B1 (en) | 2021-02-18 | 2021-02-18 | Smartphone for Obtaining Fourier Ptychography Image and Method for Obtaining Fourier Ptychography Image Using Smartphone |
KR10-2021-0021683 | 2021-02-18 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20230014453A1 US20230014453A1 (en) | 2023-01-19 |
US11880965B2 true US11880965B2 (en) | 2024-01-23 |
Family
ID=83111216
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/671,513 Active US11880965B2 (en) | 2021-02-18 | 2022-02-14 | Smartphone for obtaining Fourier ptychography image and method for obtaining Fourier ptychography image using smartphone |
Country Status (2)
Country | Link |
---|---|
US (1) | US11880965B2 (en) |
KR (1) | KR102638985B1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SG11201503293VA (en) * | 2012-10-30 | 2015-05-28 | California Inst Of Techn | Fourier ptychographic imaging systems, devices, and methods |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140133702A1 (en) * | 2010-10-26 | 2014-05-15 | California Institute Of Technology | Methods for Rapid Distinction between Debris and Growing Cells |
US20140267670A1 (en) * | 2013-03-15 | 2014-09-18 | Pooncharas Tipgunlakant | Mobile microscopy device and method therefor |
US20170178317A1 (en) * | 2015-12-21 | 2017-06-22 | Canon Kabushiki Kaisha | Physical registration of images acquired by fourier ptychography |
US20170371141A1 (en) * | 2014-12-23 | 2017-12-28 | Canon Kabushiki Kaisha | Illumination systems and devices for fourier ptychographic imaging |
US20180203122A1 (en) * | 2015-07-14 | 2018-07-19 | Brightway Vision Ltd. | Gated structured imaging |
US20180231761A1 (en) * | 2017-02-13 | 2018-08-16 | Tsinghua University | Wavelength multiplexed fourier ptychographic microscopy system and method |
US20180299376A1 (en) * | 2014-11-10 | 2018-10-18 | Donald Channing Cooper | Modular illumination and sensor chamber |
KR102082747B1 (en) | 2019-01-23 | 2020-02-28 | 연세대학교 산학협력단 | Focal-length adjustable 3D imaging device and method based LED array |
US20220046169A1 (en) * | 2020-08-07 | 2022-02-10 | The Government Of The United States Of America, As Represented By The Secretary Of The Navy | Incoherent Fourier Ptychographic Super-Resolution Imaging System with Priors |
-
2021
- 2021-02-18 KR KR1020210021683A patent/KR102638985B1/en active IP Right Grant
-
2022
- 2022-02-14 US US17/671,513 patent/US11880965B2/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140133702A1 (en) * | 2010-10-26 | 2014-05-15 | California Institute Of Technology | Methods for Rapid Distinction between Debris and Growing Cells |
US20140267670A1 (en) * | 2013-03-15 | 2014-09-18 | Pooncharas Tipgunlakant | Mobile microscopy device and method therefor |
US20180299376A1 (en) * | 2014-11-10 | 2018-10-18 | Donald Channing Cooper | Modular illumination and sensor chamber |
US20170371141A1 (en) * | 2014-12-23 | 2017-12-28 | Canon Kabushiki Kaisha | Illumination systems and devices for fourier ptychographic imaging |
US20180203122A1 (en) * | 2015-07-14 | 2018-07-19 | Brightway Vision Ltd. | Gated structured imaging |
US20170178317A1 (en) * | 2015-12-21 | 2017-06-22 | Canon Kabushiki Kaisha | Physical registration of images acquired by fourier ptychography |
US20180231761A1 (en) * | 2017-02-13 | 2018-08-16 | Tsinghua University | Wavelength multiplexed fourier ptychographic microscopy system and method |
KR102082747B1 (en) | 2019-01-23 | 2020-02-28 | 연세대학교 산학협력단 | Focal-length adjustable 3D imaging device and method based LED array |
US20220046169A1 (en) * | 2020-08-07 | 2022-02-10 | The Government Of The United States Of America, As Represented By The Secretary Of The Navy | Incoherent Fourier Ptychographic Super-Resolution Imaging System with Priors |
Non-Patent Citations (4)
Title |
---|
Pavan Chandra Konda et al., Fourier Ptychography: current applications and future promises, vol. 28, No. 7/Mar. 30, 2020/Optics Express 9603-9630, Mar. 19, 2020). |
Tomas Aidukas et al., "Miniature Fourier Ptychographic Microscope Using Mobile Phone Camera Sensors", DOI:10.1364/MICROSCOPY.2018.MTu4A2,2018.04.17.). |
Wang et al. "Enhanced image reconstruction of ptychographic microscopy with double-height illumination" Optics Express. Dec. 6, 2021. * |
Zheng et al. "Wide-Field, high-resolution Fourier ptychographic microscopy" Nat Photonics. Sep. 1, 2013. * |
Also Published As
Publication number | Publication date |
---|---|
KR20220118053A (en) | 2022-08-25 |
KR102638985B1 (en) | 2024-02-20 |
US20230014453A1 (en) | 2023-01-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6200491B2 (en) | Projection display device and display method having multi-channel optical system with non-circular aperture as a whole | |
ES2561937T3 (en) | Sensor for microscopy | |
JP6307770B2 (en) | Image sensor | |
US11408829B2 (en) | Macro inspection systems, apparatus and methods | |
US9046680B2 (en) | Scanning illumination microscope | |
JP2015092253A (en) | Microscopy having adaptive optical system | |
US11880965B2 (en) | Smartphone for obtaining Fourier ptychography image and method for obtaining Fourier ptychography image using smartphone | |
US9182605B2 (en) | Front-projection autostereoscopic 3D display system | |
CN111123495A (en) | Three-dimensional total internal reflection microscopic imaging device and method based on annular array light source illumination | |
CN107037576B (en) | Optical microscopic imaging device and imaging method thereof | |
JP6899237B2 (en) | Stereoscopic image display device | |
US20150253556A1 (en) | Confocal Incident-Light Scanning Microsope For Multipoint Scanning | |
CN111239081B (en) | Super-resolution total internal reflection microscopic imaging device and method based on annular array light source illumination | |
CN103399397B (en) | Prediction for image scanning system focuses on | |
JP7053588B2 (en) | A method for forming a preview image using a slope microscope and an image forming device for a slope microscope and a slope microscope. | |
US11694604B2 (en) | Adjustable light-emissive elements in a display wall | |
US20200404229A1 (en) | Systems, devices, and Methods for driving projectors | |
JP2004015297A (en) | Stereoscopic observation apparatus and method for generating stereoscopic image reproducing color of object surface | |
TWI837190B (en) | Macro inspection systems, apparatus and methods | |
US8100543B1 (en) | Display system and method equipped with at least one steerable deflecting mirror | |
US8118440B1 (en) | Capture system and method equipped with at least one steerable deflecting mirror | |
JP2017040505A (en) | Three-dimensional object reading system | |
KR20220083702A (en) | Subpixel line scanning | |
DE102017220720A1 (en) | Method and device for non-contact measurement of three-dimensional surface contours |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEE, SEUNG AH;LEE, KYUNG CHUL;LEE, KYUNGWON;AND OTHERS;REEL/FRAME:059008/0542 Effective date: 20220214 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |