EP3699667A4 - Optical fibre bundle image processing method and apparatus - Google Patents

Optical fibre bundle image processing method and apparatus Download PDF

Info

Publication number
EP3699667A4
EP3699667A4 EP18868761.0A EP18868761A EP3699667A4 EP 3699667 A4 EP3699667 A4 EP 3699667A4 EP 18868761 A EP18868761 A EP 18868761A EP 3699667 A4 EP3699667 A4 EP 3699667A4
Authority
EP
European Patent Office
Prior art keywords
image processing
processing method
optical fibre
fibre bundle
bundle image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP18868761.0A
Other languages
German (de)
French (fr)
Other versions
EP3699667A1 (en
Inventor
Jinhua Shao
Houli Duan
Jin Sun
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Microview Medical Technologies Co Ltd
Original Assignee
Suzhou Microview Medical Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Microview Medical Technologies Co Ltd filed Critical Suzhou Microview Medical Technologies Co Ltd
Publication of EP3699667A1 publication Critical patent/EP3699667A1/en
Publication of EP3699667A4 publication Critical patent/EP3699667A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/361—Optical details, e.g. image relay to the camera or image sensor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G02B23/26—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes using light guides
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G06T17/205—Re-meshing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20004—Adaptive image processing
    • G06T2207/20012—Locally adaptive

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Astronomy & Astrophysics (AREA)
  • Image Processing (AREA)
  • Microscoopes, Condenser (AREA)
EP18868761.0A 2017-10-16 2018-10-15 Optical fibre bundle image processing method and apparatus Pending EP3699667A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710959003.1A CN107678153B (en) 2017-10-16 2017-10-16 Optical fiber bundle image processing method and device
PCT/CN2018/110250 WO2019076265A1 (en) 2017-10-16 2018-10-15 Optical fibre bundle image processing method and apparatus

Publications (2)

Publication Number Publication Date
EP3699667A1 EP3699667A1 (en) 2020-08-26
EP3699667A4 true EP3699667A4 (en) 2021-01-06

Family

ID=61140253

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18868761.0A Pending EP3699667A4 (en) 2017-10-16 2018-10-15 Optical fibre bundle image processing method and apparatus

Country Status (10)

Country Link
US (1) US11525996B2 (en)
EP (1) EP3699667A4 (en)
JP (1) JP7001295B2 (en)
KR (1) KR102342575B1 (en)
CN (1) CN107678153B (en)
AU (1) AU2018353915A1 (en)
CA (1) CA3079123C (en)
MX (1) MX2020003986A (en)
RU (1) RU2747946C1 (en)
WO (1) WO2019076265A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107622491B (en) * 2017-10-16 2022-03-11 苏州微景医学科技有限公司 Optical fiber bundle image analysis method and device
CN107678153B (en) * 2017-10-16 2020-08-11 苏州微景医学科技有限公司 Optical fiber bundle image processing method and device
KR102561360B1 (en) * 2021-06-04 2023-08-01 한국과학기술연구원 Method for postprocessing fiberscope image processing not using calibration and fiberscope system performing the same
KR102553001B1 (en) * 2021-10-05 2023-07-10 한국과학기술연구원 Method and apparatus for removing honeycomb artifacts from optical fiber bundle images based on artificial intelligence

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050207668A1 (en) * 2002-07-18 2005-09-22 Mauna Kea Tech. Method for processing an image acquired through a guide consisting of a plurality of optical fibers
DE102006011707A1 (en) * 2006-03-14 2007-09-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and device for producing a structure-free fiberscopic recording

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5810032A (en) * 1981-07-09 1983-01-20 オリンパス光学工業株式会社 Endoscope
US4601537A (en) * 1984-01-06 1986-07-22 Ohio State University Research Foundation Apparatus and methods for forming images and for optical demultiplexing
JPH08191440A (en) * 1995-01-10 1996-07-23 Fukuda Denshi Co Ltd Method and device for correcting endoscope image
JPH1048689A (en) * 1996-04-05 1998-02-20 Nikon Corp Microphotograph photographing device
JPH11355574A (en) * 1998-06-11 1999-12-24 Toshiba Corp Image processor and its method
CN100417225C (en) * 2005-10-27 2008-09-03 中国科学院上海技术物理研究所 Method of focal plane array image space-time changing based on fibre-optical coupled
JP5629270B2 (en) * 2008-12-29 2014-11-19 マウナ ケア テクノロジーズ Image processing method and apparatus
CN101882326A (en) * 2010-05-18 2010-11-10 广州市刑事科学技术研究所 Three-dimensional craniofacial reconstruction method based on overall facial structure shape data of Chinese people
CN103218991B (en) * 2013-03-29 2015-01-28 中国电子科技集团公司第四十一研究所 Optical fiber image real-time processing method based on field programmable gate array (FPGA)
CN104346778B (en) * 2013-07-30 2017-08-22 比亚迪股份有限公司 The edge enhancing method and device and digital camera equipment of image
JP6118698B2 (en) * 2013-09-30 2017-04-19 株式会社Ihi Image analysis apparatus and program
KR102144994B1 (en) * 2013-09-30 2020-08-14 삼성전자주식회사 Method for decreasing noise of image and image processing apparatus using thereof
JP2016020896A (en) * 2014-06-20 2016-02-04 キヤノン株式会社 Positional deviation extent measuring method, correction table generating device, image pickup device, and projection device
CN104933707B (en) * 2015-07-13 2018-06-08 福建师范大学 A kind of super-pixel reconstruct segmentation and method for reconstructing based on multiphoton confocal microscopic cell images
CN105894450A (en) * 2015-12-07 2016-08-24 乐视云计算有限公司 Image processing method and device
US10176567B2 (en) * 2015-12-21 2019-01-08 Canon Kabushiki Kaisha Physical registration of images acquired by Fourier Ptychography
US9894254B2 (en) * 2016-05-10 2018-02-13 Massachusetts Institute Of Technology Methods and apparatus for optical fiber imaging
CN106204419A (en) * 2016-06-27 2016-12-07 乐视控股（北京）有限公司 Image processing method and device
CN106251339A (en) * 2016-07-21 2016-12-21 深圳市大疆创新科技有限公司 Image processing method and device
CN106844289A (en) * 2017-01-22 2017-06-13 苏州蜗牛数字科技股份有限公司 Based on the method that mobile phone camera scanning circumstance is modeled
CN106859579A (en) * 2017-01-26 2017-06-20 浙江大学 A kind of fibre bundle confocal fluorescent endoscopic imaging method and device based on sub-pix
CN106981090B (en) * 2017-02-16 2020-04-28 南京邮电大学 Three-dimensional reconstruction method for in-tube stepping unidirectional beam scanning tomographic image
CN107678153B (en) * 2017-10-16 2020-08-11 苏州微景医学科技有限公司 Optical fiber bundle image processing method and device
CN107622491B (en) * 2017-10-16 2022-03-11 苏州微景医学科技有限公司 Optical fiber bundle image analysis method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050207668A1 (en) * 2002-07-18 2005-09-22 Mauna Kea Tech. Method for processing an image acquired through a guide consisting of a plurality of optical fibers
DE102006011707A1 (en) * 2006-03-14 2007-09-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and device for producing a structure-free fiberscopic recording

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
FANG FANG ET AL: "Methods for removing "honeycomb" noise of fiber-endoscopic images", PROCEEDINGS OF SPIE, IEEE, US, vol. 4224, 1 January 2000 (2000-01-01), pages 60 - 63, XP002435019, ISBN: 978-1-62841-730-2, DOI: 10.1117/12.403925 *
HUGHES MICHAEL ET AL: "Color reflectance fiber bundle endomicroscopy without back-reflections", JOURNAL OF BIOMEDICAL OPTICS, SPIE, vol. 19, no. 3, 1 March 2014 (2014-03-01), pages 30501, XP060047323, ISSN: 1083-3668, [retrieved on 20140303], DOI: 10.1117/1.JBO.19.3.030501 *
See also references of WO2019076265A1 *
WINTER CHRISTIAN ET AL: "Physically Motivated Enhancement of Color Images for Fiber Endoscopy", 29 October 2007, BIG DATA ANALYTICS IN THE SOCIAL AND UBIQUITOUS CONTEXT : 5TH INTERNATIONAL WORKSHOP ON MODELING SOCIAL MEDIA, MSM 2014, 5TH INTERNATIONAL WORKSHOP ON MINING UBIQUITOUS AND SOCIAL ENVIRONMENTS, MUSE 2014 AND FIRST INTERNATIONAL WORKSHOP ON MACHINE LE, ISBN: 978-3-642-17318-9, XP047462177 *

Also Published As

Publication number Publication date
KR20200070321A (en) 2020-06-17
US20200241277A1 (en) 2020-07-30
JP2020537275A (en) 2020-12-17
CN107678153A (en) 2018-02-09
WO2019076265A1 (en) 2019-04-25
US11525996B2 (en) 2022-12-13
JP7001295B2 (en) 2022-01-19
KR102342575B1 (en) 2021-12-24
MX2020003986A (en) 2020-08-13
BR112020007623A2 (en) 2020-11-10
CA3079123C (en) 2023-07-11
CN107678153B (en) 2020-08-11
AU2018353915A1 (en) 2020-05-14
RU2747946C1 (en) 2021-05-17
CA3079123A1 (en) 2019-04-25
EP3699667A1 (en) 2020-08-26

Similar Documents

Publication Publication Date Title
EP3531689A4 (en) Optical imaging method and apparatus
EP3599760A4 (en) Image processing method and apparatus
EP3446282A4 (en) Image processing apparatus and method
EP3627499A4 (en) Image processing apparatus and method
EP3477251A4 (en) Optical ranging method and optical ranging apparatus
EP3602167A4 (en) Method and system for fiber scanning projector
EP3704668A4 (en) Image processing method and apparatus
EP3565249A4 (en) Image processing apparatus and method
EP3377929A4 (en) Methods for processing ferrules and/or optical fibers
GB2573606B (en) Optical system and imaging apparatus
EP3525164A4 (en) Image processing apparatus and image processing method
GB2568358B (en) Optical system and image pickup apparatus
EP3584760A4 (en) Image processing method and apparatus
EP3522538A4 (en) Image processing method and apparatus therefor
EP3699667A4 (en) Optical fibre bundle image processing method and apparatus
GB201700936D0 (en) Optical fibre apparatus and method
EP3692402A4 (en) An optical fiber with microgratings and methods and apparatus for making and using same
EP3493156A4 (en) Image processing apparatus and image processing method
EP3676800A4 (en) Method and apparatus for processing image
EP3827412A4 (en) Method and apparatus for image processing
EP3844970A4 (en) Image processing apparatus and image processing method thereof
EP3833029A4 (en) Image processing apparatus and method
EP3506623A4 (en) Image processing apparatus and method
EP3416138A4 (en) Method and apparatus for processing image
EP3706074A4 (en) Image processing method and apparatus

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200428

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20201204

RIC1 Information provided on ipc code assigned before grant

Ipc: G02B 21/36 20060101AFI20201130BHEP

Ipc: G06T 5/00 20060101ALI20201130BHEP

Ipc: G06T 17/20 20060101ALI20201130BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20221013