JP2023115914A - 外科用顕微鏡システムならびに外科用顕微鏡システムの顕微鏡のためのシステム、方法およびコンピュータプログラム - Google Patents

外科用顕微鏡システムならびに外科用顕微鏡システムの顕微鏡のためのシステム、方法およびコンピュータプログラム Download PDF

Info

Publication number
JP2023115914A
JP2023115914A JP2023016940A JP2023016940A JP2023115914A JP 2023115914 A JP2023115914 A JP 2023115914A JP 2023016940 A JP2023016940 A JP 2023016940A JP 2023016940 A JP2023016940 A JP 2023016940A JP 2023115914 A JP2023115914 A JP 2023115914A
Authority
JP
Japan
Prior art keywords
interest
area
features
sensor data
imaging sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2023016940A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023115914A5 (https=
Inventor
テメリス ゲオルゲ
Themelis George
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leica Instruments Singapore Pte Ltd
Original Assignee
Leica Instruments Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leica Instruments Singapore Pte Ltd filed Critical Leica Instruments Singapore Pte Ltd
Publication of JP2023115914A publication Critical patent/JP2023115914A/ja
Publication of JP2023115914A5 publication Critical patent/JP2023115914A5/ja
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/20—Surgical microscopes characterised by non-optical aspects
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/24—Base structure
    • G02B21/241—Devices for focusing
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/0012—Surgical microscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/002—Scanning microscopes
    • G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052—Optical details of the image generation
    • G02B21/006—Optical details of the image generation focusing arrangements; selection of the plane to be imaged
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/002—Scanning microscopes
    • G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052—Optical details of the image generation
    • G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
    • A61B2090/3937—Visible markers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30101—Blood vessel; Artery; Vein; Vascular
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Radiology & Medical Imaging (AREA)
  • Software Systems (AREA)
  • Gynecology & Obstetrics (AREA)
  • Quality & Reliability (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Microscoopes, Condenser (AREA)
  • Focusing (AREA)
  • Automatic Focus Adjustment (AREA)
JP2023016940A 2022-02-08 2023-02-07 外科用顕微鏡システムならびに外科用顕微鏡システムの顕微鏡のためのシステム、方法およびコンピュータプログラム Pending JP2023115914A (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102022102898.4 2022-02-08
DE102022102898 2022-02-08

Publications (2)

Publication Number Publication Date
JP2023115914A true JP2023115914A (ja) 2023-08-21
JP2023115914A5 JP2023115914A5 (https=) 2026-02-17

Family

ID=85172592

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023016940A Pending JP2023115914A (ja) 2022-02-08 2023-02-07 外科用顕微鏡システムならびに外科用顕微鏡システムの顕微鏡のためのシステム、方法およびコンピュータプログラム

Country Status (4)

Country Link
US (1) US20230248464A1 (https=)
EP (1) EP4223250A1 (https=)
JP (1) JP2023115914A (https=)
CN (1) CN116577923A (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102023131862A1 (de) * 2023-11-15 2025-05-15 Carl Zeiss Meditec Ag Verfolgen von bewegten objekten während der auto-konfiguration eines operationsmikroskopiesystems
EP4586053A1 (en) * 2024-01-11 2025-07-16 Leica Instruments (Singapore) Pte. Ltd. Apparatus for an optical imaging system, optical imaging system, method and computer program
DE102024122012B9 (de) * 2024-08-01 2025-10-16 Carl Zeiss Meditec Ag Robuster autofokus für szenen mit tiefem kanal

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7594188B2 (en) * 2003-08-21 2009-09-22 Carl Zeiss Ag Operating menu for a surgical microscope
US7794396B2 (en) * 2006-11-03 2010-09-14 Stryker Corporation System and method for the automated zooming of a surgical camera
CN102625669B (zh) * 2009-06-08 2015-09-23 核磁共振成像介入技术有限公司 能够近实时地跟踪和生成柔性体内装置的动态可视化的mri导向的介入系统
CN102781336B (zh) * 2009-10-30 2016-01-20 约翰霍普金斯大学 用于外科手术干预的临床上重要的解剖标志的视觉跟踪和注释
US9788906B2 (en) * 2013-03-15 2017-10-17 Synaptive Medical (Barbados) Inc. Context aware surgical systems for intraoperatively configuring imaging devices
DE102014210053A1 (de) * 2014-05-27 2015-12-03 Carl Zeiss Meditec Ag Operationsmikroskop mit Dateneinheit und Verfahren zum Überlagern von Bildern
WO2018076094A1 (en) * 2016-10-31 2018-05-03 Synaptive Medical (Barbados) Inc. 3d navigation system and methods
US11023761B2 (en) * 2017-11-06 2021-06-01 EagleSens Systems Corporation Accurate ROI extraction aided by object tracking
EP3527123B1 (en) * 2018-02-15 2022-08-31 Leica Instruments (Singapore) Pte. Ltd. Image processing method and apparatus using elastic mapping of vascular plexus structures
EP3540494B1 (en) * 2018-03-16 2022-11-23 Leica Instruments (Singapore) Pte. Ltd. Augmented reality surgical microscope and microscopy method
US10705323B2 (en) * 2018-04-24 2020-07-07 Synaptive Medical (Barbados) Inc. Surgical microscope system with automatic zoom control
US11026585B2 (en) * 2018-06-05 2021-06-08 Synaptive Medical Inc. System and method for intraoperative video processing
US20210345856A1 (en) * 2018-10-18 2021-11-11 Sony Corporation Medical observation system, medical observation apparatus, and medical observation method
EP3690819B1 (en) * 2019-01-31 2023-09-13 Leica Instruments (Singapore) Pte. Ltd. Image processing device and method, and medical observation device comprising such an image processing device, using an intensity or brightness-dependent variation of a pseudocolor pattern characteristic
EP3744286A1 (en) * 2019-05-27 2020-12-02 Leica Instruments (Singapore) Pte. Ltd. Microscope system and method for controlling a surgical microscope
US10758309B1 (en) * 2019-07-15 2020-09-01 Digital Surgery Limited Methods and systems for using computer-vision to enhance surgical tool control during surgeries
EP3806037A1 (en) * 2019-10-10 2021-04-14 Leica Instruments (Singapore) Pte. Ltd. System and corresponding method and computer program and apparatus and corresponding method and computer program
EP3862804A1 (en) * 2020-02-05 2021-08-11 Leica Instruments (Singapore) Pte. Ltd. Apparatuses, methods and computer programs for a microscope system
US12521177B2 (en) * 2021-02-23 2026-01-13 Karl Storz Se & Co. Kg Generating suture path guidance overlays on real-time surgical images
WO2022182776A1 (en) * 2021-02-25 2022-09-01 Apeel Technology, Inc. Object throughput using trained machine learning models
US20240169579A1 (en) * 2021-03-19 2024-05-23 Digital Surgery Limited Prediction of structures in surgical data using machine learning
EP4312718A1 (en) * 2021-03-29 2024-02-07 Alcon Inc. Stereoscopic imaging platform with target locking automatic focusing mode
US11844583B2 (en) * 2021-03-31 2023-12-19 Moon Surgical Sas Co-manipulation surgical system having an instrument centering mode for automatic scope movements
EP4319678A4 (en) * 2021-04-06 2025-02-26 Digital Surgery Systems, Inc. System, method, and apparatus for tracking a tool via a digital surgical microscope
US20220351392A1 (en) * 2021-04-30 2022-11-03 Nvidia Corporation Object tracking using optical flow
EP4174553A1 (en) * 2021-10-28 2023-05-03 Leica Instruments (Singapore) Pte. Ltd. System, method and computer program for a microscope of a surgical microscope system
CA3237390A1 (en) * 2021-11-09 2023-05-19 Imed Technologies, Inc. Image processing apparatus, image processing method, program, and image processing system

Also Published As

Publication number Publication date
EP4223250A1 (en) 2023-08-09
CN116577923A (zh) 2023-08-11
US20230248464A1 (en) 2023-08-10

Similar Documents

Publication Publication Date Title
EP4223250A1 (en) Surgical microscope system and system, method and computer program for a microscope of a surgical microscope system
EP4309142B1 (en) Adaptive visualization of contextual targets in surgical video
EP4309075A1 (en) Prediction of structures in surgical data using machine learning
JP7705391B2 (ja) 機械学習モデルをトレーニングまたは用いるためのシステム、顕微鏡システム、方法およびコンピュータプログラム
US12131818B2 (en) Systems and methods for providing surgical guidance
US20230137862A1 (en) System, Method, and Computer Program for a Microscope of a Surgical Microscope System
Kadaskar et al. Image analysis of nuclei histopathology using deep learning: A review of segmentation, detection, and classification
US12469252B2 (en) Fusion of spatial and temporal context for location determination for visualization systems
CN121236011A (zh) 一种用于消化内科内窥镜检查的病灶自动识别系统
Zhao et al. Development of an approach to extracting coronary arteries and detecting stenosis in invasive coronary angiograms
EP4202523A1 (en) System, method and computer program for a surgical microscope system and corresponding surgical microscope system
US11978199B2 (en) Optical imaging system and related apparatus, method and computer program
Peng et al. Urtnet: an unstructured feature fusion network for real-time detection of endoscopic surgical instruments
EP3806037A1 (en) System and corresponding method and computer program and apparatus and corresponding method and computer program
US20260101103A1 (en) System, Method, and Computer Program for a Surgical Imaging System
US20240037920A1 (en) Continual-learning and transfer-learning based on-site adaptation of image classification and object localization modules
Zhang Video-based concurrent activity recognition in clinical settings
Wang et al. EFFCA: Enhanced Frangi Filter for Coronary Angiography Segmentation on Mobile Edge Devices
EP3862804A1 (en) Apparatuses, methods and computer programs for a microscope system
EP4530970A1 (en) Systems and methods for generating training data, for training and application of machine learning algorithms for images
EP4671846A1 (en) METHOD AND APPARATUS FOR GENERING AN IMAGE FOR A MICROSCOPE AND MICROSCOPY SYSTEM
US20260114943A1 (en) Colorization of medical devices in robotic surgery using ai and machine learning
US20230301507A1 (en) Control system for an imaging system, imaging system and method for imaging
Aoki et al. Distance-independent two-stage identification of steel surgical instruments using RGB-D metric orthoimages
Lewis et al. An Automatic Segmentation of Polyp in Colorectal Cancer Using U-Net

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260206

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20260206