CN116577923A - 用于手术显微镜系统的显微镜的系统、方法和计算机程序 - Google Patents

用于手术显微镜系统的显微镜的系统、方法和计算机程序 Download PDF

Info

Publication number
CN116577923A
CN116577923A CN202310141380.XA CN202310141380A CN116577923A CN 116577923 A CN116577923 A CN 116577923A CN 202310141380 A CN202310141380 A CN 202310141380A CN 116577923 A CN116577923 A CN 116577923A
Authority
CN
China
Prior art keywords
interest
region
imaging sensor
sensor data
features
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310141380.XA
Other languages
English (en)
Chinese (zh)
Inventor
乔治·塞梅利斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leica Instruments Singapore Pte Ltd
Original Assignee
Leica Instruments Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leica Instruments Singapore Pte Ltd filed Critical Leica Instruments Singapore Pte Ltd
Publication of CN116577923A publication Critical patent/CN116577923A/zh
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/20—Surgical microscopes characterised by non-optical aspects
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/24—Base structure
    • G02B21/241—Devices for focusing
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/0012—Surgical microscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/002—Scanning microscopes
    • G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052—Optical details of the image generation
    • G02B21/006—Optical details of the image generation focusing arrangements; selection of the plane to be imaged
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/002—Scanning microscopes
    • G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052—Optical details of the image generation
    • G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
    • A61B2090/3937—Visible markers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30101—Blood vessel; Artery; Vein; Vascular
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Radiology & Medical Imaging (AREA)
  • Software Systems (AREA)
  • Gynecology & Obstetrics (AREA)
  • Quality & Reliability (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Microscoopes, Condenser (AREA)
  • Focusing (AREA)
  • Automatic Focus Adjustment (AREA)
CN202310141380.XA 2022-02-08 2023-02-08 用于手术显微镜系统的显微镜的系统、方法和计算机程序 Pending CN116577923A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102022102898.4 2022-02-08
DE102022102898 2022-02-08

Publications (1)

Publication Number Publication Date
CN116577923A true CN116577923A (zh) 2023-08-11

Family

ID=85172592

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310141380.XA Pending CN116577923A (zh) 2022-02-08 2023-02-08 用于手术显微镜系统的显微镜的系统、方法和计算机程序

Country Status (4)

Country Link
US (1) US20230248464A1 (https=)
EP (1) EP4223250A1 (https=)
JP (1) JP2023115914A (https=)
CN (1) CN116577923A (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102023131862A1 (de) * 2023-11-15 2025-05-15 Carl Zeiss Meditec Ag Verfolgen von bewegten objekten während der auto-konfiguration eines operationsmikroskopiesystems
EP4586053A1 (en) * 2024-01-11 2025-07-16 Leica Instruments (Singapore) Pte. Ltd. Apparatus for an optical imaging system, optical imaging system, method and computer program
DE102024122012B9 (de) * 2024-08-01 2025-10-16 Carl Zeiss Meditec Ag Robuster autofokus für szenen mit tiefem kanal

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7594188B2 (en) * 2003-08-21 2009-09-22 Carl Zeiss Ag Operating menu for a surgical microscope
US7794396B2 (en) * 2006-11-03 2010-09-14 Stryker Corporation System and method for the automated zooming of a surgical camera
US9259290B2 (en) * 2009-06-08 2016-02-16 MRI Interventions, Inc. MRI-guided surgical systems with proximity alerts
KR101759534B1 (ko) * 2009-10-30 2017-07-19 더 존스 홉킨스 유니버시티 외과 수술 시 임상적으로 중요한 해부상의 랜드마크에 대한 시각 추적 및 주석 달기
US9788906B2 (en) * 2013-03-15 2017-10-17 Synaptive Medical (Barbados) Inc. Context aware surgical systems for intraoperatively configuring imaging devices
DE102014210053A1 (de) * 2014-05-27 2015-12-03 Carl Zeiss Meditec Ag Operationsmikroskop mit Dateneinheit und Verfahren zum Überlagern von Bildern
US11207139B2 (en) * 2016-10-31 2021-12-28 Synaptive Medical Inc. 3D navigation system and methods
US11023761B2 (en) * 2017-11-06 2021-06-01 EagleSens Systems Corporation Accurate ROI extraction aided by object tracking
EP3527123B1 (en) * 2018-02-15 2022-08-31 Leica Instruments (Singapore) Pte. Ltd. Image processing method and apparatus using elastic mapping of vascular plexus structures
EP3540494B1 (en) * 2018-03-16 2022-11-23 Leica Instruments (Singapore) Pte. Ltd. Augmented reality surgical microscope and microscopy method
US10705323B2 (en) * 2018-04-24 2020-07-07 Synaptive Medical (Barbados) Inc. Surgical microscope system with automatic zoom control
US11026585B2 (en) * 2018-06-05 2021-06-08 Synaptive Medical Inc. System and method for intraoperative video processing
EP3846460A4 (en) * 2018-10-18 2021-11-24 Sony Group Corporation OBSERVATION SYSTEM FOR MEDICAL PURPOSES, OBSERVATION DEVICE FOR MEDICAL PURPOSES, AND OBSERVATION PROCEDURES FOR MEDICAL PURPOSES
EP3690819B1 (en) * 2019-01-31 2023-09-13 Leica Instruments (Singapore) Pte. Ltd. Image processing device and method, and medical observation device comprising such an image processing device, using an intensity or brightness-dependent variation of a pseudocolor pattern characteristic
EP3744286A1 (en) * 2019-05-27 2020-12-02 Leica Instruments (Singapore) Pte. Ltd. Microscope system and method for controlling a surgical microscope
US10758309B1 (en) * 2019-07-15 2020-09-01 Digital Surgery Limited Methods and systems for using computer-vision to enhance surgical tool control during surgeries
EP3806037A1 (en) * 2019-10-10 2021-04-14 Leica Instruments (Singapore) Pte. Ltd. System and corresponding method and computer program and apparatus and corresponding method and computer program
EP3862804A1 (en) * 2020-02-05 2021-08-11 Leica Instruments (Singapore) Pte. Ltd. Apparatuses, methods and computer programs for a microscope system
US12521177B2 (en) * 2021-02-23 2026-01-13 Karl Storz Se & Co. Kg Generating suture path guidance overlays on real-time surgical images
US20220270269A1 (en) * 2021-02-25 2022-08-25 Apeel Technology, Inc. Object throughput using trained machine learning models
EP4309075A1 (en) * 2021-03-19 2024-01-24 Digital Surgery Limited Prediction of structures in surgical data using machine learning
CN117177702A (zh) * 2021-03-29 2023-12-05 爱尔康公司 具有目标锁定自动对焦模式的立体成像平台
US11844583B2 (en) * 2021-03-31 2023-12-19 Moon Surgical Sas Co-manipulation surgical system having an instrument centering mode for automatic scope movements
AU2022254686B2 (en) * 2021-04-06 2025-07-10 Digital Surgery Systems, Inc. System, method, and apparatus for tracking a tool via a digital surgical microscope
US20220351392A1 (en) * 2021-04-30 2022-11-03 Nvidia Corporation Object tracking using optical flow
EP4174553A1 (en) * 2021-10-28 2023-05-03 Leica Instruments (Singapore) Pte. Ltd. System, method and computer program for a microscope of a surgical microscope system
WO2023085253A1 (ja) * 2021-11-09 2023-05-19 株式会社iMed Technologies 画像処理装置、画像処理方法、プログラム、及び画像処理システム

Also Published As

Publication number Publication date
EP4223250A1 (en) 2023-08-09
JP2023115914A (ja) 2023-08-21
US20230248464A1 (en) 2023-08-10

Similar Documents

Publication Publication Date Title
EP4223250A1 (en) Surgical microscope system and system, method and computer program for a microscope of a surgical microscope system
US11825278B2 (en) Device and method for auto audio and video focusing
Yang et al. Image-based laparoscopic tool detection and tracking using convolutional neural networks: a review of the literature
JP7705391B2 (ja) 機械学習モデルをトレーニングまたは用いるためのシステム、顕微鏡システム、方法およびコンピュータプログラム
Nirschl et al. Deep learning tissue segmentation in cardiac histopathology images
US20230137862A1 (en) System, Method, and Computer Program for a Microscope of a Surgical Microscope System
CN117981009A (zh) 外科显微镜系统以及用于外科显微镜系统的相应系统、方法和计算机程序
US12469252B2 (en) Fusion of spatial and temporal context for location determination for visualization systems
US20230259003A1 (en) Apparatus and method for an imaging device
US20250006348A1 (en) System, Method, and Computer Program for an Imaging Device of a Surgical Imaging System
EP4374384A1 (en) Medical video annotation using object detection and activity estimation
Guo et al. Deep multi-task framework for optic disc and fovea detection
CN119360369A (zh) 图像处理系统、显微镜、机器学习算法和预测核标记方法
US20230190402A1 (en) System, method, and computer program for a surgical microscope system and corresponding surgical microscope system
EP4338699A1 (en) System, method, and computer program for a surgical imaging system
US11978199B2 (en) Optical imaging system and related apparatus, method and computer program
EP3806037A1 (en) System and corresponding method and computer program and apparatus and corresponding method and computer program
EP4530970A1 (en) Systems and methods for generating training data, for training and application of machine learning algorithms for images
US20260114943A1 (en) Colorization of medical devices in robotic surgery using ai and machine learning
US20250186158A1 (en) Surgical Microscope System and System, Method and Computer Program for a Surgical Microscope System
US20230301507A1 (en) Control system for an imaging system, imaging system and method for imaging
EP4671846A1 (en) METHOD AND APPARATUS FOR GENERING AN IMAGE FOR A MICROSCOPE AND MICROSCOPY SYSTEM
CN121304658A (zh) 基于多模态超声时序数据的病灶识别方法
CN121812106A (zh) 手术器械跟踪的方法、装置、系统和存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination