CN116577923A - 用于手术显微镜系统的显微镜的系统、方法和计算机程序 - Google Patents

用于手术显微镜系统的显微镜的系统、方法和计算机程序 Download PDF

Info

Publication number
CN116577923A
CN116577923A CN202310141380.XA CN202310141380A CN116577923A CN 116577923 A CN116577923 A CN 116577923A CN 202310141380 A CN202310141380 A CN 202310141380A CN 116577923 A CN116577923 A CN 116577923A
Authority
CN
China
Prior art keywords
interest
region
imaging sensor
sensor data
features
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310141380.XA
Other languages
English (en)
Chinese (zh)
Inventor
乔治·塞梅利斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leica Instruments Singapore Pte Ltd
Original Assignee
Leica Instruments Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leica Instruments Singapore Pte Ltd filed Critical Leica Instruments Singapore Pte Ltd
Publication of CN116577923A publication Critical patent/CN116577923A/zh
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/20—Surgical microscopes characterised by non-optical aspects
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/24—Base structure
    • G02B21/241—Devices for focusing
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/0012—Surgical microscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/002—Scanning microscopes
    • G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052—Optical details of the image generation
    • G02B21/006—Optical details of the image generation focusing arrangements; selection of the plane to be imaged
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/002—Scanning microscopes
    • G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052—Optical details of the image generation
    • G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
    • A61B2090/3937—Visible markers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30101—Blood vessel; Artery; Vein; Vascular
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Radiology & Medical Imaging (AREA)
  • Software Systems (AREA)
  • Gynecology & Obstetrics (AREA)
  • Quality & Reliability (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Microscoopes, Condenser (AREA)
  • Focusing (AREA)
  • Automatic Focus Adjustment (AREA)
CN202310141380.XA 2022-02-08 2023-02-08 用于手术显微镜系统的显微镜的系统、方法和计算机程序 Pending CN116577923A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102022102898.4 2022-02-08
DE102022102898 2022-02-08

Publications (1)

Publication Number Publication Date
CN116577923A true CN116577923A (zh) 2023-08-11

Family

ID=85172592

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310141380.XA Pending CN116577923A (zh) 2022-02-08 2023-02-08 用于手术显微镜系统的显微镜的系统、方法和计算机程序

Country Status (4)

Country Link
US (1) US20230248464A1 (https=)
EP (1) EP4223250A1 (https=)
JP (1) JP2023115914A (https=)
CN (1) CN116577923A (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102023131862A1 (de) * 2023-11-15 2025-05-15 Carl Zeiss Meditec Ag Verfolgen von bewegten objekten während der auto-konfiguration eines operationsmikroskopiesystems
EP4586053A1 (en) * 2024-01-11 2025-07-16 Leica Instruments (Singapore) Pte. Ltd. Apparatus for an optical imaging system, optical imaging system, method and computer program
DE102024122012B9 (de) * 2024-08-01 2025-10-16 Carl Zeiss Meditec Ag Robuster autofokus für szenen mit tiefem kanal

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7594188B2 (en) * 2003-08-21 2009-09-22 Carl Zeiss Ag Operating menu for a surgical microscope
US7794396B2 (en) * 2006-11-03 2010-09-14 Stryker Corporation System and method for the automated zooming of a surgical camera
CN102625669B (zh) * 2009-06-08 2015-09-23 核磁共振成像介入技术有限公司 能够近实时地跟踪和生成柔性体内装置的动态可视化的mri导向的介入系统
CN102781336B (zh) * 2009-10-30 2016-01-20 约翰霍普金斯大学 用于外科手术干预的临床上重要的解剖标志的视觉跟踪和注释
US9788906B2 (en) * 2013-03-15 2017-10-17 Synaptive Medical (Barbados) Inc. Context aware surgical systems for intraoperatively configuring imaging devices
DE102014210053A1 (de) * 2014-05-27 2015-12-03 Carl Zeiss Meditec Ag Operationsmikroskop mit Dateneinheit und Verfahren zum Überlagern von Bildern
WO2018076094A1 (en) * 2016-10-31 2018-05-03 Synaptive Medical (Barbados) Inc. 3d navigation system and methods
US11023761B2 (en) * 2017-11-06 2021-06-01 EagleSens Systems Corporation Accurate ROI extraction aided by object tracking
EP3527123B1 (en) * 2018-02-15 2022-08-31 Leica Instruments (Singapore) Pte. Ltd. Image processing method and apparatus using elastic mapping of vascular plexus structures
EP3540494B1 (en) * 2018-03-16 2022-11-23 Leica Instruments (Singapore) Pte. Ltd. Augmented reality surgical microscope and microscopy method
US10705323B2 (en) * 2018-04-24 2020-07-07 Synaptive Medical (Barbados) Inc. Surgical microscope system with automatic zoom control
US11026585B2 (en) * 2018-06-05 2021-06-08 Synaptive Medical Inc. System and method for intraoperative video processing
US20210345856A1 (en) * 2018-10-18 2021-11-11 Sony Corporation Medical observation system, medical observation apparatus, and medical observation method
EP3690819B1 (en) * 2019-01-31 2023-09-13 Leica Instruments (Singapore) Pte. Ltd. Image processing device and method, and medical observation device comprising such an image processing device, using an intensity or brightness-dependent variation of a pseudocolor pattern characteristic
EP3744286A1 (en) * 2019-05-27 2020-12-02 Leica Instruments (Singapore) Pte. Ltd. Microscope system and method for controlling a surgical microscope
US10758309B1 (en) * 2019-07-15 2020-09-01 Digital Surgery Limited Methods and systems for using computer-vision to enhance surgical tool control during surgeries
EP3806037A1 (en) * 2019-10-10 2021-04-14 Leica Instruments (Singapore) Pte. Ltd. System and corresponding method and computer program and apparatus and corresponding method and computer program
EP3862804A1 (en) * 2020-02-05 2021-08-11 Leica Instruments (Singapore) Pte. Ltd. Apparatuses, methods and computer programs for a microscope system
US12521177B2 (en) * 2021-02-23 2026-01-13 Karl Storz Se & Co. Kg Generating suture path guidance overlays on real-time surgical images
WO2022182776A1 (en) * 2021-02-25 2022-09-01 Apeel Technology, Inc. Object throughput using trained machine learning models
US20240169579A1 (en) * 2021-03-19 2024-05-23 Digital Surgery Limited Prediction of structures in surgical data using machine learning
EP4312718A1 (en) * 2021-03-29 2024-02-07 Alcon Inc. Stereoscopic imaging platform with target locking automatic focusing mode
US11844583B2 (en) * 2021-03-31 2023-12-19 Moon Surgical Sas Co-manipulation surgical system having an instrument centering mode for automatic scope movements
EP4319678A4 (en) * 2021-04-06 2025-02-26 Digital Surgery Systems, Inc. System, method, and apparatus for tracking a tool via a digital surgical microscope
US20220351392A1 (en) * 2021-04-30 2022-11-03 Nvidia Corporation Object tracking using optical flow
EP4174553A1 (en) * 2021-10-28 2023-05-03 Leica Instruments (Singapore) Pte. Ltd. System, method and computer program for a microscope of a surgical microscope system
CA3237390A1 (en) * 2021-11-09 2023-05-19 Imed Technologies, Inc. Image processing apparatus, image processing method, program, and image processing system

Also Published As

Publication number Publication date
EP4223250A1 (en) 2023-08-09
JP2023115914A (ja) 2023-08-21
US20230248464A1 (en) 2023-08-10

Similar Documents

Publication Publication Date Title
EP4223250A1 (en) Surgical microscope system and system, method and computer program for a microscope of a surgical microscope system
US11825278B2 (en) Device and method for auto audio and video focusing
JP7705391B2 (ja) 機械学習モデルをトレーニングまたは用いるためのシステム、顕微鏡システム、方法およびコンピュータプログラム
Nirschl et al. Deep learning tissue segmentation in cardiac histopathology images
US20230137862A1 (en) System, Method, and Computer Program for a Microscope of a Surgical Microscope System
CN117981009A (zh) 外科显微镜系统以及用于外科显微镜系统的相应系统、方法和计算机程序
US12469252B2 (en) Fusion of spatial and temporal context for location determination for visualization systems
US20230259003A1 (en) Apparatus and method for an imaging device
US20250006348A1 (en) System, Method, and Computer Program for an Imaging Device of a Surgical Imaging System
EP4374384A1 (en) Medical video annotation using object detection and activity estimation
Guo et al. Deep multi-task framework for optic disc and fovea detection
CN119360369A (zh) 图像处理系统、显微镜、机器学习算法和预测核标记方法
US20230190402A1 (en) System, method, and computer program for a surgical microscope system and corresponding surgical microscope system
EP4338699A1 (en) System, method, and computer program for a surgical imaging system
US11978199B2 (en) Optical imaging system and related apparatus, method and computer program
EP3806037A1 (en) System and corresponding method and computer program and apparatus and corresponding method and computer program
EP4530970A1 (en) Systems and methods for generating training data, for training and application of machine learning algorithms for images
CN121304658B (zh) 基于多模态超声时序数据的病灶识别方法
US20260114943A1 (en) Colorization of medical devices in robotic surgery using ai and machine learning
US20250186158A1 (en) Surgical Microscope System and System, Method and Computer Program for a Surgical Microscope System
US20230301507A1 (en) Control system for an imaging system, imaging system and method for imaging
EP4671846A1 (en) METHOD AND APPARATUS FOR GENERING AN IMAGE FOR A MICROSCOPE AND MICROSCOPY SYSTEM
BEDDAD et al. Mobile Application For Automated Identification Of Medicinal Flora
CN121812106A (zh) 手术器械跟踪的方法、装置、系统和存储介质
CN119724562A (zh) 一种基于病理深度学习的子宫内膜癌的预测方法、装置、设备及存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination