JP6018216B2 - 対話型画像注釈付けのシステムおよび方法 - Google Patents

対話型画像注釈付けのシステムおよび方法 Download PDF

Info

Publication number
JP6018216B2
JP6018216B2 JP2014540582A JP2014540582A JP6018216B2 JP 6018216 B2 JP6018216 B2 JP 6018216B2 JP 2014540582 A JP2014540582 A JP 2014540582A JP 2014540582 A JP2014540582 A JP 2014540582A JP 6018216 B2 JP6018216 B2 JP 6018216B2
Authority
JP
Japan
Prior art keywords
image
marker
placement
user
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2014540582A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015502601A (ja
Inventor
ビューロウ，トーマス
メーツ，キルステン
ベルクトールト，マルティン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2015502601A publication Critical patent/JP2015502601A/ja
Application granted granted Critical
Publication of JP6018216B2 publication Critical patent/JP6018216B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/7475—User input or interface means, e.g. keyboard, pointing device, joystick
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/46—Arrangements for interfacing with the operator or the patient
    • A61B6/467—Arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B6/468—Arrangements for interfacing with the operator or the patient characterised by special input means allowing annotation or message recording
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/467—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means
    • A61B8/468—Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient characterised by special input means allowing annotation or message recording
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03F—PHOTOMECHANICAL PRODUCTION OF TEXTURED OR PATTERNED SURFACES, e.g. FOR PRINTING, FOR PROCESSING OF SEMICONDUCTOR DEVICES; MATERIALS THEREFOR; ORIGINALS THEREFOR; APPARATUS SPECIALLY ADAPTED THEREFOR
    • G03F9/00—Registration or positioning of originals, masks, frames, photographic sheets or textured or patterned surfaces, e.g. automatically
    • G03F9/70—Registration or positioning of originals, masks, frames, photographic sheets or textured or patterned surfaces, e.g. automatically for microlithography
    • G03F9/7069—Alignment mark illumination, e.g. darkfield, dual focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/169—Annotation, e.g. comment data or footnotes
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B40/00—ICT specially adapted for biostatistics; ICT specially adapted for bioinformatics-related machine learning or data mining, e.g. knowledge discovery or pattern finding
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03F—PHOTOMECHANICAL PRODUCTION OF TEXTURED OR PATTERNED SURFACES, e.g. FOR PRINTING, FOR PROCESSING OF SEMICONDUCTOR DEVICES; MATERIALS THEREFOR; ORIGINALS THEREFOR; APPARATUS SPECIALLY ADAPTED THEREFOR
    • G03F9/00—Registration or positioning of originals, masks, frames, photographic sheets or textured or patterned surfaces, e.g. automatically
    • G03F9/70—Registration or positioning of originals, masks, frames, photographic sheets or textured or patterned surfaces, e.g. automatically for microlithography
    • G03F9/7088—Alignment mark detection, e.g. TTR, TTL, off-axis detection, array detector, video detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/171—Editing, e.g. inserting or deleting by use of digital ink
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/174—Form filling; Merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10116—X-ray image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20004—Adaptive image processing
    • G06T2207/20012—Locally adaptive
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G06T2207/20096—Interactive definition of curve of interest
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G06T2207/20101—Interactive definition of point of interest, landmark or seed
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30068—Mammography; Breast
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Public Health (AREA)
  • General Engineering & Computer Science (AREA)
  • Biophysics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Veterinary Medicine (AREA)
  • Surgery (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Molecular Biology (AREA)
  • Human Computer Interaction (AREA)
  • Artificial Intelligence (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Data Mining & Analysis (AREA)
  • Bioethics (AREA)
  • Evolutionary Biology (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Databases & Information Systems (AREA)
  • Epidemiology (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Biotechnology (AREA)
  • Optics & Photonics (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Processing Or Creating Images (AREA)
JP2014540582A 2011-11-08 2012-10-30 対話型画像注釈付けのシステムおよび方法 Expired - Fee Related JP6018216B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201161557008P 2011-11-08 2011-11-08
US61/557,008 2011-11-08
PCT/IB2012/055997 WO2013068881A1 (en) 2011-11-08 2012-10-30 System and method for interactive image annotation

Publications (2)

Publication Number Publication Date
JP2015502601A JP2015502601A (ja) 2015-01-22
JP6018216B2 true JP6018216B2 (ja) 2016-11-02

Family

ID=47471870

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014540582A Expired - Fee Related JP6018216B2 (ja) 2011-11-08 2012-10-30 対話型画像注釈付けのシステムおよび方法

Country Status (8)

Country Link
US (1) US9980692B2 (enExample)
EP (1) EP2751780B1 (enExample)
JP (1) JP6018216B2 (enExample)
CN (1) CN103918008B (enExample)
BR (1) BR112014010848B1 (enExample)
IN (1) IN2014CN03498A (enExample)
MX (1) MX2014005478A (enExample)
WO (1) WO2013068881A1 (enExample)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9886546B2 (en) * 2012-11-20 2018-02-06 General Electric Company Methods and apparatus to label radiology images
CN105338479B (zh) 2014-06-09 2020-03-10 阿里巴巴集团控股有限公司 基于场所的信息处理方法及装置
WO2017003453A1 (en) * 2015-06-30 2017-01-05 Canon U.S.A., Inc. Fiducial markers, systems, and methods of registration
US10420626B2 (en) * 2015-06-30 2019-09-24 Canon U.S.A., Inc. Fiducial markers, systems, and methods of registration
US10943362B2 (en) * 2015-12-18 2021-03-09 Koninklijke Philips N.V. Image processing for improved marker positioning on a line-shaped image feature
US10319127B2 (en) 2016-09-22 2019-06-11 International Business Machines Corporation Spatial and hierarchical placement of images at runtime
CN106845068B (zh) * 2016-12-13 2020-05-22 海纳医信（北京）软件科技有限责任公司 图片标注方法和装置
US11202652B2 (en) 2017-08-11 2021-12-21 Canon U.S.A., Inc. Registration and motion compensation for patient-mounted needle guide
CN111031957A (zh) * 2017-08-16 2020-04-17 柯惠有限合伙公司 在外科手术期间对感兴趣点空间定位的方法
CN109584295B (zh) * 2017-09-29 2022-08-26 阿里巴巴集团控股有限公司 对图像内目标物体进行自动标注的方法、装置及系统
CN107693047A (zh) * 2017-10-18 2018-02-16 飞依诺科技(苏州)有限公司 超声成像中基于对称组织的体标设置方法及系统
US10893911B2 (en) 2017-11-26 2021-01-19 Canon U.S.A., Inc. Automated image cropping for enhanced automatic device-to-image registration
EP3561656A1 (en) * 2018-04-23 2019-10-30 Koninklijke Philips N.V. Precise positioning of a marker on a display
US12023143B2 (en) 2018-10-19 2024-07-02 Canon U.S.A., Inc. Structure masking or unmasking for optimized device-to-image registration
US10778916B2 (en) * 2018-10-24 2020-09-15 Honeywell International Inc. Applying an annotation to an image based on keypoints
US10983672B2 (en) * 2019-02-12 2021-04-20 Caterpilar Inc. Augmented reality model alignment
CN113607158B (zh) * 2021-08-05 2024-11-19 中铁工程装备集团有限公司 基于可见光通信的平板光源视觉识别匹配定位方法及系统

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6480813B1 (en) * 1999-02-24 2002-11-12 Autodesk, Inc. Method and apparatus for defining a precision drawing in a drawing program
WO2000063844A1 (en) 1999-04-20 2000-10-26 Koninklijke Philips Electronics N.V. A method and apparatus for interactively constructing relational geometric objects
SE524080C2 (sv) 2000-05-19 2004-06-22 Premetec Ab Anordning med slang
JP2003534080A (ja) * 2000-05-24 2003-11-18 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 医療画像の簡便な処理のための方法および装置
JP4416393B2 (ja) 2002-12-04 2010-02-17 株式会社日立メディコ 医用画像表示装置
US7587234B2 (en) * 2001-11-02 2009-09-08 Abbott Cardiovascular Systems Inc. Method and apparatus for computer modified magnetic resonance imaging
JP4428067B2 (ja) * 2004-01-28 2010-03-10 ソニー株式会社 画像照合装置、プログラム、および画像照合方法
EP1745353A2 (en) 2004-05-03 2007-01-24 Koninklijke Philips Electronics N.V. A graphic user interface, a system, a method and a computer program for interacting with a user
US20070174769A1 (en) 2006-01-24 2007-07-26 Sdgi Holdings, Inc. System and method of mapping images of the spine
JP4999163B2 (ja) * 2006-04-17 2012-08-15 富士フイルム株式会社 画像処理方法および装置ならびにプログラム
EP2025290A1 (en) 2006-05-19 2009-02-18 Hitachi Medical Corporation Medical image display device and program
EP2080169A4 (en) * 2006-10-10 2011-07-27 Cedara Software Corp SYSTEM AND METHOD FOR SEGMENTING A REGION IN A MEDICAL IMAGE
JP4264663B2 (ja) * 2006-11-21 2009-05-20 ソニー株式会社 撮影装置、画像処理装置、および、これらにおける画像処理方法ならびに当該方法をコンピュータに実行させるプログラム
US8634610B2 (en) 2008-06-20 2014-01-21 The Trustees Of The University Of Pennsylvania System and method for assessing cancer risk
US8096949B2 (en) 2008-07-02 2012-01-17 U-Systems, Inc. User interface for ultrasound mammographic imaging
US8209152B2 (en) * 2008-10-31 2012-06-26 Eagleview Technologies, Inc. Concurrent display systems and methods for aerial roof estimation
WO2010052598A1 (en) 2008-11-06 2010-05-14 Koninklijke Philips Electronics N.V. Breast ultrasound annotation user interface
US20100145373A1 (en) * 2008-12-05 2010-06-10 Ruth Alon Nail drill
US20110182493A1 (en) * 2010-01-25 2011-07-28 Martin Huber Method and a system for image annotation
US8683363B2 (en) 2010-01-26 2014-03-25 Apple Inc. Device, method, and graphical user interface for managing user interface content and user interface elements
US8885898B2 (en) * 2010-10-07 2014-11-11 Siemens Medical Solutions Usa, Inc. Matching of regions of interest across multiple views
CA2879769C (en) * 2012-07-01 2022-06-21 Lumito Ab A system and method for improved diffuse luminescent imaging or tomography in scattering media

Also Published As

Publication number Publication date
BR112014010848A2 (pt) 2017-06-13
IN2014CN03498A (enExample) 2015-10-09
MX2014005478A (es) 2014-08-21
JP2015502601A (ja) 2015-01-22
CN103918008B (zh) 2017-08-08
BR112014010848A8 (pt) 2017-06-20
EP2751780A1 (en) 2014-07-09
US20140289605A1 (en) 2014-09-25
WO2013068881A1 (en) 2013-05-16
CN103918008A (zh) 2014-07-09
EP2751780B1 (en) 2019-07-03
BR112014010848B1 (pt) 2022-12-27
US9980692B2 (en) 2018-05-29

Similar Documents

Publication Publication Date Title
JP6018216B2 (ja) 対話型画像注釈付けのシステムおよび方法
CN107851337B (zh) 交互式网格编辑
EP2817695B1 (en) System and method for processing a pointer movement
CN105849773A (zh) 解剖结构的基于模型的分割
CN103201767A (zh) 医学图像系统
CN103608842A (zh) 用于处理医学图像的系统和方法
EP3665655B1 (en) Volume rendering of volumetric image data with interactive segmentation
US11099724B2 (en) Context sensitive magnifying glass
EP3198565B1 (en) Visualizing volumetric image of an anatomical structure
JP7053817B2 (ja) 画像セグメンテーション
EP3491622B1 (en) A method and apparatus for refining a model of an anatomical structure in an image

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20151028

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20160815

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20160906

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20160929

R150 Certificate of patent or registration of utility model

Ref document number: 6018216

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees