JP5701306B2 - マーカーを使用する画像システム - Google Patents

マーカーを使用する画像システム Download PDF

Info

Publication number
JP5701306B2
JP5701306B2 JP2012534505A JP2012534505A JP5701306B2 JP 5701306 B2 JP5701306 B2 JP 5701306B2 JP 2012534505 A JP2012534505 A JP 2012534505A JP 2012534505 A JP2012534505 A JP 2012534505A JP 5701306 B2 JP5701306 B2 JP 5701306B2
Authority
JP
Japan
Prior art keywords
marker
markers
pattern
processor
tracking
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2012534505A
Other languages
English (en)
Japanese (ja)
Other versions
JP2013508039A5 (https=
JP2013508039A (ja
Inventor
シェアラー，ショーン
スカース，ゴードン
ロビンス，スティーブン
Original Assignee
イムリス インク．
イムリス インク．
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by イムリス インク．, イムリス インク． filed Critical イムリス インク．
Publication of JP2013508039A publication Critical patent/JP2013508039A/ja
Publication of JP2013508039A5 publication Critical patent/JP2013508039A5/ja
Application granted granted Critical
Publication of JP5701306B2 publication Critical patent/JP5701306B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/90—Identification means for patients or instruments, e.g. tags
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/90—Identification means for patients or instruments, e.g. tags
    • A61B90/92—Identification means for patients or instruments, e.g. tags coded with colour
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/90—Identification means for patients or instruments, e.g. tags
    • A61B90/94—Identification means for patients or instruments, e.g. tags coded with symbols, e.g. text
    • A61B90/96—Identification means for patients or instruments, e.g. tags coded with symbols, e.g. text using barcodes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2065—Tracking using image or pattern recognition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
    • A61B2090/3983—Reference marker arrangements for use with image guided surgery

Landscapes

  • Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biomedical Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Robotics (AREA)
  • Length Measuring Devices By Optical Means (AREA)
JP2012534505A 2009-10-20 2010-10-19 マーカーを使用する画像システム Active JP5701306B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US25333009P 2009-10-20 2009-10-20
US61/253,330 2009-10-20
PCT/CA2010/001641 WO2011047467A1 (en) 2009-10-20 2010-10-19 Imaging system using markers

Publications (3)

Publication Number Publication Date
JP2013508039A JP2013508039A (ja) 2013-03-07
JP2013508039A5 JP2013508039A5 (https=) 2013-11-14
JP5701306B2 true JP5701306B2 (ja) 2015-04-15

Family

ID=43897003

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012534505A Active JP5701306B2 (ja) 2009-10-20 2010-10-19 マーカーを使用する画像システム

Country Status (5)

Country Link
US (1) US8988505B2 (https=)
EP (1) EP2491337A4 (https=)
JP (1) JP5701306B2 (https=)
CA (1) CA2718686C (https=)
WO (1) WO2011047467A1 (https=)

Families Citing this family (75)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
PL2023812T3 (pl) 2006-05-19 2017-07-31 The Queen's Medical Center Układ śledzenia ruchu dla adaptacyjnego obrazowania w czasie rzeczywistym i spektroskopii
US20110286641A1 (en) * 2010-05-19 2011-11-24 Schneider John K Sensor System Having A Platen With A Dome-Shaped Contact Surface
TWI443587B (zh) * 2011-05-30 2014-07-01 Univ Nat Cheng Kung 三維雙模掃描裝置及三維雙模掃描系統
WO2013032933A2 (en) 2011-08-26 2013-03-07 Kinecticor, Inc. Methods, systems, and devices for intra-scan motion correction
CN103033525B (zh) * 2011-09-30 2016-03-02 清华大学 Ct系统和ct图像重建方法
JP5912382B2 (ja) * 2011-10-03 2016-04-27 ソニー株式会社 撮像装置および映像記録再生システム
WO2013053397A1 (en) * 2011-10-13 2013-04-18 Brainlab Ag Medical tracking system comprising multi-functional sensor device
WO2013053398A1 (en) 2011-10-13 2013-04-18 Brainlab Medical tracking system comprising two or more communicating sensor devices
US20160345917A1 (en) * 2011-10-28 2016-12-01 Navigate Surgical Technologies, Inc. Method for making a three-dimensionally trackable apparatus
US10429182B2 (en) * 2012-06-19 2019-10-01 Brainlab Ag Method and apparatus for detecting undesirable rotation of medical markers
EP2885648A1 (en) * 2012-08-14 2015-06-24 Koninklijke Philips N.V. Patient bed with magnetic resonance radio frequency antenna, particularly for use in a magnetic resonance imaging guided therapy system
US10327708B2 (en) 2013-01-24 2019-06-25 Kineticor, Inc. Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan
US9717461B2 (en) 2013-01-24 2017-08-01 Kineticor, Inc. Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan
US9305365B2 (en) 2013-01-24 2016-04-05 Kineticor, Inc. Systems, devices, and methods for tracking moving targets
CN105338897B (zh) * 2013-01-24 2019-06-14 凯内蒂科尔股份有限公司 用于在医学成像扫描期间追踪和补偿患者运动的系统、设备和方法
CN109008972A (zh) 2013-02-01 2018-12-18 凯内蒂科尔股份有限公司 生物医学成像中的实时适应性运动补偿的运动追踪系统
AU2014231344B2 (en) 2013-03-15 2018-10-04 Synaptive Medical Inc. Systems and methods for navigation and simulation of minimally invasive therapy
US20160045276A1 (en) * 2013-04-04 2016-02-18 The Board Of Trustees Of The University Of Illinois Systems and methods for identifying instruments
EP2992852B1 (en) * 2013-04-30 2018-03-07 Koh Young Technology Inc. Optical tracking system and detection method
EP3035880A1 (en) 2013-08-13 2016-06-29 Brainlab AG Digital tool and method for planning knee replacement
US11284964B2 (en) 2013-08-13 2022-03-29 Brainlab Ag Moiré marker device for medical navigation
US8880151B1 (en) 2013-11-27 2014-11-04 Clear Guide Medical, Llc Surgical needle for a surgical system with optical recognition
JP6740131B2 (ja) 2014-02-21 2020-08-12 スリーディインテグレイテッド アーペーエス３Ｄｉｎｔｅｇｒａｔｅｄ Ａｐｓ 手術器具を備えたセット、手術システム、及びトレーニング方法
WO2015148391A1 (en) 2014-03-24 2015-10-01 Thomas Michael Ernst Systems, methods, and devices for removing prospective motion correction from medical imaging scans
CN106232012B (zh) 2014-04-24 2020-08-28 皇家飞利浦有限公司 使用标记物防止或降低不需要的辐照的身体部分的识别器
DE102014210897B4 (de) * 2014-06-06 2022-01-13 Siemens Healthcare Gmbh Verfahren und Vorrichtung zur Strahlerpositionierung
CN106714681A (zh) 2014-07-23 2017-05-24 凯内蒂科尔股份有限公司 用于在医学成像扫描期间追踪和补偿患者运动的系统、设备和方法
CN106999256B (zh) * 2014-11-03 2020-03-03 奥普蒂纳弗公司 基于无源标记的光学跟踪方法和系统
EP3250104B1 (en) 2015-01-28 2019-03-06 Brainlab AG Light point identification method
GB2536650A (en) 2015-03-24 2016-09-28 Augmedics Ltd Method and system for combining video-based and optic-based augmented reality in a near eye display
US11020144B2 (en) 2015-07-21 2021-06-01 3Dintegrated Aps Minimally invasive surgery system
CN108024806B (zh) 2015-07-21 2022-07-01 3D集成公司 套管组装套件、套管针组装套件、套筒组件、微创手术系统及其方法
US9943247B2 (en) 2015-07-28 2018-04-17 The University Of Hawai'i Systems, devices, and methods for detecting false movements for motion correction during a medical imaging scan
DK178899B1 (en) 2015-10-09 2017-05-08 3Dintegrated Aps A depiction system
CN108697367A (zh) 2015-11-23 2018-10-23 凯内蒂科尓股份有限公司 用于在医学成像扫描期间跟踪并补偿患者运动的系统、装置和方法
WO2017103046A2 (en) 2015-12-18 2017-06-22 Koninklijke Philips N.V. Medical instrument tracking
KR20170074435A (ko) * 2015-12-22 2017-06-30 삼성전자주식회사 엑스선 영상 장치, 그 제어 방법 및 엑스선 디텍터
US10250592B2 (en) 2016-12-19 2019-04-02 Ricoh Company, Ltd. Approach for accessing third-party content collaboration services on interactive whiteboard appliances using cross-license authentication
US10375130B2 (en) 2016-12-19 2019-08-06 Ricoh Company, Ltd. Approach for accessing third-party content collaboration services on interactive whiteboard appliances by an application using a wrapper application program interface
KR102592905B1 (ko) * 2016-12-21 2023-10-23 삼성전자주식회사 엑스선 영상 촬영 장치 및 제어방법
US10357325B2 (en) 2017-01-16 2019-07-23 The Aga Khan University Detection of surgical instruments on surgical tray
KR102713073B1 (ko) * 2017-01-23 2024-10-07 삼성전자주식회사 엑스선 영상 장치 및 그 제어 방법
US10395405B2 (en) * 2017-02-28 2019-08-27 Ricoh Company, Ltd. Removing identifying information from image data on computing devices using markers
US10772703B2 (en) * 2017-08-25 2020-09-15 Titan Medical Inc. Methods and apparatuses for positioning a camera of a surgical robotic system to capture images inside a body cavity of a patient during a medical procedure
US12521201B2 (en) 2017-12-07 2026-01-13 Augmedics Ltd. Spinous process clamp
US12458411B2 (en) 2017-12-07 2025-11-04 Augmedics Ltd. Spinous process clamp
CN112074760B (zh) * 2017-12-27 2025-04-08 ams传感器新加坡私人有限公司 光电模块及其操作方法
US11980507B2 (en) 2018-05-02 2024-05-14 Augmedics Ltd. Registration of a fiducial marker for an augmented reality system
US11766296B2 (en) 2018-11-26 2023-09-26 Augmedics Ltd. Tracking system for image-guided surgery
US11602402B2 (en) 2018-12-04 2023-03-14 Globus Medical, Inc. Drill guide fixtures, cranial insertion fixtures, and related methods and robotic systems
EP3906753B1 (en) 2019-01-04 2024-05-08 Gentex Corporation Control for adaptive lighting array
US11538570B2 (en) 2019-01-04 2022-12-27 Gentex Corporation Authentication and informational displays with adaptive lighting array
EP3685785B1 (en) * 2019-01-22 2026-02-18 Stryker European Operations Limited Tracker for a surgical navigation system
US12178666B2 (en) 2019-07-29 2024-12-31 Augmedics Ltd. Fiducial marker
US11980506B2 (en) 2019-07-29 2024-05-14 Augmedics Ltd. Fiducial marker
US20220398848A1 (en) * 2019-09-13 2022-12-15 Incremed Ag Surveillance System and Method for Monitoring the Sterility of Objects in an Operation Room
US11382712B2 (en) 2019-12-22 2022-07-12 Augmedics Ltd. Mirroring in image guided surgery
US11389252B2 (en) 2020-06-15 2022-07-19 Augmedics Ltd. Rotating marker for image guided surgery
US12239385B2 (en) 2020-09-09 2025-03-04 Augmedics Ltd. Universal tool adapter
US12502163B2 (en) 2020-09-09 2025-12-23 Augmedics Ltd. Universal tool adapter for image-guided surgery
US11911112B2 (en) * 2020-10-27 2024-02-27 Globus Medical, Inc. Robotic navigational system
US12106542B2 (en) * 2021-03-09 2024-10-01 Intellijoint Surgical Inc. Targets for tracking, and systems and methods for tracking the targets
DE102021202951A1 (de) * 2021-03-25 2022-09-29 Carl Zeiss Meditec Ag Medizinisches Gerät zur Ermittlung der räumlichen Lage eines flächig ausgebildeten Markers
US11896445B2 (en) 2021-07-07 2024-02-13 Augmedics Ltd. Iliac pin and adapter
US12150821B2 (en) 2021-07-29 2024-11-26 Augmedics Ltd. Rotating marker and adapter for image-guided surgery
EP4387552A4 (en) 2021-08-18 2025-04-30 Augmedics Ltd. AUGMENTED REALITY SURGICAL SYSTEM USING DEPTH SENSING
JP7766227B2 (ja) 2021-08-20 2025-11-10 ジェンテックス コーポレイション 照明アセンブリ及び照明アセンブリを有する照射システム
US20230123450A1 (en) * 2021-10-05 2023-04-20 Olympus Medical Systems Corp. Medical apparatus with embedded marking
EP4193956A1 (en) * 2021-12-10 2023-06-14 Koninklijke Philips N.V. Optical tracking markers
CN114366356B (zh) * 2022-01-17 2023-03-14 北京理工大学 自主式种植牙机器人定位精度评估装置和方法
JP7827499B2 (ja) * 2022-03-15 2026-03-10 キヤノンメディカルシステムズ株式会社 Ｘ線診断装置
US20230329805A1 (en) * 2022-04-15 2023-10-19 Stryker Corporation Pointer tool for endoscopic surgical procedures
EP4511809A4 (en) 2022-04-21 2026-03-11 Augmedics Ltd Systems and methods for medical image visualization
EP4587881A1 (en) 2022-09-13 2025-07-23 Augmedics Ltd. Augmented reality eyewear for image-guided medical intervention
US12078825B1 (en) 2023-05-11 2024-09-03 Northern Digital Inc. Textured retro-reflective marker

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5662111A (en) 1991-01-28 1997-09-02 Cosman; Eric R. Process of stereotactic optical navigation
US6405072B1 (en) 1991-01-28 2002-06-11 Sherwood Services Ag Apparatus and method for determining a location of an anatomical target with reference to a medical apparatus
US6006126A (en) 1991-01-28 1999-12-21 Cosman; Eric R. System and method for stereotactic registration of image scan data
GB9405299D0 (en) * 1994-03-17 1994-04-27 Roke Manor Research Improvements in or relating to video-based systems for computer assisted surgery and localisation
US5828770A (en) 1996-02-20 1998-10-27 Northern Digital Inc. System for determining the spatial position and angular orientation of an object
US6026315A (en) 1997-03-27 2000-02-15 Siemens Aktiengesellschaft Method and apparatus for calibrating a navigation system in relation to image data of a magnetic resonance apparatus
IL133233A (en) * 1997-05-30 2005-05-17 British Broadcasting Corp Position determination
US5923417A (en) 1997-09-26 1999-07-13 Northern Digital Incorporated System for determining the spatial position of a target
US6175610B1 (en) * 1998-02-11 2001-01-16 Siemens Aktiengesellschaft Medical technical system controlled by vision-detected operator activity
DE19817039A1 (de) * 1998-04-17 1999-10-21 Philips Patentverwaltung Anordnung für die bildgeführte Chirurgie
US6516213B1 (en) 1999-09-03 2003-02-04 Robin Medical, Inc. Method and apparatus to estimate location and orientation of objects during magnetic resonance imaging
US7111423B2 (en) * 1999-10-08 2006-09-26 Identification Dynamics, Llc Method and apparatus for reading firearm microstamping
US6381485B1 (en) 1999-10-28 2002-04-30 Surgical Navigation Technologies, Inc. Registration of human anatomy integrated for electromagnetic localization
DE10000937B4 (de) 2000-01-12 2006-02-23 Brainlab Ag Intraoperative Navigationsaktualisierung
US6490473B1 (en) 2000-04-07 2002-12-03 Coin Medical Technologies, Ltd. System and method of interactive positioning
DE50000359D1 (de) 2000-05-09 2002-09-12 Brainlab Ag Verfahren zur Registrierung eines Patientendatensatzes aus einem bildgebenden Verfahren bei navigationsunterstützen chirurgischen Eingriffen mittels Röntgenbildzuordnung
US6871086B2 (en) 2001-02-15 2005-03-22 Robin Medical Inc. Endoscopic examining apparatus particularly useful in MRI, a probe useful in such apparatus, and a method of making such probe
DE50100132D1 (de) 2001-05-22 2003-04-30 Brainlab Ag Röntgenbildregistrierungseinrichtung mit einem medizinischen Navigationssystem
US6978167B2 (en) * 2002-07-01 2005-12-20 Claron Technology Inc. Video pose tracking system and method
DE10246147B4 (de) * 2002-10-01 2007-12-06 Vr Magic Gmbh Mehrkamera-Trackingsystem
US7845560B2 (en) * 2004-12-14 2010-12-07 Sky-Trax Incorporated Method and apparatus for determining position and rotational orientation of an object
US9526587B2 (en) * 2008-12-31 2016-12-27 Intuitive Surgical Operations, Inc. Fiducial marker design and detection for locating surgical instrument in images
US8320612B2 (en) * 2005-06-09 2012-11-27 Naviswiss Ag System and method for the contactless determination and measurement of a spatial position and/or a spatial orientation of bodies, method for the calibration and testing, in particular, medical tools as well as patterns or structures on, in particular, medical tools
US9592100B2 (en) 2007-12-31 2017-03-14 St. Jude Medical, Atrial Fibrillation Division, Inc. Method and apparatus for encoding catheters with markers for identifying with imaging systems
WO2009107703A1 (ja) * 2008-02-27 2009-09-03 国立大学法人浜松医科大学 体内挿入器具の種類を識別可能な手術支援システム

Also Published As

Publication number Publication date
US20110254922A1 (en) 2011-10-20
EP2491337A1 (en) 2012-08-29
CA2718686A1 (en) 2011-04-20
EP2491337A4 (en) 2017-03-22
WO2011047467A1 (en) 2011-04-28
JP2013508039A (ja) 2013-03-07
US8988505B2 (en) 2015-03-24
CA2718686C (en) 2015-07-14

Similar Documents

Publication Publication Date Title
JP5701306B2 (ja) マーカーを使用する画像システム
US11937771B2 (en) Articulated structured light based-laparoscope
US20220395159A1 (en) Device and method for assisting laparoscopic surgery - directing and maneuvering articulating tool
US11123144B2 (en) Registration of frames of reference
US12178520B2 (en) Model registration system and method
US20200237449A1 (en) Redundant reciprocal tracking system
US10932689B2 (en) Model registration system and method
US6675040B1 (en) Optical object tracking system
US10265854B2 (en) Operating room safety zone
US9248000B2 (en) System for and method of visualizing an interior of body
US11284964B2 (en) Moiré marker device for medical navigation
US11161248B2 (en) Automatic robotic arm calibration to camera system using a laser
EP1415609A1 (en) Optical object tracking system
US20250040789A1 (en) Articulated structured light based-laparoscope
US20240382266A1 (en) Medical instrument, medical assistance system, method for determining position and computer-readable storage medium

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20130924

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20130926

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20140523

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20140609

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140826

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20141210

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20141218

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20150121

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20150217

R150 Certificate of patent or registration of utility model

Ref document number: 5701306

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250