WO2022054428A1 - 医療システムおよび制御方法 - Google Patents

医療システムおよび制御方法 Download PDF

Info

Publication number
WO2022054428A1
WO2022054428A1 PCT/JP2021/027564 JP2021027564W WO2022054428A1 WO 2022054428 A1 WO2022054428 A1 WO 2022054428A1 JP 2021027564 W JP2021027564 W JP 2021027564W WO 2022054428 A1 WO2022054428 A1 WO 2022054428A1
Authority
WO
WIPO (PCT)
Prior art keywords
endoscope
tip
control device
treatment tool
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/027564
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
裕行 高山
亮太 佐々井
勝 柳原
千春 水谷
寛 長谷川
大地 北口
修由 竹下
成浩 小島
悠貴 古澤
裕美 杵淵
雅昭 伊藤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
National Cancer Centre Japan
National Cancer Center
Original Assignee
Olympus Corp
National Cancer Centre Japan
National Cancer Center
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp, National Cancer Centre Japan, National Cancer Center filed Critical Olympus Corp
Priority to JP2022547429A priority Critical patent/JP7535587B2/ja
Priority to CN202180053633.7A priority patent/CN116171122A/zh
Publication of WO2022054428A1 publication Critical patent/WO2022054428A1/ja
Priority to US18/105,291 priority patent/US20230180995A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00006—Operational features of endoscopes characterised by electronic signal processing of control signals
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00039—Operational features of endoscopes provided with input arrangements for the user
    • A61B1/0004—Operational features of endoscopes provided with input arrangements for the user for electronic operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00039—Operational features of endoscopes provided with input arrangements for the user
    • A61B1/00042—Operational features of endoscopes provided with input arrangements for the user for mechanical operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147—Holding or positioning arrangements
    • A61B1/00149—Holding or positioning arrangements using articulated arms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147—Holding or positioning arrangements
    • A61B1/0016—Holding or positioning arrangements using motor drive units
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B34/32—Surgical robots operating autonomously
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/06—Devices, other than using radiation, for detecting or locating foreign bodies ; Determining position of diagnostic devices within or on the body of the patient
    • A61B5/065—Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/60—Rotation of whole images or parts thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000096—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope using artificial intelligence
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163—Optical arrangements
    • A61B1/00193—Optical arrangements adapted for stereoscopic vision
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2065—Tracking using image or pattern recognition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2068—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis using pointers, e.g. pointers having reference marks for determining coordinates of body points
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B2034/301—Surgical robots for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B2034/305—Details of wrist mechanisms at distal ends of robotic arms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/363—Use of fiducial points
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25—User interfaces for surgical systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6846—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive
    • A61B5/6847—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive mounted on an invasive device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10068—Endoscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Definitions

  • the present invention relates to a medical system and a control method, and more particularly to a medical system having a function of following an endoscope to an object and a control method thereof.
  • Patent Document 1 a permissible area extending around the central region of the image is set in the image, and the endoscope follows so that the treatment tool returns to the central region when the treatment tool goes out of the permissible area.
  • follow-up ends when the treatment tool enters the central region.
  • Patent Document 1 In order to achieve convenient tracking for the surgeon, in addition to suppressing excessive tracking of the endoscope, the object should be captured in the center of the image, and the object should be placed at an appropriate distance in the depth direction. It is even more desirable to meet the three conditions of capturing.
  • the permissible area of Patent Document 1 is a two-dimensional area set for the endoscopic image. That is, Patent Document 1 does not consider making the endoscope follow the treatment tool in a three-dimensional direction including the depth direction of the image. Therefore, it is difficult to realize good usability.
  • the present invention has been made in view of the above circumstances, and an object of the present invention is to provide a medical system and a control method capable of realizing the tracking of an endoscope with respect to an easy-to-use object.
  • One aspect of the present invention includes an endoscope that acquires an image including an object, a moving device that moves the endoscope inside the body, and a control device that controls the moving device based on the position of the object.
  • the control device follows the object in a first control mode in which the endoscope follows the object at a first speed and a second speed in which the endoscope follows the object at a second speed slower than the first speed.
  • the moving device can be controlled in the second control mode and the object is located outside a predetermined three-dimensional region set in the field of view of the endoscope, the moving device is moved in the first control mode.
  • a medical system that controls a device and controls the mobile device in the second control mode when the object is located inside the predetermined three-dimensional region.
  • Another aspect of the present invention is a control method for controlling the movement of an endoscope for acquiring an image including an object based on the position of the object, and the object is within the field of view of the endoscope.
  • the movement of the endoscope is controlled in the first control mode in which the endoscope is made to follow the object at the first speed, and the object is the object.
  • it is located inside a predetermined three-dimensional region, it is a control method for controlling the movement of the endoscope in a second control mode for following the object at a second speed slower than the first speed.
  • FIG. It is an external view of the medical system which concerns on one Embodiment of this invention.
  • It is a block diagram of the medical system of FIG. It is a figure which shows the 3D specific area set in the field of view of an endoscope. It is an endoscopic image which shows an example of the cross section of a specific area. It is an endoscopic image showing another example of the cross section of a specific area. It is an endoscopic image showing another example of the cross section of a specific area. It is a figure explaining the size on the endoscopic image of the specific area in the depth positions X1, X2, X3 of FIG. It is a figure explaining the movement of the treatment tool in an endoscopic image by the follow-up of an endoscope.
  • the medical system 10 holds the endoscope 1 and the treatment tool 2 inserted into the body of the patient and the endoscope 1 and moves the endoscope 1 in the body. It includes a moving device 3 to be moved, a control device 4 connected to the endoscope 1 and the moving device 3 to control the moving device 3, and a display device 5 for displaying an endoscope image.
  • the endoscope 1 is, for example, a rigid mirror, and includes an image pickup unit 1a (see FIG. 2) that has an image pickup element and acquires an endoscope image.
  • the endoscope 1 acquires an endoscope image D (see FIGS. 5 and 6) including the tip 2a of the treatment tool 2 by the imaging unit 1a, and transmits the endoscope image D to the control device 4.
  • the imaging unit 1a is, for example, a three-dimensional camera provided at the tip of the endoscope 1, and acquires a stereo image including information on the three-dimensional position of the tip 2a of the treatment tool 2 as an endoscope image D.
  • the moving device 3 includes a robot arm 3a having a plurality of joints 3b, and holds the base end portion of the endoscope 1 at the tip end portion of the robot arm 3a.
  • the robot arm 3a has three degrees of freedom of motion: linear movement back and forth along the X axis, rotation around the Y axis (pitch), and rotation around the Z axis (yaw), preferably around the X axis.
  • the X-axis is an axis on the same straight line as the optical axis A of the endoscope 1
  • the Y-axis and the Z-axis are directions orthogonal to the optical axis A and corresponding to the horizontal and vertical directions of the endoscope image D. It is an axis that extends to each.
  • the control device 4 includes at least one processor 4a such as a central processing unit, a memory 4b, a storage unit 4c, an input interface 4d, an output interface 4e, and a network interface 4f. Equipped with.
  • the endoscope image D transmitted from the endoscope 1 is sequentially input to the control device 4 via the input interface 4d, sequentially output to the display device 5 via the output interface 4e, and displayed on the display device 5. Will be done.
  • the surgeon operates the treatment tool 2 inserted into the body while observing the endoscopic image D displayed on the display device 5, and treats the affected part in the body with the treatment tool 2.
  • the storage unit 4c is a non-volatile recording medium such as a ROM (read-only memory) or a hard disk, and stores programs and data necessary for the processor 4a to execute processing.
  • the functions described later of the control device 4 are realized by the program being read into the memory 4b and executed by the processor 4a. Some functions of the control device 4 may be realized by a dedicated logic circuit or the like.
  • the control device 4 has a manual mode and a follow-up mode.
  • the manual mode an operator such as an operator manually operates the endoscope 1, and in the follow-up mode, the control device 4 automatically adjusts the endoscope 1 to the tip 2a of the treatment tool (object) 2. It is a mode to follow.
  • the control device 4 switches between the manual mode and the follow-up mode based on an instruction from the operator.
  • the control device 4 has artificial intelligence capable of recognizing human voice, switches to manual mode when recognizing voice in "manual mode", and follows mode when recognizing voice in "following mode”. Switch to.
  • the control device 4 may switch between the manual mode and the follow-up mode according to the on / off of the manual operation switch (not shown) provided in the endoscope 1.
  • an operator such as an operator can remotely control the robot arm 3a by operating an operating device (not shown) connected to the control device 4.
  • the control device 4 controls the moving device 3 based on the three-dimensional position of the tip 2a of the treatment tool 2 toward the center of the endoscopic image D and of the endoscopic image D.
  • the endoscope 1 is made to follow the tip 2a three-dimensionally so that the tip 2a moves toward a predetermined depth.
  • the control device 4 recognizes the treatment tool 2 in the endoscope image D, and calculates the three-dimensional position of the tip 2a using the endoscope image D.
  • the optical axis A of the endoscope 1 moves toward the tip 2a in a direction intersecting the optical axis A, and the tip of the endoscope 1 moves from the tip 2a by a predetermined observation distance.
  • Each joint 3b is operated so as to move in the depth direction along the optical axis A toward a distant position.
  • the follow-up modes are a first control mode in which the endoscope 1 follows the tip 2a of the treatment tool 2 at the first speed, and a second speed in which the endoscope 1 is slower than the first speed. It includes a second control mode for following the tip 2a.
  • the control device 4 controls the mobile device 3 in the first control mode when the tip 2a is outside the predetermined specific area B, and the tip 2a is inside the specific area B. In this case, the mobile device 3 is controlled in the second control mode. Therefore, when the tip 2a is arranged in the specific region B, the sensitivity of the endoscope 1 to follow the movement of the tip 2a is lowered, and the excessive follow of the endoscope 1 to the tip 2a is suppressed.
  • the specific region B is a predetermined three-dimensional region set in the field of view F of the endoscope 1 and having dimensions in the X, Y, and Z directions orthogonal to each other.
  • the X direction is a depth direction parallel to the optical axis A of the endoscope 1.
  • the Y direction and the Z direction are directions orthogonal to the optical axis A, and are parallel to the horizontal direction and the vertical direction of the endoscopic image D, respectively.
  • the specific area B is arranged at a position away from the tip of the endoscope 1 in the X direction, and is set in a part of the field of view F in the X direction. Further, the specific region B includes the optical axis A and has a three-dimensional shape whose cross section becomes smaller as it approaches the tip of the endoscope 1. Therefore, the specific region B on the endoscope image D is the region of the central portion including the center of the endoscope image D. As shown in FIGS. 4A to 4C, the shape of the cross section of the specific region B orthogonal to the optical axis A may be rectangular, circular, or elliptical, and may be another shape such as a polygon. You may. The specific area B may be superimposed and displayed on the endoscope image D, or may be hidden.
  • the shape of the cross section of the specific region B is the same as the shape of the endoscopic image D.
  • the cross section of the specific region B is also rectangular. Since the specific area B displayed on the endoscope image D may interfere with the observation of the endoscope image D, it is preferable that the specific area B is hidden. When the specific area B has the same shape as the endoscopic image D, the operator can easily recognize the position of the hidden specific area B.
  • the field of view F of the endoscope 1 is a cone shape having an apex at or near the tip of the endoscope 1.
  • the specific region B preferably has a frustum shape having a common apex with the field of view F of the endoscope 1. According to such a specific area B, as shown in FIG. 5, the apparent size and position of the specific area B on the endoscopic image D are constant regardless of the positions X1, X2, and X3 in the X direction. be.
  • the size of the specific area B on the endoscope image D (that is, the size of the cross section of the specific area B with respect to the cross section of the visual field F) shall be 25% or more and 55% or less of the size of the endoscopic image D. Is preferable.
  • the apex angle ⁇ of the specific region B is preferably 25% or more and 55% of the viewing angle ⁇ of the endoscope 1. According to this configuration, it is possible to achieve both the central arrangement in which the tip 2a of the treatment tool 2 is arranged in the center of the endoscope image D and the suppression of excessive follow-up of the endoscope 1 to the tip 2a.
  • the size of the specific region B is less than 25% of the size of the endoscope image D, the effect of suppressing the excessive follow-up of the endoscope 1 to the movement of the tip 2a becomes insufficient, and the visual field F is frequently moved. I can invite you.
  • the size of the specific region B is larger than 55% of the size of the endoscope image D, the tip 2a is often arranged at a position away from the center of the endoscope image D, and the tip 2a is arranged in the center. It can be difficult to achieve.
  • the specific area B includes the non-following area B1 and the following area B2.
  • the non-following region B1 is a region of the central portion of the specific region B including the optical axis A.
  • the tracking area B2 is an area outside the specific area B surrounding the non-following area B1. Similar to the specific region B, the non-following region B1 has a three-dimensional shape whose cross section becomes smaller as it approaches the tip of the endoscope 1, and is preferably a frustum shape.
  • the control device 4 rotates, for example, the robot arm 3a around the Y axis and the Z axis.
  • the endoscope 1 is made to follow the tip 2a at the first speed V1.
  • the control device 4 does not make the endoscope 1 follow the tip 2a and maintains the position of the endoscope 1. Specifically, the control device 4 controls the angular velocity of each joint 3b to zero. Therefore, the second velocity in the non-following region B1 is zero.
  • the control device 4 continues the operation of the endoscope 1 in the previous control cycle. That is, when the position of the endoscope 1 is maintained in the previous control cycle, the control device 4 maintains the position of the endoscope 1 in the current control cycle.
  • the control device 4 causes the endoscope 1 to follow the tip 2a also in the current control cycle.
  • the follow-up speed at this time is the second speed V2, which is larger than zero.
  • the tracking region B2 functions as a trigger for the start of tracking of the endoscope 1 to the tip 2a
  • the non-following region B1 functions as a trigger for the end of tracking of the endoscope 1 to the tip 2a. do. That is, when the tip 2a goes out from the follow-up region B2 to the outer region C, the endoscope 1 starts following the tip 2a, and the tip 2a does not pass from the outer region C via the follow-up region B2.
  • the tracking area B1 is entered, the tracking of the endoscope 1 with respect to the tip 2a ends.
  • the first speed V1 and the second speed V2 are constant, and the tracking speed of the endoscope 1 may change in two steps.
  • the first speed V1 and the second speed V2 may change depending on the distance from the center of the endoscopic image D to the tip 2a.
  • the control device 4 may calculate the distances in the Y direction and the Z direction from the optical axis A of the endoscope 1 to the tip 2a, and the larger the distance, the faster the respective speeds V1 and V2 may be.
  • the tracking speeds V1 and V2 of the endoscope 1 may continuously decrease from the outer region C to the non-following region B1.
  • 7A to 7D explain a specific example of the calculation method of the specific area B.
  • the control device 4 sets the intersection of the YZ plane P passing through the tip 2a of the treatment tool 2 and perpendicular to the optical axis A and the optical axis A as the reference point E.
  • the control device 4 defines a rectangular parallelepiped or spherical region centered on the reference point E as a specific region B.
  • 7B to 7C explain a method of calculating the actual size [mm] of the specific region B.
  • L_dz_pixel 1080/2 [pixel] Therefore, the actual size L_dz [mm] in the Z direction of the specific area B is calculated from the following equation using the pixel size [px] in the Z direction of the specific area B.
  • L_dz Lmax_dz * (dz / Lmax_dz_pixel)
  • the actual size L_dy [mm] of the specific region B in the Y direction is also calculated by the same method as L_dd.
  • the actual size L_dx in the X direction of the specific area B is also set.
  • the actual size L_dx may be set to a constant value regardless of the observation distance di.
  • the actual size L_dx at the reference observation distance di (for example, d1) is preset, and the L_dx at the other observation distance di (for example, d2) is proportional to the change in the observation distance. It may be set to the specified value.
  • the control device 4 executes the control methods of steps S2 to S8 and controls the mobile device 3 in the follow mode.
  • the control method includes step S2 for determining whether or not the position of the tip 2a of the treatment tool 2 is inside the specific area B, and when the position of the tip 2a is outside the specific area B, the tip 2a of the treatment tool 2 is not.
  • the steps S3 to S8 for causing the endoscope 1 to follow the treatment tool 2 until it reaches the tracking area B1 are included.
  • the control device 4 calculates the three-dimensional position of the tip 2a using the endoscope image D which is a stereo image, and the tip 2a is in a predetermined specific region B. Whether or not it is determined (step S2).
  • the control device 4 does not execute the control to automatically follow the endoscope 1 to the treatment tool 2, and determines the position of the endoscope 1. maintain.
  • the control device 4 starts following the endoscope 1 to the treatment tool 2 (step S3).
  • the control device 4 selects either the first control mode or the second control mode based on the position of the tip 2a. As shown in FIG. 6, since the tip 2a is located outside the specific region B at the start of tracking (NO in step S4), the control device 4 controls the moving device 3 in the first control mode.
  • the endoscope 1 is made to follow the tip 2a of the treatment tool 2 at the first speed V1 so that the tip 2a of the treatment tool 2 faces the center of the endoscope image D (step S5).
  • the control device 4 controls the mobile device 3 in the first control mode until the tip 2a enters the specific area B.
  • the control device 4 After the tip 2a enters the specific region B (YES in step S4), the control device 4 subsequently controls in the second control mode so that the tip 2a of the treatment tool 2 is located at the center of the endoscopic image D.
  • the endoscope 1 is made to follow the tip 2a of the treatment tool 2 at the second speed V2 so as to face. Since the second speed V2 is slower than the first speed V1, the responsiveness of the endoscope 1 to follow the movement of the tip 2a is lowered. That is, after the tip 2a returns from the outer region C to the specific region B, the endoscope 1 is prevented from excessively following the movement of the treatment tool 2.
  • the control device 4 controls the moving device 3 in the second control mode until the tip 2a enters the non-following region B1.
  • step S6 When the tip 2a of the treatment tool 2 enters the non-following region B1 (YES in step S6), the control device 4 ends the tracking of the endoscope 1 with respect to the treatment tool 2 (step S8). While the follow-up mode continues (NO in step S9), the control device 4 repeats steps S1 to S8.
  • the endoscope 1 in order to realize the follow-up of the endoscope 1 which is convenient for the operator, it is necessary to suppress excessive follow-up, to capture the tip 2a of the treatment tool 2 in the center of the endoscope image D, and to realize the follow-up. It is desirable to make the endoscope 1 follow the treatment tool 2 three-dimensionally so as to satisfy the three conditions of capturing the tip 2a of the treatment tool 2 at an appropriate distance in the X direction.
  • the specific region B is a three-dimensional region set in the visual field F, the distance between the tip of the endoscope 1 and the specific region B in the X direction and each position in the X direction
  • the specific area B can be appropriately designed so as to satisfy the above three conditions such as the size of the cross section of the specific area B. As a result, it is possible to realize the tracking of the endoscope 1 with respect to the easy-to-use treatment tool 2.
  • the apparent size of the specific region B on the endoscope image D differs due to the difference in the position in the X direction. Is suppressed, and preferably, the apparent size of the specific region B is constant regardless of the position in the X direction. As a result, regardless of the position of the tip 2a in the X direction, it is possible to suppress excessive tracking of the endoscope 1 and to arrange the tip 2a in the center at the same time.
  • FIG. 11 shows a specific region B'as a reference example.
  • the specific region B' is formed by simply expanding the two-dimensional region on the image plane of the endoscope image D in the X direction
  • the specific region B' is the endoscope 1 It is a region extending in the X direction from the tip of. Therefore, the endoscope 1 cannot be made to follow the treatment tool 2 so as to catch the tip 2a at an appropriate distance in the X direction.
  • the size of the cross section of the specific area B' is constant, the apparent size of the specific area B on the endoscope image D differs depending on the position in the X direction, and the endoscope 1 with respect to the treatment tool 2 has a different size.
  • the control device 4 decides to continue the operation of the endoscope 1 in the previous control cycle, but instead of this, it is decided to continue the operation.
  • the endoscope 1 may always follow the tip 2a at a second velocity V2 larger than zero. That is, the control device 4 moves in the second control mode regardless of whether the tip 2a enters the follow-up region B2 from the outer region C or the tip 2a enters the follow-up region B2 from the non-following region B1.
  • the device 3 may be controlled. In this case, as shown in FIG.
  • control device 4 determines whether or not the tip 2a is in the non-following region B1 (step S2'), and the tip 2a moves from the non-following region B1 to the tracking region B2.
  • the follow-up of the endoscope 1 to the treatment tool 2 is started (step S3).
  • the control device 4 controls the moving device 3 in the second control mode to obtain an endoscopic image.
  • the endoscope 1 is made to follow the tip 2a of the treatment tool 2 at the second speed V2 so that the tip 2a of the treatment tool 2 faces the center of D (step S7).
  • the control device 4 controls the moving device 3 in the second control mode until the tip 2a enters the non-following region B1.
  • the second speed V2 is slower than the first speed V1
  • the endoscope 1 excessively follows the movement of the treatment tool 2 while the tip 2a is moving in the tracking region B2. Is suppressed.
  • the control device 4 switches from the second control mode to the first control mode. (Step S5), the moving device 3 is controlled in the first control mode until the tip 2a returns to the specific area B.
  • the control device 4 may change the size of the cross section of the specific region B according to the viewing angle ⁇ of the endoscope 1, as shown in FIGS. 9A and 9B.
  • the storage unit 4c stores the value of the viewing angle ⁇ of each type of endoscope 1.
  • the control device 4 recognizes the model of the endoscope 1 held by the robot arm 3a, reads the value of the viewing angle ⁇ of the recognized model from the storage unit 4c, and determines the apex angle ⁇ of the specific region B as the viewing angle.
  • Set to a predetermined ratio of ⁇ For example, the apex angle ⁇ is calculated by multiplying the value of the viewing angle ⁇ by a predetermined ratio k selected from 25% to 55%.
  • the size of the cross section of the specific region B increases in proportion to the viewing angle ⁇ .
  • the area ratio of the cross section of the specific region B to the cross section of the visual field F is constant regardless of the difference in the viewing angle ⁇ of the endoscope 1 used. Therefore, the apparent size of the specific region B in the endoscope image D displayed on the display device 5 can be made the same regardless of the viewing angle ⁇ of the endoscope 1.
  • the specific region B includes the non-following region B1 that does not allow the treatment tool 2 to follow the endoscope 1, but instead, as shown in FIG. 10, the specific region B includes the non-following region B1.
  • the non-following region B1 may not be included.
  • the control device 4 causes the endoscope 1 to follow the treatment tool 2 at the second speed V2 until the tip 2a of the treatment tool 2 is arranged at the center of the endoscope image D, and the tip 2a is inside. Tracking ends when it is placed in the center of the endoscope image D. In the case of FIG. 6, the tracking ends when the tip 2a reaches the end of the tracking region B2 away from the center of the endoscope image D.
  • the endoscope 1 since the endoscope 1 follows until the tip 2a reaches the center of the endoscope image D, the treatment is performed with the tip 2a arranged at the center of the endoscope image D. be able to.
  • the second speed V2 is preferably 50% or less of the first speed V1.
  • the second speed V2 may be constant and may gradually decrease as the tip 2a of the treatment tool 2 approaches the center of the endoscopic image D.
  • the second speed V2 is faster than 50% of the first speed V1, it is difficult to sufficiently obtain the effect of suppressing excessive tracking of the endoscope 1.
  • the shape of the cross section of the specific region B may be changeable.
  • the shape of the cross section can be selected from the squares, circles, and ellipses shown in FIGS. 4A to 4C, and the parameters dy, dz, R, a, b that determine the size of the cross section in each shape are It may be configurable.
  • the shape selection and parameter setting may be performed manually by the operator or automatically by the control device 4.
  • the shape and size of the cross section of the specific region B can be set according to the surgical procedure, the treatment content, the operator's preference, and the like.
  • the visual field F is set in the vertical direction of the tip 2a by setting the cross section to the vertically long ellipse shown in FIG. 4C. It is possible to prevent the tip 2a from vibrating in the vertical direction in response to the movement excessively, and to make the visual field F stationary regardless of the vertical movement of the tip 2a during the treatment.
  • the control device 4 recognizes the treatment tool 2 or the type of treatment, and automatically determines at least one of the shape, the size in the X, Y, and Z directions of the specific region B, and the position according to the treatment tool 2 or the type of treatment. May be changed to. Further, the control device 4 may automatically change the first speed and the second speed according to the treatment tool 2 or the type of treatment. For example, the control device 4 recognizes the type of the treatment tool 2 based on the endoscopic image D, and recognizes the type of treatment from the type of the treatment tool 2.
  • the appropriate shape, size and position of the specific area B will vary depending on the treatment tool 2 or the type of treatment. According to the above configuration, the shape, size and position of the specific area B can be automatically set to those suitable for the treatment tool 2 or the type of treatment.
  • a larger specific region B in the X direction is set at a position farther from the tip of the endoscope 1.
  • a range of 90 mm to 190 mm from the tip of the endoscope 1 is set in the specific region B.
  • a specific region B is set at a position closer to the tip of the endoscope 1 in order to perform delicate treatment. For example, a range of 60 mm to 90 mm from the tip of the endoscope 1 is set in the specific region B.
  • the size of the cross section of the specific region B may be increased or the second speed may be decreased.
  • the control device 4 learns the movement of the tip 2a during treatment and changes the shape and size of the specific region B so that the operating range of the tip 2a during treatment is included in the specific region B. May be.
  • the control device 4 may continuously change the tracking speed according to the distance from the center of the endoscope image D to the tip 2a. For example, the control device 4 may calculate the angular velocity Vp of rotation around the Y axis and the angular velocity Vy of rotation around the Z axis based on the following equation, and rotate the robot arm 3a at the calculated angular velocities Vp and Vy, respectively. good.
  • py is the distance in the Y direction from the center of the endoscope image D to the tip 2a
  • pz is the distance in the Z direction from the center of the endoscope image D to the tip 2a
  • the endoscope 1 acquires a three-dimensional stereo image as the endoscope image D, but instead of this, a two-dimensional endoscope image D may be acquired.
  • the position of the tip 2a of the treatment tool 2 in the X direction may be measured by another distance measuring means such as a distance sensor provided at the tip of the endoscope 1.
  • the object to be followed by the endoscope 1 is the treatment tool 2, but the object is not limited to this, and any object reflected in the endoscope image D during the operation is not limited to this. It may be an object.
  • the object may be a medical material such as a lesion, an organ, a blood vessel, a marker, or gauze, or a medical device other than the treatment tool 2.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Optics & Photonics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Robotics (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Astronomy & Astrophysics (AREA)
  • Endoscopes (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)
PCT/JP2021/027564 2020-09-10 2021-07-26 医療システムおよび制御方法 Ceased WO2022054428A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2022547429A JP7535587B2 (ja) 2020-09-10 2021-07-26 医療システムおよび医療システムの作動方法
CN202180053633.7A CN116171122A (zh) 2020-09-10 2021-07-26 医疗系统和控制方法
US18/105,291 US20230180995A1 (en) 2020-09-10 2023-02-03 Medical system and control method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202063076408P 2020-09-10 2020-09-10
US63/076,408 2020-09-10

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/105,291 Continuation US20230180995A1 (en) 2020-09-10 2023-02-03 Medical system and control method

Publications (1)

Publication Number Publication Date
WO2022054428A1 true WO2022054428A1 (ja) 2022-03-17

Family

ID=80629721

Family Applications (4)

Application Number Title Priority Date Filing Date
PCT/JP2021/027564 Ceased WO2022054428A1 (ja) 2020-09-10 2021-07-26 医療システムおよび制御方法
PCT/JP2021/033210 Ceased WO2022054884A1 (ja) 2020-09-10 2021-09-09 内視鏡システム、制御装置、制御方法および記録媒体
PCT/JP2021/033205 Ceased WO2022054882A1 (ja) 2020-09-10 2021-09-09 制御装置、内視鏡システムおよび制御方法
PCT/JP2021/033209 Ceased WO2022054883A1 (ja) 2020-09-10 2021-09-09 制御装置、内視鏡システム、制御方法および制御プログラム

Family Applications After (3)

Application Number Title Priority Date Filing Date
PCT/JP2021/033210 Ceased WO2022054884A1 (ja) 2020-09-10 2021-09-09 内視鏡システム、制御装置、制御方法および記録媒体
PCT/JP2021/033205 Ceased WO2022054882A1 (ja) 2020-09-10 2021-09-09 制御装置、内視鏡システムおよび制御方法
PCT/JP2021/033209 Ceased WO2022054883A1 (ja) 2020-09-10 2021-09-09 制御装置、内視鏡システム、制御方法および制御プログラム

Country Status (4)

Country Link
US (4) US20230180995A1 (cg-RX-API-DMAC7.html)
JP (3) JP7535587B2 (cg-RX-API-DMAC7.html)
CN (3) CN116171122A (cg-RX-API-DMAC7.html)
WO (4) WO2022054428A1 (cg-RX-API-DMAC7.html)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9204939B2 (en) * 2011-08-21 2015-12-08 M.S.T. Medical Surgery Technologies Ltd. Device and method for assisting laparoscopic surgery—rule based approach
WO2017028916A1 (en) * 2015-08-19 2017-02-23 Brainlab Ag Reference array holder
TWI782409B (zh) * 2020-03-09 2022-11-01 陳階曉 內視鏡影像校正系統及其方法
JP7637794B2 (ja) * 2021-11-30 2025-02-28 オリンパス株式会社 内視鏡システムおよび内視鏡システムの作動方法
US20230255442A1 (en) * 2022-02-11 2023-08-17 Canon U.S.A., Inc. Continuum robot apparatuses, methods, and storage mediums
JP7854499B2 (ja) * 2022-04-05 2026-05-01 オリンパス株式会社 内視鏡システム、内視鏡システムの作動方法および手技支援プログラム
JP7841090B2 (ja) * 2022-07-08 2026-04-06 オリンパス株式会社 内視鏡システム、制御方法および制御プログラム
CN115956859B (zh) * 2022-10-11 2026-04-14 中国医学科学院北京协和医院 内窥镜控制方法及手术机器人系统
WO2024157360A1 (ja) * 2023-01-24 2024-08-02 国立研究開発法人国立がん研究センター 内視鏡画像の処置具検出装置、内視鏡画像の処置具検出方法、及び内視鏡画像の処置具検出装置プログラム
US20240349985A1 (en) * 2023-04-24 2024-10-24 Karl Storz Se & Co. Kg Corrective adjustment of image parameters using artificial intelligence
CN118319430A (zh) * 2023-12-29 2024-07-12 北京智愈医疗科技有限公司 一种基于内窥镜的水刀运动轨迹的监测装置
WO2025163471A1 (en) * 2024-01-29 2025-08-07 Covidien Lp Hysteroscopic surgical systems for use with surgical robotic systems and surgical robotic systems incorporating the same

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05284411A (ja) * 1992-03-31 1993-10-29 Victor Co Of Japan Ltd ビデオカメラにおける被写体追尾方法
JPH0723271A (ja) * 1993-06-30 1995-01-24 Victor Co Of Japan Ltd ビデオカメラにおける被写体追尾装置
JPH0938030A (ja) * 1995-07-28 1997-02-10 Shimadzu Corp 内視鏡装置
JPH09266882A (ja) * 1996-04-02 1997-10-14 Olympus Optical Co Ltd 内視鏡装置
JP2006229322A (ja) * 2005-02-15 2006-08-31 Matsushita Electric Ind Co Ltd 自動追尾制御装置及び自動追尾制御方法、並びにプログラム、自動追尾システム
JP2007222239A (ja) * 2006-02-21 2007-09-06 Fujinon Corp 体腔内観察装置
US20130331644A1 (en) * 2010-12-10 2013-12-12 Abhilash Pandya Intelligent autonomous camera control for robotics with medical, military, and space applications
US20140005475A1 (en) * 2012-06-27 2014-01-02 National Chiao Tung University Image Tracking System and Image Tracking Method Thereof
WO2018235255A1 (ja) * 2017-06-23 2018-12-27 オリンパス株式会社 医療システムとその作動方法
WO2020070883A1 (ja) * 2018-10-05 2020-04-09 オリンパス株式会社 内視鏡システム

Family Cites Families (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2911894B2 (ja) * 1986-11-13 1999-06-23 オリンパス光学工業株式会社 内視鏡画像取込み方法および内視鏡装置
JP3236070B2 (ja) 1992-06-04 2001-12-04 オリンパス光学工業株式会社 スコープ保持装置およびスコープ装置
JP3348933B2 (ja) * 1993-03-19 2002-11-20 オリンパス光学工業株式会社 電子式内視鏡装置
JP3419869B2 (ja) * 1993-12-28 2003-06-23 オリンパス光学工業株式会社 医療器具
JP3889873B2 (ja) * 1998-02-24 2007-03-07 オリンパス株式会社 計測内視鏡装置
US6471637B1 (en) 1999-09-24 2002-10-29 Karl Storz Imaging, Inc. Image orientation for endoscopic video displays
US7037258B2 (en) 1999-09-24 2006-05-02 Karl Storz Imaging, Inc. Image orientation for endoscopic video displays
JP2001112704A (ja) * 1999-10-20 2001-04-24 Olympus Optical Co Ltd 内視鏡システム
DE19961971B4 (de) 1999-12-22 2009-10-22 Forschungszentrum Karlsruhe Gmbh Vorrichtung zum sicheren automatischen Nachführen eines Endoskops und Verfolgen eines Instruments
JP2003088532A (ja) * 2001-09-19 2003-03-25 Olympus Optical Co Ltd 手術装置
JP4331541B2 (ja) 2003-08-06 2009-09-16 オリンパス株式会社 内視鏡装置
US20050123179A1 (en) 2003-12-05 2005-06-09 Eastman Kodak Company Method and system for automatic axial rotation correction in vivo images
US7654997B2 (en) * 2004-04-21 2010-02-02 Acclarent, Inc. Devices, systems and methods for diagnosing and treating sinusitus and other disorders of the ears, nose and/or throat
JP4377745B2 (ja) * 2004-05-14 2009-12-02 オリンパス株式会社 電子内視鏡
JP4785127B2 (ja) * 2005-12-08 2011-10-05 学校法人早稲田大学 内視鏡視野拡張システム、内視鏡視野拡張装置及び内視鏡視野拡張用プログラム
US7841980B2 (en) 2006-05-11 2010-11-30 Olympus Medical Systems Corp. Treatment system, trocar, treatment method and calibration method
US20080108870A1 (en) * 2006-11-06 2008-05-08 Wiita Bruce E Apparatus and method for stabilizing an image from an endoscopic camera
JP5030639B2 (ja) * 2007-03-29 2012-09-19 オリンパスメディカルシステムズ株式会社 内視鏡装置の処置具位置制御装置
US8083669B2 (en) * 2007-06-22 2011-12-27 Olympus Medical Systems Corp. Medical device for maintaining state of treatment portion
JP5192898B2 (ja) * 2008-04-25 2013-05-08 オリンパスメディカルシステムズ株式会社 マニピュレータシステム
JP2010220794A (ja) * 2009-03-24 2010-10-07 Fujifilm Corp 内視鏡画像回転装置および方法並びにプログラム
WO2012108085A1 (ja) * 2011-02-08 2012-08-16 オリンパスメディカルシステムズ株式会社 医療機器
US9204939B2 (en) 2011-08-21 2015-12-08 M.S.T. Medical Surgery Technologies Ltd. Device and method for assisting laparoscopic surgery—rule based approach
JP6021369B2 (ja) * 2012-03-21 2016-11-09 Hoya株式会社 内視鏡システム
EP2979610B1 (en) 2013-03-28 2019-06-19 Olympus Corporation Endoscope system
JP5788623B2 (ja) * 2013-07-12 2015-10-07 オリンパス株式会社 内視鏡システム
JP6218634B2 (ja) * 2014-02-20 2017-10-25 オリンパス株式会社 内視鏡システム及び内視鏡の作動方法
JP6257371B2 (ja) * 2014-02-21 2018-01-10 オリンパス株式会社 内視鏡システム及び内視鏡システムの作動方法
WO2015149040A1 (en) * 2014-03-28 2015-10-01 Dorin Panescu Quantitative three-dimensional imaging of surgical scenes
KR102387096B1 (ko) * 2014-03-28 2022-04-15 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 시계 내의 기기들의 정량적 3차원 시각화
EP3326510A4 (en) * 2015-07-23 2019-04-17 Olympus Corporation MANIPULATOR AND MEDICAL SYSTEM
WO2017082047A1 (ja) * 2015-11-13 2017-05-18 オリンパス株式会社 内視鏡システム
DE112016006299T5 (de) * 2016-01-25 2018-10-11 Sony Corporation Medizinische Sicherheitssteuerungsvorrichtung, medizinisches Sicherheitssteuerungsverfahren und medizinisches Unterstützungssystem
JP6150968B1 (ja) * 2016-02-10 2017-06-21 オリンパス株式会社 内視鏡システム
WO2017138105A1 (ja) * 2016-02-10 2017-08-17 オリンパス株式会社 マニピュレータシステム
CN107456278B (zh) * 2016-06-06 2021-03-05 北京理工大学 一种内窥镜手术导航方法和系统
JP2019165270A (ja) 2016-08-03 2019-09-26 シャープ株式会社 映像出力システム、映像出力方法および制御装置
CN109715073A (zh) 2016-09-15 2019-05-03 奥林巴斯株式会社 超声波内窥镜及超声波内窥镜系统
JPWO2018159328A1 (ja) * 2017-02-28 2019-12-19 ソニー株式会社 医療用アームシステム、制御装置及び制御方法
JP6965338B2 (ja) 2017-03-28 2021-11-10 ソニー・オリンパスメディカルソリューションズ株式会社 医療用観察装置、制御装置、及び観察視野補正方法
WO2019035206A1 (ja) * 2017-08-18 2019-02-21 オリンパス株式会社 医療システムおよび画像生成方法
US12262866B2 (en) * 2017-09-22 2025-04-01 Carl Zeiss Meditec Ag Visualization system comprising an observation apparatus and an endoscope
DE102017219621B4 (de) * 2017-09-22 2025-11-13 Carl Zeiss Meditec Ag Visualisierungssystem mit einem Beobachtungsgerät und einem Endoskop
WO2019116592A1 (ja) * 2017-12-14 2019-06-20 オリンパス株式会社 内視鏡の表示画像の調整装置及び手術システム
JP7151109B2 (ja) 2018-03-19 2022-10-12 ソニーグループ株式会社 医療用撮像装置及び医療用観察システム
BR112021016621A2 (pt) * 2019-02-21 2021-11-03 Theator Inc Sistemas e métodos para análise de vídeos cirúrgicos
JP2020151044A (ja) * 2019-03-18 2020-09-24 ソニー・オリンパスメディカルソリューションズ株式会社 医療用観察装置
JP7480477B2 (ja) * 2019-07-10 2024-05-10 ソニーグループ株式会社 医療用観察システム、制御装置及び制御方法
WO2021037381A1 (en) 2019-08-30 2021-03-04 Brainlab Ag Image based motion control correction
JP2021040987A (ja) * 2019-09-12 2021-03-18 ソニー株式会社 医療用支持アーム、及び医療用システム

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05284411A (ja) * 1992-03-31 1993-10-29 Victor Co Of Japan Ltd ビデオカメラにおける被写体追尾方法
JPH0723271A (ja) * 1993-06-30 1995-01-24 Victor Co Of Japan Ltd ビデオカメラにおける被写体追尾装置
JPH0938030A (ja) * 1995-07-28 1997-02-10 Shimadzu Corp 内視鏡装置
JPH09266882A (ja) * 1996-04-02 1997-10-14 Olympus Optical Co Ltd 内視鏡装置
JP2006229322A (ja) * 2005-02-15 2006-08-31 Matsushita Electric Ind Co Ltd 自動追尾制御装置及び自動追尾制御方法、並びにプログラム、自動追尾システム
JP2007222239A (ja) * 2006-02-21 2007-09-06 Fujinon Corp 体腔内観察装置
US20130331644A1 (en) * 2010-12-10 2013-12-12 Abhilash Pandya Intelligent autonomous camera control for robotics with medical, military, and space applications
US20140005475A1 (en) * 2012-06-27 2014-01-02 National Chiao Tung University Image Tracking System and Image Tracking Method Thereof
WO2018235255A1 (ja) * 2017-06-23 2018-12-27 オリンパス株式会社 医療システムとその作動方法
WO2020070883A1 (ja) * 2018-10-05 2020-04-09 オリンパス株式会社 内視鏡システム

Also Published As

Publication number Publication date
JP7534423B2 (ja) 2024-08-14
JPWO2022054884A1 (cg-RX-API-DMAC7.html) 2022-03-17
JPWO2022054882A1 (cg-RX-API-DMAC7.html) 2022-03-17
CN116018538B (zh) 2026-05-26
US20230172675A1 (en) 2023-06-08
US12702500B2 (en) 2026-08-11
CN115996662A (zh) 2023-04-21
US20230180996A1 (en) 2023-06-15
WO2022054884A1 (ja) 2022-03-17
JP7535587B2 (ja) 2024-08-16
WO2022054882A1 (ja) 2022-03-17
JPWO2022054428A1 (cg-RX-API-DMAC7.html) 2022-03-17
CN116018538A (zh) 2023-04-25
JP7522840B2 (ja) 2024-07-25
WO2022054883A1 (ja) 2022-03-17
CN116171122A (zh) 2023-05-26
US20230180998A1 (en) 2023-06-15
US20230180995A1 (en) 2023-06-15
CN115996662B (zh) 2025-11-18

Similar Documents

Publication Publication Date Title
JP7535587B2 (ja) 医療システムおよび医療システムの作動方法
JP5814938B2 (ja) リアルタイム速度最適化を使用した校正不要のビジュアルサーボ
US12171520B2 (en) Image guided motion scaling for robot control
US11406460B2 (en) Surgery assisting apparatus, method of controlling the same, storage medium, and surgery assisting system
US10638915B2 (en) System for moving first insertable instrument and second insertable instrument, controller, and computer-readable storage device
JP2013516264A5 (cg-RX-API-DMAC7.html)
KR102258511B1 (ko) 로봇 수술 시스템용 그래픽 사용자 인터페이스
JP7115493B2 (ja) 手術アームシステム及び手術アーム制御システム
CN113645919A (zh) 医疗臂系统、控制装置和控制方法
CN109288591A (zh) 手术机器人系统
US11497569B2 (en) Touchscreen user interface for interacting with a virtual model
JPWO2007145327A1 (ja) 遠隔操作システム
US12383126B2 (en) Surgery system and control method for surgery system to adjust position and orientation of imager
JP7854499B2 (ja) 内視鏡システム、内視鏡システムの作動方法および手技支援プログラム
Mattos et al. Next-generation micromanipulator for computer-assisted laser phonomicrosurgery
US20240341568A1 (en) Systems and methods for depth-based measurement in a three-dimensional view
US20250302273A1 (en) Medical system, control device, control method, and control program
CN121099964A (zh) 用于在成像空间中实施与成像设备相关联的变焦特征的系统和方法
WO2026080420A1 (en) Catheter for transvenous nerve ablation
CN120602778A (zh) 一种外视镜系统的注册方法及外视镜系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21866388

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022547429

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21866388

Country of ref document: EP

Kind code of ref document: A1