US20230180995A1 - Medical system and control method - Google Patents

Medical system and control method Download PDF

Info

Publication number
US20230180995A1
US20230180995A1 US18/105,291 US202318105291A US2023180995A1 US 20230180995 A1 US20230180995 A1 US 20230180995A1 US 202318105291 A US202318105291 A US 202318105291A US 2023180995 A1 US2023180995 A1 US 2023180995A1
Authority
US
United States
Prior art keywords
endoscope
tip
controller
specific region
surgical instrument
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US18/105,291
Other languages
English (en)
Inventor
Hiroyuki Takayama
Ryota SASAI
Masaru YANAGIHARA
Chiharu MIZUTANI
Hiro HASEGAWA
Daichi KITAGUCHI
Nobuyoshi TAKESHITA
Shigehiro KOJIMA
Yuki Furusawa
Yumi KINEBUCHI
Masaaki Ito
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Corp
National Cancer Centre Japan
National Cancer Center
Original Assignee
Olympus Corp
National Cancer Centre Japan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp, National Cancer Centre Japan filed Critical Olympus Corp
Priority to US18/105,291 priority Critical patent/US20230180995A1/en
Assigned to OLYMPUS CORPORATION, NATIONAL CANCER CENTER reassignment OLYMPUS CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KOJIMA, Shigehiro, MIZUTANI, Chiharu, TAKESHITA, Nobuyoshi, YANAGIHARA, MASARU, HASEGAWA, Hiro, ITO, MASAAKI, FURUSAWA, Yuki, KINEBUCHI, Yumi, KITAGUCHI, Daichi, SASAI, RYOTA, TAKAYAMA, HIROYUKI
Publication of US20230180995A1 publication Critical patent/US20230180995A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00006—Operational features of endoscopes characterised by electronic signal processing of control signals
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00039—Operational features of endoscopes provided with input arrangements for the user
    • A61B1/0004—Operational features of endoscopes provided with input arrangements for the user for electronic operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00039—Operational features of endoscopes provided with input arrangements for the user
    • A61B1/00042—Operational features of endoscopes provided with input arrangements for the user for mechanical operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147—Holding or positioning arrangements
    • A61B1/00149—Holding or positioning arrangements using articulated arms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147—Holding or positioning arrangements
    • A61B1/0016—Holding or positioning arrangements using motor drive units
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B34/32—Surgical robots operating autonomously
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/06—Devices, other than using radiation, for detecting or locating foreign bodies ; Determining position of diagnostic devices within or on the body of the patient
    • A61B5/065—Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/60—Rotation of whole images or parts thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000096—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope using artificial intelligence
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163—Optical arrangements
    • A61B1/00193—Optical arrangements adapted for stereoscopic vision
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2065—Tracking using image or pattern recognition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2068—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis using pointers, e.g. pointers having reference marks for determining coordinates of body points
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B2034/301—Surgical robots for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B2034/305—Details of wrist mechanisms at distal ends of robotic arms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/363—Use of fiducial points
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25—User interfaces for surgical systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6846—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive
    • A61B5/6847—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be brought in contact with an internal body part, i.e. invasive mounted on an invasive device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10068—Endoscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Definitions

  • the present invention relates to a medical system and a control method and particularly relates to a medical system having the function of causing an endoscope to follow an object, and a control method thereof.
  • the present application claims priority under the provisional U.S. Pat. Application No. 63/076408 filed on Sep. 10, 2020, which is incorporated herein by reference. This is a continuation of International Application PCT/JP2021/027564 which is hereby incorporated by reference herein in its entirety.
  • the field of view may become unstable and cause a surgeon to feel stress.
  • the field of view desirably stays stationary during procedures such as blunt dissection and thus a movement of the field of view may interfere with the procedure.
  • a permissible region is set in an image so as to extend around the central region of the image, an endoscope follows a surgical instrument to place the surgical instrument back to the central region when the surgical instrument moves out of the permissible region, and the following is terminated when the surgical instrument moves into the central region.
  • This configuration prevents the endoscope from following the surgical instrument insofar as the surgical instrument stays in the permissible region and the central region, thereby suppressing an excessive movement of the field of view.
  • Another aspect of the present invention is a control method for controlling a movement of an endoscope on the basis of the position of an object, the endoscope capturing an image including the object, the control method including: controlling the movement of the endoscope in a first control mode in which the endoscope is caused to follow the object at a first speed, when the object is located outside a predetermined three-dimensional region set in a field of view of the endoscope; and controlling the movement of the endoscope in a second control mode in which the endoscope is caused to follow the object at a second speed lower than the first speed, when the object is located in the predetermined three-dimensional region.
  • FIG. 1 illustrates an appearance of a medical system according to an embodiment of the present invention.
  • FIG. 2 is a block diagram of the medical system illustrated in FIG. 1 .
  • FIG. 3 illustrates a three-dimensional specific region set in the field of view of an endoscope.
  • FIG. 4 B is an endoscope image illustrating another example of a cross section of the specific region.
  • FIG. 4 C is an endoscope image illustrating another example of a cross section of the specific region.
  • FIG. 5 is an explanatory drawing of a size on the endoscope image of the specific region at depth positions X1, X2, and X3 in FIG. 3 .
  • FIG. 6 is an explanatory drawing of a movement of a surgical instrument followed by the endoscope in the endoscope image.
  • FIG. 7 D is an explanatory drawing of the specific example of the method for calculating the specific region.
  • FIG. 8 A is a flowchart of a control method performed by a controller in FIG. 1 .
  • FIG. 8 B is a flowchart of a modification of the control method performed by the controller in FIG. 1 .
  • FIG. 9 A is an explanatory drawing of a method for setting the size of the specific region according to the viewing angle of the endoscope.
  • FIG. 9 B is an explanatory drawing of the method for setting the size of the specific region according to the viewing angle of the endoscope.
  • FIG. 10 is an explanatory drawing of a modification of a movement of the surgical instrument followed by the endoscope in the endoscope image.
  • FIG. 11 illustrates a three-dimensional specific region in a reference example.
  • the endoscope 1 is, for example, a rigid endoscope and includes an imaging portion 1 a that has an image sensor and captures an endoscope image (see FIG. 2 ).
  • the endoscope 1 captures an endoscope image D (see FIGS. 5 and 6 ), which includes a tip 2 a of the surgical instrument 2 , through the imaging portion 1 a and transmits the endoscope image D to the controller 4 .
  • the imaging portion 1 a is, for example, a three-dimensional camera provided at the tip portion of the endoscope 1 and captures a stereo image, which includes information on the three-dimensional position of the tip 2 a of the surgical instrument 2 , as the endoscope image D.
  • the moving device 3 includes a robot arm 3 a having a plurality of joints 3 b and holds the proximal portion of the endoscope 1 at the tip portion of the robot arm 3 a .
  • the robot arm 3 a has three degrees of freedom of movement: a back-and-forth linear motion along the X axis, a rotation (pitch) about the Y axis, and a rotation (yaw) about the Z axis.
  • a rotation (roll) about the X axis is preferably added as a degree of freedom of movement.
  • the X axis is an axis on the same straight line as an optical axis A of the endoscope 1
  • the Y and Z axes are axes that are orthogonal to the optical axis A and extend in respective directions corresponding to the lateral direction and the longitudinal direction of the endoscope image D.
  • the controller 4 includes at least one processor 4 a like a central processing unit, a memory 4 b , a storage unit 4 c , an input interface 4 d , an output interface 4 e , and a network interface 4 f .
  • the endoscope images D transmitted from the endoscope 1 are sequentially inputted to the controller 4 through the input interface 4 d , are sequentially outputted to the display device 5 through the output interface 4 e , and are displayed on the display device 5 .
  • a surgeon operates the surgical instrument 2 inserted into a body while observing the endoscope image D displayed on the display device 5 , and performs an operation on an affected area in the body by using the surgical instrument 2 .
  • the storage unit 4 c is a ROM (read-only memory) or a nonvolatile recording medium such as a hard disk and stores a program and data necessary for causing the processor 4 a to perform processing.
  • the program is read in the memory 4 b and is executed by the processor 4 a , thereby implementing the functions of the controller 4 .
  • the functions will be described later.
  • Some of the functions of the controller 4 may be implemented by dedicated logic circuits or the like.
  • the controller 4 has a manual mode or a follow-up mode.
  • the manual mode is a mode in which an operator, e.g., a surgeon manually operates the endoscope 1
  • the follow-up mode is a mode in which the controller 4 causes the endoscope 1 to automatically follow the tip 2 a of the surgical instrument (object) 2 .
  • the controller 4 controls the moving device 3 on the basis of the three-dimensional position of the tip 2 a of the surgical instrument 2 , so that the endoscope 1 is caused to three-dimensionally follow the tip 2 a so as to move the tip 2 a toward the center of the endoscope image D and to a predetermined depth of the endoscope image D. Specifically, the controller 4 recognizes the surgical instrument 2 in the endoscope image D and calculates the three-dimensional position of the tip 2 a by using the endoscope image D.
  • the controller 4 then operates the joints 3 b such that the optical axis A of the endoscope 1 moves to the tip 2 a in a direction that crosses the optical axis A and the tip of the endoscope 1 moves to a position at a predetermined observation distance from the tip 2 a in the depth direction extending along the optical axis A.
  • the follow-up mode includes a first control mode in which the endoscope 1 is caused to follow the tip 2 a of the surgical instrument 2 at a first speed and a second control mode in which the endoscope 1 is caused to follow the tip 2 a of the surgical instrument 2 at a second speed lower than the first speed.
  • the controller 4 controls the moving device 3 in the first control mode when the tip 2 a is located outside a predetermined specific region B, and the controller 4 controls the moving device 3 in the second control mode when the tip 2 a is located in the specific region B.
  • sensitivity for following a movement of the tip 2 a by the endoscope 1 decreases, thereby suppressing excessive following motion of the endoscope 1 with respective to the tip 2 a .
  • the specific region B is a predetermined three-dimensional region that is set in a field of view F of the endoscope 1 and has dimensions in the X direction, the Y direction, and the Z direction that are orthogonal to one another.
  • the X direction is a depth direction parallel to the optical axis A of the endoscope 1 .
  • the Y direction and the Z direction are directions that are orthogonal to the optical axis A and are parallel respectively to the lateral direction and the longitudinal direction of the endoscope image D.
  • the specific region B and the endoscope image D are identical in shape in cross section.
  • the specific region B is also rectangular in cross section.
  • the specific region B displayed on the endoscope image D may interfere with an observation of the endoscope image D and thus is preferably hidden.
  • the surgeon easily recognizes the position of the hidden specific region B.
  • the field of view F of the endoscope 1 is typically shaped like a cone having the vertex at or near the tip of the endoscope 1 .
  • the specific region B is preferably a frustum with the vertex shared with the field of view F of the endoscope 1 . As illustrated in FIG. 5 , the size and position of the displayed specific region B are fixed on the endoscope image D regardless of positions X1, X2, and X 3 in the X direction.
  • the effect of suppressing excessive following motion of the endoscope 1 relative to a movement of the tip 2 a may become insufficient, leading to frequent movements of the field of view F.
  • the size of the specific region B is larger than 55% of the size of the endoscope image D, the tip 2 a is frequently disposed at a position remote from the center of the endoscope image D, leading to difficulty in placing the tip 2 a at the center.
  • the specific region B includes a non-following region B 1 and a following region B 2 .
  • the non-following region B 1 is a central region of the specific region B including the optical axis A.
  • the following region B 2 is an outer region of the specific region B and surrounds the non-following region B 1 .
  • the non-following region B 1 has a three-dimensional shape that decreases in size in cross section toward the tip of the endoscope 1 .
  • the non-following region B 1 is preferably a frustum.
  • the controller 4 keeps the position of the endoscope 1 without causing the endoscope 1 to follow the tip 2 a . Specifically, the controller 4 controls the angular velocities of the joints 3 b to zero. Thus, the second speed in the non-following region B 1 is zero.
  • the following region B 2 acts as a trigger for starting following of the tip 2 a by the endoscope 1
  • the non-following region B 1 acts as a trigger for terminating following of the tip 2 a by the endoscope 1 .
  • the tip 2 a moves from the following region B 2 to an outer region C
  • the endoscope 1 starts following the tip 2 a .
  • the tip 2 a enters the non-following region B 1 from the outer region C through the following region B 2 following of the tip 2 a by the endoscope 1 is terminated.
  • the first speed V 1 and the second speed V 2 are each kept constant, whereas the following speed of the endoscope 1 may be changed in two steps.
  • the first speed V 1 and the second speed V 2 may change according to a distance from the center of the endoscope image D to the tip 2 a .
  • the controller 4 may calculate distances from the optical axis A of the endoscope 1 to the tip 2 a in the Y direction and the Z direction and increase the speeds V 1 and V 2 according to the distances.
  • the following speeds V 1 and V 2 of the endoscope 1 may continuously decrease from the outer region C to the non-following region B 1 .
  • FIGS. 7 A to 7 D are explanatory drawings of a method for calculating the specific region B.
  • the controller 4 sets, as a fiducial point E, an intersection point of the optical axis A and a YZ plane P that passes through the tip 2 a of the surgical instrument 2 and is perpendicular to the optical axis A.
  • the controller 4 then defines, as the specific region B, a region like a rectangular solid or a sphere that is centered around the fiducial point E.
  • FIGS. 7 B and 7 C are explanatory drawings of a method for calculating an actual size [mm] of the specific region B.
  • an actual size L_dz[mm] of the specific region B in the Z direction is calculated from the following formula by using a pixel size[dx] of the specific region B in the Z direction.
  • An actual size L_dy[mm] of the specific region B in the Y direction is also calculated by the same method as L_dz.
  • an actual size L_dx of the specific region B in the X direction is also set.
  • the actual size L_dx may be set at a fixed value regardless of the observation distance di.
  • an actual size L_dx at a reference observation distance di e.g., d1
  • L_dx at another observation distance di e.g., d2
  • a surgeon performs a procedure by operating the surgical instrument 2 inserted into a body while observing the endoscope image D displayed on the display device 5 .
  • the surgeon switches from the manual mode to the follow-up mode or from the follow-up mode to the manual mode in response to, for example, a voice.
  • step S 1 when switching to the follow-up mode in step S 1 , the controller 4 performs the control method of steps S 2 to S 8 and controls the moving device 3 in the follow-up mode.
  • the control method includes step S 2 of determining whether the tip 2 a of the surgical instrument 2 is located in the specific region B and steps S 3 to S 8 of causing, when the position of the tip 2 a is located outside the specific region B, the endoscope 1 to follow the surgical instrument 2 until the tip 2 a of the surgical instrument 2 reaches the non-following region B 1 .
  • the controller 4 calculates the three-dimensional position of the tip 2 a by using the endoscope image D, which is a stereo image, and determines whether the tip 2 a is located in the predetermined specific region B (step S 2 ).
  • the controller 4 keeps the position of the endoscope 1 without causing the endoscope 1 to follow the surgical instrument 2 .
  • the controller 4 starts following of the surgical instrument 2 by the endoscope 1 (step S 3 ).
  • the controller 4 selects one of the first control mode and the second control mode on the basis of the position of the tip 2 a .
  • the tip 2 a is located outside the specific region B at the start of following (NO at step S 4 ) and thus the controller 4 controls the moving device 3 in the first control mode, so that the endoscope 1 is caused to follow the tip 2 a of the surgical instrument 2 at the first speed V 1 so as to move the tip 2 a of the surgical instrument 2 toward the center of the endoscope image D (step S 5 ).
  • the controller 4 controls the moving device 3 in the first control mode until the tip 2 a enters the specific region B.
  • the controller 4 controls the moving device 3 in the second control mode, so that the endoscope 1 is caused to follow the tip 2 a of the surgical instrument 2 at the second speed V 2 so as to move the tip 2 a of the surgical instrument 2 toward the center of the endoscope image D. Since the second speed V 2 is lower than the first speed V 1 , the responsivity for following a movement of the tip 2 a by the endoscope 1 decreases. In other words, after the tip 2 a returns to the specific region B from the outer region C, the endoscope 1 is prevented from excessively following a movement of the surgical instrument 2 . The controller 4 controls the moving device 3 in the second control mode until the tip 2 a enters the non-following region B 1 .
  • the controller 4 causes the endoscope 1 to finish following the surgical instrument 2 (step S 8 ).
  • step S 9 While the follow-up mode continues (NO at step S 9 ), the controller 4 repeats steps S 1 to S 8 .
  • the endoscope 1 To allow a surgeon to follow an object through the endoscope 1 with ease of operation, it is desirable to cause the endoscope 1 to follow the surgical instrument 2 so as to satisfy three conditions: suppressing excessive following motion, bringing the tip 2 a of the surgical instrument 2 at the center of the endoscope image D, and bringing the tip 2 a of the surgical instrument 2 at a proper distance in the X direction.
  • the specific region B is a three-dimensional region set in the field of view F and thus can be properly designed.
  • a distance between the tip of the endoscope 1 and the specific region B in the X direction and a size of the specific region B in cross section at each position in the X direction are designed to satisfy the three conditions. This allows the endoscope 1 to follow the surgical instrument 2 with ease of operation.
  • the specific region B is shaped to decrease in size in cross section toward the tip of the endoscope 1 , thereby suppressing a difference in the size of the displayed specific region B on the endoscope image D between positions in the X direction.
  • the specific region B is preferably displayed with a fixed size regardless of the position in the X direction. This can suppress excessive following motion of the endoscope 1 and place the tip 2 a at the center regardless of the position of the tip 2 a in the X direction.
  • FIG. 11 illustrates a specific region B′ as a reference example.
  • the specific region B′ is formed by simply extending a two-dimensional region on the image plane of the endoscope image D, the specific region B′ extends from the tip of the endoscope 1 in the X direction.
  • the endoscope 1 cannot be caused to follow the surgical instrument 2 such that the tip 2 a is brought at a proper distance in the X direction.
  • the size of the specific region B′ is fixed in cross section and thus the displayed specific region B′ on the endoscope image D changes in size according to the position in the X direction.
  • the displayed specific region B′ decreases in size at a position X 3 remote from the tip of the endoscope 1 in the X direction, so that excessive following motion of the endoscope 1 cannot be suppressed, though the tip 2 a can be placed at the center.
  • the size of the displayed specific region B′ increases at a position X1 close to the tip of the endoscope 1 in the X direction. This can suppress excessive following motion of the endoscope 1 but leads to difficulty in placing the tip 2 a at the center.
  • the controller 4 when the tip 2 a is located in the following region B 2 , the controller 4 continues the operation of the endoscope 1 in the previous control cycle.
  • the endoscope 1 may be caused to always follow the tip 2 a at the second speed V 2 larger than zero.
  • the controller 4 may control the moving device 3 in the second control mode in either of the following cases: where the tip 2 a enters the following region B 2 from the outer region C, and where the tip 2 a enters the following region B 2 from the non-following region B 1 .
  • the controller 4 determines whether the tip 2 a is located in the non-following region B 1 (step S 2 ′). When the tip 2 a moves from the non-following region B 1 into the following region B 2 (NO at step S 2 ′), the controller 4 starts following the surgical instrument 2 by the endoscope 1 (step S 3 ).
  • the tip 2 a is located in the following region B 2 at the start of following (YES at step S 4 and NO at step S 6 ) and thus the controller 4 controls the moving device 3 in the second control mode, so that the endoscope 1 is caused to follow the tip 2 a of the surgical instrument 2 at the second speed V 2 so as to move the tip 2 a of the surgical instrument 2 toward the center of the endoscope image D (step S 7 ).
  • the controller 4 controls the moving device 3 in the second control mode until the tip 2 a enters the non-following region B 1 .
  • the second speed V 2 is lower than the first speed V 1 , the endoscope 1 is prevented from excessively following a movement of the surgical instrument 2 while the tip 2 a moves in the following region B 2 .
  • the controller 4 switches from the second control mode to the first control mode (step S 5 ) and controls the moving device 3 in the first control mode until the tip 2 a returns to the specific region B.
  • the controller 4 may change the size of the specific region B in cross section according to the viewing angle ⁇ of the endoscope 1 .
  • a value of the viewing angle ⁇ is stored for each type of the endoscope 1 .
  • the controller 4 recognizes the type of the endoscope 1 held by the robot arm 3 a , reads the value of the viewing angle ⁇ of the recognized type from the storage unit 4 c , and sets the vertex angle ⁇ of the specific region B at a predetermined rate of the viewing angle ⁇ .
  • the vertex angle ⁇ is calculated by multiplying the value of the viewing angle ⁇ by a predetermined rate k selected from 25% to 55%.
  • the specific region B increases in size in cross section in proportion to the viewing angle ⁇ .
  • the area ratio of the cross section of the specific region B to the cross section of the field of view F is kept constant regardless of a difference in the viewing angle ⁇ of the used endoscope 1 .
  • the displayed specific region B on the endoscope image D displayed on the display device 5 can have the same size regardless of the viewing angle ⁇ of the endoscope 1 .
  • the specific region B includes the non-following region B 1 where the endoscope 1 is not caused to follow the surgical instrument 2 .
  • the non-following region B 1 may be absent in the specific region B.
  • the controller 4 causes the endoscope 1 to follow the surgical instrument 2 at the second speed V 2 until the tip 2 a of the surgical instrument 2 is located at the center of the endoscope image D.
  • the controller 4 causes the endoscope 1 to finish following the surgical instrument 2 .
  • the endoscope 1 finishes following the tip 2 a when the tip 2 a reaches the end of the following region B 2 remote from the center of the endoscope image D.
  • the endoscope 1 is caused to follow the tip 2 a until the tip 2 a reaches the center of the endoscope image D.
  • a procedure can be performed with the tip 2 a located at the center of the endoscope image D.
  • the second speed V 2 is preferably 50% or less of the first speed V 1 .
  • the second speed V 2 may remain constant or gradually decrease as the tip 2 a of the surgical instrument 2 moves close to the center of the endoscope image D. If the second speed V 2 is higher than 50% of the first speed V 1 , it is difficult to sufficiently obtain the effect of suppressing excessive following motion of the endoscope 1 .
  • the shape of the specific region B may be changed in cross section.
  • the cross-sectional shape can be selected from a rectangle, a circle, and an ellipse in FIGS. 4 A to 4 C , and parameters dy, dz, R, a, and b can be set to determine the size of each shape in cross section.
  • the selection of the shape and the setting of the parameters may be manual operations performed by the surgeon or automatic operations performed by the controller 4 .
  • the shape and size of the specific region B in cross section can be set according to, for example, the technique, the contents of the procedure, or the preferences of the surgeon.
  • the cross section is set as a vertically oriented ellipse in FIG. 4 C .
  • This can prevent the field of view F from excessively reacting to a longitudinal movement of the tip 2 a and vibrating in the longitudinal direction, thereby stopping the field of view F regardless of a longitudinal movement of the tip 2 a during the procedure.
  • the controller 4 may recognize the type of the surgical instrument 2 or a procedure and automatically change at least one of the shape of the specific region B, the sizes of the specific region B in the X, Y, and Z directions, and the position of the specific region B according to the type of the surgical instrument 2 or the procedure. Furthermore, the controller 4 may automatically change the first speed and the second speed according to the type of the surgical instrument 2 or the procedure. For example, the controller 4 recognizes the type of the surgical instrument 2 on the basis of the endoscope image D and recognizes the type of the procedure according to the type of the surgical instrument 2 .
  • the proper shape, size, and position of the specific region B change according to the type of the surgical instrument 2 or the procedure.
  • the shape, size, and position of the specific region B can be automatically set to be suitable for the type of the surgical instrument 2 and the procedure.
  • the specific region B having a larger size in the X direction is set to be located at a larger distance from the tip of the endoscope 1 .
  • a range of 90 mm to 190 mm from the tip of the endoscope 1 is set as the specific region B.
  • the specific region B is set to be located at a shorter distance from the tip of the endoscope 1 in order to perform an elaborate procedure. For example, a range of 60 mm to 90 mm from the tip of the endoscope 1 is set as the specific region B.
  • the size of the specific region B may be increased in cross section or the second speed may be reduced.
  • the controller 4 may learn a movement of the tip 2 a during a procedure and change the shape and size of the specific region B such that the motion range of the tip 2 a is included in the specific region B during the procedure.
  • a definite border may be absent between the specific region B and the outer region C.
  • the controller 4 may continuously change the following speed according to a distance from the center of the endoscope image D to the tip 2 a .
  • the controller 4 may calculate an angular velocity Vp of a rotation about the Y axis and an angular velocity Vy of a rotation about the Z axis according to the formula below, and rotate the robot arm 3 a at the calculated angular velocities Vp and Vy.
  • py is a distance from the center of the endoscope image D to the tip 2 a in the Y direction
  • pz is a distance from the center of the endoscope image D to the tip 2 a in the Z direction
  • Gy and Gz are predetermined coefficients of proportionality.
  • the endoscope 1 captures a three-dimensional stereo image as the endoscope image D.
  • a two-dimensional endoscope image D may be captured.
  • the position of the tip 2 a of the surgical instrument 2 in the X direction may be measured by another distance-measuring means, e.g., a distance sensor provided at the tip of the endoscope 1 .
  • an object to be followed by the endoscope 1 is the surgical instrument 2 but is not limited thereto.
  • the endoscope 1 may follow any object in the endoscope image D during a surgical operation.
  • an object may be a lesion, an organ, a blood vessel, a marker, a biomedical material such as gauze, or a medical instrument other than the surgical instrument 2 .
  • Endoscope 1 a Imaging portion 2 Surgical instrument (object) 3 Moving device 3 a Robot arm 3 b Joint 4 Controller 5 Display device 10 Medical system A Optical axis B Specific region (predetermined three-dimensional region) B 1 Non-following region (specific region) B 2 Following region (specific region) C Outer region D Endoscope image F Field of view ⁇ Viewing angle

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Optics & Photonics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Robotics (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Astronomy & Astrophysics (AREA)
  • Endoscopes (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)
US18/105,291 2020-09-10 2023-02-03 Medical system and control method Abandoned US20230180995A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/105,291 US20230180995A1 (en) 2020-09-10 2023-02-03 Medical system and control method

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063076408P 2020-09-10 2020-09-10
PCT/JP2021/027564 WO2022054428A1 (ja) 2020-09-10 2021-07-26 医療システムおよび制御方法
US18/105,291 US20230180995A1 (en) 2020-09-10 2023-02-03 Medical system and control method

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/027564 Continuation WO2022054428A1 (ja) 2020-09-10 2021-07-26 医療システムおよび制御方法

Publications (1)

Publication Number Publication Date
US20230180995A1 true US20230180995A1 (en) 2023-06-15

Family

ID=80629721

Family Applications (4)

Application Number Title Priority Date Filing Date
US18/105,291 Abandoned US20230180995A1 (en) 2020-09-10 2023-02-03 Medical system and control method
US18/105,300 Pending US20230180998A1 (en) 2020-09-10 2023-02-03 Endoscope system, controller, control method, and recording medium
US18/105,314 Pending US20230180996A1 (en) 2020-09-10 2023-02-03 Controller, endoscope system, control method, and control program
US18/105,305 Active 2043-02-14 US12702500B2 (en) 2020-09-10 2023-02-03 Controller, endoscope system, and control method

Family Applications After (3)

Application Number Title Priority Date Filing Date
US18/105,300 Pending US20230180998A1 (en) 2020-09-10 2023-02-03 Endoscope system, controller, control method, and recording medium
US18/105,314 Pending US20230180996A1 (en) 2020-09-10 2023-02-03 Controller, endoscope system, control method, and control program
US18/105,305 Active 2043-02-14 US12702500B2 (en) 2020-09-10 2023-02-03 Controller, endoscope system, and control method

Country Status (4)

Country Link
US (4) US20230180995A1 (cg-RX-API-DMAC7.html)
JP (3) JP7535587B2 (cg-RX-API-DMAC7.html)
CN (3) CN116171122A (cg-RX-API-DMAC7.html)
WO (4) WO2022054428A1 (cg-RX-API-DMAC7.html)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9204939B2 (en) * 2011-08-21 2015-12-08 M.S.T. Medical Surgery Technologies Ltd. Device and method for assisting laparoscopic surgery—rule based approach
WO2017028916A1 (en) * 2015-08-19 2017-02-23 Brainlab Ag Reference array holder
TWI782409B (zh) * 2020-03-09 2022-11-01 陳階曉 內視鏡影像校正系統及其方法
JP7637794B2 (ja) * 2021-11-30 2025-02-28 オリンパス株式会社 内視鏡システムおよび内視鏡システムの作動方法
US20230255442A1 (en) * 2022-02-11 2023-08-17 Canon U.S.A., Inc. Continuum robot apparatuses, methods, and storage mediums
JP7854499B2 (ja) * 2022-04-05 2026-05-01 オリンパス株式会社 内視鏡システム、内視鏡システムの作動方法および手技支援プログラム
JP7841090B2 (ja) * 2022-07-08 2026-04-06 オリンパス株式会社 内視鏡システム、制御方法および制御プログラム
CN115956859B (zh) * 2022-10-11 2026-04-14 中国医学科学院北京协和医院 内窥镜控制方法及手术机器人系统
WO2024157360A1 (ja) * 2023-01-24 2024-08-02 国立研究開発法人国立がん研究センター 内視鏡画像の処置具検出装置、内視鏡画像の処置具検出方法、及び内視鏡画像の処置具検出装置プログラム
US20240349985A1 (en) * 2023-04-24 2024-10-24 Karl Storz Se & Co. Kg Corrective adjustment of image parameters using artificial intelligence
CN118319430A (zh) * 2023-12-29 2024-07-12 北京智愈医疗科技有限公司 一种基于内窥镜的水刀运动轨迹的监测装置
WO2025163471A1 (en) * 2024-01-29 2025-08-07 Covidien Lp Hysteroscopic surgical systems for use with surgical robotic systems and surgical robotic systems incorporating the same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190000585A1 (en) * 2016-01-25 2019-01-03 Sony Corporation Medical safety control apparatus, medical safety control method, and medical support system
US20190365499A1 (en) * 2017-02-28 2019-12-05 Sony Corporation Medical arm system, control device, and control method

Family Cites Families (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2911894B2 (ja) * 1986-11-13 1999-06-23 オリンパス光学工業株式会社 内視鏡画像取込み方法および内視鏡装置
JP2797830B2 (ja) * 1992-03-31 1998-09-17 日本ビクター株式会社 ビデオカメラにおける被写体追尾方法
JP3236070B2 (ja) 1992-06-04 2001-12-04 オリンパス光学工業株式会社 スコープ保持装置およびスコープ装置
JP3348933B2 (ja) * 1993-03-19 2002-11-20 オリンパス光学工業株式会社 電子式内視鏡装置
JP2833425B2 (ja) * 1993-06-30 1998-12-09 日本ビクター株式会社 ビデオカメラにおける被写体追尾装置
JP3419869B2 (ja) * 1993-12-28 2003-06-23 オリンパス光学工業株式会社 医療器具
JPH0938030A (ja) * 1995-07-28 1997-02-10 Shimadzu Corp 内視鏡装置
JPH09266882A (ja) * 1996-04-02 1997-10-14 Olympus Optical Co Ltd 内視鏡装置
JP3889873B2 (ja) * 1998-02-24 2007-03-07 オリンパス株式会社 計測内視鏡装置
US6471637B1 (en) 1999-09-24 2002-10-29 Karl Storz Imaging, Inc. Image orientation for endoscopic video displays
US7037258B2 (en) 1999-09-24 2006-05-02 Karl Storz Imaging, Inc. Image orientation for endoscopic video displays
JP2001112704A (ja) * 1999-10-20 2001-04-24 Olympus Optical Co Ltd 内視鏡システム
DE19961971B4 (de) 1999-12-22 2009-10-22 Forschungszentrum Karlsruhe Gmbh Vorrichtung zum sicheren automatischen Nachführen eines Endoskops und Verfolgen eines Instruments
JP2003088532A (ja) * 2001-09-19 2003-03-25 Olympus Optical Co Ltd 手術装置
JP4331541B2 (ja) 2003-08-06 2009-09-16 オリンパス株式会社 内視鏡装置
US20050123179A1 (en) 2003-12-05 2005-06-09 Eastman Kodak Company Method and system for automatic axial rotation correction in vivo images
US7654997B2 (en) * 2004-04-21 2010-02-02 Acclarent, Inc. Devices, systems and methods for diagnosing and treating sinusitus and other disorders of the ears, nose and/or throat
JP4377745B2 (ja) * 2004-05-14 2009-12-02 オリンパス株式会社 電子内視鏡
JP4699040B2 (ja) * 2005-02-15 2011-06-08 パナソニック株式会社 自動追尾制御装置及び自動追尾制御方法、並びにプログラム、自動追尾システム
JP4785127B2 (ja) * 2005-12-08 2011-10-05 学校法人早稲田大学 内視鏡視野拡張システム、内視鏡視野拡張装置及び内視鏡視野拡張用プログラム
JP4980625B2 (ja) 2006-02-21 2012-07-18 富士フイルム株式会社 体腔内観察装置
US7841980B2 (en) 2006-05-11 2010-11-30 Olympus Medical Systems Corp. Treatment system, trocar, treatment method and calibration method
US20080108870A1 (en) * 2006-11-06 2008-05-08 Wiita Bruce E Apparatus and method for stabilizing an image from an endoscopic camera
JP5030639B2 (ja) * 2007-03-29 2012-09-19 オリンパスメディカルシステムズ株式会社 内視鏡装置の処置具位置制御装置
US8083669B2 (en) * 2007-06-22 2011-12-27 Olympus Medical Systems Corp. Medical device for maintaining state of treatment portion
JP5192898B2 (ja) * 2008-04-25 2013-05-08 オリンパスメディカルシステムズ株式会社 マニピュレータシステム
JP2010220794A (ja) * 2009-03-24 2010-10-07 Fujifilm Corp 内視鏡画像回転装置および方法並びにプログラム
WO2012078989A1 (en) * 2010-12-10 2012-06-14 Wayne State University Intelligent autonomous camera control for robotics with medical, military, and space applications
WO2012108085A1 (ja) * 2011-02-08 2012-08-16 オリンパスメディカルシステムズ株式会社 医療機器
US9204939B2 (en) 2011-08-21 2015-12-08 M.S.T. Medical Surgery Technologies Ltd. Device and method for assisting laparoscopic surgery—rule based approach
JP6021369B2 (ja) * 2012-03-21 2016-11-09 Hoya株式会社 内視鏡システム
TWI517828B (zh) * 2012-06-27 2016-01-21 國立交通大學 影像追蹤系統及其影像追蹤方法
EP2979610B1 (en) 2013-03-28 2019-06-19 Olympus Corporation Endoscope system
JP5788623B2 (ja) * 2013-07-12 2015-10-07 オリンパス株式会社 内視鏡システム
JP6218634B2 (ja) * 2014-02-20 2017-10-25 オリンパス株式会社 内視鏡システム及び内視鏡の作動方法
JP6257371B2 (ja) * 2014-02-21 2018-01-10 オリンパス株式会社 内視鏡システム及び内視鏡システムの作動方法
WO2015149040A1 (en) * 2014-03-28 2015-10-01 Dorin Panescu Quantitative three-dimensional imaging of surgical scenes
KR102387096B1 (ko) * 2014-03-28 2022-04-15 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 시계 내의 기기들의 정량적 3차원 시각화
EP3326510A4 (en) * 2015-07-23 2019-04-17 Olympus Corporation MANIPULATOR AND MEDICAL SYSTEM
WO2017082047A1 (ja) * 2015-11-13 2017-05-18 オリンパス株式会社 内視鏡システム
JP6150968B1 (ja) * 2016-02-10 2017-06-21 オリンパス株式会社 内視鏡システム
WO2017138105A1 (ja) * 2016-02-10 2017-08-17 オリンパス株式会社 マニピュレータシステム
CN107456278B (zh) * 2016-06-06 2021-03-05 北京理工大学 一种内窥镜手术导航方法和系统
JP2019165270A (ja) 2016-08-03 2019-09-26 シャープ株式会社 映像出力システム、映像出力方法および制御装置
CN109715073A (zh) 2016-09-15 2019-05-03 奥林巴斯株式会社 超声波内窥镜及超声波内窥镜系统
JP6965338B2 (ja) 2017-03-28 2021-11-10 ソニー・オリンパスメディカルソリューションズ株式会社 医療用観察装置、制御装置、及び観察視野補正方法
WO2018235255A1 (ja) * 2017-06-23 2018-12-27 オリンパス株式会社 医療システムとその作動方法
WO2019035206A1 (ja) * 2017-08-18 2019-02-21 オリンパス株式会社 医療システムおよび画像生成方法
US12262866B2 (en) * 2017-09-22 2025-04-01 Carl Zeiss Meditec Ag Visualization system comprising an observation apparatus and an endoscope
DE102017219621B4 (de) * 2017-09-22 2025-11-13 Carl Zeiss Meditec Ag Visualisierungssystem mit einem Beobachtungsgerät und einem Endoskop
WO2019116592A1 (ja) * 2017-12-14 2019-06-20 オリンパス株式会社 内視鏡の表示画像の調整装置及び手術システム
JP7151109B2 (ja) 2018-03-19 2022-10-12 ソニーグループ株式会社 医療用撮像装置及び医療用観察システム
WO2020070883A1 (ja) 2018-10-05 2020-04-09 オリンパス株式会社 内視鏡システム
BR112021016621A2 (pt) * 2019-02-21 2021-11-03 Theator Inc Sistemas e métodos para análise de vídeos cirúrgicos
JP2020151044A (ja) * 2019-03-18 2020-09-24 ソニー・オリンパスメディカルソリューションズ株式会社 医療用観察装置
JP7480477B2 (ja) * 2019-07-10 2024-05-10 ソニーグループ株式会社 医療用観察システム、制御装置及び制御方法
WO2021037381A1 (en) 2019-08-30 2021-03-04 Brainlab Ag Image based motion control correction
JP2021040987A (ja) * 2019-09-12 2021-03-18 ソニー株式会社 医療用支持アーム、及び医療用システム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190000585A1 (en) * 2016-01-25 2019-01-03 Sony Corporation Medical safety control apparatus, medical safety control method, and medical support system
US20190365499A1 (en) * 2017-02-28 2019-12-05 Sony Corporation Medical arm system, control device, and control method

Also Published As

Publication number Publication date
JP7534423B2 (ja) 2024-08-14
JPWO2022054884A1 (cg-RX-API-DMAC7.html) 2022-03-17
JPWO2022054882A1 (cg-RX-API-DMAC7.html) 2022-03-17
CN116018538B (zh) 2026-05-26
US20230172675A1 (en) 2023-06-08
US12702500B2 (en) 2026-08-11
CN115996662A (zh) 2023-04-21
US20230180996A1 (en) 2023-06-15
WO2022054428A1 (ja) 2022-03-17
WO2022054884A1 (ja) 2022-03-17
JP7535587B2 (ja) 2024-08-16
WO2022054882A1 (ja) 2022-03-17
JPWO2022054428A1 (cg-RX-API-DMAC7.html) 2022-03-17
CN116018538A (zh) 2023-04-25
JP7522840B2 (ja) 2024-07-25
WO2022054883A1 (ja) 2022-03-17
CN116171122A (zh) 2023-05-26
US20230180998A1 (en) 2023-06-15
CN115996662B (zh) 2025-11-18

Similar Documents

Publication Publication Date Title
JP7535587B2 (ja) 医療システムおよび医療システムの作動方法
US10638915B2 (en) System for moving first insertable instrument and second insertable instrument, controller, and computer-readable storage device
US11406460B2 (en) Surgery assisting apparatus, method of controlling the same, storage medium, and surgery assisting system
US12016522B2 (en) Medical safety control apparatus, medical safety control method, and medical support system
KR102363661B1 (ko) 원격동작 의료 시스템 내의 기구의 화면외 표시를 위한 시스템 및 방법
CN102791214B (zh) 采用实时速度优化的不经校准的视觉伺服
US10155315B2 (en) Medical system and method for controlling the same
JP6091410B2 (ja) 内視鏡装置の作動方法及び内視鏡システム
JP4460297B2 (ja) 方向可変のビューエンドスコープ用インターフェース
JP5384108B2 (ja) 遠隔操作システム
US5572999A (en) Robotic system for positioning a surgical instrument relative to a patient's body
JP4152402B2 (ja) 手術支援装置
CN115551432A (zh) 用于促进外科手术空间中的设备的自动操作的系统和方法
US20020151784A1 (en) Surgical microscope
US20200100649A1 (en) Medical system and operation method of medical system
US11540699B2 (en) Medical manipulator system
US11241144B2 (en) Medical system and operation method of medical system
US20220218427A1 (en) Medical tool control system, controller, and non-transitory computer readable storage
JP2013516264A5 (cg-RX-API-DMAC7.html)
US12383126B2 (en) Surgery system and control method for surgery system to adjust position and orientation of imager
KR20200107615A (ko) 초음파 영상 장치, 그 제어 방법, 및 컴퓨터 프로그램 제품
JP7854499B2 (ja) 内視鏡システム、内視鏡システムの作動方法および手技支援プログラム
US20250302273A1 (en) Medical system, control device, control method, and control program
CN114913234A (zh) 判断器械是否在内窥镜视野内的方法
US20220323157A1 (en) System and method related to registration for a medical procedure

Legal Events

Date Code Title Description
AS Assignment

Owner name: NATIONAL CANCER CENTER, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAKAYAMA, HIROYUKI;SASAI, RYOTA;YANAGIHARA, MASARU;AND OTHERS;SIGNING DATES FROM 20221222 TO 20230111;REEL/FRAME:062582/0949

Owner name: OLYMPUS CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAKAYAMA, HIROYUKI;SASAI, RYOTA;YANAGIHARA, MASARU;AND OTHERS;SIGNING DATES FROM 20221222 TO 20230111;REEL/FRAME:062582/0949

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION