US11465289B2 - Apparatus and method for controlling continuum robot, and computer-readable storage medium - Google Patents

Apparatus and method for controlling continuum robot, and computer-readable storage medium Download PDF

Info

Publication number
US11465289B2
US11465289B2 US16/924,805 US202016924805A US11465289B2 US 11465289 B2 US11465289 B2 US 11465289B2 US 202016924805 A US202016924805 A US 202016924805A US 11465289 B2 US11465289 B2 US 11465289B2
Authority
US
United States
Prior art keywords
continuum robot
wires
image information
continuum
torsional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US16/924,805
Other languages
English (en)
Other versions
US20200338743A1 (en
Inventor
Fumitaro Masaki
Kiyoshi Takagi
Yusuke Tanaka
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Assigned to CANON KABUSHIKI KAISHA reassignment CANON KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TAKAGI, KIYOSHI, TANAKA, YUSUKE, MASAKI, FUMITARO
Publication of US20200338743A1 publication Critical patent/US20200338743A1/en
Application granted granted Critical
Publication of US11465289B2 publication Critical patent/US11465289B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147—Holding or positioning arrangements
    • A61B1/00154—Holding or positioning arrangements using guiding arrangements for insertion
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00006—Operational features of endoscopes characterised by electronic signal processing of control signals
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00131—Accessories for endoscopes
    • A61B1/00135—Oversleeves mounted on the endoscope prior to insertion
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/005—Flexible endoscopes
    • A61B1/0051—Flexible endoscopes with controlled bending of insertion part
    • A61B1/0052—Constructional details of control elements, e.g. handles
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/005—Flexible endoscopes
    • A61B1/0051—Flexible endoscopes with controlled bending of insertion part
    • A61B1/0055—Constructional details of insertion parts, e.g. vertebral elements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/005—Flexible endoscopes
    • A61B1/009—Flexible endoscopes with bending or curvature detection of the insertion part
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70—Manipulators specially adapted for use in surgery
    • A61B34/71—Manipulators operated by drive cable mechanisms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J18/00—Arms
    • B25J18/06—Arms flexible
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02—Sensing devices
    • B25J19/021—Optical sensing devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/10—Programme-controlled manipulators characterised by positioning means for manipulator elements
    • B25J9/104—Programme-controlled manipulators characterised by positioning means for manipulator elements with cables, chains or ribbons
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1664—Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2065—Tracking using image or pattern recognition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B2034/305—Details of wrist mechanisms at distal ends of robotic arms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A61B2034/305—Details of wrist mechanisms at distal ends of robotic arms
    • A61B2034/306—Wrists with multiple vertebrae
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/06—Measuring instruments not otherwise provided for
    • A61B2090/064—Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension
    • A61B2090/066—Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension for measuring torque
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/06—Measuring instruments not otherwise provided for
    • A61B2090/067—Measuring instruments not otherwise provided for for measuring angles

Definitions

  • the present invention relates to a continuum-robot control apparatus, a method for controlling the same, and a computer-readable storage medium storing a program for causing a computer to function as the control apparatus.
  • Continuum robots are also called continuum robots, which include a curved portion having a flexible structure and whose shape is controlled by deforming the curved portion.
  • the continuum robots have mainly two advantages over rigid-link robots constituted by rigid links. First, continuum robots are movable along a curve in a narrow space in which a rigid-link robot would be caught or an environment in which scatters are present. Second, continuum robots have essential flexibility, and can be operated without damaging fragile objects. This does not necessarily need, for example, to detect an external force which is required by rigid-link robots.
  • NPL 1 describes a technique of a continuum robot including a curved portion that is curved by driving wires.
  • PTL 1 describes a control technique for making a continuum robot used as an endoscope intrude into a space. Specifically, PTL 1 describes a technique for controlling all of adjacent curved portion sets so that the curve of a curved portion in a forward section is formed into the curve shape of a curved portion in the following section as the base unit of the endoscope advances to thereby continuously propagate the curve shape.
  • the present invention has been made in consideration of such a problem. It is therefore an object of the present invention to provide a mechanism for suppressing a decrease in the accuracy of drive control of a continuum robot even if the continuum robot is twisted.
  • a control apparatus for a continuum robot is a control apparatus for a continuum robot including a curved portion that is curved by driving a wire using a driving mechanism.
  • the control apparatus includes an acquisition unit that obtains a torsional amount the continuum robot and a setting unit that sets a driving displacement amount of the wire driven by the driving mechanism based on the torsional amount obtained by the acquisition unit.
  • the present invention further includes a method for controlling a continuum robot using the continuum robot control apparatus described above, as well as a computer-readable storage medium storing a program for causing a computer to function as the continuum robot control apparatus.
  • FIG. 1 is a diagram illustrating, in outline, an example of the configuration of a continuum robot according to a first embodiment of the present invention.
  • FIG. 2 is a schematic diagram of the first embodiment of the present invention, illustrating the details of a base unit and a first curved portion of the continuum robot illustrated in FIG. 1
  • FIG. 3 is a schematic diagram of the first embodiment of the present invention, for defining the arrangement of the wires illustrated in FIG. 2 in an x-y plane.
  • FIG. 4 is a schematic diagram of the first embodiment of the present invention illustrating an example of the progress of the movement of the continuum robot illustrated in FIG. 1 .
  • FIG. 5 is a schematic diagram illustrating an example of the functional configuration of a control system for a continuum robot according to the first embodiment of the present invention, illustrating the flow of a signal when the continuum robot is moved in the forward direction.
  • FIG. 6 is a schematic diagram illustrating an example of the functional configuration of the continuum robot control system according to the first embodiment of the present invention, illustrating the flow of a signal when the continuum robot is moved in the rearward direction.
  • FIG. 7 is a schematic diagram of the first embodiment of the present invention, illustrating an example in which bronchial tubes are used as the insertion-extraction path illustrated in FIG. 1 .
  • FIG. 8A is a schematic diagram of the first embodiment of the present invention, illustrating an example of image information during forward movement and rearward movement obtained at the position illustrated in FIG. 7 .
  • FIG. 8B is a schematic diagram of the first embodiment of the present invention, illustrating an example of image information during forward movement and rearward movement obtained at the position illustrated in FIG. 7 .
  • FIG. 9 is a schematic diagram illustrating an example of one wire guide of a continuum robot according to a second embodiment of the present invention.
  • FIG. 10 is a diagram illustrating, in outline, an example of the configuration of the continuum robot according to the second embodiment of the present invention.
  • FIG. 11 is a schematic diagram illustrating an example of the functional configuration of a continuum robot control system 10 - 2 according to a fourth embodiment of the present invention.
  • Embodiments of the present invention will be described in detail hereinbelow with reference to the drawings.
  • Embodiments of the present invention illustrate examples in which a control system for a continuum robot (also referred to as a continuum manipulator) is used for a flexible endoscope.
  • the flexible endoscope used as an example of the continuum robot control system according to the embodiments of the present invention is used not only for a medical field but also for any other fields for observing the inside of a path in and out of which a curved portion is inserted and extracted (hereinafter referred to as “insertion-extraction path”) (for example, industrial endoscopes for observing the inside of a pipe or the like).
  • FIG. 1 is a diagram illustrating, in outline, an example of the configuration of a continuum robot 100 - 1 according to the first embodiment of the present invention.
  • the continuum robot 100 - 1 includes a base unit 110 ( FIG. 1 illustrates only a casing including an upper surface 114 of the base unit 110 ), a first curved portion 120 , a second curved portion 130 , and a third curved portion 140 .
  • the continuum robot 100 - 1 illustrated in FIG. 1 includes a plurality of curved portions 120 to 140 in series in the direction of the long axis and is movable in the direction of the long axis of the plurality of curved portions 120 to 140 .
  • FIG. 1 illustrates a continuum robot including three curved portions
  • the present embodiment is not limited to this configuration.
  • a continuum robot including two curved portions and a continuum robot including four or more curved portions can also be used in the present embodiment.
  • the first curved portion 120 includes a plurality of wires 101 - 1 to 103 - 1 extending through an upper surface 114 of the base unit 110 corresponding to the reference plane of the first curved portion 120 , a first wire guide 121 in which the plurality of wires 101 - 1 to 103 - 1 are fixed at different positions and which guides the plurality of wires 101 - 1 to 103 - 1 , and second wire guides 122 to 125 which are disposed between the upper surface 114 of the base unit 110 and the first wire guide 121 , in which the predetermined wire 101 - 1 of the plurality of wires 101 - 1 to 103 - 1 is fixed at a predetermined position, and which guides the plurality of wires 101 - 1 to 103 - 1 . As illustrated in FIG. 1 , the plurality of wires 101 - 1 to 103 - 1 are not fixed to the upper surface 114 of the base unit 110 .
  • the continuum robot 100 - 1 illustrated in FIG. 1 is configured such that the first curved portion 120 can be curved into a desired curved shape (for example, a circular arc) by driving at least part (or all) of the plurality of wires 101 - 1 to 103 - 1 .
  • a desired curved shape for example, a circular arc
  • the end remote from the upper surface 114 of the base unit 110 is referred to as “distal end”, and the end adjacent to the upper surface 114 of the base unit 110 is referred to as “proximal end”.
  • the first curved portion 120 is from the upper surface 114 of the base unit 110 (strictly, the upper surface 114 itself is not included) to the distal end of the first wire guide 121 .
  • the wires 101 - 1 to 103 - 1 are fixed to different positions at the distal end of the first wire guide 121 .
  • the wire 101 - 1 is fixed to the respective proximal ends of the second wire guides 122 to 125 .
  • the second curved portion 130 includes a plurality of wires 101 - 2 to 103 - 2 extending through the distal surface of the first wire guide 121 of the first curved portion 120 corresponding to the reference plane of the second curved portion 130 , a first wire guide 131 in which the plurality of wires 101 - 2 to 103 - 2 are fixed at different positions and which guides the plurality of wires 101 - 2 to 103 - 2 , and second wire guides 132 to 135 which are disposed between the distal surface of the first wire guide 121 of the first curved portion 120 and the first wire guide 131 , in which the predetermined wire 101 - 2 of the plurality of wires 101 - 2 to 103 - 2 is fixed to a predetermined position, and which guides the plurality of wires 101 - 2 to 103 - 2 .
  • the plurality of wires 101 - 2 to 103 - 2 are not fixed to the upper surface 114 of the base unit 110 .
  • the continuum robot 100 - 1 illustrated in FIG. 1 is configured such that the second curved portion 130 can be curved into a desired curved shape (for example, a circular arc) by driving at least part (or all) of the plurality of wires 101 - 2 to 103 - 2 .
  • a desired curved shape for example, a circular arc
  • the second curved portion 130 is from the distal surface of the first wire guide 121 of the first curved portion 120 (strictly, the distal surface itself is not included) to the distal end of the first wire guide 131 .
  • the wires 101 - 2 to 103 - 2 are fixed to different positions at the distal end of the first wire guide 131 .
  • the wire 101 - 2 is fixed to the respective proximal ends of the second wire guides 132 to 135 .
  • the third curved portion 140 includes a plurality of wires 101 - 3 to 103 - 3 extending through the distal surface of the first wire guide 131 of the second curved portion 130 corresponding to the reference plane of the third curved portion 140 , a first wire guide 141 in which the plurality of wires 101 - 3 to 103 - 3 are fixed at different positions and which guides the plurality of wires 101 - 3 to 103 - 3 , and second wire guides 142 to 145 which are disposed between the distal surface of the first wire guide 131 of the second curved portion 130 and the first wire guide 141 , in which the predetermined wire 101 - 3 of the plurality of wires 101 - 3 to 103 - 3 is fixed to a predetermined position, and which guides the plurality of wires 101 - 3 to 103 - 3 .
  • the plurality of wires 101 - 3 to 103 - 3 are not fixed to the upper surface 114 of the base unit 110 .
  • the continuum robot 100 - 1 illustrated in FIG. 1 is configured such that the third curved portion 140 can be curved into a desired curved shape (for example, a circular arc) by driving at least part (or all) of the plurality of wires 101 - 3 to 103 - 3 .
  • a desired curved shape for example, a circular arc
  • the third curved portion 140 is from the distal surface of the first wire guide 131 of the second curved portion 130 (strictly, the distal surface itself is not included) to the distal end of the first wire guide 141 .
  • the wires 101 - 3 to 103 - 3 are fixed to different positions at the distal end of the first wire guide 141 .
  • the wire 101 - 3 is fixed to the respective proximal ends of the second wire guides 142 to 145 .
  • FIG. 1 illustrates the center of the upper surface 114 of the base unit 110 as an origin O, as well as the x-axis and the y-axis passing through the origin O in the surface and perpendicular to each other.
  • FIG. 1 also illustrates the z-axis perpendicular to the upper surface 114 of the base unit 110 .
  • FIG. 1 also illustrates the central axis 150 of the continuum robot 100 - 1 and a position 160 at which an imaging apparatus (an imaging apparatus 310 illustrated in FIGS. 5 and 6 , for example) to be mounted to the continuum robot 100 - 1 .
  • an imaging apparatus an imaging apparatus 310 illustrated in FIGS. 5 and 6 , for example
  • FIG. 1 illustrates an example in which a plurality of wire guides arranged discretely are disposed, a bellows or mesh continuum wire guide may be disposed.
  • FIG. 2 is a schematic diagram of the first embodiment of the present invention, illustrating the details of the base unit 110 and the first curved portion 120 of the continuum robot 100 - 1 illustrated in FIG. 1 .
  • the same components as the components illustrated in FIG. 1 are given the same reference signs and detailed descriptions will be omitted.
  • the wire 101 - 1 is fixed to a position 1211
  • the wire 102 - 1 is fixed to a position 1212
  • the wire 103 - 1 is fixed to a position 1213 .
  • the positions 1211 to 1213 are different positions at the distal end of the first wire guide 121 , as described above.
  • the second wire guide 122 is fitted with the wire 101 - 1 at a position 1221 .
  • the second wire guide 123 is fitted with the wire 101 - 1 at a position 1231 .
  • the second wire guide 124 is fitted with the wire 101 - 1 at a position 1241 .
  • the second wire guide 125 is fitted with the wire 101 - 1 at a position 1251 .
  • the positions 1221 to 1251 are respective proximal end positions of the second wire guides 122 to 125 , as described above.
  • the base unit 110 has therein an actuator 111 for pushing and pulling the wire 101 - 1 , an actuator 112 for pushing and pulling the wire 102 - 1 , and an actuator 113 for pushing and pulling the wire 103 - 1 .
  • the continuum robot 100 - 1 illustrated in FIG. 1 is configured to curve the first curved portion 120 into a desired curved shape by controlling the actuators 111 to 113 to drive the wires 101 - 1 to 103 - 3 , respectively.
  • the orientation of the continuum robot 100 - 1 (the first curved portion 120 ) is controlled in this manner.
  • the actuators 111 to 113 constitute a driving mechanism in the present invention.
  • FIG. 2 the central axis 150 of the continuum robot 100 - 1 (more specifically, the first curved portion 120 in the example illustrated in FIG. 2 ) is indicated by the broken line, as in FIG. 1 .
  • FIG. 2 illustrates the x-axis, the y-axis, and the z-axis, as in FIG. 1 .
  • FIG. 2 illustrates the driving displacement amount l p1a of the wire 101 - 1 driven by the actuator 111 , the driving displacement amount l p1b of the wire 102 - 1 driven by the actuator 112 , and the driving displacement amount l p1c of the wire 103 - 1 driven by the actuator 113 .
  • FIG. 1 illustrates the driving displacement amount l p1a of the wire 101 - 1 driven by the actuator 111 , the driving displacement amount l p1b of the wire 102 - 1 driven by the actuator 112 , and the driving displacement amount l p1c of the wire 103 - 1 driven by the actuator
  • FIG. 2 also illustrates a position 1214 through which the central axis 150 passes at the distal end of the first wire guide 121 .
  • FIG. 2 also illustrates an angle formed by the central axis 150 and a line segment parallel to the z-axis at the position 1214 as the curve angle ⁇ 1 of the first curved portion 120 .
  • FIG. 2 also illustrates a w-axis, which is a projection of the central axis 150 on an x-y plane, and a position 12141 , which is a projection of the position 1214 on the x-y plane.
  • FIG. 2 also illustrates an angle formed by the x-axis and the w-axis as the rotational angle ⁇ 1 of the first curved portion 120 .
  • FIG. 2 also illustrates the curvature radius ⁇ 1 of the first curved portion 120 about the central axis 150 .
  • the curved portion to be driven is generalized as the n-th curved portion (n is any positive number), and the following elements are defined for the n-th curved portion.
  • the example illustrated in FIG. 1 may use a configuration in which the base unit 110 has therein an actuator (not illustrated) for pushing and pulling the wires 101 - 2 to 103 - 2 of the second curved portion 130 and an actuator (not illustrated) for pushing and pulling the wires 101 - 3 to 103 - 3 of the third curved portion 140 , like the actuators 111 to 113 for pushing and pulling the wires 101 - 1 to 103 - 1 of the first curved portion 120 illustrated in FIG. 2 .
  • FIG. 3 is a schematic diagram of the first embodiment of the present invention, for defining the arrangement of the wires 101 to 103 illustrated in FIG. 2 in an x-y plane.
  • the wires 101 to 103 are arranged at the vertices of an equilateral triangle with a piece length of r s .
  • the kinematic model of the continuum robot is derived on the basis of the following assumption.
  • the wires are deformed at a constant curvature at a curved portion (at individual curved portions if there are multiple curved portions).
  • the relationship between the driving displacement amount l p1a , the driving displacement amount l p1b of the wire 102 - 1 , and the driving displacement amount l p1c of the wire 103 - 1 of the wire 101 - 1 of the first curved portion 120 illustrated in FIG. 2 and the curve angle ⁇ 1 and the rotational angle ⁇ 1 of the first curved portion 120 are respectively expressed as Eq. (1-1), Eq. (1-2), and Eq. (1-3).
  • the continuum robot 100 - 1 illustrated in FIG. 1 is used for a bronchoscope.
  • an imaging apparatus is fixed to the position 160 of the continuum robot 100 - 1 illustrated in FIG. 1 for use as a bronchoscope for observing the inside of a bronchial tube, which is the insertion-extraction path 20 .
  • a continuum robot control system calculates the driving displacement amounts l pna , l pnb , and l pnc on the basis of image information obtained by the imaging apparatus while moving the continuum robot 100 - 1 into the inside of the bronchial tubes by moving the base unit 110 and controls the orientation of the continuum robot 100 - 1 .
  • FIG. 4 is a schematic diagram of the first embodiment of the present invention illustrating an example of the progress of the movement of the continuum robot 100 - 1 illustrated in FIG. 1 .
  • FIG. 4 illustrated the z direction (a predetermined direction of the continuum robot 100 - 1 ) illustrated in FIGS. 1 and 2 .
  • the base unit 110 is disposed on a linear stage extending in the z direction, for example.
  • the manipulator can manually move the continuum robot 100 - 1 along the linear stage.
  • the linear stage may include an actuator, such as a motor, so as to move the base unit 110 along the linear stage.
  • the linear stage may include a sensor for detecting coordinate information in the z direction (corresponding to a detection apparatus 320 illustrated in FIGS. 5 and 6 ).
  • time 401 indicates an initial state in which the first curved portion 120 to the third curved portion 140 extending from the upper surface 114 of the base unit 110 in the z direction are not curved. Thereafter, in FIG. 4 , the base unit 110 moves in the z direction, and the first curved portion 120 to the third curved portion 140 are curved with the passage of time, from time 402 , time 403 , time 404 , to time 405 .
  • the coordinate information in the z direction on the upper surface 114 of the base unit 110 illustrated in FIG. 4 is denoted by z b in FIG. 1 . Since the curve angle ⁇ n and the rotational angle ⁇ n of the n-th curved portion depend on the coordinate information z b indicating the position of the base unit 110 , they can be expressed as ⁇ n (z b ) and ⁇ n (z b ), respectively.
  • the driving displacement amounts l pna , l pnb , and l pnc of the wires 101 - n to 103 - n also depend on the coordinate information z b and can be expressed as l pna (z b ), l pnb (z b ), and l pnc (z b ), respectively.
  • FIG. 5 is a schematic diagram illustrating an example of the functional configuration of a control system 10 - 1 for a continuum robot according to the first embodiment of the present invention, illustrating the flow of a signal when the continuum robot 100 is moved in the forward direction.
  • the continuum-robot control system 10 - 1 includes a continuum robot 100 , a continuum-robot control apparatus 200 , an imaging apparatus 310 , a detection apparatus 320 , an input unit 330 , and a display unit 340 .
  • the continuum robot 100 illustrated in FIG. 5 is an application of the continuum robot 100 - 1 illustrated in FIG. 1 .
  • the present invention may employ a continuum robot 100 - 2 illustrated in FIG. 10 .
  • the continuum-robot control apparatus 200 includes an image DB/torsional-amount acquisition unit 210 , a storage unit 220 , and a kinematic operation unit 230 .
  • the components of the continuum-robot control apparatus 200 will be described later.
  • the imaging apparatus 310 is mounted on the continuum robot 100 - 1 at the position 160 in FIG. 1 and images an area in the direction of movement of the continuum robot 100 - 1 to generate image information on the inside of the insertion-extraction path 20 , for example.
  • the detection apparatus 320 detects the coordinate information z b in the z direction on the upper surface 114 of the base unit 110 , as described with reference to FIG. 4 , and outputs the detected coordinate information z b to the continuum-robot control apparatus 200 .
  • the detection apparatus 320 detects coordinate information z b for each of time 401 to time 405 and outputs the coordinate information z b to the continuum-robot control apparatus 200 .
  • the input unit 330 is a device for the manipulator, such as an operator, to input an operation and includes, for example, a keyboard and a mouse.
  • the display unit 340 displays a variety of information under the control of the continuum-robot control apparatus 200 .
  • the display unit 340 displays image information generated by the imaging apparatus 310 , input information input from the input unit 330 , coordinate information z b detected by the detection apparatus, and information obtained by processing performed by the continuum-robot control apparatus 200 .
  • the image DB/torsional-amount acquisition unit 210 includes an image database (image DB) that stores the image information obtained by the imaging apparatus 310 and a torsional-amount acquisition unit that obtains the torsional amount of the continuum robot 100 - 1 on the basis of the image information.
  • image DB image database
  • a torsional-amount acquisition unit that obtains the torsional amount of the continuum robot 100 - 1 on the basis of the image information.
  • the image DB/torsional-amount acquisition unit 210 obtains the torsional amount of the continuum robot 100 - 1 on the basis of the image information obtained by the imaging apparatus 310 and the coordinate information z b on the continuum robot 100 - 1 in the z direction (a predetermined direction) detected by the detection apparatus 320 .
  • the storage unit 220 stores the image information obtained by the imaging apparatus 310 and stored in the image DB/torsional-amount acquisition unit 210 and the coordinate information z b detected by the detection apparatus 320 in association with each other.
  • the storage unit 220 can also store information on the curve angle ⁇ n and the rotational angle ⁇ n input from the input unit 330 in association with each other.
  • the kinematic operation unit 230 performs processing for setting the respective driving displacement amounts l pna , l pnb , and l pnc of the wires 101 to 103 driven by the actuators 111 to 113 serving as a driving mechanism.
  • the kinematic operation unit 230 controls the driving of the continuum robot 100 - 1 on the basis of the set driving displacement amounts l pna , l pnb , and l pnc .
  • the curve angle ⁇ n (z b ), the rotational angle ⁇ n (z b ), and the driving displacement amounts l pna (z b ), l pnb (z b ), and l pnc (z b ) at the plurality of positions of the insertion-extraction path 20 are stored in the storage unit 220 .
  • the image information obtained by the imaging apparatus 310 and the coordinate information z b detected by the detection apparatus 320 are stored in the image DB/torsional-amount acquisition unit 210 and the storage unit 220 in association with each other.
  • FIG. 6 is a schematic diagram illustrating an example of the functional configuration of the control system 10 - 1 for a continuum robot according to the first embodiment of the present invention, illustrating the flow of a signal when the continuum robot 100 is moved in the rearward direction.
  • the same components as those in FIG. 5 are given the same reference signs.
  • the continuum robot 100 illustrated in FIG. 6 is an application of the continuum robot 100 - 1 illustrated in FIG. 1 , as in FIG. 5 described above.
  • the present invention may employ the continuum robot 100 - 2 illustrated in FIG. 10 .
  • the imaging apparatus 310 of the present embodiment is configured to image an area in the forward direction of the continuum robot 100 - 1 . F or that reason, when the continuum robot 100 - 1 is moved in the rearward direction, the imaging apparatus 310 cannot obtain image information on an area in the rearward direction. Therefore, in the present embodiment, the driving displacement amounts l pna , l pnb , and l pnc are set using information that is stored in the storage unit 220 when the continuum robot 100 - 1 in FIG. 5 is moved forward, and the driving of the continuum robot 100 - 1 is controlled.
  • the image information obtained by the imaging apparatus 310 and the coordinate information z b detected by the detection apparatus 320 are stored in the image DB/torsional-amount acquisition unit 210 and the storage unit 220 in association with each other.
  • the image DB/torsional-amount acquisition unit 210 obtains the torsional amount ⁇ of the continuum robot 100 - 1 from the amount of rotation of the image using image information at forward movement and rearward movement obtained at the same position (including substantially the same position) of the insertion-extraction path 20 on the basis of the coordinate information z b .
  • the image DB/torsional-amount acquisition unit 210 obtains the torsional amount ⁇ at each position of the insertion-extraction path 20 using, of the image information stored in the storage unit 220 , image information stored in association with the coordinate information z b on each position.
  • the kinematic operation unit 230 When the continuum robot 100 - 1 illustrated in FIG. 6 is moved rearward, the kinematic operation unit 230 performs processing for setting the respective driving displacement amounts l pna , l pnb , and l pnc of the wires 101 to 103 on the basis of the torsional amount ⁇ obtained by the image DB/torsional-amount acquisition unit 210 .
  • the kinematic operation unit 230 that performs this processing serves as a setting unit in the present invention.
  • the kinematic operation unit 230 controls the driving of the continuum robot 100 - 1 on the basis of the set driving displacement amounts l pna , l pnb , and l pnc .
  • FIG. 7 is a schematic diagram of the first embodiment of the present invention, illustrating an example in which bronchial tubes 700 are used as the insertion-extraction path 20 in FIG. 1 .
  • the image DB/torsional-amount acquisition unit 210 first obtains image information at individual positions when the imaging apparatus 310 is moved forward to the position 721 . Likewise, the image DB/torsional-amount acquisition unit 210 obtains image information at individual positions when the imaging apparatus 310 is moved rearward from the position 721 .
  • the image DB/torsional-amount acquisition unit 210 obtains the torsional amount ⁇ of the continuum robot 100 - 1 from the amount of rotation of the images on the basis of the coordinate information z b using, for example, image information at forward movement and rearward movement obtained at a position 711 of the left upper lobe bronchi 710 of the bronchial tubes 700 .
  • the image DB/torsional-amount acquisition unit 210 obtains the torsional amount ⁇ at individual positions of the insertion-extraction path 20 using, of the image information stored in the storage unit 220 , image information stored in association with the coordinate information z b at the individual positions.
  • an example of the position used in comparing image information obtained during forward movement and during rearward movement is the position 711 at which the divergence of the left upper lobe bronchi 710 and the left lower lobe bronchi 720 of the bronchial tubes 700 can be observed.
  • this is not intended to limit the present embodiment.
  • FIG. 8 is a schematic diagram of the first embodiment of the present invention, illustrating an example of the image information during forward movement and rearward movement obtained at the position 711 illustrated in FIG. 7 .
  • FIG. 8 illustrates an example of images displayed on the display unit 340 on the basis of the image information obtained during forward movement and rearward movement. More specifically, FIG. 8A illustrates an image 810 during forward movement displayed on the display unit 340 on the basis of image information obtained during forward movement, FIG. 8B illustrates an image 820 obtained during rearward movement displayed on the display unit 340 on the basis of image information obtained during rearward movement.
  • the image 810 obtained during forward movement illustrated in FIG. 8A includes a path area 811 of the left upper lobe bronchi 710 in FIG. 7 and a path area 812 of the left lower lobe bronchi 720 in FIG. 7 .
  • the image 820 obtained during rearward movement illustrated in FIG. 8B includes a path area 821 of the left upper lobe bronchi 710 in FIG. 7 and a path area 822 of the left lower lobe bronchi 720 in FIG. 7 .
  • the image DB/torsional-amount acquisition unit 210 obtains the torsional amount ⁇ by comparing the image 810 obtained during forward movement illustrated in FIG. 8A and the image 820 obtained during rearward movement illustrated in FIG. 8B .
  • the image DB/torsional-amount acquisition unit 210 obtains the torsional amount ⁇ by extracting the outlines of the path area 811 and the path area 812 from the image 810 obtained during forward movement and the outlines of the path area 821 and the path area 822 from the image 820 obtained during rearward movement and comparing the inclination of a straight line 813 connecting the center of the outlines of the path area 811 and the path area 812 and the inclination of a straight line 823 connecting the center of the outlines of the path area 821 and the path area 822 to each other.
  • the image DB/torsional-amount acquisition unit 210 obtains the torsional amount ⁇ on the basis of the image information and structural information on the insertion-extraction path 20 into which the continuum robot 100 - 1 is inserted.
  • the image obtained during rearward movement is twisted at an amount of about 20° with respect to the image obtained during forward movement.
  • such comparison of images is performed at a plurality of characteristic positions.
  • Eq. (2-1), Eq. (2-2), and Eq. (2-3) described above can be rewritten to Eq. (3-1), Eq. (3-2), and Eq. (3-3), respectively, as follows, where ⁇ n is the torsional amount ⁇ of the n-th curved portion.
  • the kinematic operation unit 230 sets the driving displacement amounts l pna (z b ), l pnb (z b ), and l pnc (z b ) given by Eq. (3-1), Eq. (3-2), and Eq. (3-3), for example. Specifically, the kinematic operation unit 230 sets the driving displacement amounts described above on the basis of the torsional amount ⁇ n , the curve angle ⁇ n , and the rotational angle ⁇ n . The kinematic operation unit 230 controls the driving of the continuum robot 100 - 1 using the set driving displacement amounts.
  • the torsional amount ⁇ e can be obtained from the images during forward movement and during rearward movement captured by the imaging apparatus 310 .
  • the torsional amount ⁇ n may change continuously as expressed as Eq. (5) using the length of each curved portion, l n , and the entire length of the curved portions,
  • the torsional amount ⁇ n of each curved portion may be multiplied by an appropriate correction coefficient.
  • monitoring the breathing and comparing only images captured at a specific timing of the breathing allows increasing the estimation accuracy of the rotation amount of the images. This can be achieved, for example, by the imaging apparatus 310 obtaining moving images at individual positions and by the image DB/torsional-amount acquisition unit 210 comparing images with the same degree of deformation of the lumen (insertion-extraction path 20 ) due to breathing during forward movement and during rearward movement.
  • the curve angle ⁇ n and the rotational angle ⁇ n of the continuum robot 100 - 1 are controlled by displacing all of the three wires 101 to 103 .
  • this is not intended to limit the present invention.
  • a configuration in which the curve angle ⁇ n and the rotational angle ⁇ n of the continuum robot 100 - 1 are controlled by fixing one of the three wires 101 to 103 and displacing the other two wires can provide the same advantageous effects and can be employed in the present invention.
  • the kinematic operation unit 230 can set the driving displacement amounts l pna , l pnb , and l pnc expressed as Eq. (6-1), Eq. (6-2), and Eq. (6-3), respectively.
  • l pna 0 (6-1)
  • l pnb cos( ⁇ /6+ ⁇ n ⁇ n ) r s ⁇ n (6-2)
  • l pnc cos( ⁇ /6 ⁇ n + ⁇ n ) r s ⁇ n (6-3)
  • the kinematic operation unit 230 can also set driving displacement amounts l pna , l pnb , and l pnc after the torsional amount ⁇ n is obtained, as in Eq. (7-1), Eq. (7-2), Eq. (7-3), respectively.
  • l pna 0 (7-1)
  • l pnb cos( ⁇ /6+ ⁇ n ⁇ ( ⁇ n ⁇ n )) r s ⁇ n (7-2)
  • l pnc cos( ⁇ /6 ⁇ n +( ⁇ n ⁇ n ) r s ⁇ n (7-3)
  • the image DB/torsional-amount acquisition unit 210 obtains the torsional amount ⁇ of the continuum robot 100 - 1 , and the kinematic operation unit 230 sets the driving displacement amounts of the wires on the basis of the torsional amount.
  • This configuration allows suppressing a decrease in the accuracy of drive control of the continuum robot even if the continuum robot is twisted. This allows the continuum robot to be smoothly moved rearward even if the continuum robot has no rearward view. Furthermore, the driving displacement amounts of the wires can be corrected according to the torsional amount. This allows the continuum robot to be controlled to a desired orientation even if the continuum robot is twisted.
  • the continuum robot 100 is used not only for observing the inside of bronchial tubes but also as a guide sheath through which a biopsy tool, such as forceps and a suction needle, is passed.
  • FIG. 9 is a schematic diagram illustrating an example of one wire guide 900 of the continuum robot 100 according to the second embodiment of the present invention.
  • FIG. 9 illustrates the x-axis, the y-axis, and the z-axis, as in FIG. 1 .
  • the wire guide 900 has a doughnut shape, as illustrated in FIG. 9 .
  • the wire guide 900 has a through-hole 910 in which the wire 101 is fixed, a through-hole 920 in which the wire 102 is passed or fixed, a through-hole 930 in which the wire 103 is passed or fixed, and marks 940 .
  • FIG. 10 is a diagram illustrating, in outline, an example of the configuration of a continuum robot 100 - 2 according to the second embodiment of the present invention.
  • FIG. 10 illustrates the x-axis, the y-axis, and the z-axis, as in FIG. 1 .
  • the continuum robot 100 - 2 includes a curved portion 1010 and a sleeve 1020 disposed between the curved portion 1010 and a base unit (not illustrated, for example the base unit 110 illustrated in FIG. 2 ).
  • the curved portion 1010 includes the wire guide 900 illustrated in FIG. 9 at multiple (ten) positions in the z direction. Specifically, the curved portion 1010 includes wire guides 900 - 1 to 900 - 10 .
  • the continuum robot 100 - 2 illustrated in FIG. 10 may be equipped with the imaging apparatus 310 at the position 160 .
  • the position 160 at which the imaging apparatus 310 is disposed may not be between the wire guide 900 - 1 and the wire guide 900 - 10 .
  • the imaging apparatus 310 disposed at the position 160 images an area in the forward direction of the continuum robot 100 - 2 (z direction) to generate image information.
  • the wires 101 , 102 , and 103 are fixed in the through-holes 910 , 920 , and 930 , respectively.
  • the wire 101 is fixed in the through-hole 910 , and the other through-holes 920 and 930 allow the wires 102 and 103 to pass through.
  • the sleeve 1020 allows the wires 101 to 103 to pass through without fixing them.
  • the continuum robot 100 - 2 illustrated in FIG. 10 allows a biopsy tool to pass through.
  • the continuum robot 100 - 2 moves forward while observing an area in front of the continuum robot 100 - 2 in the insertion-extraction path 20 using the imaging apparatus (a fiber scope camera) 310 disposed in the wire guide.
  • the imaging apparatus a fiber scope camera
  • the continuum robot 100 - 2 is moved forward, and at the point in time where it reaches the tumor for biopsy, the manipulator, such as an operator, extracts the imaging apparatus 310 from the continuum robot 100 - 2 and inserts the biopsy tool into the continuum robot 100 - 2 . After obtaining a sample with the biopsy tool, the manipulator extracts the biopsy tool, inserts and disposes the imaging apparatus 310 into the continuum robot 100 - 2 again, and moves the continuum robot 100 - 2 rearward.
  • the imaging apparatus 310 is not fixed in the continuum robot 100 - 2 .
  • the manipulator When inserting the imaging apparatus (fiberscope camera) 310 , the manipulator, such as an operator, determines the position of the imaging apparatus 310 in the z direction so that the marks 940 of the wire guide 900 - 1 at the most distal end of the continuum robot 100 - 2 always fall within the imagable range of the imaging apparatus 310 .
  • the imaging apparatus 310 has a configuration for imaging an area including the marks 940 of the wire guide 900 - 1 .
  • the marks 940 are at the same positions when an image obtained by the imaging apparatus 310 is displayed on the display unit 340 , the positional relationship between the imaging apparatus (fiberscope camera) 310 and the continuum robot 100 - 2 is kept.
  • the amount of rotation ⁇ corresponds to the amount of rotation of the imaging apparatus (fiberscope camera) 310 in the continuum robot 100 - 2 .
  • the factors of rotation of the positions of the marks 940 may be the twist of the continuum robot 100 - 2 itself and the rotation of the imaging apparatus 310 in the continuum robot 100 - 2 .
  • the torsional amount ⁇ e of the continuum robot 100 - 2 itself at the most distal end is expressed as Eq. (8), where ⁇ is the rotation amount of the images during forward movement and rearward movement, and ⁇ is the rotation amount.
  • the kinematic operation unit 230 adopts a configuration in which the driving displacement amounts of the wires 101 to 103 are set on the basis of the torsional amount ⁇ e obtained by the image DB/torsional-amount acquisition unit 210 .
  • a configuration in which magnets are attached to part of the wire guide 900 and the imaging apparatus 310 to prevent the rotation is also applicable.
  • Another configuration in which the wire guide 900 has a groove, and the imaging apparatus 310 has a protrusion, and they are joined together to prevent the rotation is also applicable.
  • the second embodiment can suppress a decrease in the accuracy of drive control of the continuum robot even if the continuum robot is twisted, as in the first embodiment described above.
  • ⁇ n (z b ), ⁇ n (z b ), l pna (z b ), l pnb (z b ), and l pnc (z b ) during forward movement and rearward movement to the target site and the coordinate information z b are stored in the image DB/torsional-amount acquisition unit 210 and the storage unit 220 illustrated in FIG. 6 .
  • the continuum robot 100 (base unit 110 ) is moved forward and rearward, using l pna (z b ), l pnb (z b ), and l pnc (z b ) at the first examination as the driving displacement amounts of the wires of the continuum robot 100 for the forward movement and rearward movement.
  • the flow of the signal at that time with the functional configuration of the continuum robot control system 10 is illustrated in FIG. 6 described above.
  • the image DB/torsional-amount acquisition unit 210 illustrated in FIG. 6 compares an image at the first examination and an image at the second examination for each of forward movement and rearward movement to obtain the torsional amount of the continuum robot 100 from the amount of rotation of the images.
  • the continuum-robot control apparatus 200 can use a configuration in which the continuum robot 100 is controlled using the same driving displacement amounts of the wires 101 to 103 as the amounts obtained at the first examination. This allows the manipulator, such as an operator, to easily move the continuum robot 100 to the target site.
  • the continuum-robot control apparatus 200 can use a configuration in which the continuum-robot control apparatus 200 determines that the continuum robot 100 is twisted, and the torsional amount ⁇ n is transmitted from the image DB/torsional-amount acquisition unit 210 to the kinematic operation unit 230 .
  • the kinematic operation unit 230 updates the driving displacement amounts of the wires 101 to 103 according to Eq. (3-1) to Eq. (3-2). Using the updated driving displacement amounts of the wires 101 to 103 allows finding all of the driving displacement amounts of the wires 101 to 103 to the target site. This allows the manipulator, such as an operator, to move the continuum robot 100 to the target site even if the continuum robot 100 is twisted.
  • the threshold of the torsional amount described above is determined from the amount of rotation of the images caused by, for example, a body motion due to breathing. In this case, a plurality of images are obtained at different breathing timings, with the base unit 110 at rest, and the amount of rotation of the images generated at that time is used as the threshold of the torsional amount.
  • the driving displacement amounts of the wires 101 to 103 are updated on the basis of the torsional amount that the image DB/torsional-amount acquisition unit 210 illustrated in FIG. 6 obtains from the image information obtained by the imaging apparatus 310 .
  • the manipulator may make fine adjustments to the torsional amount via the input unit 330 .
  • a torsional amount input dial which is one component of the input unit 330 , may be disposed at hand of the manipulator, such as an operator, and the manipulator may adjust the torsional amount via the input dial.
  • the third embodiment can suppress a decrease in the accuracy of drive control of the continuum robot even if the continuum robot is twisted, as in the first embodiment described above.
  • image information obtained by imaging the inside of the bronchial tubes of the patient using a bronchoscope as the continuum robot 100 are compared.
  • the present invention is not limited to the above configuration.
  • the fourth embodiment illustrates a configuration in which another image information on the bronchial tubes generated using another modality and image information generated by the imaging apparatus 310 disposed at a bronchoscope are compared.
  • FIG. 11 is a schematic diagram illustrating an example of the functional configuration of a continuum robot control system 10 - 2 according to the fourth embodiment of the present invention.
  • the same components as those in FIGS. 5 and 6 are denoted by the same reference signs.
  • the continuum robot control system 10 - 2 includes a computed tomography (CT) apparatus 350 , in addition to the components of the continuum robot control system 10 - 1 illustrated in FIGS. 5 and 6 .
  • CT computed tomography
  • the CT apparatus 350 is another imaging apparatus different from the imaging apparatus 310 and generates CT-image information which is another image information different from image information obtained by the imaging apparatus 310 .
  • the image DB/torsional-amount acquisition unit 210 obtains computed tomography (CT)image information on, for example, the chest of the patient, from the CT apparatus 350 before the bronchoscope is inserted.
  • CT computed tomography
  • the image DB/torsional-amount acquisition unit 210 creates a virtual image that is assumed when the bronchoscope is inserted to observe the inside of the bronchial tubes from the obtained CT-image information.
  • the continuum-robot control apparatus 200 virtually moves the base unit 110 forward in the CT image and calculates ⁇ n (z b ), ⁇ n (z b ), l pna (z b ), l pnb (z b ), and l pnc (z b ) for a virtual path to the target site.
  • These calculated values and the virtual image information at a characteristic site are stored in the image DB/torsional-amount acquisition unit 210 and the storage unit 220 illustrated in FIG. 11 .
  • the continuum-robot control apparatus 200 controls the continuum robot 100 using the virtually obtained l pna (z b ), l pnb (z b ), and l pnc (z b ) as the driving displacement amounts of the wires 101 to 103 .
  • the image DB/torsional-amount acquisition unit 210 obtains image information generated by the imaging apparatus 310 while the continuum robot 100 is moved forward and compares the feature points between the image information and the virtual image information created from the CT-image information to obtain the torsional amount ⁇ n of the continuum robot 100 .
  • the continuum-robot control apparatus 200 determines that the continuum robot 100 is twisted. In this case, the kinematic operation unit 230 sets (corrects) the driving displacement amounts of the wires 101 to 103 according to Eq. (3-1) to Eq. (3-3) on the basis of the torsional amount ⁇ n obtained by the image DB/torsional-amount acquisition unit 210 .
  • the fourth embodiment illustrates an example in which a bronchoscope is used as the continuum robot 100
  • the present invention is not limited to the medical field.
  • the virtual image information may be created from a computer-aided design (CAD) drawing at piping designing.
  • CAD computer-aided design
  • the fourth embodiment can suppress a decrease in the accuracy of drive control of the continuum robot even if the continuum robot is twisted, as in the first embodiment described above.
  • the present invention allows suppressing a decrease in the accuracy of drive control of the continuum robot even if the continuum robot is twisted.
  • Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or m ore circuits to perform the functions of one or more of the above-described embodiment(s).
  • computer executable instructions e.g., one or more programs
  • a storage medium which may also be referred to more fully
  • the computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions.
  • the computer executable instructions may be provided to the computer, for example, from a network or the storage medium.
  • the storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)TM), a flash memory device, a memory card, and the like.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Veterinary Medicine (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Gynecology & Obstetrics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Astronomy & Astrophysics (AREA)
  • General Physics & Mathematics (AREA)
  • Manipulator (AREA)
  • Endoscopes (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)
US16/924,805 2018-01-12 2020-07-09 Apparatus and method for controlling continuum robot, and computer-readable storage medium Active 2039-02-14 US11465289B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2018-003724 2018-01-12
JPJP2018-003724 2018-01-12
JP2018003724A JP7030530B2 (ja) 2018-01-12 2018-01-12 連続体ロボットの制御装置及びその制御方法、並びに、プログラム
PCT/JP2018/047593 WO2019138864A1 (ja) 2018-01-12 2018-12-25 連続体ロボットの制御装置及びその制御方法、並びに、プログラム

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/047593 Continuation WO2019138864A1 (ja) 2018-01-12 2018-12-25 連続体ロボットの制御装置及びその制御方法、並びに、プログラム

Publications (2)

Publication Number Publication Date
US20200338743A1 US20200338743A1 (en) 2020-10-29
US11465289B2 true US11465289B2 (en) 2022-10-11

Family

ID=67218276

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/924,805 Active 2039-02-14 US11465289B2 (en) 2018-01-12 2020-07-09 Apparatus and method for controlling continuum robot, and computer-readable storage medium

Country Status (5)

Country Link
US (1) US11465289B2 (de)
EP (1) EP3714763A4 (de)
JP (1) JP7030530B2 (de)
CN (1) CN111587085B (de)
WO (1) WO2019138864A1 (de)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3991983A4 (de) 2019-06-28 2022-08-10 FUJIFILM Corporation Originalplatte für eine lithografische druckplatte auf der druckpresse, verfahren zur herstellung einer lithografischen druckplatte und lithografisches druckverfahren
US11786106B2 (en) * 2020-05-26 2023-10-17 Canon U.S.A., Inc. Robotic endoscope probe having orientation reference markers
CN111761609B (zh) * 2020-07-08 2022-06-03 天津大学 基于接触辅助结构的柔性连续体机器人
US20220016394A1 (en) * 2020-07-16 2022-01-20 Canon U.S.A., Inc. Medical Apparatus and Method of Use Thereof
JP7458929B2 (ja) 2020-07-29 2024-04-01 キヤノン株式会社 連続体ロボットの制御システム及びその作動方法、並びに、プログラム
CN112294236B (zh) * 2020-10-14 2022-03-25 北京大学 内窥镜前端弯曲部形态检测系统及其检测方法
WO2023150517A1 (en) * 2022-02-01 2023-08-10 Canon U.S.A., Inc. Methods, apparatus and systems for controlling a medical device
CN114526934B (zh) * 2022-02-16 2024-01-23 常州大学 一种驱动绳自动张紧的柔性检测机器人及其控制方法
CN114872068B (zh) * 2022-06-10 2023-08-22 北京通用人工智能研究院 一种桌面式连续体机器人

Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004248366A (ja) 2003-02-12 2004-09-02 Yazaki Corp ハーネス用外装部材とそれを用いたハーネス配索構造
JP2007090098A (ja) 2006-12-25 2007-04-12 Olympus Corp 内視鏡形状検出装置
JP2007159337A (ja) 2005-12-08 2007-06-21 Sumitomo Wiring Syst Ltd ワイヤハーネス用外装材
JP2007181267A (ja) 2005-12-27 2007-07-12 Yazaki Corp スライド構造体用の給電装置
JP2007306993A (ja) 2006-05-16 2007-11-29 Olympus Medical Systems Corp 回転自走式内視鏡システム
JP2007330348A (ja) 2006-06-12 2007-12-27 Olympus Medical Systems Corp 内視鏡挿入形状検出装置
JP2008048788A (ja) 2006-08-22 2008-03-06 Olympus Medical Systems Corp 内視鏡
JP2010104426A (ja) 2008-10-28 2010-05-13 Olympus Medical Systems Corp 医療機器
US20120271109A1 (en) 2000-04-03 2012-10-25 Intuitive Surgical Operations, Inc. Steerable endoscope and improved method of insertion
US20130090763A1 (en) * 2008-01-25 2013-04-11 The Trustees Of Columibia University In The City Of The City Of New York Systems and methods for force sensing in a robot
US20130300537A1 (en) * 2012-05-11 2013-11-14 Vanderbilt University Method and system for contact detection and contact localization along continuum robots
US20140330432A1 (en) * 2012-04-20 2014-11-06 Vanderbilt University Systems and methods for safe compliant insertion and hybrid force/motion telemanipulation of continuum robots
JP2015530903A (ja) 2012-08-14 2015-10-29 インテュイティブ サージカル オペレーションズ， インコーポレイテッド 多数のビジョンシステムのレジストレーションのためのシステム及び方法
WO2016063682A1 (ja) 2014-10-22 2016-04-28 オリンパス株式会社 内視鏡挿入形状観測装置
WO2017014301A1 (ja) 2015-07-23 2017-01-26 オリンパス株式会社 入力機構及び医療システム
WO2017014308A1 (ja) 2015-07-23 2017-01-26 オリンパス株式会社 マニピュレータ及び医療システム
US9566711B2 (en) * 2014-03-04 2017-02-14 Sarcos Lc Coordinated robotic control
US20180125593A1 (en) * 2015-04-27 2018-05-10 Fondazione Istituto Italiano Di Tecnologia A shape-keeping deployable structure including a pair of robotic systems of the continuum type
US20180304458A1 (en) * 2017-04-21 2018-10-25 Canon Kabushiki Kaisha Continuum robot control system and continuum robot control method
US10254499B1 (en) * 2016-08-05 2019-04-09 Southern Methodist University Additive manufacturing of active devices using dielectric, conductive and magnetic materials
US20190184553A1 (en) * 2016-08-22 2019-06-20 Canon Kabushiki Kaisha Continuum robot, modification method of kinematic model of continuum robot, and control method of continuum robot
US10543605B2 (en) * 2017-08-15 2020-01-28 Avigilon Corporation Camera on movable arm
US10743750B2 (en) * 2014-04-28 2020-08-18 Massachusetts Institute Of Technology Multi-link modular continuum robotic endoscope system
US10786903B2 (en) * 2017-10-05 2020-09-29 Institute Of Nuclear Energy Research, Atomic Energy Council, Executive Yuan Map creation system and method thereof for movable robot
US20200375682A1 (en) * 2019-05-31 2020-12-03 Canon U.S.A., Inc. Actively controlled steerable medical device with passive bending mode

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6033456B2 (ja) * 2013-02-27 2016-11-30 オリンパス株式会社 マニピュレータ
JP2018003724A (ja) 2016-07-04 2018-01-11 本田技研工業株式会社 内燃機関の過給システム

Patent Citations (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120271109A1 (en) 2000-04-03 2012-10-25 Intuitive Surgical Operations, Inc. Steerable endoscope and improved method of insertion
JP2004248366A (ja) 2003-02-12 2004-09-02 Yazaki Corp ハーネス用外装部材とそれを用いたハーネス配索構造
JP2007159337A (ja) 2005-12-08 2007-06-21 Sumitomo Wiring Syst Ltd ワイヤハーネス用外装材
JP2007181267A (ja) 2005-12-27 2007-07-12 Yazaki Corp スライド構造体用の給電装置
JP2007306993A (ja) 2006-05-16 2007-11-29 Olympus Medical Systems Corp 回転自走式内視鏡システム
JP2007330348A (ja) 2006-06-12 2007-12-27 Olympus Medical Systems Corp 内視鏡挿入形状検出装置
JP2008048788A (ja) 2006-08-22 2008-03-06 Olympus Medical Systems Corp 内視鏡
JP2007090098A (ja) 2006-12-25 2007-04-12 Olympus Corp 内視鏡形状検出装置
US20130090763A1 (en) * 2008-01-25 2013-04-11 The Trustees Of Columibia University In The City Of The City Of New York Systems and methods for force sensing in a robot
JP2010104426A (ja) 2008-10-28 2010-05-13 Olympus Medical Systems Corp 医療機器
US20140330432A1 (en) * 2012-04-20 2014-11-06 Vanderbilt University Systems and methods for safe compliant insertion and hybrid force/motion telemanipulation of continuum robots
US20170182659A1 (en) * 2012-04-20 2017-06-29 Vanderbilt University Systems and methods for safe compliant insertion and hybrid force/motion telemanipulation of continuum robots
US20130300537A1 (en) * 2012-05-11 2013-11-14 Vanderbilt University Method and system for contact detection and contact localization along continuum robots
JP2015530903A (ja) 2012-08-14 2015-10-29 インテュイティブ サージカル オペレーションズ， インコーポレイテッド 多数のビジョンシステムのレジストレーションのためのシステム及び方法
US9566711B2 (en) * 2014-03-04 2017-02-14 Sarcos Lc Coordinated robotic control
US10743750B2 (en) * 2014-04-28 2020-08-18 Massachusetts Institute Of Technology Multi-link modular continuum robotic endoscope system
WO2016063682A1 (ja) 2014-10-22 2016-04-28 オリンパス株式会社 内視鏡挿入形状観測装置
US20180125593A1 (en) * 2015-04-27 2018-05-10 Fondazione Istituto Italiano Di Tecnologia A shape-keeping deployable structure including a pair of robotic systems of the continuum type
WO2017014301A1 (ja) 2015-07-23 2017-01-26 オリンパス株式会社 入力機構及び医療システム
WO2017014308A1 (ja) 2015-07-23 2017-01-26 オリンパス株式会社 マニピュレータ及び医療システム
US10254499B1 (en) * 2016-08-05 2019-04-09 Southern Methodist University Additive manufacturing of active devices using dielectric, conductive and magnetic materials
US10571642B1 (en) * 2016-08-05 2020-02-25 Southern Methodist University Additive manufacturing of active devices using dielectric, conductive and magnetic materials
US20190184553A1 (en) * 2016-08-22 2019-06-20 Canon Kabushiki Kaisha Continuum robot, modification method of kinematic model of continuum robot, and control method of continuum robot
US20180304458A1 (en) * 2017-04-21 2018-10-25 Canon Kabushiki Kaisha Continuum robot control system and continuum robot control method
US11084166B2 (en) * 2017-04-21 2021-08-10 Canon Kabushiki Kaisha Continuum robot control system and continuum robot control method
US10543605B2 (en) * 2017-08-15 2020-01-28 Avigilon Corporation Camera on movable arm
US10786903B2 (en) * 2017-10-05 2020-09-29 Institute Of Nuclear Energy Research, Atomic Energy Council, Executive Yuan Map creation system and method thereof for movable robot
US20200375682A1 (en) * 2019-05-31 2020-12-03 Canon U.S.A., Inc. Actively controlled steerable medical device with passive bending mode

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
BAJO ANDREA, SIMAAN NABIL: "Hybrid motion/force control of multi-backbone continuum robots", THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, vol. 35, no. 4, 20 April 2016 (2016-04-20), pages 422 - 434, XP055812870, DOI: 10.1177/0278364915584806
Bajo, Andrea, et al., "Hybrid motion/force control of multi-backbone continuum robots", International Journal of Robotics Research, XP055812870, vol. 35, No. 4, Apr. 20, 2016 (Apr. 20, 2016), pp. 422-434, US ISSN: 0278-3649, DOi: 10.1177/0278364915584606.
SHI CHAOYANG; LUO XIONGBIAO; QI PENG; LI TIANLIANG; SONG SHUANG; NAJDOVSKI ZORAN; FUKUDA TOSHIO; REN HONGLIANG: "Shape Sensing Techniques for Continuum Robots in Minimally Invasive Surgery: A Survey", IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, IEEE, USA, vol. 64, no. 8, 1 August 2017 (2017-08-01), USA, pages 1665 - 1678, XP011656270, ISSN: 0018-9294, DOI: 10.1109/TBME.2016.2622361
Shi, Chaoyang, et al., "Shape Sensing Techniques for Continuum Robots in Minimally Invasive Surgery: A Survey", IEEE Transactions on Biomedical Engineering, IEEE Service Center, Piscataway, NJ, USA, XP011656270, vol. 64, No. 8, Aug. 1, 2017 (Aug. 1, 2017), pp. 1665-1678, ISSN: 0018-9294, DOI: 10.1109/TBME.2016.2622361.
Xu Kai et al, "An Exporimental Kinestatic Comparison betweenContinuum Manipulators with Structural Variations", IEEE International Conference on Robotics and Automatio4(ICRA), 2014, pp. 3258-3264.

Also Published As

Publication number Publication date
WO2019138864A1 (ja) 2019-07-18
EP3714763A1 (de) 2020-09-30
CN111587085A (zh) 2020-08-25
EP3714763A4 (de) 2021-07-21
JP2019122491A (ja) 2019-07-25
US20200338743A1 (en) 2020-10-29
CN111587085B (zh) 2024-03-19
JP7030530B2 (ja) 2022-03-07

Similar Documents

Publication Publication Date Title
US11465289B2 (en) Apparatus and method for controlling continuum robot, and computer-readable storage medium
US11712154B2 (en) Automated calibration of surgical instruments with pull wires
US20230012778A1 (en) Navigation of tubular networks
US11084166B2 (en) Continuum robot control system and continuum robot control method
CN117224241B (zh) 一种软式内镜操控系统的控制方法及相关装置
US20190374090A1 (en) Wire-driven manipulator
US11553937B2 (en) Deflection mechanism of an ear-nose-throat tool
US11926062B2 (en) Methods and apparatus for controlling a continuum robot
US11737773B2 (en) Non-circular working channel of an ear-nose-throat tool
US20190029762A1 (en) Medical manipulator system and manipulator curved-shape estimation method
US11541209B2 (en) Preventing twisting of pull wires when deflecting an ear-nose-throat tool
US11911004B2 (en) Bending and extending device and bending and extending method
WO2023164047A1 (en) Method and apparatus for controlling continuum robot
JP2023113300A (ja) 連続体ロボット制御システム及び連続体ロボット制御方法

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: CANON KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MASAKI, FUMITARO;TAKAGI, KIYOSHI;TANAKA, YUSUKE;SIGNING DATES FROM 20200716 TO 20200721;REEL/FRAME:053681/0060

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE