WO2013100171A1 - Stereo-endoscope device, stereo-endoscope system, and stereo-endoscope robot - Google Patents

Stereo-endoscope device, stereo-endoscope system, and stereo-endoscope robot Download PDF

Info

Publication number
WO2013100171A1
WO2013100171A1 PCT/JP2012/084272 JP2012084272W WO2013100171A1 WO 2013100171 A1 WO2013100171 A1 WO 2013100171A1 JP 2012084272 W JP2012084272 W JP 2012084272W WO 2013100171 A1 WO2013100171 A1 WO 2013100171A1
Authority
WO
WIPO (PCT)
Prior art keywords
stereo
angle
medical device
swiveling
treatment
Prior art date
Application number
PCT/JP2012/084272
Other languages
French (fr)
Inventor
Satoru Kikuchi
Osamu Konno
Original Assignee
Olympus Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corporation filed Critical Olympus Corporation
Priority to EP12861469.0A priority Critical patent/EP2797486B1/en
Priority to CN201280065232.4A priority patent/CN104023614B/en
Publication of WO2013100171A1 publication Critical patent/WO2013100171A1/en
Priority to US14/311,581 priority patent/US20140303437A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163Optical arrangements
    • A61B1/00193Optical arrangements adapted for stereoscopic vision
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00006Operational features of endoscopes characterised by electronic signal processing of control signals
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064Constructional details of the endoscope body
    • A61B1/00071Insertion part of the endoscope body
    • A61B1/0008Insertion part of the endoscope body characterised by distal tip features
    • A61B1/00097Sensors
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00131Accessories for endoscopes
    • A61B1/00133Drive units for endoscopic tools inserted through or with the endoscope
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163Optical arrangements
    • A61B1/00174Optical arrangements characterised by the viewing angles
    • A61B1/00183Optical arrangements characterised by the viewing angles for variable viewing angles
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/012Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor characterised by internal passages or accessories therefor
    • A61B1/018Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor characterised by internal passages or accessories therefor for receiving instruments
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/313Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes
    • A61B1/3132Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes for laparoscopy
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045Control thereof
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/28Surgical forceps
    • A61B17/29Forceps for use in minimally invasive surgery
    • A61B2017/2901Details of shaft
    • A61B2017/2906Multiple forceps
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2065Tracking using image or pattern recognition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/06Measuring instruments not otherwise provided for
    • A61B2090/061Measuring instruments not otherwise provided for for measuring dimensions, e.g. length
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/06Measuring instruments not otherwise provided for
    • A61B2090/062Measuring instruments not otherwise provided for penetration depth
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37Surgical systems with images on a monitor during operation
    • A61B2090/371Surgical systems with images on a monitor during operation with simultaneous use of two cameras

Definitions

  • the present invention relates to a stereo-endoscope device, a stereo-endoscope system, and a stereo-endoscope robot .
  • intersection of the optical axes of the imaging fibers is adjusted, thus changing the stereoscopic effect of the acquired image.
  • An object of the present invention is to provide a stereo-endoscope device, a stereo-endoscope system, and a stereo-endoscope robot capable of easily acquiring appropriate stereoscopic images of an affected site.
  • the present invention provides the following solutions.
  • the present invention provides a stereo-endoscope device including: an inserted portion that can be inserted into a subject's body; two imaging devices that are disposed on the inserted portion with a space therebetween; an angle changing mechanism that changes a relative angle of optical axes of the imaging devices; a distance detecting unit for detecting the distance to the imaging devices from a treatment part of a medical device that is inserted into the subject's body and is used to treat an affected site; and a control section that controls the angle changing mechanism based on insertion information of the medical device, the insertion information including the distance detected by the distance detecting unit.
  • the inserted portion is
  • the distance detecting unit detects the distance from the treatment part of the medical device to the imaging devices, and the control section controls the angle changing mechanism based on the detected distance.
  • the control section adjusts the convergence angle of the two imaging devices according to the distance from the treatment part of the medical device to the imaging devices.
  • the control section adjusts the convergence angle of the two imaging devices according to the distance from the treatment part of the medical device to the imaging devices.
  • the distance detecting unit may include a measurement part that measures the amount of insertion of the treatment part of the medical device inserted into the subject's body and a conversion part that converts the amount of insertion measured by the measurement part to the distance from the treatment part of the medical device to the imaging devices.
  • control section may control the angle changing mechanism such that an intersection of the optical axes of the imaging devices coincides with the position of the treatment part of the medical device.
  • the intersection of the optical axes of the imaging devices can be made to coincide with the treatment part of the medical device based on the distance detected by the distance detecting unit.
  • the mechanism may include, at a tip of the inserted portion, a pair of swiveling members attached so as to be capable of swiveling on shafts that extend in a direction intersecting with the longitudinal axis of the inserted portion and driving units for swiveling the pair of swiveling members, and the imaging devices may be attached to the swiveling members.
  • the driving units may swivel the pair of swiveling members between closed positions in which the pair of swiveling members extend in the direction of the longitudinal axis of the inserted portion and are close to each other and open positions in which the pair of
  • swiveling members extend in directions intersecting with the longitudinal axis of the inserted portion and are away from each other.
  • the swiveling members are located at the closed positions to be along the longitudinal direction of the inserted portion, thereby reducing the cross-sectional area to make the insertion easier. Furthermore, after the tip of the inserted portion is inserted into the subject's body, the swiveling members are made to swivel to be located at the open positions, thus ensuring a space between the imaging devices and making it easier to form a large convergence angle .
  • the present invention provides a stereo-endoscope system including: one of the above-described stereo-endoscope devices; the medical device that has a swiveling part capable of swiveling the treatment part on a shaft extending in a direction intersecting with the longitudinal axis of the medical device; and a swivel-angle detecting section that detects a swivel angle of the swiveling part of the medical device, in which the control section controls the angle changing mechanism based on insertion information of the medical device, the insertion information including the swivel angle detected by the swivel-angle detecting section.
  • the treatment region of the treatment part at the affected site in the subject's body can be
  • control section controls the angle changing mechanism based on the swivel angle of the swiveling part of the medical device detected by the swivel-angle detecting section, thereby making it possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part over the entire swivel range of the swiveling part of the medical device.
  • the stereo-endoscope system may further include: an inserted member that has a through-hole into which the medical device can be inserted; and an insertion-angle detecting section that detects an angle of a central axis of the through-hole of the inserted member, and the control section may control the angle changing
  • the mechanism based on insertion information of the medical device, the insertion information including the angle detected by the insertion-angle detecting section.
  • the control section controls the angle changing mechanism based on the angle of the central axis of the through-hole of the inserted member detected by the insertion- angle detecting section, thereby making it possible to
  • the stereo-endoscope system may further include: at least one medical device identical to said medical device; and a motion detecting section that detects motions of the treatment parts of the medical devices, and the control section may control the angle changing mechanism based on the distance to the imaging devices from the treatment part of the medical device whose treatment part has the largest amount of motion detected by the motion detecting section.
  • the medical device whose treatment part has the largest amount of motion is considered to be the one being manipulated by the operator. Therefore, with this structure, it is possible, in an
  • the present invention provides a stereo-endoscope robot including: one of the above- described stereo-endoscope systems; a manipulation part that manipulates the medical device through remote manipulation performed by an operator; and an information detecting section that detects the insertion information of the medical device from manipulation information of the medical device
  • control section controls the angle changing mechanism based on the insertion information of the medical device detected by the information detecting section.
  • the affected site in the subject's body can be treated via the manipulation part through remote manipulation performed by the operator.
  • the control section controls the angle changing mechanism based on the insertion information of the medical device detected by the information detecting section from the manipulation information of the manipulation part, thereby making it possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part of the medical device through remote
  • an advantage is afforded in that appropriate stereoscopic images of the affected site can be easily acquired.
  • Fig. 1 is a view showing the overall structure of a stereo-endoscope device according to a first embodiment of the present invention.
  • Fig. 2A is a front view of an inserted portion viewed in a radial direction when swiveling members of the stereo-endoscope device shown in Fig. 1 are located at closed positions .
  • Fig. 2B is a front view of the inserted portion shown in Fig. 2A viewed from the tip thereof.
  • Fig. 3A is a front view of the inserted portion viewed in a radial direction when the swiveling members of the stereo-endoscope device shown in Fig. 1 are located at open positions.
  • Fig. 3B is a front view of the inserted portion shown in Fig. 3A viewed from the tip thereof.
  • Fig. 4 is a front view showing a state in which a treatment instrument protrudes from a channel of the inserted portion shown in Fig. 3A.
  • Fig. 5 is a view showing the overall structure of the treatment instrument shown in Fig. 4.
  • Fig. 6 is a functional block diagram of the stereo- endoscope device shown in Fig. 1.
  • Fig. 7 is a view showing an insertion state in which the inserted portion of the stereo-endoscope device shown in Fig. 1 is inserted into a body, and the swiveling members are located at the closed positions.
  • Fig. 8 is a view showing a state in which the swiveling members are located at the open positions.
  • Fig. 9 is a graph showing an example control pattern showing the relationship between the distance and the
  • Fig. 10 is a flowchart for explaining an
  • Fig. 11 is the flowchart for explaining the
  • Fig. 12 is a front view showing an inserted portion according to a first modification of the first embodiment of the present invention.
  • Fig. 13 is a longitudinal sectional view of the inserted portion shown in Fig. 12.
  • Fig. 14 is a view showing the overall structure of a stereo-endoscope system according to a second embodiment of the present invention.
  • Fig. 15 is a flowchart for explaining an
  • Fig. 16 is a view showing the overall structure of a stereo-endoscope system according to a third modification of the second embodiment of the present invention.
  • Fig. 17 is a view showing the overall structure of a stereo-endoscope system according to a fourth modification of the second embodiment of the present invention.
  • Fig. 18 is a view showing the overall structure of a stereo-endoscope robot according to a third embodiment of the present invention.
  • a stereo-endoscope device 1 of this embodiment includes an elongated inserted portion 2 that can be inserted into the body of a patient (subject's body) and a main system 3 that is connected to the inserted portion 2.
  • the inserted portion 2 has, on the tip thereof, two shafts (rotational axes) 4 that extend parallel to each other in a direction perpendicular to a longitudinal axis of the inserted portion 2 and two swiveling members (angle changing mechanism) 5 that are supported so as to be capable of swiveling on these shafts 4.
  • Rotary microactuators (driving units, angle changing mechanism) 6 that rotate the shafts 4 are provided at base ends of the swiveling members 5.
  • microactuators 6 are synchronized to rotate the shafts 4 in opposite directions, the swiveling members 5 are made to swivel between closed positions in which they are located close to each other in the direction of the longitudinal axis of the inserted portion 2, as shown in Figs. 2A and 2B, and open positions in which they are located away from each other in directions intersecting with the longitudinal axis of the inserted portion 2, as shown in Figs. 3A and 3B.
  • the swiveling members 5 include distance sensors
  • distance detecting units 9, illumination devices 8, and imaging devices 7 that face each other when the swiveling members 5 are located at the closed positions.
  • the imaging devices 7 are, for example, CCDs or CMOS imagers having optical axes 7a (see Fig. 8) that are perpendicular to longitudinal axes of the swiveling members 5.
  • the illumination devices 8 are, for example, LEDs that emit illumination light in directions intersecting with the longitudinal axes of the swiveling members 5.
  • the distance sensor 9 includes, for example, a light emitting device 9a that is provided on one of the swiveling members 5 and a light receiving device 9b that is provided on the other one of the swiveling members 5.
  • Light emitted from the light emitting device 9a is reflected on an object A (see Fig. 4 etc.), such as an
  • the amount of light received by the light receiving device 9b is small when the distance is long and is large when the distance is short; therefore, the distance from the distance sensor 9 to the object A can be detected based on the amount of received light.
  • the swiveling members 5 have, at the tips thereof, a tip distance sensor (distance detecting unit) 10 that detects the distance from the object A to the swiveling members 5 in the state where the swiveling members 5 are located at the closed positions.
  • the tip distance sensor 10 includes a light emitting device 10a and a light receiving device 10b.
  • the inserted portion 2 is provided with a channel 21 that passes through the inserted portion 2 along the longitudinal axis thereof and a magnetic encoder 23 (see Fig. 4) that is disposed near the channel 21.
  • the channel 21 has an opening 21a between the two shafts 4, which are provided at the tip of the inserted portion 2.
  • the inserted portion 2 is structured such that a treatment instrument (medical device) 30 can be
  • the treatment instrument 30 includes, for example, a treatment part 31 that is used to treat the affected site of the patient, a manipulation part 37 that is grasped by an operator to manipulate the treatment part 31, and a shaft part 39 that connects the treatment part 31 and the manipulation part 37.
  • the treatment part 31 includes a swiveling part 33 that is provided at the tip of the shaft part 39 so as to be capable of swiveling on a swivel shaft that extends in a direction intersecting with the long axis of the shaft part 39 and a pair of forceps members 35 that extend from the
  • swiveling part 33 toward the distal end and that can be opened and closed with an opening-and-closing shaft that extends parallel to the above-described swivel shaft of the swiveling part 33.
  • the operator can manipulate the manipulation part 37 to swivel the swiveling part 33 and to open and close the pair of forceps members 35.
  • the shaft part 39 is provided with a plurality of
  • magnetic codes 39A that are formed of a magnetic material and arranged at regular intervals in the longitudinal direction thereof .
  • the magnetic encoder 23 produces a magnetic field and reads the magnetism that changes when the magnetic codes 39A on the treatment instrument 30 pass through the magnetic field, thereby detecting the amount of insertion of the treatment instrument 30.
  • the detected amount of insertion of the treatment instrument 30 is sent to the main system 3 as insertion information.
  • treatment instrument 30 corresponds to the amount of
  • the main system 3 includes a sensor control section 11 that controls the distance sensor 9 and the tip distance sensor 10, an illumination control section 12 that controls lighting of the illumination devices 8, an image-acquisition control section 13 that controls image acquisition performed by the imaging devices 7, a swivel control section (control section) 14 that controls the angles of the swiveling members 5, an image processing section 15 that processes image signals acquired by the imaging devices - 7, an image display section 16 that displays images processed by the image processing section 15, a pattern storage section 17 that stores a control pattern associating the distance and the convergence angle in the form of a LUT (look-up table), and the manipulation part 37 manipulated by the operator.
  • a sensor control section 11 that controls the distance sensor 9 and the tip distance sensor 10
  • an illumination control section 12 that controls lighting of the illumination devices 8
  • an image-acquisition control section 13 controls image acquisition performed by the imaging devices 7
  • a swivel control section (control section) 14 that controls the angles of the swiveling members 5
  • an image processing section 15 that processes image signals acquired by the
  • the swivel control section 14 switches between an
  • the swivel control section 14 sets the observation mode when it receives insertion information indicating a state in which the amount of
  • insertion of the treatment instrument 30 is zero, that is, a state in which the treatment part 31 of the treatment
  • the swivel control section 14 sets the treatment mode when it receives insertion information indicating a state in which the amount of insertion of the treatment instrument 30 is not zero, that is, a state in which the treatment part 31 of the treatment instrument 30 protrudes from the channel 21 of the inserted portion 2.
  • the inserted portion 2 is inserted into the body of the patient and is located at a desired position, and, in the treatment mode, the treatment instrument 30 is used to treat the affected site of the patient.
  • the swivel control section 14 actuates the tip distance sensor 10 at the time of insertion during which the swiveling members 5 are located at the closed positions, as shown in Fig. 7, and actuates the distance sensor 9 when the swiveling members 5 are located at the open positions, as shown in Fig. 8.
  • the light receiving devices 9b and 10b which constitute the distance sensor 9 and the tip distance sensor 10,
  • the swivel control section 14 monitors the voltage signal sent from the light receiving device 10b, constituting the tip distance sensor 10, at the time of insertion during which the swiveling members 5 are located at the closed positions. Then, when the voltage signal exceeds a stored predetermined threshold, that is, when the distance between the tips of the swiveling members 5 and the object A reaches a predetermined distance, the swivel control section 14 actuates the rotary microactuators 6 to make the swiveling members 5 swivel from the closed positions to initial open positions.
  • the swivel control section 14 outputs start-up signals to the sensor control section 11, the illumination control section 12, and the image-acquisition control section 13.
  • the sensor control section 11 drives the distance sensor 9, instead of the tip distance sensor 10, to make the distance sensor 9 detect the distance to the object A.
  • the illumination control section 12 Upon reception of the start-up signal, the illumination control section 12 actuates the illumination devices 8. Upon reception of the start-up signal, the image-acquisition control section 13 actuates the imaging devices 7.
  • the swivel control section 14 calculates the distance
  • microactuators 6 so as to achieve the found convergence angle a.
  • the control pattern stored in the pattern storage section 17 has a linear relationship between the distance and the convergence angle a, as shown in Fig. 9, for example.
  • the optical axes 7a of the two imaging devices 7 intersect at a corresponding convergence angle.
  • the pattern storage section 17 stores the relationship between a convergence angle ⁇ and the amount of insertion of the treatment instrument 30, which is converted to the distance from the treatment part 31 to the imaging devices 7 and then associated with the convergence angle.
  • the swivel control section 14 calculates the angles of the swiveling members 5 for achieving the found convergence angle a and performs control such that the shafts 4 of the rotary microactuators 6 are rotated to these angles from the initial open positions.
  • the swivel control section 14 searches, in the control pattern stored in the pattern storage section 17, for the convergence angle ⁇
  • the rotary microactuators 6 are actuated to locate the two swiveling members 5 at the closed positions shown in Figs. 2A and 2B.
  • the inserted portion 2 is inserted, starting from the tips of the swiveling members 5, into the space in the body via a through-hole of a trocar D located in an opening C that is formed to penetrate a body surface tissue B (Step SA1).
  • the swivel control section 14 has set the observation mode.
  • the sensor control section 11 actuates the light emitting device 10a and the light receiving device 10b of the tip distance sensor 10. Then, a voltage signal indicating the amount of light emitted from the light emitting device 10a, reflected on the object A in the body, and then received by the light receiving device 10b is input to the swivel control section 14, and the swivel control section 14 determines the distance (Step SA2) .
  • Step SA3 If the distance detected by the tip distance sensor 10 becomes smaller than a predetermined distance J ("Yes" in Step SA3) , at this position, the swivel control section 14 actuates the rotary microactuators 6 to make the two swiveling members 5 swivel to the predetermined initial open positions, as shown in Fig. 8 (Step SA ) .
  • the swivel control section 14 Furthermore, at the same time that the swivel control section 14 makes the swiveling members 5 swivel to the initial open positions, the swivel control section 14 outputs start-up signals to the sensor control section 11, the illumination control section 12, and the image-acquisition control section 13 (Step SA5) . Upon reception of the start-up signal, the sensor control section 11 stops the tip distance sensor 10 that has been activated and actuates the light emitting device 9a and the light receiving device 9b of the distance sensor 9. ⁇ 0049 ⁇
  • the illumination control section 12 Upon reception of the start-up signal, the illumination control section 12 actuates the illumination devices 8 to radiate illumination light onto the object A.
  • the image-acquisition control section 13 actuates the two imaging devices 7 to acquire image signals.
  • the image signals acquired by the two imaging devices 7 are displayed on the image display section 16 via the image processing section 15.
  • two types of images of the object A acquired from two directions, namely, the right and left directions, are obtained (Step SA6) .
  • the voltage signal corresponding to the amount of light received by the light receiving device 9b of the distance sensor 9 is sent to the swivel control section 14, and the distance is calculated therein (Step SA7) .
  • the swivel control section 14 uses the calculated distance to search, in the control pattern stored in the pattern storage section 17, for the corresponding convergence angle a and calculates the angles of the swiveling members 5 for achieving the found convergence angle a. Then, the swivel control section 14 actuates the rotary microactuators 6 until the swiveling members 5 swivel so as to achieve the calculated angles (Step SA8) .
  • the control pattern is stored so as to associate the convergence angle a and the distance at which the intersection of the optical axes 7a of the two imaging devices 7 coincides with the surface of the object A; therefore, by swiveling the swiveling members 5 so as to achieve the convergence angle a corresponding to the detected distance, it is possible to acquire two images of the object A viewed from two directions, namely, the right and left directions, with the intersection of the optical axes 7a of the two imaging devices 7 always coinciding with the surface of the object A.
  • Step SA9 when the treatment instrument 30 is made to protrude from the channel 21 of the inserted portion 2 and inserted into the body of the patient (Step SA9) , the magnetic encoder 23 inputs, to the swivel control section 14, insertion information indicating that the amount of insertion of the treatment instrument 30 is not zero, and the swivel control section 14 switches to the treatment mode (Step SA10). Then, when the treatment instrument 30 is located near the affected site of the patient, the magnetic encoder 23 detects the amount of insertion of the treatment instrument 30 (Step SA11) and inputs the insertion information of the treatment instrument 30 to the swivel control section 14.
  • the swivel control section 14 searches, in the control pattern stored in the pattern storage section 17, for the relationship value (pattern) of the convergence angle ⁇
  • the control pattern is stored so as to associate the convergence angle ⁇ and the distance at which the intersection of the optical axes 7a of the two imaging devices 7 coincides with the treatment part 31 of the treatment instrument 30;
  • Step SA14 Until the amount of insertion of the treatment instrument 30, detected by the magnetic encoder 23, becomes zero, that is, until the treatment part 31 of the treatment instrument 30 is accommodated in the channel 21 of the inserted portion 2 (Step SA14), detection of the amount of insertion, reading of the control pattern, and adjustment of the convergence angle ⁇ , which are performed in Steps SA11 to SA13, are repeated. Thereafter, once the treatment instrument 30 is accommodated in the channel 21 ("Yes" in Step SA14), the swivel control section 14 switches to the observation mode (Step SA15) .
  • the swivel control section 14 Based on the relationship value for control of the swivel angles of the swiveling members 5 with respect to the amount of change in the distance, which is stored in advance, the swivel control section 14 drives the rotary microactuators 6 according to the amount of change in the distance from the treatment part 31 of the treatment instrument 30 to the imaging devices 7 (Step SA16) . Then, if the inserted portion 2 is withdrawn, so that the distance to the object A is equal to or .larger ..than the .predetermined distance J ("Yes" in Step SA17), the swivel control section 14 outputs signals
  • the swivel control section 14 actuates the rotary microactuators 6 to locate the two swiveling members 5 at the closed positions (Step SA19) and instructs the sensor control section 11 to stop the distance sensor 9 and actuate the tip distance sensor 10.
  • the inserted portion 2 and the swiveling members 5 can be withdrawn from the body via the trocar D (Step SA20) .
  • the swiveling members 5 are made to swivel based on the distance from the treatment part 31 to the imaging devices 7 corresponding to the amount of insertion of the treatment instrument 30 detected by the magnetic encoder 23, thereby adjusting the convergence angle such that the intersection of the optical axes 7a of the two imaging devices 7 always coincides with the treatment part 31
  • This embodiment can be modified as described below.
  • the inserted portion 2 includes channels 21A and 21B that are parallel to each other and magnetic encoders 23A and 23B that are disposed near the channels 21A and 21B, respectively, and the magnetic encoders 23A and 23B detect the amounts of insertion of the treatment instruments 30A and 30B into the channels 21A and 21B, respectively.
  • the amounts of motion of the treatment parts 31 may be detected from image processing and the swivel angles of the swiveling parts 33, and the swivel angles of the swiveling members 5 may be adjusted based on the distance to the imaging devices 7 from the treatment part 31 of the treatment instrument 30A or 30B having a larger amount of motion.
  • the operator may manually select one of the treatment instruments 30A and 30B and adjust the swivel angles of the swiveling members 5 based on the insertion information sent from the corresponding magnetic encoder 23A or 23B that detects the amount of insertion of the selected treatment instrument 30A or 30B.
  • channels 21A and 21B correspond to the channel 21
  • the magnetic encoders 23A and 23B correspond to the magnetic encoder 23
  • the treatment instruments 30A and 30B correspond to the treatment instrument 30.
  • the treatment instrument 30 ⁇ or the treatment instrument 30B whose treatment part 31 has the largest amount of motion is considered to be the one being manipulated by the operator.
  • a swivel-angle detecting section (not shown) that detects the swivel angle of the swiveling part 33 is provided on the treatment instrument 30, and the detected swivel angle is input to the swivel control section 14.
  • the swivel control section 14 adjusts the swivel angles of the swiveling members 5 based on the swivel angle of the swiveling part 33 in addition to the amount of insertion of the treatment instrument 30, thereby making it possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part 31 over the entire swivel range of the swiveling part 33 of the treatment instrument 30.
  • a stereo-endoscope system 101 of this embodiment includes the stereo-endoscope device 1, the two treatment instruments (medical devices) 30A and 30B, trocars (inserted members) 41A and 41B for inserting the treatment instruments 30A and 30B into the body of the stereo-endoscope device 1, the two treatment instruments (medical devices) 30A and 30B, trocars (inserted members) 41A and 41B for inserting the treatment instruments 30A and 30B into the body of the
  • an insertion-angle detecting section 43 that detects the angles of insertion of the treatment instruments 30A and 30B.
  • the trocars 41A and 4 IB are substantially-tubular members having through-holes into which the treatment instruments 30A and 30B can be inserted.
  • the treatment instruments can be inserted into the body of the patient.
  • the trocars 41A and 41B With the trocars 41A and 41B inserted into the surface of the patient's body, the angles of insertion of the trocars 41A and 41B into the body surface can be changed by using the body surface as supporting points.
  • the trocars 41A and 41B are respectively provided with magnetic encoders 23A and 23B that are located near the through-holes. ⁇ 0067 ⁇
  • the treatment instruments 30A and 30B are inserted into the body of the patient via the trocars 41A and 41B,
  • the treatment instruments 30A and 30B are provided with swivel-angle detecting sections (not shown) for detecting the swivel angles of the swiveling parts 33.
  • the swivel angles detected by the swivel-angle detecting sections are input to the swivel control section 14.
  • the insertion-angle detecting section 43 includes three cameras 45A, 45B, and 45C that acquire images of the trocars 41A and 41B inserted into the surface of the patient's body and an analysis section (not shown) that analyzes the images acquired by the cameras 45A, 45B, and 45C to detect the angles of the central axes of the through-holes of the trocars 41A and 41B (hereinafter, simply referred to as "the angles of the trocars 41A and 41B").
  • the angles of the trocars 41A and 41B detected by the analysis section are input to the swivel control section 14 as insertion information.
  • the swivel control section 14 controls the rotary
  • microactuators 6 based on the insertion information of the treatment instruments 30A and 30B, the insertion information including the amounts of insertion of the treatment
  • instruments 30A and 30B which are sent from the magnetic encoders 23A and 23B, the swivel angles of the swiveling parts 33, which are sent from the swivel-angle detecting sections, and the angles of the trocars 41A and 41B, which are sent from the analysis section of the insertion-angle detecting section 43.
  • the pattern storage section 17 stores the relationship between the convergence angle ⁇ and the insertion information of each of the treatment instruments 30A and 30B, which is obtained after the amount of insertion of the
  • the swivel angle of the corresponding swiveling part 33, and the angle of the corresponding one of the trocars 41A and 41B are converted to the distance from the corresponding treatment part 31 to the imaging devices 7 and then associated with the convergence angle.
  • the swivel control section 14 drives the rotary microactuators 6 so as to achieve the convergence angle ⁇ corresponding to that insertion information included in control pattern.
  • the stereo-endoscope device 1 is inserted into the body of the patient, and the trocars 41A and 41B are inserted into the body surface B of the patient. Since the observation mode is the same as that in the first embodiment, a
  • the magnetic encoders 23A and 23B output the insertion information of the treatment instruments 30A and 30B, respectively, and the swivel control section 14 switches to the treatment mode (Step SA10) .
  • the affected site of the patient is grasped with the treatment instrument 30A, and a needle is held with the treatment part 31 of the treatment instrument 30B. Furthermore, the rotary microactuators 6 are controlled based on the insertion information of the treatment part 31 of one of the treatment instrument 30A and the
  • the magnetic encoders 23A and 23B detect the amounts of insertion of the treatment instruments 30A and 30B
  • the swivel-angle detecting sections detect the swivel angles of the swiveling parts 33
  • the insertion- angle detecting section 43 detects the angles of insertion of the trocars 41A and 41B (Step SB11) . Then, the insertion information of each of the treatment instruments 30A and 30B is input to the swivel control section 14.
  • the swivel control section 14 searches, in the control pattern stored in the pattern storage section 17, for a relationship value (pattern) of the convergence angle ⁇
  • Step SB12 drives the rotary microactuators 6 so as to achieve the found convergence angle ⁇ (Step SA13) .
  • the control pattern is stored so as to associate the convergence angle ⁇ , the angle of insertion, the swivel angle, and the distance at which the intersection of the optical axes 7a of the two imaging devices 7 coincides with the treatment part 31 of the treatment instrument 30A or 30B; therefore, by swiveling the swiveling members 5 so as to achieve the
  • Step SA14 to Step SA20 are the same as those in the first embodiment .
  • the swivel control section 14 controls the angles of the swiveling members 5 based on the distance from the treatment part 31 to the imaging devices 7, the swivel angle of the swiveling part 33, and the angle of the trocar 41A or 41B, thereby making it possible to automatically acquire stereoscopic images over the entire treatment region of the treatment part 31 of the treatment instrument 30A or 30B, which is determined by the entire swivel range of the swiveling part 33 and the angle of the trocar 41A or 41B.
  • This embodiment can be modified as described below.
  • swivel control section 14 controls the rotary microactuators 6 based on the insertion information of the treatment instrument 30A or the treatment instrument 30B that is specified in advance by the operator, among the two treatment instruments 30A and 30B; however, in a third modification, whether to use the insertion information of the treatment instrument 30A or 30B may be automatically determined by the swivel control section 14, for example.
  • the image processing section 15 may include a motion detecting section 115 that detects, in the image, the motions of the treatment parts 31 of the treatment instruments 30A and 30B and may input motion information indicating the detected amounts of motion of the treatment parts 31 to the swivel control section 14.
  • the swivel control section 14 selects, from the received motion information, the treatment instrument 30A or the treatment instrument 30B that has a larger amount of motion and drives the rotary microactuators 6 so as to achieve the convergence angle ⁇ corresponding to the insertion information of the selected treatment instrument 30A or treatment
  • an information storage section (not shown) that temporarily stores the motion information output from the motion detecting section 115 may be provided.
  • the swivel control section 14 reads the motion information stored in the information storage section and performs a search in the pattern storage section 17.
  • the image display section 16 has a GUI function, and, when the operator specifies either one of the treatment instruments 30A and 30B on the image display section 16, selection
  • the swivel control section 14 selects the specified treatment instrument 30A or treatment instrument 30B based on the received
  • an information storage section (not shown) that temporarily stores the selection information output from the image display section 16 may be provided.
  • the swivel control section 14 reads the selection information stored in the information storage section and performs a search in the pattern storage section 17. ⁇ 0083 ⁇
  • a stereo-endoscope robot 201 of this embodiment includes the stereo-endoscope system 101, two 3D manipulators (manipulation parts) 203A and 203B, and
  • the 3D manipulators 203A and 203B hold the treatment instrument 30A or the treatment instrument 30B to manipulate the treatment instrument 30A or the treatment instrument 30B through remote manipulation performed by the operator.
  • the operator can perform remote manipulation of the angles of insertion of the trocars 41A and 41B, the amount of insertion of the inserted portion 2, swiveling of the treatment parts 31, and opening and closing of the forceps members 35.
  • the manipulation information includes the amounts of insertion of the treatment instruments 30A and 30B, the swivel angles of the swiveling parts 33, and the angles of the trocars 41A and 41B.
  • the information detecting sections 205A and 205B detect the insertion information of the treatment instruments 30A and 30B, respectively, from the received manipulation information and output it to the swivel control section 14.
  • embodiment can treat the affected site in the subject's body with the 3D manipulators 203A and 203B through remote
  • the swivel control section 14 controls the angles of the swiveling members 5 based on the insertion information of the treatment instrument 30A or 30B, which is detected from the manipulation information of the corresponding one of the 3D manipulators 203A and 203B, thereby making it possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part 31 of the treatment instrument 30A or 30B through remote manipulation.
  • convergence angle a varies linearly with respect to the detected distance; however, it is not limited thereto, and the convergence angle a may vary in a curved manner or vary in a stepwise manner.
  • the relationship between the convergence angle ⁇ and the amount of insertion of the treatment instrument 30, which is converted to the distance from the treatment part 31 to the imaging devices 7 and associated with the convergence angle, is stored in the pattern storage section 17; however, the distance sensor 9 and the tip distance sensor 10 may include a
  • measurement part for measuring the amount of insertion of the treatment part 31 of the treatment instrument 30, 30A, or 30B inserted into the subject's body and a conversion part for converting the amount of insertion measured by the measurement part to the distance from the treatment part 31 of the
  • the treatment instrument 30, 30A, or 30B to the imaging devices 7, and the relationship between the distance and the convergence angle ⁇ may be stored in the pattern storage section 17. Even in this case, it is possible to easily detect the distance from the treatment part 31 of the treatment instrument 30, 30A, or 30B to the imaging devices 7 based on the amount of insertion of the treatment part 31, without directly measuring this distance.
  • the two swiveling members 5 swivel at the same angle in the opposite directions in synchronization with each other; however, instead of this, they may swivel independently at different angles. By doing so, it is possible not only to perform front-view observation of an object A that is located in front of the inserted portion 2 in the longitudinal direction thereof but also to perform inclined-view observation or side- view observation of an object A that is inclined with respect to the longitudinal direction thereof. Furthermore, only one of the swiveling members 5 may be made to swivel.
  • both of the swiveling members 5 may be made to swivel at different angles or swivel in the same direction.
  • tip distance sensor distance detecting unit
  • swivel control section control section

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Physics & Mathematics (AREA)
  • Pathology (AREA)
  • Optics & Photonics (AREA)
  • Robotics (AREA)
  • Signal Processing (AREA)
  • Endoscopes (AREA)
  • Surgical Instruments (AREA)

Abstract

Appropriate stereoscopic images of an affected site are easily acquired. Provided is a stereo-endoscope device that includes an inserted portion (2) that can be inserted into a subject's body; two imaging devices that are disposed on the inserted portion (2) with a space therebetween; driving units (6) that change the relative angle of the optical axes of the imaging devices; a distance sensor for detecting the distance to the imaging devices from a treatment part (31) of a treatment instrument (30) that is inserted into the subject's body and is used to treat the affected site; and a swivel control section that controls the driving units (6) based on insertion information of the treatment instrument (30), the insertion information including the distance detected by the distance sensor.

Description

{DESCRIPTION}
{Title of Invention}
STEREO-ENDOSCOPE DEVICE, STEREO-ENDOSCOPE SYSTEM, AND STEREO- ENDOSCOPE ROBOT
{Technical Field}
{0001}
The present invention relates to a stereo-endoscope device, a stereo-endoscope system, and a stereo-endoscope robot .
{Background Art}
{0002}
There are known conventional technologies for viewing an object stereoscopically with an endoscope used for surgery (see PTL 1, for example) . In a technology described in PTL 1, by deforming ends of a plurality of imaging fibers that are disposed at the tip of an inserted portion inserted into the body, the convergence angle, which is the angle of
intersection of the optical axes of the imaging fibers, is adjusted, thus changing the stereoscopic effect of the acquired image.
{Citation List}
{Patent Literature}
{0003}
{PTL 1} Japanese Unexamined Patent Application, Publication No. Hei 08-94966 {Summary of Invention}
{Technical Problem}
{0004}
However, the technology described in PTL 1 has a
disadvantage in that it is necessary for the observer, such as a doctor, to manually adjust the convergence angle by
deforming the imaging fibers while viewing the monitor, and, when the observer has his/her hands full during surgery etc., it is difficult to acquire an appropriate stereoscopic image in accordance with the movement of the object.
{0005}
An object of the present invention is to provide a stereo-endoscope device, a stereo-endoscope system, and a stereo-endoscope robot capable of easily acquiring appropriate stereoscopic images of an affected site.
{Solution to Problem}
{0006}
In order to achieve the above-described object, the present invention provides the following solutions.
According to a first aspect, the present invention provides a stereo-endoscope device including: an inserted portion that can be inserted into a subject's body; two imaging devices that are disposed on the inserted portion with a space therebetween; an angle changing mechanism that changes a relative angle of optical axes of the imaging devices; a distance detecting unit for detecting the distance to the imaging devices from a treatment part of a medical device that is inserted into the subject's body and is used to treat an affected site; and a control section that controls the angle changing mechanism based on insertion information of the medical device, the insertion information including the distance detected by the distance detecting unit.
{0007}
According to this aspect, the inserted portion is
inserted into the subject's body, and the two imaging devices are actuated, thereby making it possible to acquire
stereoscopic images of the affected site in the subject's body. In this case, when the medical device is inserted into the subject's body, the distance detecting unit detects the distance from the treatment part of the medical device to the imaging devices, and the control section controls the angle changing mechanism based on the detected distance.
{0008}
Specifically, since the angle changing mechanism changes the relative angle of the optical axes of the two imaging devices, the control section adjusts the convergence angle of the two imaging devices according to the distance from the treatment part of the medical device to the imaging devices. Thus, it is possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part of the medical device, at the affected site in the subject's body.
{0009}
In the above-described aspect, the distance detecting unit may include a measurement part that measures the amount of insertion of the treatment part of the medical device inserted into the subject's body and a conversion part that converts the amount of insertion measured by the measurement part to the distance from the treatment part of the medical device to the imaging devices.
With this structure, it is possible to easily detect the distance from the treatment part of the medical device to the imaging devices based on the amount of insertion of the treatment part of the medical device, without directly
measuring this distance.
{0010}
In the above-described aspect, the control section may control the angle changing mechanism such that an intersection of the optical axes of the imaging devices coincides with the position of the treatment part of the medical device.
With this structure, . the intersection of the optical axes of the imaging devices can be made to coincide with the treatment part of the medical device based on the distance detected by the distance detecting unit. Thus, it is possible to automatically acquire appropriate stereoscopic images with a central focus on the treatment region of the treatment part of the medical device.
{0011}
In the above-described aspect, the angle changing
mechanism may include, at a tip of the inserted portion, a pair of swiveling members attached so as to be capable of swiveling on shafts that extend in a direction intersecting with the longitudinal axis of the inserted portion and driving units for swiveling the pair of swiveling members, and the imaging devices may be attached to the swiveling members.
{0012}
With this structure, by actuating the driving units, constituting the angle changing mechanism, to swivel the pair of swiveling members, the relative angle of the optical axes of the two imaging devices can be easily changed.
{0013}
In the above-described aspect, the driving units may swivel the pair of swiveling members between closed positions in which the pair of swiveling members extend in the direction of the longitudinal axis of the inserted portion and are close to each other and open positions in which the pair of
swiveling members extend in directions intersecting with the longitudinal axis of the inserted portion and are away from each other.
{0014 } With this structure, in inserting the inserted portion into the subject's body, the swiveling members are located at the closed positions to be along the longitudinal direction of the inserted portion, thereby reducing the cross-sectional area to make the insertion easier. Furthermore, after the tip of the inserted portion is inserted into the subject's body, the swiveling members are made to swivel to be located at the open positions, thus ensuring a space between the imaging devices and making it easier to form a large convergence angle .
{0015}
According to a second aspect, the present invention provides a stereo-endoscope system including: one of the above-described stereo-endoscope devices; the medical device that has a swiveling part capable of swiveling the treatment part on a shaft extending in a direction intersecting with the longitudinal axis of the medical device; and a swivel-angle detecting section that detects a swivel angle of the swiveling part of the medical device, in which the control section controls the angle changing mechanism based on insertion information of the medical device, the insertion information including the swivel angle detected by the swivel-angle detecting section.
{0016}
According to this aspect, by swiveling the swiveling part of the medical device, the treatment region of the treatment part at the affected site in the subject's body can be
changed. In this case, the control section controls the angle changing mechanism based on the swivel angle of the swiveling part of the medical device detected by the swivel-angle detecting section, thereby making it possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part over the entire swivel range of the swiveling part of the medical device.
{0017}
In the above-described aspect, the stereo-endoscope system may further include: an inserted member that has a through-hole into which the medical device can be inserted; and an insertion-angle detecting section that detects an angle of a central axis of the through-hole of the inserted member, and the control section may control the angle changing
mechanism based on insertion information of the medical device, the insertion information including the angle detected by the insertion-angle detecting section.
{0018}
With this structure, by changing the angle of the central axis of the through-hole of the inserted member, the treatment region of the treatment part of the medical device at the affected site in the subject's body can be changed. In this case, the control section controls the angle changing mechanism based on the angle of the central axis of the through-hole of the inserted member detected by the insertion- angle detecting section, thereby making it possible to
automatically acquire stereoscopic images of the entire treatment region of the treatment part of the medical device, which is determined by the angle of the central axis of the through-hole of the inserted member.
{0019}
In the above-described aspect, the stereo-endoscope system may further include: at least one medical device identical to said medical device; and a motion detecting section that detects motions of the treatment parts of the medical devices, and the control section may control the angle changing mechanism based on the distance to the imaging devices from the treatment part of the medical device whose treatment part has the largest amount of motion detected by the motion detecting section.
{0020}
Among the plurality of medical devices, the medical device whose treatment part has the largest amount of motion is considered to be the one being manipulated by the operator. Therefore, with this structure, it is possible, in an
automatic manner, to preferentially acquire stereoscopic images with a central focus on the treatment region of the treatment part of the medical device that the operator focuses on, among the plurality of medical devices.
{0021}
According to a third aspect, the present invention provides a stereo-endoscope robot including: one of the above- described stereo-endoscope systems; a manipulation part that manipulates the medical device through remote manipulation performed by an operator; and an information detecting section that detects the insertion information of the medical device from manipulation information of the medical device
manipulated by the manipulation part, in which the control section controls the angle changing mechanism based on the insertion information of the medical device detected by the information detecting section.
{0022}
According to this aspect, the affected site in the subject's body can be treated via the manipulation part through remote manipulation performed by the operator. In this case, the control section controls the angle changing mechanism based on the insertion information of the medical device detected by the information detecting section from the manipulation information of the manipulation part, thereby making it possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part of the medical device through remote
manipulation. {Advantageous Effects of Invention}
{0023}
According to the present invention, an advantage is afforded in that appropriate stereoscopic images of the affected site can be easily acquired.
{Brief Description of Drawings}
{0024}
{Fig. 1} Fig. 1 is a view showing the overall structure of a stereo-endoscope device according to a first embodiment of the present invention.
{Fig. 2A} Fig. 2A is a front view of an inserted portion viewed in a radial direction when swiveling members of the stereo-endoscope device shown in Fig. 1 are located at closed positions .
{Fig. 2B} Fig. 2B is a front view of the inserted portion shown in Fig. 2A viewed from the tip thereof.
{Fig. 3A} Fig. 3A is a front view of the inserted portion viewed in a radial direction when the swiveling members of the stereo-endoscope device shown in Fig. 1 are located at open positions. a
{Fig. 3B} Fig. 3B is a front view of the inserted portion shown in Fig. 3A viewed from the tip thereof.
{Fig. 4} Fig. 4 is a front view showing a state in which a treatment instrument protrudes from a channel of the inserted portion shown in Fig. 3A. {Fig. 5} Fig. 5 is a view showing the overall structure of the treatment instrument shown in Fig. 4.
{Fig. 6} Fig. 6 is a functional block diagram of the stereo- endoscope device shown in Fig. 1.
{Fig. 7} Fig. 7 is a view showing an insertion state in which the inserted portion of the stereo-endoscope device shown in Fig. 1 is inserted into a body, and the swiveling members are located at the closed positions.
{Fig. 8} Fig. 8 is a view showing a state in which the swiveling members are located at the open positions.
{Fig. 9} Fig. 9 is a graph showing an example control pattern showing the relationship between the distance and the
convergence angle, stored in a pattern storage section shown in Fig. 6.
{Fig. 10} Fig. 10 is a flowchart for explaining an
observation procedure with use of the stereo-endoscope device shown in Fig. 1.
{Fig. 11} Fig. 11 is the flowchart for explaining the
observation procedure continuing from Fig. 10.
{Fig. 12} Fig. 12 is a front view showing an inserted portion according to a first modification of the first embodiment of the present invention.
{Fig. 13} Fig. 13 is a longitudinal sectional view of the inserted portion shown in Fig. 12.
{Fig. 14} Fig. 14 is a view showing the overall structure of a stereo-endoscope system according to a second embodiment of the present invention.
{Fig. 15} Fig. 15 is a flowchart for explaining an
observation procedure with use of the stereo-endoscope device shown in Fig. 14.
{Fig. 16} Fig. 16 is a view showing the overall structure of a stereo-endoscope system according to a third modification of the second embodiment of the present invention.
{Fig. 17} Fig. 17 is a view showing the overall structure of a stereo-endoscope system according to a fourth modification of the second embodiment of the present invention.
{Fig. 18} Fig. 18 is a view showing the overall structure of a stereo-endoscope robot according to a third embodiment of the present invention.
{Description of Embodiments}
{0025}
First Embodiment
A stereo-endoscope device according to a first embodiment of the present invention will be described below with
reference to the drawings.
As shown in Fig. 1, a stereo-endoscope device 1 of this embodiment includes an elongated inserted portion 2 that can be inserted into the body of a patient (subject's body) and a main system 3 that is connected to the inserted portion 2.
{0026} The inserted portion 2 has, on the tip thereof, two shafts (rotational axes) 4 that extend parallel to each other in a direction perpendicular to a longitudinal axis of the inserted portion 2 and two swiveling members (angle changing mechanism) 5 that are supported so as to be capable of swiveling on these shafts 4.
{0027}
Rotary microactuators (driving units, angle changing mechanism) 6 that rotate the shafts 4 are provided at base ends of the swiveling members 5. When the two rotary
microactuators 6 are synchronized to rotate the shafts 4 in opposite directions, the swiveling members 5 are made to swivel between closed positions in which they are located close to each other in the direction of the longitudinal axis of the inserted portion 2, as shown in Figs. 2A and 2B, and open positions in which they are located away from each other in directions intersecting with the longitudinal axis of the inserted portion 2, as shown in Figs. 3A and 3B.
{0028}
The swiveling members 5 include distance sensors
(distance detecting units) 9, illumination devices 8, and imaging devices 7 that face each other when the swiveling members 5 are located at the closed positions.
The imaging devices 7 are, for example, CCDs or CMOS imagers having optical axes 7a (see Fig. 8) that are perpendicular to longitudinal axes of the swiveling members 5.
The illumination devices 8 are, for example, LEDs that emit illumination light in directions intersecting with the longitudinal axes of the swiveling members 5.
{0029}
The distance sensor 9 includes, for example, a light emitting device 9a that is provided on one of the swiveling members 5 and a light receiving device 9b that is provided on the other one of the swiveling members 5.
Light emitted from the light emitting device 9a is reflected on an object A (see Fig. 4 etc.), such as an
affected site, of a patient and is received by the light receiving device 9b. The amount of light received by the light receiving device 9b is small when the distance is long and is large when the distance is short; therefore, the distance from the distance sensor 9 to the object A can be detected based on the amount of received light.
{0030}
Furthermore, the swiveling members 5 have, at the tips thereof, a tip distance sensor (distance detecting unit) 10 that detects the distance from the object A to the swiveling members 5 in the state where the swiveling members 5 are located at the closed positions. Like the distance sensor 9, the tip distance sensor 10 includes a light emitting device 10a and a light receiving device 10b. {0031}
Furthermore, the inserted portion 2 is provided with a channel 21 that passes through the inserted portion 2 along the longitudinal axis thereof and a magnetic encoder 23 (see Fig. 4) that is disposed near the channel 21.
The channel 21 has an opening 21a between the two shafts 4, which are provided at the tip of the inserted portion 2. As shown in Fig. 4, the inserted portion 2 is structured such that a treatment instrument (medical device) 30 can be
inserted into the channel 21 and made to move out of and into the opening 21a.
{0032}
As shown in Fig. 5, the treatment instrument 30 includes, for example, a treatment part 31 that is used to treat the affected site of the patient, a manipulation part 37 that is grasped by an operator to manipulate the treatment part 31, and a shaft part 39 that connects the treatment part 31 and the manipulation part 37.
{0033}
The treatment part 31 includes a swiveling part 33 that is provided at the tip of the shaft part 39 so as to be capable of swiveling on a swivel shaft that extends in a direction intersecting with the long axis of the shaft part 39 and a pair of forceps members 35 that extend from the
swiveling part 33 toward the distal end and that can be opened and closed with an opening-and-closing shaft that extends parallel to the above-described swivel shaft of the swiveling part 33.
{0034}
The operator can manipulate the manipulation part 37 to swivel the swiveling part 33 and to open and close the pair of forceps members 35.
The shaft part 39 is provided with a plurality of
magnetic codes 39A that are formed of a magnetic material and arranged at regular intervals in the longitudinal direction thereof .
{0035}
The magnetic encoder 23 produces a magnetic field and reads the magnetism that changes when the magnetic codes 39A on the treatment instrument 30 pass through the magnetic field, thereby detecting the amount of insertion of the treatment instrument 30. The detected amount of insertion of the treatment instrument 30 is sent to the main system 3 as insertion information. The amount of insertion of the
treatment instrument 30 corresponds to the amount of
protrusion of the treatment part 31 of the treatment
instrument 30 from the opening 21a of the channel 21 in the inserted portion 2, for example.
{0036}
As shown in Fig. 6, the main system 3 includes a sensor control section 11 that controls the distance sensor 9 and the tip distance sensor 10, an illumination control section 12 that controls lighting of the illumination devices 8, an image-acquisition control section 13 that controls image acquisition performed by the imaging devices 7, a swivel control section (control section) 14 that controls the angles of the swiveling members 5, an image processing section 15 that processes image signals acquired by the imaging devices - 7, an image display section 16 that displays images processed by the image processing section 15, a pattern storage section 17 that stores a control pattern associating the distance and the convergence angle in the form of a LUT (look-up table), and the manipulation part 37 manipulated by the operator.
{0037}
The swivel control section 14 switches between an
observation mode and a treatment mode based on the insertion information of the treatment instrument 30 sent from the magnetic encoder 23. Specifically, the swivel control section 14 sets the observation mode when it receives insertion information indicating a state in which the amount of
insertion of the treatment instrument 30 is zero, that is, a state in which the treatment part 31 of the treatment
instrument 30 is accommodated in the channel 21 of the
inserted portion 2. Furthermore, the swivel control section 14 sets the treatment mode when it receives insertion information indicating a state in which the amount of insertion of the treatment instrument 30 is not zero, that is, a state in which the treatment part 31 of the treatment instrument 30 protrudes from the channel 21 of the inserted portion 2. For example, in the observation mode, the inserted portion 2 is inserted into the body of the patient and is located at a desired position, and, in the treatment mode, the treatment instrument 30 is used to treat the affected site of the patient.
{0038}
In the observation mode, the swivel control section 14 actuates the tip distance sensor 10 at the time of insertion during which the swiveling members 5 are located at the closed positions, as shown in Fig. 7, and actuates the distance sensor 9 when the swiveling members 5 are located at the open positions, as shown in Fig. 8.
{0039}
The light receiving devices 9b and 10b, which constitute the distance sensor 9 and the tip distance sensor 10,
respectively, each output a voltage signal corresponding to the amount of received light, to the swivel control section 14. The swivel control section 14 monitors the voltage signal sent from the light receiving device 10b, constituting the tip distance sensor 10, at the time of insertion during which the swiveling members 5 are located at the closed positions. Then, when the voltage signal exceeds a stored predetermined threshold, that is, when the distance between the tips of the swiveling members 5 and the object A reaches a predetermined distance, the swivel control section 14 actuates the rotary microactuators 6 to make the swiveling members 5 swivel from the closed positions to initial open positions.
{0040}
Furthermore, after the swiveling members 5 are made to swivel to the initial open positions, the swivel control section 14 outputs start-up signals to the sensor control section 11, the illumination control section 12, and the image-acquisition control section 13.
Upon reception of the start-up signal, the sensor control section 11 drives the distance sensor 9, instead of the tip distance sensor 10, to make the distance sensor 9 detect the distance to the object A.
{0041}
Upon reception of the start-up signal, the illumination control section 12 actuates the illumination devices 8. Upon reception of the start-up signal, the image-acquisition control section 13 actuates the imaging devices 7.
Furthermore, when the voltage signal is .received from the light receiving device 9b constituting the distance sensor 9, the swivel control section 14 calculates the distance
corresponding to the received voltage signal and searches for a convergence angle a corresponding to this distance, in the control pattern stored in the pattern storage section 17.
Then, the swivel control section 14 drives the rotary
microactuators 6 so as to achieve the found convergence angle a.
{0042}
The control pattern stored in the pattern storage section 17 has a linear relationship between the distance and the convergence angle a, as shown in Fig. 9, for example. In this relationship, at a position coincident with the surface of the object A, which is located respective distances away from the imaging devices 7, the optical axes 7a of the two imaging devices 7 intersect at a corresponding convergence angle.
Furthermore, the pattern storage section 17 stores the relationship between a convergence angle β and the amount of insertion of the treatment instrument 30, which is converted to the distance from the treatment part 31 to the imaging devices 7 and then associated with the convergence angle.
{0043}
By using the convergence angle a found from the control pattern based on the distance detected by the distance sensor 9, the swivel control section 14 calculates the angles of the swiveling members 5 for achieving the found convergence angle a and performs control such that the shafts 4 of the rotary microactuators 6 are rotated to these angles from the initial open positions.
{0044}
On the other hand, in the treatment mode, when the insertion information of the treatment instrument 30 is received from the magnetic encoder 23, the swivel control section 14 searches, in the control pattern stored in the pattern storage section 17, for the convergence angle β
corresponding to the amount of insertion of the treatment instrument 30 and drives the rotary microactuators 6 so as to achieve the found convergence angle β .
{0045}
The behavior of the thus-structured stereo-endoscope device 1 of this embodiment will be described below with reference to a flowchart shown in Figs. 10 and 11.
To observe the object A in the body by using the stereo- endoscope device 1 of this embodiment, first, the rotary microactuators 6 are actuated to locate the two swiveling members 5 at the closed positions shown in Figs. 2A and 2B. In this state, as shown in Fig. 7, the inserted portion 2 is inserted, starting from the tips of the swiveling members 5, into the space in the body via a through-hole of a trocar D located in an opening C that is formed to penetrate a body surface tissue B (Step SA1). At this time, the swivel control section 14 has set the observation mode.
{0046} Next, the sensor control section 11 actuates the light emitting device 10a and the light receiving device 10b of the tip distance sensor 10. Then, a voltage signal indicating the amount of light emitted from the light emitting device 10a, reflected on the object A in the body, and then received by the light receiving device 10b is input to the swivel control section 14, and the swivel control section 14 determines the distance (Step SA2) .
{0047}
If the distance detected by the tip distance sensor 10 becomes smaller than a predetermined distance J ("Yes" in Step SA3) , at this position, the swivel control section 14 actuates the rotary microactuators 6 to make the two swiveling members 5 swivel to the predetermined initial open positions, as shown in Fig. 8 (Step SA ) .
{0048}
Furthermore, at the same time that the swivel control section 14 makes the swiveling members 5 swivel to the initial open positions, the swivel control section 14 outputs start-up signals to the sensor control section 11, the illumination control section 12, and the image-acquisition control section 13 (Step SA5) . Upon reception of the start-up signal, the sensor control section 11 stops the tip distance sensor 10 that has been activated and actuates the light emitting device 9a and the light receiving device 9b of the distance sensor 9. {0049}
Upon reception of the start-up signal, the illumination control section 12 actuates the illumination devices 8 to radiate illumination light onto the object A. Upon reception of the start-up signal, the image-acquisition control section 13 actuates the two imaging devices 7 to acquire image signals. The image signals acquired by the two imaging devices 7 are displayed on the image display section 16 via the image processing section 15. Thus, two types of images of the object A acquired from two directions, namely, the right and left directions, are obtained (Step SA6) .
{0050}
The voltage signal corresponding to the amount of light received by the light receiving device 9b of the distance sensor 9 is sent to the swivel control section 14, and the distance is calculated therein (Step SA7) . The swivel control section 14 uses the calculated distance to search, in the control pattern stored in the pattern storage section 17, for the corresponding convergence angle a and calculates the angles of the swiveling members 5 for achieving the found convergence angle a. Then, the swivel control section 14 actuates the rotary microactuators 6 until the swiveling members 5 swivel so as to achieve the calculated angles (Step SA8) .
{0051} The control pattern is stored so as to associate the convergence angle a and the distance at which the intersection of the optical axes 7a of the two imaging devices 7 coincides with the surface of the object A; therefore, by swiveling the swiveling members 5 so as to achieve the convergence angle a corresponding to the detected distance, it is possible to acquire two images of the object A viewed from two directions, namely, the right and left directions, with the intersection of the optical axes 7a of the two imaging devices 7 always coinciding with the surface of the object A.
{0052}
Then, as shown in Fig. 4, when the treatment instrument 30 is made to protrude from the channel 21 of the inserted portion 2 and inserted into the body of the patient (Step SA9) , the magnetic encoder 23 inputs, to the swivel control section 14, insertion information indicating that the amount of insertion of the treatment instrument 30 is not zero, and the swivel control section 14 switches to the treatment mode (Step SA10). Then, when the treatment instrument 30 is located near the affected site of the patient, the magnetic encoder 23 detects the amount of insertion of the treatment instrument 30 (Step SA11) and inputs the insertion information of the treatment instrument 30 to the swivel control section 14.
{0053} The swivel control section 14 searches, in the control pattern stored in the pattern storage section 17, for the relationship value (pattern) of the convergence angle β
corresponding to the amount of insertion of the treatment instrument 30 (Step SA12) and drives the rotary microactuators 6 so as to achieve the found convergence angle β (Step SA13) . {0054}
The control pattern is stored so as to associate the convergence angle β and the distance at which the intersection of the optical axes 7a of the two imaging devices 7 coincides with the treatment part 31 of the treatment instrument 30;
therefore, by swiveling the swiveling members 5 so as to achieve the convergence angle β corresponding to the detected distance, it is possible to acquire two images of the object A viewed from two directions, namely, the right and left
directions, with the intersection of the optical axes 7a of the two imaging devices 7 always coinciding with the treatment part 31 of the treatment instrument 30.
{0055}
Until the amount of insertion of the treatment instrument 30, detected by the magnetic encoder 23, becomes zero, that is, until the treatment part 31 of the treatment instrument 30 is accommodated in the channel 21 of the inserted portion 2 (Step SA14), detection of the amount of insertion, reading of the control pattern, and adjustment of the convergence angle β , which are performed in Steps SA11 to SA13, are repeated. Thereafter, once the treatment instrument 30 is accommodated in the channel 21 ("Yes" in Step SA14), the swivel control section 14 switches to the observation mode (Step SA15) .
{0056}
Based on the relationship value for control of the swivel angles of the swiveling members 5 with respect to the amount of change in the distance, which is stored in advance, the swivel control section 14 drives the rotary microactuators 6 according to the amount of change in the distance from the treatment part 31 of the treatment instrument 30 to the imaging devices 7 (Step SA16) . Then, if the inserted portion 2 is withdrawn, so that the distance to the object A is equal to or .larger ..than the .predetermined distance J ("Yes" in Step SA17), the swivel control section 14 outputs signals
indicating the end of image acquisition, to the illumination control section 12 and the image-acquisition control section 13 (Step SA18). Thus, the illumination devices 8 and the imaging devices 7 are stopped, thus ending image acquisition. {0057}
Next, the swivel control section 14 actuates the rotary microactuators 6 to locate the two swiveling members 5 at the closed positions (Step SA19) and instructs the sensor control section 11 to stop the distance sensor 9 and actuate the tip distance sensor 10. Thus, the inserted portion 2 and the swiveling members 5 can be withdrawn from the body via the trocar D (Step SA20) .
{0058}
In this way, according to the stereo-endoscope device 1 of this embodiment, when the treatment instrument 30 is inserted into the subject's body, the swiveling members 5 are made to swivel based on the distance from the treatment part 31 to the imaging devices 7 corresponding to the amount of insertion of the treatment instrument 30 detected by the magnetic encoder 23, thereby adjusting the convergence angle such that the intersection of the optical axes 7a of the two imaging devices 7 always coincides with the treatment part 31 Thus, it is possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part 31 of the treatment instrument 30 at the affected site in the subject's body, without the observer, such as a doctor, having to manually adjust the convergence angle β while viewing the image display section 16.
{0059}
This embodiment can be modified as described below.
For example, in this embodiment, a description has been given of an example structure in which a single treatment instrument 30 is provided; however, in a first modification, two treatment instruments 30 may be used, as shown in Figs. 1 and 13. {0060}
In this case, the inserted portion 2 includes channels 21A and 21B that are parallel to each other and magnetic encoders 23A and 23B that are disposed near the channels 21A and 21B, respectively, and the magnetic encoders 23A and 23B detect the amounts of insertion of the treatment instruments 30A and 30B into the channels 21A and 21B, respectively.
{0061}
Furthermore, the amounts of motion of the treatment parts 31 may be detected from image processing and the swivel angles of the swiveling parts 33, and the swivel angles of the swiveling members 5 may be adjusted based on the distance to the imaging devices 7 from the treatment part 31 of the treatment instrument 30A or 30B having a larger amount of motion. Alternatively, the operator may manually select one of the treatment instruments 30A and 30B and adjust the swivel angles of the swiveling members 5 based on the insertion information sent from the corresponding magnetic encoder 23A or 23B that detects the amount of insertion of the selected treatment instrument 30A or 30B.
It is assumed that the channels 21A and 21B correspond to the channel 21, the magnetic encoders 23A and 23B correspond to the magnetic encoder 23, and the treatment instruments 30A and 30B correspond to the treatment instrument 30.
{0062} .
29
When the plurality of treatment instruments 30A and 30B are used, the treatment instrument 30Ά or the treatment instrument 30B whose treatment part 31 has the largest amount of motion is considered to be the one being manipulated by the operator. According to this modification, it is possible, in an automatic manner, to preferentially acquire stereoscopic images with a central focus on the treatment region of the treatment part 31 of the treatment instrument 30A or the treatment instrument 30B that the operator focuses on, among the plurality of treatment instruments 30A and 30B.
{0063}
In this embodiment and the first modification, a
description has been given of an example case where only the amount of insertion of the treatment instrument 30 is used as insertion information; however, in a second modification, the amount of insertion of the treatment instrument 30 and the swivel angle of the swiveling part 33 may be used as insertion information. In this case, a swivel-angle detecting section (not shown) that detects the swivel angle of the swiveling part 33 is provided on the treatment instrument 30, and the detected swivel angle is input to the swivel control section 14.
{0064}
By swiveling the swiveling part 33 of the treatment instrument 30, the treatment region of the treatment part 31 at the affected site of the patient can be changed without changing the position of the inserted portion 2. According to this modification, the swivel control section 14 adjusts the swivel angles of the swiveling members 5 based on the swivel angle of the swiveling part 33 in addition to the amount of insertion of the treatment instrument 30, thereby making it possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part 31 over the entire swivel range of the swiveling part 33 of the treatment instrument 30.
{0065}
Second Embodiment
Next, a stereo-endoscope system according to a second embodiment of the present invention will be described.
As shown in Fig. 14, a stereo-endoscope system 101 of this embodiment includes the stereo-endoscope device 1, the two treatment instruments (medical devices) 30A and 30B, trocars (inserted members) 41A and 41B for inserting the treatment instruments 30A and 30B into the body of the
patient, and an insertion-angle detecting section 43 that detects the angles of insertion of the treatment instruments 30A and 30B.
Hereinafter, identical symbols are assigned to parts having the same structures as those in the stereo-endoscope device 1 according to the first embodiment, and a description thereof will be omitted.
{0066}
The trocars 41A and 4 IB are substantially-tubular members having through-holes into which the treatment instruments 30A and 30B can be inserted. By inserting the trocars 41A and 41B into holes incised in the surface of the patient's body, the treatment instruments can be inserted into the body of the patient. With the trocars 41A and 41B inserted into the surface of the patient's body, the angles of insertion of the trocars 41A and 41B into the body surface can be changed by using the body surface as supporting points. Furthermore, the trocars 41A and 41B are respectively provided with magnetic encoders 23A and 23B that are located near the through-holes. {0067 }
The treatment instruments 30A and 30B are inserted into the body of the patient via the trocars 41A and 41B,
respectively. The treatment instruments 30A and 30B are provided with swivel-angle detecting sections (not shown) for detecting the swivel angles of the swiveling parts 33. The swivel angles detected by the swivel-angle detecting sections are input to the swivel control section 14.
{0068}
The insertion-angle detecting section 43 includes three cameras 45A, 45B, and 45C that acquire images of the trocars 41A and 41B inserted into the surface of the patient's body and an analysis section (not shown) that analyzes the images acquired by the cameras 45A, 45B, and 45C to detect the angles of the central axes of the through-holes of the trocars 41A and 41B (hereinafter, simply referred to as "the angles of the trocars 41A and 41B"). The angles of the trocars 41A and 41B detected by the analysis section are input to the swivel control section 14 as insertion information.
{0069}
The swivel control section 14 controls the rotary
microactuators 6 based on the insertion information of the treatment instruments 30A and 30B, the insertion information including the amounts of insertion of the treatment
instruments 30A and 30B, which are sent from the magnetic encoders 23A and 23B, the swivel angles of the swiveling parts 33, which are sent from the swivel-angle detecting sections, and the angles of the trocars 41A and 41B, which are sent from the analysis section of the insertion-angle detecting section 43.
{0070}
Specifically, the pattern storage section 17 stores the relationship between the convergence angle β and the insertion information of each of the treatment instruments 30A and 30B, which is obtained after the amount of insertion of the
corresponding treatment instrument 30A and 30B, the swivel angle of the corresponding swiveling part 33, and the angle of the corresponding one of the trocars 41A and 41B are converted to the distance from the corresponding treatment part 31 to the imaging devices 7 and then associated with the convergence angle. Based on the insertion information of one of the treatment instruments 30A and 30B specified by the user, the swivel control section 14 drives the rotary microactuators 6 so as to achieve the convergence angle β corresponding to that insertion information included in control pattern.
{0071}
The behavior of the thus-structured stereo-endoscope system 101 of this embodiment will be described below with reference to a flowchart shown in Fig. 15.
To perform suturing while observing the affected site of the patient by using the stereo-endoscope system 101 of this embodiment, the stereo-endoscope device 1 is inserted into the body of the patient, and the trocars 41A and 41B are inserted into the body surface B of the patient. Since the observation mode is the same as that in the first embodiment, a
description thereof will be omitted.
{0072}
After the inserted portion 2 of the stereo-endoscope device 1 is located at a desired position in the body of the patient, when the treatment instruments 30A and 30B are inserted into the body of the patient via the trocars 41A and 41B, respectively, the magnetic encoders 23A and 23B output the insertion information of the treatment instruments 30A and 30B, respectively, and the swivel control section 14 switches to the treatment mode (Step SA10) .
{0073}
In this embodiment, for example, the affected site of the patient is grasped with the treatment instrument 30A, and a needle is held with the treatment part 31 of the treatment instrument 30B. Furthermore, the rotary microactuators 6 are controlled based on the insertion information of the treatment part 31 of one of the treatment instrument 30A and the
treatment instrument 30B selected by the operator.
{0074}
In the treatment mode, the magnetic encoders 23A and 23B detect the amounts of insertion of the treatment instruments 30A and 30B, the swivel-angle detecting sections detect the swivel angles of the swiveling parts 33, and the insertion- angle detecting section 43 detects the angles of insertion of the trocars 41A and 41B (Step SB11) . Then, the insertion information of each of the treatment instruments 30A and 30B is input to the swivel control section 14.
{0075}
The swivel control section 14 searches, in the control pattern stored in the pattern storage section 17, for a relationship value (pattern) of the convergence angle β
corresponding to the amount of insertion of the treatment instrument 30A or 30B, the swivel angle of the corresponding swiveling part 33, and the angle of insertion of the
corresponding one of the trocars 41A and 41B (Step SB12) and drives the rotary microactuators 6 so as to achieve the found convergence angle β (Step SA13) .
{0076}
The control pattern is stored so as to associate the convergence angle β , the angle of insertion, the swivel angle, and the distance at which the intersection of the optical axes 7a of the two imaging devices 7 coincides with the treatment part 31 of the treatment instrument 30A or 30B; therefore, by swiveling the swiveling members 5 so as to achieve the
convergence angle β corresponding to the detected distance, swivel angle, and angle of insertion, it is possible to acquire two images of the object A viewed from two directions, namely, the right and left directions, with the intersection of the optical axes 7a of the two imaging devices 7 always coinciding with the treatment part 31 of the treatment
instrument 30A or 30B.
Step SA14 to Step SA20 are the same as those in the first embodiment .
{0077 }
According to the stereo-endoscope system 101 of this embodiment, by swiveling the swiveling part 33 of the
treatment instrument 30A or 30B or by changing the angle of the trocar 41A or 41B, it is possible to change the treatment region of the treatment part 31 of the treatment instrument 30A or 30B at the affected site of the patient. The swivel control section 14 controls the angles of the swiveling members 5 based on the distance from the treatment part 31 to the imaging devices 7, the swivel angle of the swiveling part 33, and the angle of the trocar 41A or 41B, thereby making it possible to automatically acquire stereoscopic images over the entire treatment region of the treatment part 31 of the treatment instrument 30A or 30B, which is determined by the entire swivel range of the swiveling part 33 and the angle of the trocar 41A or 41B.
{0078}
This embodiment can be modified as described below.
In this embodiment, the swivel control section 14
controls the rotary microactuators 6 based on the insertion information of the treatment instrument 30A or the treatment instrument 30B that is specified in advance by the operator, among the two treatment instruments 30A and 30B; however, in a third modification, whether to use the insertion information of the treatment instrument 30A or 30B may be automatically determined by the swivel control section 14, for example.
{0079}
Specifically, as shown in Fig. 16, the image processing section 15 may include a motion detecting section 115 that detects, in the image, the motions of the treatment parts 31 of the treatment instruments 30A and 30B and may input motion information indicating the detected amounts of motion of the treatment parts 31 to the swivel control section 14. In this case, the swivel control section 14 selects, from the received motion information, the treatment instrument 30A or the treatment instrument 30B that has a larger amount of motion and drives the rotary microactuators 6 so as to achieve the convergence angle β corresponding to the insertion information of the selected treatment instrument 30A or treatment
instrument 30B, included in the control pattern.
{0080}
By doing so, it is possible to acquire, while
automatically giving priority to and automatically switching to, stereoscopic images with a central focus on the treatment region of the treatment part 31 of the treatment instrument 30A or the treatment instrument 30B that the operator focuses on, among the two treatment instruments 30A and 30B.
In this modification, an information storage section (not shown) that temporarily stores the motion information output from the motion detecting section 115 may be provided. In this case, the swivel control section 14 reads the motion information stored in the information storage section and performs a search in the pattern storage section 17.
{0081} Furthermore, in a fourth modification, as shown in Fig. 17, the image display section 16 has a GUI function, and, when the operator specifies either one of the treatment instruments 30A and 30B on the image display section 16, selection
information indicating the specified treatment instrument 30A or treatment instrument 30B is input to the swivel control section 14 through the GUI function. In this case, the swivel control section 14 selects the specified treatment instrument 30A or treatment instrument 30B based on the received
selection information and drives the rotary microactuators 6 so as to achieve the convergence angle β corresponding to the insertion information of the selected treatment instrument 30A or 30B, included in the control pattern.
{0082}
By doing so, it is possible to acquire, while
automatically giving priority to and automatically switching to, stereoscopic images with a central focus on the treatment region of the treatment part 31 of the desired treatment instrument 30A or treatment instrument 30B that the operator focuses on, among the two treatment instruments 30A and 30B.
In this modification, an information storage section (not shown) that temporarily stores the selection information output from the image display section 16 may be provided. In this case, the swivel control section 14 reads the selection information stored in the information storage section and performs a search in the pattern storage section 17. {0083}
Third Embodiment
Next, a stereo-endoscope robot according to a third embodiment of the present invention will be described.
As shown in Fig. 18, a stereo-endoscope robot 201 of this embodiment includes the stereo-endoscope system 101, two 3D manipulators (manipulation parts) 203A and 203B, and
information detecting sections 205A and 205B.
Hereinafter, identical reference symbols are assigned to parts having the same structures as those in the stereo- endoscope device 1 of the first embodiment and the stereo- endoscope system 101 of the second embodiment, and a
description thereof will be omitted.
{008 }
The 3D manipulators 203A and 203B hold the treatment instrument 30A or the treatment instrument 30B to manipulate the treatment instrument 30A or the treatment instrument 30B through remote manipulation performed by the operator.
Specifically, with the 3D manipulators 203A and 203B, the operator can perform remote manipulation of the angles of insertion of the trocars 41A and 41B, the amount of insertion of the inserted portion 2, swiveling of the treatment parts 31, and opening and closing of the forceps members 35.
{0085} Manipulation information about manipulation of the treatment instruments 30A and 30B performed with the 3D manipulators 203A and 203B is input to the information
detecting sections 205A and 205B, respectively.
The manipulation information includes the amounts of insertion of the treatment instruments 30A and 30B, the swivel angles of the swiveling parts 33, and the angles of the trocars 41A and 41B.
The information detecting sections 205A and 205B detect the insertion information of the treatment instruments 30A and 30B, respectively, from the received manipulation information and output it to the swivel control section 14.
{0086}
The thus-structured endoscope robot 201 of this
embodiment can treat the affected site in the subject's body with the 3D manipulators 203A and 203B through remote
manipulation performed by the operator. In this case, the swivel control section 14 controls the angles of the swiveling members 5 based on the insertion information of the treatment instrument 30A or 30B, which is detected from the manipulation information of the corresponding one of the 3D manipulators 203A and 203B, thereby making it possible to automatically acquire stereoscopic images with a central focus on the treatment region of the treatment part 31 of the treatment instrument 30A or 30B through remote manipulation. {0087}
Although the embodiments of the present invention have been described above in detail with reference to the drawings, the specific structures are not limited to the embodiments, and design changes etc. that do not depart from the gist of the present invention are also encompassed. For example, the present invention is not limited to the above-described embodiments and modifications and may be applied to an
embodiment in which these embodiments and modifications are appropriately combined; it is not particularly limited.
Furthermore, in the above-described embodiments, the
convergence angle a varies linearly with respect to the detected distance; however, it is not limited thereto, and the convergence angle a may vary in a curved manner or vary in a stepwise manner.
{0088}
Furthermore, in the above-described embodiments, the relationship between the convergence angle β and the amount of insertion of the treatment instrument 30, which is converted to the distance from the treatment part 31 to the imaging devices 7 and associated with the convergence angle, is stored in the pattern storage section 17; however, the distance sensor 9 and the tip distance sensor 10 may include a
measurement part for measuring the amount of insertion of the treatment part 31 of the treatment instrument 30, 30A, or 30B inserted into the subject's body and a conversion part for converting the amount of insertion measured by the measurement part to the distance from the treatment part 31 of the
treatment instrument 30, 30A, or 30B to the imaging devices 7, and the relationship between the distance and the convergence angle β may be stored in the pattern storage section 17. Even in this case, it is possible to easily detect the distance from the treatment part 31 of the treatment instrument 30, 30A, or 30B to the imaging devices 7 based on the amount of insertion of the treatment part 31, without directly measuring this distance.
{0089}
Furthermore, in the above-described embodiments, the two swiveling members 5 swivel at the same angle in the opposite directions in synchronization with each other; however, instead of this, they may swivel independently at different angles. By doing so, it is possible not only to perform front-view observation of an object A that is located in front of the inserted portion 2 in the longitudinal direction thereof but also to perform inclined-view observation or side- view observation of an object A that is inclined with respect to the longitudinal direction thereof. Furthermore, only one of the swiveling members 5 may be made to swivel.
Furthermore, both of the swiveling members 5 may be made to swivel at different angles or swivel in the same direction. {Reference Signs List}
{0090}
a convergence angle (relative angle)
β convergence angle (relative angle)
1 stereo-endoscope device
2 inserted portion
5 swiveling member (angle changing mechanism)
6 rotary microactuator (driving unit, angle changing mechanism)
7 imaging device
7a optical axis
9 distance sensor (distance detecting unit)
10 tip distance sensor (distance detecting unit) 14 swivel control section (control section)
30, 30A, 30B treatment instrument (medical device) 33 swiveling part
41A, 41B trocar (inserted portion; inserted member)
115 motion detecting section
203A, 203B 3D manipulator
205A, 205B information detecting section
201 stereo-endoscope robot

Claims

{ CLAIMS }
{Claim 1}
A stereo-endoscope device comprising:
an inserted portion that can be inserted into a subject's body;
two imaging devices that are disposed on the inserted portion with a space therebetween;
an angle changing mechanism that changes a relative angle of optical axes of the imaging devices;
a distance detecting unit for detecting the distance to the imaging devices from a treatment part of a medical device that is inserted into the subject's body and is used to treat an affected site; and
a control section that controls the angle changing mechanism based on insertion information of the medical device, the insertion information including the distance detected by the distance detecting unit.
{Claim 2}
A stereo-endoscope device according to claim 1, wherein the distance detecting unit includes a measurement part that measures the amount of insertion of the treatment part of the medical device inserted into the subject's body and a
conversion part that converts the amount of insertion measured by the measurement part to the distance from the treatment part of the medical device to the imaging devices.
{Claim 3}
A stereo-endoscope device according to claim 1 or 2, wherein the control section controls the angle changing mechanism such that an intersection of the optical axes of the imaging devices coincides with the position of the treatment part of the medical device.
{Claim 4}
A stereo-endoscope device according to one of claims 1
3,
wherein the angle changing mechanism includes, at a ti of the inserted portion, a pair of swiveling members attach so as to be capable of swiveling on shafts that extend in a direction intersecting with the longitudinal axis of the inserted portion and driving units for swiveling the pair o swiveling members; and
the imaging devices are attached to the swiveling
members .
{Claim 5}
A stereo-endoscope device according to claim 4, wherein the driving units swivel the pair of swiveling members between closed positions in which the pair of swiveling members extend in the direction of the longitudinal axis of the inserted portion and are close to each other and open positions in which the pair of swiveling members extend in directions intersecting with the longitudinal axis of the inserted portion and are away from each other.
{Claim 6}
A stereo-endoscope system comprising:
a stereo-endoscope device according to one of claims 1
5;
the medical device that has a swiveling part capable of swiveling the treatment part on a shaft extending in a direction intersecting with the longitudinal axis of the medical device; and
a swivel-angle detecting section that detects a swivel angle of the swiveling part of the medical device,
wherein the control section controls the angle changing mechanism based on insertion information of the medical device, the insertion information including the swivel angle detected by the swivel-angle detecting section.
{Claim 7}
A stereo-endoscope system according to claim 6, further comprising :
an inserted member that has a through-hole into which the medical device can be inserted; and
an insertion-angle detecting section that detects an angle of a central axis of the through-hole of the inserted member,
wherein the' control section controls the angle changing mechanism based on insertion information of the medical device, the insertion information including the angle detected by the insertion-angle detecting section.
{Claim 8}
A stereo-endoscope system according to claim 6 or 7, further comprising:
at least one of the medical devices; and
a motion detecting section that detects motions of the treatment parts of the medical devices,
wherein the control section controls the angle changing mechanism based on the distance to the imaging devices from the treatment part of the medical device whose treatment part has the largest amount of motion detected by the motion detecting section.
{Claim 9}
A stereo-endoscope robot comprising:
a stereo-endoscope system according to one of claims 6 to
8; a manipulation part that manipulates the medical device through remote manipulation performed by an operator; and an information detecting section that detects the insertion information of the medical device from manipulation information of the medical device manipulated by the
manipulation part,
wherein the control section controls the angle changing mechanism based on the insertion information of the medical device detected by the information detecting section.
PCT/JP2012/084272 2011-12-28 2012-12-26 Stereo-endoscope device, stereo-endoscope system, and stereo-endoscope robot WO2013100171A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP12861469.0A EP2797486B1 (en) 2011-12-28 2012-12-26 Stereo-endoscope device, stereo-endoscope system, and stereo-endoscope robot
CN201280065232.4A CN104023614B (en) 2011-12-28 2012-12-26 Stereo endoscope device, stereoscopic endoscope system and stereo endoscope robot
US14/311,581 US20140303437A1 (en) 2011-12-28 2014-06-23 Stereo-endoscope device, stereo-endoscope system, and stereo-endoscope robot

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011-289876 2011-12-28
JP2011289876A JP5973727B2 (en) 2011-12-28 2011-12-28 Stereoscopic endoscope apparatus, stereoscopic endoscope system, and stereoscopic endoscope robot

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/311,581 Continuation US20140303437A1 (en) 2011-12-28 2014-06-23 Stereo-endoscope device, stereo-endoscope system, and stereo-endoscope robot

Publications (1)

Publication Number Publication Date
WO2013100171A1 true WO2013100171A1 (en) 2013-07-04

Family

ID=48697642

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/084272 WO2013100171A1 (en) 2011-12-28 2012-12-26 Stereo-endoscope device, stereo-endoscope system, and stereo-endoscope robot

Country Status (5)

Country Link
US (1) US20140303437A1 (en)
EP (1) EP2797486B1 (en)
JP (1) JP5973727B2 (en)
CN (1) CN104023614B (en)
WO (1) WO2013100171A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105939688A (en) * 2014-02-07 2016-09-14 奥林巴斯株式会社 Surgical system and method for operating surgical system
EP3173047A4 (en) * 2014-07-25 2018-01-10 Olympus Corporation Treatment device and treatment device system

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6259661B2 (en) * 2011-01-28 2018-01-10 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Optical tracking system
US9131957B2 (en) * 2012-09-12 2015-09-15 Gyrus Acmi, Inc. Automatic tool marking
JP6027947B2 (en) * 2013-07-26 2016-11-16 オリンパス株式会社 Manipulator system
JP5975504B2 (en) * 2014-07-24 2016-08-23 アドバンストヘルスケア株式会社 Trocar, port, surgery support system
CN104434012B (en) * 2014-12-16 2016-09-28 刘志勇 Side-looking virtual endoscope system and detection method
US10765306B2 (en) * 2015-07-29 2020-09-08 Tarek Ahmed Nabil Abou El Kheir Advanced 3-dimensional endoscopic system with real dynamic convergence
JP6631994B2 (en) * 2016-02-12 2020-01-15 京セラ株式会社 Trocar
US11992235B2 (en) * 2016-02-12 2024-05-28 Briteseed, Llc System to differentiate and identify types of tissue within a region proximate to a working end of a surgical instrument
DE102017008148A1 (en) * 2017-08-29 2019-02-28 Joimax Gmbh Sensor unit, intraoperative navigation system and method for detecting a surgical instrument
EP3677213A4 (en) * 2017-12-06 2020-11-04 Sony Olympus Medical Solutions Inc. Medical control device and medical observation system
CN112690860B (en) * 2019-10-23 2022-04-01 苏州英途康医疗科技有限公司 Automatic clip feeding device and method
DE102020104574A1 (en) * 2020-02-21 2021-08-26 Olympus Winter & Ibe Gmbh Medical system, media and / or energy source, and trocar
USD1022197S1 (en) 2020-11-19 2024-04-09 Auris Health, Inc. Endoscope
CN114533260B (en) * 2022-04-27 2022-07-22 深圳市艾泉科技有限公司 Therapeutic apparatus and skin treatment device
WO2023225105A1 (en) * 2022-05-17 2023-11-23 EyeQ Technologies, Inc. Three-dimensional ocular endoscope device and methods of use

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05341206A (en) * 1992-06-09 1993-12-24 Olympus Optical Co Ltd Stereoscopic endoscope device
JPH06105806A (en) * 1992-08-14 1994-04-19 Olympus Optical Co Ltd Endoscope apparatus
JPH06261860A (en) * 1993-03-12 1994-09-20 Olympus Optical Co Ltd Video display device of endoscope
JP2001025035A (en) * 1999-07-07 2001-01-26 Olympus Optical Co Ltd Stereoscopic viewing device and method for assembling, disassembling and using the same

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002000547A (en) * 2000-06-26 2002-01-08 Fuji Photo Film Co Ltd Fluorescent imaging instrument
WO2002056756A2 (en) * 2001-01-19 2002-07-25 Framtidartaekni Ehf. Hand-held digital imaging diagnostic and operational instrument with wireless transmission data of image
US7686826B2 (en) * 2003-10-30 2010-03-30 Cambridge Endoscopic Devices, Inc. Surgical instrument
US8512229B2 (en) * 2004-04-14 2013-08-20 Usgi Medical Inc. Method and apparatus for obtaining endoluminal access
US8562516B2 (en) * 2004-04-14 2013-10-22 Usgi Medical Inc. Methods and apparatus for obtaining endoluminal access
JP5325396B2 (en) * 2007-06-15 2013-10-23 オリンパスメディカルシステムズ株式会社 Imaging system
CA2722749A1 (en) * 2008-04-29 2009-11-05 Wilson-Cook Medical Inc. Device platform for medical procedures
JP5384869B2 (en) * 2008-07-24 2014-01-08 オリンパスメディカルシステムズ株式会社 Endoscopic treatment system
JP5904750B2 (en) * 2011-10-14 2016-04-20 オリンパス株式会社 Stereoscopic endoscope device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05341206A (en) * 1992-06-09 1993-12-24 Olympus Optical Co Ltd Stereoscopic endoscope device
JPH06105806A (en) * 1992-08-14 1994-04-19 Olympus Optical Co Ltd Endoscope apparatus
JPH06261860A (en) * 1993-03-12 1994-09-20 Olympus Optical Co Ltd Video display device of endoscope
JP2001025035A (en) * 1999-07-07 2001-01-26 Olympus Optical Co Ltd Stereoscopic viewing device and method for assembling, disassembling and using the same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2797486A4 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105939688A (en) * 2014-02-07 2016-09-14 奥林巴斯株式会社 Surgical system and method for operating surgical system
EP3103411A4 (en) * 2014-02-07 2017-09-27 Olympus Corporation Surgical system and method for operating surgical system
CN105939688B (en) * 2014-02-07 2019-03-19 奥林巴斯株式会社 The working method of surgery systems and surgery systems
EP3173047A4 (en) * 2014-07-25 2018-01-10 Olympus Corporation Treatment device and treatment device system
US10420575B2 (en) 2014-07-25 2019-09-24 Olympus Corporation Treatment tool and treatment tool system

Also Published As

Publication number Publication date
JP5973727B2 (en) 2016-08-23
EP2797486A4 (en) 2015-09-16
US20140303437A1 (en) 2014-10-09
CN104023614B (en) 2017-03-01
JP2013138717A (en) 2013-07-18
EP2797486B1 (en) 2017-04-26
CN104023614A (en) 2014-09-03
EP2797486A1 (en) 2014-11-05

Similar Documents

Publication Publication Date Title
EP2797486B1 (en) Stereo-endoscope device, stereo-endoscope system, and stereo-endoscope robot
US11382715B2 (en) Jig-holding device and medical observation device
US10485407B2 (en) Surgical device, outer tube, endoscope, and treatment tool
US11033338B2 (en) Medical information processing apparatus, information processing method, and medical information processing system
US10064650B2 (en) Surgical device, outer tube, endoscope, and treatment tool
JP2007301378A (en) Treatment system, trocar, and control method for treatment system
JP2005013715A (en) Observation system
US10292576B2 (en) Surgical device, outer tube, endoscope, and treatment tool
EP2979619B1 (en) Device for endoscopic surgery
US11540700B2 (en) Medical supporting arm and medical system
US11109927B2 (en) Joint driving actuator and medical system
JP4027876B2 (en) Body cavity observation system
CN113038864A (en) Medical viewing system configured to generate three-dimensional information and calculate an estimated region and corresponding method
US11553838B2 (en) Endoscope and arm system
EP2979613B1 (en) Device for endoscopic surgery
US11039067B2 (en) Image pickup apparatus, video signal processing apparatus, and video signal processing method
US10674893B2 (en) Endoscopic surgical device and guide device
WO2020050187A1 (en) Medical system, information processing device, and information processing method
IL266992A (en) Medical imaging device with a telescopic scope

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12861469

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2012861469

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2012861469

Country of ref document: EP