WO2013011733A1 - Endoscope guidance system and endoscope guidance method - Google Patents

Endoscope guidance system and endoscope guidance method Download PDF

Info

Publication number
WO2013011733A1
WO2013011733A1 PCT/JP2012/061839 JP2012061839W WO2013011733A1 WO 2013011733 A1 WO2013011733 A1 WO 2013011733A1 JP 2012061839 W JP2012061839 W JP 2012061839W WO 2013011733 A1 WO2013011733 A1 WO 2013011733A1
Authority
WO
WIPO (PCT)
Prior art keywords
endoscope
guidance system
unit
image
ultrasonic
Prior art date
Application number
PCT/JP2012/061839
Other languages
French (fr)
Japanese (ja)
Inventor
玉野 聡
Original Assignee
株式会社 日立メディコ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社 日立メディコ filed Critical 株式会社 日立メディコ
Publication of WO2013011733A1 publication Critical patent/WO2013011733A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/273Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the upper alimentary canal, e.g. oesophagoscopes, gastroscopes
    • A61B1/2733Oesophagoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00043Operational features of endoscopes provided with output arrangements
    • A61B1/00045Display arrangement
    • A61B1/0005Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147Holding or positioning arrangements
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0093Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy
    • A61B5/0095Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy by applying light and detecting acoustic waves, i.e. photoacoustic measurements
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0833Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures
    • A61B8/0841Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures for locating instruments
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/46Ultrasonic, sonic or infrasonic diagnostic devices with special arrangements for interfacing with the operator or the patient
    • A61B8/461Displaying means of special interest
    • A61B8/463Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5261Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from different diagnostic modalities, e.g. ultrasound and X-ray

Definitions

  • the present invention relates to an endoscope guidance system, and more particularly to an endoscope guidance system that safely guides an endoscope to a subject.
  • Endoscopes used for medical image diagnosis are techniques for optically observing organs in body cavities, and are often used as gastrocameras.
  • a cell acquisition forceps protrudes from a forceps opening at the distal end of an endoscope, collects a biological tissue, and performs a pathological examination of the collected tissue.
  • a needle at the distal end of the endoscope a drug is administered to a living tissue in a body cavity via the needle.
  • endoscopes can perform various treatments and examinations without performing laparotomy, they are widely used as examination techniques or surgical techniques with less subject invasion and less burden on the subject. (For example, see Patent Document 1).
  • three-dimensional image diagnosis using medical images is performed for definitive diagnosis of visceral diseases and grasping of lesion positions.
  • image diagnosis using medical images it is easy to grasp the position of the lesion, but when combined with an endoscope, the positional relationship between the position of the endoscope and the position of the treatment target and the three-dimensional medical image It was difficult to grasp three-dimensionally.
  • the present invention has been made to solve the conventional problems.
  • the endoscope is guided to a subject while using a medical image, the endoscope is safely guided and treatment using the endoscope is performed.
  • An object of the present invention is to provide an endoscope guidance system capable of safely performing treatment on a living body even when performing collection or collection.
  • An endoscope guidance system includes an endoscope guidance system including an endoscope, a position sensor that detects a position of the endoscope in a space, and a medical image of a portion to which the endoscope is guided.
  • the endoscope guidance method of the present invention is a endoscope guidance system including an endoscope, detects a position of the endoscope in a space, generates a medical image of a portion to which the endoscope is guided, The position of the endoscope is displayed on the medical image. Therefore, while confirming the position of the endoscope with medical images, the endoscope can be safely guided to the subject, and the subject can be safely treated even when performing treatment or collection using the endoscope. And so on.
  • the endoscope when guiding an endoscope to a subject while using a medical image, the endoscope is safely guided to the subject, and also when performing treatment or collection using the endoscope.
  • the subject can be safely treated.
  • summary of the endoscope guidance system which concerns on 1st Embodiment The flowchart which shows operation
  • the figure which shows the medical image and information which are displayed on the monitor of the endoscope guidance system which concerns on 2nd Embodiment The figure which shows the outline
  • FIG. 1 is a block diagram showing a configuration of an endoscope guidance system according to the first embodiment.
  • an endoscope guidance system 1 includes an endoscope 2, an ultrasonic probe 11, and an ultrasonic device 10.
  • the endoscope 2 can optically observe the structure in the body cavity of the subject, and includes an optical camera 3, an endoscope magnetic sensor 5 (first position sensor), an ultrasonic transducer 6, and a forceps port 7. And a puncture needle 70 (protrusion).
  • the endoscope 2 is connected to the ultrasonic apparatus 10 via the endoscope shaft 8. Further, the puncture needle 70 protrudes from the forceps port 7 of the endoscope 2, and the biological tissue can be collected or treated from the distal end of the endoscope 2.
  • the optical camera 3 includes a CCD image sensor and an optical fiber, and acquires an optical image.
  • the endoscope magnetic sensor 5 detects the position and angle (including the rotation angle) of the endoscope 2 in space, and particularly detects the position of the distal end portion of the endoscope 2.
  • the ultrasonic transducer 6 transmits ultrasonic waves and receives reflected signals from tissues in the subject in order to grasp in real time the lesion (test portion) in the body cavity of the subject. Get an image. Further, the ultrasonic transducer 6 observes the photoacoustic effect generated by the light for photoacoustic treatment.
  • the forceps port 7 may include an optical fiber, an LED, a laser, or the like for irradiating light for photoacoustic treatment.
  • the ultrasonic probe 11 includes an ultrasonic transducer 30 and an ultrasonic probe magnetic sensor 16 (second position sensor).
  • the ultrasonic probe 11 transmits an ultrasonic wave to the subject via the ultrasonic transducer 30 and receives a reflected signal from a tissue in the subject, thereby causing a lesion (in the subject's body cavity) To obtain an ultrasonic image for grasping in real time.
  • the ultrasonic probe 11 observes the photoacoustic effect generated by the light for photoacoustic treatment.
  • a two-dimensional array ultrasonic probe in which transducers are arranged two-dimensionally a mechanical scan type ultrasonic probe that mechanically swings the transducer unit, or a transducer 1
  • a one-dimensional ultrasonic probe arranged in a dimension.
  • the ultrasonic device 10 includes an endoscope connector 4, an optical module 9, an ultrasonic transmission / reception circuit 12, an ultrasonic image generation circuit 13 (medical image generation unit), a control circuit 14 (medical image control unit), an operation panel 15 (operation Part), monitor 17 (display part), speaker 18, position detection part 19, guidance route setting part 20, arrival position setting part 21, information providing part 22, test part position setting part 23, and attention area setting part 24 Prepare.
  • the endoscope connector 4 is an interface for connecting the endoscope 2 and the ultrasonic device 10.
  • the endoscope connector 4 includes channels such as a puncture needle, forceps, light, laser, wiring, air supply, water supply, and suction.
  • the optical module 9 includes a light emitting element and a light receiving element, and supplies light to the light source of the endoscope 2 through an optical fiber or the like.
  • the ultrasonic transmission / reception circuit 12 generates an ultrasonic transmission signal for the ultrasonic transducers 6 and 30 and receives the ultrasonic signal.
  • the ultrasonic image generation circuit 13 (medical image generation unit) is an ultrasonic signal received by the ultrasonic transmission / reception circuit 12 based on the position information of the ultrasonic probe 11 acquired by the ultrasonic probe magnetic sensor 16. An ultrasonic image (medical image) is generated from the image.
  • the ultrasonic image generated by the ultrasonic image generation circuit 13 is displayed on the monitor 17 as a video.
  • the control circuit 14 (medical image control unit) controls the endoscope 2, the ultrasonic probe 11, and the ultrasonic device 10.
  • the operation panel 15 (operation unit) inputs an instruction from the operator to the ultrasonic apparatus 10.
  • the position detection unit 19 grasps the positions of the magnetic sensors 5 and 16 (first and second position sensors) in the space in three dimensions.
  • the guide path setting unit 20 sets a guide path for guiding the endoscope 2 in the body cavity of the subject to an ultrasonic image (medical image).
  • the arrival position setting unit 21 sets an arrival position at which the endoscope 2 is guided and arrives in the body cavity of the subject in an ultrasonic image (medical image).
  • the test part position setting unit 23 sets the position of the test part in an ultrasonic image (medical image).
  • the attention area setting unit 24 sets an attention area in the guide route through which the endoscope 2 is guided into the body cavity of the subject.
  • the information providing unit 22 provides information on the distance or direction between the position of the endoscope 2 in the body cavity of the subject and the arrival position or the position of the subject to be examined.
  • the information providing unit 22 determines the position and angle of the endoscope 2 (including the rotation angle of the endoscope probe), the guidance speed of the endoscope 2, the guidance acceleration of the endoscope 2, and the guidance of the endoscope 2.
  • Information on at least one of the direction and the pressure when the endoscope 2 abuts is provided.
  • the information providing unit 22 provides information indicating that the attention area has been reached when the endoscope 2 reaches the attention area.
  • the endoscope guidance system of the present invention includes the attention area setting unit 24 that sets the attention area in the guidance route through which the endoscope 2 is guided, and when the endoscope 2 reaches the attention area. And an information providing unit 22 for providing information indicating that the region of interest has been reached.
  • the monitor 17 displays an ultrasonic image or an endoscope optical image.
  • the ultrasonic image may be an ultrasonic image generated in real time by the ultrasonic image generation circuit 13, and an ultrasonic image (preliminarily acquired as an ultrasonic three-dimensional image by the ultrasonic image generation circuit 13 ( Volume data). That is, the medical image generation unit (ultrasound image generation circuit 13) generates a medical image acquired in advance as a three-dimensional image of a portion where the endoscope 2 is guided.
  • the magnetic sensor 16 (position sensor) of the ultrasonic probe 11 can grasp the three-dimensional position of a living body and a lesioned part, the ultrasonic image is a normal ultrasonic B-mode image. May be.
  • the monitor 17 provides the position and angle of the endoscope 2 detected by the magnetic sensor 5, the guidance route set by the guidance route setting unit 20, the arrival position set by the arrival position setting unit 21, and information provision Information on the distance or direction provided by the unit 22, the position of the test part set by the test part position setting unit 23, and the attention area set by the attention area setting unit 24 are displayed as an ultrasonic image (medical image). ) Superimposed on the screen.
  • the speaker 18 provides information on the distance or direction provided by the information providing unit 22 by sound, and guides the endoscope 2 by sound.
  • the endoscope guidance system of the present invention is an endoscope guidance system including the endoscope 2, and a position sensor (endoscope magnetic sensor 5) that detects the position of the endoscope 2 in space, A medical image generation unit (ultrasonic image generation circuit 13) that generates a medical image of a portion to which the endoscope 2 is guided, and a display unit (monitor 17) that displays the position of the endoscope 2 on the medical image .
  • the endoscope guidance method of the present invention is a endoscope guidance system including the endoscope 2, and detects the position of the endoscope 2 in the space, and obtains a medical image of a portion to which the endoscope 2 is guided.
  • the position of the endoscope 2 is generated and displayed on the medical image. Therefore, while confirming the position of the endoscope with medical images, the endoscope can be safely guided to the subject, and the subject can be safely treated even when performing treatment or collection using the endoscope. And so on.
  • the display unit (monitor 17) includes a guidance path through which the endoscope 2 is guided, a reaching position where the endoscope 2 is guided and reached, and a position of the test part At least one of them is displayed on a medical image. Therefore, while confirming the guide route, the arrival position, and the position of the test part, the endoscope can be safely guided to the subject, and also when performing treatment or collection using the endoscope, Safe treatment can be performed.
  • FIG. 2 is a flowchart showing the operation of the endoscope guidance system 1.
  • FIG. 3 is a diagram showing an ultrasonic image and an endoscopic optical image displayed on the monitor 17.
  • FIG. 4 is a diagram showing information on the arrival position of the subject in the body cavity, the position of the test portion, the guide route, and the distance or direction.
  • the ultrasonic probe 11 acquires ultrasonic 3D volume data (ultrasonic three-dimensional image) of the subject using the magnetic sensor 16 (second position sensor) (step S1). As shown in FIG. 3, the monitor 17 displays an ultrasonic three-dimensional image 31 acquired in advance. The monitor 17 displays an ultrasonic image 32 (B mode image), a treatment guide image 33, and an endoscope optical image 34 generated in real time.
  • the arrival position setting unit 21 displays an ultrasonic three-dimensional image 31, an ultrasonic image 32, and a treatment guide image 33 displayed on the monitor 17.
  • An arrival position P1 at which the distal end of the endoscope 2 is guided and reached is set for (medical image) (step S2).
  • the subject position setting unit 23 sets the subject position P2 for the ultrasonic three-dimensional image 31, the ultrasonic image 32, and the treatment guide image 33 that are medical images.
  • the test portion position P2 is, for example, a lesion position, a treatment position, or a tissue acquisition position.
  • the guide route setting unit 20 sets the guide route P3 according to the insertion plan of the endoscope 2 for the ultrasonic three-dimensional image 31 displayed on the monitor 17. (Step S3).
  • the guidance route may be set using a touch pen or the like using the operation panel 15, or may be set using a mouse, a trackball, a joystick, or the like.
  • a line may be drawn along the insertion plan of the endoscope 2 with a touch pen, a mouse, a trackball, and a joystick, or a plurality of lines may be drawn along the insertion plan of the endoscope 2.
  • the points may be designated and the respective points may be automatically connected by lines.
  • the attention area setting unit 24 sets the attention area P4 in the guidance path P3 for the ultrasonic image displayed on the monitor 17 (step S3).
  • the attention area P4 is an area where the endoscope 2 is likely to be erroneously inserted, an area where the insertion path needs to be careful because the guide path is complicated or narrow, and an area where the endoscope 2 is likely to bleed. This is an area that requires careful insertion. For example, as shown in FIG. 4 (b), since the endoscope 2 is likely to be erroneously inserted at the tracheal bifurcation, the attention area P4 is set.
  • the insertion of the endoscope 2 is started using the shaft 8 for inserting the endoscope 2 into the body cavity (step S4).
  • the monitor 17 displays an optical image acquired by the endoscope 2.
  • the monitor 17 superimposes and displays the position P5 of the endoscope 2 detected by the magnetic sensor 5 on the ultrasonic three-dimensional image 31 (medical image).
  • the position of the endoscope 2 is displayed on the ultrasonic three-dimensional image 31.
  • the monitor 17 can also display an ultrasonic image acquired by the endoscope ultrasonic transducer 6 attached to the endoscope 2. Thereby, an ultrasonic image viewed from inside the body cavity is displayed.
  • the endoscope 2 includes the ultrasonic transducer 6 and acquires an ultrasonic image of the portion to be examined. According to this configuration, while confirming an ultrasonic image from the endoscope, the endoscope can be safely guided to the subject, and also when performing treatment or collection using the endoscope, the subject Can be treated safely.
  • the information providing unit 22 provides information related to the distance and direction between the position P5 of the endoscope 2 and the arrival position P1 (or the test part position P2) based on the position information of the endoscope magnetic sensor 5. (Step S5). As shown in FIG. 4 (c), based on the information provided from the information providing unit 22, the monitor 17 displays the vector V1 on the ultrasonic image.
  • the vector V1 indicates the distance and direction from the position P5 of the endoscope 2 to the arrival position P1. For example, when the endoscope 2 approaches the arrival position P1 along the guide path P3, the blue vector V1 may be displayed. When the endoscope 2 moves away from the arrival position P1, the red vector V1 may be displayed. .
  • the display form of the vector V1 is different depending on whether it approaches or farther from the arrival position P1.
  • the monitor 17 may display the distance to the arrival position P1 along the guidance route P3.
  • the speaker 18 may indicate the distance and direction from the position of the endoscope 2 to the arrival position P1 by sound or voice. The sound and voice may be changed depending on whether the endoscope 2 approaches or reaches the arrival position P1 along the guidance path P3. May be changed.
  • the information providing unit 22 also determines the position and angle of the endoscope 2, the guidance speed of the endoscope 2, the guidance acceleration of the endoscope 2, the guidance direction of the endoscope 2, and the pressure sensor. Information about at least one of the contact pressures is provided (step S5).
  • the monitor 17 or the speaker 18 shows information provided from the information providing unit 22.
  • the information providing unit 22 provides information indicating that the endoscope 2 has reached the attention area P4 when the endoscope 2 reaches the attention area P4 (steps S6 and S7).
  • the warning unit (the monitor 17 or the speaker 18) alerts the operator based on the information provided from the information providing unit 22, or automatically displays the optical image of the endoscope 2.
  • the monitor 17 may automatically enlarge the optical image that displays the attention area P4, and may change the display form such as the color of the frame of the optical image.
  • the speaker 18 may emit a sound or a sound that alerts the operator while the endoscope 2 is present in the attention area P4.
  • the warning unit (the monitor 17 or the speaker 18) is based on information provided from the information providing unit 22 (such as the position and angle of the endoscope 2). A warning is given when the position of the endoscope 2 deviates from the guidance path P3 (step S6 and step S7).
  • the endoscope 2 based on the position and angle of the endoscope 2, when the distance between the position of the endoscope 2 and the guide path P3 exceeds a predetermined threshold, the endoscope 2 is mistaken for an organ different from the guide path P3.
  • the monitor 17 displays a warning message 35, and the speaker 18 generates a warning sound, judging that it has been inserted.
  • the endoscope 2 can be guided more safely into the body cavity of the subject.
  • the endoscope guidance system of the present invention provides a guidance route setting unit 20 that sets a guidance route for guiding the endoscope 2, and a warning when the position of the endoscope 2 deviates from the guidance route.
  • Warning section (monitor 17 or speaker 18). According to this configuration, it can be confirmed that the endoscope has deviated from the guidance path by a warning, and therefore the endoscope can be safely guided to the subject.
  • the monitor 17 warns the distance or direction between the position of the endoscope 2 and the guide path P3 when the position P5 of the endoscope 2 deviates from the guide path P3.
  • the vector V2 may be displayed on an ultrasonic three-dimensional image (medical image).
  • the monitor 17 may change the display form such as the shape and color of the vector V2 according to the distance that the endoscope 2 deviates from the guide path P3, and the speaker 18 changes the sound and sound. May be.
  • the warning unit (the monitor 17 or the speaker 18) is configured so that the position of the endoscope 2 and the guidance path when the position of the endoscope 2 deviates from the guidance path. Warning the distance or direction. According to this configuration, since the distance or direction of the endoscope deviating from the guidance path can be confirmed, the endoscope can be safely guided to the subject.
  • the information providing unit 22 provides information on the distance or direction between the position of the endoscope 2 and the test portion position P2, and the monitor 17 Based on the information provided by the information providing unit 22, the distance and direction between the position P5 of the endoscope 2 and the test portion position P2 are displayed in an ultrasonic three-dimensional image (medical image) (step S9). As shown in FIG. 6, a vector V3 may be displayed to represent the distance or direction between the position P5 of the endoscope 2 and the test portion position P2.
  • the monitor 17 may change the display form such as the shape and color of the vector V3 according to the distance or direction between the position P5 of the endoscope 2 and the test portion position P2, and the speaker 18 The voice may be changed.
  • the puncture needle 70 protruding part protrudes from the forceps port 7 and can reach the test part position P2 while grasping the distance or direction to the test part position P2, and collected from the living body.
  • treatment can be performed (step S10).
  • the protrusion may be a medical instrument such as a forceps or a high-frequency knife.
  • the protruding portion is a forceps, the forceps can reach the test portion position P2 while grasping the distance or direction to the test portion position P2, and safely treat the living tissue with respect to the subject. (Step S10).
  • the endoscope guidance system of the present invention includes the arrival position setting unit 21 that sets the arrival position to which the endoscope 2 is guided and reached, and the distance between the position of the endoscope 2 and the arrival position, or And an information providing unit 22 that provides information on the direction. According to this configuration, since the distance or direction from the endoscope to the reaching position can be confirmed, the endoscope can be safely guided to the subject.
  • the endoscope guidance system of the present invention provides the information about the distance or direction between the position of the endoscope 2 and the position of the test part, and the test part position setting part 23 for setting the position of the test part And an information providing unit 22 for providing information. According to this configuration, since the distance or direction from the endoscope to the position of the test portion can be confirmed, when performing treatment or collection using the endoscope, treatment or collection is safely performed on the subject. be able to.
  • the puncture needle 70 (projection) includes a magnetic sensor (third position sensor) that detects the position of the puncture needle 70 (projection) in the space, and the monitor 17 exceeds the position of the puncture needle 70 (projection). You may display on the sound wave three-dimensional image 31 (medical image). Further, the information providing unit 22 may provide information on the distance or direction between the position of the puncture needle 70 (protruding part) and the test part position P2 to the warning unit (the monitor 17 or the speaker 18). In order to indicate the distance or direction between the position of the puncture needle 70 (protruding portion) and the test portion position P2, the monitor 17 may display a vector on the medical image.
  • the monitor 17 may change the display form such as the shape and color of the vector, and the speaker 18 And the sound may be changed.
  • the puncture needle 70 (protruding portion) can surely reach the test portion position P2, and against the living body.
  • the protruding portion is a forceps
  • the forceps can reach the test portion position P2 while grasping the distance or direction between the tip position of the forceps and the test portion position P2, and it is safe for the subject. Living tissue can be treated.
  • the endoscope includes a protrusion (puncture needle 70), the protrusion includes a position sensor (magnetic sensor) that detects the position of the protrusion in space,
  • the display unit displays the position of the protrusion on the medical image.
  • the endoscope guidance system of the present invention relates to a test part position setting unit 23 that sets the position of the test part, and a distance or direction between the position of the protrusion (puncture needle 70) and the position of the test part.
  • an information providing unit 22 that provides information. According to this configuration, since the distance or direction from the protruding portion to the position of the test portion can be confirmed, when treatment or collection using a puncture needle or forceps is performed, treatment or collection is safely performed on the subject. be able to.
  • the state of biological tissue collection and treatment can be checked. It can be observed in real time with ultrasound images. As a result, it is possible to acquire a biological tissue more safely with respect to the living body or to perform a treatment while confirming the effects of collecting the biological tissue and the treatment (step S11). Further, when the endoscope 2 reaches the arrival position P1 (step S8), the monitor 17 may switch from the optical image of the endoscope 2 to the ultrasonic image of the endoscope 2.
  • step S11 it is possible to observe the photoacoustic effect with the ultrasonic transducer 6 by directing the ultrasonic transducer 6 of the endoscope 2 toward the test portion position P2, and while confirming the photoacoustic effect, Further, it is possible to safely acquire a biological tissue or perform treatment (step S11).
  • a photoacoustic agent that specifically aggregates at a diseased site is administered to the subject, and a laser or the like is irradiated from the forceps port 7 of the endoscope 2 to the test portion position P2, thereby causing photoacoustics.
  • the drug absorbs light energy, vibrates and evaporates, generating an ultrasonic signal.
  • the photoacoustic effect is observed.
  • treatment using photoacoustics and observation of photoacoustic effects can be applied not only to the body surface but also to deep organs such as the esophagus, stomach, digestive tract, and intestinal tract.
  • the endoscope 2 includes the ultrasonic transducer 6 and the photoacoustic effect is observed by the ultrasonic transducer 6. According to this configuration, the photoacoustic effect can be observed from the inside of the subject, and effective photoacoustic treatment can be performed.
  • an ultrasonic image viewed from inside the blood vessel can be acquired by the ultrasonic transducer 6. More detailed lesion information can be obtained.
  • the endoscope 2 is removed from the subject (step S12).
  • an ultrasonic image (volume data) acquired in advance as an ultrasonic three-dimensional image by the ultrasonic image generation circuit 13 is used for inserting the endoscope 2.
  • a reference image is used.
  • the reference image may be a CT image or an MRI image as long as it is three-dimensional volume data.
  • the coordinate system of the endoscope magnetic sensor 5 and the coordinate system of the ultrasonic probe magnetic sensor 16 can be handled as the same.
  • Japanese Patent No. 4300488 ⁇ Ultrasonic diagnosis Reference image display method and ultrasonic diagnostic apparatus ", Hitachi Medical Co., Ltd.. Japanese Patent No.
  • 4300488 shows coordinate transformation in the case of a magnetic sensor attached to an ultrasonic probe outside the body, but in this embodiment, a magnetic attached to the ultrasonic probe outside the body. If the sensor is the magnetic sensor 5 attached to the endoscope 2, it can also be applied to mutual coordinate conversion between the CT or MRI three-dimensional coordinate system and the endoscope magnetic sensor coordinate system.
  • the monitor 17 (display unit) is detected by the magnetic sensor 5 as shown in FIG.
  • the information, the position P2 of the test part set by the test part position setting unit 23, and the attention area P4 set by the attention area setting unit 24 can be displayed superimposed on the CT / MRI image 36.
  • the monitor 17 may display the position of the puncture needle 70 (protrusion) on the CT / MRI image 36 (medical image).
  • the monitor 17 displays an ultrasonic image of the endoscope ultrasonic transducer 6 attached to the endoscope 2 together with the CT / MRI image 36, or superimposes it on the test part of the CT / MRI image 36. May be.
  • the endoscope guidance system includes a CT / MRI image database 80.
  • the CT / MRI image database 80 stores CT / MRI three-dimensional images (volume data) acquired in advance together with position information.
  • the control circuit 14 acquires a CT / MRI image using the volume data stored in the CT / MRI image database 80 (step S100).
  • the control circuit 14 calculates the three-dimensional position of the endoscope magnetic sensor 5 provided at the distal end of the endoscope 2, and matches the CT / MRI coordinate system and the coordinate system of the endoscope magnetic sensor 5.
  • the monitor 17 is based on the coordinate system that matches, the position P5 and angle of the endoscope 2, the guidance path P3, the arrival position P1, the information about the distance or direction, the test part position P2, the attention area P4, etc. / MRI image is superimposed and displayed (steps S2, S3, S5, S7, S9, etc.).
  • the present invention can be applied to a three-dimensional image using various medical images (X-ray image, CT, MRI, ultrasound image, angiography, etc.).
  • an ultrasonic image is used.
  • the medical image diagnostic apparatus 101 does not include the ultrasonic probe 11, the endoscope ultrasonic transducer 6, the ultrasonic transmission / reception circuit 12, and the ultrasonic image generation circuit 13.
  • volume data of a CT / MRI three-dimensional image is used as a reference image.
  • a CT / MRI three-dimensional image (volume data) acquired in advance is stored in the CT / MRI image database 80 together with position information.
  • the method described in Japanese Patent No. 4300488 is used.
  • the control circuit 14 acquires a CT / MRI image using the volume data stored in the CT / MRI image database 80 (step S200).
  • the control circuit 14 calculates the three-dimensional position of the endoscope magnetic sensor 5 provided at the distal end of the endoscope 2, and matches the CT / MRI coordinate system and the coordinate system of the endoscope magnetic sensor 5.
  • the monitor 17 is based on the coordinate system that matches, the position P5 and angle of the endoscope 2, the guidance path P3, the arrival position P1, the information about the distance or direction, the test part position P2, the attention area P4, etc. / MRI image is superimposed and displayed (steps S2, S3, S5, S7, S9, etc.).
  • the present invention can also be applied to a three-dimensional image using various medical images other than the ultrasonic image.
  • the endoscope when guiding an endoscope to a subject while using a medical image, the endoscope is safely guided to a living body, and treatment or collection using the endoscope is performed. In addition, it is possible to safely treat the living body.
  • the monitor 17 includes a guide path P3, a vector V1 indicating the distance and direction from the position P5 of the endoscope 2 to the arrival position P1, and the position of the endoscope 2 and the guide path P3. At least one of the vector V2 indicating the distance or direction and the vector V3 indicating the distance or direction between the position P5 of the endoscope 2 and the position P2 to be examined is used as an optical image (medical image) of the endoscope 2. It may be displayed.
  • the monitor 17 is the arrival position P1, the test portion position P2, the position and angle of the endoscope 2, the guidance speed of the endoscope 2, the guidance acceleration of the endoscope 2, the guidance direction of the endoscope 2, and At least one of the contact pressures of the endoscope 2 by the pressure sensor may be displayed on the optical image (medical image) of the endoscope 2.
  • the endoscope guidance system safely guides an endoscope to a living body when guiding the endoscope to a subject while using a medical image, and performs treatment or collection using the endoscope. Even when it is performed, it has an effect that treatment can be safely performed on a living body, and is useful as an endoscope guidance system for safely guiding an endoscope to a subject.
  • 1 Endoscope guidance system 2 Endoscope, 3 Optical camera, 4 Endoscope connector, 5 Endoscope magnetic sensor, 6 Endoscope ultrasonic transducer, 7 Forceps opening, 8 Endoscope shaft, 9 Light Module, 10 ultrasonic device, 11 ultrasonic probe, 12 ultrasonic transmission / reception circuit, 13 ultrasonic image generation circuit, 14 control circuit, 15 operation panel, 16 ultrasonic probe magnetic sensor, 17 monitor, 18 speaker, 19 position detection unit, 20 guide route setting unit, 21 arrival position setting unit, 22 information providing unit, 23 test portion position setting unit, 24 attention area setting unit, 70 puncture needle

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Medical Informatics (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Public Health (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Gastroenterology & Hepatology (AREA)
  • Acoustics & Sound (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Endoscopes (AREA)

Abstract

Provided is an endoscope guidance system whereby an endoscope can be safely guided into the body when an endoscope is to be guided into a subject while medical imaging is being used, and whereby treatment and the like can also be safely carried out for a patient when a treatment, sampling, or the like in which the endoscope is used is to be carried out. An endoscope guidance system provided with an endoscope, wherein the endoscope guidance system comprises a position sensor for detecting the position of the endoscope in space, a medical image generation unit for generating a medical image of the portion where the endoscope is being guided, and a display unit for displaying the position of the endoscope on the medical image.

Description

内視鏡誘導システム及び内視鏡誘導方法Endoscope guidance system and endoscope guidance method
 本発明は、内視鏡誘導システムに関し、特に、被検体に安全に内視鏡を誘導する内視鏡誘導システムに関する。 The present invention relates to an endoscope guidance system, and more particularly to an endoscope guidance system that safely guides an endoscope to a subject.
 医用画像診断に用いられる内視鏡(endoscope)は、光学的に体腔内臓器を観察する手法であり、胃カメラなどとして多く利用されている。また、内視鏡先端の鉗子口から細胞取得鉗子が突出して生体組織を採取し、採取された組織の病理検査を行うことが行われている。さらに、内視鏡先端に針を備えることにより、針を介して体腔内の生体組織に薬剤を投与することが行われている。 Endoscopes used for medical image diagnosis are techniques for optically observing organs in body cavities, and are often used as gastrocameras. In addition, a cell acquisition forceps protrudes from a forceps opening at the distal end of an endoscope, collects a biological tissue, and performs a pathological examination of the collected tissue. Furthermore, by providing a needle at the distal end of the endoscope, a drug is administered to a living tissue in a body cavity via the needle.
 このように、内視鏡は、開腹手術を行うことなく、種々治療や検査が可能となるため、被検者の侵襲が少なく且つ被検者の負担の少ない検査手法又は手術手法として普及している(例えば、特許文献1参照)。 As described above, since endoscopes can perform various treatments and examinations without performing laparotomy, they are widely used as examination techniques or surgical techniques with less subject invasion and less burden on the subject. (For example, see Patent Document 1).
特開昭62-82944号公報JP 62-82944 JP
 しかしながら、従来の光学内視鏡においては、光学的に明らかな所見がある場合(例えば、変色、ただれ、出血など)、病変の位置を認識することは容易であるが、光学的に明らかな所見が無いか、或いは病変が臓器内面から離れている場合、病変の位置を認識することは困難であった。また、光学内視鏡に超音波探触子を組み合わせた超音波内視鏡が使用されているが、生体内部構造が複雑であるため、病変位置を3次元的に把握することは困難であった。 However, in conventional optical endoscopes, if there are optically clear findings (e.g., discoloration, dripping, bleeding, etc.), it is easy to recognize the position of the lesion, but optically obvious findings. If there was no lesion or the lesion was far from the inner surface of the organ, it was difficult to recognize the position of the lesion. In addition, although an ultrasonic endoscope in which an ultrasonic probe is combined with an optical endoscope is used, it is difficult to grasp the lesion position three-dimensionally because the internal structure of the living body is complicated. It was.
 また、内臓疾患の確定診断及び病変位置把握のために、医用画像(X線画像、CT、MRI、超音波画像、及び血管造影など)を用いた3次元画像診断が行われている。しかしながら、医用画像を用いた画像診断では、病変位置の把握は容易であるが、内視鏡と組み合わせた場合、内視鏡の位置や治療対象の位置と3次元の医用画像との位置関係を立体的に把握することは困難であった。 In addition, three-dimensional image diagnosis using medical images (X-ray images, CT, MRI, ultrasound images, angiography, etc.) is performed for definitive diagnosis of visceral diseases and grasping of lesion positions. However, in image diagnosis using medical images, it is easy to grasp the position of the lesion, but when combined with an endoscope, the positional relationship between the position of the endoscope and the position of the treatment target and the three-dimensional medical image It was difficult to grasp three-dimensionally.
 本発明は、従来の問題を解決するためになされたもので、医用画像を用いながら内視鏡を被検体へ誘導する場合に安全に内視鏡を誘導するとともに、内視鏡を用いた治療や採取などを行う場合にも、生体に安全に治療などを行うことができる内視鏡誘導システムを提供することを目的とする。 The present invention has been made to solve the conventional problems. When the endoscope is guided to a subject while using a medical image, the endoscope is safely guided and treatment using the endoscope is performed. An object of the present invention is to provide an endoscope guidance system capable of safely performing treatment on a living body even when performing collection or collection.
 本発明の内視鏡誘導システムは、内視鏡を備える内視鏡誘導システムにおいて、空間における前記内視鏡の位置を検出する位置センサと、前記内視鏡が誘導される部分の医用画像を生成する医用画像生成部と、前記医用画像に前記内視鏡の位置を表示する表示部とを備える。よって、内視鏡の位置を医用画像で確認しながら、内視鏡を被検体へ安全に誘導するとともに、内視鏡を用いた治療や採取などを行う場合にも、被検体に安全に治療などを行うことができる。 An endoscope guidance system according to the present invention includes an endoscope guidance system including an endoscope, a position sensor that detects a position of the endoscope in a space, and a medical image of a portion to which the endoscope is guided. A medical image generation unit for generating, and a display unit for displaying the position of the endoscope on the medical image. Therefore, while confirming the position of the endoscope with medical images, the endoscope can be safely guided to the subject, and the subject can be safely treated even when performing treatment or collection using the endoscope. And so on.
 本発明の内視鏡誘導方法は、内視鏡を備える内視鏡誘導システムにおいて、空間における前記内視鏡の位置を検出し、前記内視鏡が誘導される部分の医用画像を生成し、前記医用画像に前記内視鏡の位置を表示する。よって、内視鏡の位置を医用画像で確認しながら、内視鏡を被検体へ安全に誘導するとともに、内視鏡を用いた治療や採取などを行う場合にも、被検体に安全に治療などを行うことができる。 The endoscope guidance method of the present invention is a endoscope guidance system including an endoscope, detects a position of the endoscope in a space, generates a medical image of a portion to which the endoscope is guided, The position of the endoscope is displayed on the medical image. Therefore, while confirming the position of the endoscope with medical images, the endoscope can be safely guided to the subject, and the subject can be safely treated even when performing treatment or collection using the endoscope. And so on.
 本発明によれば、医用画像を用いながら内視鏡を被検体へ誘導する場合に被検体へ安全に内視鏡を誘導するとともに、内視鏡を用いた治療や採取などを行う場合にも、被検体に安全に治療などを行うことができる。 According to the present invention, when guiding an endoscope to a subject while using a medical image, the endoscope is safely guided to the subject, and also when performing treatment or collection using the endoscope. The subject can be safely treated.
第1の実施の形態に係る内視鏡誘導システムの概要を示す図The figure which shows the outline | summary of the endoscope guidance system which concerns on 1st Embodiment 第1の実施の形態に係る内視鏡誘導システムの動作を示すフロー図The flowchart which shows operation | movement of the endoscope guidance system which concerns on 1st Embodiment 第1の実施の形態に係る内視鏡誘導システムのモニタに表示される医用画像及び情報を示す図The figure which shows the medical image and information which are displayed on the monitor of the endoscope guidance system which concerns on 1st Embodiment 内視鏡の誘導を示す図Diagram showing endoscopic guidance モニタに表示される警告を示す図Diagram showing warning displayed on monitor 内視鏡の位置と被検部位置との距離又は方向を表すベクトルを示す図The figure which shows the vector showing the distance or direction of the position of an endoscope, and a to-be-tested part position 第2の実施の形態に係る内視鏡誘導システムのモニタに表示される医用画像及び情報を示す図The figure which shows the medical image and information which are displayed on the monitor of the endoscope guidance system which concerns on 2nd Embodiment 第2の実施の形態に係る内視鏡誘導システムの概要を示す図The figure which shows the outline | summary of the endoscope guidance system which concerns on 2nd Embodiment. 第2の実施の形態に係る内視鏡誘導システムの動作を示すフロー図The flowchart which shows operation | movement of the endoscope guidance system which concerns on 2nd Embodiment. その他の実施の形態に係る内視鏡誘導システムの概要を示す図The figure which shows the outline | summary of the endoscope guidance system which concerns on other embodiment. その他の実施の形態に係る内視鏡誘導システムの動作を示すフロー図The flowchart which shows operation | movement of the endoscope guidance system which concerns on other embodiment. モニタに表示される内視鏡の光学画像を示す図The figure which shows the optical image of the endoscope displayed on a monitor
 (第1の実施の形態)
 以下、本発明の実施の形態の内視鏡誘導システムについて、図面を用いて説明する。図1は、第1の実施の形態に係る内視鏡誘導システムの構成を示すブロック図である。図1において、内視鏡誘導システム1は、内視鏡2、超音波探触子11、及び超音波装置10を備える。
(First embodiment)
Hereinafter, an endoscope guidance system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of an endoscope guidance system according to the first embodiment. In FIG. 1, an endoscope guidance system 1 includes an endoscope 2, an ultrasonic probe 11, and an ultrasonic device 10.
 内視鏡2は、光学的に被検体の体腔内の構造を観察することができ、光学カメラ3、内視鏡磁気センサ5(第1の位置センサ)、超音波振動子6、鉗子口7、及び穿刺針70(突出部)を備える。内視鏡2は、内視鏡シャフト8を介して超音波装置10に接続されている。また、内視鏡2の鉗子口7からは、穿刺針70が突出して、内視鏡2の先端から生体組織を採取又は治療することができる。 The endoscope 2 can optically observe the structure in the body cavity of the subject, and includes an optical camera 3, an endoscope magnetic sensor 5 (first position sensor), an ultrasonic transducer 6, and a forceps port 7. And a puncture needle 70 (protrusion). The endoscope 2 is connected to the ultrasonic apparatus 10 via the endoscope shaft 8. Further, the puncture needle 70 protrudes from the forceps port 7 of the endoscope 2, and the biological tissue can be collected or treated from the distal end of the endoscope 2.
 光学カメラ3は、CCDイメージセンサや光ファイバなどを備え、光学画像を取得する。内視鏡磁気センサ5は、空間における内視鏡2の位置や角度(回転角度を含む)を検出し、特に、内視鏡2の先端部の位置を検出する。超音波振動子6は、被検体の体腔内の病変部(被検部)をリアルタイムに把握するために、超音波を送信し、被検体内の組織からの反射信号を受信することで超音波画像を取得する。また、超音波振動子6は、光音響治療用の光によって生じる光音響効果を観測する。また、鉗子口7は、光音響治療用の光を照射するための光ファイバ、LED、又はレーザーなどを備えてもよい。 The optical camera 3 includes a CCD image sensor and an optical fiber, and acquires an optical image. The endoscope magnetic sensor 5 detects the position and angle (including the rotation angle) of the endoscope 2 in space, and particularly detects the position of the distal end portion of the endoscope 2. The ultrasonic transducer 6 transmits ultrasonic waves and receives reflected signals from tissues in the subject in order to grasp in real time the lesion (test portion) in the body cavity of the subject. Get an image. Further, the ultrasonic transducer 6 observes the photoacoustic effect generated by the light for photoacoustic treatment. The forceps port 7 may include an optical fiber, an LED, a laser, or the like for irradiating light for photoacoustic treatment.
 超音波探触子11は、超音波振動子30及び超音波探触子磁気センサ16(第2の位置センサ)を備える。超音波探触子11は、超音波振動子30を介して超音波を被検体に送信し、被検体内の組織からの反射信号を受信することにより、被検体の体腔内の病変部(被検部)をリアルタイムに把握するための超音波画像を取得する。また、超音波探触子11は、光音響治療用の光によって生じる光音響効果を観測する。超音波探触子11としては、振動子が2次元に配列された2次元アレイ超音波探触子、振動子部を機械的にスイングさせるメカニカルスキャン型超音波探触子、又は振動子が1次元に配列された1次元超音波探触子などがある。 The ultrasonic probe 11 includes an ultrasonic transducer 30 and an ultrasonic probe magnetic sensor 16 (second position sensor). The ultrasonic probe 11 transmits an ultrasonic wave to the subject via the ultrasonic transducer 30 and receives a reflected signal from a tissue in the subject, thereby causing a lesion (in the subject's body cavity) To obtain an ultrasonic image for grasping in real time. The ultrasonic probe 11 observes the photoacoustic effect generated by the light for photoacoustic treatment. As the ultrasonic probe 11, a two-dimensional array ultrasonic probe in which transducers are arranged two-dimensionally, a mechanical scan type ultrasonic probe that mechanically swings the transducer unit, or a transducer 1 There is a one-dimensional ultrasonic probe arranged in a dimension.
 超音波装置10は、内視鏡コネクタ4、光モジュール9、超音波送受信回路12、超音波画像生成回路13(医用画像生成部)、制御回路14(医用画像制御部)、操作パネル15(操作部)、モニタ17(表示部)、スピーカ18、位置検出部19、誘導経路設定部20、到達位置設定部21、情報提供部22、被検部位置設定部23、及び注目領域設定部24を備える。 The ultrasonic device 10 includes an endoscope connector 4, an optical module 9, an ultrasonic transmission / reception circuit 12, an ultrasonic image generation circuit 13 (medical image generation unit), a control circuit 14 (medical image control unit), an operation panel 15 (operation Part), monitor 17 (display part), speaker 18, position detection part 19, guidance route setting part 20, arrival position setting part 21, information providing part 22, test part position setting part 23, and attention area setting part 24 Prepare.
 内視鏡コネクタ4は、内視鏡2と超音波装置10とを接続するインターフェイスである。内視鏡コネクタ4は、穿刺針、鉗子、光、レーザー、配線、送気、送水、及び吸引などのチャネルを備える。光モジュール9は、発光素子や受光素子を備え、光ファイバなどを介して内視鏡2の光源に光を供給する。 The endoscope connector 4 is an interface for connecting the endoscope 2 and the ultrasonic device 10. The endoscope connector 4 includes channels such as a puncture needle, forceps, light, laser, wiring, air supply, water supply, and suction. The optical module 9 includes a light emitting element and a light receiving element, and supplies light to the light source of the endoscope 2 through an optical fiber or the like.
 超音波送受信回路12は、超音波振動子6、30に対する超音波送信信号を生成し、超音波信号を受信する。超音波画像生成回路13(医用画像生成部)は、超音波探触子磁気センサ16により取得された超音波探触子11の位置情報に基づいて、超音波送受信回路12が受信した超音波信号から超音波画像(医用画像)を生成する。超音波画像生成回路13によって生成される超音波画像は、映像としてモニタ17に表示される。制御回路14(医用画像制御部)は、内視鏡2、超音波探触子11、及び超音波装置10を制御する。操作パネル15(操作部)は、操作者からの指示を超音波装置10に入力する。 The ultrasonic transmission / reception circuit 12 generates an ultrasonic transmission signal for the ultrasonic transducers 6 and 30 and receives the ultrasonic signal. The ultrasonic image generation circuit 13 (medical image generation unit) is an ultrasonic signal received by the ultrasonic transmission / reception circuit 12 based on the position information of the ultrasonic probe 11 acquired by the ultrasonic probe magnetic sensor 16. An ultrasonic image (medical image) is generated from the image. The ultrasonic image generated by the ultrasonic image generation circuit 13 is displayed on the monitor 17 as a video. The control circuit 14 (medical image control unit) controls the endoscope 2, the ultrasonic probe 11, and the ultrasonic device 10. The operation panel 15 (operation unit) inputs an instruction from the operator to the ultrasonic apparatus 10.
 位置検出部19は、空間における磁気センサ5、16(第1及び第2の位置センサ)の位置を3次元的に把握する。誘導経路設定部20は、被検体の体腔内に内視鏡2が誘導される誘導経路を、超音波画像(医用画像)に設定する。到達位置設定部21は、被検体の体腔内に内視鏡2が誘導されて到達する到達位置を、超音波画像(医用画像)に設定する。被検部位置設定部23は、被検部の位置を超音波画像(医用画像)に設定する。注目領域設定部24は、被検体の体腔内に内視鏡2が誘導される誘導経路における注目領域を設定する。 The position detection unit 19 grasps the positions of the magnetic sensors 5 and 16 (first and second position sensors) in the space in three dimensions. The guide path setting unit 20 sets a guide path for guiding the endoscope 2 in the body cavity of the subject to an ultrasonic image (medical image). The arrival position setting unit 21 sets an arrival position at which the endoscope 2 is guided and arrives in the body cavity of the subject in an ultrasonic image (medical image). The test part position setting unit 23 sets the position of the test part in an ultrasonic image (medical image). The attention area setting unit 24 sets an attention area in the guide route through which the endoscope 2 is guided into the body cavity of the subject.
 情報提供部22は、被検体の体腔内における内視鏡2の位置と到達位置若しくは被検部位置との距離又は方向に関する情報を提供する。情報提供部22は、内視鏡2の位置や角度(内視鏡探触子の回転角度を含む)、内視鏡2の誘導速度、内視鏡2の誘導加速度、内視鏡2の誘導方向、及び内視鏡2が当接する際の圧力のうち少なくとも1つに関する情報を提供する。情報提供部22は、内視鏡2が注目領域に到達したときに、注目領域に到達したことを示す情報を提供する。 The information providing unit 22 provides information on the distance or direction between the position of the endoscope 2 in the body cavity of the subject and the arrival position or the position of the subject to be examined. The information providing unit 22 determines the position and angle of the endoscope 2 (including the rotation angle of the endoscope probe), the guidance speed of the endoscope 2, the guidance acceleration of the endoscope 2, and the guidance of the endoscope 2. Information on at least one of the direction and the pressure when the endoscope 2 abuts is provided. The information providing unit 22 provides information indicating that the attention area has been reached when the endoscope 2 reaches the attention area.
 上述のように、本発明の内視鏡誘導システムは、内視鏡2が誘導される誘導経路における注目領域を設定する注目領域設定部24と、内視鏡2が注目領域に到達したときに、注目領域に到達したことを示す情報を提供する情報提供部22とを備える。この構成によれば、内視鏡が誤挿入されやすい領域、誘導経路が複雑又は狭小であるため内視鏡の挿入に注意を要する領域、及び出血しやすいため内視鏡の挿入に注意を要する領域などを確認できるため、内視鏡を被検体へ安全に誘導することができる。 As described above, the endoscope guidance system of the present invention includes the attention area setting unit 24 that sets the attention area in the guidance route through which the endoscope 2 is guided, and when the endoscope 2 reaches the attention area. And an information providing unit 22 for providing information indicating that the region of interest has been reached. According to this configuration, an area where the endoscope is likely to be erroneously inserted, an area where the insertion path needs to be careful because the guide path is complicated or narrow, and an endoscope needs attention because it tends to bleed. Since the region and the like can be confirmed, the endoscope can be safely guided to the subject.
 モニタ17(表示部)は、超音波画像又は内視鏡光学画像を表示する。ここで、超音波画像は、超音波画像生成回路13によってリアルタイムに生成される超音波画像であってもよく、超音波画像生成回路13によって超音波3次元画像として予め取得された超音波画像(ボリュームデータ)であってもよい。つまり、医用画像生成部(超音波画像生成回路13)は、内視鏡2が誘導される部分の3次元画像として予め取得された医用画像を生成する。また、超音波探触子11の磁気センサ16(位置センサ)により、生体及び病変部などの3次元的位置の把握が可能であるため、超音波画像は、通常の超音波Bモード画像であってもよい。 The monitor 17 (display unit) displays an ultrasonic image or an endoscope optical image. Here, the ultrasonic image may be an ultrasonic image generated in real time by the ultrasonic image generation circuit 13, and an ultrasonic image (preliminarily acquired as an ultrasonic three-dimensional image by the ultrasonic image generation circuit 13 ( Volume data). That is, the medical image generation unit (ultrasound image generation circuit 13) generates a medical image acquired in advance as a three-dimensional image of a portion where the endoscope 2 is guided. In addition, since the magnetic sensor 16 (position sensor) of the ultrasonic probe 11 can grasp the three-dimensional position of a living body and a lesioned part, the ultrasonic image is a normal ultrasonic B-mode image. May be.
 モニタ17(表示部)は、磁気センサ5により検出された内視鏡2の位置や角度、誘導経路設定部20により設定された誘導経路、到達位置設定部21により設定された到達位置、情報提供部22により提供される距離又は方向などに関する情報、被検部位置設定部23により設定される被検部の位置、及び注目領域設定部24により設定される注目領域を、超音波画像(医用画像)に重畳して表示する。スピーカ18は、情報提供部22により提供される距離又は方向に関する情報を音によって提供し、内視鏡2を音で誘導する。 The monitor 17 (display unit) provides the position and angle of the endoscope 2 detected by the magnetic sensor 5, the guidance route set by the guidance route setting unit 20, the arrival position set by the arrival position setting unit 21, and information provision Information on the distance or direction provided by the unit 22, the position of the test part set by the test part position setting unit 23, and the attention area set by the attention area setting unit 24 are displayed as an ultrasonic image (medical image). ) Superimposed on the screen. The speaker 18 provides information on the distance or direction provided by the information providing unit 22 by sound, and guides the endoscope 2 by sound.
 上述の通り、本発明の内視鏡誘導システムは、内視鏡2を備える内視鏡誘導システムにおいて、空間における内視鏡2の位置を検出する位置センサ(内視鏡磁気センサ5)と、内視鏡2が誘導される部分の医用画像を生成する医用画像生成部(超音波画像生成回路13)と、医用画像に内視鏡2の位置を表示する表示部(モニタ17)とを備える。また、本発明の内視鏡誘導方法は、内視鏡2を備える内視鏡誘導システムにおいて、空間における内視鏡2の位置を検出し、内視鏡2が誘導される部分の医用画像を生成し、医用画像に内視鏡2の位置を表示する。よって、内視鏡の位置を医用画像で確認しながら、内視鏡を被検体へ安全に誘導するとともに、内視鏡を用いた治療や採取などを行う場合にも、被検体に安全に治療などを行うことができる。 As described above, the endoscope guidance system of the present invention is an endoscope guidance system including the endoscope 2, and a position sensor (endoscope magnetic sensor 5) that detects the position of the endoscope 2 in space, A medical image generation unit (ultrasonic image generation circuit 13) that generates a medical image of a portion to which the endoscope 2 is guided, and a display unit (monitor 17) that displays the position of the endoscope 2 on the medical image . Further, the endoscope guidance method of the present invention is a endoscope guidance system including the endoscope 2, and detects the position of the endoscope 2 in the space, and obtains a medical image of a portion to which the endoscope 2 is guided. The position of the endoscope 2 is generated and displayed on the medical image. Therefore, while confirming the position of the endoscope with medical images, the endoscope can be safely guided to the subject, and the subject can be safely treated even when performing treatment or collection using the endoscope. And so on.
 また、本発明の内視鏡誘導システムでは、表示部(モニタ17)は、内視鏡2が誘導される誘導経路、内視鏡2が誘導されて到達する到達位置、及び被検部の位置のうち少なくとも1つを医用画像に表示する。よって、誘導経路、到達位置、及び被検部位置を確認しながら、内視鏡を被検体へ安全に誘導するとともに、内視鏡を用いた治療や採取などを行う場合にも、被検体に安全に治療などを行うことができる。 Further, in the endoscope guidance system of the present invention, the display unit (monitor 17) includes a guidance path through which the endoscope 2 is guided, a reaching position where the endoscope 2 is guided and reached, and a position of the test part At least one of them is displayed on a medical image. Therefore, while confirming the guide route, the arrival position, and the position of the test part, the endoscope can be safely guided to the subject, and also when performing treatment or collection using the endoscope, Safe treatment can be performed.
 次に、本実施の形態に係る内視鏡誘導システム1の動作について説明する。図2は、内視鏡誘導システム1の動作を示したフロー図である。図3は、モニタ17に表示される超音波画像及び内視鏡光学画像を示した図である。図4は、被検体の体腔内における到達位置、被検部位置、誘導経路、及び距離又は方向に関する情報を示した図である。 Next, the operation of the endoscope guidance system 1 according to the present embodiment will be described. FIG. 2 is a flowchart showing the operation of the endoscope guidance system 1. FIG. 3 is a diagram showing an ultrasonic image and an endoscopic optical image displayed on the monitor 17. FIG. 4 is a diagram showing information on the arrival position of the subject in the body cavity, the position of the test portion, the guide route, and the distance or direction.
 超音波探触子11は、磁気センサ16(第2の位置センサ)を用いて、被検体の超音波3Dボリュームデータ(超音波3次元画像)を取得する(ステップS1)。図3に示すように、モニタ17は、予め取得された超音波3次元画像31を表示する。また、モニタ17は、リアルタイムに生成される超音波画像32(Bモード画像)、治療ガイド画像33、及び内視鏡光学画像34を表示する。 The ultrasonic probe 11 acquires ultrasonic 3D volume data (ultrasonic three-dimensional image) of the subject using the magnetic sensor 16 (second position sensor) (step S1). As shown in FIG. 3, the monitor 17 displays an ultrasonic three-dimensional image 31 acquired in advance. The monitor 17 displays an ultrasonic image 32 (B mode image), a treatment guide image 33, and an endoscope optical image 34 generated in real time.
 図3及び図4(a)に示すように、操作パネル15を用いて、到達位置設定部21は、モニタ17に表示された超音波3次元画像31、超音波画像32、及び治療ガイド画像33(医用画像)に対し、内視鏡2の先端が誘導されて到達する到達位置P1を設定する(ステップS2)。また、操作パネル15を用いて、被検部位置設定部23は、医用画像である超音波3次元画像31、超音波画像32、及び治療ガイド画像33に対し、被検部位置P2を設定する(ステップS2)。ここで、被検部位置P2は、例えば、病変位置、治療位置、又は組織取得位置などである。 As shown in FIG. 3 and FIG. 4 (a), using the operation panel 15, the arrival position setting unit 21 displays an ultrasonic three-dimensional image 31, an ultrasonic image 32, and a treatment guide image 33 displayed on the monitor 17. An arrival position P1 at which the distal end of the endoscope 2 is guided and reached is set for (medical image) (step S2). Further, using the operation panel 15, the subject position setting unit 23 sets the subject position P2 for the ultrasonic three-dimensional image 31, the ultrasonic image 32, and the treatment guide image 33 that are medical images. (Step S2). Here, the test portion position P2 is, for example, a lesion position, a treatment position, or a tissue acquisition position.
 図3及び図4(b)に示すように、誘導経路設定部20は、モニタ17に表示された超音波3次元画像31に対し、内視鏡2の挿入計画に従った誘導経路P3を設定する(ステップS3)。誘導経路の設定は、操作パネル15を用いてタッチペンなどによって設定されてもよく、マウスやトラックボールやジョイスティックなどによって設定されてもよい。また、誘導経路を設定する場合、タッチペン、マウス、トラックボール、及びジョイスティックなどによって、内視鏡2の挿入計画に沿って線を引いてもよいし、内視鏡2の挿入計画に沿って複数の点を指定してそれぞれの点を自動的に線で連結させてもよい。 As shown in FIGS. 3 and 4 (b), the guide route setting unit 20 sets the guide route P3 according to the insertion plan of the endoscope 2 for the ultrasonic three-dimensional image 31 displayed on the monitor 17. (Step S3). The guidance route may be set using a touch pen or the like using the operation panel 15, or may be set using a mouse, a trackball, a joystick, or the like. Further, when setting the guide route, a line may be drawn along the insertion plan of the endoscope 2 with a touch pen, a mouse, a trackball, and a joystick, or a plurality of lines may be drawn along the insertion plan of the endoscope 2. The points may be designated and the respective points may be automatically connected by lines.
 図4(b)に示すように、注目領域設定部24は、モニタ17に表示された超音波画像に対し、誘導経路P3における注目領域P4を設定する(ステップS3)。ここで、注目領域P4は、内視鏡2が誤挿入されやすい領域、誘導経路が複雑又は狭小であるため内視鏡2の挿入に注意を要する領域、及び出血しやすいため内視鏡2の挿入に注意を要する領域などである。例えば、図4(b)に示すように、気管分岐部では内視鏡2が誤挿入されやすいため、注目領域P4が設定される。 As shown in FIG. 4 (b), the attention area setting unit 24 sets the attention area P4 in the guidance path P3 for the ultrasonic image displayed on the monitor 17 (step S3). Here, the attention area P4 is an area where the endoscope 2 is likely to be erroneously inserted, an area where the insertion path needs to be careful because the guide path is complicated or narrow, and an area where the endoscope 2 is likely to bleed. This is an area that requires careful insertion. For example, as shown in FIG. 4 (b), since the endoscope 2 is likely to be erroneously inserted at the tracheal bifurcation, the attention area P4 is set.
 内視鏡2を体腔内へ挿入するためのシャフト8を用いて、内視鏡2の挿入が開始される(ステップS4)。図3に示すように、モニタ17は、内視鏡2により取得される光学画像を表示する。モニタ17は、磁気センサ5により検出された内視鏡2の位置P5を超音波3次元画像31(医用画像)に重畳して表示する。これにより、超音波3次元画像31に内視鏡2の位置が映し出される。また、モニタ17は、内視鏡2に取り付けられた内視鏡超音波振動子6によって取得される超音波画像を表示することも可能である。これにより、体腔内から見た超音波画像が表示される。 The insertion of the endoscope 2 is started using the shaft 8 for inserting the endoscope 2 into the body cavity (step S4). As shown in FIG. 3, the monitor 17 displays an optical image acquired by the endoscope 2. The monitor 17 superimposes and displays the position P5 of the endoscope 2 detected by the magnetic sensor 5 on the ultrasonic three-dimensional image 31 (medical image). As a result, the position of the endoscope 2 is displayed on the ultrasonic three-dimensional image 31. The monitor 17 can also display an ultrasonic image acquired by the endoscope ultrasonic transducer 6 attached to the endoscope 2. Thereby, an ultrasonic image viewed from inside the body cavity is displayed.
 本発明の内視鏡誘導システムでは、内視鏡2は超音波振動子6を備え、被検部の超音波画像を取得する。この構成によれば、内視鏡からの超音波画像を確認しながら、内視鏡を被検体へ安全に誘導するとともに、内視鏡を用いた治療や採取などを行う場合にも、被検体に安全に治療などを行うことができる。 In the endoscope guidance system according to the present invention, the endoscope 2 includes the ultrasonic transducer 6 and acquires an ultrasonic image of the portion to be examined. According to this configuration, while confirming an ultrasonic image from the endoscope, the endoscope can be safely guided to the subject, and also when performing treatment or collection using the endoscope, the subject Can be treated safely.
 情報提供部22は、内視鏡磁気センサ5の位置情報に基づいて、内視鏡2の位置P5と到達位置P1(又は、被検部位置P2)との距離及び方向などに関する情報を提供する(ステップS5)。図4(c)に示すように、情報提供部22から提供される情報に基づいて、モニタ17は、超音波画像にベクトルV1を表示する。ベクトルV1は、内視鏡2の位置P5から到達位置P1への距離及び方向を示す。例えば、内視鏡2が誘導経路P3に沿って到達位置P1に近づく場合は、青色のベクトルV1を表示してもよく、到達位置P1から遠ざかる場合は、赤色のベクトルV1を表示してもよい。すなわち、到達位置P1に近づく場合と遠ざかる場合で、ベクトルV1の表示形態を異ならせている。また、モニタ17は、誘導経路P3に沿った到達位置P1までの距離を表示してもよい。また、情報提供部22から提供される情報に基づいて、スピーカ18は、内視鏡2の位置から到達位置P1への距離及び方向を音や音声で示してもよい。内視鏡2が誘導経路P3に沿って到達位置P1に近づく場合と遠ざかる場合とで、音や音声を変化させてもよく、到達位置P1までの距離に応じて音や音声の間隔(ピッチ)を変化させてもよい。 The information providing unit 22 provides information related to the distance and direction between the position P5 of the endoscope 2 and the arrival position P1 (or the test part position P2) based on the position information of the endoscope magnetic sensor 5. (Step S5). As shown in FIG. 4 (c), based on the information provided from the information providing unit 22, the monitor 17 displays the vector V1 on the ultrasonic image. The vector V1 indicates the distance and direction from the position P5 of the endoscope 2 to the arrival position P1. For example, when the endoscope 2 approaches the arrival position P1 along the guide path P3, the blue vector V1 may be displayed. When the endoscope 2 moves away from the arrival position P1, the red vector V1 may be displayed. . That is, the display form of the vector V1 is different depending on whether it approaches or farther from the arrival position P1. Further, the monitor 17 may display the distance to the arrival position P1 along the guidance route P3. Further, based on the information provided from the information providing unit 22, the speaker 18 may indicate the distance and direction from the position of the endoscope 2 to the arrival position P1 by sound or voice. The sound and voice may be changed depending on whether the endoscope 2 approaches or reaches the arrival position P1 along the guidance path P3. May be changed.
 また、情報提供部22は、内視鏡2の位置や角度、内視鏡2の誘導速度、内視鏡2の誘導加速度、内視鏡2の誘導方向、及び圧力センサによる内視鏡2の当接圧力のうち少なくとも1つに関する情報を提供する(ステップS5)。モニタ17又はスピーカ18は、情報提供部22から提供される情報を示す。 The information providing unit 22 also determines the position and angle of the endoscope 2, the guidance speed of the endoscope 2, the guidance acceleration of the endoscope 2, the guidance direction of the endoscope 2, and the pressure sensor. Information about at least one of the contact pressures is provided (step S5). The monitor 17 or the speaker 18 shows information provided from the information providing unit 22.
 情報提供部22は、内視鏡2が注目領域P4に到達したときに、注目領域P4に到達したことを示す情報を提供する(ステップS6及びステップS7)。警告部(モニタ17又はスピーカ18)は、情報提供部22から提供される情報に基づいて、操作者に注意喚起を行ったり、内視鏡2の光学画像を自動的に表示したりする。例えば、モニタ17は、注目領域P4を映し出す光学画像を自動的に拡大してもよく、光学画像の枠の色などの表示形態を変化させてもよい。また、スピーカ18は、内視鏡2が注目領域P4に存在する間、操作者に注意を喚起するような音や音声を発してもよい。 The information providing unit 22 provides information indicating that the endoscope 2 has reached the attention area P4 when the endoscope 2 reaches the attention area P4 (steps S6 and S7). The warning unit (the monitor 17 or the speaker 18) alerts the operator based on the information provided from the information providing unit 22, or automatically displays the optical image of the endoscope 2. For example, the monitor 17 may automatically enlarge the optical image that displays the attention area P4, and may change the display form such as the color of the frame of the optical image. Further, the speaker 18 may emit a sound or a sound that alerts the operator while the endoscope 2 is present in the attention area P4.
 また、図4(d)及び図5に示すように、警告部(モニタ17又はスピーカ18)は、情報提供部22から提供される情報(内視鏡2の位置や角度など)に基づいて、内視鏡2の位置が誘導経路P3から逸れた場合に警告を行う(ステップS6及びステップS7)。 Further, as shown in FIG. 4D and FIG. 5, the warning unit (the monitor 17 or the speaker 18) is based on information provided from the information providing unit 22 (such as the position and angle of the endoscope 2). A warning is given when the position of the endoscope 2 deviates from the guidance path P3 (step S6 and step S7).
 例えば、内視鏡2の位置や角度に基づいて、内視鏡2の位置と誘導経路P3との距離が所定の閾値を超えた場合に、内視鏡2が誘導経路P3と違う器官に誤挿入されたと判断して、モニタ17は警告メッセージ35を表示し、スピーカ18は警告音を発生させる。これにより、医用画像を用いながら内視鏡2を被検体の体腔内へ安全に誘導することができる。また、内視鏡2の内視鏡超音波振動子6からの超音波画像を利用すれば、さらに安全に、内視鏡2を被検体の体腔内へ誘導することができる。 For example, based on the position and angle of the endoscope 2, when the distance between the position of the endoscope 2 and the guide path P3 exceeds a predetermined threshold, the endoscope 2 is mistaken for an organ different from the guide path P3. The monitor 17 displays a warning message 35, and the speaker 18 generates a warning sound, judging that it has been inserted. Thereby, it is possible to safely guide the endoscope 2 into the body cavity of the subject while using the medical image. Further, if the ultrasonic image from the endoscope ultrasonic transducer 6 of the endoscope 2 is used, the endoscope 2 can be guided more safely into the body cavity of the subject.
 上述のように、本発明の内視鏡誘導システムは、内視鏡2が誘導される誘導経路を設定する誘導経路設定部20と、内視鏡2の位置が誘導経路から逸れた場合に警告する警告部(モニタ17又はスピーカ18)とを備える。この構成によれば、警告により内視鏡が誘導経路から逸れたことを確認できるため、内視鏡を被検体へ安全に誘導することができる。 As described above, the endoscope guidance system of the present invention provides a guidance route setting unit 20 that sets a guidance route for guiding the endoscope 2, and a warning when the position of the endoscope 2 deviates from the guidance route. Warning section (monitor 17 or speaker 18). According to this configuration, it can be confirmed that the endoscope has deviated from the guidance path by a warning, and therefore the endoscope can be safely guided to the subject.
 また、図5に示すように、モニタ17は、内視鏡2の位置P5が誘導経路P3から逸れた場合に、内視鏡2の位置と誘導経路P3との距離又は方向を警告するために、ベクトルV2を超音波3次元画像(医用画像)に表示してもよい。この場合、モニタ17は、内視鏡2が誘導経路P3から逸れた距離に応じて、ベクトルV2の形や色などの表示形態を変化させてもよく、スピーカ18は、音や音声を変化させてもよい。 Further, as shown in FIG. 5, the monitor 17 warns the distance or direction between the position of the endoscope 2 and the guide path P3 when the position P5 of the endoscope 2 deviates from the guide path P3. The vector V2 may be displayed on an ultrasonic three-dimensional image (medical image). In this case, the monitor 17 may change the display form such as the shape and color of the vector V2 according to the distance that the endoscope 2 deviates from the guide path P3, and the speaker 18 changes the sound and sound. May be.
 上述のように、本発明の内視鏡誘導システムでは、警告部(モニタ17又はスピーカ18)は、内視鏡2の位置が誘導経路から逸れた場合に、内視鏡2の位置と誘導経路との距離又は方向を警告する。この構成によれば、内視鏡が誘導経路から逸れた距離又は方向を確認できるため、内視鏡を被検体へ安全に誘導することができる。 As described above, in the endoscope guidance system of the present invention, the warning unit (the monitor 17 or the speaker 18) is configured so that the position of the endoscope 2 and the guidance path when the position of the endoscope 2 deviates from the guidance path. Warning the distance or direction. According to this configuration, since the distance or direction of the endoscope deviating from the guidance path can be confirmed, the endoscope can be safely guided to the subject.
 内視鏡2が到達位置P1に到達した場合(ステップS8)、情報提供部22は、内視鏡2の位置と被検部位置P2との距離又は方向に関する情報を提供し、モニタ17は、情報提供部22により提供された情報に基づいて、内視鏡2の位置P5と被検部位置P2との距離及び方向を超音波3次元画像(医用画像)に表示する(ステップS9)。図6に示すように、内視鏡2の位置P5と被検部位置P2との距離又は方向を表すために、ベクトルV3を表示してもよい。この場合、内視鏡2の位置P5と被検部位置P2との距離又は方向に応じて、モニタ17はベクトルV3の形や色などの表示形態を変化させてもよく、スピーカ18は音や音声を変化させてもよい。これにより、鉗子口7から穿刺針70(突出部)が突出して、被検部位置P2への距離又は方向を把握しながら、被検部位置P2へ到達することができ、生体に対して採取や治療を施すことができる(ステップS10)。また、突出部は、鉗子や高周波メスなどの医療器具であってもよい。突出部が鉗子である場合は、被検部位置P2への距離又は方向を把握しながら、鉗子が被検部位置P2へ到達することができ、被検体に対して安全に生体組織を処置することができる(ステップS10)。 When the endoscope 2 has reached the arrival position P1 (step S8), the information providing unit 22 provides information on the distance or direction between the position of the endoscope 2 and the test portion position P2, and the monitor 17 Based on the information provided by the information providing unit 22, the distance and direction between the position P5 of the endoscope 2 and the test portion position P2 are displayed in an ultrasonic three-dimensional image (medical image) (step S9). As shown in FIG. 6, a vector V3 may be displayed to represent the distance or direction between the position P5 of the endoscope 2 and the test portion position P2. In this case, the monitor 17 may change the display form such as the shape and color of the vector V3 according to the distance or direction between the position P5 of the endoscope 2 and the test portion position P2, and the speaker 18 The voice may be changed. As a result, the puncture needle 70 (protruding part) protrudes from the forceps port 7 and can reach the test part position P2 while grasping the distance or direction to the test part position P2, and collected from the living body. Or treatment can be performed (step S10). The protrusion may be a medical instrument such as a forceps or a high-frequency knife. When the protruding portion is a forceps, the forceps can reach the test portion position P2 while grasping the distance or direction to the test portion position P2, and safely treat the living tissue with respect to the subject. (Step S10).
 上述のように、本発明の内視鏡誘導システムは、内視鏡2が誘導されて到達する到達位置を設定する到達位置設定部21と、内視鏡2の位置と到達位置との距離又は方向に関する情報を提供する情報提供部22とを備える。この構成によれば、内視鏡から到達位置への距離又は方向を確認できるため、内視鏡を被検体へ安全に誘導することができる。 As described above, the endoscope guidance system of the present invention includes the arrival position setting unit 21 that sets the arrival position to which the endoscope 2 is guided and reached, and the distance between the position of the endoscope 2 and the arrival position, or And an information providing unit 22 that provides information on the direction. According to this configuration, since the distance or direction from the endoscope to the reaching position can be confirmed, the endoscope can be safely guided to the subject.
 また、本発明の内視鏡誘導システムは、被検部の位置を設定する被検部位置設定部23と、内視鏡2の位置と被検部の位置との距離又は方向に関する情報を提供する情報提供部22とを備える。この構成によれば、内視鏡から被検部位置への距離又は方向を確認できるため、内視鏡を用いた治療や採取などを行う場合に、被検体に安全に治療や採取などを行うことができる。 In addition, the endoscope guidance system of the present invention provides the information about the distance or direction between the position of the endoscope 2 and the position of the test part, and the test part position setting part 23 for setting the position of the test part And an information providing unit 22 for providing information. According to this configuration, since the distance or direction from the endoscope to the position of the test portion can be confirmed, when performing treatment or collection using the endoscope, treatment or collection is safely performed on the subject. be able to.
 穿刺針70(突出部)は、空間における穿刺針70(突出部)の位置を検出する磁気センサ(第3の位置センサ)を備え、モニタ17は、穿刺針70(突出部)の位置を超音波3次元画像31(医用画像)に表示してもよい。また、情報提供部22は、穿刺針70(突出部)の位置と被検部位置P2との距離又は方向に関する情報を、警告部(モニタ17又はスピーカ18)に提供してもよい。穿刺針70(突出部)の位置と被検部位置P2との距離又は方向を表すために、モニタ17は医用画像にベクトルを表示してもよい。この場合、穿刺針70(突出部)の位置と被検部位置P2との距離又は方向に応じて、モニタ17はベクトルの形や色などの表示形態を変化させてもよく、スピーカ18は音や音声を変化させてもよい。これにより、穿刺針70の先端位置と被検部位置P2との距離又は方向を把握しながら、穿刺針70(突出部)が被検部位置P2へ確実に到達することができ、生体に対して安全に生体組織を取得したり、治療を施したりすることができる。突出部が鉗子である場合は、鉗子の先端位置と被検部位置P2との距離又は方向を把握しながら、鉗子が被検部位置P2へ到達することができ、被検体に対して安全に生体組織を処置することができる。 The puncture needle 70 (projection) includes a magnetic sensor (third position sensor) that detects the position of the puncture needle 70 (projection) in the space, and the monitor 17 exceeds the position of the puncture needle 70 (projection). You may display on the sound wave three-dimensional image 31 (medical image). Further, the information providing unit 22 may provide information on the distance or direction between the position of the puncture needle 70 (protruding part) and the test part position P2 to the warning unit (the monitor 17 or the speaker 18). In order to indicate the distance or direction between the position of the puncture needle 70 (protruding portion) and the test portion position P2, the monitor 17 may display a vector on the medical image. In this case, depending on the distance or direction between the position of the puncture needle 70 (protrusion) and the test part position P2, the monitor 17 may change the display form such as the shape and color of the vector, and the speaker 18 And the sound may be changed. Thereby, while grasping the distance or direction between the tip position of the puncture needle 70 and the test portion position P2, the puncture needle 70 (protruding portion) can surely reach the test portion position P2, and against the living body. Thus, it is possible to safely acquire a biological tissue or perform treatment. When the protruding portion is a forceps, the forceps can reach the test portion position P2 while grasping the distance or direction between the tip position of the forceps and the test portion position P2, and it is safe for the subject. Living tissue can be treated.
 上述のように、本発明の内視鏡誘導システムでは、内視鏡は突出部(穿刺針70)を備え、突出部は空間における突出部の位置を検出する位置センサ(磁気センサ)を備え、表示部(モニタ17)は医用画像に突出部の位置を表示する。この構成によれば、突出部の位置を医用画像で確認しながら、突出部を被検部位置へ安全に誘導できるため、被検体に安全に治療や採取などを行うことができる。 As described above, in the endoscope guidance system of the present invention, the endoscope includes a protrusion (puncture needle 70), the protrusion includes a position sensor (magnetic sensor) that detects the position of the protrusion in space, The display unit (monitor 17) displays the position of the protrusion on the medical image. According to this configuration, since the protruding portion can be safely guided to the position of the test portion while confirming the position of the protruding portion with the medical image, it is possible to safely treat or collect the subject.
 また、本発明の内視鏡誘導システムは、被検部の位置を設定する被検部位置設定部23と、突出部(穿刺針70)の位置と被検部の位置との距離又は方向に関する情報を提供する情報提供部22とを備える。この構成によれば、突出部から被検部位置への距離又は方向を確認できるため、穿刺針や鉗子を用いた治療や採取などを行う場合に、被検体に安全に治療や採取などを行うことができる。 In addition, the endoscope guidance system of the present invention relates to a test part position setting unit 23 that sets the position of the test part, and a distance or direction between the position of the protrusion (puncture needle 70) and the position of the test part. And an information providing unit 22 that provides information. According to this configuration, since the distance or direction from the protruding portion to the position of the test portion can be confirmed, when treatment or collection using a puncture needle or forceps is performed, treatment or collection is safely performed on the subject. be able to.
 また、内視鏡2の光学カメラ3や超音波振動子6を被検部位置P2へ向けて、被検部の光学画像や超音波画像を取得することで、生体組織採取や治療の状況を超音波画像でリアルタイムに観察することができる。これにより、生体組織採取や治療の効果を確認しながら、生体に対してさらに安全に生体組織を取得したり、治療を施したりすることができる(ステップS11)。また、内視鏡2が到達位置P1に到達した場合に(ステップS8)、モニタ17は、内視鏡2の光学画像から内視鏡2の超音波画像に切り替えてもよい。 In addition, by directing the optical camera 3 and the ultrasonic transducer 6 of the endoscope 2 to the test part position P2, and acquiring the optical image and the ultrasonic image of the test part, the state of biological tissue collection and treatment can be checked. It can be observed in real time with ultrasound images. As a result, it is possible to acquire a biological tissue more safely with respect to the living body or to perform a treatment while confirming the effects of collecting the biological tissue and the treatment (step S11). Further, when the endoscope 2 reaches the arrival position P1 (step S8), the monitor 17 may switch from the optical image of the endoscope 2 to the ultrasonic image of the endoscope 2.
 また、内視鏡2の超音波振動子6を被検部位置P2へ向けて、超音波振動子6により光音響効果を観測することもでき、光音響効果を確認しながら、生体に対してさらに安全に生体組織を取得したり、治療を施したりすることができる(ステップS11)。光音響効果の観測では、疾患部位に特異的に凝集する光音響薬剤を被検体に投与し、内視鏡2の鉗子口7からレーザーなどを被検部位置P2に照射することで、光音響薬剤が、光エネルギーを吸収して、振動及び蒸発し、超音波信号を発生する。この超音波信号を超音波振動子6、30が観測することにより、光音響効果の観測が行われる。これにより、光音響を用いた治療及び光音響効果の観測は、体表のみならず、食道、胃、消化管、及び腸管などの生体深部臓器への適用も可能となる。 In addition, it is possible to observe the photoacoustic effect with the ultrasonic transducer 6 by directing the ultrasonic transducer 6 of the endoscope 2 toward the test portion position P2, and while confirming the photoacoustic effect, Further, it is possible to safely acquire a biological tissue or perform treatment (step S11). In the observation of the photoacoustic effect, a photoacoustic agent that specifically aggregates at a diseased site is administered to the subject, and a laser or the like is irradiated from the forceps port 7 of the endoscope 2 to the test portion position P2, thereby causing photoacoustics. The drug absorbs light energy, vibrates and evaporates, generating an ultrasonic signal. By observing the ultrasonic signals by the ultrasonic transducers 6 and 30, the photoacoustic effect is observed. Thus, treatment using photoacoustics and observation of photoacoustic effects can be applied not only to the body surface but also to deep organs such as the esophagus, stomach, digestive tract, and intestinal tract.
 上述のように、本発明の内視鏡誘導システムでは、内視鏡2は超音波振動子6を備え、超音波振動子6により光音響効果を観測する。この構成によれば、被検体内部から光音響効果を観測することができ、効果的な光音響治療を行うことができる。 As described above, in the endoscope guidance system of the present invention, the endoscope 2 includes the ultrasonic transducer 6 and the photoacoustic effect is observed by the ultrasonic transducer 6. According to this configuration, the photoacoustic effect can be observed from the inside of the subject, and effective photoacoustic treatment can be performed.
 また、被検体の体腔内の観察手段として、内視鏡2先端の鉗子口7からIVUS(intravascular ultrasound)などを用いれば、超音波振動子6により血管内から見た超音波画像を取得できるので、さらなる詳細な病変情報を取得することができる。 In addition, if an IVUS (intravascular ultrasound) is used from the forceps port 7 at the distal end of the endoscope 2 as an observation means in the body cavity of the subject, an ultrasonic image viewed from inside the blood vessel can be acquired by the ultrasonic transducer 6. More detailed lesion information can be obtained.
 生体組織採取や治療の効果を確認した場合は、内視鏡2を被検体から抜去する(ステップS12)。 When confirming the effect of collection of biological tissue or treatment, the endoscope 2 is removed from the subject (step S12).
 (第2の実施の形態)
 以下、本発明の第2の実施の形態にかかる医用画像診断装置について、図面を用いて説明する。特に言及しない場合は、他の構成は、第1の実施の形態にかかる内視鏡誘導システムと同様である。
(Second embodiment)
Hereinafter, a medical image diagnostic apparatus according to a second embodiment of the present invention will be described with reference to the drawings. Unless otherwise specified, other configurations are the same as those of the endoscope guidance system according to the first embodiment.
 第1の実施の形態では、図3に示すように、超音波画像生成回路13によって超音波3次元画像として予め取得された超音波画像(ボリュームデータ)を、内視鏡2を挿入するためのリファレンス像とする。一方、第2の実施の形態では、リファレンス像は、3次元ボリュームデータであれば、CT画像やMRI画像であってもよい。 In the first embodiment, as shown in FIG. 3, an ultrasonic image (volume data) acquired in advance as an ultrasonic three-dimensional image by the ultrasonic image generation circuit 13 is used for inserting the endoscope 2. A reference image is used. On the other hand, in the second embodiment, the reference image may be a CT image or an MRI image as long as it is three-dimensional volume data.
 第1の実施の形態では、内視鏡磁気センサ5の座標系と超音波探触子磁気センサ16の座標系を同一として扱える。一方、第2の実施の形態では、CT座標系やMRI座標系と内視鏡磁気センサ5の座標系を一致させる必要がある。ここで、CTやMRIの3次元画像の座標系を、超音波探触子11に取り付けた磁気センサ5の座標系に変換する手法に関しては、日本国特許第4300488号公報(「超音波診断におけるリファレンス像表示方法及び超音波診断装置」、株式会社日立メディコ)に詳しく記載されている。日本国特許第4300488号公報は、体外の超音波探触子に取り付けた磁気センサである場合の座標変換を示しているが、本実施の形態では、体外の超音波探触子に取り付けた磁気センサを、内視鏡2に取り付けた磁気センサ5とすれば、CTやMRIの3次元座標系と内視鏡磁気センサ座標系との相互座標変換にも適用可能である。 In the first embodiment, the coordinate system of the endoscope magnetic sensor 5 and the coordinate system of the ultrasonic probe magnetic sensor 16 can be handled as the same. On the other hand, in the second embodiment, it is necessary to match the CT coordinate system or MRI coordinate system with the coordinate system of the endoscope magnetic sensor 5. Here, regarding a method for converting the coordinate system of the CT or MRI three-dimensional image into the coordinate system of the magnetic sensor 5 attached to the ultrasonic probe 11, Japanese Patent No. 4300488 (`` Ultrasonic diagnosis Reference image display method and ultrasonic diagnostic apparatus ", Hitachi Medical Co., Ltd.). Japanese Patent No. 4300488 shows coordinate transformation in the case of a magnetic sensor attached to an ultrasonic probe outside the body, but in this embodiment, a magnetic attached to the ultrasonic probe outside the body. If the sensor is the magnetic sensor 5 attached to the endoscope 2, it can also be applied to mutual coordinate conversion between the CT or MRI three-dimensional coordinate system and the endoscope magnetic sensor coordinate system.
 このように、CTやMRIの3次元座標系と内視鏡磁気センサ座標系との相互座標変換が実現できるので、図7に示すように、モニタ17(表示部)は、磁気センサ5により検出された内視鏡2の位置P5や角度、誘導経路設定部20により設定された誘導経路P3、到達位置設定部21により設定された到達位置P1、情報提供部22により提供される距離又は方向に関する情報、被検部位置設定部23により設定される被検部の位置P2、及び注目領域設定部24により設定される注目領域P4を、CT/MRI画像36に重畳して表示することができる。また、モニタ17は、穿刺針70(突出部)の位置をCT/MRI画像36(医用画像)に表示してもよい。また、モニタ17は、内視鏡2に取り付けた内視鏡超音波振動子6の超音波画像をCT/MRI画像36とともに表示したり、CT/MRI画像36の被検部に重畳したりしてもよい。 In this way, mutual coordinate transformation between the CT and MRI three-dimensional coordinate system and the endoscope magnetic sensor coordinate system can be realized, so that the monitor 17 (display unit) is detected by the magnetic sensor 5 as shown in FIG. The position P5 and angle of the endoscope 2, the guidance route P3 set by the guidance route setting unit 20, the arrival position P1 set by the arrival position setting unit 21, and the distance or direction provided by the information providing unit 22 The information, the position P2 of the test part set by the test part position setting unit 23, and the attention area P4 set by the attention area setting unit 24 can be displayed superimposed on the CT / MRI image 36. Further, the monitor 17 may display the position of the puncture needle 70 (protrusion) on the CT / MRI image 36 (medical image). The monitor 17 displays an ultrasonic image of the endoscope ultrasonic transducer 6 attached to the endoscope 2 together with the CT / MRI image 36, or superimposes it on the test part of the CT / MRI image 36. May be.
 図8に示すように、本実施の形態に係る内視鏡誘導システムは、CT/MRI画像データベース80を備える。CT/MRI画像データベース80は、予め取得されたCT/MRI3次元画像(ボリュームデータ)を、位置情報とともに格納する。図9に示すように、制御回路14が、CT/MRI画像データベース80に格納されるボリュームデータを用いて、CT/MRI画像を取得する(ステップS100)。制御回路14は、内視鏡2の先端に備え付けられた内視鏡磁気センサ5の3次元位置を算出し、CT/MRI座標系と内視鏡磁気センサ5の座標系を一致させる。モニタ17は、一致する座標系に基づいて、内視鏡2の位置P5や角度、誘導経路P3、到達位置P1、距離又は方向に関する情報、被検部位置P2、及び注目領域P4などを、CT/MRI画像に重畳して表示する(ステップS2、S3、S5、S7、及びS9など)。このように、様々な医用画像(X線画像、CT、MRI、超音波画像、及び血管造影など)を用いた3次元画像に、本発明は適用可能である。 As shown in FIG. 8, the endoscope guidance system according to the present embodiment includes a CT / MRI image database 80. The CT / MRI image database 80 stores CT / MRI three-dimensional images (volume data) acquired in advance together with position information. As shown in FIG. 9, the control circuit 14 acquires a CT / MRI image using the volume data stored in the CT / MRI image database 80 (step S100). The control circuit 14 calculates the three-dimensional position of the endoscope magnetic sensor 5 provided at the distal end of the endoscope 2, and matches the CT / MRI coordinate system and the coordinate system of the endoscope magnetic sensor 5. The monitor 17 is based on the coordinate system that matches, the position P5 and angle of the endoscope 2, the guidance path P3, the arrival position P1, the information about the distance or direction, the test part position P2, the attention area P4, etc. / MRI image is superimposed and displayed (steps S2, S3, S5, S7, S9, etc.). Thus, the present invention can be applied to a three-dimensional image using various medical images (X-ray image, CT, MRI, ultrasound image, angiography, etc.).
 また、第2の実施の形態では超音波画像を用いたが、超音波画像を用いなくても、本発明は適用可能である。図10に示すように、医用画像診断装置101は、超音波探触子11、内視鏡超音波振動子6、超音波送受信回路12、及び超音波画像生成回路13を備えていない。この場合、リファレンス像として、CT/MRI3次元画像のボリュームデータを用いる。予め取得されたCT/MRI3次元画像(ボリュームデータ)は、CT/MRI画像データベース80に位置情報とともに格納される。超音波探触子11に取り付けた磁気センサ5の座標系とCT/MRI座標系との変換に関しては、日本国特許第4300488号公報に記載されている手法を用いる。 In the second embodiment, an ultrasonic image is used. However, the present invention can be applied without using an ultrasonic image. As shown in FIG. 10, the medical image diagnostic apparatus 101 does not include the ultrasonic probe 11, the endoscope ultrasonic transducer 6, the ultrasonic transmission / reception circuit 12, and the ultrasonic image generation circuit 13. In this case, volume data of a CT / MRI three-dimensional image is used as a reference image. A CT / MRI three-dimensional image (volume data) acquired in advance is stored in the CT / MRI image database 80 together with position information. Regarding the conversion between the coordinate system of the magnetic sensor 5 attached to the ultrasonic probe 11 and the CT / MRI coordinate system, the method described in Japanese Patent No. 4300488 is used.
 図11に示すように、制御回路14が、CT/MRI画像データベース80に格納されるボリュームデータを用いて、CT/MRI画像を取得する(ステップS200)。制御回路14は、内視鏡2の先端に備え付けられた内視鏡磁気センサ5の3次元位置を算出し、CT/MRI座標系と内視鏡磁気センサ5の座標系を一致させる。モニタ17は、一致する座標系に基づいて、内視鏡2の位置P5や角度、誘導経路P3、到達位置P1、距離又は方向に関する情報、被検部位置P2、及び注目領域P4などを、CT/MRI画像に重畳して表示する(ステップS2、S3、S5、S7、及びS9など)。このように、超音波画像以外の様々な医用画像を用いた3次元画像にも、本発明は適用可能である。 As shown in FIG. 11, the control circuit 14 acquires a CT / MRI image using the volume data stored in the CT / MRI image database 80 (step S200). The control circuit 14 calculates the three-dimensional position of the endoscope magnetic sensor 5 provided at the distal end of the endoscope 2, and matches the CT / MRI coordinate system and the coordinate system of the endoscope magnetic sensor 5. The monitor 17 is based on the coordinate system that matches, the position P5 and angle of the endoscope 2, the guidance path P3, the arrival position P1, the information about the distance or direction, the test part position P2, the attention area P4, etc. / MRI image is superimposed and displayed (steps S2, S3, S5, S7, S9, etc.). As described above, the present invention can also be applied to a three-dimensional image using various medical images other than the ultrasonic image.
 以上の実施の形態によれば、医用画像を用いながら内視鏡を被検体へ誘導する場合に生体へ安全に内視鏡を誘導するとともに、内視鏡を用いた治療や採取などを行う場合にも、生体に安全に治療などを行うことができる。 According to the above embodiment, when guiding an endoscope to a subject while using a medical image, the endoscope is safely guided to a living body, and treatment or collection using the endoscope is performed. In addition, it is possible to safely treat the living body.
 以上、本発明にかかる実施の形態について説明したが、本発明はこれらに限定されるものではなく、請求項に記載された範囲内において変更・変形することが可能である。 As mentioned above, although embodiment concerning this invention was described, this invention is not limited to these, It is possible to change and change within the range described in the claim.
 例えば、図12に示すように、モニタ17は、誘導経路P3、内視鏡2の位置P5から到達位置P1への距離及び方向を示すベクトルV1、内視鏡2の位置と誘導経路P3との距離又は方向を示すベクトルV2、及び内視鏡2の位置P5と被検部位置P2との距離又は方向を示すベクトルV3のうち少なくとも1つを、内視鏡2の光学画像(医用画像)に表示してもよい。また、モニタ17は、到達位置P1、被検部位置P2、内視鏡2の位置や角度、内視鏡2の誘導速度、内視鏡2の誘導加速度、内視鏡2の誘導方向、及び圧力センサによる内視鏡2の当接圧力のうち少なくとも1つを、内視鏡2の光学画像(医用画像)に表示してもよい。 For example, as shown in FIG. 12, the monitor 17 includes a guide path P3, a vector V1 indicating the distance and direction from the position P5 of the endoscope 2 to the arrival position P1, and the position of the endoscope 2 and the guide path P3. At least one of the vector V2 indicating the distance or direction and the vector V3 indicating the distance or direction between the position P5 of the endoscope 2 and the position P2 to be examined is used as an optical image (medical image) of the endoscope 2. It may be displayed. In addition, the monitor 17 is the arrival position P1, the test portion position P2, the position and angle of the endoscope 2, the guidance speed of the endoscope 2, the guidance acceleration of the endoscope 2, the guidance direction of the endoscope 2, and At least one of the contact pressures of the endoscope 2 by the pressure sensor may be displayed on the optical image (medical image) of the endoscope 2.
 本発明にかかる内視鏡誘導システムは、医用画像を用いながら内視鏡を被検体へ誘導する場合に生体へ安全に内視鏡を誘導するとともに、内視鏡を用いた治療や採取などを行う場合にも、生体に安全に治療などを行うことのできるという効果を有し、被検体に安全に内視鏡を誘導する内視鏡誘導システムなどとして有用である。 The endoscope guidance system according to the present invention safely guides an endoscope to a living body when guiding the endoscope to a subject while using a medical image, and performs treatment or collection using the endoscope. Even when it is performed, it has an effect that treatment can be safely performed on a living body, and is useful as an endoscope guidance system for safely guiding an endoscope to a subject.
 1 内視鏡誘導システム、2 内視鏡、3 光学カメラ、4 内視鏡コネクタ、5 内視鏡磁気センサ、6 内視鏡超音波振動子、7 鉗子口、8 内視鏡シャフト、9 光モジュール、10 超音波装置、11 超音波探触子、12 超音波送受信回路、13 超音波画像生成回路、14 制御回路、15 操作パネル、16 超音波探触子磁気センサ、17 モニタ、18 スピーカ、19 位置検出部、20 誘導経路設定部、21 到達位置設定部、22 情報提供部、23 被検部位置設定部、24 注目領域設定部、70 穿刺針 1 Endoscope guidance system, 2 Endoscope, 3 Optical camera, 4 Endoscope connector, 5 Endoscope magnetic sensor, 6 Endoscope ultrasonic transducer, 7 Forceps opening, 8 Endoscope shaft, 9 Light Module, 10 ultrasonic device, 11 ultrasonic probe, 12 ultrasonic transmission / reception circuit, 13 ultrasonic image generation circuit, 14 control circuit, 15 operation panel, 16 ultrasonic probe magnetic sensor, 17 monitor, 18 speaker, 19 position detection unit, 20 guide route setting unit, 21 arrival position setting unit, 22 information providing unit, 23 test portion position setting unit, 24 attention area setting unit, 70 puncture needle

Claims (13)

  1.  内視鏡を備える内視鏡誘導システムにおいて、
     空間における前記内視鏡の位置を検出する位置センサと、
     前記内視鏡が誘導される部分の医用画像を生成する医用画像生成部と、
     前記医用画像に前記内視鏡の位置を表示する表示部と
     を備えることを特徴とする内視鏡誘導システム。
    In an endoscope guidance system including an endoscope,
    A position sensor for detecting the position of the endoscope in space;
    A medical image generation unit that generates a medical image of a portion to which the endoscope is guided;
    An endoscope guidance system comprising: a display unit that displays a position of the endoscope on the medical image.
  2.  前記表示部は、前記内視鏡が誘導される誘導経路、前記内視鏡が誘導されて到達する到達位置、及び被検部の位置のうち少なくとも1つを前記医用画像に表示することを特徴とする請求項1に記載の内視鏡誘導システム。 The display unit displays at least one of a guide route through which the endoscope is guided, a reaching position at which the endoscope is guided and reached, and a position of a test unit on the medical image. The endoscope guidance system according to claim 1.
  3.  前記内視鏡が誘導される誘導経路を設定する誘導経路設定部と、
     前記内視鏡の位置が前記誘導経路から逸れた場合に警告する警告部と
     を備えることを特徴とする請求項1に記載の内視鏡誘導システム。
    A guide route setting unit for setting a guide route for guiding the endoscope;
    2. The endoscope guidance system according to claim 1, further comprising a warning unit that warns when the position of the endoscope deviates from the guidance path.
  4.  前記警告部は、前記内視鏡の位置が前記誘導経路から逸れた場合に、前記内視鏡の位置と前記誘導経路との距離又は方向を警告することを特徴とする請求項3に記載の内視鏡誘導システム。 4. The warning unit according to claim 3, wherein when the position of the endoscope deviates from the guide path, the warning unit warns the distance or direction between the position of the endoscope and the guide path. Endoscope guidance system.
  5.  前記内視鏡が誘導されて到達する到達位置を設定する到達位置設定部と、
     前記内視鏡の位置と前記到達位置との距離又は方向に関する情報を提供する情報提供部とを備えることを特徴とする請求項1に記載の内視鏡誘導システム。
    An arrival position setting unit for setting an arrival position at which the endoscope is guided and reached;
    2. The endoscope guidance system according to claim 1, further comprising an information providing unit that provides information regarding a distance or direction between the position of the endoscope and the arrival position.
  6.  被検部の位置を設定する被検部位置設定部と、
     前記内視鏡の位置と前記被検部の位置との距離又は方向に関する情報を提供する情報提供部とを備えることを特徴とする請求項1に記載の内視鏡誘導システム。
    A test part position setting unit for setting the position of the test part;
    2. The endoscope guidance system according to claim 1, further comprising: an information providing unit that provides information regarding a distance or direction between the position of the endoscope and the position of the test unit.
  7.  前記内視鏡は、突出部を備え、
     前記突出部は、空間における前記突出部の位置を検出する位置センサを備え、
     前記表示部は、前記医用画像に前記突出部の位置を表示することを特徴とする請求項1に記載の内視鏡誘導システム。
    The endoscope includes a protrusion,
    The protrusion includes a position sensor that detects a position of the protrusion in space.
    2. The endoscope guidance system according to claim 1, wherein the display unit displays a position of the protruding portion on the medical image.
  8.  被検部の位置を設定する被検部位置設定部と、
     前記突出部の位置と前記被検部の位置との距離又は方向に関する情報を提供する情報提供部とを備えることを特徴とする請求項7に記載の内視鏡誘導システム。
    A test part position setting unit for setting the position of the test part;
    8. The endoscope guidance system according to claim 7, further comprising an information providing unit that provides information regarding a distance or direction between the position of the protruding portion and the position of the test portion.
  9.  前記内視鏡が誘導される誘導経路における注目領域を設定する注目領域設定部と、
     前記内視鏡が前記注目領域に到達したときに、前記注目領域に到達したことを示す情報を提供する情報提供部と
     を備えることを特徴とする請求項1に記載の内視鏡誘導システム。
    A region-of-interest setting unit for setting a region of interest in a guidance route through which the endoscope is guided;
    2. The endoscope guidance system according to claim 1, further comprising: an information providing unit that provides information indicating that the endoscope has reached the attention area when the endoscope reaches the attention area.
  10.  前記内視鏡は、超音波振動子を備え、被検部の超音波画像を取得することを特徴とする請求項1に記載の内視鏡誘導システム。 2. The endoscope guidance system according to claim 1, wherein the endoscope includes an ultrasonic transducer and acquires an ultrasonic image of a portion to be examined.
  11.  前記内視鏡は、超音波振動子を備え、前記超音波振動子により光音響効果を観測することを特徴とする請求項1に記載の内視鏡誘導システム。 2. The endoscope guidance system according to claim 1, wherein the endoscope includes an ultrasonic transducer, and the photoacoustic effect is observed by the ultrasonic transducer.
  12.  前記医用画像生成部は、前記内視鏡が誘導される部分の3次元画像として予め取得された医用画像を生成することを特徴とする請求項1に記載の内視鏡誘導システム。 2. The endoscope guidance system according to claim 1, wherein the medical image generation unit generates a medical image acquired in advance as a three-dimensional image of a portion where the endoscope is guided.
  13.  内視鏡を備える内視鏡誘導システムにおいて、
     空間における前記内視鏡の位置を検出し、
     前記内視鏡が誘導される部分の医用画像を生成し、
     前記医用画像に前記内視鏡の位置を表示することを特徴とする内視鏡誘導方法。
    In an endoscope guidance system including an endoscope,
    Detecting the position of the endoscope in space;
    Generating a medical image of a portion to which the endoscope is guided;
    An endoscope guiding method, wherein the position of the endoscope is displayed on the medical image.
PCT/JP2012/061839 2011-07-15 2012-05-09 Endoscope guidance system and endoscope guidance method WO2013011733A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011-156542 2011-07-15
JP2011156542 2011-07-15

Publications (1)

Publication Number Publication Date
WO2013011733A1 true WO2013011733A1 (en) 2013-01-24

Family

ID=47557924

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/061839 WO2013011733A1 (en) 2011-07-15 2012-05-09 Endoscope guidance system and endoscope guidance method

Country Status (2)

Country Link
JP (1) JPWO2013011733A1 (en)
WO (1) WO2013011733A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014065336A1 (en) * 2012-10-25 2014-05-01 オリンパス株式会社 Insertion system, insertion support device, insertion support method and program
JP2014079377A (en) * 2012-10-16 2014-05-08 Olympus Corp Observation apparatus, observation support apparatus, observation support method, and observation support program
JP2015028542A (en) * 2013-07-30 2015-02-12 オリンパス株式会社 Blade inspection device and blade inspection method
JP2016511027A (en) * 2013-02-08 2016-04-14 コビディエン エルピー Lung denervation system and method
EP2967487A4 (en) * 2013-03-15 2017-02-15 Fujifilm Sonosite, Inc. Ultrasound device with video display capability and associated devices, systems, and methods
JP2018134386A (en) * 2016-12-07 2018-08-30 ベイラブス, インク.Bay Labs, Inc. Guided navigation of ultrasound probe
KR20210061881A (en) * 2019-11-20 2021-05-28 전남대학교산학협력단 Photoacoustic image based laparoscopy apparatus and apparatus for searching catheter in blood vessel based on photoacoustic images
CN116158720A (en) * 2022-12-30 2023-05-26 深圳开立生物医疗科技股份有限公司 Optical-photoacoustic-ultrasonic composite endoscope and endoscope system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002200030A (en) * 2000-12-27 2002-07-16 Olympus Optical Co Ltd Position detecting device for endoscope
JP2002345725A (en) * 2001-05-22 2002-12-03 Olympus Optical Co Ltd Endoscopic system
JP2004089483A (en) * 2002-08-30 2004-03-25 Olympus Corp Endoscope apparatus
JP2006223849A (en) * 2005-01-18 2006-08-31 Pentax Corp Electronic endoscope system
JP2009125394A (en) * 2007-11-26 2009-06-11 Toshiba Corp Intravascular image diagnostic apparatus and intravascular image diagnostic system
JP2010517632A (en) * 2007-01-31 2010-05-27 ザ ペン ステイト リサーチ ファンデーション System for continuous guidance of endoscope

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002200030A (en) * 2000-12-27 2002-07-16 Olympus Optical Co Ltd Position detecting device for endoscope
JP2002345725A (en) * 2001-05-22 2002-12-03 Olympus Optical Co Ltd Endoscopic system
JP2004089483A (en) * 2002-08-30 2004-03-25 Olympus Corp Endoscope apparatus
JP2006223849A (en) * 2005-01-18 2006-08-31 Pentax Corp Electronic endoscope system
JP2010517632A (en) * 2007-01-31 2010-05-27 ザ ペン ステイト リサーチ ファンデーション System for continuous guidance of endoscope
JP2009125394A (en) * 2007-11-26 2009-06-11 Toshiba Corp Intravascular image diagnostic apparatus and intravascular image diagnostic system

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014079377A (en) * 2012-10-16 2014-05-08 Olympus Corp Observation apparatus, observation support apparatus, observation support method, and observation support program
JP2014083289A (en) * 2012-10-25 2014-05-12 Olympus Corp Insertion system, insertion support device, and insertion support method and program
WO2014065336A1 (en) * 2012-10-25 2014-05-01 オリンパス株式会社 Insertion system, insertion support device, insertion support method and program
US11547872B2 (en) 2013-02-08 2023-01-10 Covidien Lp System and method for lung denervation
JP2016511027A (en) * 2013-02-08 2016-04-14 コビディエン エルピー Lung denervation system and method
US10328281B2 (en) 2013-02-08 2019-06-25 Covidien Lp System and method for lung denervation
US10328280B2 (en) 2013-02-08 2019-06-25 Covidien Lp System and method for lung denervation
EP2967487A4 (en) * 2013-03-15 2017-02-15 Fujifilm Sonosite, Inc. Ultrasound device with video display capability and associated devices, systems, and methods
JP2015028542A (en) * 2013-07-30 2015-02-12 オリンパス株式会社 Blade inspection device and blade inspection method
JP2018134386A (en) * 2016-12-07 2018-08-30 ベイラブス, インク.Bay Labs, Inc. Guided navigation of ultrasound probe
JP7083143B2 (en) 2016-12-07 2022-06-10 キャプション ヘルス インコーポレイテッド Guided navigation of ultrasonic probe
KR102326307B1 (en) * 2019-11-20 2021-11-15 전남대학교산학협력단 Photoacoustic image based laparoscopy apparatus and apparatus for searching catheter in blood vessel based on photoacoustic images
KR20210061881A (en) * 2019-11-20 2021-05-28 전남대학교산학협력단 Photoacoustic image based laparoscopy apparatus and apparatus for searching catheter in blood vessel based on photoacoustic images
CN116158720A (en) * 2022-12-30 2023-05-26 深圳开立生物医疗科技股份有限公司 Optical-photoacoustic-ultrasonic composite endoscope and endoscope system
CN116158720B (en) * 2022-12-30 2023-11-21 深圳开立生物医疗科技股份有限公司 Optical-photoacoustic-ultrasonic composite endoscope and endoscope system

Also Published As

Publication number Publication date
JPWO2013011733A1 (en) 2015-02-23

Similar Documents

Publication Publication Date Title
WO2013011733A1 (en) Endoscope guidance system and endoscope guidance method
JP4581036B2 (en) Ultrasound endoscope system, ultrasound probe, and ultrasound endoscope
EP2967289B1 (en) Full-field three dimensional surface measurement
JP6668348B2 (en) Transesophageal echocardiography endoscopic (TEE) camera assist device
JP2008535560A (en) 3D imaging for guided interventional medical devices in body volume
JP6600690B2 (en) Insert support system
JP2012235983A (en) Medical image display system
US20160287210A1 (en) Devices and methods for ultrasound imaging
WO2021090056A1 (en) Combined ultrasound and endoscopy
JP5527841B2 (en) Medical image processing system
JP3808990B2 (en) Ultrasound diagnostic imaging equipment
JP2014204904A (en) Medical guide system
JP4248615B2 (en) Ultrasound diagnostic imaging equipment
JP4119530B2 (en) Endoscope device and position detection catheter inserted into endoscope
US20220202500A1 (en) Intraluminal navigation using ghost instrument information
WO2012075707A1 (en) Duodenoscope system integrated with infrared thermal scanner
US20220378400A1 (en) Combined ultrasound and endoscopy
CN116261419A (en) System and method for a triple imaging hybrid probe
CN114302679A (en) Ultrasonic endoscope system and method for operating ultrasonic endoscope system
WO2022059197A1 (en) Method for collecting biological tissue and biopsy support system
JP3943923B2 (en) Ultrasound diagnostic imaging equipment
US20230346211A1 (en) Apparatus and method for 3d surgical imaging
CN202051728U (en) Hard cystoscope system with color doppler ultrasonic scanning function
JPH08117233A (en) Ultrasonic endoscope device
CN102008324B (en) Hard cystoscope system with color Doppler ultrasonic scanning function

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12814234

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2013524622

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12814234

Country of ref document: EP

Kind code of ref document: A1