JP2012024518A - Device, method, and program for assisting endoscopic observation - Google Patents

Abstract

PROBLEM TO BE SOLVED: To recognize the position of an endoscope inserted in a tubular tissue of a subject within the tubular tissue.SOLUTION: The center line L of a tubular tissue of a subject is acquired from a previously acquired three-dimensional image of the subject, an endoscopic image captured while moving the endoscope inserted in the tubular tissue along the longitudinal direction of the tubular tissue is displayed. When one feature region of the tubular tissue is displayed in the displayed endoscopic image, the reference position of the endoscope is input and a position Q1 corresponding to the one feature region is set on the center line L. The amount of movement and the direction of travel of the endoscope moved further from the reference position are acquired, the position distant by the acquired amount of movement in the acquired direction of travel along the center line from the position Q1 corresponding to the one feature region is calculated as a present position Q2, and an indicator M indicating the calculated present position Q2 is displayed on the center line L.

Description

  The present invention relates to a technique for supporting endoscopic observation in an operation or examination under an endoscope inserted into a tubular tissue of a subject, and in particular, a virtual endoscope representing a tubular tissue of a subject. The present invention relates to a technique for supporting endoscopic observation using a mirror image.

  In recent years, attention has been paid to a technique for observing or treating a tubular tissue such as a large intestine or a bronchus of a patient using an endoscope. The doctors move the endoscope to a desired position while moving the endoscope to a desired position while using a curved portion or a branching portion in the tubular tissue as a mark on the endoscope image photographed by the endoscope. Observation or the like is performed with the endoscope image photographed by the above. However, in a tubular structure having a complicated structure, a similar scene continues except for a characteristic portion such as a curved portion or a branching portion in the tubular tissue, so that it is difficult to accurately grasp the position in the tubular tissue. This reduces the efficiency of doctors' smooth movement of the endoscope to the desired site of the tubular tissue so as not to collide with the wall of the tubular structure having a complicated structure, and increases the burden on the subject. This is one factor. For this reason, in order to smoothly move the endoscope to a desired site, there is a need for a technique that supports the grasp of the position of the endoscope inserted into the tubular tissue.

  For example, an endoscope in a tubular tissue is used by using a virtual endoscope image that generates an image similar to an endoscope from a three-dimensional volume image obtained by imaging with CT or the like. A technology that supports the grasping of the position of a person has been proposed.

  For example, in Patent Document 1, a virtual endoscopic image is generated from a three-dimensional image of a subject acquired in advance, and an error between the virtual endoscopic image and a real image captured by the endoscope is calculated and calculated. The position of the viewpoint of the virtual endoscope is moved until the error is less than the allowable error, and the calculation of the error between the moved virtual endoscope image and the endoscope image is repeated, and the calculated error is less than the allowable error. Describes a device that calculates the position and direction of the endoscope tip from the line-of-sight parameter of the virtual endoscopic image.

JP 2009-279251 A

  However, in a soft tubular tissue such as the large intestine, the patient's body position when the virtual endoscopic image is taken is supine, and the patient's body position when the endoscope is inserted is in the lateral position, etc. Even in the same region, the tubular tissue is deformed by the action of gravity for each different body position. For this reason, there is a high possibility that a virtual endoscopic image and an endoscopic image generated from three-dimensional image data obtained by a CT apparatus or the like are displayed in different shapes even in the same region. According to the proposed method, image matching is difficult. Furthermore, the image in the tubular tissue has a similar structure that is continuous in a section having no curved portion or branching portion as a characteristic of the tubular structure, and it is difficult to perform matching by comparing the features of the image.

  In order to confirm the position of the distal end of the treatment instrument, a method of arranging a magnetic sensor in the treatment instrument has also been proposed. However, the tubular tissue in the body is deformed due to deformation of the tubular tissue due to the patient's body position during imaging. Thus, the exact position could not be confirmed, and the desired accuracy could not be obtained.

  The present invention has been made in view of the above circumstances, and when observing a tubular tissue under an endoscope inserted into a subject, the position of the endoscope within the tubular tissue can be grasped more reliably. An object is to provide an apparatus, a method, and a program.

  An endoscope observation support apparatus according to the present invention includes a center line acquisition unit that acquires a center line of a tubular tissue of a subject from a previously acquired three-dimensional image of the subject, and an endoscope that is inserted into the tubular tissue. Endoscopic image display means for displaying an endoscopic image photographed while moving along the longitudinal direction of the tubular tissue, and one characteristic region of the tubular tissue is displayed on the displayed endoscopic image. Position determining means for determining the position of the endoscope as a reference position and setting a position corresponding to the one feature region on the center line, and the endoscope further moved from the reference position A movement amount acquisition means for acquiring a movement amount and a traveling direction of the current position, and a position separated from the position corresponding to the one characteristic region by the acquired movement amount along the center line in the acquired traveling direction. The current position And position calculating means, is characterized in that the index representing the calculated the current position and a current position display means for displaying on said center line.

  The endoscope observation support method according to the present invention acquires a center line of a tubular tissue of a subject from a previously acquired three-dimensional image of the subject, and moves the endoscope inserted into the tubular tissue in the longitudinal direction of the tubular tissue. An endoscope image taken while moving along the screen is displayed, and when one feature region of the tubular tissue is displayed in the displayed endoscope image, a reference position of the endoscope is input And setting a position corresponding to the one feature region on the center line, obtaining a movement amount and a traveling direction of the endoscope further moved from the reference position, and a position corresponding to the one feature region Then, a position that is separated by the acquired amount of movement in the acquired traveling direction along the center line is calculated as a current position, and an index representing the calculated current position is displayed on the center line. It is what.

  An endoscope observation support program according to the present invention includes a computer, a center line acquisition unit that acquires a center line of a tubular tissue of a subject from a three-dimensional image of the subject that has been acquired in advance, and an internal portion inserted into the tubular tissue. Endoscopic image display means for displaying an endoscopic image taken while moving the endoscope along the longitudinal direction of the tubular tissue, and one feature region of the tubular tissue in the displayed endoscopic image Is displayed, the position of the endoscope is determined as a reference position, and a position determination means for setting a position corresponding to the one feature region on the center line, and the position further moved from the reference position The movement amount acquisition means for acquiring the movement amount and the traveling direction of the endoscope, and the position corresponding to the one feature region, the distance along the center line is separated by the acquired movement amount in the acquired traveling direction. Current position Current position calculating means for calculating a position, characterized in that the functioning of the index representing the calculated the current position as the current position display means for displaying on said center line.

  In the present invention, the tubular tissue is typified by a tubular internal organ such as the intestine and stomach if the subject is a human body, but may be anything as long as an endoscope can be inserted. The feature region may be any region as long as the user has a form that can be distinguished from other regions in the tubular tissue, such as a bent portion of the intestine or a region in which a polyp is noticeable. When the user finds these characteristic areas, the areas can be specified and indicated by indexes of various shapes such as a circle, a rectangle, and a closed curved surface. For example, when the tubular tissue is the large intestine, the characteristic region may be one of an anal canal, a spleen fold, and a liver fold. When the tubular tissue is a bronchus, the feature region may be either the larynx or the bronchial bifurcation. When the tubular tissue is the esophagus, the characteristic region may be either the pharynx or the cardia. Moreover, it is good also considering the area | region which has unevenness | corrugations, such as a tumor in a tubular tissue, as a characteristic area.

  In the present invention, the reference position is a position used as a reference for calculating the position of the endoscope located in the tubular tissue, and the feature region in the tubular tissue is displayed in the endoscopic image. It means the position of the endoscope at the time. This reference position is determined by storing the position of the endoscope with the user's mouse, keyboard or other input device when the feature area is displayed in the endoscopic image, Various methods can be used. For example, when the feature region in the tubular tissue is displayed in the endoscopic image, the user may determine the reference position by clicking a button provided on the screen with the mouse, and the interactive GUI may be used as the reference position. The reference position may be determined by command input for ordering acquisition of the position.

  In addition, since the specification of the reference position is a position at which measurement of the movement amount and the movement direction along the longitudinal direction of the tubular tissue of the endoscope is started, the movement amount along the longitudinal direction of the tubular tissue based on this is determined. As long as the movement direction can be measured, any method may be used. As an example, the reference position can be specified as the insertion depth of the endoscope by attaching a numerical value representing the length from the distal end of the endoscope on the outer surface of the probe exposed from the tubular tissue. . Further, the reference position may be specified by an existing function of the endoscope that measures the insertion depth of the endoscope into the tubular tissue.

  The “position” in “set a position corresponding to the one feature area on the center line” means a position on the center line in the vicinity of the feature area, for example, the virtual area when the feature area is displayed with a virtual endoscope. It may be the position of the viewpoint of the endoscope, may be the position of a point on the center line closest to the feature area, or may be an arbitrary position on the center line included in a predetermined range from the feature area.

  Further, in the present invention, various methods can be used for acquiring the movement amount and the traveling direction of the endoscope as long as the movement amount and the traveling direction moved along the tubular tissue of the endoscope can be acquired. . For example, the movement amount acquisition means in the endoscope observation support apparatus of the present invention may acquire the movement amount and movement direction of the probe of the endoscope exposed outside the tubular tissue. For example, a scale can be provided on the probe of the endoscope or the coating film of the probe, and the portion of the probe exposed outside the tubular tissue can be read by the optical detection means. Alternatively, it is possible to obtain a moving amount and a traveling direction of the probe by photographing with an optical photographing device arranged so that fixed point photographing is possible and reading the scale from the photographed image by a known method. In addition, based on the scale provided on the endoscope probe or probe coating film, the user manually measures the amount and direction of movement of the probe, and the movement measured as input from the keyboard or other input device by the user The amount and direction of travel may be obtained. Moreover, you may measure the moving distance and the advancing direction along the longitudinal direction of the tubular structure | tissue of an endoscope with the existing function of an endoscope.

  In addition, the index indicating the current position of the endoscope may be anything as long as the position is identifiable on the display screen. For example, the index may be a cross mark, or a known index that can indicate a position, such as a point, a circle, a rectangle, an arrow, or a closed curved surface.

  The endoscopic observation support apparatus of the present invention includes a virtual endoscopic image generation unit that generates a virtual endoscopic image with a viewpoint moved along the center line, and the generated virtual endoscopic image. Display means for displaying, wherein the determination of the reference position is performed when the feature region in the tubular tissue is displayed in both the virtual endoscopic image and the endoscopic image that are displayed. It is preferable that

  “The same feature region in the tubular tissue is displayed in both the virtual endoscopic image and the endoscopic image” is acceptable as long as both images display the same feature region. Since the form of the feature area may be deformed depending on the body position of the subject, the form of the feature area on both images is strict if it can be recognized that the form of the feature area is the same in the feature area. There is no need to match. In order to obtain the position of the endoscopic image by accurately associating the position of the viewpoint of the virtual endoscopic image when displaying the same feature region with the position of the imaging means such as the CCD of the endoscopic image, Preferably, when the reference position is input, it is preferable that the same feature region is represented by the same position or the same size on both images.

  When the same feature region in the tubular tissue is displayed in both the virtual endoscopic image and the endoscopic image, the viewpoint of the virtual endoscopic image is first moved in the virtual endoscopic image to thereby move the tubular tissue The same feature area in the tubular tissue may be displayed in accordance with the movement of the endoscope in the endoscopic image, and the endoscopic image is first displayed in the endoscopic image. The feature region in the tubular tissue may be displayed in accordance with the movement, and then the same feature region in the tubular tissue may be displayed by moving the viewpoint of the virtual endoscopic image in the virtual endoscopic image. The same feature region in the tubular tissue may be displayed simultaneously with the image.

  Further, the display of the endoscopic image and the virtual endoscopic image may be performed on one display device or may be performed separately on a plurality of display devices as long as they are displayed in a comparable manner. . Moreover, when displaying an endoscopic image and a virtual endoscopic image on a plurality of display devices, it is preferable that the endoscope image and the virtual endoscopic image are arranged in the same physical location so that both images can be observed simultaneously. In addition, the endoscopic image and the virtual endoscopic image can be switched and displayed as long as they can be compared with each other, and can be displayed in a superimposed manner.

  In the endoscope observation support apparatus according to the present invention, it is preferable that the position determining means determines the reference position for each different feature region in the tubular tissue. Thus, the endoscope observation support apparatus of the present invention receives a new reference position, acquires the movement amount and the traveling direction from the new reference position, and inputs the reference position in the acquired movement amount and the traveling direction. The position where the position representing the feature area when moved is calculated, and the calculated position is displayed.

  In the endoscope observation support apparatus according to the present invention, the current position display unit may further display not only the calculated position index but also another index. For example, the present position display means may further display the tubular tissue together with the center line. This tubular tissue may be obtained by extracting from a three-dimensional image of a subject, or may be a tubular tissue model or the like. Further, the current position display means may further display a schematic endoscope having the position as a tip. The current position display means may further display an index representing the feature area.

  According to the endoscope observation support apparatus, method, and program of the present invention, an endoscope image captured while moving an endoscope inserted into a tubular tissue along the longitudinal direction of the tubular tissue is displayed and displayed. When one feature region of the tubular tissue is displayed in the endoscopic image, the reference position of the endoscope is input and a position corresponding to one feature region is set on the center line L, and the reference A movement amount and a traveling direction of the endoscope further moved from the position are acquired, and a position separated from the position corresponding to one feature region by the acquired movement amount in the traveling direction along the center line. Since the current position is calculated and an index indicating the calculated current position is displayed on the center line, even if the position of the endoscope in the tubular tissue cannot be grasped only by the endoscopic image of the tubular tissue, Based on the distance and direction of travel of the endoscope The position of the endoscope within the tubular tissue can be accurately grasped Te. This makes it possible to predict the approach of the curved portion of the tubular tissue and the traveling direction of the tubular tissue, support smooth movement of the endoscope through the tubular tissue in surgery and inspection, and prevent mistakes in the procedure. Contribute to

  Further, in the endoscopic observation support apparatus of the present invention, virtual endoscopic image generation means for generating a virtual endoscopic image with the viewpoint moved along the center line, and the generated virtual endoscopic image Display means for displaying, wherein the determination of the reference position is performed when the feature region in the tubular tissue is displayed in both the displayed virtual endoscopic image and endoscopic image Since the reference position of the endoscope can be set more accurately, the position of the viewpoint of the virtual endoscope can be calculated more accurately. As a result, since the indicator on the center line is displayed at a more accurate position, the position of the endoscope can be grasped more accurately.

  In the endoscopic observation support apparatus of the present invention, when the reference position determining means determines the reference position for each different characteristic region in the tubular tissue, the tubular position is determined by the body position of the subject and the movement of the endoscope. It is possible to correct the difference between the position of the endoscope and the position of the viewpoint of the virtual endoscopic image caused by the expansion and contraction of the tissue, and the reference position of the endoscope can be set more accurately. The position of the viewpoint of the virtual endoscope can be calculated. As a result, since the indicator on the center line is displayed at a more accurate position, the position of the endoscope can be grasped more accurately.

  In the case where the endoscope observation support apparatus of the present invention further displays an indicator representing a typical endoscope or feature region having a tubular tissue or a viewpoint position as a tip together with the center line, the tubular tissue is more It is possible to accurately grasp the position of the endoscope in the interior.

Hardware configuration diagram of an endoscope observation support system according to an embodiment of the present invention Functional block diagram of the endoscope observation support system in the first embodiment of the present invention The flowchart showing the flow of the endoscopic observation support process in the first embodiment of the present invention. A diagram schematically showing an example of the input screen when the endoscope and virtual endoscope represent the same feature area A diagram schematically showing an example of the positional relationship between the viewpoint and feature region of the endoscope and virtual endoscope image The figure which represented typically an example of the centerline and index | index displayed by 1st Embodiment The figure which represented typically the modification of the centerline and index which are displayed in 1st Embodiment

  Hereinafter, an endoscope observation support system according to an embodiment of the present invention will be described.

  FIG. 1 is a hardware configuration diagram showing an outline of the endoscope observation support system. As shown in the figure, this system includes an endoscope 1, a digital processor 2, a light source device 3, an endoscope image display 4, a modality 5, an image storage server 6, a position detection device 7, and an image processing workstation. A display (hereinafter referred to as WS display) 8 and an image processing workstation 9 are included.

In the present embodiment, the endoscope 1 is a flexible endoscope for the large intestine and is inserted into the large intestine of the subject. Light guided by the optical fiber from the light source device 3 is irradiated from the distal end portion 1A of the endoscope 1, and an image in the abdominal cavity of the subject is obtained by the imaging optical system of the endoscope 1. The digital processor 2 converts the imaging signal obtained by the endoscope 1 into a digital image signal, corrects the image quality by digital signal processing such as white balance adjustment and shading correction, and then performs DICOM (Digital Imaging and Communications in Adds incidental information defined in the Medicine) standard and outputs endoscopic image data (I _RE ). The output endoscopic image data (I _RE ) is transmitted to the image processing workstation 9 via the LAN according to a communication protocol compliant with the DICOM standard. Further, the digital processor 2 converts the endoscope image data (I _RE ) into an analog signal and outputs the analog signal to the endoscope image display 4, and the endoscope image (I _RE) is displayed on the endoscope image display 4. ) Is displayed. Since the acquisition of the imaging signal by the endoscope 1 is performed at a predetermined frame rate, the endoscope display (I _RE ) is displayed as a moving image representing the abdominal cavity on the endoscope display 4. Furthermore, the endoscope 1 can also shoot still images according to user operations.

  The modality 5 is an apparatus that generates image data (V) of a three-dimensional medical image representing a region by imaging the region to be examined of the subject, and is a CT device here. Additional information defined by the DICOM standard is also added to the three-dimensional medical image data (V). In addition, the three-dimensional medical image data (V) is also transmitted to the image processing workstation 9 via the LAN according to a communication protocol compliant with the DICOM standard.

  The image storage server 6 is connected to the modality 5 and the image processing workstation 9 via a LAN, and medical image data acquired by the modality 5 and an image of a medical image generated by image processing at the image processing workstation 9. A computer that stores and manages data in an image database, and includes a large-capacity external storage device and database management software (for example, ORDB (Object Relational Database management software)).

  The position detection device 7 is composed of a known optical photographing device. In a region 7A of FIG. 1, a support tool (not shown) that supports a part of the probe 1B of the endoscope exposed outside the tubular tissue of the subject so as to be horizontally movable in order to detect the position of the endoscope 1. Is installed. And the numerical value which showed the length from the front-end | tip part of an endoscope in mm unit is described on the outer surface of the probe 1B of an endoscope. The position detection device 7 is arranged by a well-known fixing method at a position where the numerical value can be read, that is, a position 7A where the probe 1B supported horizontally by the support portion can be photographed at a fixed point. The position detection device 7 is connected to the image processing workstation 9 via a known interface, and in response to an instruction from the image processing workstation 9, the numerical value on the probe 1B is optically photographed and the acquired signal value is obtained. Transmit to the image processing workstation 9.

  The image processing workstation 9 is a computer having a well-known hardware configuration such as a CPU, a main storage device, an auxiliary storage device, an input / output interface, a communication interface, and a data bus, and includes an input device (pointing device, keyboard, etc.) WS display 8 is connected. The image processing workstation 9 is connected to the digital processor 2, the modality 5, and the image storage server 6 via a LAN, and is connected to the position detection device 7 via a known interface. Further, the image processing workstation 9 is installed with a well-known operating system, various application software, and the like, and is also installed with an application for executing the endoscope observation support processing of the present invention. These software may be installed from a recording medium such as a CD-ROM, or may be installed after being downloaded from a storage device of a server connected via a network such as the Internet. Good.

  FIG. 2 is a block diagram in which the endoscope observation support system according to the first embodiment of the present invention is divided at a functional level.

  As shown in FIG. 2, the endoscope observation support system of the present specification includes an endoscope 1 and an endoscope image forming unit 2 that forms an endoscope image from an image signal captured from the endoscope 1. An endoscopic image display means 4 (endoscopic image display 4) for displaying an endoscopic image formed in the endoscopic image forming unit 2, and a three-dimensional medical for forming a three-dimensional image of the subject. An image forming unit 5, an image storage server 6 for storing a three-dimensional medical image, a position detection device 7 for detecting the movement amount of the endoscope 1, and a three-dimensional image for acquiring a three-dimensional image V of the subject in advance. The image acquisition unit 11, the center line acquisition unit 17 that extracts the tubular tissue of the subject and the center line L of the tubular tissue from the 3D image acquired by the 3D image acquisition unit 11, and the center line acquisition unit 17 acquired. A virtual that generates a virtual endoscopic image 41 with the viewpoint moved along the center line L Endoscopic image generation means 12, display means 8 (WS display 8) for displaying the generated virtual endoscopic image 41 and center line L, and endoscope 1 inserted into the tubular tissue of the subject, tubular tissue An endoscopic image display means 4 (endoscopic image display 4) for displaying an endoscopic image 31 photographed along the longitudinal direction, and one characteristic region R in the tubular tissue in the endoscopic image 31. Is displayed, the position of the endoscope is determined as the reference position P1 and the position Q1 corresponding to the feature region R on the center line is set, and the position of the endoscope 1 from the reference position P1 is determined. Only the movement amount acquired in the movement direction acquired along the center line Lv from the position Q1 corresponding to the feature region R when the reference position P1 is input, and the movement amount acquisition means 14 for acquiring the movement amount and the movement direction. The remote position Q2 Out the current position calculating unit 15, and a current position display unit 16 for displaying on the center line L which is displayed an indicator M representing the position Q2 of the calculated viewpoint.

  Hereinafter, each functional block shown in FIG. 2 will be described in detail. In addition, when the hardware apparatus shown in FIG. 1 and each functional block shown in FIG. 2 respond | correspond substantially 1 to 1, the same code | symbol is attached | subjected and description is abbreviate | omitted. The function of the endoscope image forming unit 2 is realized by the digital processor of FIG. 1, the function of the three-dimensional medical image forming unit 5 is realized by the modality of FIG. 1, and the function of the position detecting unit 7 is the position detecting device. 7 is realized. The broken line frame indicates the image processing workstation 9, and the functions of the processing units in the broken line frame are realized by executing a predetermined program on the image processing workstation 9.

  The three-dimensional image acquisition unit 11 has a communication interface function for receiving the three-dimensional medical image V from the three-dimensional medical image forming unit 5 or the image management database 6 and storing it in a predetermined memory area of the image processing workstation 9.

The center line acquisition unit 17 extracts the tubular tissue of the subject and the center line L of the tubular tissue from the 3D image acquired by the 3D image acquisition unit 11. Various known methods can be applied to the extraction of the tubular tissue and the centerline. For example, “Colon centreline calculation for CT colonography using optimized 3D topological thinning.”, Proceedings of the 1st The method described in International Symposium on 3D Data Processing Visualization and Transmission, IEEE Computer Society, pp. 800-803, 2002 can be used. Further, in the present embodiment, the center line acquisition unit 17 determines the viewpoint of the virtual endoscope when the virtual endoscopic image 41 is reconstructed so as to display the large intestine feature regions R1 and R2 from a predetermined direction. Get the coordinates of the position. Specifically, when the user designates a plurality of feature regions R _V1 and R _V2 on the center line of the extracted large intestine with an input device such as a mouse, the plurality of feature regions R _V1 and R _V2 of the large intestine are previously stored. The coordinates of the position of the viewpoint of the virtual endoscope when the virtual endoscopic image 41 is reconstructed so as to display the feature regions R _V1 and R _V2 from a predetermined direction are extracted to the image processing WS9. Saved. It is assumed that R _V1 indicates the spleen fold of the large intestine and R _V2 indicates the liver fold of the large intestine.

  The virtual endoscopic image generation unit 12 generates a virtual endoscopic image 41 with the viewpoint moved along the center line Lv acquired by the virtual endoscopic image generation unit 12 center line acquisition unit 17 by a known method. To do.

  Endoscopic image display means 4 (endoscopic image display 4) includes display means 8 (WS display 8) for displaying the generated virtual endoscopic image 41 and center line L, and the tubular tissue of the subject. An endoscopic image 31 photographed along the longitudinal direction of the large intestine by the inserted endoscope 1 is displayed. In the present embodiment, the endoscope image display 4 and the WS display 8 are arranged so that the same size displays are arranged side by side so that doctors can easily compare the two displays. The endoscopic image 31 and the virtual endoscopic image 41 are displayed in windows of the same size on the respective displays 4 and 8 so that they can be easily compared.

When the same feature region R _V1 in the tubular tissue is displayed in both the displayed virtual endoscopic image 41 and endoscopic image 31, the reference position determination unit 13 uses a pointing device or an input device such as a keyboard. Accepts input from the user. In response to this input, the reference position determining means 13 determines the position of the endoscope as the reference position P1. The determined reference position P1 is specified as the insertion depth of the endoscope 1 by the movement amount acquisition means 14. Further, the reference position determination unit 13 as the position Q1 corresponding to the feature region R _V1, sets the coordinate of the viewing point of the virtual endoscope when viewing feature region R _V1 in virtual endoscopic image 31. Further, the reference position determination unit 13 stores the reference position P1 in a predetermined memory area of the image processing workstation 9 in association with the position Q1 corresponding to the feature area _RV1 .

  The movement amount acquisition means 14 functions as a communication interface for acquiring an image signal obtained by photographing a numerical value on the probe 1B of the endoscope through communication with the position detection device 7, and from the position detection device 7 at a predetermined time interval. An image signal obtained by capturing the numerical value Sc recorded on the probe 1B of the endoscope at an arbitrary position at the position P of the endoscope is acquired, and a known image processing is performed on the image signal to recognize and acquire the numerical value Sc. And a function of storing in a predetermined memory area of the image processing workstation 9.

  Also, the movement amount acquisition means 14 is a numerical value acquired from the position detection device 7 when the endoscope is at an arbitrary position P2 from the numerical value Sc1 acquired from the position detection device 7 when the endoscope is at the reference position P1. The movement amount Sq (Sq = | Sc1-Sc2 |) and the traveling direction Sd up to Sc2 are acquired. Since the numerical values Sc1 and Sc2 attached to the probe 1B of the endoscope 1 are numerical values representing the length from the distal end of the endoscope, if Sc1-Sc2 is negative, the traveling direction Sd of the endoscope Is a direction in which the endoscope further enters from the reference position P1 to the back of the large intestine (a direction from the rectum to the cecum). It is understood that the direction is from the head to the rectum. Here, the case where the direction of travel of the endoscope is the direction from the rectum to the cecum is represented as Sd = 1, and the case where the endoscope is traveled from the cecum to the rectum is represented as Sd = 0.

Current position calculating means 15, from the position Q1 corresponding to the feature region R _V1, along the center line Lv, acquired in the moving direction by the movement amount obtained in distant current position Q2 position Q1 coordinates and the center line Lv It is calculated by a known method based on the route and the like.

The current position display means 16 displays an index M representing the calculated current position Q2 on the center line L. FIG. 6A is a diagram illustrating an example of display of the center line + and the index in the present embodiment. As shown in FIG. 6A, the current position display means 16 displays the center line L extracted by the center line acquisition means 17 on the WS display 8 and the index M representing the calculated current position Q2 on the displayed center line L. The guide image 51 is displayed. As the position Q1 corresponding to the feature region R _V1, because it sets a viewpoint position of the virtual endoscope when viewing feature region R _V1, the current position Q2 is virtual when displaying the characteristic region R _V1 It represents the viewpoint position of the virtual endoscope that is separated from the viewpoint position of the endoscope by the amount of movement of the endoscope in the direction in which the endoscope has moved. Note that as the current position, a sign of the position of the virtual endoscope corresponding to each position other than the imaging unit 1A of the endoscope 1 can be displayed on the guide image 51. In order to perform movement and treatment in the tubular tissue using the image captured by the imaging unit 1A as a clue, the position corresponding to the imaging unit 1A of the endoscope 1 is displayed on the guide image 51 so as to be identifiable as the current position Q2. It is preferable to do.

  Next, using the flowchart shown in FIG. 3, a schematic flow of a user operation performed in the endoscope observation support system according to the first embodiment of the present invention and a process performed in each of the above processing units. Will be explained.

  First, prior to the observation of the tubular tissue of the subject using the endoscope 1, the 3D medical image V is formed by imaging the tubular tissue of the subject by the 3D medical image forming unit 5. In the image processing workstation 9, the three-dimensional image acquisition unit 11 acquires the three-dimensional medical image V formed by the three-dimensional medical image forming unit 5 (S01). Then, the center line acquisition unit 17 acquires the center line L of the tubular tissue based on the 3D medical image V acquired by the 3D image acquisition unit 11 (S02).

The virtual endoscopic image generation unit 12 generates a virtual endoscopic image 41 in which the viewpoint is moved along the center line L acquired by the center line acquisition unit 17. In the present embodiment, the viewpoint of the virtual endoscopic image is moved in accordance with a user movement instruction received by an input device such as a pointing device. Then, the display unit 8 (WS display 8) displays the generated virtual endoscopic image 41 (S03). In this embodiment, the virtual endoscopic image generation unit 12 displays a virtual endoscopic image 41 representing the feature region R _V1 in response to an input by the user input device.

  Then, the endoscope image forming unit 2 generates an endoscope image 31 at a predetermined frame rate from an image signal photographed along the longitudinal direction of the tubular tissue by the endoscope 1 inserted into the tubular tissue of the subject. The endoscope image 31 formed repeatedly is displayed on the endoscope image display 4 in real time as a through moving image (S04).

In FIG. 4, the endoscopic image 31 and the virtual endoscopic image 41 have the same characteristic area R1 (hereinafter, the characteristic area on the endoscopic image 31 is R _E1 , and the characteristic area on the virtual endoscopic image 41 is It shows an example of an input screen when represents represents and R _V1.). FIG. 5 is a diagram for explaining a method of calculating the current position in the present embodiment. Figure 5 right, large intestine endoscope 1 and colon C _R of the object represents schematically, the endoscope 1 along the path represented by the dashed line the imaging unit 1A of the endoscope as the tip C Move _R. The left side of FIG. 5 shows _CV and the center line L of the large intestine subject obtained from tomography by a modality such as a CT apparatus, and the viewpoint of the virtual endoscope moves on the center line L. FIG. 5 shows the positions E1, E2 of the imaging unit 1A of the endoscope that moves along the length directions of the large intestine C _R and C _V and the large intestine, and the imaging unit 1A of the endoscope at the position E1. When the position detection device 7 is at a predetermined position 7A, the position P1 of the endoscope probe 1B is fixed, and when the endoscope imaging unit 1A is at the position E2, the position detection device 7 is fixed at the predetermined position 7A. position P2 probe 1B of the endoscope is, position Q1 corresponding to the feature region R _V1, showing the relationship between the current position Q2, which is moved from the feature region R _V1. Similarly, in FIG. 5, the position P1 ′ of the probe 1B of the endoscope that is fixed-point photographed at the predetermined position 7A by the position detection device 7 when the imaging unit 1A of the endoscope is at the position E1 ′, A position P2 ′ of the probe 1B of the endoscope that is fixed-point imaged at the predetermined position 7A by the position detection device 7 when the imaging unit 1A of the endoscope is at the position E2 ′, a position Q1 ′ corresponding to the feature region R _V2 ; A relationship with the current position Q2 ′ of the virtual endoscopic image 41 moved from the feature region _RV2 is shown. FIG. 4 shows a state where the curved region of the large intestine is the feature region R1, and the feature regions R _E1 and R _V1 are displayed in both the endoscopic image and the virtual endoscopic image, respectively.

As shown in FIG. 4, a user such as a doctor has a feature region R _E1 displayed on the endoscopic image 31 and a feature region R _V1 displayed on the virtual endoscopic image 41 having substantially the same size and the same arrangement. The endoscope 1 is moved so that the displayed state is obtained. As shown in FIG. 5, in the state where the same feature regions R _E1 and R _V1 are displayed in the endoscopic image 31 and the virtual endoscopic image 41, the imaging unit 1A (the endoscope 1 of the endoscope 1) of the endoscope 1 is displayed. (Tip) is the state arranged at E1, and the viewpoint of the virtual endoscope is the state arranged at Q1. That is, the endoscopic image 31 and the virtual endoscopic image 41 have the same feature regions R _E1 and R _V1 displayed with substantially the same size and the same arrangement, and the position E1 of the imaging unit 1A of the endoscope. The viewpoint position Q1 of the virtual endoscope represents substantially the same point in the large intestine C _R and C _V.

Next, as shown in FIG. 4, when the same feature region R1 in the tubular tissue is displayed in both the displayed virtual endoscopic image 41 and endoscopic image 31, the user uses an input device such as a mouse. The pointer Ptr is moved and a part of the feature region R _V1 of the virtual endoscopic image is clicked. Then, the reference position determination unit 13 receives an instruction to determine the reference position P1 (Y in S05), and the reference position determination unit 13 thereby determines the reference position P1. Further, the reference position determination unit 13 acquires the coordinates of the position designated by the input of the reference position determination unit 13, and uses the coordinates of the viewpoint of the virtual endoscope for the feature region R _V1 closest to the acquired coordinates as the feature. The coordinates of the position Q1 corresponding to the area R1 are set, and the reference position P1 and the position Q1 corresponding to the feature area R1 are associated with each other and stored in a predetermined memory area of the image processing workstation 9. Based on this determination, the movement amount acquisition unit 14 acquires the insertion depth of the endoscope at the reference position P1, and the current position calculation unit 15 acquires the coordinates of the position Q1 corresponding to the feature region R _V1 (S06). .

Note that the feature region R _V1 closest to the coordinates of the designated position can be specified by various known methods. In the present embodiment, the distance between the coordinates of the viewpoint of the endoscope corresponding to the plurality of stored feature regions R _V1 and R _V2 and the coordinates of the designated position is calculated, and the coordinate having the shortest distance is calculated as the feature region _V1. Set as the coordinates of the position corresponding to. For example, the characteristic region R _V is present some or all of the coordinates of the specified position in the predetermined range may be a closest feature region R _V.

  Next, the movement amount acquisition unit 14 determines the insertion length of the endoscope at the reference position P1 of the endoscope at the position 7A for fixed point imaging according to the determination of the reference position determination unit 13. Obtained as the upper numerical value Sc1. That is, as shown in FIG. 5, the reference position P1 where the position E1 of the imaging unit 1A of the endoscope 1 and the position of the viewpoint Q1 of the virtual endoscope coincide with each other in the large intestine is inserted into the large intestine of the endoscope 1. It is specified by the depth Sc1.

  Then, the movement amount acquisition unit 14 acquires the movement amount and the traveling direction along the length direction of the large intestine of the endoscope 1 from the reference position P1 (S07). That is, as shown in FIG. 5, after the acquisition of the reference position P1 from the reference position P1, the movement amount Sq and the traveling direction Sd from the reference position P1 to the position P2 of the endoscope 1 moved by the user or the like are acquired.

  The movement amount acquisition means 14 acquires an image signal obtained by photographing the numerical value Sc2 written on the outer surface of the probe 1B of the endoscope at an arbitrary position P2 of the endoscope from the position detection device 7 at a predetermined time interval. A known image processing is performed on the image signal to obtain a numerical value Sc2. That is, the position P2 where the endoscope 1 has moved from the reference position P1 is specified by the insertion depth Sc2 of the endoscope 1 into the large intestine. Then, the movement amount acquisition unit 14 acquires the movement amount Sq and the traveling direction Sd of the endoscope from the reference position P1 based on the difference between Sc2 and Sc1 as described above. In FIG. 5, the movement amount Sq of the endoscope is | Sc1-Sc2 |, and the traveling direction Sd is a direction in which the insertion depth of the endoscope 1 into the large intestine becomes deep.

Current position calculating means 15 obtains the coordinate position Q1 corresponding to the feature region R _V1, along from the position Q1 corresponding to the feature region to the center line L of the large intestine, apart movement amount Sq acquired in the traveling direction Sd The current position Q2 is calculated (S08).

  The current position display means 16 displays a guide image 51 displayed on the center line L on which the center line L extracted by the center line acquisition means 17 and the index M representing the calculated viewpoint position Q2 are displayed on the WS display 8. It is displayed (S09). 6A shows an example in which an arrow (index) M indicating the current position Q2 is displayed on the guide image 51. FIG.

  The image processing workstation 9 repeats the processes from S05 to S10 unless an operation for instructing the end of observation is performed (No in S11).

  On the other hand, when there is no instruction for determining the reference position P1 (N in S05), and the reference position P1 of the endoscope has not been determined yet (Y in S10), the determination of the reference position P1 is performed. Wait for instructions (S05). If there is no instruction to determine the reference position P1 (N in S05) and the endoscope reference position P1 has already been determined at least once (N in S10), the processes from S07 to S09 are performed. As a result, the guide image 51 displays an index M representing the current position on the center line L of the guide image 51 in conjunction with the movement of the endoscope 1 in time.

Also, as shown in FIG. 5, when new feature regions R _E2 and R _V2 are displayed in the endoscopic image 31 ′ and the virtual endoscopic image 41 ′, a part of the feature region R _V2 by the user Is received (Y in S05), the reference position determination means 13 determines a new reference position P1 ′ as described above. Further, the reference position determining unit 13 sets the coordinates of the viewpoint when the feature region R _V2 is represented in the virtual endoscopic image 41 as the coordinates of the position Q1 ′ corresponding to the new feature region R _V2 . The movement amount acquisition means 14 acquires the insertion depth Sc1 ′ of the endoscope at the reference position P1 ′, and the current position calculation means 15 acquires the coordinates of the position Q1 ′ corresponding to the new feature region R _V2 (S06). ). At this time, the position E1 ′ of the distal end portion of the endoscope 1 is in a state of being arranged at substantially the same position as the position Q1 ′ of the viewpoint of the virtual endoscope displaying the characteristic region _RV2 .

Then, in response to an operation of moving the imaging unit 1A of the endoscope to E2 ′ by the user, the movement amount acquisition unit 14 is provided on the outer surface of the probe 1B when the imaging unit 1A of the endoscope is arranged at E2 ′. A numerical value Sc2 ′ representing the insertion depth of the endoscope at the position P2 ′ is acquired. As a result, the movement amount Sq and the traveling direction Sd from the new reference position P1 ′ are acquired (S07), and only the acquired movement amount Sq and the traveling direction Sd are separated from the position Q1 ′ corresponding to the new feature region _RV2. The current position Q2 ′ is calculated (S08), and the calculated current position Q2 ′ is displayed (S09).

  On the other hand, when an operation for instructing the end of observation is performed (Y in S11), the endoscope diagnosis support process of the present embodiment is ended.

  As described above, in the first embodiment of the present invention, an endoscope image taken along the longitudinal direction of the tubular tissue is displayed and displayed by the endoscope inserted into the tubular tissue of the subject. When the feature region of the tubular tissue is displayed in the endoscopic image, the reference position of the endoscope is determined and the position Q1 corresponding to the feature region on the center line L is set, and is further moved from the reference position P1. The movement amount Sq and the traveling direction Sd of the endoscope are acquired, and the current position Q2 that is separated from the position Q1 corresponding to the feature region along the center line L by the acquired movement amount Sq in the traveling direction Sd. This is a case where the position of the endoscope in the tubular tissue cannot be grasped only by the endoscopic image of the tubular tissue because the index M representing the calculated current position Q2 is displayed on the displayed center line L. Even in the distance and direction of travel of the endoscope The position of the endoscope within the tubular tissue can be accurately grasped by Zui. This makes it possible to predict the approach of the curved portion of the tubular tissue and the traveling direction of the tubular tissue, support smooth movement of the endoscope through the tubular tissue in surgery and inspection, and prevent mistakes in the procedure. Contribute to

  In the first embodiment, as shown in FIG. 5, by determining the reference position for each feature region, the shift between the position E2 of the photographing unit 1A of the endoscope 1 and the current position Q2 is corrected. Since the endoscope reference position P1 ′ can be switched and determined more accurately, the viewpoint position Q2 ′ of the virtual endoscope can be calculated more accurately. The difference between the position E1 of the imaging unit 1A of the endoscope 1 and the current position Q2 is that the path along which the endoscope moves along the longitudinal direction of the tubular tissue does not necessarily coincide with the center line of the tubular tissue. Since the tubular tissue is inevitably generated by the expansion and contraction and deformation of the body position and the movement of the endoscope, the index on the center line is displayed at a more accurate position by determining the reference position for each feature region. Therefore, the position of the endoscope can be grasped more accurately.

FIG. 6B is a diagram showing a modification of the display of the current position Q2 on the guide image 51. As shown in FIG. 6B, as a modified example of the current position display means 16 of the first embodiment, not only the index indicating the calculated current position Q2 but also another index may be displayed. . For example, the current position display means 16 may further display the tubular tissue 52 together with the center line L. This tubular tissue may be obtained by extracting from a three-dimensional image of a subject, or may be a tubular tissue model or the like. In addition, the tubular tissue can be displayed by various known methods. For example, an arbitrary transparency is set as appropriate, and an arbitrary color such as multicolor or black and white is displayed by a known display method such as a volume rendering method. be able to. The current position display means 16 may further display a schematic endoscope 53 having the current position Q2 as a tip. The current position display unit 16 may further display an index representing the feature region R. In FIG. 6B, as an index representing the feature region R, an index representing the position Q1 corresponding to the feature region _RV1 is displayed as a point. According to the modification of the current position display means 16 described above, by displaying not only the center line L but also the tubular tissue and a schematic endoscope, the posture of the endoscope in the tubular tissue can be further improved. The position can be accurately grasped.

As in the present embodiment, the reference position determination unit 13 _{receives the specification} of the feature region R _V1 on the virtual endoscopic image by the user, and thereby inputs the reference position P1 of the endoscope 1 and the feature region R of the tubular tissue. _When the position corresponding to _V1 is set at the same time, the input operation becomes simpler, so that the endoscopic diagnosis support of the present invention can be performed more efficiently. In order to associate the position Q1 corresponding to the feature region R _V1 of the reference position P1 and the tubular tissue, instead of specifying a part of the feature region R _V1, a plurality of characteristic regions R _V1 which is previously _extracted, the R _V2 Corresponding positions Q1 and Q2 may be displayed in a selectable manner, and a position Q1 representing the characteristic region _RV1 corresponding to the reference position P1 of the endoscope 1 may be set by an input device such as a mouse.

In a modification of this embodiment, the reference position determining means 13, if associated to the position Q1 corresponding to the feature region R _V1 of the reference position P1 and the tubular tissue, the characteristic region of the reference position P1 and the tubular tissue it may be carried out and determination of the association and the reference position P1 and the position Q1 corresponding to R _V1 to different timings, which may be performed first. For example, the reference position determination button is displayed on the screen of the WS display 8 so as to be selectable, and the reference position determination means 13 acquires the reference position P1 of the endoscope 1 by the selection operation of the reference position determination button by the user's mouse or the like. The feature region R _V1 specified at the reference position P1 of the endoscope 1 or the point Q1 on the center line L corresponding to the feature region R _V1 is separately input by a user input device or the like. acquired by, or in association with the position Q1 indicating the feature region R _V1 of the reference position P1 and the tubular tissue.

In the present embodiment, the coordinates of the viewpoints Q1 and Q1 ′ of the virtual endoscope set in advance are associated as the positions corresponding to the feature regions R _V1 and R _V2 , respectively, but the reference position P1 of the endoscope the position Q1 corresponding to the feature region R _V1 of the tubular tissue may be those obtaining in association with each other, it can be acceptable error from the feature region R _V1, R _V2 instead on the position of the viewing point of the virtual endoscopy and Positions in the vicinity of the feature area within a predetermined range can also be associated. Further, if the reference position P1 of the endoscope and the position Q1 corresponding to the feature region R _V1 of the tubular tissue can be associated with each other, the points Q1, Q2 on the center line L representing the feature regions R _V1 , R _V2 Is not necessarily extracted in advance, the feature region R _V1 is displayed in the endoscope image 31 and the reference position P1 of the endoscope 1 is input, and then the position Q1 corresponding to the feature region R _V1 is extracted. May be. For example, after inputting the reference position P1 of the endoscope 1 for the position Q1 corresponding to the feature region _RV1 , the viewpoint of the virtual endoscope is manually moved to display the feature region in the virtual endoscope image 31. The position of the viewpoint of the virtual endoscope when _RV1 is displayed may be set, or the center line L may be displayed and set as the position selected by the user using the input device on the center line.

In the first embodiment of the present invention, the virtual endoscope image generating means 12 that generates the virtual endoscope image 41 with the viewpoint moved along the center line L, and the generated virtual endoscope Display means 8 for displaying an image 41, and the reference position P1 is determined by displaying the feature region R _V1 in the tubular tissue in both the displayed virtual endoscopic image 41 and endoscopic image 31. Since the position P1 of the viewpoint of the virtual endoscope 31 coincides with the position E1 of the imaging unit 1A of the endoscope with high accuracy, the position P1 of the viewpoint of the virtual endoscope 31 is based on the viewpoint position P1. The calculated viewpoint position P2 accurately represents the position E2 of the imaging unit 1A of the endoscope, and the position 1A (the position of the distal end) of the imaging unit of the endoscope can be grasped more accurately. . In other words, the reference position P1 of the endoscope can be set more accurately, and the viewpoint position Q2 of the virtual endoscope can be calculated more accurately. As a result, since the index M on the center line is displayed at a more accurate position, the position of the further moved endoscope can be grasped more accurately. In particular, since the same feature region is represented by the same position or the same size on both the virtual endoscopic image 41 and the endoscopic image 31, the above effect is further remarkable.

  When the same feature region in the tubular tissue is displayed in both the virtual endoscopic image and the endoscopic image, the viewpoint of the virtual endoscopic image is first moved in the virtual endoscopic image to thereby move the tubular tissue The same feature area in the tubular tissue may be displayed in accordance with the movement of the endoscope in the endoscopic image, and the endoscopic image is first displayed in the endoscopic image. The feature region in the tubular tissue may be displayed in accordance with the movement, and then the same feature region in the tubular tissue may be displayed by moving the viewpoint of the virtual endoscopic image in the virtual endoscopic image. The same feature region in the tubular tissue may be displayed simultaneously with the image.

The input of the reference position P1, the endoscope of the reference position P1 and the reference position associated feature regions R _V1 of the tubular tissue to be identified to each other by P1 possible, it displayed virtual endoscopic image 41 and not necessarily performed when the feature region R _V1 in both the tubular tissue of the endoscopic image 31 is displayed, when the feature region R _V1 in only tubular tissue endoscopic image 31 is displayed Even can be done. For example, the reference position P1 of the endoscope 1 is determined when the feature region of the tubular tissue is displayed in the endoscopic image 31, and corresponds to a plurality of feature regions R _V1 and R _V2 extracted in advance on the WS display 8. The position corresponding to the feature region _RV1 may be selected by an input device such as a mouse, and the reference position P1 and the position Q1 corresponding to the feature region _RV1 may be associated with each other.

  In the first embodiment, the movement amount acquisition unit 14 acquires a numerical value attached to the outer surface of the probe 1B of the endoscope 1 and measures the insertion depth of the endoscope 1 into the tubular tissue. Since the movement amount and movement direction of the endoscope are acquired, the movement amount and movement direction of the endoscope can be acquired with a simple device and method. In addition, the acquisition method of a movement amount and a movement direction is not restricted to the method of this embodiment, As long as the movement direction and movement amount to the longitudinal direction of the tubular structure | tissue of the endoscope 1 can be measured, it will be various. The method can be applied. For example, the user reads the numerical values Sc1 and Sc2 attached to the outer surface of the probe 1B of the endoscope 1 and inputs the numerical values Sc1 and Sc2 from the keyboard or the like using an interactive GUI, and the movement amount acquisition unit 14 acquires the numerical values Sc1 and Sc2. You may make it do.

  In addition, the index M representing the viewpoint Q2 of the virtual endoscope may be anything as long as it displays the position in an identifiable manner. For example, the index may be a cross mark, or a known index that can indicate a position, such as a point, a circle, a rectangle, an arrow, or a closed curved surface. In addition, the index M may represent an arbitrary point on the center line L with a range of errors expected along the center line L around the point Q2 representing the feature region on the center line L. Good.

  The modality 5 can use a modality capable of acquiring volume data capable of reconstructing a virtual endoscopic image, such as an MRI apparatus, in addition to the above CT apparatus.

  Further, in the guide image 51, while the observation with the endoscope is continued, the position of the viewpoint of the virtual endoscope is calculated in synchronization with the movement of the endoscope 1, and the center line of the guide image 51 is calculated. Since an index M indicating the position of the viewpoint is displayed on L, a user such as a doctor grasps the route of the large intestine from the center line of the guide image 51, and the position of the endoscope in the large intestine by the index M above it. The endoscope can be operated while referring to the above as appropriate. For this reason, the approach of the endoscope 1 to the curved portion or the target diagnosis site can be dynamically and accurately captured.

  The tubular tissue may be anything as long as an endoscope can be inserted, and the feature region may be anything as long as the user has a form that can be distinguished from other regions in the tubular tissue. For example, the feature region can be indicated by various methods such as a circle, a rectangle, an arrow, and a closed curved surface. For example, the tubular tissue may be a large intestine, and the characteristic region may include any of an anal canal, a spleen fold, and a liver fold. Further, the tubular tissue may be a bronchus, and the characteristic region may include one of a larynx and a bronchial bifurcation. The tubular tissue may be an esophagus, and the characteristic region may include one of a pharynx and a cardia. Moreover, it is good also considering the area | region which has unevenness | corrugations, such as a tumor in a tubular tissue, as a characteristic area.

In the present embodiment, the user designates a plurality of feature regions R _V1 and R _V2 in the tubular tissue on the virtual endoscopic image with an input device such as a mouse, whereby a plurality of feature regions R _V1 and Although R _V2 are previously extracted, the characteristic region of the tubular tissue _{R 1, R 2, R 3} , ... obtained from the shape model and the 3-dimensional image data of the center line of the predefined tubular tissue R _n by performing matching between the center line L, a plurality of characteristic regions _{R 1,} R ₂ on the geometric _model, R 3, ... feature region on the center line L and the corresponding _{R n R V1, R V2,} R V3 ,... R _Vn may be automatically extracted.

  As a modification of the first embodiment, a configuration may be adopted in which a warning unit 18 (not shown) is added to the endoscope observation support apparatus according to the first embodiment.

  This warning unit 18 is a processing unit mounted on the image processing workstation 9, and is designated in advance as the virtual endoscope viewpoint position Q2 on the center line after S08 of the first embodiment shown in FIG. When the distance from the position of the target site W1 is smaller than a predetermined threshold, that is, when the endoscope 1 is approaching the target site W1 designated in advance, a warning WM is output on the guide image 51. Is. The warning WM blinks the index M indicating the position Q2 of the viewpoint of the virtual endoscope or changes the color of the index M to an identifiable color. Thereby, in the tubular tissue, the site to be taken care of when the endoscope 1 is moved is registered in advance as the attention site W1, so that the endoscope 1 approaches the attention site W1 in the tubular tissue. Can be easily recognized, which contributes to prevention of erroneous operation of the endoscope 1. Note that the method for outputting the warning to the outside may be a method for outputting a warning sound or sound in addition to the above method, or both warning message superimposition display and warning sound may be output. .

  Each of the above embodiments is merely an example, and all of the above description should not be used to limit the technical scope of the present invention.

  In addition, the system configuration, the hardware configuration, the processing flow, the module configuration, the user interface, specific processing contents, and the like in the above embodiment are variously modified without departing from the spirit of the present invention. Are included in the technical scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Endoscope 2 Digital processor 3 Light source device 4 Endoscopic image display 5 Modality 6 Treatment tool 7 Position detection part 8 Image processing workstation display 9 Image processing workstation 11 Three-dimensional image acquisition means 12 Virtual endoscopic image Generation means 13 Input means 14 Movement amount acquisition means 15 Position calculation means 16 Current position display means 17 Centerline acquisition means

Claims (12)

Centerline acquisition means for acquiring a centerline of the tubular tissue of the subject from a three-dimensional image of the subject acquired in advance;
Endoscopic image display means for displaying an endoscope image taken while moving the endoscope inserted into the tubular tissue along the longitudinal direction of the tubular tissue;
When one feature region of the tubular tissue is displayed in the displayed endoscopic image, the position of the endoscope is determined as a reference position, and a position corresponding to the one feature region on the center line A reference position determining means for setting
A movement amount acquisition means for acquiring a movement amount and a traveling direction of the endoscope further moved from the reference position;
Current position calculating means for calculating, as a current position, a position that is separated from the position corresponding to the one characteristic area by the acquired movement amount in the acquired traveling direction along the center line;
An endoscope observation support apparatus, comprising: a current position display unit configured to display an index representing the calculated current position on the center line. Virtual endoscopic image generation means for generating a virtual endoscopic image with the viewpoint moved along the center line;
Display means for displaying the generated virtual endoscopic image,
The determination of the reference position is performed when a feature region in the tubular tissue is displayed in both of the displayed virtual endoscopic image and the endoscopic image. The endoscope observation support apparatus according to 1.   The endoscope observation support apparatus according to claim 1 or 2, wherein the reference position determining means determines the reference position for each different feature region in the tubular tissue.   The medical image processing apparatus according to claim 1, wherein the current position display unit further displays the tubular tissue together with the center line.   5. The endoscope observation support according to claim 1, wherein the current position display unit further displays a schematic endoscope having the position of the viewpoint as a tip. 6. apparatus.   The endoscope observation support apparatus according to any one of claims 1 to 5, wherein the current position display means further displays an index representing the feature region.   7. The inside according to claim 1, wherein the movement amount obtaining unit obtains a movement amount and a movement direction of the probe of the endoscope exposed outside the tubular tissue. Endoscopic observation support device. The tubular tissue is the large intestine;
The endoscopic observation support device according to any one of claims 1 to 7, wherein the characteristic region includes any one of an anal canal, a spleen fold portion, and a liver fold portion. The tubular tissue is bronchi;
The endoscopic observation support apparatus according to any one of claims 1 to 8, wherein the characteristic region includes one of a larynx and a bronchial bifurcation. The tubular tissue is the esophagus;
The endoscopic observation support apparatus according to any one of claims 1 to 9, wherein the characteristic region includes one of a pharynx and a cardia. Obtaining a center line of the tubular tissue of the subject from a three-dimensional image of the subject obtained in advance;
Displaying an endoscope image taken while moving the endoscope inserted into the tubular tissue along the longitudinal direction of the tubular tissue;
When one feature region of the tubular tissue is displayed in the displayed endoscopic image, a reference position of the endoscope is input and a position corresponding to the one feature region is set on the center line And
Obtaining the moving amount and the traveling direction of the endoscope further moved from the reference position;
A position that is separated from the position corresponding to the one characteristic region by the acquired amount of movement in the acquired traveling direction along the center line is calculated as a current position;
An endoscope observation support method, comprising: displaying an index representing the calculated current position on the center line. Computer
Centerline acquisition means for acquiring the centerline of the tubular tissue of the subject from the three-dimensional image of the subject acquired in advance;
Endoscopic image display means for displaying an endoscope image taken while moving the endoscope inserted into the tubular tissue along the longitudinal direction of the tubular tissue;
When one feature region of the tubular tissue is displayed in the displayed endoscopic image, the position of the endoscope is determined as a reference position, and a position corresponding to the one feature region on the center line A reference position determining means for setting
A movement amount acquisition means for acquiring a movement amount and a traveling direction of the endoscope further moved from the reference position;
Current position calculating means for calculating, as a current position, a position that is separated from the position corresponding to the one characteristic area by the acquired movement amount in the acquired traveling direction along the center line;
An endoscope observation support program that functions as current position display means for displaying an index representing the calculated current position on the center line.