JP2010046216A - Optical tomographic image obtaining apparatus and optical tomographic image obtaining method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make it possible to easily register the position of an OCT probe to the obtaining range of a plurality of optical tomographic images obtained in the past in the case of obtaining the plurality of optical tomographic images using the OCT probe inserted into the forceps opening of an endoscope apparatus. <P>SOLUTION: An endoscope image 510 during imaging, a tomographic image 512 during imaging, a 3D image 522 generated by making a plurality of tomographic images imaged in the past as volume data, an endoscope image 520 imaged including the obtaining range of the plurality of tomographic images which are base of the 3D image 522, and the positional information 524 of the endoscope when the endoscope image 520 is imaged are displayed while being arranged in the same screen in a monitor device 500. A index 521 showing the obtaining range of the plurality of tomographic image which is the base of the 3D image 522 is displayed superposed on the endoscope image 520 imaged in the past. An operator actually images while registering the trajectory 511 of aiming light Le imaged in the endoscope image 510 during imaging to the same position of the end portion of the index 521 displayed in the endoscope image 520 imaged in the past. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an optical tomographic image acquisition apparatus and an optical tomographic image acquisition method, and in particular, an optical tomographic image acquisition apparatus and an optical tomographic image acquisition method capable of easily aligning an OCT probe inserted into a forceps port of an endoscope apparatus. About.

  Conventionally, as an endoscope apparatus for observing the inside of a body cavity of a living body, an electronic endoscope apparatus that irradiates illumination light inside the body cavity of a living body, captures an image of reflected light reflected, and displays it on a monitor or the like is widely spread. And used in various fields. Many endoscope apparatuses are provided with a forceps port, and a biopsy or treatment of tissue in the body cavity can be performed with a treatment tool introduced into the body cavity via the forceps port.

  On the other hand, in recent years, development of a tomographic image acquisition apparatus that acquires a tomographic image of a living body and the like without cutting a measurement target such as a biological tissue has been promoted. An optical tomographic imaging apparatus using an optical coherence tomography measurement method is known.

  This OCT measurement is a measurement method that utilizes the fact that interference light is detected when the optical path lengths of the measurement light, reflected light, and reference light match. That is, in this method, the low coherent light emitted from the light source is divided into measurement light and reference light, the measurement light is irradiated onto the measurement object, and the reflected light from the measurement object is guided to the multiplexing means. On the other hand, the reference light is guided to the multiplexing means after the optical path length is changed in order to change the measurement depth in the measurement target. Then, the reflected light and the reference light are combined by the combining means, and the interference light resulting from the combination is measured by heterodyne detection or the like. In the OCT apparatus, by changing the optical path length of the reference light, the measurement position (measurement depth) with respect to the measurement object is changed and a tomographic image is acquired. This method is generally called TD-OCT (Time domain OCT) measurement. More specifically, the optical path length adjustment mechanism of the reference light in Patent Document 1 has an optical system that focuses the reference light emitted from the optical fiber onto the mirror, and moves only the mirror in the beam axis direction of the reference light. The optical path length is adjusted. The optical path length adjustment mechanism for the reference light shown in Patent Document 2 collimates the reference light emitted from the optical fiber by the lens, and condenses the reference light that has become parallel light again by the optical path length adjustment lens. The light is incident on the fiber, and the optical path length is adjusted by advancing and retracting the optical path length adjusting lens in the beam axis direction of the reference light.

  On the other hand, an optical tomographic imaging apparatus based on SD-OCT (Spectral Domain OCT) measurement has been proposed as an apparatus for acquiring a tomographic image at high speed without changing the optical path length of the reference light described above. This SD-OCT apparatus divides broadband low-coherent light into measurement light and reference light using a Michelson interferometer, and then irradiates the measurement light to the measurement object, and the reflected light returned at that time. The tomographic image is constructed without scanning in the depth direction by performing Fourier analysis on the channeled spectrum obtained by decomposing the interference light between the reference light and the reference light into frequency components.

  Furthermore, an optical tomographic imaging apparatus based on SS-OCT (Swept source OCT) measurement has been proposed as an apparatus for acquiring a tomographic image at high speed without changing the optical path length of the reference light. This SS-OCT apparatus sweeps the frequency of the laser light emitted from the light source to cause interference between the reflected light and the reference light, and the reflected light intensity at the depth position of the measurement object is determined from the interferogram in the optical frequency region. A tomographic image is constructed using the detected image.

  By repeating the measurement while slightly shifting the irradiation position in the above-described tomographic image, a two-dimensional optical tomographic image of a predetermined scanning region can be acquired. Furthermore, volume data of a three-dimensional image can be obtained by acquiring a plurality of two-dimensional optical tomographic images by shifting the irradiation position in a direction perpendicular to the tomographic plane.

Such an OCT apparatus (optical tomographic imaging apparatus) is capable of observing a measurement site with high precision (resolution of about 10 μm), and an OCT probe (optical probe) is inserted into the forceps opening of the endoscope apparatus. By guiding the signal light and the reflected light of the signal light and acquiring the optical tomographic image in the body cavity, for example, it is possible to diagnose the depth of invasion of the initial cancer.
JP-A-6-165784 JP 2003-139688 A

  However, when using the OCT probe inserted into the forceps opening of the endoscope to observe the same measurement location, it is difficult to specify the measurement location because of the high resolution, and the same measurement is performed by accurately aligning the position of the OCT probe. There has been a problem that it is difficult to obtain optical tomographic images of places.

  The present invention has been made in view of such circumstances, and intends to perform a follow-up observation by generating a three-dimensional image from an optical tomographic image acquired using an OCT probe inserted into a forceps opening of an endoscope apparatus. In this case, an object is to provide an optical tomographic image acquisition apparatus and an optical tomographic image acquisition method capable of easily aligning an OCT probe.

  In order to achieve the object, an optical tomographic image acquisition apparatus according to claim 1, an endoscope image acquisition unit that acquires an endoscopic image in a body cavity using an imaging device provided in the endoscope; Optical tomographic image acquisition for acquiring an optical tomographic image of a measurement object from interference light obtained by irradiating the measurement light from the optical probe inserted through the forceps opening of the endoscope and combining the reflected light reflected from the measurement object and the reference light Means, a plurality of past optical tomographic images acquired in a predetermined range in the body cavity, and a past endoscopic image acquired by the endoscopic image acquiring means when acquiring the plurality of past optical tomographic images A storage unit that associates and stores a past endoscopic image including an index indicating an acquisition range of the plurality of past optical tomographic images, and reads out the past endoscopic image from the storage unit Means and the endoscopic image acquisition means. That the current endoscopic image, characterized by comprising a display control means for comparably displayed on the display means a past endoscopic image read by said reading means.

  According to the present invention, the current endoscopic image acquired by the endoscopic image acquiring unit and the past endoscopic image read out by the reading unit are displayed on the display unit so as to be comparable. When acquiring multiple optical tomographic images at the same position as multiple optical tomographic images recorded on the optical probe, it is possible to easily align the optical probe, shorten the alignment time, and The burden can be reduced.

  The optical tomographic image acquisition apparatus according to claim 1, wherein the display control unit causes the display unit to display the current endoscopic image and the past endoscopic image side by side. It is characterized by that.

  Thereby, the current endoscopic image and the past endoscopic image can be easily compared.

  The optical tomographic image acquisition apparatus according to claim 1, wherein the display control unit superimposes the current endoscopic image and the past endoscopic image at a first ratio. It is displayed on the display means.

  Thereby, the current endoscopic image and the past endoscopic image can be easily compared.

  According to a fourth aspect of the present invention, in the optical tomographic image acquisition apparatus according to the third aspect of the present invention, there is provided a means for changing the first ratio.

  Thereby, the current endoscopic image and the past endoscopic image can be easily compared.

  In the optical tomographic image acquisition device according to claim 3 or 4 as shown in claim 5, the display control means displays the current endoscopic image and the past endoscopic image side by side, Alternatively, there is provided a means for selecting whether to display the images at the first ratio.

  Thereby, the current endoscopic image and the past endoscopic image can be easily compared.

  In the optical tomographic image acquisition apparatus according to any one of claims 1 to 5, as described in claim 6, means for extracting characteristic portions of the first endoscope image and the second endoscope image; Means for performing image processing on the first endoscopic image and the second endoscopic image so that the extracted feature portion is emphasized and displayed, or only the extracted feature portion is displayed. It is provided with.

  Thereby, the current endoscopic image and the past endoscopic image can be easily compared.

  7. The optical tomographic image acquisition apparatus according to claim 6, wherein the means for extracting the characteristic portion of the first endoscopic image and the second endoscopic image includes an object. At least one of object extraction means for extracting an object region, outline extraction means for extracting the outline of an object, feature part extraction means for extracting a feature part based on feature parameters, and color extraction means for extracting the color of an object It is characterized by including.

  Thereby, a characteristic part can be extracted appropriately.

  The optical tomographic image acquisition apparatus according to any one of claims 1 to 7, wherein the reading unit reads the plurality of past optical tomographic images from the storage unit, and reads the plurality of optical tomographic images. A display unit configured to generate a stereoscopic image based on a plurality of past optical tomographic images, wherein the display control unit displays the current optical tomographic image acquired by the optical tomographic image acquisition unit and the stereoscopic image on the display unit; It is characterized by being displayed.

  As a result, the stereoscopic image and the current endoscope can be compared, and the OCT probe can be easily aligned.

  9. The optical tomographic image acquisition apparatus according to claim 8, wherein the display control unit displays the current optical tomographic image and the stereoscopic image side by side on the display unit. .

  As a result, the stereoscopic image and the current endoscope can be compared, and the OCT probe can be easily aligned.

  The optical tomographic image acquisition apparatus according to any one of claims 1 to 9, wherein the storage means indicates a past position indicating the position of the endoscope at the time of acquiring the past endoscopic image. Position information and the past endoscopic image are stored in association with each other, the reading unit reads the past position information from the storage unit, and the display control unit stores the past position information on the display unit. It is characterized by being displayed.

  As a result, the OCT probe can be easily aligned.

  The optical tomographic image acquisition apparatus according to any one of claims 1 to 10, further comprising means for acquiring current position information indicating a position of the current endoscope. Displays the current position information on the display means.

  As a result, the OCT probe can be easily aligned.

  The optical tomographic image acquisition apparatus according to any one of claims 1 to 11, further comprising means for designating a person to be observed, wherein the reading means is designated by the storage means from the storage means. All the endoscopic images of the user are read out, and the display control means causes the display means to display a list of all the read-out endoscopic images, and from the displayed endoscopic images, the past A means for selecting an endoscopic image is provided.

  Thereby, the necessary endoscopic image of the designated observer can be selected.

  The optical tomographic image acquisition apparatus according to any one of claims 1 to 12, wherein an acquisition range of the plurality of optical tomographic images is obtained from an endoscopic image at the time of acquisition of the plurality of optical tomographic images. A range extracting means for extracting the index, means for synthesizing the extracted index indicating the acquired position with the endoscopic image, and storing the plurality of optical tomographic images and the endoscopic image in association with each other in the storage means. A storage control means is provided.

  Thereby, when the optical tomographic image is acquired for the same range next time, the OCT probe can be easily aligned.

  14. The optical tomographic image acquisition apparatus according to claim 13, wherein the optical probe irradiates aiming light which is measurement position visible light together with low coherence light, and the range extracting means includes the aiming light. And acquiring the plurality of optical tomographic image acquisition ranges.

  Thereby, the acquisition range of a some optical tomographic image can be extracted appropriately.

  15. The optical tomographic image acquisition apparatus according to claim 13, wherein the plurality of optical tomographic images are based on a measurement position mark movement locus applied to the optical probe and a measurement width of the optical tomographic image. The acquisition range is extracted.

  Thereby, the acquisition range of a some optical tomographic image can be extracted appropriately.

  The optical tomographic image acquisition apparatus according to any one of claims 1 to 15, wherein the storage control unit obtains position information indicating an acquisition position of the endoscopic image as the past endoscope. The image data is stored in a storage unit in association with an image.

  Thereby, when the optical tomographic image is acquired for the same range next time, the OCT probe can be easily aligned.

  The optical tomographic image acquisition apparatus according to any one of claims 8 to 16, wherein the display control unit is generated based on a plurality of past optical tomographic images read from the storage unit. The past three-dimensional image and the current three-dimensional image generated based on the plurality of optical tomographic images acquired by the optical tomographic image acquiring unit are displayed on the display unit so as to be comparable.

  Thereby, a change can be observed easily.

  18. The optical tomographic image acquisition apparatus according to claim 17, further comprising means for extracting a cross-sectional image of an arbitrary cutting plane from the past stereoscopic image and the current stereoscopic image, and the display control. The means is characterized in that the extracted sectional image is displayed on the display means.

  Thereby, a change can be observed easily.

  In order to achieve the above object, an optical tomographic image acquisition method according to claim 19 is an endoscopic image acquisition step of acquiring an endoscopic image in a body cavity using an imaging device provided in the endoscope; An optical tomographic image acquisition step for acquiring an optical tomographic image based on reflected light of light emitted from an optical probe inserted through the forceps opening of the endoscope, and a plurality of past acquired in a predetermined range in the body cavity An optical tomographic image and a past endoscopic image acquired by the endoscopic image acquiring unit at the time of acquiring the plurality of past optical tomographic images, showing an acquisition range of the plurality of past optical tomographic images A reading step of reading out the past endoscopic image from storage means for storing the past endoscopic image including an index in association with the current endoscopic image acquired by the endoscopic image acquiring step; Past insights read out in the readout step Characterized by comprising a display control process for comparably displayed on the display means an image.

  According to the present invention, the current endoscopic image acquired by the endoscopic image acquiring unit and the past endoscopic image read out by the reading unit are displayed on the display unit so as to be comparable. When acquiring multiple optical tomographic images at the same position as multiple optical tomographic images recorded on the optical probe, the optical probe can be easily aligned, shortening the alignment time, and It becomes possible to reduce the burden.

  According to the present invention, the current endoscopic image acquired by the endoscopic image acquiring unit and the past endoscopic image read out by the reading unit are displayed on the display unit so as to be comparable. When acquiring multiple optical tomographic images at the same position as multiple optical tomographic images recorded on the optical probe, the optical probe can be easily aligned, shortening the alignment time, and It becomes possible to reduce the burden.

  The best mode for carrying out the present invention will be described below.

<Diagnostic imaging system>
FIG. 1 is an example of a block diagram of an image diagnostic system 1 according to the present invention. As shown in the figure, the diagnostic imaging system 1 includes a diagnostic imaging apparatus 10 and an image server 700. The diagnostic imaging apparatus 10 and the image server 700 are connected via the LAN 2 and can transmit and receive patient data and image data using a predetermined protocol. The method for connecting to the LAN 2 may be wired or wireless.

<Appearance of diagnostic imaging equipment>
FIG. 2 is an example of an external view showing the diagnostic imaging apparatus 10 according to the present invention.

  As shown in FIG. 2, the diagnostic imaging apparatus 10 mainly includes an endoscope 100, an endoscope processor 200, a light source device 300, an OCT processor 400, and a monitor device 500. The endoscope processor 200 may be configured to incorporate the light source device 300.

  The endoscope 100 includes a hand operation unit 112 and an insertion unit 114 that is connected to the hand operation unit 112. The surgeon grasps and operates the hand operation unit 112 and performs observation by inserting the insertion unit 114 into the body of the subject.

  A universal cable 116 is connected to the hand operation unit 112, and an LG connector 120 is provided at the tip of the universal cable 116. By connecting the LG connector 120 to the light source device 300 in a detachable manner, illumination light is sent to the illumination optical system 152 disposed at the distal end portion of the insertion portion 114. The LG connector 120 is connected to an electrical connector 110 via a universal cable 116, and the electrical connector 110 is detachably coupled to the endoscope processor 200. As a result, observation image data obtained by the endoscope 100 is output to the endoscope processor 200 and an image is displayed on the monitor device 500 connected to the endoscope processor 200.

  The hand operating unit 112 is provided with an air / water feed button 126, a suction button 128, a shutter button 130, a function switching button 132, a pair of angle knobs 134, and a pair of lock levers 136. The description about is omitted.

  Further, the hand operation section 112 is provided with a forceps insertion portion 138, and the forceps insertion portion 138 is communicated with the forceps port 156 of the distal end portion 144. In the diagnostic imaging apparatus 10 according to the present invention, the OCT probe 600 is led out from the forceps port 156 by inserting the OCT probe 600 from the forceps insertion portion 138. The OCT probe 600 is inserted from the forceps insertion part 138 and inserted from the forceps port 156, an operation part 604 for the operator to operate the OCT probe 600, and the OCT processor 400 via the connector 410. It consists of a cable 606 to be connected.

  On the other hand, the insertion portion 114 of the endoscope 100 includes a flexible portion 140, a bending portion 142, and a distal end portion 144 in this order from the hand operating portion 112 side. The distal end portion 144 is provided with an observation optical system 150, an illumination optical system 152, an air / water supply nozzle 154, a forceps port 156, and the like.

  The observation optical system 150 is disposed on the distal end surface of the distal end portion 144, and the CCD 180 is disposed behind the observation optical system 150. A signal cable (not shown) is connected to the substrate of the CCD 180, and this signal cable is inserted into the insertion portion 114, the hand operation portion 112, the universal cable 116, etc., and extended to the electrical connector 110, and the endoscope processor 200. Connected to. Therefore, the observation image captured by the observation optical system 150 is formed on the light receiving surface of the CCD 180 and converted into an electric signal, which is output to the endoscope processor 200 and converted into a video signal. Thereby, an observation image is displayed on the monitor device 500 connected to the endoscope processor 200.

  The illumination optical system 152 is provided adjacent to the observation optical system 150, and is disposed on both sides of the observation optical system 150 as necessary. An exit end of a light guide 170, which will be described later, is disposed in the back of the illumination optical system 152. The light guide 170 is inserted into the insertion portion 114, the hand operating portion 112, and the universal cable 116, and the incident end of the light guide 170 is Arranged in the LG connector 120. Therefore, by connecting the LG connector 120 to the light source device 300, the illumination light irradiated from the light source device 300 is transmitted to the illumination optical system 152 via the light guide 170, and irradiated to the front observation range from the illumination optical system 152. Is done.

  A description of the air / water supply nozzle 154 is omitted.

  A tube-shaped forceps channel (not shown) is connected to the forceps port 156. The forceps channel is inserted into the insertion portion 114 and then branched. One of the forceps channels communicates with the forceps insertion portion 138 of the hand operation portion 112 and the other is connected to a suction valve (not shown) in the hand operation portion 112. . The suction valve is operated by a suction button 128, whereby a lesioned part or the like can be sucked from the forceps opening 156.

  A bending portion 142 is provided on the proximal end side of the distal end portion 144 configured as described above. The bending portion 142 is configured to be bent remotely by rotating the angle knobs 134 and 134 of the hand operation unit 112.

  A flexible portion 140 is provided on the proximal end side of the bending portion 142. The soft part 140 has flexibility and is configured by covering a core material made of, for example, a metal net tube with a coating such as resin.

<Internal configuration of endoscope, endoscope processor, and light source device>
FIG. 3 is an example of a block diagram illustrating an internal configuration of the endoscope 100, the endoscope processor 200, and the light source device 300.

[Endoscope]
At the distal end portion 144 of the endoscope 100, an observation optical system 150, an illumination optical system 152, and a ccd 180 are disposed.

The observation optical system 150 forms an image of the subject on the light receiving surface of the CCD 180, and the CCD 180 converts the subject image formed on the light receiving surface into an electric signal by each light receiving element. The CCD 180 of this embodiment is a color CCD in which three primary color red (R), green (G), and blue (B) color filters are arranged for each pixel in a predetermined arrangement (Bayer arrangement, honeycomb arrangement). It is.

In addition, inside the endoscope 100, a wiring 160 for driving the CCD 180 and taking out the CCD output is provided, and a light guide 170 is provided.

One end 170 A of the light guide 170 is connected to the light source device 300 via the LG connector 120, and the other end 170 B of the light guide 170 faces the illumination optical system 152. The light emitted from the light source device 300 is emitted from the illumination optical system 152 via the light guide 170 and illuminates the visual field range of the observation optical system 150.

[Endoscope processor]
The endoscope processor 200 mainly includes a central processing unit (CPU) 210, an analog front end (AFE) 220, an image input controller 222, an image processing unit 224, an image input interface unit 226, a position detection unit 228, and an image composition unit. 230, a CCD driver 240, a timing generator (TG) 242, a character generator (CG) 244, a memory 246, a video output unit 248, an audio processing unit 250, a speaker 252, an operation unit 254, and a communication interface unit 258. .

The CPU 210 has a built-in program ROM, and this program ROM has a CPU.
In addition to the control program executed by 210, various data necessary for control are recorded.
The CPU 210 executes a program ROM based on an instruction input such as a shooting instruction from the operation unit 254.
The control program recorded in (1) is read into the memory 246 and sequentially executed to control each unit. The memory 246 is used as a program execution processing area, a temporary storage area for image data, and various work areas.

The CCD 180 in the endoscope 100 sets the charge accumulated in each pixel to 1 in synchronization with the vertical transfer clock and horizontal transfer clock supplied from the TG 242 via the CCD driver 240.
Each line is output as a serial image signal. The CPU 210 controls the driving of the CCD 180 by controlling the TG 242.

  The operation unit 254 has a keyboard, a mouse, and the like for inputting instructions for communication with the image server 700, as will be described later, in addition to a switch for instructing start and end of shooting.

The image signal output from the CCD 180 is an analog signal, and this analog image signal is taken into the AFE 220. The AFE 220 is a correlated double sampling circuit (CD
S), an automatic gain control circuit (AGC), and an AD converter (ADC). The CDS removes noise contained in the image signal, the AGC amplifies the noise-removed image signal with a predetermined gain, and the ADC converts the analog image signal into a digital image having a gradation width of a predetermined bit. Convert to signal.

The image input controller 222 has a built-in line buffer having a predetermined capacity, and the AFE2
The image signal for one frame output from 20 is accumulated. This image input controller 22
The image signal for one frame accumulated in 2 is stored in the memory 246 via the bus 256.

In addition to the CPU 210, the memory 246, and the image input controller 222, the image processing unit 224, the image input interface unit 226, the image composition unit 230, the CG 244, the video output unit 248, the communication interface unit 258, and the like are connected to the bus 256. These are capable of transmitting and receiving information to and from each other via a bus 256.

  The image signal for one frame stored in the memory 246 is captured by the image processing unit 224 and subjected to necessary image processing.

  The communication interface unit 258 communicates with the image server 700 via the LAN 2 using a predetermined protocol. By specifying the patient ID in the operation unit 254, the medical history of the patient, an endoscopic image or a tomographic image taken in the past can be acquired from the image server 700 via the communication interface unit 258.

  The endoscope processor 200 receives an image signal of a tomographic image output from the OCT processor 400 via the image input interface unit 226. This image signal is converted into a video signal for the monitor device 500 by the video output unit 248 and output to the monitor device 500.

Further, the CG 244 generates a warning character or the like according to a command from the CPU 210 and outputs it to the image composition unit 230, and the sound processing unit 250 generates a warning sound such as a beep sound or a warning sound from the speaker 252 according to a command from the CPU 210. Let

  The image synthesizing unit 230 performs processing for superimposing a warning character or the like generated by the CG 244 on a tomographic image or an endoscopic image, thereby displaying the warning character or the like on the screen of the monitor device 500.

  The position detection unit 228 detects the position (insertion depth) of the endoscope from the output signal of the position sensor 229 provided in the endoscope 100. The position information of the endoscope is superimposed in the image composition unit 230 and displayed on the monitor device 500 together with the endoscope image and the like. In addition, the image is recorded in the image server 700 together with the photographed endoscope image and the like.

[Light source device]
The light source device 300 mainly includes a white light source 310, a diaphragm 330, a condenser lens 340, and an automatic light amount adjustment circuit (ALC) 370, and makes visible light incident on the light guide 170.

As the light source 310, for example, a halogen lamp can be used. White light emitted from the halogen lamp has a wavelength range of 400 nm to 1800 nm.

The ALC 370 is based on the brightness information of the photographed image applied from the CPU 210, and the aperture 3
30 is controlled to adjust the amount of light incident on the light guide 170 so that the captured image is maintained at a constant brightness. This prevents halation or the like from occurring.

<Internal configuration of OCT processor and OCT probe>
FIG. 4 is an example of a block diagram showing the internal configuration of the OCT processor 400 and the OCT probe 600.

[OCT processor]
The OCT processor 400 shown in FIG. 4 includes a first light source unit 12 that emits light, a second light source unit 13 that emits aiming light (second light flux) Le for indicating a measurement mark, and a first light source unit 13. The light emitted from the light source unit 12 is split into measurement light and reference light, and the reflected light and reference light are combined to generate interference light, and the optical path length of the reference light is adjusted An optical path length adjusting unit 18, an interference light detecting unit 20 that detects the interference light generated by the branching and multiplexing unit 14 as an interference signal, and a processing unit 22 that processes the interference signal detected by the interference light detecting unit 20. Have Further, the OCT processor 400 transmits the optical fiber coupler 28 that splits the light emitted from the first light source unit 12, the detection unit 30 a that detects the reference light, the detection unit 30 b that detects the reflected light, and the processing unit 22. And an operation control unit 32 for inputting various conditions and changing settings. Further, an optical fiber is used as a light path, and measurement light, reference light, reflected light, and the like are guided to each part.

  The first light source unit 12 includes a semiconductor optical amplifier 40, an optical branching device 42, a collimator lens 44, a diffraction grating element 46, an optical system 48, and a rotating polygon mirror 50, and the frequency is constant. The swept laser beam La is emitted.

  The semiconductor optical amplifier (semiconductor gain medium) 40 emits weak emission light and amplifies incident light when a drive current is applied. An optical fiber FB10 is connected to the semiconductor optical amplifier 40. Specifically, one end of the optical fiber FB10 is connected to a portion where light is emitted from the semiconductor optical amplifier 40, and the other end of the optical fiber FB10 is connected to a portion where light enters the semiconductor optical amplifier 40. The light emitted from the semiconductor optical amplifier 40 is emitted to the optical fiber FB10 and enters the semiconductor optical amplifier 40 again.

  Thus, by forming a loop of the optical path with the semiconductor optical amplifier 40 and the optical fiber FB10, the semiconductor optical amplifier 40 and the optical fiber FB10 become an optical resonator, and a drive current is applied to the semiconductor optical amplifier 40. Pulsed laser light is generated.

  The optical splitter 42 is provided on the optical path of the optical fiber FB10 and is also connected to the optical fiber FB11. The optical branching device 42 branches a part of the light guided in the optical fiber FB10 to the optical fiber FB11.

  The collimator lens 44 is disposed at the other end of the optical fiber FB11, that is, the end not connected to the optical fiber FB10, and makes the light emitted from the optical fiber FB11 parallel light.

  The diffraction grating element 46 is disposed at a predetermined angle on the optical path of the parallel light generated by the collimator lens 44. The diffraction grating element 46 splits the parallel light emitted from the collimator lens 44.

  The optical system 48 is disposed on the optical path of the light split by the diffraction grating element 46. The optical system 48 is composed of a plurality of lenses, refracts the light split by the diffraction grating element 46, and converts the refracted light into parallel light.

  The rotating polygon mirror 50 is disposed on the optical path of the parallel light generated by the optical system 48 and reflects the parallel light. The rotating polygonal mirror 50 is a rotating body that rotates at a constant speed in the R1 direction of FIG. 4. A surface perpendicular to the rotation axis is a regular octagon, and a side surface (each side of the octagon is irradiated with parallel light). Surface) is formed of a reflecting surface that reflects the irradiated light. The rotating polygon mirror 50 rotates to change the angle of each reflecting surface with respect to the optical axis of the optical system 48.

  The light emitted from the optical fiber FB11 passes through the collimator lens 44, the diffraction grating element 46, and the optical system 48, and is reflected by the rotary polygon mirror 50. The reflected light passes through the optical system 48, the diffraction grating element 46, and the collimator lens 44 and enters the optical fiber FB11.

  Here, as described above, since the angle of the reflecting surface of the rotating polygon mirror 50 changes with respect to the optical axis of the optical system 48, the angle at which the rotating polygon mirror 50 reflects light changes with time. For this reason, only the light in a specific frequency region out of the light dispersed by the diffraction grating element 46 is incident on the optical fiber FB11 again. Here, since the light in a specific frequency range incident on the optical fiber FB11 is determined by the angle between the optical axis of the optical system 48 and the reflection surface of the rotary polygon mirror 50, the frequency range of the light incident on the optical fiber FB11 is It changes depending on the angle between the optical axis of the optical system 48 and the reflecting surface of the rotary polygon mirror 50.

  The light in a specific frequency range that has entered the optical fiber FB11 is incident on the optical fiber FB10 from the optical splitter 42, and is combined with the light in the optical fiber FB10. Thereby, the pulsed laser light guided to the optical fiber FB10 becomes laser light in a specific frequency range, and the laser light La in the specific frequency range is emitted to the optical fiber FB1.

  Here, since the rotary polygon mirror 50 rotates at a constant speed in the direction of the arrow Rl, the wavelength λ of the light incident on the optical fiber FB1l again changes with a constant period as time passes. As a result, the frequency of the laser light La emitted to the optical fiber FB1 also changes at a constant period with the passage of time.

  The first light source unit 12 has such a configuration, and emits the laser light La swept in wavelength to the optical fiber FB1 side.

  Next, the branching / combining unit 14 is configured by, for example, a 2 × 2 optical fiber coupler, and is optically connected to the optical fiber FB1, the optical fiber FB2, the optical fiber FB3, and the optical fiber FB4, respectively.

  The branching / combining unit 14 divides the light La incident from the first light source unit 12 through the optical fiber FB1 into the measurement light L1 and the reference light L2, and causes the measurement light L1 to enter the optical fiber FB2 to thereby enter the reference light. L2 enters the optical fiber FB3.

  Further, the branching / combining unit 14 is incident on the optical fiber FB3, and after the frequency shift and the optical path length are changed by the optical path length adjusting unit 18 to be described later, returns to the optical fiber FB3 and enters the branching / multiplexing unit 14 The reference light L2 obtained and the reflected light L3 from the measurement target S, which is acquired by the OCT probe 600 described later and is incident on the branching / combining unit 14 from the optical fiber FB2, are combined and emitted to the optical fiber FB4.

  In addition, the second light source unit 13 emits colored light with visibility in order to make it easy to confirm the measurement site as the aiming light Le. For example, red semiconductor laser light with a wavelength of 0.66 μm, He—Ne laser light with a wavelength of 0.63 μm, blue semiconductor laser light with a wavelength of 0.405 μm, or the like can be used. Therefore, the second light source unit 13 includes, for example, a semiconductor laser 13a that emits red, blue, or green laser light, and a lens 13b that condenses the aiming light Le emitted from the semiconductor 13a. The aiming light Le emitted from the second light source unit 13 is input to the WDM (wavelength division multiplexing) coupler 15 through the optical fiber FB8, and after being combined with the measurement light L1, through the optical fiber FB9, Input to the rotation drive unit 26.

  The optical path length adjusting unit 18 is arranged on the reference light L2 emission side of the optical fiber FB3 (that is, the end of the optical fiber FB3 opposite to the branching / combining unit 14).

  The optical path length adjustment unit 18 includes a first optical lens 64 that converts the light emitted from the optical fiber FB3 into parallel light, a second optical lens 66 that condenses the light converted into parallel light by the first optical lens 64, and A reflection mirror 68 that reflects the light collected by the second optical lens 66, a base 70 that supports the second optical lens 66 and the reflection mirror 68, and the base 70 are moved in a direction parallel to the optical axis direction. The optical path length of the reference light L2 is adjusted by changing the distance between the first optical lens 64 and the second optical lens 66.

  The first optical lens 64 converts the reference light L2 emitted from the core of the optical fiber FB3 into parallel light, and condenses the reference light L2 reflected by the reflection mirror 68 on the core of the optical fiber FB3.

  The second optical lens 66 condenses the reference light L2 made parallel by the first optical lens 64 on the reflection mirror 68, and makes the reference light L2 reflected by the reflection mirror 68 parallel. Thus, the first optical lens 64 and the second optical lens 66 form a confocal optical system.

The reflection mirror 68 is disposed at the focal point of the light collected by the second optical lens 66 and reflects the reference light L2 collected by the second optical lens 66.

  As a result, the reference light L2 emitted from the optical fiber FB3 becomes parallel light by the first optical lens 64 and is condensed on the reflection mirror 68 by the second optical lens 66. Thereafter, the reference light L2 reflected by the reflecting mirror 68 becomes parallel light by the second optical lens 66, and is condensed on the core of the optical fiber FB3 by the first optical lens 64.

  The base 70 fixes the second optical lens 66 and the reflection mirror 68, and the mirror moving mechanism 72 moves the base 70 in the optical axis direction of the first optical lens 64 (direction of arrow A in FIG. 1). . The distance between the first optical lens 64 and the second optical lens 66 can be changed by moving the base 70 in the arrow A direction by the mirror moving mechanism 72, and the optical path length of the reference light L2 can be adjusted. Can do.

  The interference light detection unit 20 is connected to the optical fiber FB4, and detects the interference light L4 generated by combining the reference light L2 and the reflected light L3 by the branching / combining unit 14 as an interference signal.

  Here, the OCT processor 400 is provided in the optical fiber coupler 28 that branches the laser light La from the optical fiber FB1 to the optical fiber FB5, and the optical fiber FB5 that branches off from the optical fiber coupler 28. It has a detector 30a for detecting the light intensity and a detector 30b for detecting the light intensity of the interference light L4 on the optical path of the optical fiber FB4. The interference light detection unit 20 adjusts the balance of the light intensity of the interference light L4 detected from the optical fiber FB4 based on the detection results of the detectors 30a and 30b.

  From the interference signal detected by the interference light detection unit 20, the processing unit 22 is a region where the OCT probe 600 and the measurement target S are in contact at the measurement position, more precisely, the surface of the probe outer cylinder 52 of the OCT probe 600. A region that can be considered to be in contact with the surface of the measuring object S is detected, and a tomographic image is acquired from the interference signal detected by the interference light detection unit 20.

  The operation control unit 32 includes input means such as a keyboard and a mouse, and control means for managing various conditions based on the input information, and is connected to the processing unit 22. The operation control unit 32 inputs, sets, and changes various processing conditions and the like in the processing unit 22 based on an operator instruction input from the input unit.

  Note that the operation control unit 32 may display the operation screen on the monitor device 500, or may provide a separate display unit to display the operation screen. The operation control unit 32 controls the operation of the first first light source unit 12, the second light source unit 13, the interference light detection unit 20, the rotation drive unit 26, the optical path length, and the detection units 30a and 30b and various conditions. You may make it perform the setting of.

[OCT probe]
The OCT probe 600 is connected to the optical fiber FB9 via the rotation driving unit 26, and the measurement light L1 is incident from the optical fiber FB9, and the measurement light S1 is incident on the measurement target S. The reflected light L3 from is acquired, and the acquired reflected light L3 is emitted to the optical fiber FB9.

  As shown in FIG. 5, the distal end portion of the insertion portion 602 of the OCT probe 600 has a probe outer cylinder 620, a cap 622, an optical fiber 623, a spring 624, a fixing member 626, and an optical lens 628. is doing.

  The probe outer cylinder (sheath) 620 is a cylindrical member having flexibility, and is made of a material through which the measurement light L1 and the reflected light L3 are transmitted. Note that the probe outer cylinder 620 has a tip through which the measurement light L1 (aiming light Le) and the reflected light L3 pass (the end opposite to the side where the optical fiber FB9 is disposed, hereinafter referred to as the tip of the probe outer cylinder 620). It is sufficient that a part of the side is made of a material that transmits light over the entire circumference (transparent material).

  The cap 622 is provided at the distal end of the probe outer cylinder 620 and closes the distal end of the probe outer cylinder 620.

  The optical fiber 623 is a linear member, and is accommodated in the probe outer cylinder 620 along the probe outer cylinder 620, guides the measurement light L1 emitted from the optical fiber FB9 to the optical lens 628, and performs measurement. The reflected light L3 from the measuring object S acquired by the optical lens 628 is guided to the optical fiber FB9 by irradiating the measuring object S with the light L1.

  Here, the optical fiber 623 and the optical fiber FB9 are connected by a rotary joint or the like, and are optically connected in a state where the rotation of the optical fiber 623 is not transmitted to the optical fiber FB9. The optical fiber FB1 is disposed so as to be rotatable with respect to the probe outer cylinder 620.

  The spring 624 is fixed to the outer periphery of the optical fiber 623. The optical fiber 623 and the spring 624 are connected to the rotation drive unit 26.

  The optical lens 628 is disposed at the tip of the optical fiber 623 (the end opposite to the side connected to the optical fiber FB9), and the tip is measured light L1 (from the optical fiber 623). In order to collect the aiming light Le) with respect to the measuring object S, it is formed in a substantially spherical shape.

  The optical lens 628 irradiates the measuring object S with the measuring light L1 (aiming light Le) emitted from the optical fiber 623, collects the reflected light L3 from the measuring object S, and enters the optical fiber 623.

  The fixing member 626 is disposed on the outer periphery of the connection portion between the optical fiber 623 and the optical lens 628, and fixes the optical lens 628 to the end portion of the optical fiber FB1. Here, the fixing method of the optical fiber 623 and the optical lens 628 by the fixing member 626 is not particularly limited. Even if the fixing member 626 is bonded to the optical fiber 623 and the optical lens 628 with an adhesive, a bolt or the like can be used. The mechanical structure used may be fixed. Any fixing member 626 may be used as long as it is used for fixing, holding or protecting the optical fiber, such as a zirconia ferrule or a metal ferrule.

  The rotation driving unit 26 is connected to the optical fiber 623 and the spring 624, and rotates the optical fiber 623 and the spring 624 to rotate the optical lens 628 relative to the probe outer cylinder 11 in the direction of the arrow R <b> 2. The rotation drive unit 26 includes a rotation encoder (not shown), and detects the irradiation position of the measurement light L1 from position information (angle information) of the optical lens 628 based on a signal from the rotation encoder. That is, the measurement position is detected by detecting the angle of the rotating optical lens 628 with respect to the reference position in the rotation direction.

  Further, the optical fiber 623, the spring 624, the fixing member 626, and the optical lens 628 are moved inside the probe outer cylinder 620 in the arrow S1 direction (forceps opening direction) and the S2 direction (probe outside the probe) by a mechanism (not shown) of the rotation driving unit 26. It is configured to be movable in the direction of the tip of the cylinder 620.

  The OCT probe 600 is configured as described above, and the measurement light L1 (from the optical lens 628) is rotated by rotating the optical fiber FB1 and the spring 624 in the direction of arrow R2 in FIG. Aiming light Le) is irradiated to the measuring object S while scanning in the direction of arrow R2 (circumferential direction of the probe outer cylinder 620), and the return light L3 is acquired. The aiming light Le is irradiated to the measuring object S as, for example, blue, red, or green spot light, and the reflected light of the aiming light Le is also displayed as a bright spot on the observation image displayed on the monitor device 500.

  Thereby, the desired site | part of the measuring object S can be caught correctly in the perimeter of the circumference direction of the probe outer cylinder 620, and the return light L3 which reflected the measuring object S can be acquired.

  Further, when acquiring a plurality of tomographic images for generating three-dimensional volume data, the optical lens 628 is moved to the end of the movable range in the arrow S1 direction by a mechanism (not shown) of the rotation driving unit 26, and the tomographic image is displayed. It moves in the S2 direction by a predetermined amount while acquiring, or moves to the end of the movable range while alternately repeating tomographic image acquisition and a predetermined amount of movement in the S2 direction.

  Thus, a plurality of tomographic images in a desired range can be obtained for the measurement object S, and three-dimensional volume data can be obtained based on the acquired plurality of tomographic images.

  FIG. 14 is an example of a diagram illustrating a state in which a tomographic image is obtained using the OCT probe 600 derived from the forceps opening 156 of the endoscope 100. As shown in the figure, a tomographic image is obtained by bringing the distal end portion of the insertion portion 602 of the OCT probe close to a desired portion of the measuring object S. When acquiring a plurality of tomographic images in a desired range, it is not necessary to move the OCT probe 600 main body, and the optical lens 628 is moved in the longitudinal direction in the probe outer cylinder 620 by a mechanism (not shown) of the rotation drive unit 26. Just do it. Further, a plurality of tomographic images in a desired range may be acquired by moving the OCT probe 600 main body while the movement of the optical lens 628 in the longitudinal direction of the probe outer cylinder 620 is fixed. In this case, the optical lens 628 may be moved by pulling out the insertion portion 602 by a predetermined amount by a mechanism (not shown) of the OCT probe 600.

  FIG. 6A shows three-dimensional volume data in which a plurality of tomographic images acquired by alternately moving a predetermined amount of the optical lens 628 of the OCT probe 600 and acquiring an optical tomographic image are arranged. FIG. 6B shows a three-dimensional image generated based on the three-dimensional volume data shown in FIG. As described above, by moving the optical lens 628 to obtain a plurality of tomographic images and performing image processing, it is possible to generate a three-dimensional image.

<Internal configuration of image server>
FIG. 7 is an example of a block diagram showing the internal configuration of the image server 700. As shown in the figure, the image server 700 includes an input / output unit 710, a control unit 712, a database management unit 714, and a database 716.

  The image server 700 is centrally controlled by the control unit 712. The input / output unit 710 is an interface with the LAN 2 and communicates with the endoscope processor 200 of the diagnostic imaging apparatus 10 via the LAN 2 using a predetermined protocol.

  Each patient (subject) is given a unique patient ID, and the database 716 includes a patient ID, patient name, past medical history, endoscopic images and tomographic images taken in the past, and a plurality of images. The patient image including the observation image such as the three-dimensional volume data generated from the tomographic image and the position information of the endoscope at the time of obtaining the observation image is recorded in association with each other. The database management unit 714 can search the patient's medical history, observation image, and the like from the database 716 based on the input patient ID.

<First Embodiment>
The image diagnosis system 1 according to the first embodiment, when displaying an endoscopic image and a tomographic image being captured on the screen of the monitor device 500, includes an endoscope image captured in the past and a plurality of images captured in the past. The three-dimensional image generated as the volume data of the tomographic images is displayed side by side in the same screen.

  FIG. 8 is a flowchart showing the operation of the first embodiment of the diagnostic imaging system 1.

  First, the operator uses the operation unit 254 of the endoscope processor 200 to input a patient ID of a patient to be followed up (step S1).

  The input patient ID is transmitted to the image server 700 via the communication interface unit 258. The image server 700 that has received the patient ID uses the database management unit 714 to create a three-dimensional volume generated from the medical history of the patient corresponding to the patient ID, endoscopic images and tomographic images taken in the past, and a plurality of tomographic images. Patient data including observation images such as data, endoscope position information at the time of observation image acquisition, and the like is acquired from the database 716, and the acquired patient data is transmitted to the endoscope processor 200.

  The endoscope processor 200 displays a list of past observation images on the monitor device 500 from the received patient data (step S2). The photographing date and time and the position information of the endoscope may be displayed simultaneously with the observation image.

  The surgeon uses the operation unit 254 to select an image of a portion to be observed this time from past observation images displayed in a list (step S3). After that, when the operator inserts the endoscope into the body cavity of the patient and starts capturing the endoscopic image and the optical tomographic image, the image processing unit 224 displays the selected image and the image being captured side by side. The selected image and the image being shot are displayed side by side on the monitor device 500 (step S4).

  FIG. 9 is an example of a diagram showing a screen display of monitor device 500 in the present embodiment. The monitor device 500 according to the present embodiment includes an endoscope image 510 being imaged, a tomographic image 512 being imaged, position information 514 of the current endoscope obtained from the output signal of the position sensor 229, and images taken in the past. An endoscopic image 520 and an endoscopic image that are captured including the acquisition range of a plurality of tomographic images based on the three-dimensional image 522 and the three-dimensional image 522 generated using the plurality of tomographic images as volume data Position information 524 of the endoscope when 520 is imaged is displayed side by side in the same screen. In addition, in the endoscope image 520 taken in the past, an index 521 indicating an acquisition range of a plurality of tomographic images that is the basis of the three-dimensional image 522 is displayed in an overlapping manner. A method for generating the index 521 will be described later. The three-dimensional image 522 may be displayed in the same direction as the index 521 of the endoscope image 520. Since the endoscopic image 510 being shot is a moving image, the aiming light Le is reflected as a locus 511 of the aiming light Le.

  By displaying in this way, the surgeon can obtain the endoscope image 520, the three-dimensional image 522, and the position information captured in the past, the endoscope image 510, the tomographic image 512, and the position information being captured. Since it is possible to compare, it is possible to easily confirm the portion to be followed up, and when it is desired to obtain a three-dimensional image at the same position as a three-dimensional image taken in the past, the distal end portion 144 of the endoscope can be accurately obtained. In addition, the insertion portion 602 of the OCT probe 600 can be aligned. Specifically, the operator operates the distal end portion 144 of the endoscope using the hand operation unit 112 of the endoscope so that the field of view of the endoscopic image 510 is the same as that of the endoscopic image 520, Further, using the operation unit 604 of the OCT probe 600, the trajectory 511 of the aiming light Le reflected in the endoscope image 510 being photographed is displayed on the end of the index 521 displayed on the endoscope image 520 photographed in the past. Align with the same position.

  After the alignment, the surgeon performs main imaging of a plurality of tomographic images and endoscopic images for obtaining three-dimensional volume data (step S5). The OCT processor 400 acquires a plurality of tomographic images by moving the optical lens 628 by a predetermined amount based on an imaging instruction from the operation unit 604 of the OCT probe 600. The endoscope processor 200 performs main imaging based on an imaging instruction from the shutter button 130 and traces the trajectory of the aiming light Le while the OCT probe 600 acquires a plurality of tomographic images. Extract the acquisition range.

  This acquisition range is extracted by estimating the length direction from the movement locus of the measurement position mark 640 provided at the distal end of the insertion portion 602 of the OCT probe 600 and estimating the width direction from the measurement width of the tomographic image. May be. FIG. 16 is an example of a diagram illustrating the measurement position mark 640. As shown in the figure, the measurement position mark 640 is provided so as to make one round in the circumferential direction of the probe outer cylinder 620 at the irradiation position of the measurement light L1 of the optical lens 628 (or a position close to the irradiation position). Mark. The measurement position mark 640 does not affect the measurement light L1 and the reflected light L3 from the measurement object S, and has a characteristic of transmitting these lights, and is provided on either the inner wall or the outer wall of the probe outer cylinder 620. It may be.

  As shown in FIG. 17, with the optical lens 628 fixed in the longitudinal direction of the probe outer cylinder 620, the insertion portion 602 is pulled out by a predetermined amount by a mechanism (not shown) of the OCT probe 600, and a plurality of tomograms in a desired range is obtained. Get an image. At this time, the movement locus of the measurement position mark 640 is traced. Reference numeral 642 in FIG. 17 indicates the radiation area (radial coherent length) of the measurement light. From the trace of the traced measurement position mark 640, the travel length direction of the measurement light radiation area 642, that is, acquisition of a plurality of tomographic images. The length direction of the range can be extracted. Furthermore, the width direction of the acquisition range can be extracted from the ratio between the length direction and the width direction of the tomographic image. Further, when the measurement position mark 640 is provided at a position close to the irradiation position of the measurement light L1, the measurement position traced by knowing in advance the position difference between the measurement position mark 640 and the radiation area 642 of the measurement light. The length direction of the acquisition range of a plurality of tomographic images can be extracted from the movement locus of the mark 640. As described above, by using the measurement position mark 640 provided on the probe outer cylinder 620, it is possible to extract a plurality of tomographic image acquisition ranges without combining the aiming light Le with the measurement light.

  As described above, when the movement of the optical lens 628 reaches the end, the acquisition of the tomographic image ends. The OCT processor 400 generates a three-dimensional image using the acquired tomographic images as three-dimensional volume data (step S6). In addition, the endoscope processor 200 synthesizes an index indicating the acquired range of a plurality of tomographic images with the actually captured endoscope image (step S7).

  The three-dimensional volume data, the endoscopic image, and the position information of the main imaging are recorded in the database 716 of the image server 700 in association with the patient ID and the imaging date (step S8). Therefore, these images can be used for the next follow-up observation.

  In the present embodiment, the position information of the endoscope is detected from the output signal of the position sensor 229, but the position sensor 229 may not be provided. For example, the operator may determine from a scale provided on the endoscope 100. In this case, the position information of the endoscopic image being photographed cannot be displayed on the monitor device 500, but the endoscope scale value read when photographing the endoscopic image is manipulated by the endoscope processor 200. By inputting from the unit 254, it is possible to record the shooting position information in the database 716 of the image server 700 in association with the taken endoscope image.

  Further, the position information of the endoscope may be obtained from the CT information, MRI information, US information, etc. of the patient recorded in the database 716 of the image server 700. By generating three-dimensional data from these tomographic images, it is possible to obtain position information with a rough measurement position.

  Furthermore, a new index indicating the acquisition range of the acquired plurality of tomographic images may be generated and displayed so as to be comparable to the index 521 indicating the acquisition range of the plurality of tomographic images of the endoscope images taken in the past. . By displaying in this way, it is possible to check the lacking area of the three-dimensional volume data.

<Second Embodiment>
In the second embodiment, when displaying an endoscope image being photographed, the endoscope image being photographed and the endoscope image photographed in the past are displayed in an overlapping manner.

  FIG. 10 is a flowchart showing the operation of the second embodiment of the diagnostic imaging system 1. In addition, the same code | symbol is attached | subjected to the part which is common in the flowchart shown in FIG. 8, and the detailed description is abbreviate | omitted.

  Similar to the first embodiment, when the operator inputs the patient ID of the patient (step S1), the endoscope processor 200 acquires the patient data of the patient corresponding to the patient ID, and the past observation image Is displayed (step S2).

  When an image of a part to be observed this time is selected from past observation images displayed in a list (step S3), the image compositing unit 230 of the endoscope processor 200 is selected as an endoscope image being photographed. The endoscopic images are superimposed at a predetermined ratio. The operator may have means for changing the ratio at the time of superimposing images.

  The image processing unit 224 performs image processing so that the superimposed endoscopic image and the tomographic image being captured are displayed side by side. The image signal is output to the monitor device 500 via the video output unit 248, and the superimposed endoscopic image and the tomographic image being captured are displayed superimposed on the monitor device 500 (step S11).

  FIG. 11 is an example of a diagram showing a display on monitor device 500 in the present embodiment. The monitor device 500 according to the present embodiment includes a tomographic image 512 being imaged, an image 532 in which an endoscope image being imaged and a past endoscope image are superimposed, and positional information of current and past endoscopes. 534 are displayed side by side. Similar to the first embodiment, an endoscope image captured in the past is combined with an index 521 indicating the acquisition range of a plurality of tomographic images that is the basis of the three-dimensional image, Since the trajectory 511 of the aiming light Le is reflected in the endoscopic image, the superimposed image 532 includes the index 521 and the trajectory 511 of the aiming light Le.

  By operating the OCT probe 600 and aligning the trajectory 511 of the aiming light Le with the end portion of the index 521, the surgeon can reliably perform alignment.

  After the alignment, the surgeon performs main imaging of a plurality of tomographic images and an endoscopic image for obtaining a three-dimensional image (step S5). The OCT processor 400 generates a three-dimensional image using the acquired tomographic images as volume data (step S6). In addition, the endoscope processor 200 synthesizes an index indicating the acquired range of a plurality of tomographic images with the actually captured endoscope image (step S7).

  The three-dimensional volume data, the endoscopic image, and the position information of the main imaging are recorded in the database 716 of the image server 700 in association with the patient ID and the imaging date (step S8).

  As described above, the endoscopic image being photographed and the endoscopic image photographed in the past are displayed so as to be easily aligned with the OCT probe.

  The operator selects between the case where the endoscope images in the past and the photographing in the first embodiment are displayed side by side and the case in which the endoscope images in the past and the photographing in the second embodiment are displayed in an overlapping manner. Possible means may be provided. In this case, it is desirable to enable switching even during acquisition of an endoscopic image and a tomographic image.

<Third Embodiment>
In the third embodiment, a feature portion is extracted from an endoscopic image, and the extracted feature portion is highlighted.

  FIG. 12 is a flowchart showing the operation of the third embodiment of the diagnostic imaging system 1. In addition, the same code | symbol is attached | subjected to the part which is common in the flowchart shown in FIG. 8, and the detailed description is abbreviate | omitted.

  As before, when the surgeon inputs the patient ID of the patient (step S1), the endoscope processor 200 acquires the patient data of the patient corresponding to the patient ID and displays a list of past observation images. (Step S2).

  When an image of a part to be observed this time is selected from the list of past observation images displayed (step S3), the image processing unit 224 of the endoscope processor 200 branches from the selected endoscope image. Then, structural features such as protrusions in the living body and features such as the tip of the insertion portion 602 of the OCT probe 600 are extracted. Feature part extraction includes object extraction to extract the object area where the object exists, contour extraction to extract the contour of the object, feature part extraction to extract the feature part based on the feature parameter, color extraction to extract the color of the object, etc. Do by. Further, the image processing unit 224 generates an endoscopic image that emphasizes the extracted feature portion (step S21). In the image that emphasizes the feature portion, the outline of the feature portion is represented by a thick line. An image displaying only the extracted feature portion may be generated. Even in this case, the index 521 indicating the acquisition range of a plurality of tomographic images that is the basis of the three-dimensional image is displayed.

  Next, as for the endoscopic image being photographed, the feature portion is extracted in the same manner as the selected endoscopic image, and an image that emphasizes the feature portion is generated (step S22).

  The image processing unit 224 performs image processing for displaying these images side by side, and these images are displayed side by side on the monitor device 500 (step S4).

  FIG. 13 is an example of a diagram showing a display on monitor device 500 in the present embodiment. The monitor device 500 according to the present embodiment includes an image 540 in which a characteristic portion of an endoscopic image being captured is emphasized, a tomographic image 512 being captured, and a current endoscope obtained from an output signal of the position sensor 229. Position information 514, a three-dimensional image 522 generated by using a plurality of tomographic images taken in the past as volume data, and an endoscope imaged including a plurality of tomographic image acquisition ranges based on the three-dimensional image 522 An image 550 in which the feature part of the mirror image is emphasized and an endoscope position information 524 when the endoscope image in which the feature part is emphasized are acquired are displayed side by side.

  The surgeon operates the OCT probe 600 to feature the trajectory 511 of the aiming light Le reflected in the image 540 in which the characteristic portion of the endoscopic image being photographed is emphasized. In step S5, a plurality of tomographic images and an endoscopic image for obtaining a three-dimensional image are captured at the same position as the end portion of the index 521 displayed in the image 550 in which is emphasized. The OCT processor 400 generates a three-dimensional image using the acquired tomographic images as volume data (step S6). In addition, the endoscope processor 200 synthesizes an index indicating the acquired range of a plurality of tomographic images with the actually captured endoscope image (step S7).

  The three-dimensional volume data, the endoscopic image, and the position information of the main imaging are recorded in the database 716 of the image server 700 in association with the patient ID and the imaging date (step S8).

  As described above, by displaying the image in which the characteristic part of the endoscopic image being captured is emphasized and the image in which the characteristic part of the endoscopic image captured in the past is emphasized on the same screen, the OCT probe can be displayed. Positioning becomes easy.

  As in the second embodiment, the display of the image in which the characteristic part is emphasized may be displayed in an overlapping manner, or means that allows the operator to select whether to display the images side by side or in an overlapping manner. May be provided.

<Display of acquired 3D image>
FIG. 15 shows a three-dimensional image 570 in which a plurality of optical tomographic images acquired in the first to third embodiments are generated as three-dimensional volume data, and a past acquired from the database 716 when the three-dimensional image 570 is acquired. FIG. 6 is an example of a diagram showing a state where a three-dimensional image 522 generated by generating a plurality of optical tomographic images as three-dimensional volume data is displayed on the same screen of the monitor device 500.

  The diagnostic imaging apparatus 10 of the present invention can display these two three-dimensional images in the same viewing direction (projection direction). Further, the image processor 224 of the endoscope processor 200 can cut out any same cross section from these three-dimensional images and display the cross section in response to an input from the operation unit 254.

  In the example of FIG. 15, the three-dimensional image 570 and the three-dimensional image 522 are displayed in the same line-of-sight direction, and the cut surfaces 571 and 572 in the same cross section 573 are displayed.

  The surgeon can observe the change in the affected area by confirming these images.

FIG. 1 is an example of a block diagram of an image diagnostic system 1 according to the present invention. FIG. 2 is an example of an external view showing the diagnostic imaging apparatus 10 according to the present invention. FIG. 3 is an example of a block diagram illustrating an internal configuration of the endoscope 100, the endoscope processor 200, and the light source device 300. FIG. 4 is an example of a block diagram showing the internal configuration of the OCT processor 400 and the OCT probe 600. FIG. 5 is an example of a partial cross-sectional view showing the distal end portion of the insertion portion 602 of the OCT probe 600 in an enlarged manner. FIG. 6 is an example of a block diagram showing the internal configuration of the image server 700. FIG. 7 is an example of a block diagram showing the internal configuration of the image server 700. FIG. 8 is a flowchart showing the operation of the first embodiment of the diagnostic imaging system 1. FIG. 9 is an example of a diagram illustrating a display of the monitor device 500 according to the first embodiment. FIG. 10 is a flowchart showing the operation of the second embodiment of the diagnostic imaging system 1. FIG. 11 is an example of a diagram illustrating a display of the monitor device 500 according to the second embodiment. FIG. 12 is a flowchart showing the operation of the third embodiment of the diagnostic imaging system 1. FIG. 13 is an example of a diagram illustrating a display of the monitor device 500 according to the third embodiment. FIG. 14 is an example of a diagram illustrating a state in which a tomographic image is obtained using the OCT probe 600 derived from the forceps opening 156 of the endoscope 100. FIG. 15 is an example of a diagram showing the acquired three-dimensional image 550 and the past three-dimensional image 522 displayed on the same screen of the monitor device 500. FIG. 16 is an example of a diagram illustrating the measurement position mark 640. FIG. 17 is an example of a diagram illustrating a state where a plurality of tomographic images in a desired range are acquired by extracting the insertion unit 602 by a predetermined amount.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Image diagnostic system, 10 ... Image diagnostic apparatus, 100 ... Endoscope, 138 ... Forceps insertion part, 156 ... Forceps opening, 200 ... Endoscope processor, 230 ... Image composition part, 300 ... Light source device, 400 ... OCT Processor, 500 ... Monitor device, 510 ... Endoscopic image being photographed, 511 ... Trace of aiming light Le, 512 ... Tomographic image being photographed, 514 ... Position information of endoscopic image 510, 520 ... Photo taken in the past Endoscopic image, 521... Index, 522... Three-dimensional image generated by using a plurality of tomographic images taken in the past as volume data, 524. Position information of endoscopic image 520, 532. An image in which an image and a past endoscopic image are superimposed, 600 ... an OCT probe, 640 ... a measurement position mark, 700 ... an image server

Claims (19)

Endoscopic image acquisition means for acquiring an endoscopic image in a body cavity using an imaging device provided in the endoscope;
Optical tomographic image acquisition for acquiring an optical tomographic image of a measurement object from interference light obtained by irradiating the measurement light from the optical probe inserted through the forceps opening of the endoscope and combining the reflected light reflected from the measurement object and the reference light Means,
A plurality of past optical tomographic images acquired in a predetermined range within a body cavity, and a past endoscopic image acquired by the endoscopic image acquiring means when acquiring the plurality of past optical tomographic images, Storage means for associating and storing past endoscopic images including an index indicating an acquisition range of the past plurality of optical tomographic images;
Reading means for reading the past endoscopic image from the storage means;
Display control means for displaying a current endoscopic image acquired by the endoscopic image acquisition means and a past endoscopic image read by the reading means in a manner that can be compared with the display means;
An optical tomographic image acquisition apparatus comprising:   The optical tomographic image acquisition apparatus according to claim 1, wherein the display control unit displays the current endoscopic image and the past endoscopic image side by side on the display unit.   2. The optical tomographic image according to claim 1, wherein the display control unit causes the display unit to display the current endoscopic image and the past endoscopic image so as to overlap each other at a first ratio. Acquisition device.   The optical tomographic image acquisition apparatus according to claim 3, further comprising means for changing the first ratio.   The display control means comprises means for selecting whether to display the current endoscopic image and the past endoscopic image side by side or to overlap and display at a first ratio. The optical tomographic image acquisition apparatus according to claim 3 or 4. Means for extracting characteristic portions of the first endoscopic image and the second endoscopic image;
Means for image processing the first endoscopic image and the second endoscopic image so that the extracted feature portion is highlighted or displayed, or only the extracted feature portion is displayed;
The optical tomographic image acquisition apparatus according to any one of claims 1 to 5, further comprising:   The means for extracting the characteristic portions of the first endoscope image and the second endoscope image is an object extracting means for extracting an object region where an object is present, an outline extracting means for extracting the contour of an object, and a feature The optical tomographic image acquisition apparatus according to claim 6, comprising at least one of a feature part extraction unit that extracts a feature part based on a parameter and a color extraction unit that extracts a color of an object. The reading means reads the past optical tomographic images from the storage means,
Means for generating a stereoscopic image based on the plurality of past optical tomographic images read out;
The light according to claim 1, wherein the display control unit causes the display unit to display a current optical tomographic image acquired by the optical tomographic image acquisition unit and the stereoscopic image. Tomographic image acquisition device.   The optical tomographic image acquisition apparatus according to claim 8, wherein the display control unit displays the current optical tomographic image and the stereoscopic image side by side on the display unit. The storage means stores past position information indicating the position of the endoscope at the time of acquiring the past endoscopic image and the past endoscopic image in association with each other,
The reading means reads the past position information from the storage means,
The optical tomographic image acquisition apparatus according to claim 1, wherein the display control unit displays the past position information on the display unit. Means for obtaining current position information indicating the position of the current endoscope;
The optical tomographic image acquisition apparatus according to claim 1, wherein the display control unit displays the current position information on the display unit. A means for designating the person to be observed;
The readout means reads out all the endoscopic images of the designated observer from the storage means,
The display control means causes the display means to display a list of all the read endoscope images,
12. The optical tomographic image acquisition apparatus according to claim 1, further comprising means for selecting the past endoscopic image from the list-displayed endoscopic images. A range extracting means for extracting an acquisition range of the plurality of optical tomographic images from an endoscopic image at the time of acquisition of the plurality of optical tomographic images;
Means for synthesizing an index indicating the extracted acquisition position with the endoscopic image;
13. The optical tomographic image acquisition apparatus according to claim 1, further comprising a storage control unit that stores the plurality of optical tomographic images and the endoscopic image in association with each other in a storage unit. The optical probe emits aiming light which is visible light at a measurement position together with low coherence light,
The optical tomographic image acquisition apparatus according to claim 13, wherein the range extracting unit extracts an acquisition range of the plurality of optical tomographic images by tracing a trajectory of the aiming light.   The optical tomographic image according to claim 13, wherein an acquisition range of the plurality of optical tomographic images is extracted based on a measurement position mark movement trajectory applied to the optical probe and a measurement width of the optical tomographic image. Acquisition device.   16. The storage control unit according to claim 1, wherein the storage control unit stores position information indicating an acquisition position of the endoscopic image in the storage unit in association with the past endoscopic image. Optical tomographic image acquisition device.   The display control unit is based on a past stereoscopic image generated based on a plurality of past optical tomographic images read from the storage unit and a plurality of optical tomographic images acquired by the optical tomographic image acquiring unit. 17. The optical tomographic image acquisition apparatus according to claim 8, wherein the current stereoscopic image generated in this way is displayed on a display unit so as to be comparable. Means for extracting a cross-sectional image of an arbitrary cutting plane from the past stereoscopic image and the current stereoscopic image;
The optical tomographic image acquisition apparatus according to claim 17, wherein the display control unit displays the extracted cross-sectional image on a display unit. An endoscopic image acquisition step of acquiring an endoscopic image in a body cavity using an imaging device provided in the endoscope;
An optical tomographic image acquisition step of acquiring an optical tomographic image based on the reflected light of the light emitted from the optical probe inserted through the forceps opening of the endoscope;
A plurality of past optical tomographic images acquired in a predetermined range within a body cavity, and a past endoscopic image acquired by the endoscopic image acquiring means when acquiring the plurality of past optical tomographic images, A step of reading out the past endoscopic image from storage means for storing the past endoscopic image including an index indicating an acquisition range of the past plural optical tomographic images;
A display control step of displaying a current endoscopic image acquired by the endoscopic image acquisition step and a past endoscopic image read out by the read-out step so that the display means can be compared with each other;
An optical tomographic image acquisition method comprising:

Images