JP6843672B2 - Processing equipment, endoscopic system, operating method of processing equipment and computer programs - Google Patents

Description

The present invention relates to a processing device, an endoscopic system, an operating method of the processing device, and a computer program.

An endoscope system (see, for example, Patent Document 1) has been proposed in which an image of the inside of a body taken by an image sensor included in an endoscope is displayed on a monitor. In the endoscope system described in Patent Document 1, the flexible tube of the endoscope is inserted into the body. The processing device emits light, and the light emitted by the processing device is emitted from the tip surface of the flexible tube inserted in the body.

An image pickup element is provided on the tip surface of the flexible tube, and the image pickup element captures an image of the inside of the body by using the light emitted from the inside of the body by the processing device through the flexible tube. The data related to the image taken by the image sensor is acquired by the processing device. The processing device performs image processing on the acquired data and outputs the image-processed data to the monitor. The monitor displays an image related to the data input from the processing device, that is, an image taken by the image sensor.

Japanese Unexamined Patent Publication No. 2012-65945

In a conventional endoscope system as described in Patent Document 1, a forceps opening is provided in the endoscope, and the forceps opening communicates with an opening provided in the tip surface of a flexible tube. ..

For example, a laser probe connected to an optical fiber is inserted into the forceps opening. The laser probe emits laser light in the body. The laser beam irradiates, for example, a tumor in the body. In the tumor, the part irradiated with the laser beam dies. At this time, it is preferable that appropriate treatment is performed so that the portion irradiated with the laser beam in the body substantially coincides with the tumor.

Further, in the image taken by the image sensor, there is usually a part that is not clearly captured because the intensity of the light emitted from the processing device into the body is weak. As the image captured by the image sensor, it is preferable that the image has few parts that are not clearly captured.

The present invention has been made in view of such circumstances, and an object of the present invention is to operate a processing device, an endoscope system, and a processing device capable of performing appropriate treatment or taking an appropriate image. To provide methods and computer programs.

The processing device according to one aspect of the present invention is a processing device that performs image processing related to an image in the body taken by an image sensor having a plurality of pixels, and is a light source that emits light into the body and the plurality of pixels. Each includes an acquisition unit that sequentially acquires pixel data related to images taken by each, and a determination unit that determines whether or not the light source should emit light each time the acquisition unit acquires pixel data.

The endoscope system according to one aspect of the present invention includes the above-mentioned processing device and an endoscope having the image pickup element.

The method of operating the processing device according to one aspect of the present invention is a method of operating the processing device that performs image processing, and is a step of sequentially acquiring pixel data related to an image in the body taken by each of a plurality of pixels of the image sensor. The processing device executes the step of determining whether or not the light source should emit light into the body each time the pixel data is acquired.

A computer program according to an embodiment of the present invention, each time the each of the plurality of pixels each having the imaging device sequentially acquires the pixel data of the image of the body captured to obtain the image prime over data, light source light to the body Let the computer execute the process of determining whether or not to output.

According to the above aspect, it is possible to take an appropriate treatment or an appropriate image.

It is explanatory drawing of the endoscope system in Embodiment 1. FIG. It is an external view of the image sensor. It is explanatory drawing of the structure of the E / O converter and the O / E converter. It is sectional drawing of a laser probe. It is explanatory drawing of the change of the irradiation part of a laser beam. It is a flowchart which shows the procedure of the emission control processing. It is a flowchart which shows the procedure of the emission control processing in Embodiment 2. It is explanatory drawing of the endoscope system in Embodiment 3. FIG.

Specific examples of the endoscope system according to the embodiment of the present invention will be described below with reference to the drawings.
(Embodiment 1)
FIG. 1 is an explanatory diagram of the endoscope system 1 according to the first embodiment. The endoscope system 1 includes an endoscope 10, a light guide 11, a monitor 12, and a processing device 13. The endoscope 10, the light guide 11, and the monitor 12 are each detachably connected to the processing device 13.

The endoscope 10 has an elongated flexible tube 10a. The flexible tube 10a is inserted into the human body. The processing device 13 emits light containing a wavelength component in the visible light region (hereinafter referred to as lamp light) into the body through the flexible tube 10a of the endoscope 10. Specifically, the lamp light is emitted from the tip surface of the flexible tube 10a. The endoscope 10 uses the lamp light emitted by the processing device 13 to take an image of the inside of the body, and outputs data related to the taken image to the processing device 13. The processing device 13 performs image processing on the data input from the endoscope 10, and outputs the processed data to the monitor 12. The monitor 12 displays an image related to the data input from the processing device 13, that is, an image taken by the endoscope 10. Since the lamp light has low directivity, the range in which the lamp light is irradiated is wide in the body.

The light guide 11 includes a laser probe 20, a connector 21, a connecting tube 22, and an optical fiber 23. The laser probe 20 and the connector 21 are connected by a connecting tube 22. The optical fiber 23 is inserted through the connecting tube 22 and connects the laser probe 20 and the connector 21. The connecting tube 22 and the optical fiber 23 have flexibility.

The endoscope 10 is provided with an insertion port 10b into which the laser probe 20 is inserted. The insertion port 10b communicates with the opening 10c provided on the tip surface of the flexible tube 10a. The laser probe 20 is arranged in the endoscope 10 in the vicinity of the opening 10c or in a place outside the opening 10c.

The connector 21 is detachably connected to the processing device 13. In addition to the lamp light, the processing device 13 also emits laser light having high directivity. The laser beam is incident on the optical fiber 23 via the connector 21. The optical fiber 23 guides the laser light to the laser probe 20. The laser probe 20 emits light guided by the optical fiber 23 into the body.
As described above, the processing device 13 emits the laser beam into the body via the light guide 11.

The processing device 13 includes a system controller 30, a lamp drive unit 31, a lamp 32, a condenser lens 33, a light guide 34, and a connector 35. The system controller 30 is connected to the lamp drive unit 31, and the lamp drive unit 31 is connected to the lamp 32.

The lamp driving unit 31 causes the lamp 32 to emit the lamp light and stop the emission of the lamp light according to the instruction of the system controller 30. The lamp 32 emits lamp light toward the condenser lens 33. The condenser lens 33 collects the lamp light emitted by the lamp 32. The lamp light collected by the condenser lens 33 is incident on the light guide 34 from one end surface of the light guide 34. The other end of the light guide 34 is connected to the connector 35.

The endoscope 10 further includes a connector 50, a light guide 51, and a light distribution lens 52. The connector 50 is connected to one end of the light guide 51, and the light distribution lens 52 is installed on the tip surface of the flexible tube 10a of the endoscope 10. The connector 50 is detachably connected to the connector 35 of the processing device 13. When the connector 50 is connected to the connector 35, the light guides 34 and 51 guide the lamp light incident on one end surface of the light guide 34, and distribute the guided lamp light from the other end surface of the light guide 51. It emits light toward the optical lens 52. The light guide 51 is flexible. The light distribution lens 52 irradiates the body with light incident from the other end surface of the light guide 51.
As described above, the lamp 32 emits the lamp light into the body via the light guides 34 and 51.

The endoscope 10 further includes an objective lens 53, an image pickup element 54, an element drive unit 55, and a memory 56. The element drive unit 55 is separately connected to the image pickup element 54, the memory 56, and the system controller 30 of the processing device 13. The lamp light emitted from the light distribution lens 52 is reflected in the body. The reflected lamp light is incident on the image sensor 54 via the objective lens 53.

FIG. 2 is an external view of the image sensor 54. The image pickup device 54 has a light receiving surface 54a that receives lamp light via the objective lens 53. On the light receiving surface 54a, a plurality of pixels P, P, ... Are arranged in a matrix of M rows and N columns. Each of M and N is an integer of 2 or more. Each pixel P has a rectangular shape. When the lamp light reflected in the body is incident on the light receiving surface 54a of the image sensor 54 via the objective lens 53, an image inside the body is formed on the light receiving surface 54a.

The plurality of pixels P, P, ... Each of the plurality of pixels P, P, ... Of the image sensor 54 are driven by the element drive unit 55. The element driving unit 55 causes a plurality of pixels P, P, ..., Each of which sequentially captures an image of the inside of the body. Specifically, first, the element driving unit 55 causes the pixels P to photograph the inside of the N pixels P, P, ... In the first row in order from the left. Next, the element driving unit 55 causes the pixels P to photograph the inside of the N pixels P, P, ... In the second row in order from the left. Next, the element driving unit 55 causes the pixels P to photograph the inside of the N pixels P, P, ... In the third row in order from the left. Hereinafter, similarly, the element driving unit 55 causes the pixels P, P, ... In the 4th to Mth rows to sequentially photograph the inside of the body.

As described above, the plurality of pixels P, P, ... Each of the plurality of pixels P, P, ... ..

Each of the plurality of pixels P, P, ... Of the image pickup device 54 outputs pixel data related to the image taken by itself to the element drive unit 55 each time the inside of the body is photographed. The pixel data indicates the color, brightness, and the like of the image taken by the pixel P corresponding to itself. The (MN) pixel data output from the pixels P, P, ... Arranged in a matrix of M rows and N columns is pixel data for one frame. The "・" in (MN) represents the product. The element driving unit 55 causes pixels P, P, ... Arranged in a matrix of M rows and N columns to output pixel data for one frame at predetermined time intervals. The predetermined time interval is (1/60) seconds, (1/30) seconds, or the like.

The color indicated by the pixel data is a color composed of at least one of a plurality of basic colors. One example of the plurality of basic colors is magenta, yellow and cyan, and another example of the plurality of basic colors is red, green and blue.
In the pixel data, the data indicating the color indicates the light intensity ratio related to the basic color, for example, the light intensity ratio related to magenta, yellow and cyan, or the light intensity ratio related to red, green and blue. It may be data.

The element driving unit 55 outputs the input pixel data to the processing device 13 each time pixel data is input from the image sensor 54. The memory 56 stores specification data indicating the specifications (resolution, type, etc.) of the endoscope 10. When the endoscope 10 is connected to the processing device 13, the element driving unit 55 notifies the system controller 30 of the processing device 13 of the specification data stored in the memory 56. The system controller 30 operates according to the specification data. Further, when the element driving unit 55 starts shooting an image related to pixel data for one frame, the element driving unit 55 notifies the system controller 30 of the start of shooting. Therefore, the start of shooting is notified at predetermined time intervals.

The processing device 13 further includes a first processing unit 36, an E / O converter 37, an optical fiber 38, an O / E converter 39, a second processing unit 40, and a timing controller 41. The element driving unit 55 is further connected to the first processing unit 36. The first processing unit 36 is connected to the E / O converter 37. The E / O converter 37 is connected to the O / E converter 39 by an optical fiber 38. The O / E converter 39 is connected to the second processing unit 40. The second processing unit 40 is further connected to the monitor 12. The timing controller 41 is separately connected to the system controller 30 and the element drive unit 55.

Pixel data is input to the first processing unit 36 from the element driving unit 55. The first processing unit 36 performs image processing on the pixel data each time pixel data is input from the element driving unit 55, and outputs the processed pixel data to the E / O converter 37. Each time the electric pixel data is input from the first processing unit 36, the E / O converter 37 converts the input electric pixel data into optical pixel data, and converts the converted optical pixel data into an optical fiber. It is transmitted to the O / E converter 39 via 38.

Each time the O / E converter 39 receives light pixel data from the E / O converter 37, the received light pixel data is converted into electrical pixel data, and the converted pixel data is sent to the second processing unit 40. Output. The second processing unit 40 performs image processing on the input pixel data each time pixel data is input from the O / E converter 39, and outputs the processed pixel data to the monitor 12 and the system controller 30 respectively. Output. The monitor 12 displays an image related to the pixel data for one frame, that is, an image captured by the image sensor 54, each time the pixel data for one frame is input from the second processing unit 40.
The system controller 30 sequentially acquires pixel data related to images captured by a plurality of pixels P, P, ... From the second processing unit 40. The system controller 30 functions as an acquisition unit.

FIG. 3 is an explanatory diagram of the configuration of the E / O converter 37 and the O / E converter 39. The E / O converter 37 has a laser diode 37a and a V / I converter 37b. Both ends of the laser diode 37a are separately connected to the V / I conversion unit 37b. The V / I conversion unit 37b adjusts the value of the current supplied to the laser diode 37a according to the pixel data of electricity input from the first processing unit 36.

When a current is supplied to the laser diode 37a, the laser diode 37a emits a laser beam. The laser diode 37a is, for example, a vertical cavity surface emitting laser (VICSEL). The excitation wavelength of the laser light emitted by the laser diode 37a is 1.55 μm, 1.3 μm, or the like. It should be noted that these wavelengths are wavelengths when it is assumed that the medium through which light propagates is a vacuum.

The intensity of the laser light emitted from the laser diode 37a is substantially proportional to the value of the current supplied to the laser diode 37a. The V / I conversion unit 37b adjusts the value of the current supplied to the laser diode 37a according to the pixel data of electricity, and the intensity of the laser light emitted by the laser diode 37a is the current supplied from the V / I conversion unit 37b. It is adjusted according to the value of.

As described above, the V / I conversion unit 37b modulates the intensity of the laser light emitted by the laser diode 37a according to the pixel data input from the first processing unit 36. As a result, the electric pixel data is converted into the optical pixel data. The laser beam emitted by the laser diode 37a is incident on the optical fiber 38 from one end surface of the optical fiber 38 using a lens (not shown) or the like, and propagates through the optical fiber 38. The laser diode 37a transmits optical pixel data to the O / E converter 39 via the optical fiber 38.

The O / E converter 39 has a photodiode 39a and an I / V converter 39b. The light propagating through the optical fiber 38 is incident on the photodiode 39a from the other end surface of the optical fiber 38. The photodiode 39a is, for example, a PIN photodiode, and receives pixel data of light transmitted by the laser diode 37a. The photodiode 39a is biased in the opposite direction.

When light is incident on the photodiode 39a from the other end surface of the optical fiber 38, the photodiode 39a supplies a current to the I / V conversion unit 39b. The value of the current supplied by the photodiode 39a increases as the intensity of the light incident on the photodiode 39a increases. The I / V conversion unit 39b outputs a voltage to the second processing unit 40. The value of the voltage output by the I / V conversion unit 39b is higher as the value of the current supplied to the I / V conversion unit 39b is larger.

As described above, the I / V conversion unit 39b outputs a voltage corresponding to the intensity of the light incident on the photodiode 39a from the optical fiber 38. As a result, the light pixel data received by the photodiode 39a is converted into electrical pixel data by the I / V conversion unit 39b, and the converted pixel data is output from the I / V conversion unit 39b to the second processing unit 40. To.

The processing device 13 converts the electric pixel data into the light pixel data, and returns the converted light pixel data to the electric pixel data. Thereby, the ground potential of the voltage related to the pixel data of electricity can be changed.

The timing controller 41 shown in FIG. 1 outputs a clock signal to the element drive unit 55 included in the endoscope 10. The clock signal is composed of a high level voltage and a low level voltage, and the voltage indicated by the clock signal periodically switches from the low level voltage to the high level voltage. Each time the voltage indicated by the clock signal is switched from the low level voltage to the high level voltage, the element drive unit 55 executes the process. The timing controller 41 adjusts the timing at which the voltage indicated by the clock signal is switched from the low level voltage to the high level voltage, the cycle of the clock signal, and the like according to the instruction of the system controller 30.

The processing device 13 further includes an LD drive unit 42, an LD module 43, an optical fiber 44, and a connector 45. The LD drive unit 42 is connected to the system controller 30 and the LD module 43. The LD module 43 and the connector 45 are connected by an optical fiber 44.

The LD drive unit 42 causes the LD module 43 to emit the laser beam and stop the emission of the laser beam according to the instruction of the system controller 30. Further, the LD drive unit 42 adjusts the intensity of the laser beam emitted by the LD module 43. The connector 45 of the processing device 13 is detachably connected to the connector 21 of the light guide 11. When the connector 45 is connected to the connector 21, when the LD module 43 emits a laser beam, the laser beam emitted by the LD module 43 is guided to the laser probe 20 by the optical fibers 23 and 44. As described above, the laser probe 20 emits the laser light guided by the optical fiber 23 into the body. The laser probe 20 is fixed, for example, in the vicinity of the opening 10c in the flexible tube 10a of the endoscope 10 or in a place out of the opening 10c.

As described above, the LD module 43 emits laser light into the body via the optical fibers 23 and 44 and the laser probe 20. The LD module 43 functions as a light source.
The excitation wavelength of the laser beam emitted by the LD module 43 is, for example, 630 nm. This wavelength is also a wavelength when it is assumed that the medium through which light propagates is a vacuum.

FIG. 4 is a cross-sectional view of the laser probe 20. The laser probe 20 has a tubular body 20a whose both end faces are open. The optical fiber 23 is inserted from one end of the tubular body 20a. An exit lens 20b is provided in the vicinity of the other end of the cylinder 20a. The laser light emitted from the end surface of the optical fiber 23 is emitted to the outside of the laser probe 20 via the emitting lens 20b. In the tubular body 20a, the direction changing unit 20c is attached to the optical fiber 23.

The direction changing unit 20c has, for example, a piezoelectric element. The direction changing unit 20c changes the direction of the light emitted from the optical fiber 23 by changing the direction of the end face of the optical fiber 23 from which the laser beam is emitted. The operation of the direction changing unit 20c is controlled by, for example, the system controller 30. In this case, the direction changing unit 20c is connected to the system controller 30, and the connecting line connecting the direction changing unit 20c and the system controller 30 is inserted in the connecting pipe 22.

FIG. 5 is an explanatory diagram of changing the irradiation portion of the laser beam. In FIG. 5, a plurality of pixels P, P, ... Photographed by each of the plurality of pixels P, P, ... Tumor E is indicated by a thick line. As described above, since the plurality of pixels P, P, ... Are arranged in a matrix of M rows and N columns, the plurality of photographing portions T, T, ... Are also a matrix of M rows and N columns. It is arranged in a shape. As described above, since each pixel P has a rectangular shape, each photographing portion T also has a rectangular shape.

Pixels P, P, ... Arranged in the first row of the image sensor 54 form N imaging portions T, T, ... In the first row, as indicated by arrows. Take pictures in order from the left. Next, the pixels P, P, ... Arranged in the second row also have the N shooting portions T, T, ... In the second row on the left, as indicated by the arrows. Take pictures in order from. Next, the pixels P, P, ... Arranged in the third row also photograph the N photographing portions T, T, ... In the third row in order from the left. Hereinafter, similarly, the pixels P, P, ... In the 4th to Mth rows photograph the photographing portions T, T, ... In the 4th to Mth rows.

The direction changing unit 20c changes the portion irradiated with the laser beam each time the system controller 30 acquires pixel data from the second processing unit 40, and the portion irradiated with the laser beam is the pixel acquired by the system controller 30. It coincides with or substantially matches the photographed portion T shown in the image related to the data.

Therefore, the portion irradiated with the laser beam is first changed in order from the left with respect to the photographing portions T, T, ... In the first row. Next, the portion irradiated with the laser beam is changed in order from the left with respect to the photographing portions T, T, ... In the second row. Next, the portion irradiated with the laser beam is changed in order from the left with respect to the photographing portions T, T, ... In the third row. Hereinafter, similarly, the portion irradiated with the laser beam is changed to the photographing portions T, T, ... In the 4th to Mth rows.

As shown in FIG. 1, the processing device 13 further has a memory 46. The memory 46 is connected to the system controller 30. The computer program A1 is stored in the memory 46. The system controller 30 has a CPU (Central Processing Unit) (not shown), and the CPU of the system controller 30 executes various processes by executing the computer program A1. The system controller 30 instructs the lamp driving unit 31 to control the operation of the lamp 32. Further, the system controller 30 instructs the timing controller 41 to adjust the timing at which the voltage indicated by the clock signal is switched from the low level voltage to the high level voltage, the cycle of the clock signal, or the like.

Further, the CPU of the system controller 30 executes the emission control process related to the emission of the LD module 43 by executing the computer program A1. The computer program A1 is used to cause the CPU (computer) to execute the emission control process.

The computer program A1 may be stored in the storage medium B1 so that the computer can read it. In this case, the computer program A1 read from the storage medium B1 by a reading device (not shown) is stored in the memory 46. The storage medium B1 is an optical disk, a flexible disk, a magnetic disk, a magnetic optical disk, a semiconductor memory, or the like. The optical disk is a CD (Compact Disc) -ROM (Read Only Memory), a DVD (Digital Versatile Disc) -ROM, or a BD (Blu-ray (registered trademark) Disc). The magnetic disk is, for example, a hard disk. Further, the computer program A1 may be downloaded from an external device (not shown) connected to a communication network (not shown), and the downloaded computer program A1 may be stored in the memory 46.

FIG. 6 is a flowchart showing the procedure of the emission control process. When the element drive unit 55 notifies the start of shooting, the system controller 30 starts the emission control process. The emission control process is executed in a state where the lamp 32 emits lamp light. As described above, the system controller 30 acquires pixel data from the second processing unit 40. Further, the portion irradiated with the laser beam coincides with or substantially coincides with the photographing portion T shown in the image related to the pixel data acquired by the system controller 30.
In the following, it is assumed that the drug is administered to a patient into which the flexible tube 10a of the endoscope 10 is inserted, and the color of the tumor E in the body changes to a specific color, for example, orange. When the tumor E is irradiated with the laser beam, the portion of the tumor E irradiated with the laser beam dies.

In the emission control process, first, the system controller 30 determines whether or not the pixel data has been acquired from the second processing unit 40 (step S1). When the system controller 30 determines that the pixel data has not been acquired (S1: NO), the system controller 30 executes step S1 again and waits until the pixel data is output from the second processing unit 40 to the system controller 30.

When the system controller 30 determines that the pixel data has been acquired (S1: YES), the system controller 30 determines whether or not the LD module 43 should emit the laser beam (step S2). In step S2, the system controller 30 determines that the LD module 43 should emit laser light when the color indicated by the acquired pixel data, that is, the color of the image related to the acquired pixel data is a specific color. When the color indicated by the acquired pixel data is not a specific color, it is determined that the LD module 43 should not emit the laser beam. The system controller 30 also functions as a determination unit.

When the system controller 30 determines that the LD module 43 should emit the laser beam (S2: YES), the system controller 30 determines the intensity of the laser beam emitted by the LD module 43 (step S3). In step S3, for example, the system controller 30 determines the intensity of the laser beam to be stronger as the brightness indicated by the pixel data acquired from the second processing unit 40 is lower. For example, when the specific color is orange and the color indicated by the pixel data is light orange, the intensity of the laser beam is determined to be weak. In the same case, when the color indicated by the pixel data is dark orange, the intensity of the laser beam is determined to be strong. The system controller 30 also functions as a determination unit.

Next, the system controller 30 instructs the LD drive unit 42 to emit the laser beam whose intensity is the intensity determined in step S3 (step S4). As a result, the LD drive unit 42 causes the LD module 43 to emit laser light whose intensity is the intensity determined in step S3. As a result, the laser beam is applied to the photographing portion T in the image related to the pixel data used in the determination in step S2.

Next, the system controller 30 uses, for example, a timer (not shown) to determine whether or not a predetermined time has elapsed since the execution of step S4 (step S5). When the system controller 30 determines that the predetermined time has not elapsed (S5: NO), the system controller 30 executes step S5 again and waits until the predetermined time elapses. When the system controller 30 determines that the predetermined time has elapsed (S5: YES), the system controller 30 instructs the LD drive unit 42 to stop the emission of the laser beam (step S6). As a result, the LD module 43 stops emitting the laser beam.

When the system controller 30 determines that the LD module 43 should not emit the laser beam (S2: NO), or after executing step S6, the pixel data for one frame after starting the emission control process. Is determined (step S7). When it is determined that the pixel data for one frame has not been acquired (S7: NO), the system controller 30 executes step S1. Whether or not the LD module 43 should emit laser light in step S2 each time the system controller 30 determines that the pixel data has been acquired from the second processing unit 40 in step S1 until the pixel data for one frame is acquired. Is determined.
When it is determined that the pixel data for one frame has been acquired (S7: YES), the system controller 30 ends the emission control process.

In the endoscope system 1, the number of pixels P included in the image pickup device 54 of the endoscope 10 is usually large, so that the area of the photographing portion T is small. As described above, the portion irradiated with the laser beam coincides with or substantially coincides with the photographing portion T shown in the image related to the pixel data acquired by the system controller 30. As a result, for example, the portion irradiated by the LD module 43 in the body substantially coincides with the tumor E (see FIG. 5), and appropriate treatment is performed.

Further, since the intensity of the laser beam emitted by the LD module 43 is determined based on the pixel data acquired by the system controller 30, more appropriate measures are taken.
Further, in step S2 of the emission control process, the system controller 30 causes the LD module 43 to emit laser light based on whether or not the color of the image related to the pixel data acquired from the second processing unit 40 is a specific color. Determine if it should be emitted. Therefore, the tumor E is accurately irradiated with the laser beam.

(Embodiment 2)
In the first embodiment, the laser beam emitted by the LD module 43 is used to kill the tumor E. However, the use of the laser beam emitted by the LD module 43 is not limited to the use of killing the tumor E.
Hereinafter, the difference between the second embodiment and the first embodiment will be described. Since the other configurations other than the configurations described later are common to the first embodiment, the same reference numerals as those of the first embodiment are assigned to the components common to the first embodiment, and the description thereof is omitted. To do.

In the second embodiment, the laser light emitted by the LD module 43 contains a wavelength component in the visible light region. Further, the memory 46 stores pixel data for one frame previously acquired by the system controller 30 from the second processing unit 40. The system controller 30 executes the emission control process by executing the computer program A1 as in the first embodiment. In the second embodiment, the emission control process is executed for the purpose of causing the image sensor 54 to take an image having few parts that are not clearly captured.

FIG. 7 is a flowchart showing the procedure of the emission control process according to the second embodiment. Similar to the first embodiment, the system controller 30 starts the emission control process when the element drive unit 55 notifies the start of shooting. The emission control process is executed in a state where the lamp 32 emits lamp light. Further, the portion irradiated with the laser beam coincides with or substantially coincides with the photographing portion T shown in the image related to the pixel data acquired by the system controller 30.

In the emission control process, first, the system controller 30 reads out the previous pixel data taken by the taking pixel, which is the pixel P that executes the image acquisition (step S11). Next, the system controller 30 determines whether or not the LD module 43 should emit the laser beam based on the pixel data read in step S11 (step S12).

When the system controller 30 determines that the LD module 43 should emit the laser beam (S12: YES), the system controller 30 determines the intensity of the laser beam emitted by the LD module 43 (step S13). For example, the system controller 30 determines the intensity of the laser beam to be stronger as the brightness indicated by the pixel data read in step S11 is smaller.

Next, the system controller 30 instructs the LD drive unit 42 to emit the laser beam whose intensity is the intensity determined in step S13 (step S14). As a result, the LD drive unit 42 causes the LD module 43 to emit the laser beam whose intensity is determined in step S13. As a result, the portion T photographed by the photographing pixel is irradiated with the lamp light and the laser light.

Next, the system controller 30 determines whether or not the pixel data related to the image captured by the captured pixels has been acquired from the second processing unit 40 (step S15). When the system controller 30 determines that the pixel data has not been acquired (S15: NO), the system controller 30 executes step S15 again, and the pixel data related to the image captured by the captured pixels is output from the second processing unit 40. Wait until. When the system controller 30 determines that the pixel data has been acquired (S15: YES), the system controller 30 instructs the LD drive unit 42 to stop the emission of the laser beam (step S16). As a result, the LD module 43 stops emitting the laser beam.
When the system controller 30 acquires from the second processing unit 40, the photographing pixel for which the next photographing is executed is changed to another pixel P by the element driving unit 55.

When the system controller 30 determines that the LD module 43 should not emit the laser beam (S12: NO), the system controller 30 determines whether or not the pixel data related to the image captured by the captured pixels has been acquired from the second processing unit 40. Determine (step S17). When the system controller 30 determines that the pixel data has not been acquired (S17: NO), the system controller 30 executes step S17 again, and the pixel data related to the image captured by the captured pixels is output from the second processing unit 40. Wait until. As described above, when the system controller 30 acquires from the second processing unit 40, the photographing pixel is changed to another pixel P.

After executing step S16, or when it is determined that the pixel data has been acquired (S17: YES), the system controller 30 stores the acquired pixel data in the memory 46 (step S18). The pixel data stored in the memory 46 is read out as the previous pixel data in the next emission control process. Next, the system controller 30 determines whether or not the pixel data for one frame has been acquired since the emission control process was started (step S19).

When it is determined that the pixel data for one frame has not been acquired (S19: NO), the system controller 30 executes step S11. In this step S11, the previous pixel data taken by the new shooting pixel is read out. When it is determined that the pixel data for one frame has been acquired (S19: YES), the system controller 30 ends the emission control process.

As described above, in the emission control process, the system controller 30 executes step S12 each time the pixel data is acquired from the second processing unit 40 unless the pixel data for one frame is acquired, and the next shooting is performed. It is determined whether or not the laser beam should be emitted to the imaged portion photographed by the pixel.

In step S12, the system controller 30 determines the LD based on, for example, the brightness indicated by the pixel data read in step S11 and the intensity of the laser light emitted when the captured pixel captured the image last time. Determines if the module 43 should emit laser light. When the laser light is not emitted, the intensity of the laser light is zero.

In the endoscope system 1, the number of pixels P included in the image pickup device 54 of the endoscope 10 is usually large, so that the area of the photographing portion T is small. When each pixel P takes a picture, the intensity of the light applied to the pictured portion T is adjusted to an appropriate intensity based on the pixel data acquired in the past. As a result, the image sensor 54 captures an appropriate image with few unclear parts.
Further, since the intensity of the light emitted by the LD module 43 is determined based on the pixel data acquired by the system controller 30, a more appropriate image is taken.

(Embodiment 3)
FIG. 8 is an explanatory diagram of the endoscope system according to the third embodiment.
Hereinafter, the differences between the third embodiment and the first embodiment will be described. Since the other configurations other than the configurations described later are common to the first embodiment, the same reference numerals as those of the first embodiment are assigned to the components common to the first embodiment, and the description thereof is omitted. To do.

In the endoscope system 1 according to the third embodiment, the configuration of the processing device 13 is different from that of the endoscope system 1 according to the first embodiment. The processing device 13 according to the third embodiment has a different output source for outputting pixel data to the system controller 30 as compared with the processing device 13 according to the first embodiment.

The first processing unit 36 performs image processing on the pixel data each time pixel data is input from the element driving unit 55, and outputs the processed pixel data to the E / O converter 37 and the system controller 30. To do. The second processing unit 40 performs image processing on the input pixel data each time pixel data is input from the O / E converter 39, and outputs the image-processed pixel data to the monitor 12.

The system controller 30 executes the emission control process in the same manner as in the first embodiment. In the description of the emission control process according to the first embodiment, the output control process according to the third embodiment can be described by changing the output source of the pixel data from the second processing unit 40 to the first processing unit 36.
The endoscope system 1 and the processing device 13 according to the third embodiment similarly exhibit the effects of the endoscope system 1 and the processing device 13 according to the first embodiment.

In the third embodiment, the LD module 43 is changed to an LD module that emits a laser beam having a wavelength component in the visible light region, and the system controller 30 executes an emission control process as in the second embodiment. May be good. In this case, in the description of the output control process in the second embodiment, the output control process can be described by changing the output source of the pixel data from the second processing unit 40 to the first processing unit 36. The memory 46 stores pixel data for one frame acquired by the system controller 30 from the first processing unit 36.
The endoscope system 1 and the processing device 13 configured as described above have the same effects as the endoscope system 1 and the processing device 13 in the second embodiment.

Further, in the second embodiment or the third embodiment in which the emission control process according to the second embodiment is executed, a second lamp that emits a lamp light having low directivity is used instead of the LD module 43. May be good. In this case, instead of the LD drive unit 42, a lamp drive unit that operates in the same manner as the LD drive unit 42 is used. When the second lamp is used, the portion irradiated with the lamp light emitted by the second lamp coincides with or substantially coincides with the photographing portion T shown in the image related to the pixel data acquired by the system controller 30. It does not have to be. For example, the portion irradiated with the lamp light emitted by the second lamp may be substantially coincident with the portion irradiated with the lamp light emitted by the lamp 32, and the irradiated portion may be fixed. Even in this case, an appropriate image is taken.

Further, in the first to third embodiments and the third embodiment in which the emission control process according to the second embodiment is executed, the LD drive unit 42 and the LD module 43 are configured in the same manner as the E / O converter 37. An E / O converter can be used. In this case, the laser diode of the E / O converter emits the laser light into the body via the optical fibers 23 and 44 and the laser probe 20 as in the LD module 43. Similar to the LD drive unit 42, the V / I conversion unit of the E / O converter causes the laser diode to emit the laser light and stop the emission of the laser light according to the instruction of the system controller 30, and the laser Adjust the intensity of the laser beam emitted by the diode. The excitation wavelength of the laser light emitted by the laser diode is the same as the excitation wavelength of the laser light emitted by the LD module 43.

Further, in the first to third embodiments and the third embodiment in which the emission control process according to the second embodiment is executed, the processing device 13 has a plurality of E / O converters 37, 37, ... , These E / O converters 37, 37, ... Include an E / O converter 37 that is not used as a component for transmitting optical pixel data to the O / E converter 39. Assume. In this case, the E / O converter 37, which is not used as a component for transmitting optical pixel data, can be substituted as the LD drive unit 42 and the LD module 43.

The laser diode 37a of the substitute E / O converter 37 emits laser light into the body via the optical fibers 23 and 44 and the laser probe 20 in the same manner as the LD module 43. Similar to the LD drive unit 42, the V / I conversion unit 37b of the substitute E / O converter 37 emits the laser light to the laser diode 37a and stops the emission of the laser light according to the instruction of the system controller 30. To adjust the intensity of the laser beam emitted by the laser diode 37a. The excitation wavelength of the laser light emitted by the laser diode 37a is the same as the excitation wavelength of the laser light emitted by the LD module 43.
As described above, when the E / O converter 37 is used as the LD drive unit 42 and the LD module 43, it is possible to realize a configuration in which the laser beam is emitted without significantly changing the existing configuration of the processing device 13. it can.

It should be considered that the first to third embodiments disclosed this time are exemplary in all respects and are not restrictive. The scope of the present invention is indicated by the scope of claims, not the above-mentioned meaning, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

1 Endoscope system 10 Endoscope 10a Flexible tube 10b Insertion port 10c Aperture 20 Laser probe 20a Cylinder 20b Ejection lens 20c Direction changer 21, 35, 45, 50 Connector 22 Connecting tube 23, 38, 44 Optical fiber 30 System controller (acquisition unit, judgment unit, determination unit)
31 Lamp drive unit 32 Lamp 33 Condensing lens 34, 51 Light guide 36 First processing unit 37 E / O converter 37a Laser diode 37b V / I conversion unit 39 O / E converter 39a Photodiode 39b I / V conversion unit 40 Second processing unit 41 Timing controller 42 LD drive unit 43 LD module (light source)
46, 56 Memory 52 Light distribution lens 53 Objective lens 54 Image sensor 54a Light receiving surface 55 Element drive unit A1 Computer program B1 Storage medium E Tumor P pixel T Imaging part

Claims (6)

A processing device that performs image processing related to an image inside the body taken by an image sensor having a plurality of pixels.
A light source that emits light into the body,
An acquisition unit that sequentially acquires pixel data related to images taken by each of the plurality of pixels, and an acquisition unit.
A processing device including a determination unit that determines whether or not the light source should emit light each time the acquisition unit acquires pixel data. Claim 1 includes a determination unit that determines the intensity of the light emitted by the light source based on the pixel data acquired by the acquisition unit when the determination unit determines that the light source should emit light. The processing apparatus described in. The processing apparatus according to claim 1 or 2, wherein the determination unit determines that the light source should emit light when the color of the image related to the pixel data acquired by the acquisition unit is a specific color. .. The processing apparatus according to any one of claims 1 to 3,
An endoscope system including an endoscope having the image pickup element. It is a method of operating a processing device that performs image processing.
A step of sequentially acquiring pixel data related to an internal image taken by each of a plurality of pixels of the image sensor, and a step of sequentially acquiring pixel data.
Each time the pixel data is acquired, the step of determining whether or not the light source should emit light into the body
A method of operating the processing device, which is executed by the processing device . Pixel data related to internal images taken by each of a plurality of pixels of the image sensor are sequentially acquired, and the pixel data is sequentially acquired.
Each time of acquiring the image prime over data, light source computer program for executing a process of determining whether to emit light in the body to the computer.

Images