JP2020171599A - Image generation device, computer program, and image generation method - Google Patents

Abstract

To provide an image generation device, a computer program, and an image generation method capable of generating image data of an image having high visibility of a lesioned part, the image data displaying two types of images together.SOLUTION: In a processor device, in a case of detecting plural lesioned parts on the basis of normal image data of a biological tissue, a system controller 30 identifies the largest lesioned part having the largest area in the lesioned parts, in a normal image according to the normal image data. An image processing circuit 35 generates a superimposed image data obtained by superimposing a special light image of the biological tissue, in the region of a normal image different from a lesioned region including the largest lesioned part identified by the system controller 30.SELECTED DRAWING: Figure 2

Description

The present invention relates to an image generator, a computer program and an image generation method.

An endoscope system (see Patent Document 1) in which an electron scope is inserted into a cavity of a human body and an image of a living tissue taken by the electron scope is displayed is widely used. In the endoscopic system described in Patent Document 1, the electronic scope irradiates a living tissue with white light containing red, blue, and green components. The reflected light reflected by the living tissue is incident on the electron scope. In the reflected light, normal image data corresponding to the wavelength components of red, blue and green and special light image data corresponding to two of red, blue and green are generated. Generates image data for displaying a normal image of normal image data and a special light image of special light image data together. In the image of the generated image data, the lesion portion formed in the living tissue is observed.

International Publication No. 2017/507680 Pamphlet

When both the normal image data and the special light image data are reduced in order to generate image data for displaying the normal image and the special light image together, the visibility of the lesion is reduced and detailed observation of the lesion can be performed. I can't do it. The larger the reduction width, the smaller the number of pixels of the image data generated by the reduction, so that the visibility of the lesion is low.

The present invention has been made in view of such circumstances, and an object of the present invention is to generate image data of an image in which two types of images are displayed together and the lesion portion is highly visible. It is an object of the present invention to provide an image generator, a computer program, and an image generation method capable of the present invention.

The image generator according to one aspect of the present invention has a lesion detection unit that detects a lesion portion in the biological tissue and a lesion detection unit that detects a plurality of lesion portions based on the first image data of the biological tissue. In the first image of the first image data, a lesion including a maximum lesion specific portion that identifies the largest lesion portion having the largest area among the plurality of lesion portions and a maximum lesion portion specified by the maximum lesion specific portion. An image generation unit that generates superimposed image data of the superimposed image on which the second image of the living tissue is superimposed is provided in the region of the first image different from the region.

The computer program according to one aspect of the present invention detects a lesion in the living tissue based on the first image data of the living tissue on a computer, and when a plurality of lesions are detected, the first image data of the first image data is detected. In one image, the largest lesion having the largest area among the plurality of lesions is identified, and the second image of the living tissue is located in a region of the first image different from the lesion region including the identified maximum lesion. The process of instructing the generation of the superimposed image data of the superimposed image on which the image is superimposed is executed.

In the image generation method according to one aspect of the present invention, when a computer detects a lesion in the living tissue based on the first image data of the living tissue and detects a plurality of lesions, the first image data In the first image, the largest lesion having the largest area among the plurality of lesions is identified, and the area of the first image different from the lesion area including the identified maximum lesion is the area of the living tissue. 2 Instructs the generation of superimposed image data of the superimposed image on which the images are superimposed.

According to the above aspect, it is possible to generate image data of an image in which two types of images are displayed together and the lesion portion is highly visible.

It is a block diagram which shows the main part structure of the endoscopic system in Embodiment 1. FIG. It is explanatory drawing of the operation of an image processing circuit. It is a flowchart which shows the procedure of image display processing. It is explanatory drawing of the lesion part detection processing. It is a specific explanatory diagram of the number of lesions. It is a specific explanatory diagram of a lesion area. It is explanatory drawing of the superimposition image. It is explanatory drawing of the change of the superimposition image. It is a flowchart which shows the procedure of the image display processing in Embodiment 2. It is a flowchart which shows the procedure of the image display processing in Embodiment 2. It is a specific explanatory view of the largest lesion part and the second lesion part. It is explanatory drawing of the superimposition image. It is explanatory drawing of the superimposition image in Embodiment 3. It is explanatory drawing of the superimposition image in Embodiment 4. It is explanatory drawing of the superimposition image in Embodiment 5. It is a flowchart which shows the procedure of the image display processing in Embodiment 6. It is explanatory drawing of a normal image and a superposed image. It is explanatory drawing of determination of superimposition position in Embodiment 7.

Hereinafter, the present invention will be described in detail with reference to the drawings showing the embodiments thereof. As a specific example of the embodiment, an endoscope system including a processor device that functions as an image generation device will be described.
(Embodiment 1)
<Overview of endoscopy system>
FIG. 1 is a block diagram showing a configuration of a main part of the endoscope system 1 according to the first embodiment. The endoscope system 1 includes an electronic scope 10, a processor device 11, and a monitoring device 12. The electronic scope 10 and the monitoring device 12 are detachably connected to the processor device 11. The electron scope 10 is inserted into the cavity of the human body. The electron scope 10 photographs the living tissue in the cavity and outputs the image data of the photographed image to the processor device 11. The processor device 11 performs image processing on the image data input from the electronic scope 10, and outputs the processed image data to the monitoring device 12. The monitoring device 12 displays an image of image data input from the processor device 11. The image data is data used for displaying an image, and is, for example, gradation values of a plurality of pixels constituting the image.

<Structure of electronic scope 10>
The electron scope 10 has an elongated flexible tube 20 having flexibility. The outside of the flexible tube 20 is covered with a sheath (exodermis). One end of the flexible tube 20 is attached to the processor device 11. The other end of the flexible tube 20, that is, the tip of the flexible tube 20, is made of a rigid resin housing.

On the outside of the flexible tube 20, the operation unit 21 is installed on the processor device 11 side. The flexible tube 20 is curved according to the operation performed by the operation unit 21, and the direction of the tip surface of the flexible tube 20 changes in a direction such as an upward direction, a downward direction, a left direction, or a right direction. This bending mechanism is a well-known mechanism incorporated into a general electronic scope. An operation wire is arranged in the flexible tube 20. The flexible tube 20 is curved by the traction of the operation wire linked to the operation of the operation unit 21.

In the electron scope 10, light is irradiated from the tip surface of the flexible tube 20 to the living tissue in the cavity, and the reflected light reflected by the living tissue is incident on the tip surface of the flexible tube 20. In the electron scope 10, an image is formed by the reflected light incident from the tip surface, and the image is captured. By operating the operation unit 21, the user changes the orientation of the tip surface of the flexible tube 20 and changes the area of the image captured by the electronic scope 10.

The operation unit 21 is provided with a curved operation knob. The user bends the flexible tube 20 by operating the bending operation knob of the operation unit 21. Further, the operation unit 21 has an air supply button for injecting air from the tip surface of the flexible tube 20, a water supply button for injecting water from the tip surface of the flexible tube 20, and an image display performed by the monitoring device 12. A display switching button for switching between moving image display and static display may be provided. Further, the operation unit 21 has a magnification adjustment button for instructing enlargement or reduction of the image displayed on the monitor device 12, and light for switching the light emitted from the tip surface of the flexible tube 20 to normal light or therapeutic light. A switching button may be provided. When an operation is performed by the operation unit 21, the operation unit 21 outputs an operation signal indicating the operation performed by the operation unit 21 to the processor device 11.

In the electron scope 10, a flexible elongated light guide 22 is arranged in the flexible tube 20. The light guide 22 is composed of, for example, a plurality of quartz optical fibers. One end of the light guide 22 is arranged at the tip of the flexible tube 20. The other end of the light guide 22 is located on the processor device 11 side. An illumination window is provided on the tip surface of the flexible tube 20, and an illumination lens 23 is arranged on the illumination window. The illumination lens 23 faces one end surface of the light guide 22. The processor device 11 emits light to the end surface of the light guide 22. In the light guide 22, the light incident from the end surface on the processor device 11 side propagates toward the tip surface of the flexible tube 20 and exits from the tip surface. The light emitted from the tip surface of the light guide 22 is diffused by the illumination lens 23. The light diffused by the illumination lens 23 irradiates the living tissue in the cavity.

An incident window is further provided on the tip surface of the flexible tube 20. The objective optical system 24 is arranged on the tip end side of the flexible tube 20. The objective optical system 24 is composed of a lens group including an objective lens, a prism, and the like, and is arranged in an incident window. In the flexible tube 20, the solid-state image sensor 25 is arranged on the processor device 11 side of the objective optical system 24.

The reflected light reflected by the living tissue is incident on the objective optical system 24. The incident reflected light is imaged on the image pickup surface of the solid-state image pickup device 25 via the objective optical system 24. The objective optical system 24 forms an image of a living tissue on the imaging surface of the solid-state imaging device 25. The solid-state image sensor 25 performs photoelectric conversion of an image of light formed on the image pickup surface.

The solid-state image sensor 25 is, for example, CMOS (Complementary Metal Oxide Semiconductor). A driver circuit 26 is installed in the flexible tube 20. The driver circuit 26 includes a CPU (Central Processing Unit), a timing generator, an analog signal processing circuit, and the like.

The processor device 11 outputs a control signal to the driver circuit 26. In the driver circuit 26, the CPU controls the operation of the timing generator according to the control signal input from the processor device 11. The timing generator outputs a clock signal to the solid-state image sensor 25. The solid-state image sensor 25 accumulates signal charges of wavelength components of red, blue, and green in response to the clock signal input from the timing generator, performs an imaging operation of the biological tissue in a predetermined field period, and causes the image pickup surface to perform an imaging operation. The image signal of the formed image is output to the driver circuit 26.

The image signal output from the solid-state image sensor 25 to the driver circuit 26 is an analog signal. The analog signal processing circuit included in the driver circuit 26 performs noise processing, gain correction processing, and the like on the image signal input from the solid-state image sensor 25. The analog signal processing circuit includes a correlation double sampling circuit, an automatic gain adjustment circuit, an A / D (Analog / Digital) converter, and the like.

The correlated double sampling circuit performs a correlated double sampling process on the image signal output by the solid-state image sensor 25, and removes noise generated by driving the solid-state image sensor 25. The automatic gain adjustment circuit amplifies the noise-removed image signal by the correlated double sampling circuit. The A / D converter converts the image signal amplified by the automatic gain adjustment circuit into digital format image data having a predetermined number of bits. The driver circuit 26 outputs digital image data converted by the A / D converter to the processor device 11.

As another form, the electronic scope 10 may output an analog image signal output by the solid-state image sensor 25 to the processor device 11. In this case, in the processor device 11, the analog format image signal input from the solid-state image sensor 25 is converted into digital format image data.

<Configuration of processor device 11>
The processor device 11 includes a system controller 30, a memory 31, an operation panel 32, a light source control circuit 33, a signal processing circuit 34, an image processing circuit 35, and an output interface 36.

The system controller 30 includes a CPU, a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The CPU included in the system controller 30 expands the computer program P stored in the ROM or the memory 31 on the RAM and executes it, thereby causing the processor device 11 to function as an image generation device. The system controller 30 outputs the above-mentioned control signal to the driver circuit 26.

The system controller 30 is not limited to the above configuration, and may be one or a plurality of processing circuits including a single-core CPU, a multi-core CPU, a microcomputer, or a volatile or non-volatile memory. .. Further, the system controller 30 has functions such as a clock for outputting information related to the current time, a timer for measuring the elapsed time from giving a measurement start instruction to giving a measurement end instruction, or a counter. You may be.

Further, the computer program P may be provided to the processor device 11 by using a non-temporary recording medium A in which the computer program P is readablely recorded. The recording medium A is, for example, a portable memory such as a CD-ROM, a USB (Universal Serial Bus) memory, an SD (Secure Digital) card, a micro SD card, or a compact flash (registered trademark). In this case, the system controller 30 may read the computer program P from the recording medium A using a reading device (not shown), and install the read computer program P in the memory 31. Further, when the processor device 11 includes a communication unit that communicates with the external device, the computer program P may be provided to the processor device 11 by communication via the communication unit. In this case, the system controller 30 may acquire the computer program P through the communication unit and install the acquired computer program P in the memory 31.

The memory 31 is composed of, for example, a recording device having a non-volatile memory or a hard disk. The non-volatile memory is, for example, EPROM (Erasable Programmable Read Only Memory). The memory 31 stores data generated in the processor device 11, data input from the outside, and the like.
As another form, the memory 31 may be a portable recording medium such as a USB memory or an SD card. In this case, the memory 31 is detachably connected to the system controller 30 in the processor device 11.

The operation panel 32 is an operation tool such as various switches or buttons provided in a housing in which a component of the processor device 11 is housed, or an input device such as a mouse, keyboard or touch panel connected to the processor device 11. .. When an operation is performed on the operation panel 32, the operation panel 32 outputs an operation signal indicating the operation performed on the operation panel 32 to the system controller 30. Further, the operation unit 21 of the electronic scope 10 also outputs an operation signal indicating the operation performed by the operation unit 21 to the system controller 30. The system controller 30 controls the operation of the component unit included in the processor device 11 in response to the operation signals input from the operation unit 21 and the operation panel 32.

The processor device 11 further includes a light source 37, a motor 38, a condenser lens 39, and a turret 40. The system controller 30 outputs an instruction to the light source control circuit 33. The light source control circuit 33 controls the operations of the light source 37 and the motor 38 according to the instructions input from the system controller 30. The light source 37 is a high-intensity lamp such as a xenon lamp, a halogen lamp, a metal hide lamp, or an LED (Light Emitting Diode), and emits light having a spectrum extending from a visible light region to an infrared light region. The light emitted by the light source 37 is collected by the condenser lens 39 and converted into light having appropriate optical characteristics through a rotary turret 40 having a filter.

The turret 40 includes, for example, a filter for special light and a filter for normal light (white light) arranged alternately in the circumferential direction. These optical filters have a fan shape, for example, and are arranged at an angular pitch according to the field period (or frame period) for acquiring an endoscopic image. A motor 38 is connected to the turret 40 via a transmission mechanism (not shown) such as an arm and a gear. The motor 38 is, for example, a DC motor, and the turret 40 is rotated according to the instruction of the light source control circuit 33 to sequentially switch the filter to be applied to the emitted light.

The light that has passed through the turret 40 is incident on the end surface of the light guide 22 included in the electron scope 10, and is irradiated to the living tissue from the tip surface of the flexible tube 20 as described above. The reflected light reflected by the living tissue is incident from the tip surface of the flexible tube 20, and an image of the living tissue is formed on the imaging surface of the solid-state image sensor 25. The driver circuit 26 outputs the image data of the image formed on the imaging surface to the signal processing circuit 34.

The image data generated by the signal processing circuit 34 when normal light is emitted from the turret 40 to the end surface of the light guide 22 is referred to as normal image data. The normal image data is image data generated by the solid-state image sensor 25 photographing a living tissue in which normal light is irradiated from the tip surface of the flexible tube 20.
The image data generated by the signal processing circuit 34 when special light is emitted from the turret 40 to the end face of the light guide 22 is referred to as special light image data. The special light image data is image data generated by the solid-state image sensor 25 photographing a biological tissue irradiated with special light from the tip surface of the flexible tube 20.

Normal light is light containing red, blue, and green wavelength components. The special light is light containing two of the red, blue, and green wavelength components, for example, light containing the red and green wavelength components and not containing the blue wavelength component. Normal image data and special light The wavelength components contained in the normal light and special light used in the generation of image data are different from each other. Normal images and special optical images are used for observing lesions formed in living tissues.

The signal processing circuit 34 is, for example, a DSP (Digital Signal Processor). When normal light is emitted from the turret 40 to the end face of the light guide 22, the driver circuit 26 of the electronic scope 10 outputs normal image data to the signal processing circuit 34. When the special light is emitted from the turret 40 to the end surface of the light guide 22, the driver circuit 26 outputs the special light image data to the signal processing circuit 34.

When the normal image data or the special light image data is input from the driver circuit 26 of the electronic scope 10, the signal processing circuit 34 performs color separation, color interpolation, gain correction, and white for the normal image data or the special light image data. Various signal processing such as balance adjustment or gamma correction is performed, and the image data subjected to the signal processing is output to the system controller 30 and the image processing circuit 35. Therefore, the signal processing circuit 34 outputs the normal image data and the special optical image data to the system controller 30 and the image processing circuit 35.

As another form, the light emitted from the turret 40 to the end face of the light guide 22 may be only normal light. In this case, the signal processing circuit 34 generates normal image data based on the image signals corresponding to the red, blue, and green wavelength components in the image signal input from the solid-state image sensor 25. Further, the signal processing circuit 34 generates special optical image data based on the image signals corresponding to two of the red, blue, and green wavelength components in the image signal input from the solid-state image sensor 25. The signal processing circuit 34 outputs the generated normal image data and special optical image data to the system controller 30 and the image processing circuit 35.

In this form, the normal image data and the special light image data are generated by the solid-state image sensor 25 photographing the living tissue irradiated with the normal light. The entire red, blue and green wavelength components correspond to the first wavelength component. The entire two wavelength components in the red, blue, and green wavelength components correspond to the second wavelength component and are different from the first wavelength component. The normal image data is image data corresponding to the first wavelength component included in the reflected light reflected by the living tissue. The special optical image data is image data corresponding to the second wavelength component contained in the reflected light in the living tissue.

The system controller 30 acquires the normal image data and the special optical image data input from the signal processing circuit 34. Similarly, the image processing circuit 35 also acquires the normal image data and the special optical image data input from the signal processing circuit 34. The system controller 30 and the image processing circuit 35 acquire common normal image data from the signal processing circuit 34 and common special optical image data from the signal processing circuit 34. The image processing circuit 35 functions as a first image acquisition unit and a second image acquisition unit.

FIG. 2 is an explanatory diagram of the operation of the image processing circuit 35. The system controller 30 outputs various instructions to the image processing circuit 35 based on the normal image data and the special optical image data acquired from the signal processing circuit 34.

The image processing circuit 35 has an image memory that temporarily holds normal image data and special optical image data, a DIP (Digital Image Processor), and the like. The image processing circuit 35 generates superimposed image data of the superimposed image in which the special light image of the special light image data is superimposed on the region of the ordinary image of the ordinary image data according to the instruction of the system controller 30, and outputs the generated superimposed image data. Output to interface 36. The image processing circuit 35 further outputs the normal image data or the special optical image data input from the signal processing circuit 34 to the output interface 36.

The signal processing executed by the signal processing circuit 34 and the image processing executed by the image processing circuit 35 may be executed in one processing circuit. Further, the image processing circuit 35 may calculate the average luminance of each pixel of the generated image data and generate the control data necessary for the automatic control of the light source 37. The control data of the light source 37 generated by the image processing circuit 35 is output to the system controller 30.

The output interface 36 has a processing circuit such as a video processor. The output interface 36 generates image data conforming to a predetermined standard such as HDMI (High-Definition Multimedia Interface, registered trademark) or DVI (Digital Visual Interface) based on the image data input from the image processing circuit 35. The output interface 36 outputs the generated image data to the monitoring device 12. The monitoring device 12 has a display screen. When the image data is input from the output interface 36, the monitoring device 12 displays the image of the input image data on the display screen. Therefore, a superimposed image, a normal image, or a special light image is displayed.

Further, the output interface 36 generates still image data or moving image data compressed by a predetermined compression method from the image data input from the image processing circuit 35, and stores the generated still image data or moving image data in the memory 31. May be good.

Further, the processor device 11 may include a communication unit. The processor device 11 may acquire information related to endoscopy such as patient's electronic medical record information or operator's information from an external device connected to the communication unit and display it on the operation panel 32 or the monitor device 12. .. Further, the processor device 11 may transmit information on the inspection result such as the normal image data, the image analysis result or the operator's findings to the external device, and store the information in the external device.

The CPU (computer) of the system controller 30 executes an image display process for displaying an image on the monitoring device 12 by executing the computer program P.

<Explanation of image display processing>
FIG. 3 is a flowchart showing the procedure of the image display processing. The system controller 30 executes image display processing each time, for example, acquires normal image data and special optical image data from the signal processing circuit 34. First, the system controller 30 detects the lesion portion in each detection region provided in the normal image of the normal image data acquired from the signal processing circuit 34 (step S1).

FIG. 4 is an explanatory diagram of the lesion detection process. FIG. 4 shows a normal image Gn. The normal image Gn is a rectangular image. The normal light region An, which is irradiated with normal light, is indicated by a white region and has a circular shape. Areas that are not normally illuminated are indicated by horizontal hatching. The lesion B formed on the living tissue is indicated by a mesh hatching. In the normal image Gn of FIG. 4, three lesions B are shown.

As shown in the center of FIG. 4, a plurality of detection regions Ad for detecting the lesion portion B are preset in the normal image Gn. The detection area Ad has a rectangular shape. The plurality of detection regions Ad are arranged in a matrix. Each detection area Ad includes a plurality of pixels. The system controller 30 detects the lesion portion B in the living tissue based on the gradation values of a plurality of pixels corresponding to each detection region Ad in the normal image data. The system controller 30 also functions as a lesion detection unit.

For the detection of the lesion portion B, a known detection method, for example, the detection method described in International Publication No. 2017/507680 pamphlet can be used. In this detection method, a line segment connecting a reference point set in the color plane and a corresponding point of each pixel in the color plane defined by at least two color components out of three or more color components, and an object. Based on the angle formed by the reference axis having a correlation with the disease, the evaluation result regarding the corresponding disease of each pixel is obtained, and whether or not the lesion portion B exists is determined.
The detection result is shown in the lower part of FIG. The area where the lesion B is not detected is shown as a white area. The area where the lesion B is detected is shown as a black area.

The lesion portion B detected by the system controller 30 does not have to be a site that is confirmed as a lesion, and may be a site that may be a lesion. Further, the system controller 30 may detect the lesion portion B based on the special light image instead of the normal image Gn. The detection of the lesion B based on the special light image is the same as the detection of the lesion B based on the normal image Gn.

Further, the system controller 30 may detect the lesion portion B by using a machine learning framework including reinforcement learning. For example, a predetermined feature amount (for example, a feature amount based on higher-order local autocorrelation) is extracted from a plurality of images of a normal biological tissue having no lesion B, and a partial space showing an image of the normal biological tissue in the feature space Is obtained by learning. When a new image is acquired, the system controller 30 may detect the lesion portion B by determining whether or not it belongs to the subspace obtained by learning. Further, the system controller 30 may include a GPU (Graphics Processing Unit) for executing machine learning.

After executing step S1, the system controller 30 determines whether or not the lesion portion B is present in the normal image Gn based on the detection result of the lesion portion B (step S2). When the lesion B is detected in at least one detection region Ad, the system controller 30 determines that the lesion B is present. If the lesion B is not detected in all the detection regions Ad, the system controller 30 determines that the lesion B does not exist.

When the system controller 30 determines that the lesion portion B does not exist (S2: NO), the system controller 30 instructs the image processing circuit 35 to output the normal image data to the output interface 36 (step S3). As a result, the normal image data is output to the monitor device 12, and the normal image Gn of the normal image data is displayed on the monitor device 12. The system controller 30 ends the image display process after executing step S3.

When the system controller 30 determines that the lesion portion B is present (S2: YES), the system controller 30 specifies the number of the detected lesion portions B based on the detection result of the lesion portion B performed in step S1 (step S4).

FIG. 5 is a specific explanatory diagram of the number of lesions B. FIG. 5 shows the detection result of the lesion portion B. In step S4, the system controller 30 identifies the number of lesions B based on the position of the detection region Ad where the lesion B is present. If a lesion B is present in two adjacent detection regions Ad, the system controller 30 considers that a common lesion B has been detected. Therefore, for the detection region Ad in which the lesion B is present, a continuous group is regarded as one lesion B. In the example of FIG. 5, the number of lesions B is specified to be three.

Next, the system controller 30 determines whether or not the number of lesions B identified in step S4 is 2 or more (step S5). When the system controller 30 determines that the number of lesions B is 2 or more (S5: YES), the system controller 30 among the plurality of detected lesions B is based on the number of detection areas Ad in which the lesions B are present. The largest lesion with the largest area is identified (step S6). The area of the lesion B is represented by the number of detection regions Ad. In the example of FIG. 5, the area of the upper left lesion B is 5. The area of the right lesion B is 2. The area of the lower left lesion B is 4. In step S6, the largest lesion is identified by the system controller 30 in the upper left lesion B. The system controller 30 also functions as a maximum lesion identification part.

When the system controller 30 determines that the number of lesions B is 1 (S5: NO), or after executing step S6, the system controller 30 determines the display lesion to be displayed on the monitoring device 12 (step S7). In step S7, when the number of lesions B is one, the system controller 30 determines the displayed lesion to be the lesion B shown in the normal image Gn. When the number of lesions B is 2 or more, the system controller 30 determines the display lesion to be the largest lesion identified in step S6. After executing step S7, the system controller 30 sets the lesion region including the display lesion portion in the normal image Gn (step S8).

FIG. 6 is a specific explanatory view of the lesion area Ab. FIG. 6 shows the detection result of the lesion portion B. As shown in the center of FIG. 4, the frame line of the detection result coincides with the frame line of the normal image Gn. The lesion area Ab set in step S8 is indicated by diagonal hunting. As shown in FIG. 6, in the lesion area Ab, a part of the frame line coincides with the frame line of the detection result, that is, a part of the frame line of the normal image Gn, and the detection area Ad corresponding to the displayed lesion part Set in the included rectangular area.

After executing step S8, the system controller 30 determines whether or not there is a superposed region on which the special light image is superimposed in the region of the normal image Gn different from the lesion region Ab (step S9). In step S9, a display area for displaying the superimposed image is considered. The display area has a rectangular shape. As shown in FIG. 6, the vertical and horizontal lengths of the display area are represented by Hd and Wd. The length and width of the lesion area Ab are represented by Hb and Wb, respectively. The vertical and horizontal lengths of the display area coincide with the vertical and horizontal lengths of the normal image Gn.

In step S9, the system controller 30 determines whether or not a superposed region exists based on the values of (Hd-Hb) and (Wd-Wb). As an example, in the system controller 30, when the value of (Hd-Hb) is equal to or higher than the threshold value related to the vertical length and the value of (Wd-Wb) is equal to or higher than the threshold value related to the horizontal length. It is determined that there is a superposed area in. In other cases, the system controller 30 determines that the superposed region does not exist.

As another example, in the system controller 30, a rectangular reference area having a constant vertical length as a first reference value and a constant horizontal length as a second reference value is changed from a display area to a lesion area. When it exists in the region excluding Ab, it is determined that the superimposed region exists. The first reference value and the second reference value are set in advance. When the reference region does not exist in the region excluding the lesion region Ab from the display region, it is determined that the superimposed region does not exist.

The determination made in step S9 corresponds to whether or not it is possible to superimpose the special optical image on the region of the normal image Gn different from the lesion region Ab. The existence of a superimposition region corresponds to the possibility of superimposition. The absence of a superposed region corresponds to the impossibility of a superposed region. The system controller 30 also functions as a determination unit.

When the system controller 30 determines that the superimposed region does not exist (S9: NO), the system controller 30 instructs the image processing circuit 35 to output the special optical image data to the output interface 36 (step S10). As a result, the image processing circuit 35 outputs the special light image data acquired from the signal processing circuit 34 to the monitor device 12, and the monitor device 12 displays the special light image of the special light image data. The special light image is an image in which the types of colors used for display are less than the types of colors used for displaying the normal image Gn. For example, red, blue, and green are used for displaying the normal image Gn, and two of red, blue, and green are used for displaying the special light image. The size of the frame, the number of pixels, and the shape of the living tissue in the image are the same for the normal image Gn and the special light image.
The system controller 30 ends the image display process after executing step S10.

When the system controller 30 determines that the superimposed region exists (S9: YES), the system controller 30 calculates the superimposed size of the special optical image superimposed on the normal image Gn (step S11). As an example, the system controller 30 calculates the superposition size based on the values of (Hd-Hb) and (Wd-Wb). As another example, the system controller 30 calculates the size of the largest region in the rectangular region having the same aspect ratio as the normal image Gn as the superimposed size, which fits in the region excluding the lesion region Ab from the display region. .. The superposition size is the length and width of the rectangular area.

Next, the system controller 30 determines the superimposition position on which the special optical image is superimposed on the normal image Gn (step S12). In step S12, the system controller 30 determines that the special light image and the lesion area Ab are arranged diagonally in the rectangular display area, or the special light image and the lesion area Ab are arranged vertically or horizontally in the display area. The superimposition position of the special optical image is determined so as to be adjacent to the direction.

Next, the system controller 30 instructs the image processing circuit 35 to generate superimposed image data of the superimposed image in which the special optical image is superimposed on the normal image Gn (step S13). As a result, the image processing circuit 35 determines the special light image to be superimposed on the normal image Gn based on the superimposed image size calculated in step S11, and the determined special light image is the normal image determined in step S12. The superimposed image data of the superimposed image superimposed on the superimposed position of Gn is generated. In the superimposed image, the special optical image of the special optical image data acquired from the signal processing circuit 34 is superimposed on the region of the normal image Gn different from the lesion region Ab. The image processing circuit 35 functions as an image generation unit.

After executing step S13, the system controller 30 instructs the image processing circuit 35 to output the superimposed image data to the output interface 36 (step S14). As a result, the image processing circuit 35 outputs the generated superimposed image data to the monitoring device 12, and the monitoring device 12 displays the superimposed image of the superimposed image data. The image processing circuit 35 also functions as an output unit.

FIG. 7 is an explanatory diagram of the superimposed image. In the example of FIG. 7, the special optical image Gs is superimposed on the normal image Gn. Each of the superimposed image and the special light image Gs is a rectangular image. The special light region As irradiated with the special light is shown in gray. Areas not exposed to special light are indicated by horizontal hatching. As described above, the lesion portion B formed in the living tissue is indicated by the hatching of the mesh.

As described above, the image processing circuit 35 determines the special optical image Gs to be superimposed on the normal image Gn based on the superimposed image size calculated in step S11. In the example of FIG. 7, the image processing circuit 35 has a special light image Gs of special light image data input from the signal processing circuit 34, which is superimposed on the normal image Gn by cutting out a region including a display lesion. The special optical image data of the optical image Gs is generated.

As shown in FIG. 7, in the superimposed image, the display lesion portion of the normal image Gn and the special light image Gs is displayed. In the process of generating the superimposed image data, the image processing circuit 35 generates the superimposed image data by using the normal image data whose number of pixels has not been changed since the acquisition time of the system controller 30. Therefore, the visibility of the displayed lesion portion shown in the normal image Gn of the superimposed image is high. Further, the special light image data is not reduced, and in the special light image data, the number of pixels related to the image data of the display lesion portion is the same as the number of pixels of the special light image data acquired from the signal processing circuit 34. Therefore, the visibility of the displayed lesion portion reflected in the special light image Gs of the superimposed image is also high.

<Explanation of changes in superimposed images>
FIG. 8 is an explanatory diagram of changes in the superimposed image. FIG. 8 shows changes in the normal image Gn and the superimposed image when the tip of the flexible tube 20 is advanced inward in the cavity. When the tip of the flexible tube 20 is advanced to the back, the normal image Gn and the superimposed image are sequentially changed to the upper image, the center image, and the lower image, respectively. When the sizes of the plurality of lesions B shown in the normal image Gn and the special light image Gs are the same, the area of the lesion B near the tip of the flexible tube 20 is large. When the tip of the flexible tube 20 is advanced to the back, the lesion portion B having the largest area is sequentially changed.

In the superimposed image, the lesion portion B having the largest area, that is, the lesion portion B near the tip of the flexible tube 20, is displayed in the normal image Gn and the special optical image Gs. In the superimposed image shown on the upper side and the center of FIG. 8, in the rectangular display region for displaying the superimposed image, the lesion region Ab including the displayed lesion portion and the special optical image Gs are arranged diagonally. In the superimposed image shown on the lower side of FIG. 8, in the display region, the lesion region Ab and the special optical image Gs are adjacent to each other in the lateral direction.
When the displayed lesion portion is located on the upper side of the center in the normal image Gn, the image processing circuit 35 generates superimposed image data of the superimposed image in which the lesion region Ab and the special light image Gs are vertically adjacent to each other. To do.

As described above, when the lesion portion B is not detected in the normal image Gn, the normal image is displayed on the monitoring device 12. In the normal image Gn, since the area of the display lesion portion is large, the special light image Gs is displayed on the monitoring device 12 when there is no region on which the special light image Gs is superimposed in the display area.

In the processor device 11, the special optical image Gs is superimposed on the region of the normal image Gn different from the lesion region Ab. Therefore, when the image processing circuit 35 generates superimposed image data, it is not necessary to reduce the normal image Gn, that is, the normal image data, or the reduction width of the normal image data is small. Therefore, the image processing circuit 35 generates superimposed image data of the superimposed image that displays the normal image Gn and the special light image Gs and has high visibility of the displayed lesion portion. Further, when a plurality of lesions B are detected, the lesion B having the largest area is displayed as a display lesion in the superimposed image, which is highly convenient for the user.

Further, in the superimposed image, the lesion area Ab and the special light image Gs are displayed diagonally, or the lesion area Ab and the special light image Gs are adjacent to each other in the vertical direction or the horizontal direction. Therefore, the normal image Gn can be easily observed while looking at the special light image Gs.

(Embodiment 2)
When a plurality of lesions B are detected, it is preferable that the number of lesions B displayed in the superimposed image is large.
Hereinafter, the difference between the second embodiment and the first embodiment will be described. Since the other configurations other than the configurations described later are common to the first embodiment, the same reference numerals as those of the first embodiment are assigned to the components common to the first embodiment, and the description thereof is omitted. To do.

<Explanation of image display processing>
9 and 10 are flowcharts showing the procedure of the image display processing in the second embodiment. The system controller 30 executes image display processing each time, for example, acquires normal image data and special optical image data from the signal processing circuit 34. In the image display process according to the second embodiment, the system controller 30 first executes step S21. The image display processing steps S21 to S25 and S34 to S41 in the second embodiment are the same as the image display processing steps S1 to S5 and S7 to S14 in the first embodiment, respectively. Further, each of the image display processing steps S28, S29, S30 to S33 in the second embodiment is the same as the image display processing steps S8, S9, S11 to S14 in the first embodiment. Therefore, detailed description of steps S21 to S25 and S28 to S41 will be omitted.

When the system controller 30 determines that the number of lesions B identified in step S24 is 2 or more (S25: YES), the lesion B is present as in step S6 of the image display process in the first embodiment. Based on the number of detection regions Ad to be detected, the largest lesion having the largest area and the second lesion having the second largest area are identified (step S26). The system controller 30 also functions as a second lesion identification part.

FIG. 11 is a specific explanatory view of the largest lesion and the second lesion. The upper portion of FIG. 11 corresponds to the central portion of FIG. Similar to the first embodiment, a plurality of detection regions Ad for detecting the lesion portion B are preset in the normal image Gn, and the system controller 30 detects the lesion portion B in each detection region Ad. The lower portion of FIG. 11 corresponds to FIG. The lower part of FIG. 11 shows the detection result of the lesion B.

In the example of FIG. 11, the area of the upper left lesion B is 3, the area of the right lesion B is 2, and the area of the lower left lesion B is 1. In step S26, the maximum lesion is identified by the system controller 30 in the upper left lesion B, and the second lesion is identified by the system controller 30 in the right lesion B.

Next, the system controller 30 determines the display lesion portion displayed by the monitoring device 12 to be the maximum lesion portion and the second lesion portion specified in step S27 (step S27). After executing step S27, the system controller 30 sets the lesion region Ab including the display lesion portion in the normal image Gn (step S28).

As shown on the upper side of FIG. 11, the frame line of the detection result coincides with the frame line of the normal image Gn. In FIG. 11, as in FIG. 6, the lesion area Ab is indicated by diagonal hunting. As shown in the lower part of FIG. 11, in the lesion region Ab set in step S28, a part of the frame line coincides with the frame line of the detection result, that is, a part of the frame line of the normal image Gn, and It is set in a rectangular area including the detection area Ad corresponding to the displayed lesion. The lesion area Ab set in step S28 includes the largest lesion and the second lesion identified in step S26.

The system controller 30 executes step S29 after executing step S28. In step S29, it is determined whether or not there is a superposed region on which the special optical image Gs is superimposed in the region of the normal image Gn different from the lesion region Ab. When the system controller 30 determines that the superimposed region exists (S29: YES), the system controller 30 sequentially executes steps S30 to S33 to end the image display process. When the system controller 30 executes step S33, the superimposed image data is output to the monitor device 12, and the superimposed image of the superimposed image data is displayed on the monitor device 12.

FIG. 12 is an explanatory diagram of the superimposed image. In FIG. 12, the superimposed image displayed on the monitoring device 12 is displayed when the system controller 30 executes step S33. FIG. 12 corresponds to FIG. When the system controller 30 executes steps S32 and S33, the image processing circuit 35 generates superimposed image data of the superimposed image in which the lesion region Ab including the displayed lesion portion is shown, and monitors the generated superimposed image data. Output to 12. In this case, in addition to the lesion portion B having the largest area, the lesion portion B having the second largest area is also displayed in the superimposed image, which is more convenient for the user.

When the system controller 30 determines that the superposed region does not exist (S29: NO), the system controller 30 determines that the superposed image data of the superposed image showing the maximum lesion portion and the second lesion portion cannot be generated, and executes step S34. To do. In step S34, when the number of lesions B is one, the system controller 30 determines the displayed lesion to be the lesion B shown in the normal image Gn. When the number of lesions B is 2 or more, the system controller 30 determines the display lesion as the largest lesion identified in step S26, and excludes the second lesion from the display lesion.

As described above, in the endoscopic system 1 of the second embodiment, when the number of lesions B is 2 or more, the maximum lesion and the second lesion can be displayed on the superimposed image. At that time, the superimposed image is displayed on the monitor device 12. When the number of lesions B is 2 or more and it is impossible to display the largest lesion and the second lesion on the superimposed image, is it possible to display the largest lesion on the superimposed image? Judge whether or not. When the maximum lesion can be displayed on the superimposed image, the superimposed image is displayed on the monitoring device 12. When it is impossible to display the maximum lesion on the superimposed image, the special optical image Gs is displayed on the monitor device 12.
The processor device 11 according to the second embodiment similarly exhibits the effect of the processor device 11 according to the first embodiment.

(Embodiment 3)
In the first embodiment, a superposed image in which a special light image Gs is superimposed on a normal image Gn is generated, and the generated superposed image is displayed on the monitor device 12. The superimposed image displayed on the monitor device 12 is not limited to the superimposed image in which the special optical image Gs is superimposed on the normal image Gn.
Hereinafter, the differences between the third embodiment and the first embodiment will be described. Since the other configurations other than the configurations described later are common to the first embodiment, the same reference numerals as those of the first embodiment are assigned to the components common to the first embodiment, and the description thereof is omitted. To do.

<Configuration of processor device 11>
The operation panel 32 receives a first superimposition instruction for superimposing the special light image Gs on the region of the normal image Gn and a second superimposition instruction for superimposing the normal image Gn on the region of the special light image Gs. The user gives a first superimposition instruction and a second superimposition instruction by operating the operation panel 32. The operation panel 32 functions as a reception unit.

<Explanation of image display processing>
When the operation panel 32 receives the first superposition instruction, the system controller 30 executes the same image display process as in the first embodiment. When the operation panel 32 receives the second superposition instruction, the system controller 30 executes an image display process in which the image processing circuit 35 generates a superposed image in which the normal image Gn is superposed on the region of the special light image Gs. In the description of the image display process according to the first embodiment, by replacing the normal image Gn and the special light image Gs with the special light image Gs and the normal image Gn, respectively, the superimposed image in which the normal image Gn is superimposed on the region of the special light image Gs. It is possible to explain the image display process generated by the image processing circuit 35 from the superimposed image data of.

FIG. 13 is an explanatory diagram of the superimposed image in the third embodiment. When the operation panel 32 receives the first superimposition instruction, the image processing circuit 35 generates the superimposition image data of the superimposition image shown on the upper side of FIG. 13 according to the instruction of the system controller 30. This superimposed image is the same as the superimposed image shown in FIG.

When the operation panel 32 receives the second superimposition instruction, the image processing circuit 35 generates superimposed image data of the superposed image in which the normal image Gn is superposed on the region of the special optical image Gs according to the instruction of the system controller 30. To do. As shown in the lower part of FIG. 13, when the number of lesions B is 2 or more, the largest lesion B, which has the largest area, is displayed on the special light image Gs and the normal image Gn.

By switching the superimposition instruction received by the operation panel 32, the user switches the superimposition image displayed on the monitor device 12. Therefore, the user can make various observations on the largest lesion.
The processor device 11 according to the third embodiment similarly exhibits the effect of the processor device 11 according to the first embodiment.

<Note>
A configuration in which the operation panel 32 receives the first superimposition instruction and the second superimposition instruction may be added to the configuration of the processor device 11 in the second embodiment. When the operation panel 32 receives the first superposition instruction, the system controller 30 executes the same image display process as in the second embodiment. When the operation panel 32 receives the second superposition instruction, the image processing circuit 35 generates superimposition image data of the superimposition image in which the normal image Gn is superposed on the region of the special optical image Gs.

In the description of the image display processing according to the second embodiment, by replacing the normal image Gn and the special light image Gs with the special light image Gs and the normal image Gn, respectively, the superimposed image in which the normal image Gn is superimposed on the region of the special light image Gs It is possible to explain the image display process generated by the image processing circuit 35 from the superimposed image data of.

Further, the component unit that receives the first superimposition instruction and the second superimposition instruction is not limited to the operation panel 32 of the processor device 11, and may be, for example, the operation unit 21 of the electronic scope 10. For example, the operation unit 21 has a button, and the user gives a first superposition instruction and a second superimposition instruction by operating the button of the operation unit 21.

(Embodiment 4)
In the third embodiment, the special light image Gs superimposed on the normal image Gn cuts out a region including a display lesion in the special light image Gs of the special light image data acquired by the image processing circuit 35 from the signal processing circuit 34. It is not limited to the special optical image Gs generated by the above. Further, the normal image Gn superimposed on the special optical image Gs is usually generated by cutting out a region including a display lesion in the normal image Gn of the normal image data acquired by the image processing circuit 35 from the signal processing circuit 34. It is not limited to the image Gn.
Hereinafter, the differences between the fourth embodiment and the third embodiment will be described. Since the other configurations other than the configurations described later are common to the third embodiment, the same reference numerals as those of the third embodiment are assigned to the components common to the third embodiment, and the description thereof is omitted. To do.

<Explanation of image display processing>
When the system controller 30 instructs the image processing circuit 35 to generate the superimposed image data in step S13, the superimposed image data of the superimposed image in which the special light image Gs is superimposed on the region of the normal image Gn, or the superimposed image data of the special light image Gs. The superimposed image data of the superimposed image in which the normal image Gn is superimposed on the region is generated, and the generated superimposed image data is output to the monitor device 12. The monitoring device 12 displays the superimposed image of the input superimposed image data.

FIG. 14 is an explanatory diagram of the superimposed image according to the fourth embodiment. When the operation panel 32 receives the first superimposition instruction, as shown on the upper side of FIG. 14, a superimposition image in which the special light image Gs is superposed on the region of the normal image Gn is displayed. When the operation panel 32 receives the second superimposition instruction, as shown in the lower side of FIG. 14, a superimposition image in which the normal image Gn is superposed on the region of the special light image Gs is displayed.

As shown in FIG. 14, when the special light image Gs is superimposed on the region of the normal image Gn, the image processing circuit 35 reduces the special light image data acquired from the signal processing circuit 34 and reduces the reduced special light image data. The special light image Gs is superimposed on the region of the normal image Gn different from the lesion region Ab. Similarly, when the normal image Gn is superimposed on the region of the special light image Gs, the image processing circuit 35 reduces the normal image data acquired from the signal processing circuit 34, and reduces the reduced normal image data Gn to the lesion area. It is superimposed on the region of the special optical image Gs different from Ab. The image processing circuit 35 also functions as a reduction unit.

As described above, since the reduced special light image Gs or the normal image Gn is displayed on the monitoring device 12, the living tissue can be confirmed over a wide range by viewing the reduced image.
The processor device 11 in the fourth embodiment similarly exhibits other effects among the effects played by the processor device 11 in the third embodiment, except for the effect obtained by cutting out the region including the display lesion portion.

<Note>
After adding a configuration in which the operation panel 32 receives the first superimposition instruction and the second superimposition instruction to the configuration of the processor device 11 in the second embodiment, the reduced special optical image Gs or the normal image Gn is further superimposed. Configurations may be added.

(Embodiment 5)
As described above, in the third embodiment, the special light image Gs superimposed on the normal image Gn displays the display lesion portion in the special light image Gs of the special light image data acquired by the image processing circuit 35 from the signal processing circuit 34. It is not limited to the special optical image Gs generated by cutting out the including region. Further, the normal image Gn superimposed on the special optical image Gs is usually generated by cutting out a region including a display lesion in the normal image Gn of the normal image data acquired by the image processing circuit 35 from the signal processing circuit 34. It is not limited to the image Gn.
Hereinafter, the differences between the fifth embodiment and the third embodiment will be described. Since the other configurations other than the configurations described later are common to the third embodiment, the same reference numerals as those of the third embodiment are assigned to the components common to the third embodiment, and the description thereof is omitted. To do.

<Explanation of image display processing>
When the system controller 30 instructs the image processing circuit 35 to generate the superimposed image data in step S13, the superimposed image data of the superimposed image in which the special light image Gs is superimposed on the region of the normal image Gn, or the superimposed image data of the special light image Gs. The superimposed image data of the superimposed image in which the normal image Gn is superimposed on the region is generated, and the generated superimposed image data is output to the monitor device 12. The monitoring device 12 displays the superimposed image of the input superimposed image data.

FIG. 15 is an explanatory diagram of the superimposed image according to the fifth embodiment. When the operation panel 32 receives the first superimposition instruction, as shown on the upper side of FIG. 15, a superimposition image in which the special light image Gs is superposed on the region of the normal image Gn is displayed. When the operation panel 32 receives the second superimposition instruction, as shown in the lower side of FIG. 15, a superimposition image in which the normal image Gn is superposed on the region of the special light image Gs is displayed.

As shown in FIG. 15, when the special light image Gs is superimposed on the region of the normal image Gn, the image processing circuit 35 displays the display lesion portion in the special light image Gs of the special light image data acquired from the signal processing circuit 34. Cut out the included area and enlarge the cut out area. As a result, the special light image data of the special light image Gs superimposed on the normal image Gn is generated. Similarly, in the normal image Gn of the normal image data acquired from the signal processing circuit 34, the area including the display lesion portion is cut out and the cut out area is enlarged. As a result, the normal image data of the normal image Gn superimposed on the special light image Gs is generated.

As described above, since the magnified special light image Gs or the normal image Gn is displayed on the monitoring device 12, the maximum lesion portion can be observed in detail.
The processor device 11 according to the fifth embodiment similarly exhibits the effect of the processor device 11 according to the third embodiment.

<Note>
After adding a configuration in which the operation panel 32 receives the first superimposition instruction and the second superimposition instruction to the configuration of the processor device 11 in the second embodiment, the enlarged special optical image Gs or the normal image Gn is further superimposed. Configurations may be added.

(Embodiment 6)
In the image display processing according to the first embodiment, the system controller 30 sets the superimposed position on which the special light image Gs is superimposed at the position where the special light image and the lesion area Ab are diagonally arranged in the rectangular display area, or , The special optical image and the lesion area Ab are determined at positions adjacent to the display area in the vertical or horizontal direction. However, the superimposition position is not limited to these positions.
Hereinafter, the difference between the sixth embodiment and the first embodiment will be described. Since the other configurations other than the configurations described later are common to the first embodiment, the same reference numerals as those of the first embodiment are assigned to the components common to the first embodiment, and the description thereof is omitted. To do.

<Explanation of image display processing>
FIG. 16 is a flowchart showing the procedure of the image display processing according to the sixth embodiment. The contents of many steps executed in the image display process of the fifth embodiment are the same as the contents of the steps executed in the image display process of the first embodiment. Therefore, among the steps executed in the image display process of the fifth embodiment, the steps having the same contents as the steps executed in the image display process of the first embodiment are given the same numbers as those of the first embodiment. The description will be omitted.

In the endoscope system 1, the living tissue is imaged by irradiating light from the tip surface of the flexible tube 20. Depending on the angle of light irradiating the living tissue from the tip surface of the flexible tube 20 or the structure of the living tissue, there is a possibility that a dark part may be generated in which the irradiation light radiated from the tip surface of the flexible tube 20 is not sufficiently applied. There is.

After executing step S11, the system controller 30 detects a dark portion in a region of the normal image Gn different from the lesion region Ab (step S41). A dark portion can be detected by comparing the gradation value of each pixel in normal image data with a threshold value and obtaining a region in which pixels having a gradation value equal to or less than the threshold value are continuous. The system controller 30 also functions as a dark area detection unit.
After executing step S41, the system controller 30 executes step S12 to determine the superposition position of the special optical image Gs.

When the dark portion is not detected in step S41, the system controller 30 determines the superimposition position as in the first embodiment. When the dark part is detected in step S41, the system controller 30 determines the superimposition position at a position where the dark part of the normal image Gn is hidden by the special light image Gs.

FIG. 17 is an explanatory diagram of a normal image Gn and a superimposed image. As shown in FIG. 17, when a dark portion Ak is detected in the normal image Gn, the system controller 30 sets the superimposition position on which the special light image Gs is superimposed, and the dark portion Ak is special in the normal image Gn different from the lesion region Ab. The position is determined to be hidden by the optical image Gs. The image processing circuit 35 generates superimposed image data of the superimposed image in which the special light image Gs is superimposed on the dark portion Ak of the normal image Gn detected by the system controller 30, and outputs the generated superimposed image data to the monitor device 12.

As described above, since the special light image Gs is superimposed on the dark portion Ak of the normal image Gn which is unnecessary for observing the living tissue, there are few parts unnecessary for observing the living tissue in the superimposed image.
The processor device 11 according to the sixth embodiment similarly exhibits the effect of the processor device 11 according to the first embodiment.

<Note>
A configuration for determining the superposition position so that the dark portion Ak may be hidden may be added to the configuration of the processor device 11 in the second to fifth embodiments. In this case, the system controller 30 not only superimposes the special light image Gs on the region of the normal image Gn, but also superimposes the normal image Gn on the region of the special light image Gs at a position where the dark portion Ak is hidden. You may decide.

(Embodiment 7)
In the first embodiment, the vertical and horizontal lengths of the display area for displaying the superimposed image are the same as the vertical and horizontal lengths of the normal image Gn. However, the display area may be wider than the area of the normal image Gn acquired from the signal processing circuit 34.
Hereinafter, the differences between the seventh embodiment and the first embodiment will be described. Since the other configurations other than the configurations described later are common to the first embodiment, the same reference numerals as those of the first embodiment are assigned to the components common to the first embodiment, and the description thereof is omitted. To do.

<Explanation of image display processing>
FIG. 18 is an explanatory diagram of determining the superposition position in the seventh embodiment. In step S12 of the image display process, the system controller 30 determines the superimposition position on which the special optical image Gs is superimposed, as in the first embodiment. In step S12, the system controller 30 arranges the special light image Gs and the lesion area Ab diagonally in the rectangular display area, or the special light image Gs and the lesion area Ab are in the vertical direction of the display area. Alternatively, the superimposition position of the special optical image Gs is determined so as to be adjacent in the horizontal direction.
As shown on the upper side of FIG. 18, the vertical length Hd and the horizontal length Wd of the display area are longer than the vertical length and the horizontal length of the normal image Gn acquired from the signal processing circuit 34, respectively. The lesion area Ab is usually set in the upper left of the image Gn.

The image processing circuit 35 generates superimposed image data according to the instructions of the system controller 30. In the superimposed image of the superimposed image data, as shown in the lower part of FIG. 18, the special optical image Gs is arranged over the region of the normal image Gn different from the lesion region Ab and the region outside the normal image Gn.

As described above, in the superimposed image, since the special optical image Gs is arranged over the region of the normal image Gn different from the lesion region Ab and the region outside the normal image Gn, the superimposed image makes it easy to observe the lesion portion B. The superimposed image data of is generated by the image processing circuit 35.
The processor device 11 according to the seventh embodiment similarly exhibits the effect of the processor device 11 according to the first embodiment.

<Note>
In the second to sixth embodiments, the display area may be wider than the area of the normal image Gn or the special optical image Gs acquired from the signal processing circuit 34, as in the seventh embodiment.

<Notes on the whole of Embodiments 1 to 7>
In the first to seventh embodiments, when the system controller 30 detects the lesion portion B, the system controller 30 does not receive the instruction of the user and superimposes the special light image Gs on the region of the normal image Gn, or the special light. The image processing circuit 35 may be instructed to generate a superimposed image in which the normal image Gn is superimposed on the region of the image Gs. The image processing circuit 35 generates a superposed image according to the instruction of the system controller 30, and the monitoring device 12 displays the superposed image.

Further, in the first to seventh embodiments, the operation panel 32 may receive a stop instruction for stopping the generation of the superimposed image data and a generation instruction for instructing the generation of the superimposed image data. When the operation panel 32 receives the stop instruction, the image processing circuit 35 outputs the normal image data or the special optical image data acquired from the signal processing circuit 34. As a result, the normal image Gn or the special light image Gs is independently displayed on the monitor device 12. When the operation panel 32 receives the generation instruction, the operation panel 32 generates the superimposed image data and outputs the generated superimposed image data.

Further, in the first to seventh embodiments, the superimposed image of the superimposed image data generated by the image processing circuit 35 is usually an image in which the special light image Gs is superimposed on the region of the normal image Gn or the region of the special light image Gs. It is not limited to the image on which the image Gn is superimposed. As an example, the superimposed image of the superimposed image data generated by the image processing circuit 35 is a superimposed image in which the normal image Gn or the special optical image Gs whose display is switched in real time is superimposed on the paused normal image Gn or the special light image Gs region. It may be an image. As another example, in the superimposed image of the superimposed image data generated by the image processing circuit 35, the paused normal image Gn or special light image Gs is superimposed on the region of the normal image Gn or the special light image Gs whose display is switched in real time. It may be a superimposed image.

Further, in the first to seventh embodiments, the maximum number of lesions B determined as the display lesions is not limited to 2, and may be 3 or more. For example, as the displayed lesion, the largest lesion, the second lesion, and the lesion having the third largest area may be determined. Further, the shapes of the normal image Gn, the special light image Gs, and the superimposed image are not limited to the rectangular shape.

The technical features (constituent requirements) described in the first to seventh embodiments can be combined with each other, and by combining them, a new technical feature can be formed.
The disclosed embodiments 1 to 7 should be considered as exemplary in all respects and not restrictive. The scope of the present invention is indicated by the scope of claims, not the above-mentioned meaning, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

1 Endoscope system 11 Processor device (image generator)
30 System controller (lesion detection part, maximum lesion identification part, second lesion identification part, judgment part, dark part detection part)
35 Image processing circuit (image generation unit, first image acquisition unit, second image acquisition unit, reduction unit, output unit)
32 Operation panel (reception section)
P computer program

Claims (13)

A lesion detection part that detects a lesion part in the living tissue based on the first image data of the living tissue,
When the lesion detection part detects a plurality of lesion parts, the maximum lesion identification part that identifies the maximum lesion part having the largest area among the plurality of lesion parts in the first image of the first image data, and the maximum lesion identification part.
An image generation unit that generates superimposed image data of a superimposed image in which a second image of the biological tissue is superimposed on a region of the first image different from the lesion region including the maximum lesion identified by the maximum lesion specifying portion. An image generator comprising. When the lesion detection part detects a plurality of lesions, the first image includes a second lesion identification part that identifies the second lesion having the second largest area among the plurality of lesions.
The image generation device according to claim 1, wherein the lesion region includes the maximum lesion portion and the second lesion portion specified by the second lesion specific portion. The image generator according to claim 1 or 2, wherein in the superimposed image, the second image is arranged over a region of the first image different from the lesion region and a region outside the first image. .. A first image acquisition unit for acquiring the first image data is provided.
The image generation unit is any one of claims 1 to 3 that generates the superimposed image data using the first image data whose number of pixels has not been changed since the acquisition time of the first image acquisition unit. The image generator according to. A second image acquisition unit that acquires the second image data of the second image, and
It is provided with a reduction unit for reducing the second image data acquired by the second image acquisition unit.
The image generation unit generates superimposed image data of a superimposed image in which a second image of the second image data reduced by the reduced portion is superimposed on a region of the first image different from the lesion region. The image generator according to any one of claims 3. A determination unit for determining whether or not the second image can be superimposed on the region of the first image different from the lesion region.
When the determination unit determines that the superimposition is possible, the superimposed image data generated by the image generation unit is output, and when the determination unit determines that the superimposition is not possible, the second The image generator according to any one of claims 1 to 5, further comprising an output unit for outputting the second image data of the image. A dark portion detecting portion for detecting a dark portion in the region of the first image different from the lesion region is provided.
The image generation unit is one of claims 1 to 6 that generates superimposed image data of a superimposed image in which the second image is superimposed on the dark portion of the first image detected by the dark portion detecting unit. The image generator described. The image generation unit is a superposed image in which the lesion area and the second image are diagonally arranged in a rectangular image area, or the lesion area and the second image are arranged in the vertical direction or in the image area. The image generator according to any one of claims 1 to 6, which generates superimposed image data of superimposed images adjacent to each other in the lateral direction. The first image data and the second image data of the second image are generated by photographing the living tissue irradiated with light.
The image generator according to any one of claims 1 to 8, wherein the wavelength components contained in the two lights used in the generation of the first image data and the second image data are different from each other. The first image data and the second image data of the second image are generated by photographing the living tissue irradiated with light.
The first image data is image data corresponding to the first wavelength component contained in the reflected light reflected by the living tissue.
The image generation according to any one of claims 1 to 8, wherein the second image data is image data included in the reflected light and corresponding to a second wavelength component different from the first wavelength component. apparatus. A reception unit that receives an instruction to superimpose the first image on the second image is provided.
The image generation unit generates superimposed image data of a superimposed image in which the first image is superimposed on the area of the second image when the receiving unit receives an instruction. The image generator according to any one. On the computer
Based on the first image data of the living tissue, the lesion portion in the living tissue is detected.
When a plurality of lesions are detected, the largest lesion having the largest area among the plurality of lesions is identified in the first image of the first image data.
A computer program for instructing the generation of superimposed image data of the superimposed image on which the second image of the living tissue is superimposed on the region of the first image different from the lesion region including the specified maximum lesion portion. .. The computer
Based on the first image data of the living tissue, the lesion portion in the living tissue is detected.
When a plurality of lesions are detected, the largest lesion having the largest area among the plurality of lesions is identified in the first image of the first image data.
An image generation method for instructing generation of superimposed image data of a superimposed image in which a second image of the living tissue is superimposed on a region of the first image different from the lesion region including the specified maximum lesion portion.