JP7447281B2 - Processor device, operating method of processor device - Google Patents

Description

The present invention relates to a processor device that acquires endoscopic images captured by an endoscope, and a method of operating the processor device.

Endoscope systems that include a light source device, an endoscope, and a processor device are widely known. In an endoscope system, an endoscopic image is obtained by irradiating an observation target with illumination light and capturing an image of the observation target illuminated with the illumination light. Endoscopic images are displayed on a display and used for diagnosis and the like.

In addition, some endoscope systems use normal imaging, in which white light (normal light) is irradiated onto the observation target to capture an endoscopic image for observation (normal image), and normal light has a different emission spectrum. Some systems perform special imaging in which an endoscopic image (special image) for acquiring biological information is captured by irradiating different special lights onto an observation target. For example, Patent Document 1 listed below describes an example in which excitation light of ICG (indocyanine green) is irradiated as special light to obtain a fluorescence image as an endoscopic image.

Further, Patent Document 1 listed below describes a configuration in which a normal image and a special image are recorded and displayed on a common screen. By doing so, for example, when a region of interest is detected during observation, it is possible to observe it in detail while playing back, rewinding, etc. the recorded image.

JP2019-098008A

However, with the device described in Patent Document 1, necessary information may not be obtained in some cases. In other words, in an endoscopy using an endoscope system, the majority of the examination is performed while observing normal images, so the frequency of special images is set lower than that of normal images. Therefore, there are cases where a special image for obtaining desired information does not exist. In order to prevent this kind of problem, it may be possible to set the frequency of special images to be high, but in this case, the frequency of normal images will decrease, making it difficult to see the normal images and having a negative impact on the examination. It will affect you.

The present invention has been made in view of the above background, and an object of the present invention is to provide a processor device and a method of operating the processor device that can more reliably obtain necessary information while suppressing adverse effects on inspection. shall be.

In order to achieve the above object, the processor device of the present invention has a normal observation mode in which an endoscopic image output from an endoscope is displayed on a display, a normal observation mode in which an endoscopic image output from an endoscope is displayed on a display, and a processor device in which an endoscope image is displayed on a display. In a processor device that records an image as a moving image and switches between multiple types of observation modes, including a detailed observation mode in which the recorded moving image is played back and displayed on a display based on a playback instruction, the imaging control processor usually Normal imaging in which light is irradiated onto the observation target to capture a normal image as an endoscopic image, and special light with a different emission spectrum from normal light is irradiated onto the observation target to capture a special image as an endoscopic image. special imaging is performed, and the imaging frequency of normal images and the imaging frequency of special images are switched according to the type of observation mode.

In the detailed observation mode, the frequency of capturing normal images may be lowered compared to the normal observation mode.

In the detailed observation mode, the frequency of capturing special images may be increased compared to the normal observation mode.

The special light includes multiple types of special light with different emission spectra, and the special image includes multiple types of special images corresponding to multiple types of special light.In detailed observation mode, in normal observation mode On the other hand, for some of the plurality of types of special images, the imaging frequency may be increased more than in the normal observation mode.

In the detailed observation mode, the imaging frequency may be lowered than in the normal observation mode for some special images other than some special images.

A biometric information image that displays biometric information of the observation target may be generated using the special image, and the generated biometric information image may be displayed on a display.

The biological information image may be an oxygen saturation image indicating the oxygen saturation of blood hemoglobin.

The biological information image may be a blood vessel image showing a blood vessel at a specific depth.

The biological information image may be a color difference expansion image that expands the color difference of each range for each of a plurality of ranges set in the special image.

Further, in order to achieve the above object, the operating method of the processor device of the present invention includes a normal observation mode in which an endoscopic image output from an endoscope is displayed on a display, and a normal observation mode in which an endoscopic image output from an endoscope is displayed on a display. and a detailed observation mode in which an endoscopic image is recorded as a moving image and the recorded moving image is played back and displayed on a display based on a playback instruction. , the imaging control processor performs normal imaging in which the observation target is irradiated with normal light to capture a normal image as an endoscopic image, and special light with a different emission spectrum from normal light is irradiated on the observation target to perform internal imaging. Special imaging is performed in which a special image is taken as a endoscopic image, and the imaging frequency of normal images and the imaging frequency of special images are switched depending on the type of observation mode.

According to the present invention, it is possible to provide a processor device and a method for operating the processor device in which normal images are easy to see and special images are easy to see when performing detailed observation.

FIG. 1 is a simplified schematic diagram of an endoscope system. FIG. 2 is a block diagram showing the functions of the endoscope system. It is a flowchart showing the flow of displaying endoscopic images. It is a flowchart showing the flow of recording and playing back endoscopic images. It is an explanatory diagram showing imaging control in normal observation mode. FIG. 3 is an explanatory diagram showing imaging control in detailed observation mode.

In FIG. 1, an endoscope system 10 includes an endoscope 12, a light source device 14, a processor device 16, a display 18, and a UI (User Interface) 19. The endoscope 12 is optically connected to the light source device 14 and electrically connected to the processor device 16 . The endoscope 12 includes an insertion section 12a that is inserted into the body of an observation target, an operation section 12b provided at the proximal end of the insertion section 12a, a curved section 12c provided at the distal end of the insertion section 12a, and a distal end. 12d. The bending portion 12c performs a bending operation by operating the operating portion 12b. The distal end portion 12d is directed in a desired direction by the bending action of the bending portion 12c.

The operation unit 12b also includes an observation mode changeover switch 12f used to switch the observation mode, a procedure support information presentation switch 12g used to present procedure support information related to the treatment instrument, and a procedure support information presentation switch 12g used to provide instructions for obtaining a still image of the observation target. A still image acquisition instruction switch 12h that is used and a zoom operation section 12i that is used to operate the zoom lens 43 are provided. The endoscope system 10 has two observation modes: a normal observation mode and a detailed observation mode for performing more detailed observation than the normal observation mode. The switching is performed.

The light source device 14 includes a light source section 20 (see FIG. 2) that emits illumination light for illuminating an observation target. Illumination light from the light source section 20 is guided by a light guide 25 (see FIG. 2) and irradiated toward the observation target from the tip section 12d. The observation target illuminated by the illumination light from the light source section 20 is imaged by an image sensor 44 (see FIG. 2) built into the distal end section 12d.

Processor device 16 is electrically connected to display 18 and UI 19. The display 18 outputs and displays an image of the observation target, information attached to the image of the observation target, and the like. The UI 19 includes a keyboard, a mouse, a touch pad, a microphone, etc., and has a function of accepting input operations such as function settings. Note that an external memory (not shown) may be connected to the processor device 16.

In FIG. 2, the light source device 14 includes the light source section 20 described above. The light source section 20 is connected to a light source control section 21 of the processor device 16, and the emission spectrum and emission timing of the illumination light emitted by the light source section 20 are controlled by the light source control section 21.

In this embodiment, the light source section 20 emits normal light and special light that have different emission spectra. The normal light is, for example, white light. White light includes, for example, violet light with a wavelength band of 380 to 420 nm, blue light with a wavelength band of 420 to 500 nm, green light with a wavelength band of 480 to 600 nm, and red light with a wavelength band of 600 to 650 nm. An endoscopic image (normal image) captured by irradiating the observation target with normal light is displayed on the display 18.

There may be one type of special light or multiple types of special light, but in this embodiment, six types of special light are set (see FIG. 5). These special lights include, for example, violet light (peak wavelength 400 nm to 420 nm) for which the absorption coefficient of blood hemoglobin is high, and the amount of light emitted is made larger than that of normal light. An endoscopic image (special image) captured by irradiating the observation target with this special light is used to generate a blood vessel image (biological information image) showing the superficial blood vessel structure and glandular duct structure.

Furthermore, the special light includes, for example, the light that emits only the violet light described above. The endoscopic image (special image) captured by irradiating this special light onto the observation target shows more superficial blood vessels than in the case described above (in which the amount of violet light emitted is greater than that of normal light). It is used to generate blood vessel images (biological information images) showing the structure and duct structure.

Furthermore, the special light includes, for example, light that emits blue-violet light (peak wavelength of 470 nm to 480 nm) in which oxyhemoglobin and deoxyhemoglobin have different extinction coefficients. An endoscopic image (special image) captured by irradiating the observation target with this special light is used to generate an oxygen saturation image (biological information image) indicating the oxygen saturation of blood hemoglobin.

Further, the special light includes, for example, the above-mentioned violet light, blue-violet light, and red light (peak wavelength 620 nm to 630 nm) whose emission amount is greater than that of normal light. The endoscopic image (special image) captured by irradiating this special light onto the observation target is used to generate a color difference-enhanced image (biological information image) that expands the color difference between the lesion and the area other than the lesion. . Note that the type of special light and the type of biological information image generated using the endoscopic image (special image) captured by irradiating each special light are not limited to the above and can be changed as appropriate.

Illumination light from the light source section 20 is incident on the above-mentioned light guide 25 via the optical path coupling section 23 composed of mirrors, lenses, and the like. The light guide 25 is built into the endoscope 12 and a universal cord (a cord that connects the endoscope 12, the light source device 14, and the processor device 16). The light guide 25 propagates the light from the optical path coupling section 23 to the distal end portion 12d of the endoscope 12.

The distal end portion 12d of the endoscope 12 is provided with an illumination optical system 30a and an imaging optical system 30b. The illumination optical system 30a has an illumination lens 32, and the illumination light propagated by the light guide 25 is irradiated onto the observation target via the illumination lens 32. The imaging optical system 30b includes an objective lens 42, a zoom lens 43, and an image sensor 44. Light emitted from the observation target by illumination light enters the image sensor 44 via the objective lens 42 and the zoom lens 43. As a result, an image of the observation target is formed on the image sensor 44. The zoom lens 43 is a lens for enlarging an observation target, and is moved between a telephoto end and a wide end by operating the zoom operation section 12i.

The image sensor 44 is a color sensor, and in this embodiment, a B pixel has a B (blue) color filter, a G pixel has a G (green) color filter, and an R pixel has an R (red) color filter. A primary color color sensor with three types of pixels is used. As such an image sensor 44, a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor can be used.

The image sensor 44 is controlled by an image sensor control section 45 of the processor device 16. The image sensor control unit 45 performs imaging (reading out signals from the image sensor 44) at predetermined cycles (60 times per second in this embodiment). Then, along with this imaging, an image signal is output from the imaging sensor 44. In this embodiment, image signals for 60 frames (sheets) are output per second.

Note that instead of the primary color image sensor 44 provided with RGB primary color filters, a complementary color image sensor 44 having complementary color filters of C (cyan), M (magenta), Y (yellow), and G (green) is used. may also be used. When using a complementary color image sensor, image signals of four colors, CMYG, are output. Therefore, by converting the image signals of four colors of CMYG into image signals of three colors of RGB through complementary color-primary color conversion, it is possible to obtain image signals of each color of RGB similar to that of the image sensor 38. Further, instead of the image sensor 38, a monochrome sensor without a color filter may be used.

A CDS/AGC (Correlated Double Sampling/Automatic Gain Control) circuit 46 performs correlated double sampling (CDS) and automatic gain control (AGC) on the analog image signal obtained from the image sensor 44 . The image signal that has passed through the CDS/AGC circuit 46 is converted into a digital image signal by an A/D (Analog/Digital) converter 48. The digital image signal after A/D conversion is input to the processor device 16.

The processor device 16 includes a central control section 68 that constitutes an imaging control processor of the present invention. The central control unit 68 is a hardware resource for executing program instructions stored in the memory 69, and drives and controls each unit of the processor device 16 to execute the program instructions. Under drive control of the central control unit 68 in accordance with execution of program instructions, the processor device 16 functions as an imaging control unit 50, a DSP (Digital Signal Processor) 52, a noise reduction unit 54, an image processing unit 58, and a display control unit 60. do.

The imaging control section 50 is provided with the light source control section 21 and the imaging sensor control section 45 described above. The imaging control unit 50 controls the light source unit 20 via the light source control unit 21 to illuminate the observation target, and controls the image sensor 44 via the imaging sensor control unit 45 to capture an image of the observation target (imaging sensor 44). Then, by this imaging, an endoscopic image output from the image sensor 44 is obtained.

The imaging control unit 50 performs normal imaging in which the object to be observed is imaged by irradiating normal light to obtain a normal image. Further, the photographing control unit 50 performs special imaging in which an observation mode is irradiated with special light to take an image, and acquires a special image. Special imaging is performed for each type of special light. As described above, in this embodiment, six types of special light are provided, so special imaging is performed for each of the six types of special light, and six types of special images are acquired (see FIG. 5). . In this embodiment, endoscopic images such as normal images and special images are blue signals (B image signals) and green signals (G image signals) output from B pixels, G pixels, and R pixels of the image sensor 44. , is a color image composed of red signals (R image signals).

The endoscopic image acquired by the imaging control unit 50 is transmitted to the DSP 52. The DSP 52 performs various signal processing such as defect correction processing, offset processing, gain correction processing, matrix processing, gamma conversion processing, demosaic processing, and YC conversion processing on the received endoscopic image.

In the defect correction process, signals of defective pixels of the image sensor 44 are corrected. In the offset processing, dark current components are removed from the image signal that has been subjected to the defect correction processing, and an accurate zero level is set. The gain correction process adjusts the signal level of the endoscopic image by multiplying the image signal of each color after the offset process by a specific gain coefficient. Note that when a monochrome sensor is used as the image sensor 44, the endoscopic image may be captured by the monochrome sensor every time light of a specific color is emitted, and a monochrome image of multiple colors may be output from the monochrome sensor. preferable.

The image signal of each color after the gain correction process is subjected to matrix processing to improve color reproducibility. Thereafter, the brightness and saturation of the endoscopic image are adjusted by gamma conversion processing. The endoscopic image after matrix processing is subjected to demosaic processing (also referred to as isotropic processing or simultaneous processing), and a signal of the missing color of each pixel is generated by interpolation. Through demosaic processing, all pixels have signals of each RGB color. The DSP 52 performs YC conversion processing on the demosaiced endoscopic image, and outputs the luminance signal Y, color difference signal Cb, and color difference signal Cr to the noise reduction unit 54.

The noise reduction unit 54 performs noise reduction processing using, for example, a moving average method or a median filter method, on the endoscopic image that has been subjected to demosaic processing or the like by the DSP 56. The endoscopic image with reduced noise is input to the image processing section 58. In this embodiment, a normal image captured by irradiating normal light and a special image captured by irradiating special light S are input to the image processing unit 58 as endoscopic images.

The image processing section 58 includes a normal observation mode layer processing section 62, a detailed observation mode image processing section 64, and a storage device 66. The normal observation mode image processing section 62 operates when the above-mentioned observation mode is the normal observation mode. On the other hand, the detailed observation mode image processing section 64 operates when the observation mode is the detailed observation mode. The storage device 66 is used for recording endoscopic images by the detailed observation mode image processing unit 64.

As shown in FIG. 3, when the normal observation mode image processing section 62 receives a normal image from the noise reduction section 54 (the endoscopic image into which the normal image is input from the noise reduction section 54 is not a special image) case), the normal image is input to the display control unit 60. The display control section 60 controls the display of the display 18 , and the normal image is converted into a video signal for display in the display control section 60 and displayed on the display 18 .

Further, when a special image is input from the noise reduction unit 54, the normal observation mode image processing unit 62 indicates the biological information of the observation target using the special image alone or using the special image and the normal image. Generate biometric information images. The biological information image is the aforementioned blood vessel image, oxygen saturation image, color difference expansion image, etc., and is generated by performing analysis processing on a special image. The normal observation mode image processing unit 62 inputs the generated biological information image to the display control unit 60. The biological information image is converted into a display video signal by the display control unit 60 and displayed on the display 18. The biological information image is displayed superimposed on the observation image or side by side with the observation image.

Note that the recognition process may be performed on a normal image, a special image, or a biometric information image. The recognition process includes a detection process that detects a region of interest such as a lesion, and a discrimination process that discriminates the type and stage (grade) of the lesion. Further, the discrimination process includes a process performed on the region of interest and a process performed on the entire image to be subjected to the recognition process.

In the recognition process, for example, an endoscopic image is divided into a plurality of small regions, and image feature amounts are calculated from the divided endoscopic images. Then, in the detection process, it is determined whether each small region is a lesion based on the calculated feature amount, a group of regions identified as the same type is extracted as one lesion, and the extracted lesion is The area containing the area is detected as the area of interest. In addition, in the discrimination process, the type and/or degree of the lesion is determined based on the detected region of interest, the feature amount within the region of interest, and the aspect (position, size, shape, etc.) of the region of interest. (stage) is determined. Judgments in the recognition processing (detection processing, discrimination processing) described above are preferably performed by a machine learning algorithm such as a convolutional neural network or deep learning.

Similar to the normal observation mode image processing unit 62, the detailed observation mode image processing unit 64 outputs the biological information image generated from the normal image and the special image to the display control unit 60 and displays it on the display 18 (see FIG. 3). .

Further, as shown in FIG. 4, the detailed observation mode image processing unit 64 encodes the normal image and the special image as a moving image, and stores (records) the moving image in the storage device 66. Then, based on instructions for playback, rewinding, etc., the stored (recorded) moving image is read out from the storage device 66 and decoded. The decoded normal image is displayed on the display 18 via the display control unit 60. On the other hand, the decoded special image is subjected to analysis processing to generate a biometric information image, and the biometric information image is displayed on the display 18 via the display control unit 60. Note that recognition processing can also be performed on a normal image, special image, or biological information image in the detailed observation mode. The recognition process may be performed on images before recording, or may be performed when playing back recorded images.

In this manner, in the detailed observation mode, it is possible to record normal images and special images, and perform more detailed observation while playing back, rewinding, etc. the biological information image generated using the normal images and special images. However, in general, the frame rate (imaging frequency) of special images is set lower than that of normal images, and the number of frames of special images is small compared to the number of frames of normal images, so it is difficult to detect the presence of special images. There is a problem that the desired information cannot be obtained (desired biometric information image cannot be generated) without doing so. Furthermore, if the frame rate of the special image is increased in order to prevent such a problem, the frame rate of the normal image will be lowered, which will have an adverse effect on the observation of the normal image.

Therefore, in the present invention, the above-mentioned imaging control section 50 switches the frame rate between the normal image and the special image depending on the observation mode. Hereinafter, the relationship between the observation mode and the frame rate of the normal image and special image will be specifically explained using FIGS. 5 and 6.

Note that in the following description, a case will be described in which six types of special light are used as the special light. In the following description, the normal light will be referred to as "normal light N," or simply "N," and the six types of special light will be referred to as "special lights S1 to S6, or simply S1 to S6." Furthermore, in the following description, a normal image, that is, an endoscopic image captured by irradiating normal light N, will be referred to as a "normal image NP, or simply NP." In addition, the endoscopic image captured by irradiating the special light S1 is "special image SP1," or simply SP1, and the endoscopic image captured by irradiating the special light S2 is "special image SP2, or simply SP2." The endoscopic image captured by irradiating the special light S3 is referred to as "special image SP3," or simply SP3, and the endoscopic image captured by irradiating the special light S4 is referred to as "special image SP4," or simply SP4, special light. The endoscopic image captured by irradiating the light S5 will be referred to as a "special image SP5," or simply SP5, and the endoscopic image captured by irradiating the special light S6 will be referred to as a "special image SP6, or simply SP6."

As shown in FIG. 5, when the observation mode is the normal observation mode, the photographing control unit 50 changes the normal light N and the special lights S1 to S6 to "N, N, N, N, N, S1, N, N , N, N, N, S2, N, N, N, N, N, S3, N, N, N, N, N, S4, N, N, N, N, N, S5, N, N, N , N, N, S6" and images are taken in accordance with the irradiation of each illumination light. The irradiation period of each illumination light is 1/60 (second), and imaging is performed 60 times per second. As a result, "NP, NP, NP, NP, NP, SP1, NP, NP, NP, NP, NP, SP2, NP, NP, NP, NP, NP, SP3, NP, NP, NP, NP, NP, Endoscopic images (normal image N and special images SP1 to SP6) are captured in the order of ``SP4, NP, NP, NP, NP, NP, SP5, NP, NP, NP, NP, NP, SP6''.

Thus, in the normal observation mode, the normal image capturing frequency is high (50 times per second). Therefore, the movement of the normal image is smooth and easy to observe. In particular, in the normal observation mode, while changing the position and/or direction of the camera (the distal end 12d of the insertion section 12a), the extraction (pickup) of a suspected lesion (site that should be observed in more detail) is performed. This is usually done while observing the image. Therefore, as in this example, it is effective to set the normal image capturing frequency to be high in the normal observation mode to facilitate observation.

On the other hand, as shown in FIG. 6, when the observation mode is the detailed observation mode, the imaging control unit 50 controls the normal light N and the special lights S1 to S3 in the order of "N, S1, N, S2, N, S3". The images are taken in accordance with the irradiation of each illumination light. In this case, as in the normal observation mode described above, the irradiation period of each illumination light is 1/60 (second), and imaging is performed 60 times per second. As a result, endoscopic images (normal image N and special images SP1 to SP3) are captured in the order of "NP, SP1, NP, SP2, NP, SP3".

In this way, in the detailed observation mode, the imaging frequency of the normal image NP is lowered compared to the normal observation mode (reduced from 50 times per second to 30 times per second). However, the detailed observation mode is a mode for observing in more detail the region extracted (picked up) in the normal observation mode, and changes in the position and/or orientation of the camera (the distal end 12d of the insertion section 12a) are not performed in the normal observation mode. less compared to Therefore, it is unlikely to be adversely affected by a decrease in imaging frequency.

Furthermore, in the detailed observation mode, the total imaging frequency of special images SP1 to SP6 is increased compared to the normal observation mode. Specifically, the total imaging frequency of special images SP1 to SP6 is 10 times per second in the normal observation mode, but increases to 30 times per second in the detailed observation mode. More specifically, the imaging frequency of special images SP1 to SP3 has increased from 3/5 times per second to 10 times, and the imaging frequency of special images SP4 to SP6 has increased from 3/5 times per second to 0 times. However, overall, the frequency of capturing special images has increased from 10 times per second to 30 times per second.

That is, in this embodiment, the special light includes multiple types of special light (in this embodiment, special lights S1 to S6) whose emission spectra are different from each other, and the special image includes multiple types of special light. The detailed observation mode includes a plurality of corresponding special images (special SP1 to SP6 in this embodiment), and in the detailed observation mode, some of the plurality of special images (in this embodiment) are For SP1 to SP3), the imaging frequency is increased compared to the normal observation mode.

On the other hand, in this embodiment, in the detailed observation mode, some special images (SP3 to SP6 in this embodiment) other than the above-mentioned part of the special images (SP1 to SP3 in this embodiment) are normally Although the imaging frequency is lower than in the observation mode, the overall imaging frequency of special images SP1 to SP6 is increased compared to the normal observation mode.

In this way, in the detailed observation mode, the frequency of capturing special images (special images SP1 to SP3 in this embodiment) is increased compared to the normal mode. Therefore, in the detailed observation mode, these special images and the biological information images generated using these special images move smoothly and are easy to observe. In addition, there is no need to obtain necessary information because the image you want to check does not exist. As mentioned above, the detailed observation mode is a mode for observing in detail the parts extracted (picked up) in the normal observation mode, and in the detailed observation mode, not only the normal image NP but also special images and special images are used. Detailed observation is performed while observing the generated biological information image. For this reason, it is effective to set the special image capturing frequency to be high in the detailed observation mode, as in this example. In particular, in detailed observation mode, not only endoscopic images obtained in real time but also recorded endoscopic images are referred to, so by setting the special image capturing frequency to be high, you can more accurately obtain the necessary information. can be obtained.

In the above embodiment, six types of special lights S1 to S6 are provided as special lights, and the explanation has been given using an example in which special images SP1 to SP6 are captured as special images, but there are five types of special lights and special images. The number of types may be less than or equal to seven types, or may be seven or more types.

Further, in the above embodiment, an example has been described in which the frequency of capturing special images SP1 to SP3 is increased in the detailed observation mode compared to the normal observation mode. Furthermore, the rate of increase in the frequency of photographing can be freely set. For example, the imaging frequency of only one of the special images SP1 to SP6 may be increased. Furthermore, the frequency of capturing all of the special images SP1 to SP6 may be increased. Furthermore, the rate of increase in the imaging frequency may be set individually for each special image, such as increasing the imaging frequency by 10 times for the special image SP1 and increasing the imaging frequency by 5 times for the special image SP2. .

Furthermore, in the above embodiment, an example was explained in which the imaging frequency of special images SP4 to SP6 is reduced in the detailed observation mode compared to the normal observation mode, but the type and/or number of special images whose imaging frequency is reduced, Furthermore, the rate of decrease in the frequency of photographing can be freely set. Additionally, special images that reduce the frequency of shooting may be abolished. Further, the user may specify the type and/or number of special images for which the imaging frequency is to be changed (increased or decreased), and the rate of change (increase or decrease rate) in the imaging frequency.

In the above embodiment, the light source control unit 21, the image sensor control unit 45, the image capture control unit 50, the DPS 52, the noise reduction unit 54, the image processing unit 58, the normal observation mode image processing unit 62, the detailed observation mode image processing unit 64, the center The hardware structure of a processing unit that executes various processes, such as the control unit 68, is the following various processors. Various types of processors include CPUs (Central Processing Units) and FPGAs (Field Programmable Gate Arrays), which are general-purpose processors that execute software (programs) and function as various processing units.The circuit configuration is changed after manufacturing. These include a programmable logic device (PLD), which is a capable processor, and a dedicated electric circuit, which is a processor having a circuit configuration specially designed to execute various types of processing.

One processing unit may be composed of one of these various types of processors, or may be composed of a combination of two or more processors of the same type or different types (for example, multiple FPGAs or a combination of a CPU and an FPGA). may be done. Further, the plurality of processing units may be configured with one processor. As an example of configuring multiple processing units with one processor, first, as typified by computers such as clients and servers, one processor is configured with a combination of one or more CPUs and software, There is a form in which this processor functions as a plurality of processing units. Second, there are processors that use a single IC (Integrated Circuit) chip to implement the functions of an entire system including multiple processing units, as typified by System On Chip (SoC). be. In this way, various processing units are configured using one or more of the various processors described above as a hardware structure.

Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit (circuitry) in the form of a combination of circuit elements such as semiconductor elements. Further, the hardware structure of the storage unit is a storage device such as an HDD (hard disc drive) or an SSD (solid state drive).

10 Endoscope system 12 Endoscope 12a Insertion section 12b Operation section 12c Curved section 12d Tip section 12f Mode changeover switch 12g Procedure support information presentation switch 12h Still image acquisition instruction section 12i Zoom operation section 14 Light source device 16 Processor device 18 Display 19 U.I.
20 Light source section 21 Light source control section 23 Optical path coupling section 25 Light guide 30a Illumination optical system 30b Imaging optical system 32 Illumination lens 42 Objective lens 43 Zoom lens 44 Image sensor 45 Image sensor control section 46 CDS/AGC circuit 48 A/D converter 50 Imaging control unit 52 DSP
54 Noise reduction section 58 Image processing section 60 Display control section 62 Normal observation mode image processing section 64 Detailed observation mode image processing section 66 Storage device 68 Central control section 69 Memory N Normal light NP Normal images S1 to S6 Special light SP1 to SP6 Special image

Claims (10)

A normal observation mode in which an endoscopic image output from an endoscope is displayed on a display, and a normal observation mode in which the endoscopic image is displayed on the display, and the endoscopic image is recorded as a moving image, based on a reproduction instruction. A processor device that switches between a plurality of types of observation modes, including a detailed observation mode in which a moving image recorded by a camera is played back and displayed on the display,
The imaging control processor is
Normal imaging involves irradiating an observation target with normal light to capture a normal image as the endoscopic image, and normal imaging involves irradiating the observation target with special light that has a different emission spectrum from the normal light to capture the endoscopic image. Perform special imaging to capture a special image,
A processor device that switches the imaging frequency of the normal image and the imaging frequency of the special image according to the type of the observation mode. The processor device according to claim 1, wherein in the detailed observation mode, the frequency of capturing the normal images is lowered compared to the normal observation mode. 3. The processor device according to claim 1, wherein in the detailed observation mode, the frequency of capturing the special image is increased compared to the normal observation mode. The special light includes multiple types of special light with different emission spectra,
The special images include multiple types of special images corresponding to the multiple types of special light,
4. The processor device according to claim 3, wherein in the detailed observation mode, the frequency of imaging is increased for some special images of the plurality of types of special images compared to the normal observation mode. . 5. The processor device according to claim 4, wherein in the detailed observation mode, the imaging frequency of some special images other than the some special images is lowered than in the normal observation mode. generating a biological information image displaying biological information of the observation target using the special image;
The processor device according to claim 1 , wherein the generated biometric information image is displayed on the display. The processor device according to claim 6, wherein the biological information image is an oxygen saturation image indicating the oxygen saturation of blood hemoglobin. The processor device according to claim 6 or 7, wherein the biological information image is a blood vessel image showing a blood vessel at a specific depth. The processor device according to any one of claims 6 to 8, wherein the biological information image is a color difference expansion image that expands the color difference of each range for each of a plurality of ranges set in the special image. A normal observation mode in which an endoscopic image output from an endoscope is displayed on a display, and a normal observation mode in which the endoscopic image is displayed on the display, and the endoscopic image is recorded as a moving image, based on a reproduction instruction. A method for operating a processor device that switches between multiple types of observation modes, including a detailed observation mode in which a moving image recorded by a camera is played back and displayed on the display,
The imaging control processor is
Normal imaging in which normal light illumination is controlled to capture a normal image as the endoscopic image; and special light illumination with a different emission spectrum from the normal light is controlled to capture a special image as the endoscopic image. special imaging and
An operating method of a processor device, wherein the frequency of capturing the normal image and the frequency of capturing the special image are switched depending on the type of the observation mode.

Images