JP2013022219A - Image signal processor, imaging system, and electronic endoscope system - Google Patents

Image signal processor, imaging system, and electronic endoscope system Download PDF

Info

Publication number
JP2013022219A
JP2013022219A JP2011159479A JP2011159479A JP2013022219A JP 2013022219 A JP2013022219 A JP 2013022219A JP 2011159479 A JP2011159479 A JP 2011159479A JP 2011159479 A JP2011159479 A JP 2011159479A JP 2013022219 A JP2013022219 A JP 2013022219A
Authority
JP
Japan
Prior art keywords
image
light
color matrix
types
narrowband
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
JP2011159479A
Other languages
Japanese (ja)
Inventor
Ayaka Yokouchi
文香 横内
Original Assignee
Hoya Corp
Hoya株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hoya Corp, Hoya株式会社 filed Critical Hoya Corp
Priority to JP2011159479A priority Critical patent/JP2013022219A/en
Publication of JP2013022219A publication Critical patent/JP2013022219A/en
Withdrawn legal-status Critical Current

Links

Images

Abstract

PROBLEM TO BE SOLVED: To solve the problem that the contrast of a narrow-band light image of a displayed object in an image signal processor to display an object with plural kinds of images different in display patterns is low.SOLUTION: The image signal processor includes an image signal input means where an image signal is input from an imaging device imaging the object illuminated with a predetermined narrow-band light, a display mode designation means for designating a display mode for the photographed object from plural kinds of display modes, a color matrix coefficient storage means for storing plural kinds of matrix coefficients used on each display mode, a color matrix coefficient acquirement means for acquiring the plural kinds of color matrix coefficients corresponding to the designated display mode from the color matrix coefficient storage means, a color conversion processing means for respectively performing the different color conversion processing on the image signal by using the each acquired color matrix coefficient, and a composite image generation means for synthesizing the signals respectively on which the different color conversion processing has been performed and to generate a composite image where the images corresponding to respective image signals are arranged on a screen surface.

Description

  The present invention relates to an image signal processing apparatus that processes an image signal so that it can be displayed on a monitor. Specifically, the present invention is suitable for displaying narrowband light images of various specific structures included in an observation visual field on a display screen of a monitor. The present invention relates to an image signal processing device, an imaging system, and an electronic endoscope system.
  In the medical device field, an electronic endoscope system is known that generates and displays an enhanced image (narrowband light image) of a specific part in a body cavity by irradiating the body cavity with narrowband light. A specific configuration example of this type of electronic endoscope system is described in Patent Document 1.
  The electronic endoscope system described in Patent Document 1 is compatible with a frame sequential method in which optical filters such as a B filter (narrowband optical filter), a G filter (broadband optical filter), and an R filter (wideband optical filter) are arranged, for example. The rotation filter is provided. The video processor artificially converts a narrowband B image signal into a wideband B image signal, and generates a normal light (white light) image using the converted B image signal and the broadband G and R image signals. . Further, the video processor performs a predetermined color conversion process on the RGB image signals to generate a narrowband light image. One of the normal light image and the narrow-band light image is displayed on the display screen of the monitor, or both are simultaneously displayed on one screen.
JP 2008-43604 A
  Thus, in the electronic endoscope system described in Patent Document 1, the G and R filters have broadband spectral characteristics in order to generate a normal light image in a pseudo manner. However, since the G and R filters have broadband spectral characteristics, there is a detrimental effect that the contrast of the narrowband light image is lowered.
  An image signal processing apparatus according to an aspect of the present invention that solves the above-described problem is captured by an image signal input unit that inputs an image signal from an imaging apparatus that captures a subject irradiated with a predetermined narrowband light. Corresponding to the specified display mode, a display mode specifying means for specifying the display mode of the subject from a plurality of display modes, a color matrix coefficient storing means for storing a plurality of types of color matrix coefficients used in each display mode Color matrix coefficient acquisition means for acquiring a plurality of types of color matrix coefficients from the color matrix coefficient storage means, and color conversion processing execution means for performing different color conversion processing on the image signal using each of the acquired color matrix coefficients And each image signal that has undergone different color conversion processing is combined to display an image corresponding to each image signal in one screen. Is a device which is characterized by having a composite image generating means for generating a placement is the composite image.
  According to the image signal processing apparatus of the present invention, a plurality of different types of color conversion processes are performed on subject images captured using a narrowband optical filter having a transmission peak with a narrow half-value width in a specific wavelength range. Therefore, high-contrast narrowband light images having different specific structures are displayed on one screen. The surgeon can make a multifaceted diagnosis of a subject such as a living tissue by comparatively observing a plurality of types of narrowband light images displayed on one screen.
  The image signal processing apparatus according to the present invention may include a narrowband light irradiating unit that irradiates a subject with predetermined narrowband light through a light guide included in the imaging apparatus.
  The narrow-band light irradiating means may be configured to selectively irradiate a subject with a plurality of types of narrow-band light having different spectral characteristics through a light guide. The color matrix coefficient storage means may store a plurality of types of color matrix coefficients used in a plurality of types of display modes separately associated with each narrowband light. In this case, the color matrix coefficient acquisition means stores a plurality of types of color matrix coefficients corresponding to the designated display mode among the plurality of types of display modes associated with the narrowband light currently irradiated on the subject. It is good also as a structure acquired from a means.
  The narrow-band light irradiating means includes any one of a light source that emits predetermined broadband light, a plurality of types of narrow-band optical filters that split the broadband light into narrow-band light having different spectral characteristics, and a plurality of types of narrow-band optical filters. It is also possible to have a configuration having filter designating means for designating one of them and filter placement means for placing the designated narrowband optical filter in the optical path of the broadband light.
  An imaging system according to an aspect of the present invention that solves the above-described problem is a narrow-band light irradiation unit that irradiates a subject with predetermined narrow-band light, and generates an image signal by photographing the subject irradiated with the narrow-band light. Photographing means, display mode designating means for designating a display mode of the photographed subject from a plurality of types of display modes, and a color matrix coefficient storage means for storing a plurality of types of color matrix coefficients used in each display mode A color matrix coefficient acquisition unit that acquires a plurality of types of color matrix coefficients corresponding to a designated display mode from a color matrix coefficient storage unit, and a different color conversion for an image signal using each acquired color matrix coefficient The color conversion processing execution means for performing processing and the respective image signals subjected to different color conversion processing are combined to correspond to the respective image signals. Image is a system that is characterized by having a composite image generating means for generating a composite image are arranged side by side in a single screen.
  In addition, an electronic endoscope system according to an embodiment of the present invention that solves the above-described problems is a system including the image signal processing device and an electronic endoscope that is a predetermined imaging device.
  An electronic endoscope system according to another aspect of the present invention that solves the above problems is an embodiment of the imaging system, and includes narrowband light irradiation means, display mode designation means, color matrix coefficient storage means, A system having a processor having color matrix coefficient acquisition means, color conversion processing execution means, and composite image generation means, and an electronic endoscope having photographing means.
  According to the present invention, by applying a plurality of different types of color conversion processing to subject images captured using a narrowband optical filter having a transmission peak with a narrow half-value width in a specific wavelength range, high contrast is obtained. Provided are an image signal processing device, an imaging system, and an electronic endoscope system capable of displaying narrow-band optical images having different specific structures in one screen.
It is a block diagram which shows the structure of the electronic endoscope system which concerns on embodiment of this invention. It is a figure which shows the structure of the rotary filter turret mounted in the processor which the electronic endoscope system which concerns on embodiment of this invention has. It is a figure which shows the spectral characteristic of each optical filter of the rotary filter turret which concerns on embodiment of this invention. It is a figure which shows the flowchart of the endoscopic image observation process which concerns on embodiment of this invention. It is a figure which illustrates notionally the color conversion process by the color conversion circuit mounted in the processor which concerns on embodiment of this invention. It is a figure for demonstrating that the specific structure of the biological body highlighted on the display screen of a monitor in every embodiment of this invention differs for every color matrix coefficient applied by a color conversion process. It is a figure which shows the example of a display screen of the narrow-band optical image in embodiment of this invention. It is a figure which shows the example of a display screen of the narrow-band optical image in another embodiment.
  Hereinafter, an electronic endoscope system according to an embodiment of the present invention will be described with reference to the drawings.
  FIG. 1 is a block diagram illustrating a configuration of an electronic endoscope system 1 according to the present embodiment. As shown in FIG. 1, the electronic endoscope system 1 is a medical imaging system, and includes an electronic scope 100, a processor 200, and a monitor 300. The proximal end of the electronic scope 100 is connected to the processor 200. The processor 200 integrally includes an image signal processing device that processes an image signal output from the electronic scope 100 to generate an image, and a light source device that illuminates a body cavity that does not reach natural light via the electronic scope 100. It is. In another embodiment, the image signal processing device and the light source device may be configured separately.
  As illustrated in FIG. 1, the processor 200 includes a system controller 202 and a timing controller 204. The system controller 202 controls each element constituting the electronic endoscope system 1. The timing controller 204 outputs a clock pulse for adjusting the signal processing timing to each circuit in the electronic endoscope system 1.
  The lamp 208 radiates light in a wavelength range mainly extending from the visible light region to the invisible infrared region after being started by the lamp power igniter 206. As the lamp 208, a high-intensity lamp such as a xenon lamp, a halogen lamp, a mercury lamp, or a metal halide lamp is suitable. The illumination light emitted from the lamp 208 is condensed by the condenser lens 210 and is limited to an appropriate amount of light through the diaphragm 212.
  A motor 214 is mechanically connected to the diaphragm 212 via a transmission mechanism such as an arm or a gear (not shown). The motor 214 is a DC motor, for example, and is driven under the drive control of the driver 216. The diaphragm 212 is operated by the motor 214 to change the opening degree so that the image displayed on the display screen of the monitor 300 has an appropriate brightness, and the amount of illumination light emitted from the lamp 208 is changed to the opening degree. Limit accordingly. The appropriate reference for the brightness of the image is changed according to the brightness adjustment operation performed by the operator on the front panel 218 or the hand operation unit (not shown) of the electronic scope 100.
  Various forms of the configuration of the front panel 218 are assumed. As a specific configuration example of the front panel 218, a hardware key for each function mounted on the front surface of the processor 200, a touch panel GUI (Graphical User Interface), a combination of a hardware key and a GUI, and the like are assumed. .
  Irradiation light that has passed through the aperture 212 enters the rotary filter turret 213. FIG. 2 is a diagram showing a configuration of the rotary filter turret 213. As shown in FIG. 2, the rotary filter turret 213 has a plurality of optical filters F1 to F3 and an aperture AP arranged in the circumferential direction. The aperture AP is an aperture to which no optical filter is attached. The aperture AP may be replaced with a filter that transmits light in the entire visible light region.
  FIG. 3 shows an example of the spectral characteristics of the optical filters F1 to F3. In FIG. 3, the vertical axis represents spectral transmittance (no unit because it is normalized), and the horizontal axis represents wavelength (unit: nm). As shown in FIG. 3, the optical filter F1 is a narrow-band optical filter having a transmission peak with a narrow half-value width in three wavelength regions. The optical filter F2 is, for example, a narrow band optical filter having a transmission peak with a narrow half-value width in a wavelength range suitable for absorption of hemoglobin. The optical filter F3 is a narrow-band optical filter having a transmission peak with a narrow half-value width in a wavelength range corresponding to a specific structure (for example, a gastric duct structure or the like) different from the optical filter F2. Each narrow-band optical filter has, for example, detection (a filter with spectral characteristics suitable for finding a lesion from a wide range in a body cavity) and a probe (spectrum characteristics suitable for examining a found lesion). Etc.) may be provided for each application.
  The motor 215 is a step motor that is driven, for example, under the drive control of the driver 216, and is mechanically coupled to the rotary filter turret 213 via a transmission mechanism such as an arm or a gear (not shown). The motor 215 rotates the rotary filter turret 213 by an angle corresponding to the applied voltage (pulse).
  The surgeon can rotate the rotary filter turret 213 through the filter switching operation on the front panel 218 or the operation of the filter switching button 114 installed in the hand operation unit of the electronic scope 100. In FIG. 1, the connection between the filter switching button 114 (and the display mode switching button 116 described later) and other blocks is omitted to simplify the drawing.
  The rotary filter turret 213 rotates 90 ° each time a filter switching operation is performed, and is arranged by selectively inserting the optical filters F1, F2, F3, and the aperture AP into the illumination optical path. In the vicinity of the outer peripheral edge of the rotary filter turret 213, a position detection hole H for detecting the home position is formed. Based on the detection of the position detection hole H through the photo interrupter FI and the number of pulses applied to the motor 215, the system controller 202 recognizes which optical filter or aperture AP is inserted and arranged in the illumination optical path.
  The irradiation light is split into specific narrowband light by an optical filter (any one of F1 to F3) arranged in the illumination optical path, and enters an incident end of an LCB (Light Carrying Bundle) 102. When the aperture AP is disposed in the illumination optical path, the irradiation light that has passed through the stop 212 (that is, broadband light including the visible light region) is directly incident on the incident end of the LCB 102.
  Irradiation light incident on the incident end of the LCB 102 propagates by repeating total reflection in the LCB 102. Irradiation light propagating through the LCB 102 is emitted from the emission end of the LCB 102 disposed at the tip of the electronic scope 100. Irradiation light emitted from the exit end of the LCB 102 irradiates the subject via the light distribution lens 104. The reflected light from the subject forms an optical image at each pixel on the light receiving surface of the solid-state image sensor 108 via the objective lens 106.
  The solid-state image sensor 108 is, for example, an interlaced single-plate color CCD (Charge Coupled Device) image sensor having a complementary color checkered pixel arrangement. The solid-state image sensor 108 accumulates an optical image formed by each pixel on the light receiving surface as a charge corresponding to the amount of light, and obtains an image signal corresponding to each complementary color of yellow Ye, cyan Cy, green G, and magenta Mg. .
  The solid-state imaging device 108 generates and outputs mixed signals Wr, Gb, Wb, and Gr by adding image signals of two pixels adjacent in the vertical direction in order to substantially improve sensitivity and frame rate. The mixed signals Wr, Gb, Wb, and Gr are input to the endoscope side signal processing circuit 112 after being amplified by the preamplifier 110. Note that the color array of the solid-state image sensor 108 may be, for example, a Bayer type. Further, the solid-state image sensor 108 may be replaced with a CMOS (Complementary Metal Oxide Semiconductor) image sensor.
  The timing controller 204 supplies clock pulses to the endoscope side signal processing circuit 112 according to the timing control by the system controller 202. The endoscope side signal processing circuit 112 controls driving of the solid-state imaging device 108 at a timing synchronized with a frame rate of a video processed on the processor 200 side, according to a clock pulse supplied from the timing controller 204.
  The image signal input to the endoscope side signal processing circuit 112 is subjected to AD conversion after predetermined analog signal processing and input to the processor side signal processing circuit 220.
  The processor-side signal processing circuit 220 includes a color conversion circuit 222, a memory 224, and an image processing circuit 226. The color conversion circuit 222 converts an image signal (complementary color signal (MGYC)) input to the processor side signal processing circuit 220 into a primary color signal (RGB) using a predetermined color matrix coefficient stored in the memory 224, and performs image processing. Output to the circuit 226. The image processing circuit 226 performs predetermined image processing such as γ correction and edge enhancement on the input primary color signal, and buffers each color signal in a frame memory (not shown) corresponding to each color of R, G, and B for each frame. Ring. The image processing circuit 226 sweeps out each buffered color signal from the frame memory at a timing controlled by the timing controller 204 and conforms to a predetermined standard such as NTSC (National Television System Committee) or PAL (Phase Alternating Line). Convert to video signal. By sequentially inputting the converted video signals to the monitor 300, the image of the subject is displayed on the display screen of the monitor 300.
  An image of the subject is displayed on the display screen of the monitor 300 in a form corresponding to the display mode, for example. The display mode is changed according to the display mode setting operation performed on the front panel 218 by the surgeon or the operation of the display mode switching button 116 installed on the hand operation unit of the electronic scope 100.
  The surgeon can set various different display modes for each optical filter inserted and arranged in the illumination optical path. Specifically, the surgeon selects and sets a plurality of types of display modes for highlighting different specific structures corresponding to the spectral characteristics of the optical filter F1 during the period in which the optical filter F1 is disposed in the illumination optical path. Can do. During the period in which the optical filters F2 and F3 are arranged in the illumination optical path, a plurality of types of display modes for highlighting different specific structures corresponding to the spectral characteristics of the optical filters F2 and F3 can be selected and set. .
  The memory 224 stores color matrix coefficients used in a plurality of types of display modes associated with the optical filters F1 to F3. For convenience of explanation, symbols M11 to M1n are attached to n kinds of color matrix coefficients used in each display mode related to the optical filter F1, and symbols M21 are assigned to m kinds of color matrix coefficients used in each display mode related to the optical filter F2. To M2m, and symbols M31 to M31 are added to l kinds of color matrix coefficients used in each display mode according to the optical filter F3.
(Endoscopic image observation processing)
FIG. 4 shows a flowchart of endoscopic image observation processing according to the embodiment of the present invention. In the endoscopic image observation process, the subject is displayed in a form corresponding to a normal color image or display mode. Execution of the endoscope image observation process is started when the electronic endoscope system 1 is activated or when a filter switching operation is performed on the front panel 218 or the filter switching button 114. If a filter switching operation is performed during the execution of the endoscopic image observation process, the endoscopic image observation process is forcibly returned to the process of S1. For convenience of explanation, the processing step is abbreviated as “S” in the explanation and drawings in this specification.
<S1 in FIG. 4 (Filter Determination Processing)>
The system controller 202 recognizes which optical filter or aperture AP is inserted and arranged in the illumination optical path based on the detection of the position detection hole H through the photo interrupter FI and the number of pulses applied to the motor 215. Note that when the electronic endoscope system 1 is activated, the aperture AP is inserted into the illumination optical path. Specifically, the system controller 202 detects the position detection hole H by rotating the rotary filter turret 213 through drive control with respect to the motor 215 when the system is started, and the opening AP is inserted into the illumination optical path. Thus, the rotary filter turret 213 is rotated by a predetermined angle from the detection position of the hole H.
  When the aperture AP is disposed in the illumination optical path (S1: NO), the system controller 202 advances the process to S2. If any one of the optical filters F1 to F3 is disposed in the illumination optical path (S1: YES), the process proceeds to S3.
<S2 in FIG. 4 (Normal Color Image Generation Processing)>
Since the aperture AP is disposed in the illumination optical path, the subject is irradiated with broadband light including a visible light region. The solid-state image sensor 108 receives reflected light from the subject irradiated with broadband light and converts it into an image signal. The image signal is output to the monitor 300 through signal processing in each of the preamplifier 110, the endoscope side signal processing circuit 112, and the processor side signal processing circuit 220. As a result, a normal color image of the subject is displayed on the display screen of the monitor 300, and the processing of this flowchart ends. The display of a normal color image on the display screen continues until, for example, the system of the electronic endoscope system 1 is stopped or a filter switching operation is performed.
<S3 in FIG. 4 (Narrowband Optical Image Generation Processing)>
Since any one of the optical filters F1 to F3 is arranged in the illumination optical path (hereinafter, for convenience of explanation, the optical filter currently arranged in the illumination optical path is referred to as “optical path arrangement filter”), the optical path arrangement is applied to the subject. Narrow band light corresponding to the spectral characteristics of the filter is irradiated. The solid-state image sensor 108 receives the reflected light from the subject irradiated with the narrow-band light and converts it into an image signal. The image signal is input to the processor side signal processing circuit 220 through signal processing in each circuit of the preamplifier 110 and the endoscope side signal processing circuit 112.
  In accordance with a predetermined control signal from the system controller 202, the color conversion circuit 222 has two types of color matrix coefficients specified by the optical path arrangement filter and the currently set display mode (referred to as “set display mode” for convenience). Are selected from the color matrix coefficient group in the memory 224. The color conversion circuit 222 performs two types of color conversion processing on the image signal from the endoscope-side signal processing circuit 112 using each selected color matrix coefficient. The two types of image signals IS 1 and IS 2 after the color conversion process are input to the image processing circuit 226.
  For example, consider a case where the optical path arrangement filter is the optical filter F1. In this case, the color conversion circuit 222 selects two types of color matrix coefficients corresponding to the setting display mode from among the color matrix coefficients M11 to M1n associated with the optical filter F1 in accordance with a predetermined control signal from the system controller 202. A color matrix coefficient group in the memory 224 is selected and used to perform two kinds of color conversion processing.
  The image processing circuit 226 performs predetermined image processing such as γ correction and edge enhancement on the image signals IS1 and IS2, and synthesizes the image signals after image processing to generate images corresponding to the image signals IS1 and IS2. An image signal forming one composite image arranged side by side in one screen is generated. The image processing circuit 226 buffers the generated image signal in the frame memory, converts it into a video signal at a predetermined timing, and outputs it to the monitor 300.
  FIGS. 7A and 7B are diagrams showing examples of display screens of narrowband light images on the monitor 300. FIG. For convenience of explanation, the narrowband light image based on the image signal IS1 is referred to as “narrowband light image IS1”, and the narrowband light image based on the image signal IS2 is referred to as “narrowband light image IS2”. As shown in FIG. 7A, the display screen of the monitor 300 includes two types of subjects that are narrowband light images corresponding to the setting display mode and have the same (observation field of view and photographing time are the same). Narrow band optical images are simultaneously displayed on one screen. Note that immediately after the filter switching operation, the default display mode corresponding to the optical path arrangement filter after switching is the setting display mode.
  The layout of the narrow-band light image IS1 and the narrow-band light image IS2 can be changed according to the layout switching operation on the front operation unit 218 or the hand operation unit of the electronic scope 100 by the operator. FIG. 7B shows an example of the screen display of the narrowband light image IS1 and the narrowband light image IS2 after the layout switching. In the screen display example of FIG. 7B, the narrowband light image IS1 is a main screen (parent screen), and the narrowband light image IS2 is a subscreen (child screen). The narrow-band light image IS2 is superimposed and displayed on the upper right area of the narrow-band light image IS1 that is displayed largely as the main screen.
<S4 in FIG. 4 (Display Mode Switching Standby Process)>
The system controller 202 waits for execution of a display mode switching operation on the front panel 218 or the display mode switching button 116. During standby, for example, the display of the narrow-band light image corresponding to the setting display mode (S3 in FIG. 4) is continued. When the display mode switching operation is performed (S4: YES), the system controller 202 advances the process to S5.
<S5 in FIG. 4 (Narrowband Optical Image Generation Processing After Switching Display Mode)>
In accordance with a predetermined control signal from the system controller 202, the color conversion circuit 222 newly adds two types of color matrix coefficients specified by the optical path arrangement filter and the switched setting display mode from the color matrix coefficient group in the memory 224. The two color conversion processes are performed using the selected color matrix coefficients. Therefore, the narrowband light image IS1 and the narrowband light image IS2 corresponding to the setting display mode after switching are displayed on the display screen of the monitor 300. After the process of S5, the process of this flowchart returns to S4. The display of the narrow-band light image after the display mode switching on the display screen is continued until, for example, the system of the electronic endoscope system 1 is stopped or a filter switching operation or a display mode switching operation is performed.
  Here, FIGS. 5A and 5B are conceptual diagrams of color conversion processing by the color conversion circuit 222. FIG. The left diagram in FIG. 5A shows the intensity distribution P of the mixed signals Wr, Gb, Wb, Gr, and the central diagram in FIG. 5A shows the optical filter of the rotary filter turret 213 arranged in the illumination optical path. The spectral characteristic F of the optical filter F1 (here, the optical filter F1) is shown, and the right figure of FIG. The intensity distribution P is a wavelength and intensity calculated when spectral characteristics corresponding to two pixels adjacent to each other in the vertical direction of the on-chip color filter of the solid-state image sensor 108 are applied to a two-pixel addition processing formula. It is a distribution showing the relationship. FIG. 5B shows an intensity distribution P ′ indicating the relationship between the wavelength and the intensity obtained as a result of multiplying the intensity distribution P, the spectral characteristic F, and the color matrix coefficient M of FIG.
  In the present embodiment, the intensity distribution P ′ is changed by changing at least one of the spectral characteristic F and the color matrix coefficient M shown in FIG. 5A, and the living body highlighted on the display screen of the monitor 300 is displayed. Change the specific structure. Therefore, the color conversion circuit 222 uses two different color matrix coefficients M in order to highlight two different specific structures for the same observation target (highlight the same observation target in two different forms). The color conversion process that was performed is performed.
  FIGS. 6A and 6B are diagrams for explaining that the specific structure of the living body highlighted on the display screen of the monitor 300 is different for each color matrix coefficient applied in the color conversion process. . As shown in FIG. 6A, the depth of irradiation light depends on the wavelength. Specifically, as the wavelength of the irradiation light is longer, the depth of penetration becomes deeper, so that it is possible to observe deep biological structures.
  Two kinds of color matrix coefficients M applied in the color conversion process emphasize the short wavelength component and the long wavelength component in the intensity distribution of the subject image obtained by multiplying the intensity distribution P and the spectral characteristic F, respectively. Consider the case where it is designed. In this case, the enhanced image generated by applying the former color matrix coefficient M is, for example, an image that emphasizes a shallow subject image (here, a shallow blood vessel) (shallow layer in FIG. 6B). A), and the enhanced image generated by applying the latter color matrix coefficient M is, for example, an image in which a deep subject image (here, a deep blood vessel) is emphasized (deep layer B in FIG. 6B). It becomes. In the example of FIG. 6B, the blood vessel images of the shallow layer and the deep layer in the same observation visual field are displayed in one screen.
For example, the following combinations of display modes are assumed for the narrow-band light image IS1 and the narrow-band light image IS2. The combination of display forms can be freely set by the operator through operation of the front panel 218, for example. A pseudo normal color image can be generated when the three transmission peaks of the optical filter F1 are arranged in the B band, the G band, and the R band.
・ Setting display mode A
(Narrow band light images IS1, IS2) = (pseudo normal color image, blood vessel enhanced image)
Observation site suitable for setting display mode A ... Esophageal etc. Setting display mode B
(Narrowband light images IS1, IS2) = (Enhanced image of surface structure, enhanced image of deep blood vessels)
Observation site suitable for setting display mode B ... stomach etc. Setting display mode C
(Narrowband light images IS1, IS2) = (Pseudo normal color image, emphasis image of shallow blood vessel)
Observation site suitable for setting display mode C ... stomach etc. Setting display mode D
(Narrow band light images IS1, IS2) = (pseudo normal color image, surface structure enhanced image)
Observation site suitable for setting display mode D: stomach, etc.
  According to the present embodiment, the same observation object is displayed in one screen as two different types of narrow-band light images, so that the diagnostic ability is improved. The surgeon can make a multifaceted diagnosis of the living body by comparatively observing two types of narrow-band light images displayed in one screen. Further, since each narrowband light image is generated using a narrowband optical filter having a transmission peak with a narrow half-value width in a specific wavelength region, the disadvantage of reducing the contrast of the narrowband light image is effectively avoided.
  Further, according to the present embodiment, a plurality of types of display modes for highlighting different specific structures are associated with one type of optical filter that splits illumination light. Unlike the electronic endoscope system described in Patent Document 1 in which the display form of the subject is limited to two predetermined types (normal light image and one type of narrowband light image), the operator observes by switching the display mode. Various specific structures included in the visual field can be observed. Therefore, oversight of important biological information can be suitably prevented.
  Further, the spectral characteristic F shown in FIG. 5A is changed by operating the front panel 218 or the filter switching button 114 to switch the optical path arrangement filter. That is, changing the specific structure of the living body highlighted on the display screen of the monitor 300 (changing the intensity distribution P ′) is also achieved by switching the optical path arrangement filter. For example, when observing a specific structure that is difficult to be highlighted with the spectral characteristics of the optical filter F1, the surgeon switches the optical path arrangement filter to the optical filter F2 or F3, and displays suitable for highlighting the specific structure. Set the mode. As a result, it is possible to display a narrowband light image having a specific structure that is difficult to highlight with the spectral characteristics of the optical filter F1 on the display screen of the monitor 300.
  The above is the description of the embodiment of the present invention. The present invention is not limited to the above-described configuration, and various modifications can be made within the scope of the technical idea of the present invention. For example, in another embodiment, three or more kinds of narrowband light images may be displayed on one screen.
  FIGS. 8A and 8B are diagrams illustrating examples of a display screen of a narrowband light image in another embodiment. In another embodiment, the color conversion circuit 222 converts the three types of color matrix coefficients specified by the optical path arrangement filter and the setting display mode according to a predetermined control signal from the system controller 202 to the color matrix coefficient group in the memory 224. A selection is made from among the three color conversion processes using the selected color matrix coefficients. Therefore, as shown in FIG. 8A, three types of narrowband light images IS1 to IS3 are displayed on the display screen of the monitor 300. Note that the layout of the narrowband light images IS1 to IS3 can be changed to, for example, the layout shown in FIG. 8B according to the layout switching operation on the front operation unit 218 or the hand operation unit of the electronic scope 100 by the operator. In another embodiment, the number of types of narrow-band light images to be displayed in one screen is one, two, or four or more through the operator's operation of the front panel 218 or the hand operation unit of the electronic scope 100. It can be changed appropriately.
DESCRIPTION OF SYMBOLS 1 Electronic endoscope system 100 Electronic scope 200 Processor 220 Processor side signal processing circuit 222 Color conversion circuit 224 Memory 226 Image processing circuit 300 Monitor

Claims (9)

  1. An image signal input means for inputting an image signal from an imaging device that images a subject irradiated with a predetermined narrowband light;
    Display mode designating means for designating a display mode of the photographed subject from a plurality of display modes;
    Color matrix coefficient storage means for storing a plurality of types of color matrix coefficients used in each of the display modes;
    Color matrix coefficient acquisition means for acquiring a plurality of types of color matrix coefficients corresponding to the designated display mode from the color matrix coefficient storage means;
    Color conversion processing execution means for performing different color conversion processing on the image signal using each of the acquired color matrix coefficients;
    A synthesized image generating means for synthesizing the image signals subjected to different color conversion processes and generating a synthesized image in which images corresponding to the image signals are arranged in one screen;
    An image signal processing apparatus comprising:
  2. The image signal processing apparatus according to claim 1, further comprising a narrowband light irradiating unit configured to irradiate the subject with the predetermined narrowband light through a light guide included in the imaging apparatus.
  3. The narrowband light irradiation means selectively irradiates the subject with a plurality of types of narrowband light having different spectral characteristics through the light guide,
    The color matrix coefficient storage means stores a plurality of types of color matrix coefficients used in a plurality of types of display modes separately associated with each narrowband light,
    The color matrix coefficient acquisition means obtains a plurality of types of color matrix coefficients corresponding to the designated display mode among a plurality of types of display modes associated with the narrowband light currently irradiated on the subject. The image signal processing apparatus according to claim 2, wherein the image signal processing apparatus is obtained from a storage unit.
  4. The narrow-band light irradiation means includes
    A light source that emits predetermined broadband light;
    A plurality of types of narrowband optical filters that split the broadband light into narrowband light having different spectral characteristics, and
    Filter designating means for designating any one of the plurality of types of narrowband optical filters;
    Filter placement means for placing the designated narrowband optical filter in the optical path of the broadband light;
    The image signal processing apparatus according to claim 3, further comprising:
  5. Narrow-band light irradiation means for irradiating a subject with predetermined narrow-band light;
    Photographing means for photographing the subject irradiated with the narrow-band light and generating an image signal;
    Display mode designating means for designating a display mode of the photographed subject from a plurality of display modes;
    Color matrix coefficient storage means for storing a plurality of types of color matrix coefficients used in each of the display modes;
    Color matrix coefficient acquisition means for acquiring a plurality of types of color matrix coefficients corresponding to the designated display mode from the color matrix coefficient storage means;
    Color conversion processing execution means for performing different color conversion processing on the image signal using each of the acquired color matrix coefficients;
    A synthesized image generating means for synthesizing the image signals subjected to different color conversion processes and generating a synthesized image in which images corresponding to the image signals are arranged in one screen;
    An imaging system comprising:
  6. The narrowband light irradiation means selectively irradiates the subject with a plurality of types of narrowband light each having different spectral characteristics,
    The color matrix coefficient storage means stores a plurality of types of color matrix coefficients used in a plurality of types of display modes separately associated with each narrowband light,
    The color matrix coefficient acquisition means obtains a plurality of types of color matrix coefficients corresponding to the designated display mode among a plurality of types of display modes associated with the narrowband light currently irradiated on the subject. The imaging system according to claim 5, wherein the imaging system is obtained from a storage unit.
  7. The narrow-band light irradiation means includes
    A light source that emits predetermined broadband light;
    A plurality of types of narrowband optical filters that split the broadband light into narrowband light having different spectral characteristics, and
    Filter designating means for designating any one of the plurality of types of narrowband optical filters;
    Filter placement means for placing the designated narrowband optical filter in the optical path of the broadband light;
    The imaging system according to claim 6, further comprising:
  8. The image signal processing device according to any one of claims 1 to 4,
    An electronic endoscope as the imaging device;
    An electronic endoscope system comprising:
  9. The imaging system according to any one of claims 5 to 7,
    A processor having the narrowband light irradiation means, the display mode designation means, the color matrix coefficient storage means, the color matrix coefficient acquisition means, the color conversion processing execution means, and the composite image generation means;
    An electronic endoscope having the imaging means;
    An electronic endoscope system comprising:
JP2011159479A 2011-07-21 2011-07-21 Image signal processor, imaging system, and electronic endoscope system Withdrawn JP2013022219A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2011159479A JP2013022219A (en) 2011-07-21 2011-07-21 Image signal processor, imaging system, and electronic endoscope system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2011159479A JP2013022219A (en) 2011-07-21 2011-07-21 Image signal processor, imaging system, and electronic endoscope system

Publications (1)

Publication Number Publication Date
JP2013022219A true JP2013022219A (en) 2013-02-04

Family

ID=47781235

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2011159479A Withdrawn JP2013022219A (en) 2011-07-21 2011-07-21 Image signal processor, imaging system, and electronic endoscope system

Country Status (1)

Country Link
JP (1) JP2013022219A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015217084A (en) * 2014-05-16 2015-12-07 Hoya株式会社 Video processing device and endoscope system
JP2015223249A (en) * 2014-05-27 2015-12-14 Hoya株式会社 Processor for endoscope
JP2016214941A (en) * 2016-09-12 2016-12-22 富士フイルム株式会社 Endoscope system and operating method thereof
US9943554B2 (en) 2006-07-10 2018-04-17 Synapsin Pharmaceuticals, Inc. Compositions and methods relating to solenopsins and their uses in treating neurological disorders and enhancing physical performance
JP2018158159A (en) * 2018-07-11 2018-10-11 Hoya株式会社 Endoscope system
JP2019055290A (en) * 2018-12-27 2019-04-11 Hoya株式会社 Processor and endoscope system

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9943554B2 (en) 2006-07-10 2018-04-17 Synapsin Pharmaceuticals, Inc. Compositions and methods relating to solenopsins and their uses in treating neurological disorders and enhancing physical performance
JP2015217084A (en) * 2014-05-16 2015-12-07 Hoya株式会社 Video processing device and endoscope system
JP2015223249A (en) * 2014-05-27 2015-12-14 Hoya株式会社 Processor for endoscope
JP2016214941A (en) * 2016-09-12 2016-12-22 富士フイルム株式会社 Endoscope system and operating method thereof
JP2018158159A (en) * 2018-07-11 2018-10-11 Hoya株式会社 Endoscope system
JP2019055290A (en) * 2018-12-27 2019-04-11 Hoya株式会社 Processor and endoscope system

Similar Documents

Publication Publication Date Title
JP5435916B2 (en) Electronic endoscope system
JP2011250926A (en) Electronic endoscope system
US20120241620A1 (en) Optical control device, control device, and optical scope
JP2013022219A (en) Image signal processor, imaging system, and electronic endoscope system
JP5631764B2 (en) Endoscope system and operating method thereof
JP2007244681A (en) Biometric instrument
JP5997817B2 (en) Endoscope system
US20150272422A1 (en) Endoscope system, processor device, and method for operating endoscope system
WO2011099322A1 (en) Electronic endoscope system
WO2016110984A1 (en) Image processing device, method for operating image processing device, program for operating image processing device, and endoscope device
JP2004024656A (en) Fluorescent endoscope equipment
WO2016084257A1 (en) Endoscope apparatus
JP2017131559A (en) Medical imaging device, medical image acquisition system, and endoscope apparatus
JP2013013589A (en) Image signal processor, imaging system, and electronic endoscope system
JP2010184047A (en) Endoscope, endoscope driving method, and endoscope system
US20180220052A1 (en) Temporal Modulation of Fluorescence Imaging Color Channel for Improved Surgical Discrimination
JP5922955B2 (en) Electronic endoscope system
JP5509233B2 (en) Electronic endoscope apparatus and method for operating the same
JP2017158840A (en) Endoscopic image signal processing apparatus and method, and program
JP5981056B2 (en) Endoscope device
JP2013005981A (en) Light source device and imaging system
JP2011177532A (en) Endoscope apparatus
JP2019055290A (en) Processor and endoscope system
JP6071508B2 (en) Electronic endoscope system
JP2021149558A (en) Medical image processing device, medical observation system, and image processing method

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20130510

A300 Withdrawal of application because of no request for examination

Free format text: JAPANESE INTERMEDIATE CODE: A300

Effective date: 20141007