JP2010051633A - Processor for electronic endoscope - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily check abnormality of a color balance and easily specify an abnormal section. <P>SOLUTION: In an examination mode, a CPU 50 controls first to fourth switch circuits 57a-57d to display an examination image stored in an examination image storage memory 53 to a monitor 20 via an image display control circuit 52, inputs an image outputted from an image processing circuit 51 as the result of imaging the display screen by an electronic endoscope 10, and the examination image stored in the examination image storage memory 53 in an abnormality determination circuit 54 and allows the abnormality determination circuit 54 to determine the presence/absence of the abnormality of a color balance. When determining that there is abnormality in the color balance, the CPU 50 inputs the image inputted from the electronic endoscope 10 and the image outputted from the image processing circuit 51 in the abnormality determination circuit 54 and allows it to determine the presence/absence of the abnormality of the color balance. When determining that there is no abnormality in the color balance, the CPU allows a user to view the monitor and to input a determination of the presence/absence of the abnormality of the color balance. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a processor device for an electronic endoscope that performs image processing on an image signal obtained by an electronic endoscope (scope) and outputs the processed image signal to a monitor.

  In the medical field, medical diagnosis using an electronic endoscope system is actively performed. An electronic endoscope system includes an electronic endoscope having an insertion portion that is inserted into a body cavity, and an electronic endoscope that is detachably connected. An image signal (from a solid-state imaging device built in the electronic endoscope) (Hereinafter simply referred to as an image), and performs image processing to output an observation image to a monitor. The electronic endoscope system can observe gastrointestinal tract such as esophagus, stomach, small intestine, large intestine, lung trachea and the like by inserting an insertion portion into a body cavity.

  The electronic endoscope system captures an image of a body cavity as a subject and displays it on a monitor. Since the image displayed on the monitor is used for diagnosis, it is desired that the color be as close to the real thing as possible. If a doctor makes a diagnosis in a state where the color balance of the image displayed on the monitor is different from the actual one, there is a possibility of causing a misdiagnosis. In the case of a simple abnormality such as an image not appearing on the monitor, the doctor can easily notice the abnormality, but in the case of an abnormality in the color balance, the doctor hardly recognizes the abnormality.

Patent Document 1 discloses an electronic endoscope system that enables easy color adjustment of the electronic endoscope system. In this electronic endoscope system, first, a reference chart is imaged, and color adjustment from the electronic endoscope to the camera control unit (CCU) in the processor device is performed based on the imaging result. Thereafter, an inspection image is displayed on the monitor, the screen is imaged by an electronic endoscope, and an encoder for converting the image into a display image and color adjustment of the monitor are performed based on the imaging result.
Japanese Patent Laid-Open No. 8-152656

  However, in the electronic endoscope system described in Patent Document 1, in order to check for an abnormality in color balance, first, color adjustment must be performed by imaging a reference chart provided separately from the electronic endoscope system. In addition, there is a problem that it takes time and cannot check without a reference chart.

  Further, in the electronic endoscope system described in Patent Document 1, when the color balance is checked by capturing the inspection image displayed on the monitor without using the reference chart, the electronic endoscope system is used. There is a problem that it is not possible to specify where the abnormality is.

  The present invention has been made in view of the above problems, and provides a processor device for an electronic endoscope that can easily check for an abnormality in color balance and can easily identify an abnormal part. The purpose is to do.

  In order to achieve the above object, an electronic endoscope processor device according to the present invention includes an image processing unit that performs image processing on an image input from an electronic endoscope, and the image processing unit performs image processing. Image display control means for displaying an image on a monitor, storage means for storing an inspection image, determination means for comparing two images to determine whether there is an abnormality in color balance, the image processing means, and the image display control And a switch means for changing a connection state between the determination means, an operation input means for performing an operation input by a user, and controlling the switch means, and displaying an inspection image stored in the storage means as the image display As a result of being displayed on the monitor via the control means and imaging the display screen with the electronic endoscope, an image output from the image processing means and an inspection image stored in the storage means From the electronic endoscope when it is determined that there is an abnormality in the color balance in the first step. A second step in which the input image and the image output from the image processing means are input to the determination means to determine whether or not there is an abnormality in color balance; and color balance is abnormal in the second step A control unit that executes a third step of allowing the user to input a determination of whether or not there is an abnormality in color balance from the operation input unit when the user determines that there is no color balance. ~ Notifying means for notifying the user of the determination result in the third step.

  Note that, when it is determined in the first step that there is no abnormality in color balance, the notification unit preferably notifies a message indicating that there is no abnormality in color balance in the entire system.

  In addition, it is preferable that the notification unit notifies the image processing unit of a message indicating that there is an abnormality in color balance when it is determined in the second step that there is an abnormality in color balance.

  Furthermore, it is preferable that the notification means notifies a message indicating whether the monitor or the electronic endoscope has a color balance abnormality based on the determination result input by the user in the third step. .

  The electronic endoscope processor device of the present invention can easily check for an abnormality in color balance and can easily identify an abnormal part.

  In FIG. 1, an electronic endoscope system 2 includes an electronic endoscope 10, a processor device 11, a light source device 12, and the like. The electronic endoscope 10 is connected to a flexible insertion portion 13 that is inserted into a body cavity, a hand operating portion 14 that is connected to a proximal end portion of the insertion portion 13, a processor device 11, and a light source device 12. Universal cord 15.

  A distal end portion 16 having a built-in CCD type solid-state imaging device 40 (hereinafter simply referred to as CCD 40) (see FIG. 3) is connected to the distal end of the insertion portion 13. Behind the distal end portion 16 is provided a bending portion 17 in which a plurality of bending pieces are connected. The bending portion 17 is bent in the vertical and horizontal directions when the angle knob 18 provided in the hand operation portion 14 is operated and the wire inserted in the insertion portion 13 is pushed and pulled. Thereby, the front-end | tip part 16 is orient | assigned to the desired direction in a body cavity.

  The base end of the universal cord 15 is connected to the connector 19. The connector 19 is of a composite type. The connector 19 is connected to the light source device 12 in addition to the processor device 11.

  The processor device 11 receives an image output from the CCD 40 and performs various signal processing on the received image. The image processed by the processor device 11 is displayed as an observation image on the monitor 20 connected to the processor device 11 with a cable. The processor device 11 is electrically connected to the light source device 12 and comprehensively controls the operation of the electronic endoscope system 2.

  In addition to the forceps port 21 through which various treatment tools having an injection needle, a high-frequency knife and the like are inserted, the air supply / water supply device ( Operation buttons such as an air / water supply button 22 for air / water supply using air or cleaning water supplied from an unillustrated) are provided. In addition, a front panel 23 having various operation buttons including operation buttons for switching between an observation mode for performing normal imaging and an inspection mode for performing color balance inspection is provided on the front surface of the processor device 11. Yes.

  In FIG. 2, an observation window 30, an illumination window 31, a forceps outlet 32, and an air / water supply nozzle 33 are provided on the end surface 16 a of the distal end portion 16. The observation window 30 is disposed at the center on one side of the end face 16a. Two illumination windows 31 are arranged at symmetrical positions with respect to the observation window 30, and irradiate illumination light guided from the light source device 12 through the light guide 65 (see FIG. 3) to the site to be observed in the body cavity. The forceps outlet 32 is connected to a forceps channel (not shown) disposed in the insertion portion 13 and communicates with the forceps port 21 so that the distal end of the treatment tool inserted from the forceps port 21 is exposed. The air / water nozzle 33 ejects cleaning water and air supplied from the air / water supply device toward the observation window 30 in accordance with the operation of the air / water button 22.

  In FIG. 3, a CCD 40 is built in the distal end portion 16 of the electronic endoscope 10, and the CCD 40 is disposed at an imaging position of an objective lens 41 provided to face the observation window 30. The CCD 40 employs a single-plate simultaneous method as a color imaging method, and a color filter composed of a plurality of color segments (for example, a primary color filter with a Bayer arrangement) is disposed on the light receiving surface.

  The TG 42 generates a driving pulse (vertical / horizontal scanning pulse, reset pulse, etc.) for the CCD 40 and a synchronizing pulse for the analog signal processing circuit (AFE) 44 based on the control of the CPU 43. The CCD 40 is driven by a driving pulse input from the TG 42, photoelectrically converts an optical image formed through the objective lens 41, and outputs it as an image.

  The AFE 44 includes a correlated double sampling (CDS) circuit, a programmable gain amplifier (PGA), and an A / D converter. The CDS circuit performs correlated double sampling processing on the image output from the CCD 40 and removes reset noise and amplifier noise generated in the CCD 40. The PGA amplifies the image from which noise has been removed by the CDS circuit at a predetermined amplification factor designated by the CPU 43. The A / D converter digitizes the image amplified by the PGA. The digital image output from the AFE 44 is input into the processor device 11 via the connector 19 described above.

  The CPU 43 communicates with the CPU 50 in the processor device 11 and controls each part in the electronic endoscope 10. Further, a ROM 45 is connected to the CPU 43, and identification information for identifying the type of the electronic endoscope 10 and a color balance inspection result (error information) described later are stored in the ROM 45.

  The processor device 11 includes a CPU 50, an image processing circuit 51, an image display control circuit 52, an inspection image storage memory 53, an abnormality determination circuit 54, an isolator 55, and first to fourth switch circuits 57a to 57d. The CPU 50 controls each part in the processor device 11 and controls the entire electronic endoscope system 2 in an integrated manner. The isolator 55 is an isolation element for isolating the electronic endoscope 10 from the processor device 11. The image output from the AFE 44 is input to the image processing circuit 51 and the first switch circuit 57a via the isolator 55.

  The first switch circuit 57 a is an on / off switch, and is connected between the isolator 55 and the abnormality determination circuit 54. The connection state of the first switch circuit 57a is controlled by the CPU 50, and the first switch circuit 57a is turned off in the observation mode.

  Under the control of the CPU 50, the image processing circuit 51 performs image processing such as color interpolation, color separation, color balance adjustment, gamma correction, and image enhancement processing on the image for one frame input from the AFE 44. The image output from the image processing circuit 51 is input to the second and third switch circuits 57b and 57c.

  The second switch circuit 57b is a switch element that has three terminals A to C and connects the terminal A to the terminal B or the terminal C. The image display control circuit 52 is connected to the terminal A of the second switch circuit 57b, the image processing circuit 51 and the third switch circuit 57c are connected to the terminal B, and the fourth switch circuit is connected to the terminal C. 57d and the inspection image storage memory 53 are connected.

  The third switch circuit 57 c is an on / off switch, and is connected between the terminal B of the second switch circuit 57 b and the abnormality determination circuit 54. The fourth switch circuit 57d is an on / off switch, and is connected between the terminal C of the second switch circuit 57b and the abnormality determination circuit 54. Based on the control of the CPU 50, in the observation mode, the terminal A of the second switch circuit 57b is connected to the terminal B, and the third and fourth switch circuits 57c and 57d are turned off.

  In the observation mode, the image output from the image processing circuit 51 is input to the image display control circuit 52 via the second switch circuit 57b. The image display control circuit 52 converts the image input from the image processing circuit 51 into a display signal for display on the monitor 20 and outputs the display signal to the monitor 20.

  The first to fourth switch circuits 57a to 57d are switched in a predetermined order described later in the inspection mode based on the control of the CPU 50.

  As shown in FIG. 4, the inspection image storage memory 53 has an inspection image 53a represented as a four-color color bar chart in which white (W) is added to red (R), green (G), and blue (B). Is remembered. The inspection image 53a is output to the image display control circuit 52 and the abnormality determination circuit 54 by switching control of the second and fourth switch circuits 57b and 57d in the inspection mode.

  In the inspection mode, the inspection image 53 a is output to the image display control circuit 52 and displayed on the center of the screen of the monitor 20. The inspection image 53 a displayed on the monitor 20 is captured by the electronic endoscope 10. At this time, as shown in FIG. 5, a triangular pyramid-shaped light-shielding jig 70 is fitted so that external light other than the display light of the monitor 20 does not enter the distal end portion 16 of the electronic endoscope 10. The displayed inspection image 53 a is covered with a light shielding jig 70. The inspection image 53 a displayed on the monitor 20 is captured by the CCD 40 in the electronic endoscope 10, subjected to analog signal processing by the AFE 44, and then input to the image processing circuit 51 via the isolator 55.

  The abnormality determination circuit 54 acquires the image output from the image processing circuit 51 via the third switch circuit 57c, and also stores the inspection image 53a stored in the inspection image storage memory 53 via the fourth switch circuit 57d. And comparing the color balances of the two acquired images to determine whether there is an abnormality in the color balance. This comparison determination is performed in consideration of a conversion function by the AFE 44, a conversion function by the image processing circuit 51, a conversion function by the image display control circuit 52, a conversion function by the monitor 20, and the like. The abnormality determination circuit 54 determines whether or not there is a difference equal to or greater than a predetermined threshold in the color balance of both images, and notifies the CPU 50 of the determination result. When receiving the notification from the abnormality determination circuit 54, the CPU 50 controls the image display control circuit 52 to display a message indicating the determination result on the monitor 20. This message is displayed in an area other than the part where the light-shielding jig 70 is attached on the screen of the monitor 20 so that the user can visually recognize it.

  When there is a difference equal to or greater than a predetermined threshold in the color balance between the two images (that is, there is an abnormality in the color balance), the abnormality determination circuit 54 uses the image processing circuit 51 to further identify the abnormal part. By comparing the color balances of the images before and after processing, it is determined whether there is an abnormality in the color balance in the image processing circuit 51. This comparison determination is performed in consideration of the conversion function by the image processing circuit 51. The abnormality determination circuit 54 determines whether there is a difference equal to or greater than a predetermined threshold in the color balance of the images before and after the processing by the image processing circuit 51 and notifies the CPU 50 of the determination result. When receiving the notification from the abnormality determination circuit 54, the CPU 50 controls the image display control circuit 52 to display a message indicating the determination result on the monitor 20. Similarly, this message is displayed in an area other than the part where the light shielding jig 70 is attached on the screen of the monitor 20 so that the user can visually recognize the message.

  The CPU 50 displays a message such as “There is a color balance abnormality in the image processing circuit” on the monitor 20 when there is a difference greater than or equal to a predetermined threshold in the color balance of the images before and after processing by the image processing circuit 51. On the other hand, if the color balance of the images before and after the processing by the image processing circuit 51 is not different from the predetermined threshold value, the CPU 50 has an abnormality in the electronic endoscope 10 or the monitor 20. A message such as “Please visually determine if there is an abnormality in color balance” is displayed on the monitor 20 and a determination input from the user is received via the front panel 23. At this time, the CPU 50 assigns predetermined operation buttons in the front panel 23 to the YES button and the NO button so that the user can input a determination as to whether or not the color balance of the monitor 20 is abnormal. When the YES button is operated and the CPU 50 determines that the monitor 20 has a color balance abnormality, the CPU 50 displays a message such as “There is a color balance abnormality on the monitor” on the monitor 20. On the other hand, when the NO button is operated and the electronic endoscope 10 is determined to have an abnormality in color balance, the CPU 50 displays a message such as “There is an abnormality in color balance in the electronic endoscope” on the monitor 20. . Similarly, these messages are displayed in an area other than the part where the light shielding jig 70 is attached on the screen of the monitor 20 so that the user can visually recognize them. If it is determined that the electronic endoscope 10 has a color balance abnormality, the CPU 50 instructs the CPU 43 of the electronic endoscope 10 to record error information in the ROM 45.

  The light source device 12 includes a CPU 60, a light source 61, a light source driver 62, a diaphragm mechanism 63, and a condenser lens 64. The CPU 60 communicates with the CPU 50 of the processor device 11 and controls the light source driver 62 and the diaphragm mechanism 63. The light source 61 is a xenon lamp, a halogen lamp, or the like, and is driven and controlled by a light source driver 62. The diaphragm mechanism 63 is disposed on the light exit side of the light source 61 and increases or decreases the amount of light incident on the condenser lens 64. The condenser lens 64 condenses the light that has passed through the aperture mechanism 63 and guides it to the incident end of the light guide 65 of the electronic endoscope 10 connected to the light source device 12. The light guide 65 is inserted from the proximal end to the distal end portion 16 of the electronic endoscope 10, and the emission end is connected to each illumination window 31 described above. In the inspection mode, the light emission of the light source 61 is turned off.

  Next, the operation of the electronic endoscope system 2 configured as described above will be described with reference to the flowchart of FIG. When observing the inside of a body cavity using the electronic endoscope system 2, the electronic endoscope 10, the processor device 11, the light source device 12, and the monitor 20 are turned on, and the electronic endoscope 10 is inserted. The section 13 is inserted into the body cavity, and the observation image in the body cavity imaged by the CCD 40 is observed on the monitor 20 while illuminating the body cavity with the illumination light from the light source device 12. In this observation mode, the first, third, and fourth switch circuits 57a, 57c, and 57d are turned off, and the terminal A of the second switch circuit 57b is connected to the terminal B.

  On the other hand, when checking the color balance in the inspection mode, first, the distal end portion 16 of the insertion portion 13 of the electronic endoscope 10 is inserted into the light shielding jig 70 as shown in FIG. The inspection is started by operating the front panel 23 in the state in which the end surface 16a of the distal end portion 16 is opposed to the screen of the monitor 20 to enter the inspection mode (YES in step S1). When entering the inspection mode, first, the switching states of the second to fourth switch circuits 57b to 57d are changed, the terminal A of the second switch circuit 57b is connected to the terminal C, and the third and fourth switch circuits 57c. , 57d are turned on (step S2). As a result, the inspection image 53a is output from the inspection image storage memory 53 to the image display control circuit 52 via the second switch circuit 57b, and as a result, the inspection image 53a is displayed on the monitor 20 (step S3). At this time, the inspection image 53a is input from the inspection image storage memory 53 to the abnormality determination circuit 54 via the fourth switch circuit 57d.

  The inspection image 53a displayed on the monitor 20 is picked up by the CCD 40 in the electronic endoscope 10, subjected to analog signal processing by the AFE 44, and then input to the image processing circuit 51 via the isolator 55 for image processing. (Step S4). At this time, the image subjected to the image processing by the image processing circuit 51 is input to the abnormality determination circuit 54 via the third switch circuit 57c.

  Next, the abnormality determination circuit 54 compares and determines the difference in color balance between the image input from the image processing circuit 51 and the inspection image 53a input from the inspection image storage memory 53 (step S5). If the difference in color balance is smaller than the predetermined threshold (NO in step S6), the CPU 50 displays a message on the monitor 20 indicating that there is no color balance abnormality in the entire system (step S7). On the other hand, when the difference in color balance is equal to or greater than the predetermined threshold (YES in step S6), the switching states of the first switch circuit 57a and the fourth switch circuit 57d are changed, and the first switch circuit 57a is turned on. The fourth switch circuit 57d is turned off (step S8). Thus, in addition to the image input from the image processing circuit 51 via the third switch circuit 57c, the image input from the electronic endoscope 10 is input to the abnormality determination circuit 54 via the first switch circuit 57a. Entered.

  The abnormality determination circuit 54 compares and determines the difference in color balance between the images before and after the processing by the image processing circuit 51 (step S9). If the difference in color balance is equal to or greater than a predetermined threshold (YES in step S10), a message indicating that there is a color balance abnormality in the image processing circuit 51 is displayed on the monitor 20 (step S11). On the other hand, if the difference in color balance is smaller than the predetermined threshold value (NO determination in step S10), a message prompting the user to visually check the monitor 20 and input whether or not there is an abnormality in color balance is displayed on the monitor 20. It is displayed (step S12). At this time, the CPU 50 accepts a judgment input by the user through an operation of the front panel 23.

  When it is determined by the user that the monitor 20 has a color balance abnormality (YES in step S13), a message indicating that the monitor 20 has a color balance abnormality is displayed on the monitor 20 (step S14). ). On the other hand, when the user determines that the electronic endoscope 10 has a color balance abnormality (NO in step S13), a message indicating that the electronic endoscope 10 has a color balance abnormality is displayed. 20 (step S15).

  As described above, according to the present invention, it is possible to easily check whether there is a color balance abnormality by executing the inspection mode. If there is an abnormality, the electronic endoscope 10, the processor device 11, the monitor It is possible to easily identify an abnormal location such as which of 20 is abnormal.

  In the above embodiment, various messages are displayed on the monitor 20 in the inspection mode. However, the present invention is not limited to this, and other notification means such as the front panel 23 are used to notify the message. You can go. Further, a message may be sent to an external device such as a server or printer connected to the electronic endoscope system 2.

  In the above embodiment, a determination input for allowing the user to visually check the monitor 20 to determine whether there is an abnormality in color balance is received from the operation of the front panel 23, but the present invention is limited to this. Instead, it may be configured to accept from an operation input means such as a keyboard connected to the processor device 11.

  In the above-described embodiment, the inspection image 53a represented as a color bar chart of four colors R, G, B, and W is stored in the inspection image storage memory 53. However, the present invention is not limited to this. Instead, any inspection image can be used as long as it is represented by a predetermined color as a reference.

  In addition, the inspection image is not limited to one in which a plurality of colors are included in a single chart, such as a color bar chart, and may be configured by a plurality of single color charts. For example, the inspection image 80 shown in FIG. 7 is composed of four monochrome charts of R, G, B, and W. In this case, the single-color chart may be displayed on the monitor 20 one by one, and the imaging by the electronic endoscope 10 and the comparison determination by the processor device 11 may be sequentially performed.

  In the above embodiment, an electronic endoscope used in the medical field is taken as an example. However, the present invention is not limited to this, and can be applied to an industrial endoscope or the like. is there.

It is an external view which shows an electronic endoscope system. It is a top view which shows the end surface of the front-end | tip part of an electronic endoscope. It is a block diagram which shows the structure of an electronic endoscope system. It is a top view which shows a test | inspection image. It is a schematic diagram which shows a light-shielding jig | tool. It is a flowchart explaining the effect | action at the time of test | inspection mode. It is a figure which shows the modification of a test | inspection image.

Explanation of symbols

2 Electronic endoscope system 10 Electronic endoscope 11 Processor unit 20 Monitor 23 Front panel (operation input means)
40 CCD type solid-state imaging device 50 CPU (control means)
51 Image processing circuit (image processing means)
52 Image display control circuit (image display control means)
53 Inspection image storage memory (storage means)
53a Inspection image 54 Abnormality determination circuit (determination means)
57a to 57d 1st to 4th switch circuit 70 Shading jig 80 Inspection image

Claims (4)

Image processing means for performing image processing on an image input from an electronic endoscope;
Image display control means for displaying an image subjected to image processing by the image processing means on a monitor;
Storage means for storing inspection images;
A determination means for comparing two images to determine the presence or absence of an abnormality in color balance;
Switch means for changing a connection state between the image processing means, the image display control means, and the determination means;
An operation input means for performing an operation input by a user;
As a result of controlling the switch means, displaying the inspection image stored in the storage means on the monitor via the image display control means, and imaging the display screen with the electronic endoscope, the image processing means A first step of inputting the output image and the inspection image stored in the storage unit to the determination unit to execute the determination of the presence / absence of an abnormality in color balance, and abnormal color balance in the first step When it is determined that there is a color balance, the image input from the electronic endoscope and the image output from the image processing unit are input to the determination unit to determine whether there is an abnormality in color balance. When it is determined that there is no abnormality in the color balance in the second step and the second step, the operation input means determines whether there is an abnormality in the color balance by visually observing the display screen of the monitor. And a control means for performing a third step of al input,
Informing means for informing the user of the determination results in the first to third steps;
A processor device for an electronic endoscope, comprising:   2. The notification unit according to claim 1, wherein, when it is determined that there is no abnormality in color balance in the first step, the notification unit notifies a message indicating that there is no abnormality in color balance in the entire system. Processor for electronic endoscope.   2. The notification means notifies a message indicating that there is an abnormality in color balance to the image processing means when it is determined in the second step that there is an abnormality in color balance. Or a processor device for an electronic endoscope according to 2;   The notification means notifies a message indicating which of the monitor and the electronic endoscope has a color balance abnormality based on the determination result input by the user in the third step. The processor device for an electronic endoscope according to any one of claims 1 to 3.

Images