JP2009273824A - Processor apparatus for endoscope - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To suppress a cost increase and enhance a function without applying much processing load to a CPU. <P>SOLUTION: A digital image processing circuit 35 has a standard image processing section 60, a function enhancement I/F 61, and an extension image processing section 62. The standard image processing section 60 consists of a programmable integrated circuit. The standard image processing section 60 has a register region 63 having setting data related to a transfer control of the function enhancement I/F 61. The standard image processing section 60 performs the transfer control of the function enhancement I/F 61 based on the setting data. The function enhancement I/F 61 has data bus 64 for inputting/outputting image data for outputting moving image of an endoscopic image. The function enhancement I/F 61 intermediates the image data exchange between the standard image processing section 60 and the extension image processing section 62. The extension image processing section 62 receives the image data from the standard image processing section 60 via the function enhancement I/F 61 and the data bus 64, processes the image and returns the processed image data to the standard image processing section 60. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an endoscope processor device including image processing means for generating an endoscope image.

  Conventionally, examination using an endoscope, for example, an electronic endoscope, has been widely used in the medical field. The electronic endoscope has a solid-state imaging device such as a CCD image sensor at the tip of an insertion portion to be inserted into a subject. The electronic endoscope is connected to an endoscope processor device (hereinafter abbreviated as a processor device) via a cord and a connector. The processor device performs various processes on the imaging signal output from the solid-state imaging device, and generates an endoscopic image for diagnosis. The endoscopic image is displayed on a monitor connected to the processor device.

  The processor device forms image data from the image signal, and further processes image processing such as noise reduction, blur correction, color correction, and white balance correction, or special scaling such as electronic scaling, contour enhancement, and color enhancement on the formed image data. Perform image processing. The processor device also hides the invalid pixel area of the endoscopic image and displays only the effective pixel area, character information such as examination date and time, or patient and examiner information, graphical user interface (GUI) User Interface) is synthesized with the endoscopic image, and display control processing for the display screen of the endoscopic image is performed.

In the processor device, in order to execute the above-described image data formation and image processing, a dedicated image processing circuit is provided in addition to the CPU that comprehensively controls the entire device. For example, a programmable integrated circuit such as an FPGA (Field Programmable Gate Array) is used as the image processing circuit (see Patent Document 1). The programmable integrated circuit does not need to design a unique circuit for executing image data formation or image processing, and the logic circuit can be freely rewritten by reading a logic circuit program stored in advance. This process can be executed on a single chip. In addition, the logic circuit can be easily changed in accordance with the specifications of the processor device. Therefore, the development cost of the apparatus can be reduced as compared with the case of developing a non-programmable integrated circuit that performs a plurality of types of processing.
JP 2005-342147 A

  Incidentally, in recent years, image processing functions required for processor devices tend to be diversified. If all the various image processing functions are to be mounted on the standard image processing circuit, the cost of the processor device increases. Therefore, only the basic functions are implemented in the standard image processing circuit, and for other functions, a function expansion interface is provided so that new circuits can be added as needed. It is being considered.

  In a processor device controlled by a CPU, a method of providing a function expansion interface connected to the CPU via a CPU bus can be considered. However, in this method, the CPU must perform data transfer control on the CPU bus. For this reason, if the amount of data transferred is large, the processing load on the CPU increases. In particular, when expanding a function relating to moving image output of an endoscopic image, since a large amount of data is transferred per unit time, a high processing capability is required for the CPU. If a CPU with high processing capability is installed, the above problem can be solved, but there is a new problem that the cost of components increases and the cost of the processor device increases.

  In addition, an output for outputting a video signal from the image processing circuit so that a plurality of types of monitors such as a monitor corresponding to a digital video signal and a monitor compatible with an analog video signal can be connected to the processor device. Some have multiple dedicated data buses. Data transfer control of the output dedicated data bus is performed by an image processing circuit. For this reason, if a function expansion interface is provided via an output-only data bus, an increase in the processing load on the CPU can be avoided. However, when expanding a new image processing function, it is necessary to return processed image data from the extension circuit to the standard image processing circuit, and therefore, a method using an output-dedicated data bus cannot be adopted.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to realize a function expansion related to moving image output of an endoscopic image without suppressing a cost increase and placing a processing burden on the CPU. .

  In order to achieve the above object, an endoscopic processor device according to the present invention is an image processing unit provided separately from a control unit that performs overall control of the entire device, and outputs an image signal output from a solid-state image sensor. First image processing means for performing image processing to generate an endoscopic image, and a data bus for inputting / outputting image data for outputting a moving image of the endoscopic image to / from the first image processing means And a function expansion interface in which transfer of image data is controlled by the first image processing means.

  The function expansion interface includes second image processing means for executing image processing different from image processing by the first image processing means, or auxiliary processing of image processing by the first image processing means. Connected.

  A medical image generation device that generates a medical image different from the endoscopic image is connected to the function expansion interface. The function expansion interface functions as a communication interface for inputting medical image data from the medical image generation apparatus to the first image processing means.

  The function expansion interface is connected to display control means for performing display control processing on the display screen of the endoscopic image.

  The first image processing means includes a programmable integrated circuit that can rewrite a logic circuit by reading a logic circuit program. The programmable integrated circuit has a register area for holding setting data related to transfer control of the function expansion interface. The programmable integrated circuit is, for example, an FPGA (Field Programmable Gate Array), a CPLD (Complex Programmable Logic Device), or the like.

  According to the present invention, there is provided a data bus for inputting and outputting image data for outputting a moving image of an endoscopic image to and from the first image processing means, and transfer control of the image data is performed by the first image processing means. Therefore, it is possible to realize functional expansion related to moving image output of an endoscopic image without suppressing a cost increase and processing load on the CPU.

  In FIG. 1, the endoscope system 2 includes an electronic endoscope 10, a processor device 11, and a light source device 12. As is well known, the electronic endoscope 10 includes a flexible insertion portion 13 that is inserted into a body cavity of a patient, an operation portion 14 that is connected to a proximal end portion of the insertion portion 13, a processor device 11, and a light source. A connector 15 connected to the apparatus 12, an operation unit 14, and a universal cord 16 that connects the connectors 15 are included.

  An observation window 20, an illumination window 21 (both see FIG. 2) and the like are provided at the distal end of the insertion portion 13. In the back of the observation window 20, a solid-state image sensor 23 for intra-body cavity imaging is disposed via an objective optical system 22 (see FIG. 2 for both). The illumination window 21 irradiates the observation site with illumination light from the light source 53 guided by the light guide 53 disposed in the universal cord 16 or the insertion portion 13 and the illumination lens 24 (both see FIG. 2). To do.

  The operation unit 14 includes an angle knob for bending the distal end of the insertion unit 13 in the vertical and horizontal directions, an air / water feed button for ejecting air and water from the distal end of the insertion unit 13, and an endoscopic image. A release button or the like for recording a still image is provided.

  Further, a forceps port through which a treatment tool such as an electric knife is inserted is provided on the distal end side of the operation unit 14. The forceps opening communicates with a forceps outlet provided at the distal end of the insertion portion 13 through a forceps channel in the insertion portion 13.

  The processor device 11 is electrically connected to the light source device 12 and comprehensively controls the operation of the endoscope system 2. The processor device 11 supplies power to the electronic endoscope 10 via the universal cord 16 or a transmission cable inserted into the insertion portion 13 and controls the driving of the solid-state imaging device 23. In addition, the processor device 11 receives the imaging signal output from the solid-state imaging device 23 via the transmission cable, and performs various processes on the received imaging signal to generate image data. The image data generated by the processor device 11 is displayed as an endoscopic image on a monitor 17 connected to the processor device 11 by a cable.

  In FIG. 2, the electronic endoscope 10 includes the observation window 20, the illumination window 21, the objective optical system 22, the solid-state imaging device 23, and the illumination lens 24 provided at the distal end of the insertion unit 13. (Hereinafter abbreviated as AFE) 25 is provided in the operation unit 14.

  The solid-state image sensor 23 is composed of an interline transfer type CCD image sensor, a CMOS image sensor, or the like. The solid-state imaging device 23 is arranged so that image light of an observation site in the body cavity that passes through the observation window 20 and the objective optical system 22 (consisting of a lens group and a prism) is incident on the imaging surface. On the imaging surface of the solid-state imaging device 23, a color filter composed of a plurality of color segments (for example, a primary color filter with a Bayer array) is formed.

  The AFE 25 includes a correlated double sampling circuit (hereinafter abbreviated as CDS) 26, an automatic gain control circuit (hereinafter abbreviated as AGC) 27, and an analog / digital converter (hereinafter abbreviated as A / D) 28. Yes. The CDS 26 performs correlated double sampling processing on the image signal output from the solid-state image sensor 23, and removes reset noise and amplifier noise generated in the solid-state image sensor 23. The AGC 27 amplifies the imaging signal from which noise has been removed by the CDS 26 with a gain (amplification factor) specified by the processor device 11. The A / D 28 converts the imaging signal amplified by the AGC 27 into a digital signal having a predetermined number of bits. The imaging signal digitized by the A / D 28 is input to the processor device 11 via the universal code 16 and the connector 15.

  The processor device 11 includes a sub CPU 30 that controls the operation of the electronic endoscope 10, a timing generator (hereinafter abbreviated as TG) 31 that generates various timing pulses, and an insulating device for isolating the electronic endoscope 10 from the processor device 11. It has an isolation device 32 composed of a photocoupler and the like, and a main CPU 33 that controls the overall operation of the processor unit 11. The sub CPU 30 and TG 31 and the main CPU 33 are mounted on different substrates with the isolation device 32 as a boundary.

  After the electronic endoscope 10 and the processor device 11 are connected, the sub CPU 30 drives the TG 31 based on an operation start instruction from the main CPU 33 and adjusts the gain of the AGC 27.

  The TG 31 generates a driving pulse (vertical / horizontal scanning pulse, reset pulse, etc.) for the solid-state imaging device 23 and a synchronization pulse for the AFE 25. A pulse generated by the TG 31 is input to the electronic endoscope 10 via the connector 15 and the universal cord 16. The solid-state imaging device 23 performs an imaging operation according to the drive pulse from the TG 31 and outputs an imaging signal. Each unit 26 to 28 of the AFE 25 operates based on a synchronization pulse from the TG 31. Further, the TG 31 supplies a synchronization pulse for signal processing to each unit such as the main CPU 33 via the isolation device 32.

  The imaging signal output from the AFE 25 is temporarily stored in a working memory (not shown) of a digital signal processing circuit (hereinafter abbreviated as DSP) 34.

  The DSP 34 reads out the imaging signal from the AFE 25 from the work memory. The DSP 34 performs various signal processing such as color separation, color interpolation, gain correction, white balance adjustment, and gamma correction on the read imaging signal to generate image data. The image data generated by the DSP 34 is temporarily stored in a working memory (not shown) of a digital image processing circuit (hereinafter abbreviated as DIP) 35.

  In FIG. 3, the DIP 35 includes a standard image processing unit 60, a function expansion interface (hereinafter abbreviated as I / F) 61, and an additional image processing unit 62. The standard image processing unit 60 is existing hardware provided as a standard in the processor device 11. The standard image processing unit 60 includes a programmable integrated circuit that can rewrite a logic circuit by reading a logic circuit program, such as an FPGA (Field Programmable Gate Array), a CPLD (Complex Programmable Logic Device), or the like. The standard image processing unit 60 reads the image data processed by the DSP 34 from the work memory. The standard image processing unit 60 performs various types of image processing such as electronic scaling, color enhancement, edge enhancement, spectral characteristic extraction, and the like on the read image data.

  The standard image processing unit 60 is provided with a register area 63 that holds setting data related to transfer control of the function expansion I / F 61. The standard image processing unit 60 writes the setting data output from the main CPU 33 in the register area 63. The standard image processing unit 60 performs transfer control of the function expansion I / F 61 based on the setting data written in the register area 63.

  The function expansion I / F 61 is connected to the standard image processing unit 60 via the data bus 64. The data bus 64 mediates transfer of endoscopic image moving images and still image output image data. The transfer of the image data by the function expansion I / F 61 is controlled by the standard image processing unit 60 as described above.

  The additional image processing unit 62 includes a programmable integrated circuit similar to the standard image processing unit 60 or a non-programmable integrated circuit in which the logic circuit cannot be rewritten. The additional image processing unit 62 is a function retrofitted to the processor device 11 for performing image processing (for example, pattern extraction) different from the standard image processing unit 60 or auxiliary processing of image processing by the standard image processing unit 60. It is hardware for expansion.

  The additional image processing unit 62 receives the image data from the standard image processing unit 60 through the function expansion I / F 61 and the data bus 64 and performs image processing. The additional image processing unit 62 returns the processed image data to the standard image processing unit 60 through the function expansion I / F 61 and the data bus 64 again.

  The standard image processing unit 60 receives image data for outputting a still image (capture image) of an endoscopic image from the main CPU 33. A captured image is an endoscopic image recorded on a removable medium (to be described later) by a still image recording operation.

  Returning to FIG. 2, the display control circuit 36 has a VRAM that stores processed image data from the DIP 35 for two frames. The display control circuit 36 receives graphic data from the main CPU 33. The graphic data includes a display mask that hides the ineffective pixel area of the endoscopic image and displays only the effective pixel area, character information such as examination date and time, or patient and examiner information, a graphical user interface (GUI). Interface). The display control circuit 36 performs various display control processes on the image data from the DIP 35 such as a display mask, character information, a GUI composition process, and a drawing process on the display screen of the monitor 17.

  The display control circuit 36 reads image data from the VRAM and converts the read image data into a video signal (component signal, composite signal, etc.) corresponding to the display format of the monitor 17. Thereby, an endoscopic image is displayed on the monitor 17.

  Note that a plurality of types of display control circuits 36 and standard image processing units 60 are actually provided for high-resolution monitors and low-resolution monitors.

  The main CPU 33 is connected to each unit via a data bus 37 and an address bus and control lines (not shown). In addition to the above-described sub CPU 30, a ROM 38, a RAM 39, and an operation unit 40 are connected to the main CPU 33. The ROM 38 stores various programs (such as an operating system) and data (such as the setting data and graphic data described above) for controlling the operation of the processor device 11. The main CPU 33 reads necessary programs and data from the ROM 38, develops them in the RAM 39, which is a working memory, and sequentially processes the read programs.

  The operation unit 40 is an operation panel provided on the housing of the processor device 11 or a known input device such as a mouse or a keyboard. The main CPU 33 operates each unit in response to an operation signal from the operation unit 40.

  In addition to the above, the processor device 11 includes a compression processing circuit that performs image compression on image data in a predetermined compression format (for example, JPEG format), and the compressed image data as a CF card or magneto-optical disk (MO). And a network I / F for controlling transmission of various data to and from a network such as a LAN. These are connected to the main CPU 33 via the data bus 37.

  The light source device 12 includes a light source 50 formed of a xenon lamp or a halogen lamp. The light source 50 is driven by a light source driver 51. The condensing lens 52 condenses the illumination light emitted from the light source 50 and guides it to the incident end of the light guide 53. The CPU 54 communicates with the main CPU 33 of the processor device 11 and controls the light source driver 51. The illumination light guided to the incident end of the light guide 53 is collected by the illumination lens 24 and is irradiated to the site to be observed in the body cavity via the illumination window 21.

  Next, the operation of the endoscope system 2 configured as described above will be described. When observing the inside of a patient's body cavity with the electronic endoscope 10, the examiner connects the electronic endoscope 10 and the devices 11 and 12 and turns on the power of the devices 11 and 12. And the operation part 40 is operated, the information regarding a patient, etc. are input, and the test | inspection start is instruct | indicated.

  After instructing the start of the examination, the examiner inserts the insertion unit 13 into the body cavity and monitors the endoscopic image in the body cavity by the solid-state imaging device 23 while illuminating the body cavity with the illumination light from the light source device 12. Observe at 17.

  The imaging signal output from the solid-state imaging device 23 is subjected to various processes by the units 26 to 28 of the AFE 25 and then input to the DSP 34 of the processor device 11. In the DSP 34, various signal processes are performed on the input image pickup signal to generate image data. The image data generated by the DSP 34 is output to the DIP 35.

  In the DIP 35, various image processing is performed on the image data by the image processing units 60 and 62. At this time, image data is exchanged between the image processing units 60 and 62 through the function expansion I / F 61 and the data bus 64. The transfer control of the image data of the function expansion I / F 61 is performed by the standard image processing unit 60 based on the setting data held in the register area 63.

  The image data processed by the DIP 35 is input to the display control circuit 36. In the display control circuit 36, various display control processes are executed in accordance with the graphic data from the main CPU 33. Thereby, the image data is displayed on the monitor 17 as an endoscopic image.

  When the transfer control setting of the function expansion I / F 61 is changed, the setting data in the register area 63 of the standard image processing unit 60 is rewritten.

  As described above, the function expansion I / F 61 having the image data input / output data bus 64 is connected to the standard image processing unit 60 which is a programmable integrated circuit, and the transfer control of the function expansion I / F 61 is standardized. Since it is assigned to the image processing unit 60, the main CPU 33 is not burdened with processing. Therefore, the main CPU 33 does not require a high processing capability, and thus the component cost does not increase.

  It is possible to cope with the addition of hardware having an image data input / output data bus such as the additional image processing unit 62. Further, the transfer control setting of the function expansion I / F 61 can be easily changed by simply rewriting the setting data in the register area 63.

  In the above-described embodiment, the additional image processing unit 62 is connected to the function expansion I / F 61, and image processing different from the standard image processing unit 60 or auxiliary processing of image processing by the standard image processing unit 60 is performed. Although it is made to bear to the part 62, this invention is not limited to this.

  In FIG. 4, the function expansion I / F 61 mediates data exchange with the medical image generation apparatus 70. The medical image generation apparatus 70 includes an image processing unit 71 and a communication I / F 72. For example, the medical image generation apparatus 70 is connected to an ultrasonic probe, and an ultrasonic observation apparatus that generates an ultrasonic image as a medical image, and a fluorescent endoscope that is connected to a fluorescent endoscope and generates a fluorescent endoscope image. Processor device or an OCT processor device to which an OCT (Optical Coherence Tomography) probe is connected to generate an OCT image.

  A communication I / F 72 of the medical image generation apparatus 70 is connected to the function expansion I / F 61. The communication I / F 72 transmits medical image data generated by the image processing unit 71 to the function expansion I / F 61 by a communication method compliant with USB, IEEE standards, and RS-232C.

  The medical image data input via the function expansion I / F 61 is transferred to the display control circuit 36 via the standard image processing unit 60. The display control circuit 36 displays the endoscopic image and the medical image side by side based on the image data of the endoscopic image from the standard image processing unit 60 and the data of the medical image from the medical image generation device 70. (Parallel display) Or display control processing such as displaying one image as a parent image and the other as a child image (picture-in-picture display) is executed.

  Since the medical image generated by the medical image generation device 70 is taken in via the function expansion I / F 61 and parallel display and picture-in-picture display are possible, it is not necessary to prepare a monitor separately for each device. User expenses can be reduced. In addition, since various medical images and endoscopic images can be displayed on a single monitor, medical diagnosis proceeds smoothly, and the possibility of new medical diagnosis that could not be performed at present increases.

  As shown in FIG. 5, the extension display control circuit 80 may be connected to the function expansion I / F 61. The additional display control circuit 80 is responsible for processing to display an endoscopic image on a monitor of a display method (for example, HDTV (high vision) method) different from that of the existing monitor 17. The extension display control circuit 80 is hardware retrofitted to the processor device 11, as with the extension image processing unit 62. The additional display control circuit 80 intercepts the image data from the standard image processing unit 60 through the function expansion I / F 61 and the data bus 64, performs display control processing, and displays an endoscopic image on a new monitor.

  Conventional endoscopic image monitors have a relatively low resolution, but recently, there is a tendency to use high-resolution monitors such as the HDTV system. For this reason, if the additional display control circuit 80 is connected to the function expansion I / F 61 as described above, an endoscopic image can be easily displayed on a high-resolution monitor that matches the recent trend.

  In the above embodiment, the electronic endoscope 10 is exemplified as the endoscope, but an ultrasonic endoscope may be used. Moreover, in the said embodiment, although the medical electronic endoscope 10 which makes a patient a subject is illustrated, the industrial thing which uses piping etc. as a subject may be used. Furthermore, in the above-described embodiment, an example in which the processor device 11 and the light source device 12 are separate bodies has been described.

It is an external view which shows the structure of an endoscope system. It is a block diagram which shows the structure of an endoscope system. It is a block diagram which shows the internal structure of a digital image processing circuit, and the flow of data. It is a block diagram which shows another embodiment. It is a block diagram which shows another embodiment.

Explanation of symbols

2 Endoscope System 10 Electronic Endoscope 11 Processor Device 17 Monitor 23 Solid-State Image Sensor 25 Analog Signal Processing Circuit (AFE)
30 Sub CPU
33 Main CPU
34 Digital signal processing circuit (DSP)
35 Digital Image Processing Circuit (DIP)
60 Standard image processing unit 61 Interface for function expansion (I / F for function expansion)
62 Additional Image Processing Unit 63 Register Area 64 Data Bus 70 Medical Image Generation Device 72 Communication Interface (Communication I / F)
80 Additional display control circuit

Claims (5)

Image processing means provided separately from control means for comprehensively controlling the entire apparatus, and first image processing means for generating an endoscopic image by performing image processing on an imaging signal output from a solid-state imaging device When,
For function expansion, which has a data bus for inputting / outputting image data for outputting a moving image of an endoscopic image to / from the first image processing means, and transfer control of the image data is performed by the first image processing means An endoscope processor device comprising an interface.   The function expansion interface includes second image processing means for executing image processing different from image processing by the first image processing means, or auxiliary processing of image processing by the first image processing means. The endoscope processor device according to claim 1, wherein the endoscope processor device is connected.   The function expansion interface is connected to a medical image generation apparatus that generates a medical image different from an endoscopic image, and the function expansion interface is used for medical purposes from the medical image generation apparatus to the first image processing means. The endoscopic processor device according to claim 1, wherein the endoscope processor device functions as a communication interface for inputting image data.   4. The endoscopic processor device according to claim 2, wherein a display control means for performing a display control process for displaying an endoscopic image on a display screen is connected to the function expansion interface. The first image processing means has a programmable integrated circuit capable of rewriting a logic circuit by reading a logic circuit program,
5. The endoscope processor device according to claim 1, wherein the programmable integrated circuit has a register area for holding setting data related to transfer control of the function expansion interface.

Images